2023-12-12T09:55:50.812 INFO:root:teuthology version: 0.0.1.dev216+g5f3731e 2023-12-12T09:55:50.812 DEBUG:teuthology.run:Teuthology command: teuthology --owner mchangir --archive /home/teuthworker/archive/mchangir-2023-12-12_08:46:52-fs-wip-mchangir-testing-20231205.064351-testing-default-smithi/7488242 --verbose --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} --name mchangir-2023-12-12_08:46:52-fs-wip-mchangir-testing-20231205.064351-testing-default-smithi -- /home/teuthworker/archive/mchangir-2023-12-12_08:46:52-fs-wip-mchangir-testing-20231205.064351-testing-default-smithi/7488242/orig.config.yaml 2023-12-12T09:55:50.855 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T09:55:50.938 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/mchangir-2023-12-12_08:46:52-fs-wip-mchangir-testing-20231205.064351-testing-default-smithi/7488242 branch: wip-mchangir-testing-20231205.064351 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} email: mchangir@redhat.com first_in_suite: false job_id: '7488242' kernel: flavor: default kdb: true sha1: cd68252d7b4d7802f3cae7f5945b38e9b20dad4c ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: mchangir-2023-12-12_08:46:52-fs-wip-mchangir-testing-20231205.064351-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-mchangir-testing-20231205.064351 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: f1fbf3c583d03e19f5e58eb618e78d8e10d075f9 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: f1fbf3c583d03e19f5e58eb618e78d8e10d075f9 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-mchangir-testing-20231205.064351 sha1: f1fbf3c583d03e19f5e58eb618e78d8e10d075f9 owner: mchangir priority: 1000 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 5473 sha1: f1fbf3c583d03e19f5e58eb618e78d8e10d075f9 sleep_before_teardown: 0 subset: 600/1024 suite: fs suite_branch: wip-mchangir-testing-20231205.064351 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: f1fbf3c583d03e19f5e58eb618e78d8e10d075f9 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi078.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBK/zlvJHDqEnPl6Dvp8Mv0S2RJ3kT0EukCv3Yxfv+tuVMZqWIVmF0fa1gFxjFMR6lRz0x4V94Th7G/aYJcD1aW4= smithi187.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCAFaGbbwyvMrg/EarDZihOcX6SBrTXZ9VyF3YFNk8Q1aF8/j7z0M+UVdoAS1IBXUvTaGRP6BEKBAdqaF/lrC9o= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - ceph-fuse: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.tests_from_xfstests_dev teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73 timestamp: 2023-12-12_08:46:52 tube: smithi user: mchangir verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.232157 2023-12-12T09:55:50.939 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/qa; will attempt to use it 2023-12-12T09:55:50.939 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/qa/tasks 2023-12-12T09:55:50.940 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-12-12T09:55:50.941 INFO:teuthology.task.internal:Checking packages... 2023-12-12T09:55:50.965 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'f1fbf3c583d03e19f5e58eb618e78d8e10d075f9' 2023-12-12T09:55:50.965 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-12T09:55:50.965 INFO:teuthology.packaging:ref: None 2023-12-12T09:55:50.965 INFO:teuthology.packaging:tag: None 2023-12-12T09:55:50.965 INFO:teuthology.packaging:branch: wip-mchangir-testing-20231205.064351 2023-12-12T09:55:50.966 INFO:teuthology.packaging:sha1: f1fbf3c583d03e19f5e58eb618e78d8e10d075f9 2023-12-12T09:55:50.966 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-mchangir-testing-20231205.064351 2023-12-12T09:55:51.187 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-96-gf1fbf3c5-1jammy 2023-12-12T09:55:51.189 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-12-12T09:55:51.195 INFO:teuthology.task.internal:no buildpackages task found 2023-12-12T09:55:51.195 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-12-12T09:55:51.232 INFO:teuthology.task.internal:Saving configuration 2023-12-12T09:55:51.249 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-12-12T09:55:51.256 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-12T09:55:51.283 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi078.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2023-12-12_08:46:52-fs-wip-mchangir-testing-20231205.064351-testing-default-smithi/7488242', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-12 09:50:12.697375', 'locked_by': 'mchangir', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIP9nMGVNVm+Nn/ZCwoZ2FYLocUmg4erkrSYH+zGJGxVX'} 2023-12-12T09:55:51.305 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi187.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2023-12-12_08:46:52-fs-wip-mchangir-testing-20231205.064351-testing-default-smithi/7488242', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-12 09:50:12.695787', 'locked_by': 'mchangir', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIJiDj8cb81wunl1ye2SfQpsLv6q743aIQqYy86uBnZZb'} 2023-12-12T09:55:51.305 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-12-12T09:55:51.311 INFO:teuthology.task.internal:roles: ubuntu@smithi078.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-12-12T09:55:51.311 INFO:teuthology.task.internal:roles: ubuntu@smithi187.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-12-12T09:55:51.311 INFO:teuthology.run_tasks:Running task console_log... 2023-12-12T09:55:51.422 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fb097324ca0>, signals=[15]) 2023-12-12T09:55:51.423 INFO:teuthology.run_tasks:Running task internal.connect... 2023-12-12T09:55:51.432 INFO:teuthology.task.internal:Opening connections... 2023-12-12T09:55:51.432 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi078.front.sepia.ceph.com 2023-12-12T09:55:51.434 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-12T09:55:51.511 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi187.front.sepia.ceph.com 2023-12-12T09:55:51.512 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-12T09:55:51.587 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-12-12T09:55:51.602 DEBUG:teuthology.orchestra.run.smithi078:> uname -m 2023-12-12T09:55:51.607 INFO:teuthology.orchestra.run.smithi078.stdout:x86_64 2023-12-12T09:55:51.607 DEBUG:teuthology.orchestra.run.smithi078:> cat /etc/os-release 2023-12-12T09:55:51.651 INFO:teuthology.orchestra.run.smithi078.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-12-12T09:55:51.652 INFO:teuthology.orchestra.run.smithi078.stdout:NAME="Ubuntu" 2023-12-12T09:55:51.652 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION_ID="22.04" 2023-12-12T09:55:51.652 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-12-12T09:55:51.652 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION_CODENAME=jammy 2023-12-12T09:55:51.652 INFO:teuthology.orchestra.run.smithi078.stdout:ID=ubuntu 2023-12-12T09:55:51.652 INFO:teuthology.orchestra.run.smithi078.stdout:ID_LIKE=debian 2023-12-12T09:55:51.652 INFO:teuthology.orchestra.run.smithi078.stdout:HOME_URL="https://www.ubuntu.com/" 2023-12-12T09:55:51.652 INFO:teuthology.orchestra.run.smithi078.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-12-12T09:55:51.652 INFO:teuthology.orchestra.run.smithi078.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-12-12T09:55:51.652 INFO:teuthology.orchestra.run.smithi078.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-12-12T09:55:51.652 INFO:teuthology.orchestra.run.smithi078.stdout:UBUNTU_CODENAME=jammy 2023-12-12T09:55:51.653 INFO:teuthology.lock.ops:Updating smithi078.front.sepia.ceph.com on lock server 2023-12-12T09:55:51.687 DEBUG:teuthology.orchestra.run.smithi187:> uname -m 2023-12-12T09:55:51.692 INFO:teuthology.orchestra.run.smithi187.stdout:x86_64 2023-12-12T09:55:51.692 DEBUG:teuthology.orchestra.run.smithi187:> cat /etc/os-release 2023-12-12T09:55:51.737 INFO:teuthology.orchestra.run.smithi187.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-12-12T09:55:51.737 INFO:teuthology.orchestra.run.smithi187.stdout:NAME="Ubuntu" 2023-12-12T09:55:51.737 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION_ID="22.04" 2023-12-12T09:55:51.737 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-12-12T09:55:51.737 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION_CODENAME=jammy 2023-12-12T09:55:51.737 INFO:teuthology.orchestra.run.smithi187.stdout:ID=ubuntu 2023-12-12T09:55:51.737 INFO:teuthology.orchestra.run.smithi187.stdout:ID_LIKE=debian 2023-12-12T09:55:51.738 INFO:teuthology.orchestra.run.smithi187.stdout:HOME_URL="https://www.ubuntu.com/" 2023-12-12T09:55:51.738 INFO:teuthology.orchestra.run.smithi187.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-12-12T09:55:51.738 INFO:teuthology.orchestra.run.smithi187.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-12-12T09:55:51.738 INFO:teuthology.orchestra.run.smithi187.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-12-12T09:55:51.738 INFO:teuthology.orchestra.run.smithi187.stdout:UBUNTU_CODENAME=jammy 2023-12-12T09:55:51.738 INFO:teuthology.lock.ops:Updating smithi187.front.sepia.ceph.com on lock server 2023-12-12T09:55:51.762 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-12-12T09:55:51.779 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-12-12T09:55:51.799 INFO:teuthology.task.internal:Checking for old test directory... 2023-12-12T09:55:51.800 DEBUG:teuthology.orchestra.run.smithi078:> test '!' -e /home/ubuntu/cephtest 2023-12-12T09:55:51.802 DEBUG:teuthology.orchestra.run.smithi187:> test '!' -e /home/ubuntu/cephtest 2023-12-12T09:55:51.806 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-12-12T09:55:51.825 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-12-12T09:55:51.825 DEBUG:teuthology.orchestra.run.smithi078:> test -z $(ls -A /var/lib/ceph) 2023-12-12T09:55:51.850 DEBUG:teuthology.orchestra.run.smithi187:> test -z $(ls -A /var/lib/ceph) 2023-12-12T09:55:51.865 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-12-12T09:55:51.918 INFO:teuthology.run_tasks:Running task kernel... 2023-12-12T09:55:51.936 INFO:teuthology.task.kernel:normalize config orig: {'flavor': 'default', 'kdb': True, 'sha1': 'cd68252d7b4d7802f3cae7f5945b38e9b20dad4c'} 2023-12-12T09:55:51.936 INFO:teuthology.task.kernel:config {'mon.a': {'flavor': 'default', 'kdb': True, 'sha1': 'cd68252d7b4d7802f3cae7f5945b38e9b20dad4c'}, 'mon.b': {'flavor': 'default', 'kdb': True, 'sha1': 'cd68252d7b4d7802f3cae7f5945b38e9b20dad4c'}}, timeout 300 2023-12-12T09:55:51.936 DEBUG:teuthology.orchestra.run.smithi078:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-12T09:55:51.937 DEBUG:teuthology.orchestra.run.smithi187:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-12T09:55:51.941 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-12T09:55:51.941 DEBUG:teuthology.task.kernel:sha1 for mon.a is cd68252d7b4d7802f3cae7f5945b38e9b20dad4c 2023-12-12T09:55:51.941 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "cd68252d7b4d7802f3cae7f5945b38e9b20dad4c"... 2023-12-12T09:55:51.942 DEBUG:teuthology.orchestra.run.smithi078:> uname -r 2023-12-12T09:55:51.942 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-12T09:55:51.943 DEBUG:teuthology.task.kernel:sha1 for mon.b is cd68252d7b4d7802f3cae7f5945b38e9b20dad4c 2023-12-12T09:55:51.943 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "cd68252d7b4d7802f3cae7f5945b38e9b20dad4c"... 2023-12-12T09:55:51.943 DEBUG:teuthology.orchestra.run.smithi187:> uname -r 2023-12-12T09:55:51.988 INFO:teuthology.orchestra.run.smithi078.stdout:5.15.0-56-generic 2023-12-12T09:55:51.988 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs cd68252d7b4d7802f3cae7f5945b38e9b20dad4c 2023-12-12T09:55:51.988 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-12-12T09:55:51.989 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=cd68252d7b4d7802f3cae7f5945b38e9b20dad4c 2023-12-12T09:55:51.992 INFO:teuthology.orchestra.run.smithi187.stdout:5.15.0-56-generic 2023-12-12T09:55:51.992 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs cd68252d7b4d7802f3cae7f5945b38e9b20dad4c 2023-12-12T09:55:51.992 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-12-12T09:55:51.993 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=cd68252d7b4d7802f3cae7f5945b38e9b20dad4c 2023-12-12T09:55:52.131 INFO:teuthology.task.kernel:Installing linux-firmware on mon.a... 2023-12-12T09:55:52.131 DEBUG:teuthology.orchestra.run.smithi078:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2023-12-12T09:55:52.145 INFO:teuthology.orchestra.run.smithi078.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2023-12-12T09:55:52.204 INFO:teuthology.task.kernel:Installing linux-firmware on mon.b... 2023-12-12T09:55:52.204 DEBUG:teuthology.orchestra.run.smithi187:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2023-12-12T09:55:52.218 INFO:teuthology.orchestra.run.smithi187.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2023-12-12T09:55:52.319 INFO:teuthology.orchestra.run.smithi078.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2023-12-12T09:55:52.319 INFO:teuthology.orchestra.run.smithi078.stderr:hint: is subject to change. To configure the initial branch name to use in all 2023-12-12T09:55:52.319 INFO:teuthology.orchestra.run.smithi078.stderr:hint: of your new repositories, which will suppress this warning, call: 2023-12-12T09:55:52.319 INFO:teuthology.orchestra.run.smithi078.stderr:hint: 2023-12-12T09:55:52.320 INFO:teuthology.orchestra.run.smithi078.stderr:hint: git config --global init.defaultBranch 2023-12-12T09:55:52.320 INFO:teuthology.orchestra.run.smithi078.stderr:hint: 2023-12-12T09:55:52.320 INFO:teuthology.orchestra.run.smithi078.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2023-12-12T09:55:52.320 INFO:teuthology.orchestra.run.smithi078.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2023-12-12T09:55:52.320 INFO:teuthology.orchestra.run.smithi078.stderr:hint: 2023-12-12T09:55:52.320 INFO:teuthology.orchestra.run.smithi078.stderr:hint: git branch -m 2023-12-12T09:55:52.320 INFO:teuthology.orchestra.run.smithi078.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2023-12-12T09:55:52.323 DEBUG:teuthology.orchestra.run.smithi078:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2023-12-12T09:55:52.364 INFO:teuthology.orchestra.run.smithi187.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2023-12-12T09:55:52.364 INFO:teuthology.orchestra.run.smithi187.stderr:hint: is subject to change. To configure the initial branch name to use in all 2023-12-12T09:55:52.364 INFO:teuthology.orchestra.run.smithi187.stderr:hint: of your new repositories, which will suppress this warning, call: 2023-12-12T09:55:52.364 INFO:teuthology.orchestra.run.smithi187.stderr:hint: 2023-12-12T09:55:52.365 INFO:teuthology.orchestra.run.smithi187.stderr:hint: git config --global init.defaultBranch 2023-12-12T09:55:52.365 INFO:teuthology.orchestra.run.smithi187.stderr:hint: 2023-12-12T09:55:52.365 INFO:teuthology.orchestra.run.smithi187.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2023-12-12T09:55:52.365 INFO:teuthology.orchestra.run.smithi187.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2023-12-12T09:55:52.365 INFO:teuthology.orchestra.run.smithi187.stderr:hint: 2023-12-12T09:55:52.365 INFO:teuthology.orchestra.run.smithi187.stderr:hint: git branch -m 2023-12-12T09:55:52.365 INFO:teuthology.orchestra.run.smithi187.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2023-12-12T09:55:52.367 DEBUG:teuthology.orchestra.run.smithi187:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2023-12-12T09:55:52.392 DEBUG:teuthology.orchestra.run.smithi078:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2023-12-12T09:55:52.436 DEBUG:teuthology.orchestra.run.smithi187:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2023-12-12T09:55:52.450 DEBUG:teuthology.orchestra.run.smithi078:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2023-12-12T09:55:52.491 DEBUG:teuthology.orchestra.run.smithi187:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2023-12-12T09:56:36.347 INFO:teuthology.orchestra.run.smithi187.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2023-12-12T09:56:36.348 INFO:teuthology.orchestra.run.smithi187.stderr: * [new branch] main -> origin/main 2023-12-12T09:56:36.348 INFO:teuthology.orchestra.run.smithi187.stderr: * [new tag] 20231211 -> 20231211 2023-12-12T09:56:36.377 INFO:teuthology.orchestra.run.smithi187.stderr: * [new tag] 20190312 -> 20190312 2023-12-12T09:56:36.378 INFO:teuthology.orchestra.run.smithi187.stderr: * [new tag] 20190416 -> 20190416 2023-12-12T09:56:36.378 INFO:teuthology.orchestra.run.smithi187.stderr: * [new tag] 20190514 -> 20190514 2023-12-12T09:56:36.378 INFO:teuthology.orchestra.run.smithi187.stderr: * [new tag] 20190618 -> 20190618 2023-12-12T09:56:36.378 INFO:teuthology.orchestra.run.smithi187.stderr: * [new tag] 20190717 -> 20190717 2023-12-12T09:56:36.378 INFO:teuthology.orchestra.run.smithi187.stderr: * [new tag] 20190815 -> 20190815 2023-12-12T09:56:36.378 INFO:teuthology.orchestra.run.smithi187.stderr: * [new tag] 20190923 -> 20190923 2023-12-12T09:56:36.378 INFO:teuthology.orchestra.run.smithi187.stderr: * [new tag] 20191022 -> 20191022 2023-12-12T09:56:36.378 INFO:teuthology.orchestra.run.smithi187.stderr: * [new tag] 20191215 -> 20191215 2023-12-12T09:56:36.378 INFO:teuthology.orchestra.run.smithi187.stderr: * [new tag] 20200122 -> 20200122 2023-12-12T09:56:36.380 INFO:teuthology.orchestra.run.smithi187.stderr: * [new tag] 20200316 -> 20200316 2023-12-12T09:56:36.380 INFO:teuthology.orchestra.run.smithi187.stderr: * [new tag] 20200421 -> 20200421 2023-12-12T09:56:36.380 INFO:teuthology.orchestra.run.smithi187.stderr: * [new tag] 20200519 -> 20200519 2023-12-12T09:56:36.380 INFO:teuthology.orchestra.run.smithi187.stderr: * [new tag] 20200619 -> 20200619 2023-12-12T09:56:36.380 INFO:teuthology.orchestra.run.smithi187.stderr: * [new tag] 20200721 -> 20200721 2023-12-12T09:56:36.381 INFO:teuthology.orchestra.run.smithi187.stderr: * [new tag] 20200817 -> 20200817 2023-12-12T09:56:36.381 INFO:teuthology.orchestra.run.smithi187.stderr: * [new tag] 20200918 -> 20200918 2023-12-12T09:56:36.381 INFO:teuthology.orchestra.run.smithi187.stderr: * [new tag] 20201022 -> 20201022 2023-12-12T09:56:36.381 INFO:teuthology.orchestra.run.smithi187.stderr: * [new tag] 20201118 -> 20201118 2023-12-12T09:56:36.381 INFO:teuthology.orchestra.run.smithi187.stderr: * [new tag] 20201218 -> 20201218 2023-12-12T09:56:36.381 INFO:teuthology.orchestra.run.smithi187.stderr: * [new tag] 20210208 -> 20210208 2023-12-12T09:56:36.381 INFO:teuthology.orchestra.run.smithi187.stderr: * [new tag] 20210315 -> 20210315 2023-12-12T09:56:36.381 INFO:teuthology.orchestra.run.smithi187.stderr: * [new tag] 20210511 -> 20210511 2023-12-12T09:56:36.381 INFO:teuthology.orchestra.run.smithi187.stderr: * [new tag] 20210716 -> 20210716 2023-12-12T09:56:36.381 INFO:teuthology.orchestra.run.smithi187.stderr: * [new tag] 20210818 -> 20210818 2023-12-12T09:56:36.381 INFO:teuthology.orchestra.run.smithi187.stderr: * [new tag] 20210919 -> 20210919 2023-12-12T09:56:36.381 INFO:teuthology.orchestra.run.smithi187.stderr: * [new tag] 20211027 -> 20211027 2023-12-12T09:56:36.381 INFO:teuthology.orchestra.run.smithi187.stderr: * [new tag] 20211216 -> 20211216 2023-12-12T09:56:36.381 INFO:teuthology.orchestra.run.smithi187.stderr: * [new tag] 20220209 -> 20220209 2023-12-12T09:56:36.384 INFO:teuthology.orchestra.run.smithi187.stderr: * [new tag] 20220310 -> 20220310 2023-12-12T09:56:36.384 INFO:teuthology.orchestra.run.smithi187.stderr: * [new tag] 20220411 -> 20220411 2023-12-12T09:56:36.384 INFO:teuthology.orchestra.run.smithi187.stderr: * [new tag] 20220509 -> 20220509 2023-12-12T09:56:36.384 INFO:teuthology.orchestra.run.smithi187.stderr: * [new tag] 20220610 -> 20220610 2023-12-12T09:56:36.384 INFO:teuthology.orchestra.run.smithi187.stderr: * [new tag] 20220708 -> 20220708 2023-12-12T09:56:36.384 INFO:teuthology.orchestra.run.smithi187.stderr: * [new tag] 20220815 -> 20220815 2023-12-12T09:56:36.384 INFO:teuthology.orchestra.run.smithi187.stderr: * [new tag] 20220913 -> 20220913 2023-12-12T09:56:36.384 INFO:teuthology.orchestra.run.smithi187.stderr: * [new tag] 20221012 -> 20221012 2023-12-12T09:56:36.385 INFO:teuthology.orchestra.run.smithi187.stderr: * [new tag] 20221109 -> 20221109 2023-12-12T09:56:36.385 INFO:teuthology.orchestra.run.smithi187.stderr: * [new tag] 20221214 -> 20221214 2023-12-12T09:56:36.385 INFO:teuthology.orchestra.run.smithi187.stderr: * [new tag] 20230117 -> 20230117 2023-12-12T09:56:36.385 INFO:teuthology.orchestra.run.smithi187.stderr: * [new tag] 20230210 -> 20230210 2023-12-12T09:56:36.385 INFO:teuthology.orchestra.run.smithi187.stderr: * [new tag] 20230310 -> 20230310 2023-12-12T09:56:36.385 INFO:teuthology.orchestra.run.smithi187.stderr: * [new tag] 20230404 -> 20230404 2023-12-12T09:56:36.385 INFO:teuthology.orchestra.run.smithi187.stderr: * [new tag] 20230515 -> 20230515 2023-12-12T09:56:36.385 INFO:teuthology.orchestra.run.smithi187.stderr: * [new tag] 20230625 -> 20230625 2023-12-12T09:56:36.385 INFO:teuthology.orchestra.run.smithi187.stderr: * [new tag] 20230804 -> 20230804 2023-12-12T09:56:36.385 INFO:teuthology.orchestra.run.smithi187.stderr: * [new tag] 20230919 -> 20230919 2023-12-12T09:56:36.385 INFO:teuthology.orchestra.run.smithi187.stderr: * [new tag] 20231030 -> 20231030 2023-12-12T09:56:36.386 INFO:teuthology.orchestra.run.smithi187.stderr: * [new tag] 20231111 -> 20231111 2023-12-12T09:56:37.717 INFO:teuthology.orchestra.run.smithi078.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2023-12-12T09:56:37.718 INFO:teuthology.orchestra.run.smithi078.stderr: * [new branch] main -> origin/main 2023-12-12T09:56:37.718 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20231211 -> 20231211 2023-12-12T09:56:37.749 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20190312 -> 20190312 2023-12-12T09:56:37.749 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20190416 -> 20190416 2023-12-12T09:56:37.749 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20190514 -> 20190514 2023-12-12T09:56:37.749 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20190618 -> 20190618 2023-12-12T09:56:37.750 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20190717 -> 20190717 2023-12-12T09:56:37.750 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20190815 -> 20190815 2023-12-12T09:56:37.750 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20190923 -> 20190923 2023-12-12T09:56:37.750 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20191022 -> 20191022 2023-12-12T09:56:37.750 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20191215 -> 20191215 2023-12-12T09:56:37.750 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20200122 -> 20200122 2023-12-12T09:56:37.751 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20200316 -> 20200316 2023-12-12T09:56:37.751 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20200421 -> 20200421 2023-12-12T09:56:37.751 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20200519 -> 20200519 2023-12-12T09:56:37.751 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20200619 -> 20200619 2023-12-12T09:56:37.751 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20200721 -> 20200721 2023-12-12T09:56:37.752 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20200817 -> 20200817 2023-12-12T09:56:37.752 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20200918 -> 20200918 2023-12-12T09:56:37.752 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20201022 -> 20201022 2023-12-12T09:56:37.752 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20201118 -> 20201118 2023-12-12T09:56:37.752 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20201218 -> 20201218 2023-12-12T09:56:37.753 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20210208 -> 20210208 2023-12-12T09:56:37.753 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20210315 -> 20210315 2023-12-12T09:56:37.753 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20210511 -> 20210511 2023-12-12T09:56:37.753 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20210716 -> 20210716 2023-12-12T09:56:37.753 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20210818 -> 20210818 2023-12-12T09:56:37.753 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20210919 -> 20210919 2023-12-12T09:56:37.754 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20211027 -> 20211027 2023-12-12T09:56:37.754 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20211216 -> 20211216 2023-12-12T09:56:37.754 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20220209 -> 20220209 2023-12-12T09:56:37.754 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20220310 -> 20220310 2023-12-12T09:56:37.755 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20220411 -> 20220411 2023-12-12T09:56:37.755 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20220509 -> 20220509 2023-12-12T09:56:37.755 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20220610 -> 20220610 2023-12-12T09:56:37.755 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20220708 -> 20220708 2023-12-12T09:56:37.755 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20220815 -> 20220815 2023-12-12T09:56:37.756 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20220913 -> 20220913 2023-12-12T09:56:37.756 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20221012 -> 20221012 2023-12-12T09:56:37.756 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20221109 -> 20221109 2023-12-12T09:56:37.756 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20221214 -> 20221214 2023-12-12T09:56:37.756 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20230117 -> 20230117 2023-12-12T09:56:37.757 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20230210 -> 20230210 2023-12-12T09:56:37.757 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20230310 -> 20230310 2023-12-12T09:56:37.757 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20230404 -> 20230404 2023-12-12T09:56:37.757 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20230515 -> 20230515 2023-12-12T09:56:37.757 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20230625 -> 20230625 2023-12-12T09:56:37.758 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20230804 -> 20230804 2023-12-12T09:56:37.758 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20230919 -> 20230919 2023-12-12T09:56:37.758 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20231030 -> 20231030 2023-12-12T09:56:37.758 INFO:teuthology.orchestra.run.smithi078.stderr: * [new tag] 20231111 -> 20231111 2023-12-12T09:56:40.372 INFO:teuthology.orchestra.run.smithi187.stderr:Updating files: 51% (1673/3254) Updating files: 52% (1693/3254) Updating files: 53% (1725/3254) Updating files: 54% (1758/3254) Updating files: 55% (1790/3254) Updating files: 56% (1823/3254) Updating files: 57% (1855/3254) Updating files: 58% (1888/3254) Updating files: 59% (1920/3254) Updating files: 60% (1953/3254) Updating files: 61% (1985/3254) Updating files: 62% (2018/3254) Updating files: 63% (2051/3254) Updating files: 64% (2083/3254) Updating files: 65% (2116/3254) Updating files: 65% (2119/3254) Updating files: 66% (2148/3254) Updating files: 67% (2181/3254) Updating files: 68% (2213/3254) Updating files: 69% (2246/3254) Updating files: 70% (2278/3254) Updating files: 71% (2311/3254) Updating files: 72% (2343/3254) Updating files: 73% (2376/3254) Updating files: 74% (2408/3254) Updating files: 75% (2441/3254) Updating files: 76% (2474/3254) Updating files: 77% (2506/3254) Updating files: 78% (2539/3254) Updating files: 79% (2571/3254) Updating files: 80% (2604/3254) Updating files: 81% (2636/3254) Updating files: 81% (2653/3254) Updating files: 82% (2669/3254) Updating files: 83% (2701/3254) Updating files: 84% (2734/3254) Updating files: 85% (2766/3254) Updating files: 86% (2799/3254) Updating files: 87% (2831/3254) Updating files: 88% (2864/3254) Updating files: 89% (2897/3254) Updating files: 90% (2929/3254) Updating files: 91% (2962/3254) Updating files: 92% (2994/3254) Updating files: 93% (3027/3254) Updating files: 94% (3059/3254) Updating files: 95% (3092/3254) Updating files: 96% (3124/3254) Updating files: 97% (3157/3254) Updating files: 98% (3189/3254) Updating files: 99% (3222/3254) Updating files: 100% (3254/3254) Updating files: 100% (3254/3254), done. 2023-12-12T09:56:40.377 INFO:teuthology.orchestra.run.smithi187.stdout:HEAD is now at f2e52a1c Merge branch 'wfx' into 'main' 2023-12-12T09:56:40.396 INFO:teuthology.task.kernel:Downloading kernel cd68252d7b4d7802f3cae7f5945b38e9b20dad4c on mon.b... 2023-12-12T09:56:40.397 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=cd68252d7b4d7802f3cae7f5945b38e9b20dad4c 2023-12-12T09:56:40.542 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/cd68252d7b4d7802f3cae7f5945b38e9b20dad4c/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-gcd68252d7b4d/ 2023-12-12T09:56:40.543 DEBUG:teuthology.orchestra.run.smithi187:> rm -f /tmp/linux-image.deb && echo linux-image-6.6.0-gcd68252d7b4d_6.6.0-gcd68252d7b4d-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://2.chacra.ceph.com/r/kernel/testing/cd68252d7b4d7802f3cae7f5945b38e9b20dad4c/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-gcd68252d7b4d/ --input-file=- 2023-12-12T09:56:40.546 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi187.front.sepia.ceph.com to complete... 2023-12-12T09:56:41.761 INFO:teuthology.orchestra.run.smithi078.stderr:Updating files: 49% (1625/3254) Updating files: 50% (1627/3254) Updating files: 51% (1660/3254) Updating files: 52% (1693/3254) Updating files: 53% (1725/3254) Updating files: 54% (1758/3254) Updating files: 55% (1790/3254) Updating files: 56% (1823/3254) Updating files: 57% (1855/3254) Updating files: 58% (1888/3254) Updating files: 59% (1920/3254) Updating files: 60% (1953/3254) Updating files: 61% (1985/3254) Updating files: 62% (2018/3254) Updating files: 63% (2051/3254) Updating files: 64% (2083/3254) Updating files: 64% (2105/3254) Updating files: 65% (2116/3254) Updating files: 66% (2148/3254) Updating files: 67% (2181/3254) Updating files: 68% (2213/3254) Updating files: 69% (2246/3254) Updating files: 70% (2278/3254) Updating files: 71% (2311/3254) Updating files: 72% (2343/3254) Updating files: 73% (2376/3254) Updating files: 74% (2408/3254) Updating files: 75% (2441/3254) Updating files: 76% (2474/3254) Updating files: 77% (2506/3254) Updating files: 78% (2539/3254) Updating files: 79% (2571/3254) Updating files: 80% (2604/3254) Updating files: 81% (2636/3254) Updating files: 81% (2653/3254) Updating files: 82% (2669/3254) Updating files: 83% (2701/3254) Updating files: 84% (2734/3254) Updating files: 85% (2766/3254) Updating files: 86% (2799/3254) Updating files: 87% (2831/3254) Updating files: 88% (2864/3254) Updating files: 89% (2897/3254) Updating files: 90% (2929/3254) Updating files: 91% (2962/3254) Updating files: 92% (2994/3254) Updating files: 93% (3027/3254) Updating files: 94% (3059/3254) Updating files: 95% (3092/3254) Updating files: 96% (3124/3254) Updating files: 97% (3157/3254) Updating files: 98% (3189/3254) Updating files: 99% (3222/3254) Updating files: 100% (3254/3254) Updating files: 100% (3254/3254), done. 2023-12-12T09:56:41.766 INFO:teuthology.orchestra.run.smithi078.stdout:HEAD is now at f2e52a1c Merge branch 'wfx' into 'main' 2023-12-12T09:56:41.784 INFO:teuthology.task.kernel:Downloading kernel cd68252d7b4d7802f3cae7f5945b38e9b20dad4c on mon.a... 2023-12-12T09:56:41.785 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=cd68252d7b4d7802f3cae7f5945b38e9b20dad4c 2023-12-12T09:56:41.939 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/cd68252d7b4d7802f3cae7f5945b38e9b20dad4c/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-gcd68252d7b4d/ 2023-12-12T09:56:41.939 DEBUG:teuthology.orchestra.run.smithi078:> rm -f /tmp/linux-image.deb && echo linux-image-6.6.0-gcd68252d7b4d_6.6.0-gcd68252d7b4d-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://2.chacra.ceph.com/r/kernel/testing/cd68252d7b4d7802f3cae7f5945b38e9b20dad4c/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-gcd68252d7b4d/ --input-file=- 2023-12-12T09:56:41.942 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi078.front.sepia.ceph.com to complete... 2023-12-12T09:56:42.216 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12 09:56:42 URL:https://2.chacra.ceph.com/r/kernel/testing/cd68252d7b4d7802f3cae7f5945b38e9b20dad4c/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-gcd68252d7b4d/linux-image-6.6.0-gcd68252d7b4d_6.6.0-gcd68252d7b4d-1_amd64.deb [38930180/38930180] -> "/tmp/linux-image.deb" [1] 2023-12-12T09:56:42.216 INFO:teuthology.orchestra.run.smithi187.stderr:FINISHED --2023-12-12 09:56:42-- 2023-12-12T09:56:42.216 INFO:teuthology.orchestra.run.smithi187.stderr:Total wall clock time: 1.6s 2023-12-12T09:56:42.216 INFO:teuthology.orchestra.run.smithi187.stderr:Downloaded: 1 files, 37M in 1.4s (27.0 MB/s) 2023-12-12T09:56:42.221 INFO:teuthology.task.kernel:Installing kernel cd68252d7b4d7802f3cae7f5945b38e9b20dad4c on mon.b... 2023-12-12T09:56:42.221 DEBUG:teuthology.orchestra.run.smithi187:> sudo dpkg -i /tmp/linux-image.deb 2023-12-12T09:56:42.444 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package linux-image-6.6.0-gcd68252d7b4d. 2023-12-12T09:56:43.612 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12 09:56:44 URL:https://2.chacra.ceph.com/r/kernel/testing/cd68252d7b4d7802f3cae7f5945b38e9b20dad4c/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-gcd68252d7b4d/linux-image-6.6.0-gcd68252d7b4d_6.6.0-gcd68252d7b4d-1_amd64.deb [38930180/38930180] -> "/tmp/linux-image.deb" [1] 2023-12-12T09:56:43.612 INFO:teuthology.orchestra.run.smithi078.stderr:FINISHED --2023-12-12 09:56:44-- 2023-12-12T09:56:43.612 INFO:teuthology.orchestra.run.smithi078.stderr:Total wall clock time: 1.6s 2023-12-12T09:56:43.612 INFO:teuthology.orchestra.run.smithi078.stderr:Downloaded: 1 files, 37M in 1.4s (27.4 MB/s) 2023-12-12T09:56:43.616 INFO:teuthology.task.kernel:Installing kernel cd68252d7b4d7802f3cae7f5945b38e9b20dad4c on mon.a... 2023-12-12T09:56:43.616 DEBUG:teuthology.orchestra.run.smithi078:> sudo dpkg -i /tmp/linux-image.deb 2023-12-12T09:56:43.839 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package linux-image-6.6.0-gcd68252d7b4d. 2023-12-12T09:56:44.450 INFO:teuthology.orchestra.run.smithi187.stdout:(Reading database ... 129542 files and directories currently installed.) 2023-12-12T09:56:44.454 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack /tmp/linux-image.deb ... 2023-12-12T09:56:44.573 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking linux-image-6.6.0-gcd68252d7b4d (6.6.0-gcd68252d7b4d-1) ... 2023-12-12T09:56:45.899 INFO:teuthology.orchestra.run.smithi078.stdout:(Reading database ... 129542 files and directories currently installed.) 2023-12-12T09:56:45.903 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack /tmp/linux-image.deb ... 2023-12-12T09:56:46.014 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking linux-image-6.6.0-gcd68252d7b4d (6.6.0-gcd68252d7b4d-1) ... 2023-12-12T09:56:48.148 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up linux-image-6.6.0-gcd68252d7b4d (6.6.0-gcd68252d7b4d-1) ... 2023-12-12T09:56:48.281 INFO:teuthology.orchestra.run.smithi187.stderr:update-initramfs: Generating /boot/initrd.img-6.6.0-gcd68252d7b4d 2023-12-12T09:56:49.513 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up linux-image-6.6.0-gcd68252d7b4d (6.6.0-gcd68252d7b4d-1) ... 2023-12-12T09:56:49.632 INFO:teuthology.orchestra.run.smithi078.stderr:update-initramfs: Generating /boot/initrd.img-6.6.0-gcd68252d7b4d 2023-12-12T09:57:09.047 INFO:teuthology.orchestra.run.smithi187.stderr:Sourcing file `/etc/default/grub' 2023-12-12T09:57:09.064 INFO:teuthology.orchestra.run.smithi187.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-12-12T09:57:09.088 INFO:teuthology.orchestra.run.smithi187.stderr:Generating grub configuration file ... 2023-12-12T09:57:09.428 INFO:teuthology.orchestra.run.smithi187.stderr:Found linux image: /boot/vmlinuz-6.6.0-gcd68252d7b4d 2023-12-12T09:57:09.447 INFO:teuthology.orchestra.run.smithi187.stderr:Found initrd image: /boot/initrd.img-6.6.0-gcd68252d7b4d 2023-12-12T09:57:09.762 INFO:teuthology.orchestra.run.smithi187.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-12-12T09:57:09.768 INFO:teuthology.orchestra.run.smithi187.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-12-12T09:57:09.831 INFO:teuthology.orchestra.run.smithi187.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-12-12T09:57:09.836 INFO:teuthology.orchestra.run.smithi187.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-12-12T09:57:09.966 INFO:teuthology.orchestra.run.smithi187.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-12-12T09:57:09.966 INFO:teuthology.orchestra.run.smithi187.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-12-12T09:57:09.967 INFO:teuthology.orchestra.run.smithi187.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-12-12T09:57:10.004 INFO:teuthology.orchestra.run.smithi187.stderr:done 2023-12-12T09:57:10.189 DEBUG:teuthology.orchestra.run.smithi187:> dpkg-deb -c /tmp/linux-image.deb 2023-12-12T09:57:10.196 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./ 2023-12-12T09:57:10.196 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./boot/ 2023-12-12T09:57:10.196 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 4415617 2023-12-08 17:49 ./boot/System.map-6.6.0-gcd68252d7b4d 2023-12-12T09:57:10.209 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 169214 2023-12-08 17:49 ./boot/config-6.6.0-gcd68252d7b4d 2023-12-12T09:57:10.209 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11352864 2023-12-08 17:49 ./boot/vmlinuz-6.6.0-gcd68252d7b4d 2023-12-12T09:57:10.229 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./etc/ 2023-12-12T09:57:10.230 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./etc/kernel/ 2023-12-12T09:57:10.230 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./etc/kernel/postinst.d/ 2023-12-12T09:57:10.230 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./etc/kernel/postrm.d/ 2023-12-12T09:57:10.230 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./etc/kernel/preinst.d/ 2023-12-12T09:57:10.230 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./etc/kernel/prerm.d/ 2023-12-12T09:57:10.230 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/ 2023-12-12T09:57:10.230 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/ 2023-12-12T09:57:10.230 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/ 2023-12-12T09:57:10.230 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/ 2023-12-12T09:57:10.230 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/ 2023-12-12T09:57:10.230 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/ 2023-12-12T09:57:10.230 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/ 2023-12-12T09:57:10.230 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 490233 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/aesni-intel.ko 2023-12-12T09:57:10.233 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 25329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-12-12T09:57:10.233 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 29529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-12-12T09:57:10.233 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 30313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-12-12T09:57:10.233 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 93113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-12-12T09:57:10.233 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 106729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-12-12T09:57:10.233 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 152241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-12-12T09:57:10.233 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-12-12T09:57:10.233 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13777 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-12-12T09:57:10.233 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 83889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-12-12T09:57:10.233 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 18625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-12-12T09:57:10.233 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 47225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-12-12T09:57:10.233 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 47209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/serpent-avx2.ko 2023-12-12T09:57:10.234 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 51801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-12-12T09:57:10.234 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 38937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-12-12T09:57:10.234 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 40529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-12-12T09:57:10.234 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 58585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-12-12T09:57:10.234 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 50497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-12-12T09:57:10.234 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 32065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-12-12T09:57:10.234 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-12-12T09:57:10.234 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/ 2023-12-12T09:57:10.234 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/cpu/ 2023-12-12T09:57:10.234 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/cpu/mce/ 2023-12-12T09:57:10.234 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 40113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-12-12T09:57:10.234 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/cpuid.ko 2023-12-12T09:57:10.234 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 17937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/msr.ko 2023-12-12T09:57:10.235 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm/ 2023-12-12T09:57:10.235 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 354433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm/kvm-amd.ko 2023-12-12T09:57:10.235 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 881625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm/kvm-intel.ko 2023-12-12T09:57:10.235 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 2275865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm/kvm.ko 2023-12-12T09:57:10.264 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/ 2023-12-12T09:57:10.265 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 53697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/af_alg.ko 2023-12-12T09:57:10.265 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 23097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/algif_hash.ko 2023-12-12T09:57:10.265 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 19985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/algif_skcipher.ko 2023-12-12T09:57:10.265 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 17209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/ansi_cprng.ko 2023-12-12T09:57:10.265 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 19641 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/anubis.ko 2023-12-12T09:57:10.265 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/arc4.ko 2023-12-12T09:57:10.265 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/asymmetric_keys/ 2023-12-12T09:57:10.265 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2023-12-12T09:57:10.265 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/ 2023-12-12T09:57:10.265 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_memcpy.ko 2023-12-12T09:57:10.265 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 19473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_pq.ko 2023-12-12T09:57:10.265 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 21561 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_raid6_recov.ko 2023-12-12T09:57:10.266 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_tx.ko 2023-12-12T09:57:10.266 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 17745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_xor.ko 2023-12-12T09:57:10.266 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 17921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/raid6test.ko 2023-12-12T09:57:10.266 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 20489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/authenc.ko 2023-12-12T09:57:10.266 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 22577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/authencesn.ko 2023-12-12T09:57:10.266 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 21817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/blake2b_generic.ko 2023-12-12T09:57:10.266 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/blowfish_common.ko 2023-12-12T09:57:10.266 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/blowfish_generic.ko 2023-12-12T09:57:10.266 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 38809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/camellia_generic.ko 2023-12-12T09:57:10.266 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 27321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cast5_generic.ko 2023-12-12T09:57:10.266 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 17745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cast6_generic.ko 2023-12-12T09:57:10.266 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cast_common.ko 2023-12-12T09:57:10.266 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 35097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/ccm.ko 2023-12-12T09:57:10.266 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 14769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cmac.ko 2023-12-12T09:57:10.266 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 9585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/crc32_generic.ko 2023-12-12T09:57:10.267 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 47505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cryptd.ko 2023-12-12T09:57:10.267 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 39505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/crypto_engine.ko 2023-12-12T09:57:10.267 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 26953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/crypto_simd.ko 2023-12-12T09:57:10.267 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 24737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/crypto_user.ko 2023-12-12T09:57:10.267 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 17729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cts.ko 2023-12-12T09:57:10.267 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10913 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/des_generic.ko 2023-12-12T09:57:10.267 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 15681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/dh_generic.ko 2023-12-12T09:57:10.267 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11001 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/echainiv.ko 2023-12-12T09:57:10.267 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 25321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/essiv.ko 2023-12-12T09:57:10.267 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 17993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/fcrypt.ko 2023-12-12T09:57:10.267 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 26897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/khazad.ko 2023-12-12T09:57:10.267 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 15649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/lrw.ko 2023-12-12T09:57:10.267 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11513 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/lz4.ko 2023-12-12T09:57:10.267 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/lz4hc.ko 2023-12-12T09:57:10.267 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/md4.ko 2023-12-12T09:57:10.268 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 9729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/michael_mic.ko 2023-12-12T09:57:10.268 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/pcbc.ko 2023-12-12T09:57:10.268 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 18745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/pcrypt.ko 2023-12-12T09:57:10.268 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 16049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/rmd160.ko 2023-12-12T09:57:10.268 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 29393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/seed.ko 2023-12-12T09:57:10.268 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 27081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/serpent_generic.ko 2023-12-12T09:57:10.268 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 149193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/tcrypt.ko 2023-12-12T09:57:10.268 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/tea.ko 2023-12-12T09:57:10.268 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 28777 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/twofish_common.ko 2023-12-12T09:57:10.268 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/twofish_generic.ko 2023-12-12T09:57:10.268 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 17401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/vmac.ko 2023-12-12T09:57:10.268 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 36185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/wp512.ko 2023-12-12T09:57:10.268 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 14105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/xcbc.ko 2023-12-12T09:57:10.268 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 26665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/xor.ko 2023-12-12T09:57:10.269 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 18713 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/xts.ko 2023-12-12T09:57:10.269 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 9481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/xxhash_generic.ko 2023-12-12T09:57:10.269 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ 2023-12-12T09:57:10.269 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/ 2023-12-12T09:57:10.269 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 18249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/acpi_extlog.ko 2023-12-12T09:57:10.269 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 26985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/acpi_ipmi.ko 2023-12-12T09:57:10.269 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 28793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/acpi_pad.ko 2023-12-12T09:57:10.269 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/apei/ 2023-12-12T09:57:10.269 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 31241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/apei/einj.ko 2023-12-12T09:57:10.269 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/ec_sys.ko 2023-12-12T09:57:10.269 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 14937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/platform_profile.ko 2023-12-12T09:57:10.269 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 24401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/sbs.ko 2023-12-12T09:57:10.269 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 19521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/sbshc.ko 2023-12-12T09:57:10.269 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 103025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/video.ko 2023-12-12T09:57:10.269 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/ 2023-12-12T09:57:10.269 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 21601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/acard-ahci.ko 2023-12-12T09:57:10.270 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 88865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/ahci.ko 2023-12-12T09:57:10.270 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 14729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/ahci_platform.ko 2023-12-12T09:57:10.270 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 88289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/libahci.ko 2023-12-12T09:57:10.270 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 34985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/libahci_platform.ko 2023-12-12T09:57:10.270 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 17137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_acpi.ko 2023-12-12T09:57:10.270 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 30433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ali.ko 2023-12-12T09:57:10.270 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 33505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_amd.ko 2023-12-12T09:57:10.270 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 21265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_artop.ko 2023-12-12T09:57:10.270 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 21121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_atiixp.ko 2023-12-12T09:57:10.270 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 24945 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_atp867x.ko 2023-12-12T09:57:10.270 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 17657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_cmd640.ko 2023-12-12T09:57:10.270 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 25185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_cmd64x.ko 2023-12-12T09:57:10.270 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 15049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_cypress.ko 2023-12-12T09:57:10.270 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 17849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_efar.ko 2023-12-12T09:57:10.271 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 21945 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt366.ko 2023-12-12T09:57:10.271 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 33977 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt37x.ko 2023-12-12T09:57:10.271 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 23129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt3x2n.ko 2023-12-12T09:57:10.271 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 16921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt3x3.ko 2023-12-12T09:57:10.271 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 16993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_it8213.ko 2023-12-12T09:57:10.271 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 35273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_it821x.ko 2023-12-12T09:57:10.271 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_jmicron.ko 2023-12-12T09:57:10.271 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 51481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_legacy.ko 2023-12-12T09:57:10.271 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 15185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_marvell.ko 2023-12-12T09:57:10.271 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 16281 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_mpiix.ko 2023-12-12T09:57:10.271 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_netcell.ko 2023-12-12T09:57:10.271 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 16817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ninja32.ko 2023-12-12T09:57:10.271 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 15105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ns87410.ko 2023-12-12T09:57:10.271 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 17361 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ns87415.ko 2023-12-12T09:57:10.271 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 16569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_oldpiix.ko 2023-12-12T09:57:10.272 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 15377 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_opti.ko 2023-12-12T09:57:10.272 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 20681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_optidma.ko 2023-12-12T09:57:10.272 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 32585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_pcmcia.ko 2023-12-12T09:57:10.272 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 37793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_pdc2027x.ko 2023-12-12T09:57:10.272 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 20561 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-12-12T09:57:10.272 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 14225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_piccolo.ko 2023-12-12T09:57:10.272 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 15449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_radisys.ko 2023-12-12T09:57:10.272 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 19521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_rdc.ko 2023-12-12T09:57:10.272 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 15329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_rz1000.ko 2023-12-12T09:57:10.272 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sch.ko 2023-12-12T09:57:10.272 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 23097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_serverworks.ko 2023-12-12T09:57:10.272 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 23457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sil680.ko 2023-12-12T09:57:10.272 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 19697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sl82c105.ko 2023-12-12T09:57:10.272 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 16009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_triflex.ko 2023-12-12T09:57:10.272 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 30433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_via.ko 2023-12-12T09:57:10.273 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 22793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pdc_adma.ko 2023-12-12T09:57:10.273 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 29121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_inic162x.ko 2023-12-12T09:57:10.273 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 83345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_mv.ko 2023-12-12T09:57:10.273 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 70393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_nv.ko 2023-12-12T09:57:10.273 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 37377 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_promise.ko 2023-12-12T09:57:10.273 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 23041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_qstor.ko 2023-12-12T09:57:10.273 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 29273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sil.ko 2023-12-12T09:57:10.273 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 38337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sil24.ko 2023-12-12T09:57:10.273 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 17945 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sis.ko 2023-12-12T09:57:10.273 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 20441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_svw.ko 2023-12-12T09:57:10.273 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 44793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sx4.ko 2023-12-12T09:57:10.273 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 15601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_uli.ko 2023-12-12T09:57:10.273 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 35065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_via.ko 2023-12-12T09:57:10.273 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 20065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_vsc.ko 2023-12-12T09:57:10.274 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/auxdisplay/ 2023-12-12T09:57:10.274 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 16289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/auxdisplay/ks0108.ko 2023-12-12T09:57:10.274 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/bcma/ 2023-12-12T09:57:10.274 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 124473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/bcma/bcma.ko 2023-12-12T09:57:10.274 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/ 2023-12-12T09:57:10.274 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/aoe/ 2023-12-12T09:57:10.274 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 113665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/aoe/aoe.ko 2023-12-12T09:57:10.274 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/drbd/ 2023-12-12T09:57:10.274 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 965585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/drbd/drbd.ko 2023-12-12T09:57:10.274 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 173225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/floppy.ko 2023-12-12T09:57:10.274 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/mtip32xx/ 2023-12-12T09:57:10.274 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 94297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-12-12T09:57:10.274 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 115793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/nbd.ko 2023-12-12T09:57:10.274 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/null_blk/ 2023-12-12T09:57:10.274 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 110385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/null_blk/null_blk.ko 2023-12-12T09:57:10.275 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 98193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/pktcdvd.ko 2023-12-12T09:57:10.275 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 263769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/rbd.ko 2023-12-12T09:57:10.275 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/xen-blkback/ 2023-12-12T09:57:10.275 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 98145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-12-12T09:57:10.275 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/zram/ 2023-12-12T09:57:10.275 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 60217 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/zram/zram.ko 2023-12-12T09:57:10.275 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ 2023-12-12T09:57:10.275 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 30705 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/applicom.ko 2023-12-12T09:57:10.275 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hangcheck-timer.ko 2023-12-12T09:57:10.275 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/ 2023-12-12T09:57:10.275 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/amd-rng.ko 2023-12-12T09:57:10.275 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 18809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/intel-rng.ko 2023-12-12T09:57:10.275 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-12-12T09:57:10.275 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/via-rng.ko 2023-12-12T09:57:10.276 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 15633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/virtio-rng.ko 2023-12-12T09:57:10.276 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ 2023-12-12T09:57:10.276 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 30713 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-12-12T09:57:10.276 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 148601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-12-12T09:57:10.276 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 26569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-12-12T09:57:10.276 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 139313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_si.ko 2023-12-12T09:57:10.276 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 70921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-12-12T09:57:10.276 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 53513 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-12-12T09:57:10.276 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 36321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/lp.ko 2023-12-12T09:57:10.276 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/mwave/ 2023-12-12T09:57:10.276 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 84097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/mwave/mwave.ko 2023-12-12T09:57:10.276 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 25873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/nvram.ko 2023-12-12T09:57:10.276 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 32169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ppdev.ko 2023-12-12T09:57:10.276 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 51113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tlclk.ko 2023-12-12T09:57:10.276 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/ 2023-12-12T09:57:10.277 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 16401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_atmel.ko 2023-12-12T09:57:10.277 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 15881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2023-12-12T09:57:10.277 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 23473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2023-12-12T09:57:10.277 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 32985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2023-12-12T09:57:10.277 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 30121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_infineon.ko 2023-12-12T09:57:10.277 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 22697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_nsc.ko 2023-12-12T09:57:10.277 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 23561 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/xen-tpmfront.ko 2023-12-12T09:57:10.277 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/xillybus/ 2023-12-12T09:57:10.277 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 17001 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/xillybus/xillybus_class.ko 2023-12-12T09:57:10.277 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 50945 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/xillybus/xillybus_core.ko 2023-12-12T09:57:10.277 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/xillybus/xillybus_pcie.ko 2023-12-12T09:57:10.277 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/clk/ 2023-12-12T09:57:10.277 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/clk/clk-palmas.ko 2023-12-12T09:57:10.277 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 47849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/clk/clk-si5351.ko 2023-12-12T09:57:10.278 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/clk/clk-twl6040.ko 2023-12-12T09:57:10.278 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 19249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/clk/clk-wm831x.ko 2023-12-12T09:57:10.278 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/ 2023-12-12T09:57:10.278 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-12-12T09:57:10.278 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 16833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/p4-clockmod.ko 2023-12-12T09:57:10.278 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 25297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/speedstep-lib.ko 2023-12-12T09:57:10.278 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/ 2023-12-12T09:57:10.278 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/ccp/ 2023-12-12T09:57:10.278 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 70801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-12-12T09:57:10.278 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 243025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/ccp/ccp.ko 2023-12-12T09:57:10.278 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/ 2023-12-12T09:57:10.278 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/ 2023-12-12T09:57:10.278 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_common/ 2023-12-12T09:57:10.278 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 438761 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-12-12T09:57:10.279 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2023-12-12T09:57:10.279 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 24081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-12-12T09:57:10.279 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 19937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/padlock-aes.ko 2023-12-12T09:57:10.279 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 21537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/padlock-sha.ko 2023-12-12T09:57:10.279 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/virtio/ 2023-12-12T09:57:10.279 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 70273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-12-12T09:57:10.279 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dca/ 2023-12-12T09:57:10.279 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 29785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dca/dca.ko 2023-12-12T09:57:10.279 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/ 2023-12-12T09:57:10.279 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/dw/ 2023-12-12T09:57:10.279 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 15857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/dw/dw_dmac.ko 2023-12-12T09:57:10.279 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/ioat/ 2023-12-12T09:57:10.279 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 122569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/ioat/ioatdma.ko 2023-12-12T09:57:10.279 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/ 2023-12-12T09:57:10.279 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 79953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/amd64_edac.ko 2023-12-12T09:57:10.280 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 35769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/e752x_edac.ko 2023-12-12T09:57:10.280 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 63617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/edac_mce_amd.ko 2023-12-12T09:57:10.280 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 18105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i3000_edac.ko 2023-12-12T09:57:10.280 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 18065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i3200_edac.ko 2023-12-12T09:57:10.280 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 22537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i5100_edac.ko 2023-12-12T09:57:10.280 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 25657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i5400_edac.ko 2023-12-12T09:57:10.280 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 24913 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i7300_edac.ko 2023-12-12T09:57:10.280 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 52041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i7core_edac.ko 2023-12-12T09:57:10.280 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 18433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i82975x_edac.ko 2023-12-12T09:57:10.280 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 20017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/ie31200_edac.ko 2023-12-12T09:57:10.280 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 56825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/sb_edac.ko 2023-12-12T09:57:10.280 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 17529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/x38_edac.ko 2023-12-12T09:57:10.280 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/extcon/ 2023-12-12T09:57:10.280 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/extcon/extcon-gpio.ko 2023-12-12T09:57:10.281 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 27185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/extcon/extcon-max14577.ko 2023-12-12T09:57:10.281 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 29569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/extcon/extcon-max77693.ko 2023-12-12T09:57:10.281 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 24745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/extcon/extcon-max8997.ko 2023-12-12T09:57:10.281 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 26537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/extcon/extcon-palmas.ko 2023-12-12T09:57:10.281 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 23713 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/extcon/extcon-rt8973a.ko 2023-12-12T09:57:10.281 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 27785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/extcon/extcon-sm5502.ko 2023-12-12T09:57:10.281 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware/ 2023-12-12T09:57:10.281 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 34977 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware/dmi-sysfs.ko 2023-12-12T09:57:10.281 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware/efi/ 2023-12-12T09:57:10.281 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 15521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware/efi/efi-pstore.ko 2023-12-12T09:57:10.281 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 20729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware/iscsi_ibft.ko 2023-12-12T09:57:10.281 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/ 2023-12-12T09:57:10.281 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-adp5520.ko 2023-12-12T09:57:10.281 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 20153 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-amd8111.ko 2023-12-12T09:57:10.281 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 14993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-arizona.ko 2023-12-12T09:57:10.282 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-da9052.ko 2023-12-12T09:57:10.282 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-da9055.ko 2023-12-12T09:57:10.282 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 22065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-dln2.ko 2023-12-12T09:57:10.282 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 77849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-f7188x.ko 2023-12-12T09:57:10.282 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 28937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-generic.ko 2023-12-12T09:57:10.282 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 19569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-ich.ko 2023-12-12T09:57:10.282 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-janz-ttl.ko 2023-12-12T09:57:10.282 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 14113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-kempld.ko 2023-12-12T09:57:10.282 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-lp3943.ko 2023-12-12T09:57:10.282 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 9505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-max7300.ko 2023-12-12T09:57:10.282 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-max730x.ko 2023-12-12T09:57:10.282 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 22073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-max732x.ko 2023-12-12T09:57:10.282 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 25145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-ml-ioh.ko 2023-12-12T09:57:10.282 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 47073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-pca953x.ko 2023-12-12T09:57:10.283 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 26825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-pcf857x.ko 2023-12-12T09:57:10.283 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 14377 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-rdc321x.ko 2023-12-12T09:57:10.283 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 20593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-sch.ko 2023-12-12T09:57:10.283 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 19505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-sch311x.ko 2023-12-12T09:57:10.283 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-tps65912.ko 2023-12-12T09:57:10.283 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 21057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-twl4030.ko 2023-12-12T09:57:10.283 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-twl6040.ko 2023-12-12T09:57:10.283 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 20601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-viperboard.ko 2023-12-12T09:57:10.283 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 15377 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-vx855.ko 2023-12-12T09:57:10.283 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 16281 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-wm831x.ko 2023-12-12T09:57:10.283 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-wm8350.ko 2023-12-12T09:57:10.283 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 16753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-wm8994.ko 2023-12-12T09:57:10.283 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/ 2023-12-12T09:57:10.283 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-a4tech.ko 2023-12-12T09:57:10.283 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 39169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-apple.ko 2023-12-12T09:57:10.283 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 14481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-appleir.ko 2023-12-12T09:57:10.284 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 8353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-aureal.ko 2023-12-12T09:57:10.284 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 15169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-axff.ko 2023-12-12T09:57:10.284 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-belkin.ko 2023-12-12T09:57:10.284 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-cherry.ko 2023-12-12T09:57:10.284 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 16041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-chicony.ko 2023-12-12T09:57:10.284 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 60649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-cp2112.ko 2023-12-12T09:57:10.284 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-cypress.ko 2023-12-12T09:57:10.284 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 16385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-dr.ko 2023-12-12T09:57:10.284 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-elecom.ko 2023-12-12T09:57:10.284 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 17665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-elo.ko 2023-12-12T09:57:10.284 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-emsff.ko 2023-12-12T09:57:10.284 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-ezkey.ko 2023-12-12T09:57:10.284 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 14305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-gaff.ko 2023-12-12T09:57:10.284 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 9225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-generic.ko 2023-12-12T09:57:10.284 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 17129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-gt683r.ko 2023-12-12T09:57:10.285 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-gyration.ko 2023-12-12T09:57:10.285 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-holtek-kbd.ko 2023-12-12T09:57:10.285 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-holtek-mouse.ko 2023-12-12T09:57:10.285 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 14449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-holtekff.ko 2023-12-12T09:57:10.285 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 19105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-hyperv.ko 2023-12-12T09:57:10.285 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-icade.ko 2023-12-12T09:57:10.285 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 9241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-kensington.ko 2023-12-12T09:57:10.285 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 8545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-keytouch.ko 2023-12-12T09:57:10.285 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 17201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-kye.ko 2023-12-12T09:57:10.285 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-lcpower.ko 2023-12-12T09:57:10.285 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 20497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-led.ko 2023-12-12T09:57:10.285 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 42297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-lenovo.ko 2023-12-12T09:57:10.285 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 30697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-lg-g15.ko 2023-12-12T09:57:10.285 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 58185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-logitech-dj.ko 2023-12-12T09:57:10.286 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 101481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-12-12T09:57:10.286 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 80993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-logitech.ko 2023-12-12T09:57:10.286 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 30801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-magicmouse.ko 2023-12-12T09:57:10.286 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 21969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-microsoft.ko 2023-12-12T09:57:10.286 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10361 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-monterey.ko 2023-12-12T09:57:10.286 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 50161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-multitouch.ko 2023-12-12T09:57:10.286 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 32593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-ntrig.ko 2023-12-12T09:57:10.286 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 8857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-ortek.ko 2023-12-12T09:57:10.286 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 9121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-penmount.ko 2023-12-12T09:57:10.286 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-petalynx.ko 2023-12-12T09:57:10.286 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 72937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-picolcd.ko 2023-12-12T09:57:10.286 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 14225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-pl.ko 2023-12-12T09:57:10.286 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 15105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-plantronics.ko 2023-12-12T09:57:10.286 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 8417 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-primax.ko 2023-12-12T09:57:10.287 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 35393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-rmi.ko 2023-12-12T09:57:10.287 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 20833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-arvo.ko 2023-12-12T09:57:10.287 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 14065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-common.ko 2023-12-12T09:57:10.287 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 31425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-isku.ko 2023-12-12T09:57:10.287 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 29729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-kone.ko 2023-12-12T09:57:10.287 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 31129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-12-12T09:57:10.287 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 21137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-konepure.ko 2023-12-12T09:57:10.287 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 29489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-12-12T09:57:10.287 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-lua.ko 2023-12-12T09:57:10.287 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 29313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-pyra.ko 2023-12-12T09:57:10.287 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 27937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-ryos.ko 2023-12-12T09:57:10.287 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 19521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-savu.ko 2023-12-12T09:57:10.287 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 23337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat.ko 2023-12-12T09:57:10.287 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-saitek.ko 2023-12-12T09:57:10.288 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 15193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-samsung.ko 2023-12-12T09:57:10.288 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 36817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sensor-hub.ko 2023-12-12T09:57:10.288 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sjoy.ko 2023-12-12T09:57:10.288 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 51249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sony.ko 2023-12-12T09:57:10.288 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 8313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-speedlink.ko 2023-12-12T09:57:10.288 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 25297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-steelseries.ko 2023-12-12T09:57:10.288 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 9817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sunplus.ko 2023-12-12T09:57:10.288 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 16993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-thrustmaster.ko 2023-12-12T09:57:10.288 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-tivo.ko 2023-12-12T09:57:10.288 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 15089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-tmff.ko 2023-12-12T09:57:10.288 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 14385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-topseed.ko 2023-12-12T09:57:10.288 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 16473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-twinhan.ko 2023-12-12T09:57:10.288 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 71073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-uclogic.ko 2023-12-12T09:57:10.288 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-waltop.ko 2023-12-12T09:57:10.288 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 143473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-wiimote.ko 2023-12-12T09:57:10.288 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 8153 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-xinmo.ko 2023-12-12T09:57:10.289 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-zpff.ko 2023-12-12T09:57:10.289 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 16665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-zydacron.ko 2023-12-12T09:57:10.289 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 267825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid.ko 2023-12-12T09:57:10.289 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 32321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/uhid.ko 2023-12-12T09:57:10.289 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/usbhid/ 2023-12-12T09:57:10.289 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 125721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/usbhid/usbhid.ko 2023-12-12T09:57:10.289 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 19137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/usbhid/usbkbd.ko 2023-12-12T09:57:10.289 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 14953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/usbhid/usbmouse.ko 2023-12-12T09:57:10.289 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 217873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/wacom.ko 2023-12-12T09:57:10.289 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv/ 2023-12-12T09:57:10.289 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 64201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv/hv_balloon.ko 2023-12-12T09:57:10.289 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 89625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv/hv_utils.ko 2023-12-12T09:57:10.289 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 305465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv/hv_vmbus.ko 2023-12-12T09:57:10.289 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ 2023-12-12T09:57:10.289 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 66521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/abituguru.ko 2023-12-12T09:57:10.290 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 61393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/abituguru3.ko 2023-12-12T09:57:10.290 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 34745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/acpi_power_meter.ko 2023-12-12T09:57:10.290 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 17505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ad7414.ko 2023-12-12T09:57:10.290 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 19313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ad7418.ko 2023-12-12T09:57:10.290 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 25257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adc128d818.ko 2023-12-12T09:57:10.290 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 31729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1025.ko 2023-12-12T09:57:10.290 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 97977 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1026.ko 2023-12-12T09:57:10.290 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 19745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1029.ko 2023-12-12T09:57:10.290 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 45553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1031.ko 2023-12-12T09:57:10.290 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 26289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm9240.ko 2023-12-12T09:57:10.290 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 14769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ads7828.ko 2023-12-12T09:57:10.290 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7410.ko 2023-12-12T09:57:10.290 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 22049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7411.ko 2023-12-12T09:57:10.290 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 74433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7462.ko 2023-12-12T09:57:10.291 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 39585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7470.ko 2023-12-12T09:57:10.291 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 67929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7475.ko 2023-12-12T09:57:10.291 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 19625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7x10.ko 2023-12-12T09:57:10.291 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 39073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/amc6821.ko 2023-12-12T09:57:10.291 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 55201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/applesmc.ko 2023-12-12T09:57:10.291 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 49913 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/asb100.ko 2023-12-12T09:57:10.291 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 58617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/asc7621.ko 2023-12-12T09:57:10.291 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 40825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/asus_atk0110.ko 2023-12-12T09:57:10.291 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 17225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/atxp1.ko 2023-12-12T09:57:10.291 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 28281 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/coretemp.ko 2023-12-12T09:57:10.291 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 24593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/da9052-hwmon.ko 2023-12-12T09:57:10.291 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 17265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/da9055-hwmon.ko 2023-12-12T09:57:10.291 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 44465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-12-12T09:57:10.291 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 99601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/dme1737.ko 2023-12-12T09:57:10.291 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 19489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ds1621.ko 2023-12-12T09:57:10.325 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 15321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ds620.ko 2023-12-12T09:57:10.325 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 29777 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/emc1403.ko 2023-12-12T09:57:10.325 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 33185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/emc2103.ko 2023-12-12T09:57:10.326 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 30321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/emc6w201.ko 2023-12-12T09:57:10.326 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 66985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/f71805f.ko 2023-12-12T09:57:10.326 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 94457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/f71882fg.ko 2023-12-12T09:57:10.326 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 41401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/f75375s.ko 2023-12-12T09:57:10.326 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 21305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/fam15h_power.ko 2023-12-12T09:57:10.326 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 55449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/fschmd.ko 2023-12-12T09:57:10.326 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 14481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/g760a.ko 2023-12-12T09:57:10.326 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 24017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/g762.ko 2023-12-12T09:57:10.326 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 46801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/gl518sm.ko 2023-12-12T09:57:10.326 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 45529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/gl520sm.ko 2023-12-12T09:57:10.326 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/hih6130.ko 2023-12-12T09:57:10.326 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 9745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/hwmon-vid.ko 2023-12-12T09:57:10.326 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/i5500_temp.ko 2023-12-12T09:57:10.326 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 22601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/i5k_amb.ko 2023-12-12T09:57:10.327 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 34529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ibmaem.ko 2023-12-12T09:57:10.327 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 21257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ibmpex.ko 2023-12-12T09:57:10.327 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 24873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ina209.ko 2023-12-12T09:57:10.327 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ina2xx.ko 2023-12-12T09:57:10.327 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 130449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/it87.ko 2023-12-12T09:57:10.327 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 18841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/jc42.ko 2023-12-12T09:57:10.327 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 24329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/k10temp.ko 2023-12-12T09:57:10.327 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/k8temp.ko 2023-12-12T09:57:10.327 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 18929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lineage-pem.ko 2023-12-12T09:57:10.327 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 48601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm63.ko 2023-12-12T09:57:10.327 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 16697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm73.ko 2023-12-12T09:57:10.327 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 36777 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm75.ko 2023-12-12T09:57:10.327 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 19537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm77.ko 2023-12-12T09:57:10.327 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 34593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm78.ko 2023-12-12T09:57:10.328 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 31745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm80.ko 2023-12-12T09:57:10.328 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 16889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm83.ko 2023-12-12T09:57:10.328 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 72833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm85.ko 2023-12-12T09:57:10.328 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 46153 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm87.ko 2023-12-12T09:57:10.328 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 37913 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm90.ko 2023-12-12T09:57:10.328 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 19745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm92.ko 2023-12-12T09:57:10.328 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 108841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm93.ko 2023-12-12T09:57:10.328 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 33393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm95234.ko 2023-12-12T09:57:10.328 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 16201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm95241.ko 2023-12-12T09:57:10.328 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 18113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm95245.ko 2023-12-12T09:57:10.328 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 24017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc2945.ko 2023-12-12T09:57:10.328 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4151.ko 2023-12-12T09:57:10.328 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 15193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4215.ko 2023-12-12T09:57:10.328 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 14889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4222.ko 2023-12-12T09:57:10.329 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 14825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4245.ko 2023-12-12T09:57:10.329 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4260.ko 2023-12-12T09:57:10.329 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 14993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4261.ko 2023-12-12T09:57:10.329 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 33489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max16065.ko 2023-12-12T09:57:10.329 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 18433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max1619.ko 2023-12-12T09:57:10.329 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 24353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max1668.ko 2023-12-12T09:57:10.329 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 19969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max197.ko 2023-12-12T09:57:10.329 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 27129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max6639.ko 2023-12-12T09:57:10.329 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 23321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max6650.ko 2023-12-12T09:57:10.329 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 35777 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max6697.ko 2023-12-12T09:57:10.329 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 18585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/mc13783-adc.ko 2023-12-12T09:57:10.329 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/mcp3021.ko 2023-12-12T09:57:10.329 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 15937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2023-12-12T09:57:10.329 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 44129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct6683.ko 2023-12-12T09:57:10.330 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 119817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct6775-core.ko 2023-12-12T09:57:10.330 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 60705 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct6775.ko 2023-12-12T09:57:10.330 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 59737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct7802.ko 2023-12-12T09:57:10.330 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 82337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pc87360.ko 2023-12-12T09:57:10.330 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 54433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pc87427.ko 2023-12-12T09:57:10.330 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 18473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pcf8591.ko 2023-12-12T09:57:10.330 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/ 2023-12-12T09:57:10.330 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 21353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-12-12T09:57:10.330 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 17065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-12-12T09:57:10.330 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 28329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-12-12T09:57:10.330 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 9577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/max16064.ko 2023-12-12T09:57:10.330 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 17657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/max34440.ko 2023-12-12T09:57:10.330 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/max8688.ko 2023-12-12T09:57:10.330 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 15505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-12-12T09:57:10.331 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 82577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-12-12T09:57:10.331 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 8729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-12-12T09:57:10.331 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 30729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-12-12T09:57:10.331 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 15073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-12-12T09:57:10.331 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 20681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-12-12T09:57:10.331 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/powr1220.ko 2023-12-12T09:57:10.331 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 18705 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sch5627.ko 2023-12-12T09:57:10.331 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 28817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sch5636.ko 2023-12-12T09:57:10.331 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 27145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sch56xx-common.ko 2023-12-12T09:57:10.331 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 32137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sht15.ko 2023-12-12T09:57:10.331 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sht21.ko 2023-12-12T09:57:10.331 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 16833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/shtc1.ko 2023-12-12T09:57:10.331 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 40105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sis5595.ko 2023-12-12T09:57:10.331 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 19577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/smsc47b397.ko 2023-12-12T09:57:10.331 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 39193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/smsc47m1.ko 2023-12-12T09:57:10.332 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 37385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/smsc47m192.ko 2023-12-12T09:57:10.332 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 26553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/thmc50.ko 2023-12-12T09:57:10.332 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 17057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp102.ko 2023-12-12T09:57:10.332 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 14097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp103.ko 2023-12-12T09:57:10.332 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 21257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp401.ko 2023-12-12T09:57:10.332 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 19537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp421.ko 2023-12-12T09:57:10.332 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 19721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/via-cputemp.ko 2023-12-12T09:57:10.332 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 41945 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/via686a.ko 2023-12-12T09:57:10.332 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 52457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/vt1211.ko 2023-12-12T09:57:10.332 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 51545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/vt8231.ko 2023-12-12T09:57:10.332 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 57449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83627ehf.ko 2023-12-12T09:57:10.332 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 78873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83627hf.ko 2023-12-12T09:57:10.332 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 71345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83781d.ko 2023-12-12T09:57:10.332 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 63225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83791d.ko 2023-12-12T09:57:10.332 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 71321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83792d.ko 2023-12-12T09:57:10.333 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 101473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83793.ko 2023-12-12T09:57:10.333 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 119505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83795.ko 2023-12-12T09:57:10.333 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 17313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83l785ts.ko 2023-12-12T09:57:10.333 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 35625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83l786ng.ko 2023-12-12T09:57:10.333 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/wm831x-hwmon.ko 2023-12-12T09:57:10.333 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/wm8350-hwmon.ko 2023-12-12T09:57:10.333 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/ 2023-12-12T09:57:10.333 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/algos/ 2023-12-12T09:57:10.333 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 20049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-12-12T09:57:10.333 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 19345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-12-12T09:57:10.333 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/ 2023-12-12T09:57:10.333 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 27969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-ali1535.ko 2023-12-12T09:57:10.333 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 28801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-ali1563.ko 2023-12-12T09:57:10.333 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 27777 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2023-12-12T09:57:10.333 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 17937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-12-12T09:57:10.334 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 26193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-12-12T09:57:10.334 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 16201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-12-12T09:57:10.334 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 15153 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2023-12-12T09:57:10.334 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 6929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-12-12T09:57:10.334 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2023-12-12T09:57:10.334 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 50201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-12-12T09:57:10.334 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 23905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-12-12T09:57:10.334 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 20001 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-12-12T09:57:10.334 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 17337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-12-12T09:57:10.334 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-dln2.ko 2023-12-12T09:57:10.334 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 17585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-gpio.ko 2023-12-12T09:57:10.334 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 62817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-i801.ko 2023-12-12T09:57:10.334 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 22433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-isch.ko 2023-12-12T09:57:10.334 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 47889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-12-12T09:57:10.334 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 17721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-kempld.ko 2023-12-12T09:57:10.335 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 17881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-12-12T09:57:10.335 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 22337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-12-12T09:57:10.335 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 26265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-ocores.ko 2023-12-12T09:57:10.335 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 25145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-parport.ko 2023-12-12T09:57:10.335 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 16497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-12-12T09:57:10.335 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 47241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-12-12T09:57:10.335 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 15289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2023-12-12T09:57:10.335 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 18649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-12-12T09:57:10.335 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-12-12T09:57:10.335 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 22313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-sis5595.ko 2023-12-12T09:57:10.335 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 29361 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-sis630.ko 2023-12-12T09:57:10.335 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 20329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-12-12T09:57:10.335 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 19241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2023-12-12T09:57:10.335 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 19809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-12-12T09:57:10.336 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-via.ko 2023-12-12T09:57:10.336 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 26081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-12-12T09:57:10.336 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 19041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-12-12T09:57:10.336 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 47657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-xiic.ko 2023-12-12T09:57:10.336 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 22449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-mux.ko 2023-12-12T09:57:10.336 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 18825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-smbus.ko 2023-12-12T09:57:10.336 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 27073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-stub.ko 2023-12-12T09:57:10.336 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/muxes/ 2023-12-12T09:57:10.336 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 14921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2023-12-12T09:57:10.336 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2023-12-12T09:57:10.336 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 29737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2023-12-12T09:57:10.336 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ 2023-12-12T09:57:10.336 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ 2023-12-12T09:57:10.336 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 273609 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_cm.ko 2023-12-12T09:57:10.336 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 879969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_core.ko 2023-12-12T09:57:10.337 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 69273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_umad.ko 2023-12-12T09:57:10.337 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 324217 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-12-12T09:57:10.337 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 97985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/iw_cm.ko 2023-12-12T09:57:10.337 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 282273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/rdma_cm.ko 2023-12-12T09:57:10.337 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 66201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-12-12T09:57:10.337 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/ 2023-12-12T09:57:10.337 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/cxgb4/ 2023-12-12T09:57:10.337 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 493073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-12-12T09:57:10.337 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx4/ 2023-12-12T09:57:10.337 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 419737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-12-12T09:57:10.337 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx5/ 2023-12-12T09:57:10.337 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 739025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-12-12T09:57:10.337 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mthca/ 2023-12-12T09:57:10.337 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 296625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-12-12T09:57:10.337 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/ocrdma/ 2023-12-12T09:57:10.338 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 153697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2023-12-12T09:57:10.338 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/usnic/ 2023-12-12T09:57:10.338 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 168969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2023-12-12T09:57:10.338 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/ 2023-12-12T09:57:10.338 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/ipoib/ 2023-12-12T09:57:10.338 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 263081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-12-12T09:57:10.338 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/iser/ 2023-12-12T09:57:10.338 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 100241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-12-12T09:57:10.338 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/isert/ 2023-12-12T09:57:10.338 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 111425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-12-12T09:57:10.338 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srp/ 2023-12-12T09:57:10.338 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 128753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-12-12T09:57:10.338 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srpt/ 2023-12-12T09:57:10.338 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 129529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-12-12T09:57:10.339 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/ 2023-12-12T09:57:10.339 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/evbug.ko 2023-12-12T09:57:10.339 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 24129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/ff-memless.ko 2023-12-12T09:57:10.339 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport/ 2023-12-12T09:57:10.339 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-12-12T09:57:10.339 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport/fm801-gp.ko 2023-12-12T09:57:10.339 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 41241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport/gameport.ko 2023-12-12T09:57:10.339 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 41801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/joydev.ko 2023-12-12T09:57:10.339 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/ 2023-12-12T09:57:10.339 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/adp5520-keys.ko 2023-12-12T09:57:10.339 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/adp5588-keys.ko 2023-12-12T09:57:10.339 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 26841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/adp5589-keys.ko 2023-12-12T09:57:10.339 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 24761 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2023-12-12T09:57:10.339 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 36665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/gpio_keys.ko 2023-12-12T09:57:10.339 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 18625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2023-12-12T09:57:10.340 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 21257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/lkkbd.ko 2023-12-12T09:57:10.340 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 26473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/lm8323.ko 2023-12-12T09:57:10.340 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 14409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/lm8333.ko 2023-12-12T09:57:10.340 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 24265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/matrix_keypad.ko 2023-12-12T09:57:10.340 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 18217 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/max7359_keypad.ko 2023-12-12T09:57:10.340 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 15929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/mcs_touchkey.ko 2023-12-12T09:57:10.340 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 16489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2023-12-12T09:57:10.340 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/newtonkbd.ko 2023-12-12T09:57:10.340 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/opencores-kbd.ko 2023-12-12T09:57:10.340 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 14161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/qt1070.ko 2023-12-12T09:57:10.340 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 17929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/qt2160.ko 2023-12-12T09:57:10.340 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 23817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/samsung-keypad.ko 2023-12-12T09:57:10.340 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/stowaway.ko 2023-12-12T09:57:10.340 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 18289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/sunkbd.ko 2023-12-12T09:57:10.340 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 17425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/tca6416-keypad.ko 2023-12-12T09:57:10.341 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 16177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/tca8418_keypad.ko 2023-12-12T09:57:10.341 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 16801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/twl4030_keypad.ko 2023-12-12T09:57:10.341 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/xtkbd.ko 2023-12-12T09:57:10.341 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/matrix-keymap.ko 2023-12-12T09:57:10.341 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/ 2023-12-12T09:57:10.341 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 34329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/appletouch.ko 2023-12-12T09:57:10.341 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 34177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/bcm5974.ko 2023-12-12T09:57:10.341 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 123681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/cyapatp.ko 2023-12-12T09:57:10.341 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 89449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/elan_i2c.ko 2023-12-12T09:57:10.341 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/gpio_mouse.ko 2023-12-12T09:57:10.341 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 335929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/psmouse.ko 2023-12-12T09:57:10.341 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 14681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/sermouse.ko 2023-12-12T09:57:10.341 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 23881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-12-12T09:57:10.341 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 22569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/synaptics_usb.ko 2023-12-12T09:57:10.341 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 15665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/vsxxxaa.ko 2023-12-12T09:57:10.342 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/rmi4/ 2023-12-12T09:57:10.342 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 109873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/rmi4/rmi_core.ko 2023-12-12T09:57:10.342 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/ 2023-12-12T09:57:10.342 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/altera_ps2.ko 2023-12-12T09:57:10.342 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 16289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/arc_ps2.ko 2023-12-12T09:57:10.342 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 16425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/ct82c710.ko 2023-12-12T09:57:10.342 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 16953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-12-12T09:57:10.342 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 15833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/parkbd.ko 2023-12-12T09:57:10.342 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/pcips2.ko 2023-12-12T09:57:10.342 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 20153 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/ps2mult.ko 2023-12-12T09:57:10.342 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 24153 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/serio_raw.ko 2023-12-12T09:57:10.342 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 17977 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/serport.ko 2023-12-12T09:57:10.342 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/sparse-keymap.ko 2023-12-12T09:57:10.342 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/iommu/ 2023-12-12T09:57:10.343 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/iommu/amd/ 2023-12-12T09:57:10.343 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 39289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/iommu/amd/iommu_v2.ko 2023-12-12T09:57:10.343 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/ 2023-12-12T09:57:10.343 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-88pm860x.ko 2023-12-12T09:57:10.343 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-adp5520.ko 2023-12-12T09:57:10.343 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 59753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-bd2802.ko 2023-12-12T09:57:10.343 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 24785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-blinkm.ko 2023-12-12T09:57:10.343 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-da903x.ko 2023-12-12T09:57:10.343 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-da9052.ko 2023-12-12T09:57:10.343 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 16561 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-gpio.ko 2023-12-12T09:57:10.343 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 15793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-lm3530.ko 2023-12-12T09:57:10.343 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 30505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-lm3533.ko 2023-12-12T09:57:10.343 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 19353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-lm355x.ko 2023-12-12T09:57:10.343 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 19961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-lm3642.ko 2023-12-12T09:57:10.344 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 16241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-lp3944.ko 2023-12-12T09:57:10.344 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11233 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-lp8788.ko 2023-12-12T09:57:10.344 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 14929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-max8997.ko 2023-12-12T09:57:10.344 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-mc13783.ko 2023-12-12T09:57:10.344 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-menf21bmc.ko 2023-12-12T09:57:10.344 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 20721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-pca9532.ko 2023-12-12T09:57:10.344 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 20481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-pca955x.ko 2023-12-12T09:57:10.344 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 17857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-pca963x.ko 2023-12-12T09:57:10.344 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 34433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-ss4200.ko 2023-12-12T09:57:10.344 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 24865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-tca6507.ko 2023-12-12T09:57:10.344 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 15665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-wm831x-status.ko 2023-12-12T09:57:10.344 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-wm8350.ko 2023-12-12T09:57:10.344 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ 2023-12-12T09:57:10.344 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 9985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-12-12T09:57:10.344 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-12-12T09:57:10.345 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 9089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-12-12T09:57:10.345 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 7617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-12-12T09:57:10.345 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 14249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-12-12T09:57:10.345 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 14073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-12-12T09:57:10.345 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-12-12T09:57:10.345 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 14073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-12-12T09:57:10.345 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/ 2023-12-12T09:57:10.345 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/bcache/ 2023-12-12T09:57:10.345 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 654969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/bcache/bcache.ko 2023-12-12T09:57:10.345 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 40577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-bio-prison.ko 2023-12-12T09:57:10.345 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 89601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-bufio.ko 2023-12-12T09:57:10.345 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 47529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-cache-smq.ko 2023-12-12T09:57:10.345 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 156009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-cache.ko 2023-12-12T09:57:10.345 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 106897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-crypt.ko 2023-12-12T09:57:10.346 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 21545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-delay.ko 2023-12-12T09:57:10.346 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 53857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-era.ko 2023-12-12T09:57:10.346 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 28465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-flakey.ko 2023-12-12T09:57:10.346 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 41529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-log-userspace.ko 2023-12-12T09:57:10.346 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 32737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-log.ko 2023-12-12T09:57:10.346 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 49545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-mirror.ko 2023-12-12T09:57:10.346 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 78033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-multipath.ko 2023-12-12T09:57:10.346 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 16473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-queue-length.ko 2023-12-12T09:57:10.346 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 70825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-raid.ko 2023-12-12T09:57:10.346 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 36297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-region-hash.ko 2023-12-12T09:57:10.346 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 15873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-round-robin.ko 2023-12-12T09:57:10.346 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 16801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-service-time.ko 2023-12-12T09:57:10.346 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 109529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-snapshot.ko 2023-12-12T09:57:10.346 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 19361 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-switch.ko 2023-12-12T09:57:10.347 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 181865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-thin-pool.ko 2023-12-12T09:57:10.347 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 51737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-verity.ko 2023-12-12T09:57:10.347 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 8561 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-zero.ko 2023-12-12T09:57:10.347 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 15345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/faulty.ko 2023-12-12T09:57:10.347 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 19625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/linear.ko 2023-12-12T09:57:10.347 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 32417 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/multipath.ko 2023-12-12T09:57:10.347 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/persistent-data/ 2023-12-12T09:57:10.347 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 199937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-12-12T09:57:10.347 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 37337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid0.ko 2023-12-12T09:57:10.347 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 113073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid1.ko 2023-12-12T09:57:10.347 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 158681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid10.ko 2023-12-12T09:57:10.347 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 395721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid456.ko 2023-12-12T09:57:10.347 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/ 2023-12-12T09:57:10.347 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/ 2023-12-12T09:57:10.347 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 178137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptbase.ko 2023-12-12T09:57:10.347 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 63385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptctl.ko 2023-12-12T09:57:10.348 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 44665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptfc.ko 2023-12-12T09:57:10.348 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 37225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptlan.ko 2023-12-12T09:57:10.348 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 123321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptsas.ko 2023-12-12T09:57:10.348 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 79041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptscsih.ko 2023-12-12T09:57:10.348 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 53017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptspi.ko 2023-12-12T09:57:10.348 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/ 2023-12-12T09:57:10.348 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 17305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/88pm800.ko 2023-12-12T09:57:10.348 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12761 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/88pm805.ko 2023-12-12T09:57:10.348 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/88pm80x.ko 2023-12-12T09:57:10.348 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/arizona-i2c.ko 2023-12-12T09:57:10.348 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 123721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/arizona.ko 2023-12-12T09:57:10.348 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/bcm590xx.ko 2023-12-12T09:57:10.348 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 17465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/cros_ec_dev.ko 2023-12-12T09:57:10.348 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 34961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/dln2.ko 2023-12-12T09:57:10.348 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 16689 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/janz-cmodio.ko 2023-12-12T09:57:10.348 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 53585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/kempld-core.ko 2023-12-12T09:57:10.349 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 27529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/lm3533-core.ko 2023-12-12T09:57:10.349 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 14993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/lm3533-ctrlbank.ko 2023-12-12T09:57:10.349 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/lp3943.ko 2023-12-12T09:57:10.349 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 54569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/lpc_ich.ko 2023-12-12T09:57:10.349 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/lpc_sch.ko 2023-12-12T09:57:10.349 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 17409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/max8907.ko 2023-12-12T09:57:10.349 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 29857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/mc13xxx-core.ko 2023-12-12T09:57:10.349 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/mc13xxx-i2c.ko 2023-12-12T09:57:10.349 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/menf21bmc.ko 2023-12-12T09:57:10.349 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 17329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/pcf50633-adc.ko 2023-12-12T09:57:10.349 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 9153 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/pcf50633-gpio.ko 2023-12-12T09:57:10.349 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 34873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/pcf50633.ko 2023-12-12T09:57:10.349 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/rdc321x-southbridge.ko 2023-12-12T09:57:10.349 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 20289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/retu-mfd.ko 2023-12-12T09:57:10.350 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 80425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/si476x-core.ko 2023-12-12T09:57:10.350 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 48457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/sm501.ko 2023-12-12T09:57:10.350 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 19825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/ti_am335x_tscadc.ko 2023-12-12T09:57:10.350 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 51137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/tps65010.ko 2023-12-12T09:57:10.350 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/tps6507x.ko 2023-12-12T09:57:10.350 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/viperboard.ko 2023-12-12T09:57:10.350 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/vx855.ko 2023-12-12T09:57:10.350 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 17953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/wl1273-core.ko 2023-12-12T09:57:10.350 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 44345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/wm8994.ko 2023-12-12T09:57:10.350 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/ 2023-12-12T09:57:10.350 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/ad525x_dpot-i2c.ko 2023-12-12T09:57:10.350 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 48489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/ad525x_dpot.ko 2023-12-12T09:57:10.350 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/altera-stapl/ 2023-12-12T09:57:10.350 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 46585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-12-12T09:57:10.350 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 18393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/apds9802als.ko 2023-12-12T09:57:10.351 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 36729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/apds990x.ko 2023-12-12T09:57:10.351 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 45593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/bh1770glc.ko 2023-12-12T09:57:10.351 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/c2port/ 2023-12-12T09:57:10.351 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2023-12-12T09:57:10.351 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 35281 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/c2port/core.ko 2023-12-12T09:57:10.351 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/cb710/ 2023-12-12T09:57:10.351 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 25161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/cb710/cb710.ko 2023-12-12T09:57:10.351 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 17801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/ds1682.ko 2023-12-12T09:57:10.351 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 8897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/dummy-irq.ko 2023-12-12T09:57:10.351 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/echo/ 2023-12-12T09:57:10.351 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/echo/echo.ko 2023-12-12T09:57:10.351 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/ 2023-12-12T09:57:10.351 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 37849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/at24.ko 2023-12-12T09:57:10.351 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 14321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/eeprom.ko 2023-12-12T09:57:10.351 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 14769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-12-12T09:57:10.352 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/max6875.ko 2023-12-12T09:57:10.352 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 33009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/enclosure.ko 2023-12-12T09:57:10.352 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/genwqe/ 2023-12-12T09:57:10.352 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 152201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/genwqe/genwqe_card.ko 2023-12-12T09:57:10.352 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 14129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/hmc6352.ko 2023-12-12T09:57:10.352 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 31257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/hpilo.ko 2023-12-12T09:57:10.352 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/ibmasm/ 2023-12-12T09:57:10.352 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 72129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/ibmasm/ibmasm.ko 2023-12-12T09:57:10.352 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 19785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/ics932s401.ko 2023-12-12T09:57:10.352 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 21681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/isl29003.ko 2023-12-12T09:57:10.352 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 15753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/isl29020.ko 2023-12-12T09:57:10.352 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/lis3lv02d/ 2023-12-12T09:57:10.352 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 42513 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-12-12T09:57:10.352 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-12-12T09:57:10.352 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei/ 2023-12-12T09:57:10.353 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 125209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei/mei-me.ko 2023-12-12T09:57:10.353 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 56521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei/mei-txe.ko 2023-12-12T09:57:10.353 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 310113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei/mei.ko 2023-12-12T09:57:10.353 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 31329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/phantom.ko 2023-12-12T09:57:10.353 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/ti-st/ 2023-12-12T09:57:10.353 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 74265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/ti-st/st_drv.ko 2023-12-12T09:57:10.353 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 24305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/tifm_7xx1.ko 2023-12-12T09:57:10.353 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 28785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/tifm_core.ko 2023-12-12T09:57:10.353 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 18729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/tsl2550.ko 2023-12-12T09:57:10.353 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 48697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/vmw_balloon.ko 2023-12-12T09:57:10.353 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/vmw_vmci/ 2023-12-12T09:57:10.353 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 183609 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-12-12T09:57:10.353 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ 2023-12-12T09:57:10.353 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/bonding/ 2023-12-12T09:57:10.353 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 490129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/bonding/bonding.ko 2023-12-12T09:57:10.354 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/ 2023-12-12T09:57:10.354 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/b53/ 2023-12-12T09:57:10.354 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 106033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/b53/b53_common.ko 2023-12-12T09:57:10.354 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 40417 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/bcm-sf2.ko 2023-12-12T09:57:10.354 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 16041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/mv88e6060.ko 2023-12-12T09:57:10.354 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/mv88e6xxx/ 2023-12-12T09:57:10.354 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 453737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-12-12T09:57:10.354 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 16929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dummy.ko 2023-12-12T09:57:10.354 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 17961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/eql.ko 2023-12-12T09:57:10.354 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ 2023-12-12T09:57:10.354 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/ 2023-12-12T09:57:10.354 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 45785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-12-12T09:57:10.354 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 42105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-12-12T09:57:10.354 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 130553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-12-12T09:57:10.354 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 68849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-12-12T09:57:10.355 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/ 2023-12-12T09:57:10.355 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 37649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/8390.ko 2023-12-12T09:57:10.355 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 59689 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-12-12T09:57:10.355 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 27201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-12-12T09:57:10.355 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 99049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-12-12T09:57:10.355 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/adaptec/ 2023-12-12T09:57:10.355 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 54521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-12-12T09:57:10.355 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/agere/ 2023-12-12T09:57:10.355 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 69137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/agere/et131x.ko 2023-12-12T09:57:10.355 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/alteon/ 2023-12-12T09:57:10.355 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 59585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-12-12T09:57:10.355 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/altera/ 2023-12-12T09:57:10.355 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 41409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-12-12T09:57:10.355 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd/ 2023-12-12T09:57:10.355 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 54609 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-12-12T09:57:10.356 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 49289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-12-12T09:57:10.356 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 87297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-12-12T09:57:10.356 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/ 2023-12-12T09:57:10.356 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/alx/ 2023-12-12T09:57:10.356 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 97337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-12-12T09:57:10.356 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1c/ 2023-12-12T09:57:10.356 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 104673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-12-12T09:57:10.356 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1e/ 2023-12-12T09:57:10.356 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 90257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-12-12T09:57:10.356 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atlx/ 2023-12-12T09:57:10.356 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 81569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-12-12T09:57:10.356 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 69729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-12-12T09:57:10.356 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/ 2023-12-12T09:57:10.356 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 78401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-12-12T09:57:10.357 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 176761 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-12-12T09:57:10.357 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2023-12-12T09:57:10.357 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 1421497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-12-12T09:57:10.357 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 128569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-12-12T09:57:10.357 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/genet/ 2023-12-12T09:57:10.357 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 132089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-12-12T09:57:10.357 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 312081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-12-12T09:57:10.357 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/brocade/ 2023-12-12T09:57:10.357 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/brocade/bna/ 2023-12-12T09:57:10.357 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 323513 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-12-12T09:57:10.357 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/ 2023-12-12T09:57:10.357 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb/ 2023-12-12T09:57:10.357 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 193497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-12-12T09:57:10.357 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2023-12-12T09:57:10.357 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 347417 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-12-12T09:57:10.358 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2023-12-12T09:57:10.358 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 1044497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-12-12T09:57:10.358 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2023-12-12T09:57:10.358 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 166193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-12-12T09:57:10.358 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2023-12-12T09:57:10.358 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 34881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-12-12T09:57:10.358 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/cisco/ 2023-12-12T09:57:10.358 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/cisco/enic/ 2023-12-12T09:57:10.358 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 204345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-12-12T09:57:10.358 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/ 2023-12-12T09:57:10.358 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/ 2023-12-12T09:57:10.358 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 69449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-12-12T09:57:10.358 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 61489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-12-12T09:57:10.358 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 141225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-12-12T09:57:10.359 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 51497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-12-12T09:57:10.359 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 62817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-12-12T09:57:10.359 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 31369 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-12-12T09:57:10.359 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dlink/ 2023-12-12T09:57:10.359 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 60873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-12-12T09:57:10.359 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 62833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-12-12T09:57:10.359 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 45721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dnet.ko 2023-12-12T09:57:10.359 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 25185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ec_bhf.ko 2023-12-12T09:57:10.359 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/emulex/ 2023-12-12T09:57:10.359 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/emulex/benet/ 2023-12-12T09:57:10.359 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 281137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-12-12T09:57:10.359 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 49457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ethoc.ko 2023-12-12T09:57:10.359 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 51737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/fealnx.ko 2023-12-12T09:57:10.359 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/fujitsu/ 2023-12-12T09:57:10.359 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 45345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2023-12-12T09:57:10.360 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ 2023-12-12T09:57:10.360 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 90465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e100.ko 2023-12-12T09:57:10.360 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000/ 2023-12-12T09:57:10.360 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 295577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-12-12T09:57:10.360 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000e/ 2023-12-12T09:57:10.360 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 584497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-12-12T09:57:10.360 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/fm10k/ 2023-12-12T09:57:10.360 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 246209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-12-12T09:57:10.360 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/i40e/ 2023-12-12T09:57:10.360 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 925825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-12-12T09:57:10.360 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/iavf/ 2023-12-12T09:57:10.360 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 302937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-12-12T09:57:10.360 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igb/ 2023-12-12T09:57:10.360 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 514641 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-12-12T09:57:10.360 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igbvf/ 2023-12-12T09:57:10.361 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 93593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-12-12T09:57:10.361 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbe/ 2023-12-12T09:57:10.361 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 734305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-12-12T09:57:10.361 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbevf/ 2023-12-12T09:57:10.361 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 151769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-12-12T09:57:10.361 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 86921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/jme.ko 2023-12-12T09:57:10.361 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell/ 2023-12-12T09:57:10.361 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 20977 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-12-12T09:57:10.361 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 102289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell/skge.ko 2023-12-12T09:57:10.361 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 122649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-12-12T09:57:10.420 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/ 2023-12-12T09:57:10.420 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx4/ 2023-12-12T09:57:10.421 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 727601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-12-12T09:57:10.421 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 278937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-12-12T09:57:10.421 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx5/ 2023-12-12T09:57:10.421 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2023-12-12T09:57:10.421 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 1113681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-12-12T09:57:10.421 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/micrel/ 2023-12-12T09:57:10.421 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 53041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/micrel/ks8842.ko 2023-12-12T09:57:10.421 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 40993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2023-12-12T09:57:10.421 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 19489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2023-12-12T09:57:10.421 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 95665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-12-12T09:57:10.421 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/myricom/ 2023-12-12T09:57:10.421 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/myricom/myri10ge/ 2023-12-12T09:57:10.421 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 108649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-12-12T09:57:10.421 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/natsemi/ 2023-12-12T09:57:10.421 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 73441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-12-12T09:57:10.422 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 47777 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-12-12T09:57:10.422 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/neterion/ 2023-12-12T09:57:10.422 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 150905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-12-12T09:57:10.422 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/nvidia/ 2023-12-12T09:57:10.422 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 136721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-12-12T09:57:10.422 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/packetengines/ 2023-12-12T09:57:10.422 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 50481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-12-12T09:57:10.422 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 43145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-12-12T09:57:10.422 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/ 2023-12-12T09:57:10.422 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/netxen/ 2023-12-12T09:57:10.422 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 227897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-12-12T09:57:10.422 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 87081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-12-12T09:57:10.422 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2023-12-12T09:57:10.422 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 672049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-12-12T09:57:10.423 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/rdc/ 2023-12-12T09:57:10.423 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 43017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-12-12T09:57:10.423 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/ 2023-12-12T09:57:10.423 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 67385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-12-12T09:57:10.423 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 83985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-12-12T09:57:10.423 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 29321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/atp.ko 2023-12-12T09:57:10.423 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 189801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-12-12T09:57:10.423 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/samsung/ 2023-12-12T09:57:10.423 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/samsung/sxgbe/ 2023-12-12T09:57:10.423 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 104241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2023-12-12T09:57:10.423 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sfc/ 2023-12-12T09:57:10.423 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 1052497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-12-12T09:57:10.423 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/silan/ 2023-12-12T09:57:10.423 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 47097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-12-12T09:57:10.423 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sis/ 2023-12-12T09:57:10.424 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 54817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sis/sis190.ko 2023-12-12T09:57:10.424 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 63337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sis/sis900.ko 2023-12-12T09:57:10.424 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/ 2023-12-12T09:57:10.424 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 61537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-12-12T09:57:10.424 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 67193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-12-12T09:57:10.424 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 73409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-12-12T09:57:10.424 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 68177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-12-12T09:57:10.424 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/ 2023-12-12T09:57:10.424 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac/ 2023-12-12T09:57:10.424 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2023-12-12T09:57:10.424 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 39905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-12-12T09:57:10.424 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 20657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2023-12-12T09:57:10.424 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 487025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-12-12T09:57:10.424 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/ 2023-12-12T09:57:10.424 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 103337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/cassini.ko 2023-12-12T09:57:10.425 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 166097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/niu.ko 2023-12-12T09:57:10.425 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 66329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/sungem.ko 2023-12-12T09:57:10.425 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 78801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-12-12T09:57:10.425 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/tehuti/ 2023-12-12T09:57:10.425 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 50057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-12-12T09:57:10.425 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ti/ 2023-12-12T09:57:10.425 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 86529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ti/tlan.ko 2023-12-12T09:57:10.425 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/via/ 2023-12-12T09:57:10.425 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 80273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-12-12T09:57:10.425 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 83633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-12-12T09:57:10.425 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/wiznet/ 2023-12-12T09:57:10.425 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 46241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-12-12T09:57:10.425 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 30849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-12-12T09:57:10.425 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/xircom/ 2023-12-12T09:57:10.426 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 59993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-12-12T09:57:10.426 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/fddi/ 2023-12-12T09:57:10.426 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 41001 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/fddi/defxx.ko 2023-12-12T09:57:10.426 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/fddi/skfp/ 2023-12-12T09:57:10.426 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 216985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/fddi/skfp/skfp.ko 2023-12-12T09:57:10.426 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 77345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/geneve.ko 2023-12-12T09:57:10.426 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/hyperv/ 2023-12-12T09:57:10.426 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 235521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-12-12T09:57:10.426 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ieee802154/ 2023-12-12T09:57:10.426 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 18273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ieee802154/fakelb.ko 2023-12-12T09:57:10.426 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 25065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ifb.ko 2023-12-12T09:57:10.426 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ipvlan/ 2023-12-12T09:57:10.426 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 83769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ipvlan/ipvlan.ko 2023-12-12T09:57:10.426 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 62145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/macvlan.ko 2023-12-12T09:57:10.426 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 15865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/macvtap.ko 2023-12-12T09:57:10.427 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/ 2023-12-12T09:57:10.427 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 20569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-12-12T09:57:10.427 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 14185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-12-12T09:57:10.427 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/mdio-gpio.ko 2023-12-12T09:57:10.427 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 8825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/mdio-regmap.ko 2023-12-12T09:57:10.427 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 16025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio.ko 2023-12-12T09:57:10.427 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 20513 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mii.ko 2023-12-12T09:57:10.427 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 43953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/netconsole.ko 2023-12-12T09:57:10.427 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/nlmon.ko 2023-12-12T09:57:10.427 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/pcs/ 2023-12-12T09:57:10.427 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 17985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/pcs/pcs-lynx.ko 2023-12-12T09:57:10.427 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 38977 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-12-12T09:57:10.427 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/ 2023-12-12T09:57:10.427 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 9737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/amd.ko 2023-12-12T09:57:10.427 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 50033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-12-12T09:57:10.428 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 44721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm7xxx.ko 2023-12-12T09:57:10.428 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm87xx.ko 2023-12-12T09:57:10.428 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 42241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/broadcom.ko 2023-12-12T09:57:10.428 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/cicada.ko 2023-12-12T09:57:10.428 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/davicom.ko 2023-12-12T09:57:10.428 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 9449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/et1011c.ko 2023-12-12T09:57:10.428 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 24969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/icplus.ko 2023-12-12T09:57:10.428 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 15849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/lxt.ko 2023-12-12T09:57:10.428 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 82049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/marvell.ko 2023-12-12T09:57:10.428 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 76113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/micrel.ko 2023-12-12T09:57:10.428 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/national.ko 2023-12-12T09:57:10.428 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 97857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/phylink.ko 2023-12-12T09:57:10.428 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/qsemi.ko 2023-12-12T09:57:10.428 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 50065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/realtek.ko 2023-12-12T09:57:10.428 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 29985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/smsc.ko 2023-12-12T09:57:10.428 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/ste10Xp.ko 2023-12-12T09:57:10.429 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 24289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/vitesse.ko 2023-12-12T09:57:10.429 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/plip/ 2023-12-12T09:57:10.429 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 43505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/plip/plip.ko 2023-12-12T09:57:10.429 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ 2023-12-12T09:57:10.429 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 15857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/bsd_comp.ko 2023-12-12T09:57:10.429 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 29713 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_async.ko 2023-12-12T09:57:10.429 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 17665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_deflate.ko 2023-12-12T09:57:10.429 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 18625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_mppe.ko 2023-12-12T09:57:10.429 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 28729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_synctty.ko 2023-12-12T09:57:10.429 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 42545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/pppoe.ko 2023-12-12T09:57:10.429 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/pppox.ko 2023-12-12T09:57:10.429 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 32689 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/pptp.ko 2023-12-12T09:57:10.429 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 28289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/sb1000.ko 2023-12-12T09:57:10.429 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/slip/ 2023-12-12T09:57:10.429 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 42465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/slip/slip.ko 2023-12-12T09:57:10.430 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 26929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/sungem_phy.ko 2023-12-12T09:57:10.430 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 64449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/tap.ko 2023-12-12T09:57:10.430 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/ 2023-12-12T09:57:10.430 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 106169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team.ko 2023-12-12T09:57:10.430 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_activebackup.ko 2023-12-12T09:57:10.430 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_broadcast.ko 2023-12-12T09:57:10.430 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 28881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-12-12T09:57:10.430 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 9641 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_random.ko 2023-12-12T09:57:10.430 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 9321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-12-12T09:57:10.430 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 87017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/veth.ko 2023-12-12T09:57:10.430 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vmxnet3/ 2023-12-12T09:57:10.430 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 144297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-12-12T09:57:10.430 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vxlan/ 2023-12-12T09:57:10.430 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 297329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vxlan/vxlan.ko 2023-12-12T09:57:10.431 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/xen-netback/ 2023-12-12T09:57:10.431 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 144585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/xen-netback/xen-netback.ko 2023-12-12T09:57:10.431 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ntb/ 2023-12-12T09:57:10.431 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 20969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ntb/ntb.ko 2023-12-12T09:57:10.431 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme/ 2023-12-12T09:57:10.431 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme/host/ 2023-12-12T09:57:10.431 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 265121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme/host/nvme-core.ko 2023-12-12T09:57:10.431 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 102209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme/host/nvme.ko 2023-12-12T09:57:10.431 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/ 2023-12-12T09:57:10.431 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 133841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport.ko 2023-12-12T09:57:10.431 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 14561 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport_cs.ko 2023-12-12T09:57:10.431 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 84465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport_pc.ko 2023-12-12T09:57:10.431 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 26121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport_serial.ko 2023-12-12T09:57:10.431 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/ 2023-12-12T09:57:10.431 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/hotplug/ 2023-12-12T09:57:10.432 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 25009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-12-12T09:57:10.432 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 17849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2023-12-12T09:57:10.432 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 20137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2023-12-12T09:57:10.432 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/pci-stub.ko 2023-12-12T09:57:10.432 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 46465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/xen-pcifront.ko 2023-12-12T09:57:10.432 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/ 2023-12-12T09:57:10.432 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 26793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/i82092.ko 2023-12-12T09:57:10.432 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 145809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/pcmcia.ko 2023-12-12T09:57:10.432 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 62137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/pcmcia_core.ko 2023-12-12T09:57:10.432 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 34345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2023-12-12T09:57:10.432 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 34265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/pd6729.ko 2023-12-12T09:57:10.432 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 112889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/yenta_socket.ko 2023-12-12T09:57:10.432 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/phy/ 2023-12-12T09:57:10.432 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/phy/broadcom/ 2023-12-12T09:57:10.432 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2023-12-12T09:57:10.433 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/phy/samsung/ 2023-12-12T09:57:10.433 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 8441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2023-12-12T09:57:10.433 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pinctrl/ 2023-12-12T09:57:10.433 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pinctrl/intel/ 2023-12-12T09:57:10.433 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 70153 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-12-12T09:57:10.433 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/ 2023-12-12T09:57:10.433 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/chrome/ 2023-12-12T09:57:10.433 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 50889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2023-12-12T09:57:10.433 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 20849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/chrome/cros_ec.ko 2023-12-12T09:57:10.433 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 21449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2023-12-12T09:57:10.433 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 25417 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2023-12-12T09:57:10.433 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 26201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2023-12-12T09:57:10.433 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 18201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2023-12-12T09:57:10.433 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 17361 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2023-12-12T09:57:10.433 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/ 2023-12-12T09:57:10.434 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 67097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/acer-wmi.ko 2023-12-12T09:57:10.434 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 39145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/acerhdf.ko 2023-12-12T09:57:10.434 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 37025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/apple-gmux.ko 2023-12-12T09:57:10.434 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 59665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/asus-laptop.ko 2023-12-12T09:57:10.434 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 31161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-12-12T09:57:10.434 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 127441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/asus-wmi.ko 2023-12-12T09:57:10.434 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 36849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/classmate-laptop.ko 2023-12-12T09:57:10.434 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 49121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-12-12T09:57:10.434 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-12-12T09:57:10.434 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 40265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-12-12T09:57:10.434 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 22521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-12-12T09:57:10.434 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 36593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/hdaps.ko 2023-12-12T09:57:10.434 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 19449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/ibm_rtl.ko 2023-12-12T09:57:10.434 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/intel/ 2023-12-12T09:57:10.434 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-12-12T09:57:10.435 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 8985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2023-12-12T09:57:10.435 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 43497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/intel_ips.ko 2023-12-12T09:57:10.435 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 20273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/msi-wmi.ko 2023-12-12T09:57:10.435 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10377 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/mxm-wmi.ko 2023-12-12T09:57:10.435 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 34801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-12-12T09:57:10.435 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 42329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/samsung-laptop.ko 2023-12-12T09:57:10.435 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 14169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/samsung-q10.ko 2023-12-12T09:57:10.435 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 17321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/topstar-laptop.ko 2023-12-12T09:57:10.435 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-12-12T09:57:10.435 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 17081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/toshiba_haps.ko 2023-12-12T09:57:10.435 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/wmi-bmof.ko 2023-12-12T09:57:10.435 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 57569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/wmi.ko 2023-12-12T09:57:10.435 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/ 2023-12-12T09:57:10.435 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/ 2023-12-12T09:57:10.435 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 30281 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/88pm860x_battery.ko 2023-12-12T09:57:10.436 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 33985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/88pm860x_charger.ko 2023-12-12T09:57:10.436 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 55057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/bq2415x_charger.ko 2023-12-12T09:57:10.436 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 54081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/bq24190_charger.ko 2023-12-12T09:57:10.436 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 21553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/bq24735-charger.ko 2023-12-12T09:57:10.436 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 17337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/cros_peripheral_charger.ko 2023-12-12T09:57:10.436 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 19609 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/da9030_battery.ko 2023-12-12T09:57:10.436 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 19841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/da9052-battery.ko 2023-12-12T09:57:10.436 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 29281 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/ds2760_battery.ko 2023-12-12T09:57:10.436 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 23217 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/ds2780_battery.ko 2023-12-12T09:57:10.436 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 23353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/ds2781_battery.ko 2023-12-12T09:57:10.436 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 23649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/ds2782_battery.ko 2023-12-12T09:57:10.436 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 20353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/gpio-charger.ko 2023-12-12T09:57:10.436 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 18041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/isp1704_charger.ko 2023-12-12T09:57:10.436 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 20273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/lp8727_charger.ko 2023-12-12T09:57:10.436 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/max14577_charger.ko 2023-12-12T09:57:10.437 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 25897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/max17040_battery.ko 2023-12-12T09:57:10.437 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 30289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/max17042_battery.ko 2023-12-12T09:57:10.437 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 18585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/max8903_charger.ko 2023-12-12T09:57:10.437 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 23729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/max8925_power.ko 2023-12-12T09:57:10.437 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 21657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/pcf50633-charger.ko 2023-12-12T09:57:10.437 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 38009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/sbs-battery.ko 2023-12-12T09:57:10.437 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 28385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/test_power.ko 2023-12-12T09:57:10.437 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 18865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/tps65090-charger.ko 2023-12-12T09:57:10.437 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/wm831x_backup.ko 2023-12-12T09:57:10.437 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 24521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/wm831x_power.ko 2023-12-12T09:57:10.437 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 22417 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/wm8350_power.ko 2023-12-12T09:57:10.437 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/powercap/ 2023-12-12T09:57:10.437 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 57729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/powercap/intel_rapl_common.ko 2023-12-12T09:57:10.437 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 17345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/powercap/intel_rapl_msr.ko 2023-12-12T09:57:10.437 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/ 2023-12-12T09:57:10.438 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients/ 2023-12-12T09:57:10.438 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 15521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients/pps-gpio.ko 2023-12-12T09:57:10.438 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients/pps-ldisc.ko 2023-12-12T09:57:10.438 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 15913 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients/pps_parport.ko 2023-12-12T09:57:10.438 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 41873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/pps_core.ko 2023-12-12T09:57:10.438 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ptp/ 2023-12-12T09:57:10.438 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 66385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ptp/ptp.ko 2023-12-12T09:57:10.438 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 16449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ptp/ptp_kvm.ko 2023-12-12T09:57:10.438 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/ 2023-12-12T09:57:10.438 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 23497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-88pm80x.ko 2023-12-12T09:57:10.438 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 24521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-88pm860x.ko 2023-12-12T09:57:10.438 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 15393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-bq32k.ko 2023-12-12T09:57:10.438 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 20105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-da9052.ko 2023-12-12T09:57:10.438 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 18505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-da9055.ko 2023-12-12T09:57:10.438 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 20425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-da9063.ko 2023-12-12T09:57:10.439 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 16457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1286.ko 2023-12-12T09:57:10.439 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 68577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1307.ko 2023-12-12T09:57:10.439 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 20817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1374.ko 2023-12-12T09:57:10.439 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 18217 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1511.ko 2023-12-12T09:57:10.439 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 16737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1553.ko 2023-12-12T09:57:10.439 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1672.ko 2023-12-12T09:57:10.439 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13369 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1742.ko 2023-12-12T09:57:10.439 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 14697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds2404.ko 2023-12-12T09:57:10.439 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 23705 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds3232.ko 2023-12-12T09:57:10.439 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-em3027.ko 2023-12-12T09:57:10.439 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 24329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-fm3130.ko 2023-12-12T09:57:10.439 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 20729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-isl12022.ko 2023-12-12T09:57:10.439 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 35969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-isl1208.ko 2023-12-12T09:57:10.439 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 14673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-lp8788.ko 2023-12-12T09:57:10.440 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 38097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-m41t80.ko 2023-12-12T09:57:10.440 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-m48t35.ko 2023-12-12T09:57:10.440 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 25945 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-m48t59.ko 2023-12-12T09:57:10.440 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 14841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-m48t86.ko 2023-12-12T09:57:10.440 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-max6900.ko 2023-12-12T09:57:10.440 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 14673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-max8907.ko 2023-12-12T09:57:10.440 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 15345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-max8925.ko 2023-12-12T09:57:10.440 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 25809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-max8997.ko 2023-12-12T09:57:10.440 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 16681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-max8998.ko 2023-12-12T09:57:10.440 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 18513 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-mc13xxx.ko 2023-12-12T09:57:10.440 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-msm6242.ko 2023-12-12T09:57:10.440 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 19625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-palmas.ko 2023-12-12T09:57:10.440 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 46633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf2127.ko 2023-12-12T09:57:10.440 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 17977 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf50633.ko 2023-12-12T09:57:10.440 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 26993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf85063.ko 2023-12-12T09:57:10.441 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 21825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf8523.ko 2023-12-12T09:57:10.441 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 29817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf8563.ko 2023-12-12T09:57:10.441 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf8583.ko 2023-12-12T09:57:10.441 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 18033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rc5t583.ko 2023-12-12T09:57:10.441 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rp5c01.ko 2023-12-12T09:57:10.441 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 33753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rs5c372.ko 2023-12-12T09:57:10.441 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 27833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-12-12T09:57:10.441 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 25257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rx8025.ko 2023-12-12T09:57:10.441 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 20113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rx8581.ko 2023-12-12T09:57:10.441 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 21617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-s35390a.ko 2023-12-12T09:57:10.441 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 16825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-12-12T09:57:10.441 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 17889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-tps6586x.ko 2023-12-12T09:57:10.441 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 21337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-tps65910.ko 2023-12-12T09:57:10.441 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 20545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-wm831x.ko 2023-12-12T09:57:10.441 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 21089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-wm8350.ko 2023-12-12T09:57:10.442 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 27873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-x1205.ko 2023-12-12T09:57:10.442 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ 2023-12-12T09:57:10.442 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 77617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/3w-9xxx.ko 2023-12-12T09:57:10.442 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 57665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/3w-sas.ko 2023-12-12T09:57:10.442 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 55105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/3w-xxxx.ko 2023-12-12T09:57:10.442 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 135185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/BusLogic.ko 2023-12-12T09:57:10.442 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 26657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/a100u2w.ko 2023-12-12T09:57:10.442 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aacraid/ 2023-12-12T09:57:10.442 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 272305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aacraid/aacraid.ko 2023-12-12T09:57:10.442 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 100617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/advansys.ko 2023-12-12T09:57:10.442 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic7xxx/ 2023-12-12T09:57:10.442 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 356201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-12-12T09:57:10.442 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 295801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-12-12T09:57:10.442 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic94xx/ 2023-12-12T09:57:10.442 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 189185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic94xx/aic94xx.ko 2023-12-12T09:57:10.443 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 24073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/am53c974.ko 2023-12-12T09:57:10.443 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/arcmsr/ 2023-12-12T09:57:10.443 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 106881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-12-12T09:57:10.443 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 38185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/atp870u.ko 2023-12-12T09:57:10.443 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/be2iscsi/ 2023-12-12T09:57:10.443 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 246985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-12-12T09:57:10.443 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bfa/ 2023-12-12T09:57:10.443 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 1171945 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bfa/bfa.ko 2023-12-12T09:57:10.443 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2fc/ 2023-12-12T09:57:10.443 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 237273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-12-12T09:57:10.443 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2i/ 2023-12-12T09:57:10.443 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 115369 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-12-12T09:57:10.443 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 40585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ch.ko 2023-12-12T09:57:10.443 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/csiostor/ 2023-12-12T09:57:10.444 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 308921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/csiostor/csiostor.ko 2023-12-12T09:57:10.444 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/ 2023-12-12T09:57:10.444 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb3i/ 2023-12-12T09:57:10.444 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 76145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-12-12T09:57:10.444 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb4i/ 2023-12-12T09:57:10.444 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 101449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-12-12T09:57:10.444 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 146689 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-12-12T09:57:10.444 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 75553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/dc395x.ko 2023-12-12T09:57:10.444 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 38073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/dmx3191d.ko 2023-12-12T09:57:10.444 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/esas2r/ 2023-12-12T09:57:10.444 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 212425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/esas2r/esas2r.ko 2023-12-12T09:57:10.444 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 60505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/esp_scsi.ko 2023-12-12T09:57:10.444 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fcoe/ 2023-12-12T09:57:10.444 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 78209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fcoe/fcoe.ko 2023-12-12T09:57:10.444 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 158505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-12-12T09:57:10.445 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 18945 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fdomain.ko 2023-12-12T09:57:10.445 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fnic/ 2023-12-12T09:57:10.445 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 263489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fnic/fnic.ko 2023-12-12T09:57:10.445 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 201817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/hpsa.ko 2023-12-12T09:57:10.445 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 51209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/hptiop.ko 2023-12-12T09:57:10.445 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 49041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/hv_storvsc.ko 2023-12-12T09:57:10.445 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 35337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/imm.ko 2023-12-12T09:57:10.445 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 44057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/initio.ko 2023-12-12T09:57:10.445 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 266537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ipr.ko 2023-12-12T09:57:10.445 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 101881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ips.ko 2023-12-12T09:57:10.445 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/isci/ 2023-12-12T09:57:10.445 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 317153 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/isci/isci.ko 2023-12-12T09:57:10.445 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 26385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-12-12T09:57:10.445 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 52961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/iscsi_tcp.ko 2023-12-12T09:57:10.446 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libfc/ 2023-12-12T09:57:10.446 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 314865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libfc/libfc.ko 2023-12-12T09:57:10.446 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 145585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libiscsi.ko 2023-12-12T09:57:10.446 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 53521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libiscsi_tcp.ko 2023-12-12T09:57:10.446 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libsas/ 2023-12-12T09:57:10.446 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 216665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libsas/libsas.ko 2023-12-12T09:57:10.446 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/lpfc/ 2023-12-12T09:57:10.446 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 2197249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/lpfc/lpfc.ko 2023-12-12T09:57:10.446 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid/ 2023-12-12T09:57:10.446 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 73569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-12-12T09:57:10.446 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 33529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-12-12T09:57:10.446 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 310617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-12-12T09:57:10.446 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 84721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid.ko 2023-12-12T09:57:10.446 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mpt3sas/ 2023-12-12T09:57:10.446 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 659825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-12-12T09:57:10.447 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mvsas/ 2023-12-12T09:57:10.447 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 119561 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mvsas/mvsas.ko 2023-12-12T09:57:10.447 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 78129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mvumi.ko 2023-12-12T09:57:10.447 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pcmcia/ 2023-12-12T09:57:10.447 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 81625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2023-12-12T09:57:10.447 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11713 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2023-12-12T09:57:10.447 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 20865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2023-12-12T09:57:10.447 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 23857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2023-12-12T09:57:10.447 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pm8001/ 2023-12-12T09:57:10.447 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 364105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-12-12T09:57:10.447 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 123617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pmcraid.ko 2023-12-12T09:57:10.447 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 34513 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ppa.ko 2023-12-12T09:57:10.447 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 55361 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla1280.ko 2023-12-12T09:57:10.447 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla2xxx/ 2023-12-12T09:57:10.449 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 1876689 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-12-12T09:57:10.449 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 85289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-12-12T09:57:10.449 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla4xxx/ 2023-12-12T09:57:10.449 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 559033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-12-12T09:57:10.450 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 19025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qlogicfas408.ko 2023-12-12T09:57:10.450 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 15993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/raid_class.ko 2023-12-12T09:57:10.450 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 238761 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_debug.ko 2023-12-12T09:57:10.450 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 173937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_fc.ko 2023-12-12T09:57:10.450 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 279313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-12-12T09:57:10.450 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 97729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_sas.ko 2023-12-12T09:57:10.450 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 73881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_spi.ko 2023-12-12T09:57:10.450 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 44993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_srp.ko 2023-12-12T09:57:10.450 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 26249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ses.ko 2023-12-12T09:57:10.450 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 115889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/st.ko 2023-12-12T09:57:10.450 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 46825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/stex.ko 2023-12-12T09:57:10.450 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/sym53c8xx_2/ 2023-12-12T09:57:10.450 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 162121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-12-12T09:57:10.450 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 42297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/virtio_scsi.ko 2023-12-12T09:57:10.451 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 50321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/vmw_pvscsi.ko 2023-12-12T09:57:10.451 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 39961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/wd719x.ko 2023-12-12T09:57:10.451 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 50025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/xen-scsifront.ko 2023-12-12T09:57:10.451 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ssb/ 2023-12-12T09:57:10.451 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 129441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ssb/ssb.ko 2023-12-12T09:57:10.451 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/ 2023-12-12T09:57:10.451 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/iscsi/ 2023-12-12T09:57:10.451 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 736601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-12-12T09:57:10.451 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/loopback/ 2023-12-12T09:57:10.451 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 49985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/loopback/tcm_loop.ko 2023-12-12T09:57:10.451 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 39713 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_file.ko 2023-12-12T09:57:10.451 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 43025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_iblock.ko 2023-12-12T09:57:10.451 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 930257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_mod.ko 2023-12-12T09:57:10.451 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 44305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_pscsi.ko 2023-12-12T09:57:10.451 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 122521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_user.ko 2023-12-12T09:57:10.452 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/tcm_fc/ 2023-12-12T09:57:10.452 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 75593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-12-12T09:57:10.452 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/ 2023-12-12T09:57:10.452 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/ 2023-12-12T09:57:10.452 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/ 2023-12-12T09:57:10.452 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 23481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-12-12T09:57:10.452 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 29321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-12-12T09:57:10.452 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 9953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-12-12T09:57:10.452 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-12-12T09:57:10.452 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 15081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-12-12T09:57:10.452 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 16497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-12-12T09:57:10.452 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 26809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-12-12T09:57:10.452 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 20281 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-12-12T09:57:10.452 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 14865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-12-12T09:57:10.452 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 14393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-12-12T09:57:10.453 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13001 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-12-12T09:57:10.453 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 37065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-12-12T09:57:10.453 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 30729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/intel_powerclamp.ko 2023-12-12T09:57:10.453 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 18937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-12-12T09:57:10.453 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-12-12T09:57:10.453 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 26425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-12-12T09:57:10.453 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/ 2023-12-12T09:57:10.453 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/ipwireless/ 2023-12-12T09:57:10.453 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 78425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-12-12T09:57:10.453 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 57865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/moxa.ko 2023-12-12T09:57:10.453 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 50953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/mxser.ko 2023-12-12T09:57:10.453 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 108601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/n_gsm.ko 2023-12-12T09:57:10.453 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 31961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/n_hdlc.ko 2023-12-12T09:57:10.453 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 67929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/nozomi.ko 2023-12-12T09:57:10.453 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/ 2023-12-12T09:57:10.454 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/8250/ 2023-12-12T09:57:10.454 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 35753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/8250/8250_dw.ko 2023-12-12T09:57:10.454 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 59497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-12-12T09:57:10.454 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 18097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/altera_jtaguart.ko 2023-12-12T09:57:10.454 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 22577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/altera_uart.ko 2023-12-12T09:57:10.454 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 9425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/arc_uart.ko 2023-12-12T09:57:10.454 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 72425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/fsl_lpuart.ko 2023-12-12T09:57:10.454 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/jsm/ 2023-12-12T09:57:10.454 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 103073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/jsm/jsm.ko 2023-12-12T09:57:10.454 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 28785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/rp2.ko 2023-12-12T09:57:10.454 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 52817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/sc16is7xx.ko 2023-12-12T09:57:10.454 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/ 2023-12-12T09:57:10.454 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/core/ 2023-12-12T09:57:10.454 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 531265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/core/ufshcd-core.ko 2023-12-12T09:57:10.454 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/host/ 2023-12-12T09:57:10.455 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 28481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-12-12T09:57:10.455 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 14601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2023-12-12T09:57:10.455 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/ 2023-12-12T09:57:10.455 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 44513 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio.ko 2023-12-12T09:57:10.455 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_aec.ko 2023-12-12T09:57:10.455 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11281 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_cif.ko 2023-12-12T09:57:10.455 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 18329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_dmem_genirq.ko 2023-12-12T09:57:10.455 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_mf624.ko 2023-12-12T09:57:10.455 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_netx.ko 2023-12-12T09:57:10.455 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_pci_generic.ko 2023-12-12T09:57:10.455 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 16057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_pdrv_genirq.ko 2023-12-12T09:57:10.455 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_sercos3.ko 2023-12-12T09:57:10.455 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/ 2023-12-12T09:57:10.455 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/c67x00/ 2023-12-12T09:57:10.455 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 73297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/c67x00/c67x00.ko 2023-12-12T09:57:10.456 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/chipidea/ 2023-12-12T09:57:10.456 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 144377 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/chipidea/ci_hdrc.ko 2023-12-12T09:57:10.456 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 18505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2023-12-12T09:57:10.456 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12713 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2023-12-12T09:57:10.456 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2023-12-12T09:57:10.456 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/ 2023-12-12T09:57:10.456 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 87089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/cdc-acm.ko 2023-12-12T09:57:10.456 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 51345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/cdc-wdm.ko 2023-12-12T09:57:10.456 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 47305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/usblp.ko 2023-12-12T09:57:10.456 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 89857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/usbtmc.ko 2023-12-12T09:57:10.456 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/common/ 2023-12-12T09:57:10.456 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 22953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/common/ulpi.ko 2023-12-12T09:57:10.456 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/dwc2/ 2023-12-12T09:57:10.456 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/dwc2/dwc2_pci.ko 2023-12-12T09:57:10.456 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/dwc3/ 2023-12-12T09:57:10.457 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/dwc3/dwc3-haps.ko 2023-12-12T09:57:10.457 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 30041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/dwc3/dwc3-pci.ko 2023-12-12T09:57:10.457 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 448505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/dwc3/dwc3.ko 2023-12-12T09:57:10.457 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/ 2023-12-12T09:57:10.457 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/ 2023-12-12T09:57:10.457 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 60177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/u_ether.ko 2023-12-12T09:57:10.457 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 51881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/u_serial.ko 2023-12-12T09:57:10.457 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 28841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2023-12-12T09:57:10.457 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 42449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2023-12-12T09:57:10.457 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 27953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2023-12-12T09:57:10.457 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 36513 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2023-12-12T09:57:10.457 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 92489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2023-12-12T09:57:10.457 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 51049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2023-12-12T09:57:10.457 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 122081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2023-12-12T09:57:10.457 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 57681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2023-12-12T09:57:10.457 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 22185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2023-12-12T09:57:10.458 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 31265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2023-12-12T09:57:10.458 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 57729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2023-12-12T09:57:10.458 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 85609 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2023-12-12T09:57:10.458 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 19273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2023-12-12T09:57:10.458 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 58113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2023-12-12T09:57:10.458 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 67337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2023-12-12T09:57:10.458 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/ 2023-12-12T09:57:10.458 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 21265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2023-12-12T09:57:10.458 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 18057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2023-12-12T09:57:10.458 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 18465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2023-12-12T09:57:10.458 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 21657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_ether.ko 2023-12-12T09:57:10.458 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 28401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2023-12-12T09:57:10.458 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 19009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_hid.ko 2023-12-12T09:57:10.458 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 20409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2023-12-12T09:57:10.459 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 16977 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2023-12-12T09:57:10.459 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 32073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2023-12-12T09:57:10.459 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 16793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_printer.ko 2023-12-12T09:57:10.459 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 19393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_serial.ko 2023-12-12T09:57:10.459 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 27201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_zero.ko 2023-12-12T09:57:10.459 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 62185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2023-12-12T09:57:10.459 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 15201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2023-12-12T09:57:10.459 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 161225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/libcomposite.ko 2023-12-12T09:57:10.459 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/ 2023-12-12T09:57:10.459 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 17705 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2023-12-12T09:57:10.459 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/bdc/ 2023-12-12T09:57:10.459 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 157681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2023-12-12T09:57:10.459 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 36089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/goku_udc.ko 2023-12-12T09:57:10.459 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 52721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/gr_udc.ko 2023-12-12T09:57:10.459 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 69705 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2023-12-12T09:57:10.459 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 56033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/mv_udc.ko 2023-12-12T09:57:10.460 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 76057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/net2272.ko 2023-12-12T09:57:10.460 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 75073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/net2280.ko 2023-12-12T09:57:10.460 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 73169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/pch_udc.ko 2023-12-12T09:57:10.460 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 65809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2023-12-12T09:57:10.460 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 66097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2023-12-12T09:57:10.460 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 81505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2023-12-12T09:57:10.460 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 156073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/udc-core.ko 2023-12-12T09:57:10.460 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/ 2023-12-12T09:57:10.460 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/bcma-hcd.ko 2023-12-12T09:57:10.460 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 80113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/isp116x-hcd.ko 2023-12-12T09:57:10.460 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 87353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/oxu210hp-hcd.ko 2023-12-12T09:57:10.460 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 78873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/r8a66597-hcd.ko 2023-12-12T09:57:10.460 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 51329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/sl811-hcd.ko 2023-12-12T09:57:10.460 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 15593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/sl811_cs.ko 2023-12-12T09:57:10.460 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/ssb-hcd.ko 2023-12-12T09:57:10.461 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 25945 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/xhci-plat-hcd.ko 2023-12-12T09:57:10.461 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/image/ 2023-12-12T09:57:10.461 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 34585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/image/mdc800.ko 2023-12-12T09:57:10.461 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 21081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/image/microtek.ko 2023-12-12T09:57:10.461 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/ 2023-12-12T09:57:10.461 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 41721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/adutux.ko 2023-12-12T09:57:10.461 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 20713 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/appledisplay.ko 2023-12-12T09:57:10.461 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 17721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/cypress_cy7c63.ko 2023-12-12T09:57:10.461 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 23049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/cytherm.ko 2023-12-12T09:57:10.461 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/ehset.ko 2023-12-12T09:57:10.461 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 15057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/emi26.ko 2023-12-12T09:57:10.461 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 15985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/emi62.ko 2023-12-12T09:57:10.461 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/ezusb.ko 2023-12-12T09:57:10.461 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 19297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/idmouse.ko 2023-12-12T09:57:10.461 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 36553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/iowarrior.ko 2023-12-12T09:57:10.462 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/isight_firmware.ko 2023-12-12T09:57:10.462 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 36529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/ldusb.ko 2023-12-12T09:57:10.462 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 36265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/legousbtower.ko 2023-12-12T09:57:10.462 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 27793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/lvstest.ko 2023-12-12T09:57:10.462 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/sisusbvga/ 2023-12-12T09:57:10.462 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 64841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-12-12T09:57:10.462 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/trancevibrator.ko 2023-12-12T09:57:10.462 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 20473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/usb3503.ko 2023-12-12T09:57:10.462 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 25145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/usblcd.ko 2023-12-12T09:57:10.462 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 22753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/usbsevseg.ko 2023-12-12T09:57:10.462 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 70809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/usbtest.ko 2023-12-12T09:57:10.462 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 41905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/uss720.ko 2023-12-12T09:57:10.462 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 27617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/yurex.ko 2023-12-12T09:57:10.462 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/mon/ 2023-12-12T09:57:10.462 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 72953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/mon/usbmon.ko 2023-12-12T09:57:10.462 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/musb/ 2023-12-12T09:57:10.463 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 301697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/musb/musb_hdrc.ko 2023-12-12T09:57:10.463 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/phy/ 2023-12-12T09:57:10.463 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 21105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/phy/phy-generic.ko 2023-12-12T09:57:10.463 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 20177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2023-12-12T09:57:10.463 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/phy/phy-isp1301.ko 2023-12-12T09:57:10.463 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 21745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/phy/phy-tahvo.ko 2023-12-12T09:57:10.463 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ 2023-12-12T09:57:10.463 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/aircable.ko 2023-12-12T09:57:10.463 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 33329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ark3116.ko 2023-12-12T09:57:10.463 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 26633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/belkin_sa.ko 2023-12-12T09:57:10.463 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 38105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ch341.ko 2023-12-12T09:57:10.463 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 70257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/cp210x.ko 2023-12-12T09:57:10.463 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 31057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/cyberjack.ko 2023-12-12T09:57:10.463 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 58217 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/cypress_m8.ko 2023-12-12T09:57:10.464 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 49817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/digi_acceleport.ko 2023-12-12T09:57:10.464 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 9617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/empeg.ko 2023-12-12T09:57:10.464 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 44273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/f81232.ko 2023-12-12T09:57:10.464 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 175137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ftdi_sio.ko 2023-12-12T09:57:10.464 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 53113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/garmin_gps.ko 2023-12-12T09:57:10.464 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 137081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/io_edgeport.ko 2023-12-12T09:57:10.464 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 124833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/io_ti.ko 2023-12-12T09:57:10.464 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 67769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ipaq.ko 2023-12-12T09:57:10.464 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 19161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ipw.ko 2023-12-12T09:57:10.464 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 26897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ir-usb.ko 2023-12-12T09:57:10.464 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 58233 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-12-12T09:57:10.464 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 107521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/keyspan.ko 2023-12-12T09:57:10.464 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 35617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/keyspan_pda.ko 2023-12-12T09:57:10.464 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 25665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/kl5kusb105.ko 2023-12-12T09:57:10.464 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 33689 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/kobil_sct.ko 2023-12-12T09:57:10.465 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 32953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/mct_u232.ko 2023-12-12T09:57:10.465 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 22033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/metro-usb.ko 2023-12-12T09:57:10.465 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 66449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/mos7720.ko 2023-12-12T09:57:10.465 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 78217 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/mos7840.ko 2023-12-12T09:57:10.465 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 56337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/mxuport.ko 2023-12-12T09:57:10.465 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 14025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/navman.ko 2023-12-12T09:57:10.465 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/omninet.ko 2023-12-12T09:57:10.465 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 24633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/opticon.ko 2023-12-12T09:57:10.465 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 191137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/option.ko 2023-12-12T09:57:10.465 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 39073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/oti6858.ko 2023-12-12T09:57:10.465 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 54353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/pl2303.ko 2023-12-12T09:57:10.465 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 9737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/qcaux.ko 2023-12-12T09:57:10.465 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 37825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/qcserial.ko 2023-12-12T09:57:10.465 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 34321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/quatech2.ko 2023-12-12T09:57:10.465 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 15393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/safe_serial.ko 2023-12-12T09:57:10.466 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 51625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/sierra.ko 2023-12-12T09:57:10.466 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 21673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/spcp8x5.ko 2023-12-12T09:57:10.466 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 29993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ssu100.ko 2023-12-12T09:57:10.466 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 17265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/symbolserial.ko 2023-12-12T09:57:10.466 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 61489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-12-12T09:57:10.466 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 23729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-12-12T09:57:10.466 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/usb_debug.ko 2023-12-12T09:57:10.466 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 33201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/usb_wwan.ko 2023-12-12T09:57:10.466 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 125609 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/usbserial.ko 2023-12-12T09:57:10.466 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 28753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/visor.ko 2023-12-12T09:57:10.466 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 37409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/whiteheat.ko 2023-12-12T09:57:10.466 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/wishbone-serial.ko 2023-12-12T09:57:10.466 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 9289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/xsens_mt.ko 2023-12-12T09:57:10.466 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ 2023-12-12T09:57:10.466 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 52913 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/uas.ko 2023-12-12T09:57:10.467 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 26017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-alauda.ko 2023-12-12T09:57:10.467 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-cypress.ko 2023-12-12T09:57:10.467 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 22049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-datafab.ko 2023-12-12T09:57:10.467 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 33497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-12-12T09:57:10.467 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-freecom.ko 2023-12-12T09:57:10.467 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 19769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-isd200.ko 2023-12-12T09:57:10.467 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 19361 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-12-12T09:57:10.467 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13713 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-karma.ko 2023-12-12T09:57:10.467 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 17841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-onetouch.ko 2023-12-12T09:57:10.467 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 28441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-realtek.ko 2023-12-12T09:57:10.467 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 28905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-sddr09.ko 2023-12-12T09:57:10.467 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 19521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-sddr55.ko 2023-12-12T09:57:10.467 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 35337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-usbat.ko 2023-12-12T09:57:10.467 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 179969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/usb-storage.ko 2023-12-12T09:57:10.467 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip/ 2023-12-12T09:57:10.468 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 67481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip/usbip-core.ko 2023-12-12T09:57:10.468 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 72177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip/usbip-host.ko 2023-12-12T09:57:10.468 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 107001 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-12-12T09:57:10.468 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/ 2023-12-12T09:57:10.468 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/pci/ 2023-12-12T09:57:10.468 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 154297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-12-12T09:57:10.468 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 29537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/pci/vfio-pci.ko 2023-12-12T09:57:10.468 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 108737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/vfio.ko 2023-12-12T09:57:10.468 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 77609 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-12-12T09:57:10.468 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/ 2023-12-12T09:57:10.468 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 113785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost.ko 2023-12-12T09:57:10.468 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 17009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost_iotlb.ko 2023-12-12T09:57:10.468 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 58089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost_net.ko 2023-12-12T09:57:10.468 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 89249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost_scsi.ko 2023-12-12T09:57:10.468 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/ 2023-12-12T09:57:10.469 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/ 2023-12-12T09:57:10.469 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 15417 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/88pm860x_bl.ko 2023-12-12T09:57:10.469 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/aat2870_bl.ko 2023-12-12T09:57:10.469 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 23305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/adp5520_bl.ko 2023-12-12T09:57:10.469 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 32609 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/adp8860_bl.ko 2023-12-12T09:57:10.469 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 39993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/adp8870_bl.ko 2023-12-12T09:57:10.469 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 16921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/apple_bl.ko 2023-12-12T09:57:10.469 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 16777 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/as3711_bl.ko 2023-12-12T09:57:10.469 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/bd6107.ko 2023-12-12T09:57:10.469 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/da903x_bl.ko 2023-12-12T09:57:10.469 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/da9052_bl.ko 2023-12-12T09:57:10.469 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/gpio_backlight.ko 2023-12-12T09:57:10.469 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 14769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/kb3886_bl.ko 2023-12-12T09:57:10.469 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 22017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/lcd.ko 2023-12-12T09:57:10.470 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 23657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/lm3533_bl.ko 2023-12-12T09:57:10.470 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 19337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/lm3639_bl.ko 2023-12-12T09:57:10.470 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/lv5207lp.ko 2023-12-12T09:57:10.470 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 14345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/max8925_bl.ko 2023-12-12T09:57:10.470 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/pandora_bl.ko 2023-12-12T09:57:10.470 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/pcf50633-backlight.ko 2023-12-12T09:57:10.470 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/platform_lcd.ko 2023-12-12T09:57:10.470 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/wm831x_bl.ko 2023-12-12T09:57:10.470 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/ 2023-12-12T09:57:10.470 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters/ 2023-12-12T09:57:10.470 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 18785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters/ds2482.ko 2023-12-12T09:57:10.470 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 38985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters/ds2490.ko 2023-12-12T09:57:10.470 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters/matrox_w1.ko 2023-12-12T09:57:10.470 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12417 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters/w1-gpio.ko 2023-12-12T09:57:10.471 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/ 2023-12-12T09:57:10.471 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-12-12T09:57:10.471 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 22745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-12-12T09:57:10.471 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 15113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-12-12T09:57:10.471 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-12-12T09:57:10.471 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 14153 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-12-12T09:57:10.471 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-12-12T09:57:10.471 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 14049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-12-12T09:57:10.471 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 14049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-12-12T09:57:10.471 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 17921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-12-12T09:57:10.471 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 7385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_smem.ko 2023-12-12T09:57:10.471 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 56425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_therm.ko 2023-12-12T09:57:10.471 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 102673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/wire.ko 2023-12-12T09:57:10.471 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/ 2023-12-12T09:57:10.471 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 18793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/acquirewdt.ko 2023-12-12T09:57:10.472 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 19977 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/advantechwdt.ko 2023-12-12T09:57:10.472 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 18561 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/alim1535_wdt.ko 2023-12-12T09:57:10.472 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 22969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/alim7101_wdt.ko 2023-12-12T09:57:10.472 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 19113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/cpu5wdt.ko 2023-12-12T09:57:10.472 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/da9052_wdt.ko 2023-12-12T09:57:10.472 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12777 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/da9055_wdt.ko 2023-12-12T09:57:10.472 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 17409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/da9063_wdt.ko 2023-12-12T09:57:10.472 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 20169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/dw_wdt.ko 2023-12-12T09:57:10.472 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 20265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/eurotechwdt.ko 2023-12-12T09:57:10.472 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 23865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/f71808e_wdt.ko 2023-12-12T09:57:10.472 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 27401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/hpwdt.ko 2023-12-12T09:57:10.472 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 15577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/i6300esb.ko 2023-12-12T09:57:10.472 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-12-12T09:57:10.472 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 21913 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/iTCO_wdt.ko 2023-12-12T09:57:10.472 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 19241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/ib700wdt.ko 2023-12-12T09:57:10.473 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 18689 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/ibmasr.ko 2023-12-12T09:57:10.473 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 19713 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-12-12T09:57:10.473 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 21225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/it8712f_wdt.ko 2023-12-12T09:57:10.473 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/it87_wdt.ko 2023-12-12T09:57:10.473 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 21489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/kempld_wdt.ko 2023-12-12T09:57:10.473 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 18617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/machzwd.ko 2023-12-12T09:57:10.473 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 14721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/mena21_wdt.ko 2023-12-12T09:57:10.473 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13217 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/menf21bmc_wdt.ko 2023-12-12T09:57:10.473 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 24673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/nv_tco.ko 2023-12-12T09:57:10.473 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 17737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/of_xilinx_wdt.ko 2023-12-12T09:57:10.473 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 22265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/pc87413_wdt.ko 2023-12-12T09:57:10.473 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 38657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/pcwd_pci.ko 2023-12-12T09:57:10.474 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 31825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/pcwd_usb.ko 2023-12-12T09:57:10.474 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/retu_wdt.ko 2023-12-12T09:57:10.474 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 20449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sbc60xxwdt.ko 2023-12-12T09:57:10.474 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 14129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sbc_epx_c3.ko 2023-12-12T09:57:10.474 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 17321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-12-12T09:57:10.474 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 23809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sc1200wdt.ko 2023-12-12T09:57:10.474 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 23321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sch311x_wdt.ko 2023-12-12T09:57:10.474 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 21577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/smsc37b787_wdt.ko 2023-12-12T09:57:10.474 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 17273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/softdog.ko 2023-12-12T09:57:10.474 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 22273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sp5100_tco.ko 2023-12-12T09:57:10.474 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/twl4030_wdt.ko 2023-12-12T09:57:10.474 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 17649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/via_wdt.ko 2023-12-12T09:57:10.474 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 19161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-12-12T09:57:10.474 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 20681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/w83877f_wdt.ko 2023-12-12T09:57:10.475 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 25409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/w83977f_wdt.ko 2023-12-12T09:57:10.475 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 18497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/wafer5823wdt.ko 2023-12-12T09:57:10.475 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 28089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/wdt_pci.ko 2023-12-12T09:57:10.475 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 16257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/wm831x_wdt.ko 2023-12-12T09:57:10.475 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/wm8350_wdt.ko 2023-12-12T09:57:10.475 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 15697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/xen_wdt.ko 2023-12-12T09:57:10.475 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/ 2023-12-12T09:57:10.475 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 24729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-evtchn.ko 2023-12-12T09:57:10.475 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 26769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-gntalloc.ko 2023-12-12T09:57:10.475 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 47865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-gntdev.ko 2023-12-12T09:57:10.475 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-pciback/ 2023-12-12T09:57:10.475 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 176377 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-12-12T09:57:10.475 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 40121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-privcmd.ko 2023-12-12T09:57:10.475 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 71249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-scsiback.ko 2023-12-12T09:57:10.475 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xenfs/ 2023-12-12T09:57:10.476 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 19425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xenfs/xenfs.ko 2023-12-12T09:57:10.476 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ 2023-12-12T09:57:10.476 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/9p/ 2023-12-12T09:57:10.476 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 166425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/9p/9p.ko 2023-12-12T09:57:10.476 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/adfs/ 2023-12-12T09:57:10.476 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 61073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/adfs/adfs.ko 2023-12-12T09:57:10.476 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/affs/ 2023-12-12T09:57:10.476 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 163593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/affs/affs.ko 2023-12-12T09:57:10.476 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/afs/ 2023-12-12T09:57:10.476 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 932817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/afs/kafs.ko 2023-12-12T09:57:10.476 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/autofs/ 2023-12-12T09:57:10.476 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 101057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/autofs/autofs4.ko 2023-12-12T09:57:10.476 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/befs/ 2023-12-12T09:57:10.476 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 64545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/befs/befs.ko 2023-12-12T09:57:10.476 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/bfs/ 2023-12-12T09:57:10.477 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 41257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/bfs/bfs.ko 2023-12-12T09:57:10.477 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 34585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/binfmt_misc.ko 2023-12-12T09:57:10.477 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/btrfs/ 2023-12-12T09:57:10.477 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 3402729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/btrfs/btrfs.ko 2023-12-12T09:57:10.477 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cachefiles/ 2023-12-12T09:57:10.477 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 306009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cachefiles/cachefiles.ko 2023-12-12T09:57:10.477 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ceph/ 2023-12-12T09:57:10.477 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 1333017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ceph/ceph.ko 2023-12-12T09:57:10.524 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/coda/ 2023-12-12T09:57:10.524 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 100801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/coda/coda.ko 2023-12-12T09:57:10.524 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/configfs/ 2023-12-12T09:57:10.524 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 108393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/configfs/configfs.ko 2023-12-12T09:57:10.524 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cramfs/ 2023-12-12T09:57:10.524 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 29625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cramfs/cramfs.ko 2023-12-12T09:57:10.524 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/dlm/ 2023-12-12T09:57:10.524 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 642513 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/dlm/dlm.ko 2023-12-12T09:57:10.524 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/efs/ 2023-12-12T09:57:10.525 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 36649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/efs/efs.ko 2023-12-12T09:57:10.525 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/f2fs/ 2023-12-12T09:57:10.525 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 1505025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/f2fs/f2fs.ko 2023-12-12T09:57:10.525 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fat/ 2023-12-12T09:57:10.525 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 27929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fat/msdos.ko 2023-12-12T09:57:10.525 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/freevxfs/ 2023-12-12T09:57:10.525 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 42545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/freevxfs/freevxfs.ko 2023-12-12T09:57:10.525 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fscache/ 2023-12-12T09:57:10.525 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 226481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fscache/fscache.ko 2023-12-12T09:57:10.525 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fuse/ 2023-12-12T09:57:10.525 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 24489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fuse/cuse.ko 2023-12-12T09:57:10.525 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/gfs2/ 2023-12-12T09:57:10.525 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 1231529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/gfs2/gfs2.ko 2023-12-12T09:57:10.525 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfs/ 2023-12-12T09:57:10.525 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 141209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfs/hfs.ko 2023-12-12T09:57:10.526 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfsplus/ 2023-12-12T09:57:10.526 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 222817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfsplus/hfsplus.ko 2023-12-12T09:57:10.526 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hpfs/ 2023-12-12T09:57:10.526 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 192329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hpfs/hpfs.ko 2023-12-12T09:57:10.526 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/isofs/ 2023-12-12T09:57:10.526 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 74065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/isofs/isofs.ko 2023-12-12T09:57:10.526 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/jfs/ 2023-12-12T09:57:10.526 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 419497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/jfs/jfs.ko 2023-12-12T09:57:10.526 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/lockd/ 2023-12-12T09:57:10.526 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 280313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/lockd/lockd.ko 2023-12-12T09:57:10.526 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/minix/ 2023-12-12T09:57:10.526 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 89193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/minix/minix.ko 2023-12-12T09:57:10.526 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/netfs/ 2023-12-12T09:57:10.526 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 124649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/netfs/netfs.ko 2023-12-12T09:57:10.526 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/ 2023-12-12T09:57:10.527 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/blocklayout/ 2023-12-12T09:57:10.527 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 81449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-12-12T09:57:10.527 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/filelayout/ 2023-12-12T09:57:10.527 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 59449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-12-12T09:57:10.527 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/flexfilelayout/ 2023-12-12T09:57:10.527 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 117465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-12-12T09:57:10.527 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 1055721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/nfs.ko 2023-12-12T09:57:10.527 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 66441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/nfsv2.ko 2023-12-12T09:57:10.527 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 120177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/nfsv3.ko 2023-12-12T09:57:10.527 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 2042137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/nfsv4.ko 2023-12-12T09:57:10.527 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs_common/ 2023-12-12T09:57:10.527 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 16929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs_common/grace.ko 2023-12-12T09:57:10.527 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 16145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs_common/nfs_acl.ko 2023-12-12T09:57:10.527 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfsd/ 2023-12-12T09:57:10.527 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 1516873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfsd/nfsd.ko 2023-12-12T09:57:10.528 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nilfs2/ 2023-12-12T09:57:10.528 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 592833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nilfs2/nilfs2.ko 2023-12-12T09:57:10.528 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/ 2023-12-12T09:57:10.528 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-celtic.ko 2023-12-12T09:57:10.528 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-centeuro.ko 2023-12-12T09:57:10.528 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-croatian.ko 2023-12-12T09:57:10.528 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-cyrillic.ko 2023-12-12T09:57:10.528 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-gaelic.ko 2023-12-12T09:57:10.528 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-greek.ko 2023-12-12T09:57:10.528 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-iceland.ko 2023-12-12T09:57:10.528 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-inuit.ko 2023-12-12T09:57:10.528 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 14097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-roman.ko 2023-12-12T09:57:10.528 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-romanian.ko 2023-12-12T09:57:10.529 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-turkish.ko 2023-12-12T09:57:10.529 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_ascii.ko 2023-12-12T09:57:10.529 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp1250.ko 2023-12-12T09:57:10.529 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12233 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp1251.ko 2023-12-12T09:57:10.529 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp1255.ko 2023-12-12T09:57:10.529 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp737.ko 2023-12-12T09:57:10.529 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp775.ko 2023-12-12T09:57:10.529 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp850.ko 2023-12-12T09:57:10.529 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp852.ko 2023-12-12T09:57:10.529 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp855.ko 2023-12-12T09:57:10.529 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11913 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp857.ko 2023-12-12T09:57:10.529 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp860.ko 2023-12-12T09:57:10.529 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp861.ko 2023-12-12T09:57:10.529 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp862.ko 2023-12-12T09:57:10.529 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp863.ko 2023-12-12T09:57:10.530 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp864.ko 2023-12-12T09:57:10.530 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp865.ko 2023-12-12T09:57:10.530 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp866.ko 2023-12-12T09:57:10.530 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp869.ko 2023-12-12T09:57:10.530 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp874.ko 2023-12-12T09:57:10.530 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 94137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp932.ko 2023-12-12T09:57:10.530 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 142673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp936.ko 2023-12-12T09:57:10.530 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 165745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp949.ko 2023-12-12T09:57:10.530 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 118121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp950.ko 2023-12-12T09:57:10.530 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_euc-jp.ko 2023-12-12T09:57:10.530 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-1.ko 2023-12-12T09:57:10.530 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-13.ko 2023-12-12T09:57:10.530 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-14.ko 2023-12-12T09:57:10.530 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-15.ko 2023-12-12T09:57:10.530 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-2.ko 2023-12-12T09:57:10.531 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-3.ko 2023-12-12T09:57:10.531 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-4.ko 2023-12-12T09:57:10.531 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-5.ko 2023-12-12T09:57:10.531 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-6.ko 2023-12-12T09:57:10.531 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12233 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-7.ko 2023-12-12T09:57:10.531 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-9.ko 2023-12-12T09:57:10.531 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_koi8-r.ko 2023-12-12T09:57:10.531 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 8017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_koi8-ru.ko 2023-12-12T09:57:10.531 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_koi8-u.ko 2023-12-12T09:57:10.531 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 7569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_ucs2_utils.ko 2023-12-12T09:57:10.531 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 8337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_utf8.ko 2023-12-12T09:57:10.531 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ntfs/ 2023-12-12T09:57:10.531 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 219417 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ntfs/ntfs.ko 2023-12-12T09:57:10.531 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ 2023-12-12T09:57:10.531 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/cluster/ 2023-12-12T09:57:10.532 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 244409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-12-12T09:57:10.532 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlm/ 2023-12-12T09:57:10.532 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 440737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-12-12T09:57:10.532 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlmfs/ 2023-12-12T09:57:10.532 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 54049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-12-12T09:57:10.532 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 2592433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2.ko 2023-12-12T09:57:10.532 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 17905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-12-12T09:57:10.532 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 31729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-12-12T09:57:10.532 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 35897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-12-12T09:57:10.532 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/omfs/ 2023-12-12T09:57:10.532 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 53433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/omfs/omfs.ko 2023-12-12T09:57:10.532 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/overlayfs/ 2023-12-12T09:57:10.532 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 352161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/overlayfs/overlay.ko 2023-12-12T09:57:10.532 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/pstore/ 2023-12-12T09:57:10.533 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 54809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/pstore/ramoops.ko 2023-12-12T09:57:10.533 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/qnx4/ 2023-12-12T09:57:10.533 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 26865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/qnx4/qnx4.ko 2023-12-12T09:57:10.533 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/qnx6/ 2023-12-12T09:57:10.533 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 46689 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/qnx6/qnx6.ko 2023-12-12T09:57:10.533 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/quota/ 2023-12-12T09:57:10.533 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 30881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/quota/quota_tree.ko 2023-12-12T09:57:10.533 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 14297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/quota/quota_v1.ko 2023-12-12T09:57:10.533 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 22017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/quota/quota_v2.ko 2023-12-12T09:57:10.533 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/reiserfs/ 2023-12-12T09:57:10.533 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 532673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/reiserfs/reiserfs.ko 2023-12-12T09:57:10.533 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/romfs/ 2023-12-12T09:57:10.533 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 28641 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/romfs/romfs.ko 2023-12-12T09:57:10.533 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/ 2023-12-12T09:57:10.533 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/client/ 2023-12-12T09:57:10.533 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 2668401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/client/cifs.ko 2023-12-12T09:57:10.534 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/common/ 2023-12-12T09:57:10.534 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 7161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/common/cifs_arc4.ko 2023-12-12T09:57:10.534 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/common/cifs_md4.ko 2023-12-12T09:57:10.534 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/squashfs/ 2023-12-12T09:57:10.534 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 134641 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/squashfs/squashfs.ko 2023-12-12T09:57:10.534 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/sysv/ 2023-12-12T09:57:10.534 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 90721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/sysv/sysv.ko 2023-12-12T09:57:10.534 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/udf/ 2023-12-12T09:57:10.534 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 247737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/udf/udf.ko 2023-12-12T09:57:10.534 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ufs/ 2023-12-12T09:57:10.534 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 162497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ufs/ufs.ko 2023-12-12T09:57:10.534 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/xfs/ 2023-12-12T09:57:10.534 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 4011017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/xfs/xfs.ko 2023-12-12T09:57:10.535 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/ 2023-12-12T09:57:10.535 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/locking/ 2023-12-12T09:57:10.535 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 75489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/locking/locktorture.ko 2023-12-12T09:57:10.535 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/time/ 2023-12-12T09:57:10.535 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/time/test_udelay.ko 2023-12-12T09:57:10.535 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 60553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/torture.ko 2023-12-12T09:57:10.535 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/ 2023-12-12T09:57:10.535 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 6833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crc-itu-t.ko 2023-12-12T09:57:10.535 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 6529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crc7.ko 2023-12-12T09:57:10.535 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 7025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crc8.ko 2023-12-12T09:57:10.535 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crypto/ 2023-12-12T09:57:10.535 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 7097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crypto/libarc4.ko 2023-12-12T09:57:10.535 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 37081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crypto/libdes.ko 2023-12-12T09:57:10.535 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/interval_tree_test.ko 2023-12-12T09:57:10.535 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 8425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/libcrc32c.ko 2023-12-12T09:57:10.535 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 24953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lru_cache.ko 2023-12-12T09:57:10.536 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lz4/ 2023-12-12T09:57:10.536 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 33801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lz4/lz4_compress.ko 2023-12-12T09:57:10.536 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 22633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lz4/lz4hc_compress.ko 2023-12-12T09:57:10.536 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/math/ 2023-12-12T09:57:10.536 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 6617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/math/cordic.ko 2023-12-12T09:57:10.536 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 8233 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/memory-notifier-error-inject.ko 2023-12-12T09:57:10.536 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/notifier-error-inject.ko 2023-12-12T09:57:10.536 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 14089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/percpu_test.ko 2023-12-12T09:57:10.536 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 8305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/pm-notifier-error-inject.ko 2023-12-12T09:57:10.536 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/raid6/ 2023-12-12T09:57:10.536 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 143433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/raid6/raid6_pq.ko 2023-12-12T09:57:10.536 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 21105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/rbtree_test.ko 2023-12-12T09:57:10.536 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/reed_solomon/ 2023-12-12T09:57:10.536 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 18753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/reed_solomon/reed_solomon.ko 2023-12-12T09:57:10.536 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 38841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/test-kstrtox.ko 2023-12-12T09:57:10.537 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 26321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/test-string_helpers.ko 2023-12-12T09:57:10.537 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 4760425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/test_bpf.ko 2023-12-12T09:57:10.537 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 49089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/test_firmware.ko 2023-12-12T09:57:10.537 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 6369 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/test_module.ko 2023-12-12T09:57:10.537 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 20801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/test_user_copy.ko 2023-12-12T09:57:10.537 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 9585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/ts_bm.ko 2023-12-12T09:57:10.537 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/ts_fsm.ko 2023-12-12T09:57:10.537 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 9625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/ts_kmp.ko 2023-12-12T09:57:10.537 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/xz/ 2023-12-12T09:57:10.537 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/xz/xz_dec_test.ko 2023-12-12T09:57:10.537 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/mm/ 2023-12-12T09:57:10.537 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 15425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/mm/hwpoison-inject.ko 2023-12-12T09:57:10.537 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ 2023-12-12T09:57:10.537 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/ 2023-12-12T09:57:10.537 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 55737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/6lowpan.ko 2023-12-12T09:57:10.538 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 7049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_dest.ko 2023-12-12T09:57:10.538 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 7065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_fragment.ko 2023-12-12T09:57:10.538 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 7049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_hop.ko 2023-12-12T09:57:10.538 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 6985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_ipv6.ko 2023-12-12T09:57:10.538 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 7065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_mobility.ko 2023-12-12T09:57:10.538 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 7001 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_routing.ko 2023-12-12T09:57:10.538 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 15329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_udp.ko 2023-12-12T09:57:10.538 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/ 2023-12-12T09:57:10.538 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 30385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/garp.ko 2023-12-12T09:57:10.538 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 34809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/mrp.ko 2023-12-12T09:57:10.538 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 8545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/p8022.ko 2023-12-12T09:57:10.538 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 16345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/psnap.ko 2023-12-12T09:57:10.538 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/stp.ko 2023-12-12T09:57:10.538 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/8021q/ 2023-12-12T09:57:10.538 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 81737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/8021q/8021q.ko 2023-12-12T09:57:10.539 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/ 2023-12-12T09:57:10.539 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 198337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet.ko 2023-12-12T09:57:10.539 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 35977 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet_fd.ko 2023-12-12T09:57:10.539 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 26345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet_rdma.ko 2023-12-12T09:57:10.539 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 32337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet_virtio.ko 2023-12-12T09:57:10.539 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/batman-adv/ 2023-12-12T09:57:10.539 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 649297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/batman-adv/batman-adv.ko 2023-12-12T09:57:10.539 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/ 2023-12-12T09:57:10.539 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 63809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/br_netfilter.ko 2023-12-12T09:57:10.539 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 777689 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/bridge.ko 2023-12-12T09:57:10.539 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ 2023-12-12T09:57:10.539 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 7657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-12-12T09:57:10.539 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_among.ko 2023-12-12T09:57:10.539 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 9169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_arp.ko 2023-12-12T09:57:10.539 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 9073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-12-12T09:57:10.540 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 9625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-12-12T09:57:10.540 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 8737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_ip.ko 2023-12-12T09:57:10.540 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 9145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-12-12T09:57:10.540 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 9825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_limit.ko 2023-12-12T09:57:10.540 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13217 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_log.ko 2023-12-12T09:57:10.540 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 7585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_mark.ko 2023-12-12T09:57:10.540 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 7593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-12-12T09:57:10.540 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 8385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-12-12T09:57:10.540 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 7537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-12-12T09:57:10.540 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 9593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-12-12T09:57:10.540 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 8649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_snat.ko 2023-12-12T09:57:10.540 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 8825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_stp.ko 2023-12-12T09:57:10.540 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-12-12T09:57:10.540 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-12-12T09:57:10.540 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 9817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-12-12T09:57:10.541 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 9793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-12-12T09:57:10.541 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 55929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtables.ko 2023-12-12T09:57:10.541 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 14041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-12-12T09:57:10.541 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13945 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-12-12T09:57:10.541 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ceph/ 2023-12-12T09:57:10.541 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 1046681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ceph/libceph.ko 2023-12-12T09:57:10.541 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/core/ 2023-12-12T09:57:10.541 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 125993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/core/pktgen.ko 2023-12-12T09:57:10.541 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/ 2023-12-12T09:57:10.541 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 194209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp.ko 2023-12-12T09:57:10.541 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 8665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp_diag.ko 2023-12-12T09:57:10.541 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 57881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp_ipv4.ko 2023-12-12T09:57:10.541 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 60337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp_ipv6.ko 2023-12-12T09:57:10.541 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/ 2023-12-12T09:57:10.541 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 390473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/dsa_core.ko 2023-12-12T09:57:10.541 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_brcm.ko 2023-12-12T09:57:10.542 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_dsa.ko 2023-12-12T09:57:10.542 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 7721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_none.ko 2023-12-12T09:57:10.542 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 8953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_trailer.ko 2023-12-12T09:57:10.542 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/hsr/ 2023-12-12T09:57:10.542 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 99729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/hsr/hsr.ko 2023-12-12T09:57:10.542 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/ 2023-12-12T09:57:10.542 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/6lowpan/ 2023-12-12T09:57:10.542 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 45233 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-12-12T09:57:10.542 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 254625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/ieee802154.ko 2023-12-12T09:57:10.542 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 47289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/ieee802154_socket.ko 2023-12-12T09:57:10.542 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ 2023-12-12T09:57:10.542 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 24729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ah4.ko 2023-12-12T09:57:10.542 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 38905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/esp4.ko 2023-12-12T09:57:10.542 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 48337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/fou.ko 2023-12-12T09:57:10.543 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 18121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/gre.ko 2023-12-12T09:57:10.543 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 48657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/inet_diag.ko 2023-12-12T09:57:10.543 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 60633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ip_gre.ko 2023-12-12T09:57:10.543 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 61225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ip_tunnel.ko 2023-12-12T09:57:10.543 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 34505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ip_vti.ko 2023-12-12T09:57:10.543 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 14001 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ipcomp.ko 2023-12-12T09:57:10.543 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 28841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ipip.ko 2023-12-12T09:57:10.543 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ 2023-12-12T09:57:10.543 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 37641 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/arp_tables.ko 2023-12-12T09:57:10.543 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 8873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-12-12T09:57:10.543 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-12-12T09:57:10.543 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 41609 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ip_tables.ko 2023-12-12T09:57:10.543 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-12-12T09:57:10.543 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 9681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2023-12-12T09:57:10.543 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 14121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-12-12T09:57:10.544 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-12-12T09:57:10.544 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 14881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-12-12T09:57:10.544 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_filter.ko 2023-12-12T09:57:10.544 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-12-12T09:57:10.544 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 14905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-12-12T09:57:10.544 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-12-12T09:57:10.544 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_security.ko 2023-12-12T09:57:10.544 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-12-12T09:57:10.544 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 8817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-12-12T09:57:10.544 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 27625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-12-12T09:57:10.544 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 18161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-12-12T09:57:10.544 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-12-12T09:57:10.544 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 20561 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2023-12-12T09:57:10.544 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 9329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-12-12T09:57:10.544 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 15177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-12-12T09:57:10.544 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 9961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-12-12T09:57:10.545 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 17113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-12-12T09:57:10.545 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 9009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-12-12T09:57:10.545 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_bic.ko 2023-12-12T09:57:10.545 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_dctcp.ko 2023-12-12T09:57:10.545 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 15369 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_diag.ko 2023-12-12T09:57:10.545 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 9537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_highspeed.ko 2023-12-12T09:57:10.545 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_htcp.ko 2023-12-12T09:57:10.545 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_hybla.ko 2023-12-12T09:57:10.545 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_illinois.ko 2023-12-12T09:57:10.545 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_lp.ko 2023-12-12T09:57:10.545 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 8329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_scalable.ko 2023-12-12T09:57:10.545 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 14425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_vegas.ko 2023-12-12T09:57:10.545 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_veno.ko 2023-12-12T09:57:10.545 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_westwood.ko 2023-12-12T09:57:10.546 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_yeah.ko 2023-12-12T09:57:10.546 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 22601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tunnel4.ko 2023-12-12T09:57:10.546 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 17097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/udp_diag.ko 2023-12-12T09:57:10.546 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 41665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/udp_tunnel.ko 2023-12-12T09:57:10.546 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11361 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/xfrm4_tunnel.ko 2023-12-12T09:57:10.546 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ 2023-12-12T09:57:10.546 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 26377 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ah6.ko 2023-12-12T09:57:10.546 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 39537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/esp6.ko 2023-12-12T09:57:10.546 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 14425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/fou6.ko 2023-12-12T09:57:10.546 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 80897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ip6_gre.ko 2023-12-12T09:57:10.546 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 93577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ip6_tunnel.ko 2023-12-12T09:57:10.546 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-12-12T09:57:10.546 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 53273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ip6_vti.ko 2023-12-12T09:57:10.546 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ipcomp6.ko 2023-12-12T09:57:10.547 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 19017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/mip6.ko 2023-12-12T09:57:10.547 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ 2023-12-12T09:57:10.547 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 42169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-12-12T09:57:10.547 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2023-12-12T09:57:10.547 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 9753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-12-12T09:57:10.547 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 14137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-12-12T09:57:10.547 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 14273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-12-12T09:57:10.547 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 7801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-12-12T09:57:10.547 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 16209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-12-12T09:57:10.547 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 16033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-12-12T09:57:10.547 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 8913 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-12-12T09:57:10.547 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 9897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-12-12T09:57:10.547 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-12-12T09:57:10.547 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-12-12T09:57:10.547 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-12-12T09:57:10.548 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-12-12T09:57:10.548 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 15009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-12-12T09:57:10.548 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-12-12T09:57:10.548 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-12-12T09:57:10.548 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 39113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-12-12T09:57:10.548 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 8449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-12-12T09:57:10.548 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 25945 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-12-12T09:57:10.548 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 9801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-12-12T09:57:10.548 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 15393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-12-12T09:57:10.548 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 9633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-12-12T09:57:10.548 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 16025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-12-12T09:57:10.548 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 9009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-12-12T09:57:10.548 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 74073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/sit.ko 2023-12-12T09:57:10.548 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 24193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/tunnel6.ko 2023-12-12T09:57:10.548 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 23297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/xfrm6_tunnel.ko 2023-12-12T09:57:10.549 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/key/ 2023-12-12T09:57:10.549 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 82833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/key/af_key.ko 2023-12-12T09:57:10.549 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/ 2023-12-12T09:57:10.549 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 125281 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_core.ko 2023-12-12T09:57:10.549 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 20177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_debugfs.ko 2023-12-12T09:57:10.549 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 25953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_eth.ko 2023-12-12T09:57:10.549 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 35569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_ip.ko 2023-12-12T09:57:10.549 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 36713 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_ip6.ko 2023-12-12T09:57:10.549 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 33001 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_netlink.ko 2023-12-12T09:57:10.549 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 53241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_ppp.ko 2023-12-12T09:57:10.549 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/lapb/ 2023-12-12T09:57:10.549 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 47977 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/lapb/lapb.ko 2023-12-12T09:57:10.549 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/llc/ 2023-12-12T09:57:10.549 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 23193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/llc/llc.ko 2023-12-12T09:57:10.549 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 267913 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/llc/llc2.ko 2023-12-12T09:57:10.550 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mac802154/ 2023-12-12T09:57:10.550 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 290417 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mac802154/mac802154.ko 2023-12-12T09:57:10.550 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mpls/ 2023-12-12T09:57:10.550 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 9393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mpls/mpls_gso.ko 2023-12-12T09:57:10.550 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ 2023-12-12T09:57:10.550 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ 2023-12-12T09:57:10.550 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 119585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set.ko 2023-12-12T09:57:10.550 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 28353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-12-12T09:57:10.550 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 26913 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-12-12T09:57:10.550 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 26369 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-12-12T09:57:10.550 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 100297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-12-12T09:57:10.550 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 101441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-12-12T09:57:10.550 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 102817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-12-12T09:57:10.550 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 103417 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-12-12T09:57:10.551 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 112849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-12-12T09:57:10.551 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 60329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-12-12T09:57:10.551 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 109593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-12-12T09:57:10.551 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 113129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-12-12T09:57:10.551 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 112585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-12-12T09:57:10.551 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 111585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-12-12T09:57:10.551 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 114465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-12-12T09:57:10.551 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 30025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-12-12T09:57:10.551 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ 2023-12-12T09:57:10.551 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 411729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs.ko 2023-12-12T09:57:10.551 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-12-12T09:57:10.551 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 7625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-12-12T09:57:10.551 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 17729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-12-12T09:57:10.551 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 17905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-12-12T09:57:10.551 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 20673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-12-12T09:57:10.552 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 7689 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-12-12T09:57:10.552 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 7689 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-12-12T09:57:10.552 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-12-12T09:57:10.552 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 9233 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-12-12T09:57:10.552 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 7697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-12-12T09:57:10.552 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-12-12T09:57:10.552 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 7697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-12-12T09:57:10.552 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-12-12T09:57:10.552 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 49257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conncount.ko 2023-12-12T09:57:10.552 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 408257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack.ko 2023-12-12T09:57:10.552 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 15985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-12-12T09:57:10.552 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-12-12T09:57:10.552 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 33761 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-12-12T09:57:10.552 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 118145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_h323.ko 2023-12-12T09:57:10.552 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 22185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_irc.ko 2023-12-12T09:57:10.553 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 8817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-12-12T09:57:10.553 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 107233 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-12-12T09:57:10.553 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 33633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-12-12T09:57:10.553 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 17401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_sane.ko 2023-12-12T09:57:10.553 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 66641 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_sip.ko 2023-12-12T09:57:10.553 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11233 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-12-12T09:57:10.553 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 19185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-12-12T09:57:10.553 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_dup_netdev.ko 2023-12-12T09:57:10.553 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 89425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_flow_table.ko 2023-12-12T09:57:10.553 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 9593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_flow_table_inet.ko 2023-12-12T09:57:10.553 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 37129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_log_syslog.ko 2023-12-12T09:57:10.553 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 95353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat.ko 2023-12-12T09:57:10.553 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_amanda.ko 2023-12-12T09:57:10.553 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_ftp.ko 2023-12-12T09:57:10.553 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_irc.ko 2023-12-12T09:57:10.554 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 28929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_sip.ko 2023-12-12T09:57:10.554 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 8809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_tftp.ko 2023-12-12T09:57:10.554 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 44065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_synproxy_core.ko 2023-12-12T09:57:10.554 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 615649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_tables.ko 2023-12-12T09:57:10.554 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 42561 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink.ko 2023-12-12T09:57:10.554 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 30233 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_acct.ko 2023-12-12T09:57:10.554 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 30569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_cttimeout.ko 2023-12-12T09:57:10.554 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 39785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_log.ko 2023-12-12T09:57:10.554 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 22921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_osf.ko 2023-12-12T09:57:10.554 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 49377 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_queue.ko 2023-12-12T09:57:10.554 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_chain_nat.ko 2023-12-12T09:57:10.554 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 33209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_compat.ko 2023-12-12T09:57:10.554 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 40721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_ct.ko 2023-12-12T09:57:10.554 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 9601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_dup_netdev.ko 2023-12-12T09:57:10.554 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_fib.ko 2023-12-12T09:57:10.555 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_fwd_netdev.ko 2023-12-12T09:57:10.555 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 14185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_hash.ko 2023-12-12T09:57:10.555 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 20065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_limit.ko 2023-12-12T09:57:10.555 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 15401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_log.ko 2023-12-12T09:57:10.555 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 14801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_masq.ko 2023-12-12T09:57:10.555 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 14329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_nat.ko 2023-12-12T09:57:10.555 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_numgen.ko 2023-12-12T09:57:10.555 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_osf.ko 2023-12-12T09:57:10.555 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 14073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_queue.ko 2023-12-12T09:57:10.555 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 14193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_redir.ko 2023-12-12T09:57:10.555 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_reject.ko 2023-12-12T09:57:10.555 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_reject_inet.ko 2023-12-12T09:57:10.555 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_socket.ko 2023-12-12T09:57:10.555 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 20369 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_synproxy.ko 2023-12-12T09:57:10.555 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 14849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_tproxy.ko 2023-12-12T09:57:10.556 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 89313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/x_tables.ko 2023-12-12T09:57:10.556 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_AUDIT.ko 2023-12-12T09:57:10.556 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 9633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CHECKSUM.ko 2023-12-12T09:57:10.556 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 7729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CLASSIFY.ko 2023-12-12T09:57:10.556 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-12-12T09:57:10.556 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 18169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CT.ko 2023-12-12T09:57:10.556 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_DSCP.ko 2023-12-12T09:57:10.556 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 9465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_HL.ko 2023-12-12T09:57:10.556 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13369 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_HMARK.ko 2023-12-12T09:57:10.556 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 38873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_IDLETIMER.ko 2023-12-12T09:57:10.556 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_LED.ko 2023-12-12T09:57:10.556 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_LOG.ko 2023-12-12T09:57:10.556 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_MASQUERADE.ko 2023-12-12T09:57:10.556 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_NETMAP.ko 2023-12-12T09:57:10.556 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 9473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_NFLOG.ko 2023-12-12T09:57:10.557 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_NFQUEUE.ko 2023-12-12T09:57:10.557 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 19665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_RATEEST.ko 2023-12-12T09:57:10.557 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_REDIRECT.ko 2023-12-12T09:57:10.557 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 14337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_SECMARK.ko 2023-12-12T09:57:10.557 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 16057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TCPMSS.ko 2023-12-12T09:57:10.557 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-12-12T09:57:10.557 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 17361 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TEE.ko 2023-12-12T09:57:10.557 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 16785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TPROXY.ko 2023-12-12T09:57:10.557 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 8321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TRACE.ko 2023-12-12T09:57:10.557 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_addrtype.ko 2023-12-12T09:57:10.557 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_bpf.ko 2023-12-12T09:57:10.557 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 15529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_cgroup.ko 2023-12-12T09:57:10.557 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_cluster.ko 2023-12-12T09:57:10.557 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 7505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_comment.ko 2023-12-12T09:57:10.557 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connbytes.ko 2023-12-12T09:57:10.558 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connlabel.ko 2023-12-12T09:57:10.558 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 9401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connlimit.ko 2023-12-12T09:57:10.558 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connmark.ko 2023-12-12T09:57:10.558 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_conntrack.ko 2023-12-12T09:57:10.558 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 7817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_cpu.ko 2023-12-12T09:57:10.558 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_dccp.ko 2023-12-12T09:57:10.558 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 7865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_devgroup.ko 2023-12-12T09:57:10.558 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 8801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_dscp.ko 2023-12-12T09:57:10.558 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_ecn.ko 2023-12-12T09:57:10.558 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_esp.ko 2023-12-12T09:57:10.558 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 43289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_hashlimit.ko 2023-12-12T09:57:10.558 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_helper.ko 2023-12-12T09:57:10.558 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 7865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_hl.ko 2023-12-12T09:57:10.558 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_ipcomp.ko 2023-12-12T09:57:10.559 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_iprange.ko 2023-12-12T09:57:10.559 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_ipvs.ko 2023-12-12T09:57:10.559 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 16041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_l2tp.ko 2023-12-12T09:57:10.559 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 8001 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_length.ko 2023-12-12T09:57:10.559 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_limit.ko 2023-12-12T09:57:10.559 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 7545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_mac.ko 2023-12-12T09:57:10.559 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 8577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_mark.ko 2023-12-12T09:57:10.559 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_multiport.ko 2023-12-12T09:57:10.559 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_nat.ko 2023-12-12T09:57:10.559 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_nfacct.ko 2023-12-12T09:57:10.559 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 8297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_osf.ko 2023-12-12T09:57:10.559 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 9553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_owner.ko 2023-12-12T09:57:10.559 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 9729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_physdev.ko 2023-12-12T09:57:10.559 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 7633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_pkttype.ko 2023-12-12T09:57:10.559 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_policy.ko 2023-12-12T09:57:10.559 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 9473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_quota.ko 2023-12-12T09:57:10.560 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_rateest.ko 2023-12-12T09:57:10.560 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 8257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_realm.ko 2023-12-12T09:57:10.560 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 36433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_recent.ko 2023-12-12T09:57:10.560 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_sctp.ko 2023-12-12T09:57:10.560 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 30089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_set.ko 2023-12-12T09:57:10.560 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 16089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_socket.ko 2023-12-12T09:57:10.560 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 9505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_state.ko 2023-12-12T09:57:10.560 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 9473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_statistic.ko 2023-12-12T09:57:10.560 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 8809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_string.ko 2023-12-12T09:57:10.560 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 8553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_tcpmss.ko 2023-12-12T09:57:10.560 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 15777 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_tcpudp.ko 2023-12-12T09:57:10.560 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_time.ko 2023-12-12T09:57:10.560 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 9401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_u32.ko 2023-12-12T09:57:10.560 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netlink/ 2023-12-12T09:57:10.560 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netlink/netlink_diag.ko 2023-12-12T09:57:10.560 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/nsh/ 2023-12-12T09:57:10.561 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 12425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/nsh/nsh.ko 2023-12-12T09:57:10.561 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/ 2023-12-12T09:57:10.561 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 380033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/openvswitch.ko 2023-12-12T09:57:10.561 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/vport-geneve.ko 2023-12-12T09:57:10.561 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 9449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/vport-gre.ko 2023-12-12T09:57:10.561 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 11793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/vport-vxlan.ko 2023-12-12T09:57:10.561 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/packet/ 2023-12-12T09:57:10.561 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/packet/af_packet_diag.ko 2023-12-12T09:57:10.561 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/phonet/ 2023-12-12T09:57:10.561 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 110201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/phonet/phonet.ko 2023-12-12T09:57:10.561 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 54721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/phonet/pn_pep.ko 2023-12-12T09:57:10.561 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds/ 2023-12-12T09:57:10.561 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 251481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds/rds.ko 2023-12-12T09:57:10.561 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 164937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds/rds_rdma.ko 2023-12-12T09:57:10.561 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 67377 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds/rds_tcp.ko 2023-12-12T09:57:10.562 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rxrpc/ 2023-12-12T09:57:10.562 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 819657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rxrpc/rxrpc.ko 2023-12-12T09:57:10.562 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/ 2023-12-12T09:57:10.562 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 32241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_csum.ko 2023-12-12T09:57:10.562 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 23577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_gact.ko 2023-12-12T09:57:10.562 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 26873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_ipt.ko 2023-12-12T09:57:10.562 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 34097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_mirred.ko 2023-12-12T09:57:10.562 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 23401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_nat.ko 2023-12-12T09:57:10.562 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 43449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_pedit.ko 2023-12-12T09:57:10.562 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 31961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_police.ko 2023-12-12T09:57:10.562 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 20289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_simple.ko 2023-12-12T09:57:10.562 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 35297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_skbedit.ko 2023-12-12T09:57:10.562 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 36665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_vlan.ko 2023-12-12T09:57:10.562 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 26169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_basic.ko 2023-12-12T09:57:10.562 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 33961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_bpf.ko 2023-12-12T09:57:10.563 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 19169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_cgroup.ko 2023-12-12T09:57:10.563 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 31401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_flow.ko 2023-12-12T09:57:10.563 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 31769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_fw.ko 2023-12-12T09:57:10.563 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 38425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_route.ko 2023-12-12T09:57:10.563 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 61409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_u32.ko 2023-12-12T09:57:10.563 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 7441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_cmp.ko 2023-12-12T09:57:10.563 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 13409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_ipset.ko 2023-12-12T09:57:10.563 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 33289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_meta.ko 2023-12-12T09:57:10.563 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 7897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_nbyte.ko 2023-12-12T09:57:10.563 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_text.ko 2023-12-12T09:57:10.563 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 7249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_u32.ko 2023-12-12T09:57:10.563 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 21649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_choke.ko 2023-12-12T09:57:10.563 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 20849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_codel.ko 2023-12-12T09:57:10.563 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 34633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_drr.ko 2023-12-12T09:57:10.563 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 33609 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_fq.ko 2023-12-12T09:57:10.564 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 31617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_fq_codel.ko 2023-12-12T09:57:10.564 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 35433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_gred.ko 2023-12-12T09:57:10.564 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 49817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_hfsc.ko 2023-12-12T09:57:10.564 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 22089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_hhf.ko 2023-12-12T09:57:10.564 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 66393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_htb.ko 2023-12-12T09:57:10.564 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 26073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_ingress.ko 2023-12-12T09:57:10.564 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 30273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_mqprio.ko 2023-12-12T09:57:10.564 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_mqprio_lib.ko 2023-12-12T09:57:10.564 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 26065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_multiq.ko 2023-12-12T09:57:10.564 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 36137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_netem.ko 2023-12-12T09:57:10.564 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 27497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_pie.ko 2023-12-12T09:57:10.564 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_plug.ko 2023-12-12T09:57:10.564 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 24729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_prio.ko 2023-12-12T09:57:10.564 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 48729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_qfq.ko 2023-12-12T09:57:10.564 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 32905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_red.ko 2023-12-12T09:57:10.564 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 26881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_sfb.ko 2023-12-12T09:57:10.565 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 31353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_sfq.ko 2023-12-12T09:57:10.565 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 28897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_tbf.ko 2023-12-12T09:57:10.565 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 28105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_teql.ko 2023-12-12T09:57:10.565 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sctp/ 2023-12-12T09:57:10.565 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 929745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sctp/sctp.ko 2023-12-12T09:57:10.565 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 19033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sctp/sctp_diag.ko 2023-12-12T09:57:10.565 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/ 2023-12-12T09:57:10.565 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/auth_gss/ 2023-12-12T09:57:10.565 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 336529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-12-12T09:57:10.565 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 54737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-12-12T09:57:10.565 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 1520097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/sunrpc.ko 2023-12-12T09:57:10.565 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/xprtrdma/ 2023-12-12T09:57:10.565 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 707657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-12-12T09:57:10.565 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/tipc/ 2023-12-12T09:57:10.566 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/tipc/diag.ko 2023-12-12T09:57:10.566 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 862665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/tipc/tipc.ko 2023-12-12T09:57:10.566 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/unix/ 2023-12-12T09:57:10.566 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 15729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/unix/unix_diag.ko 2023-12-12T09:57:10.566 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/ 2023-12-12T09:57:10.566 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 85409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-12-12T09:57:10.566 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 68049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-12-12T09:57:10.566 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 96193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vsock.ko 2023-12-12T09:57:10.566 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 10705 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vsock_diag.ko 2023-12-12T09:57:10.566 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 17521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vsock_loopback.ko 2023-12-12T09:57:10.566 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/x25/ 2023-12-12T09:57:10.566 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 125177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/x25/x25.ko 2023-12-12T09:57:10.566 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/xfrm/ 2023-12-12T09:57:10.566 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 22657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/xfrm/xfrm_algo.ko 2023-12-12T09:57:10.566 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 20649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/xfrm/xfrm_ipcomp.ko 2023-12-12T09:57:10.567 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 102257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/xfrm/xfrm_user.ko 2023-12-12T09:57:10.567 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/virt/ 2023-12-12T09:57:10.567 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/virt/lib/ 2023-12-12T09:57:10.567 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 15537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/virt/lib/irqbypass.ko 2023-12-12T09:57:10.567 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 640081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.alias 2023-12-12T09:57:10.567 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 624107 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.alias.bin 2023-12-12T09:57:10.567 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 7663 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.builtin 2023-12-12T09:57:10.567 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 23428 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.builtin.alias.bin 2023-12-12T09:57:10.567 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 9821 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.builtin.bin 2023-12-12T09:57:10.567 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 70004 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.builtin.modinfo 2023-12-12T09:57:10.567 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 146313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.dep 2023-12-12T09:57:10.567 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 232548 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.dep.bin 2023-12-12T09:57:10.567 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 210 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.devname 2023-12-12T09:57:10.567 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 72606 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.order 2023-12-12T09:57:10.567 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 879 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.softdep 2023-12-12T09:57:10.568 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 254438 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.symbols 2023-12-12T09:57:10.568 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 309363 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.symbols.bin 2023-12-12T09:57:10.568 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./usr/ 2023-12-12T09:57:10.568 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./usr/share/ 2023-12-12T09:57:10.568 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./usr/share/doc/ 2023-12-12T09:57:10.568 INFO:teuthology.orchestra.run.smithi187.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./usr/share/doc/linux-image-6.6.0-gcd68252d7b4d/ 2023-12-12T09:57:10.568 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 170 2023-12-08 17:49 ./usr/share/doc/linux-image-6.6.0-gcd68252d7b4d/changelog.Debian.gz 2023-12-12T09:57:10.568 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-r--r-- root/root 691 2023-12-08 17:49 ./usr/share/doc/linux-image-6.6.0-gcd68252d7b4d/copyright 2023-12-12T09:57:10.569 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-gcd68252d7b4d 2023-12-12T09:57:10.569 INFO:teuthology.task.kernel:searching for kernel 6.6.0-gcd68252d7b4d 2023-12-12T09:57:10.569 DEBUG:teuthology.orchestra.run.smithi187:> egrep '(submenu|menuentry.*6.6.0-gcd68252d7b4d).*{' /boot/grub/grub.cfg 2023-12-12T09:57:10.576 INFO:teuthology.orchestra.run.smithi187.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-12-12T09:57:10.576 INFO:teuthology.orchestra.run.smithi187.stdout: menuentry 'Ubuntu, with Linux 6.6.0-gcd68252d7b4d' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-gcd68252d7b4d-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-12-12T09:57:10.576 INFO:teuthology.orchestra.run.smithi187.stdout: menuentry 'Ubuntu, with Linux 6.6.0-gcd68252d7b4d (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-gcd68252d7b4d-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-12-12T09:57:10.577 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2023-12-12T09:57:10.577 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.6.0-gcd68252d7b4d 2023-12-12T09:57:10.577 DEBUG:teuthology.orchestra.run.smithi187:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2023-12-12T09:57:10.622 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi187.front.sepia.ceph.com to complete... 2023-12-12T09:57:10.968 INFO:teuthology.orchestra.run.smithi078.stderr:Sourcing file `/etc/default/grub' 2023-12-12T09:57:10.991 INFO:teuthology.orchestra.run.smithi078.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-12-12T09:57:11.019 INFO:teuthology.orchestra.run.smithi078.stderr:Generating grub configuration file ... 2023-12-12T09:57:11.050 INFO:teuthology.orchestra.run.smithi187.stderr:Sourcing file `/etc/default/grub' 2023-12-12T09:57:11.051 INFO:teuthology.orchestra.run.smithi187.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-12-12T09:57:11.071 INFO:teuthology.orchestra.run.smithi187.stderr:Generating grub configuration file ... 2023-12-12T09:57:11.258 INFO:teuthology.orchestra.run.smithi187.stderr:Found linux image: /boot/vmlinuz-6.6.0-gcd68252d7b4d 2023-12-12T09:57:11.266 INFO:teuthology.orchestra.run.smithi187.stderr:Found initrd image: /boot/initrd.img-6.6.0-gcd68252d7b4d 2023-12-12T09:57:11.317 INFO:teuthology.orchestra.run.smithi078.stderr:Found linux image: /boot/vmlinuz-6.6.0-gcd68252d7b4d 2023-12-12T09:57:11.331 INFO:teuthology.orchestra.run.smithi078.stderr:Found initrd image: /boot/initrd.img-6.6.0-gcd68252d7b4d 2023-12-12T09:57:11.500 INFO:teuthology.orchestra.run.smithi187.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-12-12T09:57:11.506 INFO:teuthology.orchestra.run.smithi187.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-12-12T09:57:11.548 INFO:teuthology.orchestra.run.smithi187.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-12-12T09:57:11.553 INFO:teuthology.orchestra.run.smithi187.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-12-12T09:57:11.616 INFO:teuthology.orchestra.run.smithi078.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-12-12T09:57:11.625 INFO:teuthology.orchestra.run.smithi078.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-12-12T09:57:11.688 INFO:teuthology.orchestra.run.smithi078.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-12-12T09:57:11.694 INFO:teuthology.orchestra.run.smithi078.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-12-12T09:57:11.710 INFO:teuthology.orchestra.run.smithi187.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-12-12T09:57:11.711 INFO:teuthology.orchestra.run.smithi187.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-12-12T09:57:11.711 INFO:teuthology.orchestra.run.smithi187.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-12-12T09:57:11.730 INFO:teuthology.orchestra.run.smithi187.stderr:done 2023-12-12T09:57:11.855 INFO:teuthology.orchestra.run.smithi078.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-12-12T09:57:11.855 INFO:teuthology.orchestra.run.smithi078.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-12-12T09:57:11.855 INFO:teuthology.orchestra.run.smithi078.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-12-12T09:57:11.891 INFO:teuthology.orchestra.run.smithi078.stderr:done 2023-12-12T09:57:12.064 DEBUG:teuthology.orchestra.run.smithi078:> dpkg-deb -c /tmp/linux-image.deb 2023-12-12T09:57:12.072 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./ 2023-12-12T09:57:12.072 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./boot/ 2023-12-12T09:57:12.072 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 4415617 2023-12-08 17:49 ./boot/System.map-6.6.0-gcd68252d7b4d 2023-12-12T09:57:12.084 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 169214 2023-12-08 17:49 ./boot/config-6.6.0-gcd68252d7b4d 2023-12-12T09:57:12.084 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11352864 2023-12-08 17:49 ./boot/vmlinuz-6.6.0-gcd68252d7b4d 2023-12-12T09:57:12.103 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./etc/ 2023-12-12T09:57:12.103 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./etc/kernel/ 2023-12-12T09:57:12.103 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./etc/kernel/postinst.d/ 2023-12-12T09:57:12.104 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./etc/kernel/postrm.d/ 2023-12-12T09:57:12.104 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./etc/kernel/preinst.d/ 2023-12-12T09:57:12.104 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./etc/kernel/prerm.d/ 2023-12-12T09:57:12.104 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/ 2023-12-12T09:57:12.104 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/ 2023-12-12T09:57:12.104 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/ 2023-12-12T09:57:12.104 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/ 2023-12-12T09:57:12.104 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/ 2023-12-12T09:57:12.104 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/ 2023-12-12T09:57:12.104 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/ 2023-12-12T09:57:12.104 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 490233 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/aesni-intel.ko 2023-12-12T09:57:12.107 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 25329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-12-12T09:57:12.107 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 29529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-12-12T09:57:12.107 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 30313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-12-12T09:57:12.108 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 93113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-12-12T09:57:12.108 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 106729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-12-12T09:57:12.108 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 152241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-12-12T09:57:12.108 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-12-12T09:57:12.108 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13777 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-12-12T09:57:12.108 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 83889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-12-12T09:57:12.108 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-12-12T09:57:12.108 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 47225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-12-12T09:57:12.108 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 47209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/serpent-avx2.ko 2023-12-12T09:57:12.108 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 51801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-12-12T09:57:12.108 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 38937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-12-12T09:57:12.108 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 40529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-12-12T09:57:12.108 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 58585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-12-12T09:57:12.108 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 50497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-12-12T09:57:12.109 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 32065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-12-12T09:57:12.109 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-12-12T09:57:12.109 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/ 2023-12-12T09:57:12.109 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/cpu/ 2023-12-12T09:57:12.109 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/cpu/mce/ 2023-12-12T09:57:12.109 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 40113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-12-12T09:57:12.109 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/cpuid.ko 2023-12-12T09:57:12.109 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/msr.ko 2023-12-12T09:57:12.109 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm/ 2023-12-12T09:57:12.109 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 354433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm/kvm-amd.ko 2023-12-12T09:57:12.109 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 881625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm/kvm-intel.ko 2023-12-12T09:57:12.110 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 2275865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm/kvm.ko 2023-12-12T09:57:12.169 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/ 2023-12-12T09:57:12.169 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 53697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/af_alg.ko 2023-12-12T09:57:12.169 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/algif_hash.ko 2023-12-12T09:57:12.169 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/algif_skcipher.ko 2023-12-12T09:57:12.169 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/ansi_cprng.ko 2023-12-12T09:57:12.169 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19641 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/anubis.ko 2023-12-12T09:57:12.169 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/arc4.ko 2023-12-12T09:57:12.170 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/asymmetric_keys/ 2023-12-12T09:57:12.170 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2023-12-12T09:57:12.170 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/ 2023-12-12T09:57:12.170 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_memcpy.ko 2023-12-12T09:57:12.170 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_pq.ko 2023-12-12T09:57:12.170 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21561 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_raid6_recov.ko 2023-12-12T09:57:12.170 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_tx.ko 2023-12-12T09:57:12.170 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_xor.ko 2023-12-12T09:57:12.170 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/raid6test.ko 2023-12-12T09:57:12.170 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/authenc.ko 2023-12-12T09:57:12.170 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/authencesn.ko 2023-12-12T09:57:12.170 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/blake2b_generic.ko 2023-12-12T09:57:12.170 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/blowfish_common.ko 2023-12-12T09:57:12.170 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/blowfish_generic.ko 2023-12-12T09:57:12.171 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 38809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/camellia_generic.ko 2023-12-12T09:57:12.171 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 27321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cast5_generic.ko 2023-12-12T09:57:12.171 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cast6_generic.ko 2023-12-12T09:57:12.171 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cast_common.ko 2023-12-12T09:57:12.171 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 35097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/ccm.ko 2023-12-12T09:57:12.171 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cmac.ko 2023-12-12T09:57:12.171 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/crc32_generic.ko 2023-12-12T09:57:12.171 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 47505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cryptd.ko 2023-12-12T09:57:12.171 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 39505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/crypto_engine.ko 2023-12-12T09:57:12.171 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/crypto_simd.ko 2023-12-12T09:57:12.171 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/crypto_user.ko 2023-12-12T09:57:12.171 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cts.ko 2023-12-12T09:57:12.171 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10913 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/des_generic.ko 2023-12-12T09:57:12.171 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/dh_generic.ko 2023-12-12T09:57:12.171 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11001 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/echainiv.ko 2023-12-12T09:57:12.172 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 25321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/essiv.ko 2023-12-12T09:57:12.172 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/fcrypt.ko 2023-12-12T09:57:12.172 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/khazad.ko 2023-12-12T09:57:12.172 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/lrw.ko 2023-12-12T09:57:12.172 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11513 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/lz4.ko 2023-12-12T09:57:12.172 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/lz4hc.ko 2023-12-12T09:57:12.172 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/md4.ko 2023-12-12T09:57:12.172 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/michael_mic.ko 2023-12-12T09:57:12.172 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/pcbc.ko 2023-12-12T09:57:12.172 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/pcrypt.ko 2023-12-12T09:57:12.172 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/rmd160.ko 2023-12-12T09:57:12.172 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 29393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/seed.ko 2023-12-12T09:57:12.172 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 27081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/serpent_generic.ko 2023-12-12T09:57:12.172 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 149193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/tcrypt.ko 2023-12-12T09:57:12.172 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/tea.ko 2023-12-12T09:57:12.172 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28777 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/twofish_common.ko 2023-12-12T09:57:12.173 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/twofish_generic.ko 2023-12-12T09:57:12.173 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/vmac.ko 2023-12-12T09:57:12.173 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 36185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/wp512.ko 2023-12-12T09:57:12.173 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/xcbc.ko 2023-12-12T09:57:12.173 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/xor.ko 2023-12-12T09:57:12.173 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18713 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/xts.ko 2023-12-12T09:57:12.173 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/xxhash_generic.ko 2023-12-12T09:57:12.173 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ 2023-12-12T09:57:12.173 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/ 2023-12-12T09:57:12.173 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/acpi_extlog.ko 2023-12-12T09:57:12.173 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/acpi_ipmi.ko 2023-12-12T09:57:12.173 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/acpi_pad.ko 2023-12-12T09:57:12.173 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/apei/ 2023-12-12T09:57:12.173 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 31241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/apei/einj.ko 2023-12-12T09:57:12.173 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/ec_sys.ko 2023-12-12T09:57:12.174 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/platform_profile.ko 2023-12-12T09:57:12.174 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/sbs.ko 2023-12-12T09:57:12.174 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/sbshc.ko 2023-12-12T09:57:12.174 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 103025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/video.ko 2023-12-12T09:57:12.174 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/ 2023-12-12T09:57:12.174 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/acard-ahci.ko 2023-12-12T09:57:12.174 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 88865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/ahci.ko 2023-12-12T09:57:12.174 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/ahci_platform.ko 2023-12-12T09:57:12.174 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 88289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/libahci.ko 2023-12-12T09:57:12.174 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 34985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/libahci_platform.ko 2023-12-12T09:57:12.174 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_acpi.ko 2023-12-12T09:57:12.174 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 30433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ali.ko 2023-12-12T09:57:12.174 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 33505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_amd.ko 2023-12-12T09:57:12.175 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_artop.ko 2023-12-12T09:57:12.175 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_atiixp.ko 2023-12-12T09:57:12.175 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24945 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_atp867x.ko 2023-12-12T09:57:12.175 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_cmd640.ko 2023-12-12T09:57:12.175 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 25185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_cmd64x.ko 2023-12-12T09:57:12.175 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_cypress.ko 2023-12-12T09:57:12.175 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_efar.ko 2023-12-12T09:57:12.175 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21945 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt366.ko 2023-12-12T09:57:12.175 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 33977 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt37x.ko 2023-12-12T09:57:12.175 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt3x2n.ko 2023-12-12T09:57:12.175 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt3x3.ko 2023-12-12T09:57:12.175 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_it8213.ko 2023-12-12T09:57:12.175 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 35273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_it821x.ko 2023-12-12T09:57:12.175 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_jmicron.ko 2023-12-12T09:57:12.176 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 51481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_legacy.ko 2023-12-12T09:57:12.176 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_marvell.ko 2023-12-12T09:57:12.176 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16281 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_mpiix.ko 2023-12-12T09:57:12.176 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_netcell.ko 2023-12-12T09:57:12.176 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ninja32.ko 2023-12-12T09:57:12.176 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ns87410.ko 2023-12-12T09:57:12.176 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17361 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ns87415.ko 2023-12-12T09:57:12.176 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_oldpiix.ko 2023-12-12T09:57:12.176 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15377 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_opti.ko 2023-12-12T09:57:12.176 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_optidma.ko 2023-12-12T09:57:12.176 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 32585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_pcmcia.ko 2023-12-12T09:57:12.176 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 37793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_pdc2027x.ko 2023-12-12T09:57:12.176 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20561 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-12-12T09:57:12.176 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_piccolo.ko 2023-12-12T09:57:12.176 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_radisys.ko 2023-12-12T09:57:12.177 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_rdc.ko 2023-12-12T09:57:12.177 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_rz1000.ko 2023-12-12T09:57:12.177 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sch.ko 2023-12-12T09:57:12.177 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_serverworks.ko 2023-12-12T09:57:12.177 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sil680.ko 2023-12-12T09:57:12.177 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sl82c105.ko 2023-12-12T09:57:12.177 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_triflex.ko 2023-12-12T09:57:12.177 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 30433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_via.ko 2023-12-12T09:57:12.177 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pdc_adma.ko 2023-12-12T09:57:12.177 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 29121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_inic162x.ko 2023-12-12T09:57:12.177 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 83345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_mv.ko 2023-12-12T09:57:12.177 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 70393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_nv.ko 2023-12-12T09:57:12.177 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 37377 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_promise.ko 2023-12-12T09:57:12.177 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_qstor.ko 2023-12-12T09:57:12.177 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 29273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sil.ko 2023-12-12T09:57:12.178 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 38337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sil24.ko 2023-12-12T09:57:12.178 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17945 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sis.ko 2023-12-12T09:57:12.178 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_svw.ko 2023-12-12T09:57:12.178 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 44793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sx4.ko 2023-12-12T09:57:12.178 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_uli.ko 2023-12-12T09:57:12.178 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 35065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_via.ko 2023-12-12T09:57:12.178 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_vsc.ko 2023-12-12T09:57:12.178 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/auxdisplay/ 2023-12-12T09:57:12.178 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/auxdisplay/ks0108.ko 2023-12-12T09:57:12.178 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/bcma/ 2023-12-12T09:57:12.178 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 124473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/bcma/bcma.ko 2023-12-12T09:57:12.178 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/ 2023-12-12T09:57:12.178 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/aoe/ 2023-12-12T09:57:12.179 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 113665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/aoe/aoe.ko 2023-12-12T09:57:12.179 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/drbd/ 2023-12-12T09:57:12.179 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 965585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/drbd/drbd.ko 2023-12-12T09:57:12.179 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 173225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/floppy.ko 2023-12-12T09:57:12.179 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/mtip32xx/ 2023-12-12T09:57:12.179 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 94297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-12-12T09:57:12.179 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 115793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/nbd.ko 2023-12-12T09:57:12.179 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/null_blk/ 2023-12-12T09:57:12.179 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 110385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/null_blk/null_blk.ko 2023-12-12T09:57:12.179 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 98193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/pktcdvd.ko 2023-12-12T09:57:12.179 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 263769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/rbd.ko 2023-12-12T09:57:12.179 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/xen-blkback/ 2023-12-12T09:57:12.179 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 98145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-12-12T09:57:12.179 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/zram/ 2023-12-12T09:57:12.179 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 60217 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/zram/zram.ko 2023-12-12T09:57:12.180 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ 2023-12-12T09:57:12.180 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 30705 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/applicom.ko 2023-12-12T09:57:12.180 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hangcheck-timer.ko 2023-12-12T09:57:12.180 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/ 2023-12-12T09:57:12.180 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/amd-rng.ko 2023-12-12T09:57:12.180 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/intel-rng.ko 2023-12-12T09:57:12.180 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-12-12T09:57:12.180 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/via-rng.ko 2023-12-12T09:57:12.180 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/virtio-rng.ko 2023-12-12T09:57:12.180 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ 2023-12-12T09:57:12.180 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 30713 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-12-12T09:57:12.180 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 148601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-12-12T09:57:12.180 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-12-12T09:57:12.180 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 139313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_si.ko 2023-12-12T09:57:12.180 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 70921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-12-12T09:57:12.181 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 53513 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-12-12T09:57:12.181 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 36321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/lp.ko 2023-12-12T09:57:12.181 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/mwave/ 2023-12-12T09:57:12.181 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 84097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/mwave/mwave.ko 2023-12-12T09:57:12.181 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 25873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/nvram.ko 2023-12-12T09:57:12.181 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 32169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ppdev.ko 2023-12-12T09:57:12.181 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 51113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tlclk.ko 2023-12-12T09:57:12.181 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/ 2023-12-12T09:57:12.181 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_atmel.ko 2023-12-12T09:57:12.181 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2023-12-12T09:57:12.181 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2023-12-12T09:57:12.181 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 32985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2023-12-12T09:57:12.181 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 30121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_infineon.ko 2023-12-12T09:57:12.181 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_nsc.ko 2023-12-12T09:57:12.182 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23561 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/xen-tpmfront.ko 2023-12-12T09:57:12.182 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/xillybus/ 2023-12-12T09:57:12.182 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17001 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/xillybus/xillybus_class.ko 2023-12-12T09:57:12.182 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 50945 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/xillybus/xillybus_core.ko 2023-12-12T09:57:12.182 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/xillybus/xillybus_pcie.ko 2023-12-12T09:57:12.182 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/clk/ 2023-12-12T09:57:12.182 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/clk/clk-palmas.ko 2023-12-12T09:57:12.182 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 47849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/clk/clk-si5351.ko 2023-12-12T09:57:12.182 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/clk/clk-twl6040.ko 2023-12-12T09:57:12.182 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/clk/clk-wm831x.ko 2023-12-12T09:57:12.182 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/ 2023-12-12T09:57:12.182 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-12-12T09:57:12.182 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/p4-clockmod.ko 2023-12-12T09:57:12.182 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 25297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/speedstep-lib.ko 2023-12-12T09:57:12.183 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/ 2023-12-12T09:57:12.183 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/ccp/ 2023-12-12T09:57:12.183 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 70801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-12-12T09:57:12.183 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 243025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/ccp/ccp.ko 2023-12-12T09:57:12.183 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/ 2023-12-12T09:57:12.183 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/ 2023-12-12T09:57:12.183 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_common/ 2023-12-12T09:57:12.183 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 438761 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-12-12T09:57:12.183 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2023-12-12T09:57:12.183 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-12-12T09:57:12.183 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/padlock-aes.ko 2023-12-12T09:57:12.183 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/padlock-sha.ko 2023-12-12T09:57:12.183 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/virtio/ 2023-12-12T09:57:12.183 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 70273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-12-12T09:57:12.183 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dca/ 2023-12-12T09:57:12.184 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 29785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dca/dca.ko 2023-12-12T09:57:12.184 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/ 2023-12-12T09:57:12.184 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/dw/ 2023-12-12T09:57:12.184 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/dw/dw_dmac.ko 2023-12-12T09:57:12.184 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/ioat/ 2023-12-12T09:57:12.184 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 122569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/ioat/ioatdma.ko 2023-12-12T09:57:12.184 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/ 2023-12-12T09:57:12.184 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 79953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/amd64_edac.ko 2023-12-12T09:57:12.184 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 35769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/e752x_edac.ko 2023-12-12T09:57:12.184 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 63617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/edac_mce_amd.ko 2023-12-12T09:57:12.184 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i3000_edac.ko 2023-12-12T09:57:12.184 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i3200_edac.ko 2023-12-12T09:57:12.184 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i5100_edac.ko 2023-12-12T09:57:12.184 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 25657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i5400_edac.ko 2023-12-12T09:57:12.185 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24913 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i7300_edac.ko 2023-12-12T09:57:12.185 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 52041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i7core_edac.ko 2023-12-12T09:57:12.185 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i82975x_edac.ko 2023-12-12T09:57:12.185 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/ie31200_edac.ko 2023-12-12T09:57:12.185 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 56825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/sb_edac.ko 2023-12-12T09:57:12.185 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/x38_edac.ko 2023-12-12T09:57:12.185 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/extcon/ 2023-12-12T09:57:12.185 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/extcon/extcon-gpio.ko 2023-12-12T09:57:12.185 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 27185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/extcon/extcon-max14577.ko 2023-12-12T09:57:12.185 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 29569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/extcon/extcon-max77693.ko 2023-12-12T09:57:12.185 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/extcon/extcon-max8997.ko 2023-12-12T09:57:12.185 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/extcon/extcon-palmas.ko 2023-12-12T09:57:12.185 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23713 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/extcon/extcon-rt8973a.ko 2023-12-12T09:57:12.185 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 27785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/extcon/extcon-sm5502.ko 2023-12-12T09:57:12.185 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware/ 2023-12-12T09:57:12.186 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 34977 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware/dmi-sysfs.ko 2023-12-12T09:57:12.186 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware/efi/ 2023-12-12T09:57:12.186 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware/efi/efi-pstore.ko 2023-12-12T09:57:12.186 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware/iscsi_ibft.ko 2023-12-12T09:57:12.186 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/ 2023-12-12T09:57:12.186 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-adp5520.ko 2023-12-12T09:57:12.186 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20153 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-amd8111.ko 2023-12-12T09:57:12.186 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-arizona.ko 2023-12-12T09:57:12.186 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-da9052.ko 2023-12-12T09:57:12.186 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-da9055.ko 2023-12-12T09:57:12.186 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-dln2.ko 2023-12-12T09:57:12.186 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 77849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-f7188x.ko 2023-12-12T09:57:12.186 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-generic.ko 2023-12-12T09:57:12.186 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-ich.ko 2023-12-12T09:57:12.187 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-janz-ttl.ko 2023-12-12T09:57:12.187 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-kempld.ko 2023-12-12T09:57:12.187 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-lp3943.ko 2023-12-12T09:57:12.187 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-max7300.ko 2023-12-12T09:57:12.187 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-max730x.ko 2023-12-12T09:57:12.187 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-max732x.ko 2023-12-12T09:57:12.187 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 25145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-ml-ioh.ko 2023-12-12T09:57:12.187 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 47073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-pca953x.ko 2023-12-12T09:57:12.187 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-pcf857x.ko 2023-12-12T09:57:12.187 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14377 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-rdc321x.ko 2023-12-12T09:57:12.187 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-sch.ko 2023-12-12T09:57:12.187 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-sch311x.ko 2023-12-12T09:57:12.187 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-tps65912.ko 2023-12-12T09:57:12.187 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-twl4030.ko 2023-12-12T09:57:12.187 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-twl6040.ko 2023-12-12T09:57:12.188 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-viperboard.ko 2023-12-12T09:57:12.188 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15377 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-vx855.ko 2023-12-12T09:57:12.188 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16281 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-wm831x.ko 2023-12-12T09:57:12.188 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-wm8350.ko 2023-12-12T09:57:12.188 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-wm8994.ko 2023-12-12T09:57:12.188 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/ 2023-12-12T09:57:12.188 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-a4tech.ko 2023-12-12T09:57:12.188 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 39169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-apple.ko 2023-12-12T09:57:12.188 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-appleir.ko 2023-12-12T09:57:12.188 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-aureal.ko 2023-12-12T09:57:12.188 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-axff.ko 2023-12-12T09:57:12.188 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-belkin.ko 2023-12-12T09:57:12.188 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-cherry.ko 2023-12-12T09:57:12.188 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-chicony.ko 2023-12-12T09:57:12.189 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 60649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-cp2112.ko 2023-12-12T09:57:12.189 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-cypress.ko 2023-12-12T09:57:12.189 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-dr.ko 2023-12-12T09:57:12.189 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-elecom.ko 2023-12-12T09:57:12.189 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-elo.ko 2023-12-12T09:57:12.189 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-emsff.ko 2023-12-12T09:57:12.189 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-ezkey.ko 2023-12-12T09:57:12.189 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-gaff.ko 2023-12-12T09:57:12.189 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-generic.ko 2023-12-12T09:57:12.189 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-gt683r.ko 2023-12-12T09:57:12.189 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-gyration.ko 2023-12-12T09:57:12.189 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-holtek-kbd.ko 2023-12-12T09:57:12.189 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-holtek-mouse.ko 2023-12-12T09:57:12.189 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-holtekff.ko 2023-12-12T09:57:12.189 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-hyperv.ko 2023-12-12T09:57:12.190 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-icade.ko 2023-12-12T09:57:12.190 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-kensington.ko 2023-12-12T09:57:12.190 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-keytouch.ko 2023-12-12T09:57:12.190 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-kye.ko 2023-12-12T09:57:12.190 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-lcpower.ko 2023-12-12T09:57:12.190 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-led.ko 2023-12-12T09:57:12.190 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 42297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-lenovo.ko 2023-12-12T09:57:12.190 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 30697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-lg-g15.ko 2023-12-12T09:57:12.190 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 58185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-logitech-dj.ko 2023-12-12T09:57:12.190 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 101481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-12-12T09:57:12.190 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 80993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-logitech.ko 2023-12-12T09:57:12.190 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 30801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-magicmouse.ko 2023-12-12T09:57:12.190 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-microsoft.ko 2023-12-12T09:57:12.190 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10361 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-monterey.ko 2023-12-12T09:57:12.191 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 50161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-multitouch.ko 2023-12-12T09:57:12.191 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 32593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-ntrig.ko 2023-12-12T09:57:12.191 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-ortek.ko 2023-12-12T09:57:12.191 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-penmount.ko 2023-12-12T09:57:12.191 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-petalynx.ko 2023-12-12T09:57:12.191 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 72937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-picolcd.ko 2023-12-12T09:57:12.191 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-pl.ko 2023-12-12T09:57:12.191 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-plantronics.ko 2023-12-12T09:57:12.191 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8417 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-primax.ko 2023-12-12T09:57:12.191 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 35393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-rmi.ko 2023-12-12T09:57:12.191 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-arvo.ko 2023-12-12T09:57:12.191 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-common.ko 2023-12-12T09:57:12.191 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 31425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-isku.ko 2023-12-12T09:57:12.191 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 29729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-kone.ko 2023-12-12T09:57:12.191 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 31129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-12-12T09:57:12.192 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-konepure.ko 2023-12-12T09:57:12.192 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 29489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-12-12T09:57:12.192 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-lua.ko 2023-12-12T09:57:12.192 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 29313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-pyra.ko 2023-12-12T09:57:12.192 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 27937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-ryos.ko 2023-12-12T09:57:12.192 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-savu.ko 2023-12-12T09:57:12.192 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat.ko 2023-12-12T09:57:12.192 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-saitek.ko 2023-12-12T09:57:12.192 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-samsung.ko 2023-12-12T09:57:12.192 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 36817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sensor-hub.ko 2023-12-12T09:57:12.192 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sjoy.ko 2023-12-12T09:57:12.193 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 51249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sony.ko 2023-12-12T09:57:12.193 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-speedlink.ko 2023-12-12T09:57:12.193 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 25297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-steelseries.ko 2023-12-12T09:57:12.193 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sunplus.ko 2023-12-12T09:57:12.193 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-thrustmaster.ko 2023-12-12T09:57:12.193 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-tivo.ko 2023-12-12T09:57:12.193 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-tmff.ko 2023-12-12T09:57:12.193 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-topseed.ko 2023-12-12T09:57:12.193 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-twinhan.ko 2023-12-12T09:57:12.193 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 71073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-uclogic.ko 2023-12-12T09:57:12.193 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-waltop.ko 2023-12-12T09:57:12.193 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 143473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-wiimote.ko 2023-12-12T09:57:12.193 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8153 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-xinmo.ko 2023-12-12T09:57:12.193 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-zpff.ko 2023-12-12T09:57:12.194 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-zydacron.ko 2023-12-12T09:57:12.194 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 267825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid.ko 2023-12-12T09:57:12.194 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 32321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/uhid.ko 2023-12-12T09:57:12.194 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/usbhid/ 2023-12-12T09:57:12.194 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 125721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/usbhid/usbhid.ko 2023-12-12T09:57:12.194 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/usbhid/usbkbd.ko 2023-12-12T09:57:12.194 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/usbhid/usbmouse.ko 2023-12-12T09:57:12.194 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 217873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/wacom.ko 2023-12-12T09:57:12.194 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv/ 2023-12-12T09:57:12.194 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 64201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv/hv_balloon.ko 2023-12-12T09:57:12.194 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 89625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv/hv_utils.ko 2023-12-12T09:57:12.194 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 305465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv/hv_vmbus.ko 2023-12-12T09:57:12.194 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ 2023-12-12T09:57:12.194 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 66521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/abituguru.ko 2023-12-12T09:57:12.194 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 61393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/abituguru3.ko 2023-12-12T09:57:12.195 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 34745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/acpi_power_meter.ko 2023-12-12T09:57:12.195 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ad7414.ko 2023-12-12T09:57:12.195 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ad7418.ko 2023-12-12T09:57:12.195 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 25257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adc128d818.ko 2023-12-12T09:57:12.195 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 31729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1025.ko 2023-12-12T09:57:12.195 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 97977 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1026.ko 2023-12-12T09:57:12.195 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1029.ko 2023-12-12T09:57:12.195 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 45553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1031.ko 2023-12-12T09:57:12.195 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm9240.ko 2023-12-12T09:57:12.195 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ads7828.ko 2023-12-12T09:57:12.196 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7410.ko 2023-12-12T09:57:12.196 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7411.ko 2023-12-12T09:57:12.196 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 74433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7462.ko 2023-12-12T09:57:12.196 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 39585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7470.ko 2023-12-12T09:57:12.196 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 67929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7475.ko 2023-12-12T09:57:12.196 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7x10.ko 2023-12-12T09:57:12.196 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 39073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/amc6821.ko 2023-12-12T09:57:12.196 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 55201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/applesmc.ko 2023-12-12T09:57:12.196 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 49913 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/asb100.ko 2023-12-12T09:57:12.196 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 58617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/asc7621.ko 2023-12-12T09:57:12.196 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 40825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/asus_atk0110.ko 2023-12-12T09:57:12.196 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/atxp1.ko 2023-12-12T09:57:12.196 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28281 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/coretemp.ko 2023-12-12T09:57:12.196 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/da9052-hwmon.ko 2023-12-12T09:57:12.197 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/da9055-hwmon.ko 2023-12-12T09:57:12.197 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 44465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-12-12T09:57:12.197 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 99601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/dme1737.ko 2023-12-12T09:57:12.197 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ds1621.ko 2023-12-12T09:57:12.197 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ds620.ko 2023-12-12T09:57:12.197 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 29777 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/emc1403.ko 2023-12-12T09:57:12.197 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 33185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/emc2103.ko 2023-12-12T09:57:12.197 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 30321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/emc6w201.ko 2023-12-12T09:57:12.197 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 66985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/f71805f.ko 2023-12-12T09:57:12.197 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 94457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/f71882fg.ko 2023-12-12T09:57:12.197 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 41401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/f75375s.ko 2023-12-12T09:57:12.197 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/fam15h_power.ko 2023-12-12T09:57:12.197 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 55449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/fschmd.ko 2023-12-12T09:57:12.197 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/g760a.ko 2023-12-12T09:57:12.197 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/g762.ko 2023-12-12T09:57:12.198 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 46801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/gl518sm.ko 2023-12-12T09:57:12.198 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 45529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/gl520sm.ko 2023-12-12T09:57:12.198 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/hih6130.ko 2023-12-12T09:57:12.198 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/hwmon-vid.ko 2023-12-12T09:57:12.198 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/i5500_temp.ko 2023-12-12T09:57:12.198 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/i5k_amb.ko 2023-12-12T09:57:12.198 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 34529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ibmaem.ko 2023-12-12T09:57:12.198 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ibmpex.ko 2023-12-12T09:57:12.198 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ina209.ko 2023-12-12T09:57:12.198 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ina2xx.ko 2023-12-12T09:57:12.198 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 130449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/it87.ko 2023-12-12T09:57:12.198 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/jc42.ko 2023-12-12T09:57:12.198 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/k10temp.ko 2023-12-12T09:57:12.198 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/k8temp.ko 2023-12-12T09:57:12.198 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lineage-pem.ko 2023-12-12T09:57:12.199 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 48601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm63.ko 2023-12-12T09:57:12.199 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm73.ko 2023-12-12T09:57:12.199 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 36777 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm75.ko 2023-12-12T09:57:12.199 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm77.ko 2023-12-12T09:57:12.199 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 34593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm78.ko 2023-12-12T09:57:12.199 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 31745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm80.ko 2023-12-12T09:57:12.199 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm83.ko 2023-12-12T09:57:12.199 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 72833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm85.ko 2023-12-12T09:57:12.199 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 46153 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm87.ko 2023-12-12T09:57:12.199 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 37913 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm90.ko 2023-12-12T09:57:12.199 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm92.ko 2023-12-12T09:57:12.199 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 108841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm93.ko 2023-12-12T09:57:12.199 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 33393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm95234.ko 2023-12-12T09:57:12.199 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm95241.ko 2023-12-12T09:57:12.200 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm95245.ko 2023-12-12T09:57:12.200 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc2945.ko 2023-12-12T09:57:12.200 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4151.ko 2023-12-12T09:57:12.200 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4215.ko 2023-12-12T09:57:12.200 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4222.ko 2023-12-12T09:57:12.200 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4245.ko 2023-12-12T09:57:12.200 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4260.ko 2023-12-12T09:57:12.200 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4261.ko 2023-12-12T09:57:12.200 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 33489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max16065.ko 2023-12-12T09:57:12.200 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max1619.ko 2023-12-12T09:57:12.200 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max1668.ko 2023-12-12T09:57:12.200 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max197.ko 2023-12-12T09:57:12.200 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 27129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max6639.ko 2023-12-12T09:57:12.200 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max6650.ko 2023-12-12T09:57:12.201 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 35777 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max6697.ko 2023-12-12T09:57:12.201 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/mc13783-adc.ko 2023-12-12T09:57:12.201 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/mcp3021.ko 2023-12-12T09:57:12.201 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2023-12-12T09:57:12.201 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 44129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct6683.ko 2023-12-12T09:57:12.201 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 119817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct6775-core.ko 2023-12-12T09:57:12.201 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 60705 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct6775.ko 2023-12-12T09:57:12.201 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 59737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct7802.ko 2023-12-12T09:57:12.201 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 82337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pc87360.ko 2023-12-12T09:57:12.201 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 54433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pc87427.ko 2023-12-12T09:57:12.201 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pcf8591.ko 2023-12-12T09:57:12.201 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/ 2023-12-12T09:57:12.201 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-12-12T09:57:12.202 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-12-12T09:57:12.202 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-12-12T09:57:12.202 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/max16064.ko 2023-12-12T09:57:12.202 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/max34440.ko 2023-12-12T09:57:12.202 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/max8688.ko 2023-12-12T09:57:12.202 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-12-12T09:57:12.202 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 82577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-12-12T09:57:12.202 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-12-12T09:57:12.202 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 30729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-12-12T09:57:12.202 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-12-12T09:57:12.202 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-12-12T09:57:12.202 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/powr1220.ko 2023-12-12T09:57:12.202 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18705 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sch5627.ko 2023-12-12T09:57:12.202 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sch5636.ko 2023-12-12T09:57:12.203 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 27145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sch56xx-common.ko 2023-12-12T09:57:12.203 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 32137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sht15.ko 2023-12-12T09:57:12.203 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sht21.ko 2023-12-12T09:57:12.203 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/shtc1.ko 2023-12-12T09:57:12.203 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 40105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sis5595.ko 2023-12-12T09:57:12.203 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/smsc47b397.ko 2023-12-12T09:57:12.203 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 39193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/smsc47m1.ko 2023-12-12T09:57:12.203 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 37385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/smsc47m192.ko 2023-12-12T09:57:12.203 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/thmc50.ko 2023-12-12T09:57:12.203 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp102.ko 2023-12-12T09:57:12.203 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp103.ko 2023-12-12T09:57:12.203 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp401.ko 2023-12-12T09:57:12.203 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp421.ko 2023-12-12T09:57:12.203 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/via-cputemp.ko 2023-12-12T09:57:12.203 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 41945 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/via686a.ko 2023-12-12T09:57:12.204 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 52457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/vt1211.ko 2023-12-12T09:57:12.204 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 51545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/vt8231.ko 2023-12-12T09:57:12.204 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 57449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83627ehf.ko 2023-12-12T09:57:12.204 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 78873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83627hf.ko 2023-12-12T09:57:12.204 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 71345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83781d.ko 2023-12-12T09:57:12.204 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 63225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83791d.ko 2023-12-12T09:57:12.204 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 71321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83792d.ko 2023-12-12T09:57:12.204 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 101473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83793.ko 2023-12-12T09:57:12.204 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 119505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83795.ko 2023-12-12T09:57:12.204 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83l785ts.ko 2023-12-12T09:57:12.204 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 35625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83l786ng.ko 2023-12-12T09:57:12.204 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/wm831x-hwmon.ko 2023-12-12T09:57:12.204 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/wm8350-hwmon.ko 2023-12-12T09:57:12.204 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/ 2023-12-12T09:57:12.205 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/algos/ 2023-12-12T09:57:12.205 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-12-12T09:57:12.205 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-12-12T09:57:12.205 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/ 2023-12-12T09:57:12.205 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 27969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-ali1535.ko 2023-12-12T09:57:12.205 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-ali1563.ko 2023-12-12T09:57:12.205 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 27777 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2023-12-12T09:57:12.205 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-12-12T09:57:12.205 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-12-12T09:57:12.205 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-12-12T09:57:12.205 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15153 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2023-12-12T09:57:12.205 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 6929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-12-12T09:57:12.205 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2023-12-12T09:57:12.205 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 50201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-12-12T09:57:12.205 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-12-12T09:57:12.206 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20001 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-12-12T09:57:12.206 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-12-12T09:57:12.206 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-dln2.ko 2023-12-12T09:57:12.206 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-gpio.ko 2023-12-12T09:57:12.206 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 62817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-i801.ko 2023-12-12T09:57:12.206 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-isch.ko 2023-12-12T09:57:12.206 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 47889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-12-12T09:57:12.206 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-kempld.ko 2023-12-12T09:57:12.206 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-12-12T09:57:12.206 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-12-12T09:57:12.206 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-ocores.ko 2023-12-12T09:57:12.206 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 25145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-parport.ko 2023-12-12T09:57:12.206 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-12-12T09:57:12.207 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 47241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-12-12T09:57:12.207 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2023-12-12T09:57:12.207 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-12-12T09:57:12.207 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-12-12T09:57:12.207 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-sis5595.ko 2023-12-12T09:57:12.207 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 29361 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-sis630.ko 2023-12-12T09:57:12.207 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-12-12T09:57:12.207 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2023-12-12T09:57:12.207 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-12-12T09:57:12.207 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-via.ko 2023-12-12T09:57:12.207 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-12-12T09:57:12.207 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-12-12T09:57:12.208 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 47657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-xiic.ko 2023-12-12T09:57:12.208 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-mux.ko 2023-12-12T09:57:12.208 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-smbus.ko 2023-12-12T09:57:12.208 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 27073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-stub.ko 2023-12-12T09:57:12.208 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/muxes/ 2023-12-12T09:57:12.208 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2023-12-12T09:57:12.208 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2023-12-12T09:57:12.208 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 29737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2023-12-12T09:57:12.208 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ 2023-12-12T09:57:12.208 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ 2023-12-12T09:57:12.208 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 273609 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_cm.ko 2023-12-12T09:57:12.208 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 879969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_core.ko 2023-12-12T09:57:12.208 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 69273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_umad.ko 2023-12-12T09:57:12.208 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 324217 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-12-12T09:57:12.209 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 97985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/iw_cm.ko 2023-12-12T09:57:12.209 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 282273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/rdma_cm.ko 2023-12-12T09:57:12.209 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 66201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-12-12T09:57:12.209 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/ 2023-12-12T09:57:12.209 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/cxgb4/ 2023-12-12T09:57:12.209 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 493073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-12-12T09:57:12.209 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx4/ 2023-12-12T09:57:12.209 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 419737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-12-12T09:57:12.209 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx5/ 2023-12-12T09:57:12.209 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 739025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-12-12T09:57:12.209 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mthca/ 2023-12-12T09:57:12.209 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 296625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-12-12T09:57:12.209 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/ocrdma/ 2023-12-12T09:57:12.209 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 153697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2023-12-12T09:57:12.210 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/usnic/ 2023-12-12T09:57:12.210 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 168969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2023-12-12T09:57:12.210 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/ 2023-12-12T09:57:12.210 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/ipoib/ 2023-12-12T09:57:12.210 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 263081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-12-12T09:57:12.210 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/iser/ 2023-12-12T09:57:12.210 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 100241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-12-12T09:57:12.210 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/isert/ 2023-12-12T09:57:12.210 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 111425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-12-12T09:57:12.210 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srp/ 2023-12-12T09:57:12.210 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 128753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-12-12T09:57:12.210 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srpt/ 2023-12-12T09:57:12.210 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 129529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-12-12T09:57:12.210 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/ 2023-12-12T09:57:12.211 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/evbug.ko 2023-12-12T09:57:12.211 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/ff-memless.ko 2023-12-12T09:57:12.211 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport/ 2023-12-12T09:57:12.211 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-12-12T09:57:12.211 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport/fm801-gp.ko 2023-12-12T09:57:12.211 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 41241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport/gameport.ko 2023-12-12T09:57:12.211 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 41801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/joydev.ko 2023-12-12T09:57:12.211 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/ 2023-12-12T09:57:12.211 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/adp5520-keys.ko 2023-12-12T09:57:12.211 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/adp5588-keys.ko 2023-12-12T09:57:12.211 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/adp5589-keys.ko 2023-12-12T09:57:12.211 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24761 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2023-12-12T09:57:12.211 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 36665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/gpio_keys.ko 2023-12-12T09:57:12.211 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2023-12-12T09:57:12.211 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/lkkbd.ko 2023-12-12T09:57:12.212 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/lm8323.ko 2023-12-12T09:57:12.212 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/lm8333.ko 2023-12-12T09:57:12.212 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/matrix_keypad.ko 2023-12-12T09:57:12.212 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18217 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/max7359_keypad.ko 2023-12-12T09:57:12.212 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/mcs_touchkey.ko 2023-12-12T09:57:12.212 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2023-12-12T09:57:12.212 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/newtonkbd.ko 2023-12-12T09:57:12.212 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/opencores-kbd.ko 2023-12-12T09:57:12.212 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/qt1070.ko 2023-12-12T09:57:12.212 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/qt2160.ko 2023-12-12T09:57:12.212 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/samsung-keypad.ko 2023-12-12T09:57:12.212 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/stowaway.ko 2023-12-12T09:57:12.212 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/sunkbd.ko 2023-12-12T09:57:12.213 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/tca6416-keypad.ko 2023-12-12T09:57:12.213 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/tca8418_keypad.ko 2023-12-12T09:57:12.213 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/twl4030_keypad.ko 2023-12-12T09:57:12.213 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/xtkbd.ko 2023-12-12T09:57:12.213 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/matrix-keymap.ko 2023-12-12T09:57:12.213 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/ 2023-12-12T09:57:12.213 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 34329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/appletouch.ko 2023-12-12T09:57:12.213 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 34177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/bcm5974.ko 2023-12-12T09:57:12.213 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 123681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/cyapatp.ko 2023-12-12T09:57:12.213 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 89449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/elan_i2c.ko 2023-12-12T09:57:12.213 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/gpio_mouse.ko 2023-12-12T09:57:12.213 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 335929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/psmouse.ko 2023-12-12T09:57:12.213 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/sermouse.ko 2023-12-12T09:57:12.213 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-12-12T09:57:12.213 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/synaptics_usb.ko 2023-12-12T09:57:12.214 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/vsxxxaa.ko 2023-12-12T09:57:12.214 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/rmi4/ 2023-12-12T09:57:12.214 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 109873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/rmi4/rmi_core.ko 2023-12-12T09:57:12.214 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/ 2023-12-12T09:57:12.214 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/altera_ps2.ko 2023-12-12T09:57:12.214 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/arc_ps2.ko 2023-12-12T09:57:12.214 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/ct82c710.ko 2023-12-12T09:57:12.214 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-12-12T09:57:12.214 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/parkbd.ko 2023-12-12T09:57:12.214 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/pcips2.ko 2023-12-12T09:57:12.214 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20153 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/ps2mult.ko 2023-12-12T09:57:12.214 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24153 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/serio_raw.ko 2023-12-12T09:57:12.214 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17977 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/serport.ko 2023-12-12T09:57:12.214 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/sparse-keymap.ko 2023-12-12T09:57:12.214 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/iommu/ 2023-12-12T09:57:12.215 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/iommu/amd/ 2023-12-12T09:57:12.215 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 39289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/iommu/amd/iommu_v2.ko 2023-12-12T09:57:12.215 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/ 2023-12-12T09:57:12.215 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-88pm860x.ko 2023-12-12T09:57:12.215 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-adp5520.ko 2023-12-12T09:57:12.215 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 59753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-bd2802.ko 2023-12-12T09:57:12.215 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-blinkm.ko 2023-12-12T09:57:12.215 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-da903x.ko 2023-12-12T09:57:12.215 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-da9052.ko 2023-12-12T09:57:12.215 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16561 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-gpio.ko 2023-12-12T09:57:12.215 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-lm3530.ko 2023-12-12T09:57:12.215 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 30505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-lm3533.ko 2023-12-12T09:57:12.215 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-lm355x.ko 2023-12-12T09:57:12.215 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-lm3642.ko 2023-12-12T09:57:12.215 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-lp3944.ko 2023-12-12T09:57:12.216 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11233 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-lp8788.ko 2023-12-12T09:57:12.216 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-max8997.ko 2023-12-12T09:57:12.216 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-mc13783.ko 2023-12-12T09:57:12.216 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-menf21bmc.ko 2023-12-12T09:57:12.216 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-pca9532.ko 2023-12-12T09:57:12.216 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-pca955x.ko 2023-12-12T09:57:12.216 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-pca963x.ko 2023-12-12T09:57:12.216 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 34433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-ss4200.ko 2023-12-12T09:57:12.216 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-tca6507.ko 2023-12-12T09:57:12.216 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-wm831x-status.ko 2023-12-12T09:57:12.216 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-wm8350.ko 2023-12-12T09:57:12.216 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ 2023-12-12T09:57:12.216 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-12-12T09:57:12.216 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-12-12T09:57:12.216 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-12-12T09:57:12.217 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-12-12T09:57:12.217 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-12-12T09:57:12.217 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-12-12T09:57:12.217 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-12-12T09:57:12.217 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-12-12T09:57:12.217 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/ 2023-12-12T09:57:12.217 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/bcache/ 2023-12-12T09:57:12.217 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 654969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/bcache/bcache.ko 2023-12-12T09:57:12.217 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 40577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-bio-prison.ko 2023-12-12T09:57:12.217 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 89601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-bufio.ko 2023-12-12T09:57:12.217 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 47529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-cache-smq.ko 2023-12-12T09:57:12.217 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 156009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-cache.ko 2023-12-12T09:57:12.217 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 106897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-crypt.ko 2023-12-12T09:57:12.217 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-delay.ko 2023-12-12T09:57:12.217 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 53857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-era.ko 2023-12-12T09:57:12.217 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-flakey.ko 2023-12-12T09:57:12.217 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 41529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-log-userspace.ko 2023-12-12T09:57:12.218 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 32737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-log.ko 2023-12-12T09:57:12.218 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 49545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-mirror.ko 2023-12-12T09:57:12.218 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 78033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-multipath.ko 2023-12-12T09:57:12.218 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-queue-length.ko 2023-12-12T09:57:12.218 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 70825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-raid.ko 2023-12-12T09:57:12.218 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 36297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-region-hash.ko 2023-12-12T09:57:12.218 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-round-robin.ko 2023-12-12T09:57:12.218 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-service-time.ko 2023-12-12T09:57:12.218 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 109529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-snapshot.ko 2023-12-12T09:57:12.218 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19361 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-switch.ko 2023-12-12T09:57:12.218 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 181865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-thin-pool.ko 2023-12-12T09:57:12.218 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 51737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-verity.ko 2023-12-12T09:57:12.218 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8561 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-zero.ko 2023-12-12T09:57:12.218 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/faulty.ko 2023-12-12T09:57:12.219 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/linear.ko 2023-12-12T09:57:12.219 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 32417 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/multipath.ko 2023-12-12T09:57:12.219 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/persistent-data/ 2023-12-12T09:57:12.219 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 199937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-12-12T09:57:12.219 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 37337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid0.ko 2023-12-12T09:57:12.219 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 113073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid1.ko 2023-12-12T09:57:12.219 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 158681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid10.ko 2023-12-12T09:57:12.219 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 395721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid456.ko 2023-12-12T09:57:12.300 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/ 2023-12-12T09:57:12.300 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/ 2023-12-12T09:57:12.300 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 178137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptbase.ko 2023-12-12T09:57:12.301 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 63385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptctl.ko 2023-12-12T09:57:12.301 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 44665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptfc.ko 2023-12-12T09:57:12.301 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 37225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptlan.ko 2023-12-12T09:57:12.301 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 123321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptsas.ko 2023-12-12T09:57:12.301 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 79041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptscsih.ko 2023-12-12T09:57:12.301 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 53017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptspi.ko 2023-12-12T09:57:12.301 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/ 2023-12-12T09:57:12.301 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/88pm800.ko 2023-12-12T09:57:12.301 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12761 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/88pm805.ko 2023-12-12T09:57:12.301 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/88pm80x.ko 2023-12-12T09:57:12.301 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/arizona-i2c.ko 2023-12-12T09:57:12.301 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 123721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/arizona.ko 2023-12-12T09:57:12.301 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/bcm590xx.ko 2023-12-12T09:57:12.301 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/cros_ec_dev.ko 2023-12-12T09:57:12.302 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 34961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/dln2.ko 2023-12-12T09:57:12.302 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16689 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/janz-cmodio.ko 2023-12-12T09:57:12.302 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 53585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/kempld-core.ko 2023-12-12T09:57:12.302 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 27529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/lm3533-core.ko 2023-12-12T09:57:12.302 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/lm3533-ctrlbank.ko 2023-12-12T09:57:12.302 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/lp3943.ko 2023-12-12T09:57:12.302 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 54569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/lpc_ich.ko 2023-12-12T09:57:12.302 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/lpc_sch.ko 2023-12-12T09:57:12.302 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/max8907.ko 2023-12-12T09:57:12.302 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 29857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/mc13xxx-core.ko 2023-12-12T09:57:12.302 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/mc13xxx-i2c.ko 2023-12-12T09:57:12.302 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/menf21bmc.ko 2023-12-12T09:57:12.302 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/pcf50633-adc.ko 2023-12-12T09:57:12.303 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9153 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/pcf50633-gpio.ko 2023-12-12T09:57:12.303 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 34873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/pcf50633.ko 2023-12-12T09:57:12.303 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/rdc321x-southbridge.ko 2023-12-12T09:57:12.303 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/retu-mfd.ko 2023-12-12T09:57:12.303 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 80425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/si476x-core.ko 2023-12-12T09:57:12.303 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 48457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/sm501.ko 2023-12-12T09:57:12.303 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/ti_am335x_tscadc.ko 2023-12-12T09:57:12.303 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 51137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/tps65010.ko 2023-12-12T09:57:12.303 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/tps6507x.ko 2023-12-12T09:57:12.303 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/viperboard.ko 2023-12-12T09:57:12.303 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/vx855.ko 2023-12-12T09:57:12.303 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/wl1273-core.ko 2023-12-12T09:57:12.303 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 44345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/wm8994.ko 2023-12-12T09:57:12.303 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/ 2023-12-12T09:57:12.304 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/ad525x_dpot-i2c.ko 2023-12-12T09:57:12.304 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 48489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/ad525x_dpot.ko 2023-12-12T09:57:12.304 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/altera-stapl/ 2023-12-12T09:57:12.304 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 46585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-12-12T09:57:12.304 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/apds9802als.ko 2023-12-12T09:57:12.304 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 36729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/apds990x.ko 2023-12-12T09:57:12.304 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 45593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/bh1770glc.ko 2023-12-12T09:57:12.304 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/c2port/ 2023-12-12T09:57:12.304 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2023-12-12T09:57:12.304 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 35281 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/c2port/core.ko 2023-12-12T09:57:12.304 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/cb710/ 2023-12-12T09:57:12.304 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 25161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/cb710/cb710.ko 2023-12-12T09:57:12.304 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/ds1682.ko 2023-12-12T09:57:12.304 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/dummy-irq.ko 2023-12-12T09:57:12.304 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/echo/ 2023-12-12T09:57:12.305 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/echo/echo.ko 2023-12-12T09:57:12.305 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/ 2023-12-12T09:57:12.305 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 37849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/at24.ko 2023-12-12T09:57:12.305 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/eeprom.ko 2023-12-12T09:57:12.305 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-12-12T09:57:12.305 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/max6875.ko 2023-12-12T09:57:12.305 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 33009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/enclosure.ko 2023-12-12T09:57:12.305 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/genwqe/ 2023-12-12T09:57:12.305 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 152201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/genwqe/genwqe_card.ko 2023-12-12T09:57:12.305 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/hmc6352.ko 2023-12-12T09:57:12.305 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 31257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/hpilo.ko 2023-12-12T09:57:12.305 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/ibmasm/ 2023-12-12T09:57:12.305 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 72129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/ibmasm/ibmasm.ko 2023-12-12T09:57:12.305 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/ics932s401.ko 2023-12-12T09:57:12.305 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/isl29003.ko 2023-12-12T09:57:12.306 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/isl29020.ko 2023-12-12T09:57:12.306 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/lis3lv02d/ 2023-12-12T09:57:12.306 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 42513 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-12-12T09:57:12.306 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-12-12T09:57:12.306 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei/ 2023-12-12T09:57:12.306 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 125209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei/mei-me.ko 2023-12-12T09:57:12.306 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 56521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei/mei-txe.ko 2023-12-12T09:57:12.306 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 310113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei/mei.ko 2023-12-12T09:57:12.306 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 31329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/phantom.ko 2023-12-12T09:57:12.306 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/ti-st/ 2023-12-12T09:57:12.306 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 74265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/ti-st/st_drv.ko 2023-12-12T09:57:12.306 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/tifm_7xx1.ko 2023-12-12T09:57:12.306 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/tifm_core.ko 2023-12-12T09:57:12.306 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/tsl2550.ko 2023-12-12T09:57:12.307 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 48697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/vmw_balloon.ko 2023-12-12T09:57:12.307 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/vmw_vmci/ 2023-12-12T09:57:12.307 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 183609 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-12-12T09:57:12.307 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ 2023-12-12T09:57:12.307 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/bonding/ 2023-12-12T09:57:12.307 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 490129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/bonding/bonding.ko 2023-12-12T09:57:12.307 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/ 2023-12-12T09:57:12.307 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/b53/ 2023-12-12T09:57:12.307 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 106033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/b53/b53_common.ko 2023-12-12T09:57:12.307 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 40417 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/bcm-sf2.ko 2023-12-12T09:57:12.307 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/mv88e6060.ko 2023-12-12T09:57:12.307 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/mv88e6xxx/ 2023-12-12T09:57:12.307 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 453737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-12-12T09:57:12.308 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dummy.ko 2023-12-12T09:57:12.308 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/eql.ko 2023-12-12T09:57:12.308 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ 2023-12-12T09:57:12.308 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/ 2023-12-12T09:57:12.308 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 45785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-12-12T09:57:12.308 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 42105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-12-12T09:57:12.308 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 130553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-12-12T09:57:12.308 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 68849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-12-12T09:57:12.308 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/ 2023-12-12T09:57:12.308 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 37649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/8390.ko 2023-12-12T09:57:12.308 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 59689 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-12-12T09:57:12.308 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 27201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-12-12T09:57:12.308 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 99049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-12-12T09:57:12.308 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/adaptec/ 2023-12-12T09:57:12.308 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 54521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-12-12T09:57:12.309 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/agere/ 2023-12-12T09:57:12.309 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 69137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/agere/et131x.ko 2023-12-12T09:57:12.309 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/alteon/ 2023-12-12T09:57:12.309 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 59585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-12-12T09:57:12.309 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/altera/ 2023-12-12T09:57:12.309 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 41409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-12-12T09:57:12.309 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd/ 2023-12-12T09:57:12.309 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 54609 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-12-12T09:57:12.309 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 49289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-12-12T09:57:12.309 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 87297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-12-12T09:57:12.309 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/ 2023-12-12T09:57:12.309 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/alx/ 2023-12-12T09:57:12.309 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 97337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-12-12T09:57:12.309 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1c/ 2023-12-12T09:57:12.309 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 104673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-12-12T09:57:12.310 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1e/ 2023-12-12T09:57:12.310 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 90257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-12-12T09:57:12.310 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atlx/ 2023-12-12T09:57:12.310 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 81569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-12-12T09:57:12.310 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 69729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-12-12T09:57:12.310 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/ 2023-12-12T09:57:12.310 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 78401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-12-12T09:57:12.310 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 176761 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-12-12T09:57:12.310 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2023-12-12T09:57:12.310 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 1421497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-12-12T09:57:12.310 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 128569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-12-12T09:57:12.310 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/genet/ 2023-12-12T09:57:12.310 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 132089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-12-12T09:57:12.310 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 312081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-12-12T09:57:12.311 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/brocade/ 2023-12-12T09:57:12.311 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/brocade/bna/ 2023-12-12T09:57:12.311 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 323513 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-12-12T09:57:12.311 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/ 2023-12-12T09:57:12.311 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb/ 2023-12-12T09:57:12.311 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 193497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-12-12T09:57:12.311 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2023-12-12T09:57:12.311 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 347417 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-12-12T09:57:12.311 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2023-12-12T09:57:12.311 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 1044497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-12-12T09:57:12.311 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2023-12-12T09:57:12.311 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 166193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-12-12T09:57:12.311 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2023-12-12T09:57:12.311 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 34881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-12-12T09:57:12.312 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/cisco/ 2023-12-12T09:57:12.312 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/cisco/enic/ 2023-12-12T09:57:12.312 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 204345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-12-12T09:57:12.312 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/ 2023-12-12T09:57:12.312 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/ 2023-12-12T09:57:12.312 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 69449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-12-12T09:57:12.312 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 61489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-12-12T09:57:12.312 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 141225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-12-12T09:57:12.312 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 51497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-12-12T09:57:12.312 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 62817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-12-12T09:57:12.312 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 31369 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-12-12T09:57:12.312 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dlink/ 2023-12-12T09:57:12.312 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 60873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-12-12T09:57:12.312 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 62833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-12-12T09:57:12.313 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 45721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dnet.ko 2023-12-12T09:57:12.313 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 25185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ec_bhf.ko 2023-12-12T09:57:12.313 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/emulex/ 2023-12-12T09:57:12.313 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/emulex/benet/ 2023-12-12T09:57:12.313 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 281137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-12-12T09:57:12.313 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 49457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ethoc.ko 2023-12-12T09:57:12.313 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 51737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/fealnx.ko 2023-12-12T09:57:12.313 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/fujitsu/ 2023-12-12T09:57:12.313 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 45345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2023-12-12T09:57:12.313 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ 2023-12-12T09:57:12.313 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 90465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e100.ko 2023-12-12T09:57:12.313 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000/ 2023-12-12T09:57:12.313 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 295577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-12-12T09:57:12.313 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000e/ 2023-12-12T09:57:12.314 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 584497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-12-12T09:57:12.314 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/fm10k/ 2023-12-12T09:57:12.314 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 246209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-12-12T09:57:12.314 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/i40e/ 2023-12-12T09:57:12.314 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 925825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-12-12T09:57:12.314 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/iavf/ 2023-12-12T09:57:12.314 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 302937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-12-12T09:57:12.314 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igb/ 2023-12-12T09:57:12.314 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 514641 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-12-12T09:57:12.314 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igbvf/ 2023-12-12T09:57:12.314 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 93593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-12-12T09:57:12.314 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbe/ 2023-12-12T09:57:12.314 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 734305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-12-12T09:57:12.314 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbevf/ 2023-12-12T09:57:12.314 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 151769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-12-12T09:57:12.315 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 86921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/jme.ko 2023-12-12T09:57:12.315 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell/ 2023-12-12T09:57:12.315 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20977 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-12-12T09:57:12.315 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 102289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell/skge.ko 2023-12-12T09:57:12.315 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 122649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-12-12T09:57:12.315 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/ 2023-12-12T09:57:12.315 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx4/ 2023-12-12T09:57:12.315 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 727601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-12-12T09:57:12.315 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 278937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-12-12T09:57:12.315 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx5/ 2023-12-12T09:57:12.315 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2023-12-12T09:57:12.315 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 1113681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-12-12T09:57:12.315 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/micrel/ 2023-12-12T09:57:12.315 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 53041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/micrel/ks8842.ko 2023-12-12T09:57:12.316 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 40993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2023-12-12T09:57:12.316 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2023-12-12T09:57:12.316 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 95665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-12-12T09:57:12.316 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/myricom/ 2023-12-12T09:57:12.316 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/myricom/myri10ge/ 2023-12-12T09:57:12.316 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 108649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-12-12T09:57:12.316 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/natsemi/ 2023-12-12T09:57:12.316 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 73441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-12-12T09:57:12.316 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 47777 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-12-12T09:57:12.316 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/neterion/ 2023-12-12T09:57:12.316 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 150905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-12-12T09:57:12.316 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/nvidia/ 2023-12-12T09:57:12.316 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 136721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-12-12T09:57:12.316 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/packetengines/ 2023-12-12T09:57:12.316 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 50481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-12-12T09:57:12.317 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 43145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-12-12T09:57:12.317 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/ 2023-12-12T09:57:12.317 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/netxen/ 2023-12-12T09:57:12.317 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 227897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-12-12T09:57:12.317 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 87081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-12-12T09:57:12.317 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2023-12-12T09:57:12.317 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 672049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-12-12T09:57:12.317 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/rdc/ 2023-12-12T09:57:12.317 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 43017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-12-12T09:57:12.317 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/ 2023-12-12T09:57:12.317 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 67385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-12-12T09:57:12.317 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 83985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-12-12T09:57:12.317 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 29321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/atp.ko 2023-12-12T09:57:12.317 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 189801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-12-12T09:57:12.317 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/samsung/ 2023-12-12T09:57:12.318 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/samsung/sxgbe/ 2023-12-12T09:57:12.318 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 104241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2023-12-12T09:57:12.318 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sfc/ 2023-12-12T09:57:12.318 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 1052497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-12-12T09:57:12.318 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/silan/ 2023-12-12T09:57:12.318 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 47097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-12-12T09:57:12.318 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sis/ 2023-12-12T09:57:12.318 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 54817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sis/sis190.ko 2023-12-12T09:57:12.318 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 63337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sis/sis900.ko 2023-12-12T09:57:12.318 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/ 2023-12-12T09:57:12.318 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 61537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-12-12T09:57:12.318 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 67193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-12-12T09:57:12.318 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 73409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-12-12T09:57:12.318 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 68177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-12-12T09:57:12.318 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/ 2023-12-12T09:57:12.319 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac/ 2023-12-12T09:57:12.319 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2023-12-12T09:57:12.319 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 39905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-12-12T09:57:12.319 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2023-12-12T09:57:12.319 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 487025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-12-12T09:57:12.319 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/ 2023-12-12T09:57:12.319 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 103337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/cassini.ko 2023-12-12T09:57:12.319 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 166097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/niu.ko 2023-12-12T09:57:12.319 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 66329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/sungem.ko 2023-12-12T09:57:12.319 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 78801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-12-12T09:57:12.319 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/tehuti/ 2023-12-12T09:57:12.319 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 50057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-12-12T09:57:12.319 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ti/ 2023-12-12T09:57:12.319 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 86529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ti/tlan.ko 2023-12-12T09:57:12.319 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/via/ 2023-12-12T09:57:12.320 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 80273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-12-12T09:57:12.320 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 83633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-12-12T09:57:12.320 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/wiznet/ 2023-12-12T09:57:12.320 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 46241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-12-12T09:57:12.320 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 30849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-12-12T09:57:12.320 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/xircom/ 2023-12-12T09:57:12.320 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 59993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-12-12T09:57:12.320 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/fddi/ 2023-12-12T09:57:12.320 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 41001 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/fddi/defxx.ko 2023-12-12T09:57:12.320 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/fddi/skfp/ 2023-12-12T09:57:12.320 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 216985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/fddi/skfp/skfp.ko 2023-12-12T09:57:12.320 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 77345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/geneve.ko 2023-12-12T09:57:12.320 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/hyperv/ 2023-12-12T09:57:12.320 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 235521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-12-12T09:57:12.321 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ieee802154/ 2023-12-12T09:57:12.321 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ieee802154/fakelb.ko 2023-12-12T09:57:12.321 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 25065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ifb.ko 2023-12-12T09:57:12.321 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ipvlan/ 2023-12-12T09:57:12.321 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 83769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ipvlan/ipvlan.ko 2023-12-12T09:57:12.321 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 62145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/macvlan.ko 2023-12-12T09:57:12.321 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/macvtap.ko 2023-12-12T09:57:12.321 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/ 2023-12-12T09:57:12.321 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-12-12T09:57:12.321 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-12-12T09:57:12.321 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/mdio-gpio.ko 2023-12-12T09:57:12.321 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/mdio-regmap.ko 2023-12-12T09:57:12.321 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio.ko 2023-12-12T09:57:12.321 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20513 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mii.ko 2023-12-12T09:57:12.322 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 43953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/netconsole.ko 2023-12-12T09:57:12.322 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/nlmon.ko 2023-12-12T09:57:12.322 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/pcs/ 2023-12-12T09:57:12.322 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/pcs/pcs-lynx.ko 2023-12-12T09:57:12.322 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 38977 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-12-12T09:57:12.322 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/ 2023-12-12T09:57:12.322 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/amd.ko 2023-12-12T09:57:12.322 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 50033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-12-12T09:57:12.322 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 44721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm7xxx.ko 2023-12-12T09:57:12.322 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm87xx.ko 2023-12-12T09:57:12.322 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 42241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/broadcom.ko 2023-12-12T09:57:12.322 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/cicada.ko 2023-12-12T09:57:12.322 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/davicom.ko 2023-12-12T09:57:12.322 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/et1011c.ko 2023-12-12T09:57:12.322 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/icplus.ko 2023-12-12T09:57:12.323 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/lxt.ko 2023-12-12T09:57:12.323 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 82049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/marvell.ko 2023-12-12T09:57:12.323 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 76113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/micrel.ko 2023-12-12T09:57:12.323 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/national.ko 2023-12-12T09:57:12.323 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 97857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/phylink.ko 2023-12-12T09:57:12.323 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/qsemi.ko 2023-12-12T09:57:12.323 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 50065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/realtek.ko 2023-12-12T09:57:12.323 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 29985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/smsc.ko 2023-12-12T09:57:12.323 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/ste10Xp.ko 2023-12-12T09:57:12.323 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/vitesse.ko 2023-12-12T09:57:12.323 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/plip/ 2023-12-12T09:57:12.323 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 43505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/plip/plip.ko 2023-12-12T09:57:12.323 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ 2023-12-12T09:57:12.323 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/bsd_comp.ko 2023-12-12T09:57:12.324 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 29713 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_async.ko 2023-12-12T09:57:12.324 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_deflate.ko 2023-12-12T09:57:12.324 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_mppe.ko 2023-12-12T09:57:12.324 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_synctty.ko 2023-12-12T09:57:12.324 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 42545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/pppoe.ko 2023-12-12T09:57:12.324 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/pppox.ko 2023-12-12T09:57:12.324 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 32689 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/pptp.ko 2023-12-12T09:57:12.324 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/sb1000.ko 2023-12-12T09:57:12.324 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/slip/ 2023-12-12T09:57:12.324 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 42465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/slip/slip.ko 2023-12-12T09:57:12.324 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/sungem_phy.ko 2023-12-12T09:57:12.324 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 64449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/tap.ko 2023-12-12T09:57:12.324 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/ 2023-12-12T09:57:12.324 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 106169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team.ko 2023-12-12T09:57:12.325 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_activebackup.ko 2023-12-12T09:57:12.325 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_broadcast.ko 2023-12-12T09:57:12.325 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-12-12T09:57:12.325 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9641 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_random.ko 2023-12-12T09:57:12.325 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-12-12T09:57:12.325 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 87017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/veth.ko 2023-12-12T09:57:12.325 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vmxnet3/ 2023-12-12T09:57:12.325 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 144297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-12-12T09:57:12.325 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vxlan/ 2023-12-12T09:57:12.325 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 297329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vxlan/vxlan.ko 2023-12-12T09:57:12.325 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/xen-netback/ 2023-12-12T09:57:12.325 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 144585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/xen-netback/xen-netback.ko 2023-12-12T09:57:12.325 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ntb/ 2023-12-12T09:57:12.325 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ntb/ntb.ko 2023-12-12T09:57:12.326 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme/ 2023-12-12T09:57:12.326 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme/host/ 2023-12-12T09:57:12.326 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 265121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme/host/nvme-core.ko 2023-12-12T09:57:12.326 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 102209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme/host/nvme.ko 2023-12-12T09:57:12.326 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/ 2023-12-12T09:57:12.326 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 133841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport.ko 2023-12-12T09:57:12.326 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14561 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport_cs.ko 2023-12-12T09:57:12.326 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 84465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport_pc.ko 2023-12-12T09:57:12.326 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport_serial.ko 2023-12-12T09:57:12.326 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/ 2023-12-12T09:57:12.326 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/hotplug/ 2023-12-12T09:57:12.326 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 25009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-12-12T09:57:12.326 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2023-12-12T09:57:12.327 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2023-12-12T09:57:12.327 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/pci-stub.ko 2023-12-12T09:57:12.327 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 46465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/xen-pcifront.ko 2023-12-12T09:57:12.327 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/ 2023-12-12T09:57:12.327 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/i82092.ko 2023-12-12T09:57:12.327 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 145809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/pcmcia.ko 2023-12-12T09:57:12.327 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 62137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/pcmcia_core.ko 2023-12-12T09:57:12.327 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 34345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2023-12-12T09:57:12.327 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 34265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/pd6729.ko 2023-12-12T09:57:12.327 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 112889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/yenta_socket.ko 2023-12-12T09:57:12.327 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/phy/ 2023-12-12T09:57:12.327 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/phy/broadcom/ 2023-12-12T09:57:12.327 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2023-12-12T09:57:12.327 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/phy/samsung/ 2023-12-12T09:57:12.327 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2023-12-12T09:57:12.328 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pinctrl/ 2023-12-12T09:57:12.328 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pinctrl/intel/ 2023-12-12T09:57:12.328 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 70153 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-12-12T09:57:12.328 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/ 2023-12-12T09:57:12.328 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/chrome/ 2023-12-12T09:57:12.328 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 50889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2023-12-12T09:57:12.328 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/chrome/cros_ec.ko 2023-12-12T09:57:12.328 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2023-12-12T09:57:12.328 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 25417 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2023-12-12T09:57:12.328 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2023-12-12T09:57:12.328 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2023-12-12T09:57:12.328 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17361 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2023-12-12T09:57:12.328 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/ 2023-12-12T09:57:12.328 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 67097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/acer-wmi.ko 2023-12-12T09:57:12.329 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 39145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/acerhdf.ko 2023-12-12T09:57:12.329 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 37025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/apple-gmux.ko 2023-12-12T09:57:12.329 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 59665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/asus-laptop.ko 2023-12-12T09:57:12.329 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 31161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-12-12T09:57:12.329 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 127441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/asus-wmi.ko 2023-12-12T09:57:12.329 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 36849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/classmate-laptop.ko 2023-12-12T09:57:12.329 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 49121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-12-12T09:57:12.329 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-12-12T09:57:12.329 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 40265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-12-12T09:57:12.329 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-12-12T09:57:12.329 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 36593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/hdaps.ko 2023-12-12T09:57:12.329 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/ibm_rtl.ko 2023-12-12T09:57:12.329 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/intel/ 2023-12-12T09:57:12.329 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-12-12T09:57:12.329 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2023-12-12T09:57:12.330 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 43497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/intel_ips.ko 2023-12-12T09:57:12.330 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/msi-wmi.ko 2023-12-12T09:57:12.330 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10377 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/mxm-wmi.ko 2023-12-12T09:57:12.330 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 34801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-12-12T09:57:12.330 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 42329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/samsung-laptop.ko 2023-12-12T09:57:12.330 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/samsung-q10.ko 2023-12-12T09:57:12.330 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/topstar-laptop.ko 2023-12-12T09:57:12.330 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-12-12T09:57:12.330 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/toshiba_haps.ko 2023-12-12T09:57:12.330 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/wmi-bmof.ko 2023-12-12T09:57:12.330 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 57569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/wmi.ko 2023-12-12T09:57:12.330 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/ 2023-12-12T09:57:12.330 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/ 2023-12-12T09:57:12.330 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 30281 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/88pm860x_battery.ko 2023-12-12T09:57:12.331 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 33985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/88pm860x_charger.ko 2023-12-12T09:57:12.331 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 55057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/bq2415x_charger.ko 2023-12-12T09:57:12.331 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 54081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/bq24190_charger.ko 2023-12-12T09:57:12.331 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/bq24735-charger.ko 2023-12-12T09:57:12.331 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/cros_peripheral_charger.ko 2023-12-12T09:57:12.331 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19609 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/da9030_battery.ko 2023-12-12T09:57:12.331 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/da9052-battery.ko 2023-12-12T09:57:12.331 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 29281 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/ds2760_battery.ko 2023-12-12T09:57:12.331 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23217 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/ds2780_battery.ko 2023-12-12T09:57:12.331 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/ds2781_battery.ko 2023-12-12T09:57:12.331 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/ds2782_battery.ko 2023-12-12T09:57:12.331 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/gpio-charger.ko 2023-12-12T09:57:12.331 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/isp1704_charger.ko 2023-12-12T09:57:12.331 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/lp8727_charger.ko 2023-12-12T09:57:12.331 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/max14577_charger.ko 2023-12-12T09:57:12.331 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 25897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/max17040_battery.ko 2023-12-12T09:57:12.332 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 30289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/max17042_battery.ko 2023-12-12T09:57:12.332 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/max8903_charger.ko 2023-12-12T09:57:12.332 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/max8925_power.ko 2023-12-12T09:57:12.332 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/pcf50633-charger.ko 2023-12-12T09:57:12.332 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 38009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/sbs-battery.ko 2023-12-12T09:57:12.332 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/test_power.ko 2023-12-12T09:57:12.332 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/tps65090-charger.ko 2023-12-12T09:57:12.332 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/wm831x_backup.ko 2023-12-12T09:57:12.332 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/wm831x_power.ko 2023-12-12T09:57:12.332 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22417 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/power/supply/wm8350_power.ko 2023-12-12T09:57:12.332 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/powercap/ 2023-12-12T09:57:12.332 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 57729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/powercap/intel_rapl_common.ko 2023-12-12T09:57:12.332 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/powercap/intel_rapl_msr.ko 2023-12-12T09:57:12.333 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/ 2023-12-12T09:57:12.333 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients/ 2023-12-12T09:57:12.333 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients/pps-gpio.ko 2023-12-12T09:57:12.333 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients/pps-ldisc.ko 2023-12-12T09:57:12.333 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15913 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients/pps_parport.ko 2023-12-12T09:57:12.333 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 41873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/pps_core.ko 2023-12-12T09:57:12.333 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ptp/ 2023-12-12T09:57:12.333 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 66385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ptp/ptp.ko 2023-12-12T09:57:12.333 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ptp/ptp_kvm.ko 2023-12-12T09:57:12.333 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/ 2023-12-12T09:57:12.333 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-88pm80x.ko 2023-12-12T09:57:12.333 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-88pm860x.ko 2023-12-12T09:57:12.333 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-bq32k.ko 2023-12-12T09:57:12.333 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-da9052.ko 2023-12-12T09:57:12.334 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-da9055.ko 2023-12-12T09:57:12.334 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-da9063.ko 2023-12-12T09:57:12.334 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1286.ko 2023-12-12T09:57:12.334 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 68577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1307.ko 2023-12-12T09:57:12.334 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1374.ko 2023-12-12T09:57:12.334 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18217 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1511.ko 2023-12-12T09:57:12.334 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1553.ko 2023-12-12T09:57:12.334 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1672.ko 2023-12-12T09:57:12.334 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13369 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1742.ko 2023-12-12T09:57:12.334 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds2404.ko 2023-12-12T09:57:12.334 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23705 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds3232.ko 2023-12-12T09:57:12.334 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-em3027.ko 2023-12-12T09:57:12.334 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-fm3130.ko 2023-12-12T09:57:12.334 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-isl12022.ko 2023-12-12T09:57:12.335 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 35969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-isl1208.ko 2023-12-12T09:57:12.335 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-lp8788.ko 2023-12-12T09:57:12.335 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 38097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-m41t80.ko 2023-12-12T09:57:12.335 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-m48t35.ko 2023-12-12T09:57:12.335 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 25945 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-m48t59.ko 2023-12-12T09:57:12.335 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-m48t86.ko 2023-12-12T09:57:12.335 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-max6900.ko 2023-12-12T09:57:12.335 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-max8907.ko 2023-12-12T09:57:12.335 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-max8925.ko 2023-12-12T09:57:12.335 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 25809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-max8997.ko 2023-12-12T09:57:12.335 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-max8998.ko 2023-12-12T09:57:12.335 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18513 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-mc13xxx.ko 2023-12-12T09:57:12.335 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-msm6242.ko 2023-12-12T09:57:12.335 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-palmas.ko 2023-12-12T09:57:12.336 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 46633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf2127.ko 2023-12-12T09:57:12.336 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17977 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf50633.ko 2023-12-12T09:57:12.336 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf85063.ko 2023-12-12T09:57:12.336 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf8523.ko 2023-12-12T09:57:12.336 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 29817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf8563.ko 2023-12-12T09:57:12.336 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf8583.ko 2023-12-12T09:57:12.336 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rc5t583.ko 2023-12-12T09:57:12.336 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rp5c01.ko 2023-12-12T09:57:12.336 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 33753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rs5c372.ko 2023-12-12T09:57:12.336 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 27833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-12-12T09:57:12.336 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 25257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rx8025.ko 2023-12-12T09:57:12.336 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rx8581.ko 2023-12-12T09:57:12.336 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-s35390a.ko 2023-12-12T09:57:12.336 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-12-12T09:57:12.336 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-tps6586x.ko 2023-12-12T09:57:12.337 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-tps65910.ko 2023-12-12T09:57:12.337 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-wm831x.ko 2023-12-12T09:57:12.337 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-wm8350.ko 2023-12-12T09:57:12.337 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 27873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-x1205.ko 2023-12-12T09:57:12.337 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ 2023-12-12T09:57:12.337 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 77617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/3w-9xxx.ko 2023-12-12T09:57:12.337 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 57665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/3w-sas.ko 2023-12-12T09:57:12.337 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 55105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/3w-xxxx.ko 2023-12-12T09:57:12.337 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 135185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/BusLogic.ko 2023-12-12T09:57:12.337 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/a100u2w.ko 2023-12-12T09:57:12.337 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aacraid/ 2023-12-12T09:57:12.337 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 272305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aacraid/aacraid.ko 2023-12-12T09:57:12.337 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 100617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/advansys.ko 2023-12-12T09:57:12.337 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic7xxx/ 2023-12-12T09:57:12.337 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 356201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-12-12T09:57:12.338 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 295801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-12-12T09:57:12.338 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic94xx/ 2023-12-12T09:57:12.338 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 189185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic94xx/aic94xx.ko 2023-12-12T09:57:12.338 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/am53c974.ko 2023-12-12T09:57:12.338 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/arcmsr/ 2023-12-12T09:57:12.338 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 106881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-12-12T09:57:12.338 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 38185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/atp870u.ko 2023-12-12T09:57:12.338 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/be2iscsi/ 2023-12-12T09:57:12.338 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 246985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-12-12T09:57:12.338 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bfa/ 2023-12-12T09:57:12.338 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 1171945 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bfa/bfa.ko 2023-12-12T09:57:12.338 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2fc/ 2023-12-12T09:57:12.338 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 237273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-12-12T09:57:12.338 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2i/ 2023-12-12T09:57:12.339 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 115369 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-12-12T09:57:12.339 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 40585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ch.ko 2023-12-12T09:57:12.339 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/csiostor/ 2023-12-12T09:57:12.339 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 308921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/csiostor/csiostor.ko 2023-12-12T09:57:12.339 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/ 2023-12-12T09:57:12.339 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb3i/ 2023-12-12T09:57:12.339 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 76145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-12-12T09:57:12.339 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb4i/ 2023-12-12T09:57:12.339 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 101449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-12-12T09:57:12.339 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 146689 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-12-12T09:57:12.339 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 75553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/dc395x.ko 2023-12-12T09:57:12.339 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 38073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/dmx3191d.ko 2023-12-12T09:57:12.339 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/esas2r/ 2023-12-12T09:57:12.339 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 212425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/esas2r/esas2r.ko 2023-12-12T09:57:12.339 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 60505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/esp_scsi.ko 2023-12-12T09:57:12.340 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fcoe/ 2023-12-12T09:57:12.340 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 78209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fcoe/fcoe.ko 2023-12-12T09:57:12.340 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 158505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-12-12T09:57:12.340 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18945 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fdomain.ko 2023-12-12T09:57:12.340 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fnic/ 2023-12-12T09:57:12.340 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 263489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fnic/fnic.ko 2023-12-12T09:57:12.340 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 201817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/hpsa.ko 2023-12-12T09:57:12.340 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 51209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/hptiop.ko 2023-12-12T09:57:12.340 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 49041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/hv_storvsc.ko 2023-12-12T09:57:12.340 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 35337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/imm.ko 2023-12-12T09:57:12.340 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 44057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/initio.ko 2023-12-12T09:57:12.340 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 266537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ipr.ko 2023-12-12T09:57:12.340 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 101881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ips.ko 2023-12-12T09:57:12.340 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/isci/ 2023-12-12T09:57:12.341 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 317153 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/isci/isci.ko 2023-12-12T09:57:12.341 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-12-12T09:57:12.341 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 52961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/iscsi_tcp.ko 2023-12-12T09:57:12.341 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libfc/ 2023-12-12T09:57:12.341 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 314865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libfc/libfc.ko 2023-12-12T09:57:12.341 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 145585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libiscsi.ko 2023-12-12T09:57:12.341 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 53521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libiscsi_tcp.ko 2023-12-12T09:57:12.341 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libsas/ 2023-12-12T09:57:12.341 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 216665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libsas/libsas.ko 2023-12-12T09:57:12.341 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/lpfc/ 2023-12-12T09:57:12.341 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 2197249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/lpfc/lpfc.ko 2023-12-12T09:57:12.341 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid/ 2023-12-12T09:57:12.341 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 73569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-12-12T09:57:12.341 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 33529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-12-12T09:57:12.341 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 310617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-12-12T09:57:12.342 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 84721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid.ko 2023-12-12T09:57:12.342 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mpt3sas/ 2023-12-12T09:57:12.342 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 659825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-12-12T09:57:12.342 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mvsas/ 2023-12-12T09:57:12.342 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 119561 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mvsas/mvsas.ko 2023-12-12T09:57:12.342 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 78129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mvumi.ko 2023-12-12T09:57:12.342 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pcmcia/ 2023-12-12T09:57:12.342 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 81625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2023-12-12T09:57:12.342 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11713 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2023-12-12T09:57:12.342 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2023-12-12T09:57:12.342 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2023-12-12T09:57:12.342 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pm8001/ 2023-12-12T09:57:12.342 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 364105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-12-12T09:57:12.342 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 123617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pmcraid.ko 2023-12-12T09:57:12.343 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 34513 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ppa.ko 2023-12-12T09:57:12.343 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 55361 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla1280.ko 2023-12-12T09:57:12.343 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla2xxx/ 2023-12-12T09:57:12.343 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 1876689 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-12-12T09:57:12.343 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 85289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-12-12T09:57:12.343 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla4xxx/ 2023-12-12T09:57:12.343 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 559033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-12-12T09:57:12.343 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qlogicfas408.ko 2023-12-12T09:57:12.343 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/raid_class.ko 2023-12-12T09:57:12.343 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 238761 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_debug.ko 2023-12-12T09:57:12.343 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 173937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_fc.ko 2023-12-12T09:57:12.343 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 279313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-12-12T09:57:12.343 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 97729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_sas.ko 2023-12-12T09:57:12.343 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 73881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_spi.ko 2023-12-12T09:57:12.343 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 44993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_srp.ko 2023-12-12T09:57:12.343 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ses.ko 2023-12-12T09:57:12.344 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 115889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/st.ko 2023-12-12T09:57:12.344 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 46825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/stex.ko 2023-12-12T09:57:12.344 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/sym53c8xx_2/ 2023-12-12T09:57:12.344 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 162121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-12-12T09:57:12.344 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 42297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/virtio_scsi.ko 2023-12-12T09:57:12.344 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 50321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/vmw_pvscsi.ko 2023-12-12T09:57:12.344 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 39961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/wd719x.ko 2023-12-12T09:57:12.344 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 50025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/xen-scsifront.ko 2023-12-12T09:57:12.344 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ssb/ 2023-12-12T09:57:12.344 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 129441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ssb/ssb.ko 2023-12-12T09:57:12.344 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/ 2023-12-12T09:57:12.344 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/iscsi/ 2023-12-12T09:57:12.344 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 736601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-12-12T09:57:12.344 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/loopback/ 2023-12-12T09:57:12.345 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 49985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/loopback/tcm_loop.ko 2023-12-12T09:57:12.345 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 39713 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_file.ko 2023-12-12T09:57:12.345 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 43025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_iblock.ko 2023-12-12T09:57:12.345 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 930257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_mod.ko 2023-12-12T09:57:12.345 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 44305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_pscsi.ko 2023-12-12T09:57:12.345 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 122521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_user.ko 2023-12-12T09:57:12.345 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/tcm_fc/ 2023-12-12T09:57:12.345 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 75593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-12-12T09:57:12.345 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/ 2023-12-12T09:57:12.345 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/ 2023-12-12T09:57:12.345 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/ 2023-12-12T09:57:12.345 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-12-12T09:57:12.345 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 29321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-12-12T09:57:12.345 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-12-12T09:57:12.346 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-12-12T09:57:12.346 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-12-12T09:57:12.346 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-12-12T09:57:12.346 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-12-12T09:57:12.346 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20281 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-12-12T09:57:12.346 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-12-12T09:57:12.346 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-12-12T09:57:12.346 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13001 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-12-12T09:57:12.346 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 37065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-12-12T09:57:12.346 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 30729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/intel_powerclamp.ko 2023-12-12T09:57:12.346 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-12-12T09:57:12.346 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-12-12T09:57:12.346 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-12-12T09:57:12.346 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/ 2023-12-12T09:57:12.347 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/ipwireless/ 2023-12-12T09:57:12.347 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 78425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-12-12T09:57:12.347 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 57865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/moxa.ko 2023-12-12T09:57:12.347 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 50953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/mxser.ko 2023-12-12T09:57:12.347 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 108601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/n_gsm.ko 2023-12-12T09:57:12.347 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 31961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/n_hdlc.ko 2023-12-12T09:57:12.347 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 67929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/nozomi.ko 2023-12-12T09:57:12.347 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/ 2023-12-12T09:57:12.347 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/8250/ 2023-12-12T09:57:12.347 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 35753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/8250/8250_dw.ko 2023-12-12T09:57:12.347 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 59497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-12-12T09:57:12.347 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/altera_jtaguart.ko 2023-12-12T09:57:12.347 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/altera_uart.ko 2023-12-12T09:57:12.347 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/arc_uart.ko 2023-12-12T09:57:12.348 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 72425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/fsl_lpuart.ko 2023-12-12T09:57:12.348 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/jsm/ 2023-12-12T09:57:12.348 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 103073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/jsm/jsm.ko 2023-12-12T09:57:12.348 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/rp2.ko 2023-12-12T09:57:12.348 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 52817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/sc16is7xx.ko 2023-12-12T09:57:12.348 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/ 2023-12-12T09:57:12.348 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/core/ 2023-12-12T09:57:12.348 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 531265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/core/ufshcd-core.ko 2023-12-12T09:57:12.348 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/host/ 2023-12-12T09:57:12.348 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-12-12T09:57:12.348 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2023-12-12T09:57:12.348 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/ 2023-12-12T09:57:12.348 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 44513 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio.ko 2023-12-12T09:57:12.348 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_aec.ko 2023-12-12T09:57:12.349 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11281 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_cif.ko 2023-12-12T09:57:12.349 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_dmem_genirq.ko 2023-12-12T09:57:12.349 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_mf624.ko 2023-12-12T09:57:12.349 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_netx.ko 2023-12-12T09:57:12.349 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_pci_generic.ko 2023-12-12T09:57:12.349 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_pdrv_genirq.ko 2023-12-12T09:57:12.349 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_sercos3.ko 2023-12-12T09:57:12.349 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/ 2023-12-12T09:57:12.349 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/c67x00/ 2023-12-12T09:57:12.349 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 73297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/c67x00/c67x00.ko 2023-12-12T09:57:12.349 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/chipidea/ 2023-12-12T09:57:12.349 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 144377 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/chipidea/ci_hdrc.ko 2023-12-12T09:57:12.349 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2023-12-12T09:57:12.349 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12713 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2023-12-12T09:57:12.350 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2023-12-12T09:57:12.350 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/ 2023-12-12T09:57:12.350 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 87089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/cdc-acm.ko 2023-12-12T09:57:12.350 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 51345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/cdc-wdm.ko 2023-12-12T09:57:12.350 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 47305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/usblp.ko 2023-12-12T09:57:12.350 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 89857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/usbtmc.ko 2023-12-12T09:57:12.350 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/common/ 2023-12-12T09:57:12.350 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/common/ulpi.ko 2023-12-12T09:57:12.350 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/dwc2/ 2023-12-12T09:57:12.350 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/dwc2/dwc2_pci.ko 2023-12-12T09:57:12.350 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/dwc3/ 2023-12-12T09:57:12.350 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/dwc3/dwc3-haps.ko 2023-12-12T09:57:12.350 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 30041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/dwc3/dwc3-pci.ko 2023-12-12T09:57:12.350 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 448505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/dwc3/dwc3.ko 2023-12-12T09:57:12.351 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/ 2023-12-12T09:57:12.351 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/ 2023-12-12T09:57:12.351 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 60177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/u_ether.ko 2023-12-12T09:57:12.351 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 51881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/u_serial.ko 2023-12-12T09:57:12.351 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2023-12-12T09:57:12.351 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 42449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2023-12-12T09:57:12.351 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 27953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2023-12-12T09:57:12.351 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 36513 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2023-12-12T09:57:12.351 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 92489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2023-12-12T09:57:12.351 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 51049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2023-12-12T09:57:12.351 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 122081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2023-12-12T09:57:12.351 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 57681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2023-12-12T09:57:12.351 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2023-12-12T09:57:12.351 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 31265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2023-12-12T09:57:12.352 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 57729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2023-12-12T09:57:12.352 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 85609 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2023-12-12T09:57:12.352 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2023-12-12T09:57:12.352 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 58113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2023-12-12T09:57:12.352 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 67337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2023-12-12T09:57:12.352 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/ 2023-12-12T09:57:12.352 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2023-12-12T09:57:12.352 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2023-12-12T09:57:12.352 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2023-12-12T09:57:12.352 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_ether.ko 2023-12-12T09:57:12.352 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2023-12-12T09:57:12.352 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_hid.ko 2023-12-12T09:57:12.352 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2023-12-12T09:57:12.352 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16977 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2023-12-12T09:57:12.352 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 32073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2023-12-12T09:57:12.353 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_printer.ko 2023-12-12T09:57:12.353 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_serial.ko 2023-12-12T09:57:12.353 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 27201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/g_zero.ko 2023-12-12T09:57:12.353 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 62185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2023-12-12T09:57:12.353 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2023-12-12T09:57:12.353 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 161225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/libcomposite.ko 2023-12-12T09:57:12.353 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/ 2023-12-12T09:57:12.353 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17705 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2023-12-12T09:57:12.353 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/bdc/ 2023-12-12T09:57:12.353 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 157681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2023-12-12T09:57:12.353 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 36089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/goku_udc.ko 2023-12-12T09:57:12.353 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 52721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/gr_udc.ko 2023-12-12T09:57:12.353 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 69705 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2023-12-12T09:57:12.353 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 56033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/mv_udc.ko 2023-12-12T09:57:12.353 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 76057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/net2272.ko 2023-12-12T09:57:12.354 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 75073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/net2280.ko 2023-12-12T09:57:12.354 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 73169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/pch_udc.ko 2023-12-12T09:57:12.354 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 65809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2023-12-12T09:57:12.354 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 66097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2023-12-12T09:57:12.354 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 81505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2023-12-12T09:57:12.354 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 156073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/gadget/udc/udc-core.ko 2023-12-12T09:57:12.354 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/ 2023-12-12T09:57:12.354 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/bcma-hcd.ko 2023-12-12T09:57:12.354 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 80113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/isp116x-hcd.ko 2023-12-12T09:57:12.354 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 87353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/oxu210hp-hcd.ko 2023-12-12T09:57:12.354 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 78873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/r8a66597-hcd.ko 2023-12-12T09:57:12.354 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 51329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/sl811-hcd.ko 2023-12-12T09:57:12.354 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/sl811_cs.ko 2023-12-12T09:57:12.354 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/ssb-hcd.ko 2023-12-12T09:57:12.355 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 25945 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/xhci-plat-hcd.ko 2023-12-12T09:57:12.355 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/image/ 2023-12-12T09:57:12.355 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 34585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/image/mdc800.ko 2023-12-12T09:57:12.355 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/image/microtek.ko 2023-12-12T09:57:12.355 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/ 2023-12-12T09:57:12.355 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 41721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/adutux.ko 2023-12-12T09:57:12.355 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20713 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/appledisplay.ko 2023-12-12T09:57:12.355 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/cypress_cy7c63.ko 2023-12-12T09:57:12.355 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/cytherm.ko 2023-12-12T09:57:12.355 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/ehset.ko 2023-12-12T09:57:12.355 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/emi26.ko 2023-12-12T09:57:12.355 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/emi62.ko 2023-12-12T09:57:12.355 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/ezusb.ko 2023-12-12T09:57:12.355 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/idmouse.ko 2023-12-12T09:57:12.355 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 36553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/iowarrior.ko 2023-12-12T09:57:12.356 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/isight_firmware.ko 2023-12-12T09:57:12.356 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 36529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/ldusb.ko 2023-12-12T09:57:12.356 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 36265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/legousbtower.ko 2023-12-12T09:57:12.356 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 27793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/lvstest.ko 2023-12-12T09:57:12.356 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/sisusbvga/ 2023-12-12T09:57:12.356 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 64841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-12-12T09:57:12.356 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/trancevibrator.ko 2023-12-12T09:57:12.356 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/usb3503.ko 2023-12-12T09:57:12.356 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 25145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/usblcd.ko 2023-12-12T09:57:12.356 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/usbsevseg.ko 2023-12-12T09:57:12.356 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 70809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/usbtest.ko 2023-12-12T09:57:12.356 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 41905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/uss720.ko 2023-12-12T09:57:12.356 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 27617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/yurex.ko 2023-12-12T09:57:12.356 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/mon/ 2023-12-12T09:57:12.357 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 72953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/mon/usbmon.ko 2023-12-12T09:57:12.357 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/musb/ 2023-12-12T09:57:12.357 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 301697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/musb/musb_hdrc.ko 2023-12-12T09:57:12.357 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/phy/ 2023-12-12T09:57:12.357 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/phy/phy-generic.ko 2023-12-12T09:57:12.357 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2023-12-12T09:57:12.357 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/phy/phy-isp1301.ko 2023-12-12T09:57:12.357 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/phy/phy-tahvo.ko 2023-12-12T09:57:12.357 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ 2023-12-12T09:57:12.357 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/aircable.ko 2023-12-12T09:57:12.357 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 33329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ark3116.ko 2023-12-12T09:57:12.357 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/belkin_sa.ko 2023-12-12T09:57:12.357 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 38105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ch341.ko 2023-12-12T09:57:12.357 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 70257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/cp210x.ko 2023-12-12T09:57:12.357 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 31057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/cyberjack.ko 2023-12-12T09:57:12.358 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 58217 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/cypress_m8.ko 2023-12-12T09:57:12.358 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 49817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/digi_acceleport.ko 2023-12-12T09:57:12.358 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/empeg.ko 2023-12-12T09:57:12.358 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 44273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/f81232.ko 2023-12-12T09:57:12.358 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 175137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ftdi_sio.ko 2023-12-12T09:57:12.358 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 53113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/garmin_gps.ko 2023-12-12T09:57:12.358 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 137081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/io_edgeport.ko 2023-12-12T09:57:12.358 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 124833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/io_ti.ko 2023-12-12T09:57:12.358 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 67769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ipaq.ko 2023-12-12T09:57:12.358 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ipw.ko 2023-12-12T09:57:12.358 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ir-usb.ko 2023-12-12T09:57:12.358 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 58233 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-12-12T09:57:12.358 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 107521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/keyspan.ko 2023-12-12T09:57:12.358 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 35617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/keyspan_pda.ko 2023-12-12T09:57:12.359 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 25665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/kl5kusb105.ko 2023-12-12T09:57:12.359 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 33689 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/kobil_sct.ko 2023-12-12T09:57:12.359 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 32953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/mct_u232.ko 2023-12-12T09:57:12.359 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/metro-usb.ko 2023-12-12T09:57:12.359 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 66449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/mos7720.ko 2023-12-12T09:57:12.359 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 78217 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/mos7840.ko 2023-12-12T09:57:12.359 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 56337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/mxuport.ko 2023-12-12T09:57:12.359 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/navman.ko 2023-12-12T09:57:12.359 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/omninet.ko 2023-12-12T09:57:12.359 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/opticon.ko 2023-12-12T09:57:12.359 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 191137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/option.ko 2023-12-12T09:57:12.359 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 39073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/oti6858.ko 2023-12-12T09:57:12.359 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 54353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/pl2303.ko 2023-12-12T09:57:12.359 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/qcaux.ko 2023-12-12T09:57:12.359 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 37825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/qcserial.ko 2023-12-12T09:57:12.360 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 34321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/quatech2.ko 2023-12-12T09:57:12.360 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/safe_serial.ko 2023-12-12T09:57:12.360 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 51625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/sierra.ko 2023-12-12T09:57:12.360 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/spcp8x5.ko 2023-12-12T09:57:12.360 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 29993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ssu100.ko 2023-12-12T09:57:12.360 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/symbolserial.ko 2023-12-12T09:57:12.360 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 61489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-12-12T09:57:12.360 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-12-12T09:57:12.360 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/usb_debug.ko 2023-12-12T09:57:12.360 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 33201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/usb_wwan.ko 2023-12-12T09:57:12.360 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 125609 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/usbserial.ko 2023-12-12T09:57:12.360 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/visor.ko 2023-12-12T09:57:12.360 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 37409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/whiteheat.ko 2023-12-12T09:57:12.360 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/wishbone-serial.ko 2023-12-12T09:57:12.360 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/xsens_mt.ko 2023-12-12T09:57:12.361 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ 2023-12-12T09:57:12.361 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 52913 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/uas.ko 2023-12-12T09:57:12.361 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-alauda.ko 2023-12-12T09:57:12.361 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-cypress.ko 2023-12-12T09:57:12.361 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-datafab.ko 2023-12-12T09:57:12.361 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 33497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-12-12T09:57:12.361 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-freecom.ko 2023-12-12T09:57:12.361 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-isd200.ko 2023-12-12T09:57:12.361 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19361 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-12-12T09:57:12.361 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13713 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-karma.ko 2023-12-12T09:57:12.361 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-onetouch.ko 2023-12-12T09:57:12.361 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-realtek.ko 2023-12-12T09:57:12.361 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-sddr09.ko 2023-12-12T09:57:12.361 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-sddr55.ko 2023-12-12T09:57:12.361 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 35337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-usbat.ko 2023-12-12T09:57:12.362 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 179969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/usb-storage.ko 2023-12-12T09:57:12.362 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip/ 2023-12-12T09:57:12.362 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 67481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip/usbip-core.ko 2023-12-12T09:57:12.362 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 72177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip/usbip-host.ko 2023-12-12T09:57:12.362 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 107001 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-12-12T09:57:12.362 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/ 2023-12-12T09:57:12.362 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/pci/ 2023-12-12T09:57:12.362 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 154297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-12-12T09:57:12.362 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 29537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/pci/vfio-pci.ko 2023-12-12T09:57:12.362 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 108737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/vfio.ko 2023-12-12T09:57:12.362 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 77609 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-12-12T09:57:12.362 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/ 2023-12-12T09:57:12.362 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 113785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost.ko 2023-12-12T09:57:12.362 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost_iotlb.ko 2023-12-12T09:57:12.363 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 58089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost_net.ko 2023-12-12T09:57:12.363 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 89249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost_scsi.ko 2023-12-12T09:57:12.363 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/ 2023-12-12T09:57:12.363 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/ 2023-12-12T09:57:12.363 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15417 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/88pm860x_bl.ko 2023-12-12T09:57:12.363 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/aat2870_bl.ko 2023-12-12T09:57:12.363 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/adp5520_bl.ko 2023-12-12T09:57:12.363 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 32609 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/adp8860_bl.ko 2023-12-12T09:57:12.363 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 39993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/adp8870_bl.ko 2023-12-12T09:57:12.363 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/apple_bl.ko 2023-12-12T09:57:12.363 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16777 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/as3711_bl.ko 2023-12-12T09:57:12.363 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/bd6107.ko 2023-12-12T09:57:12.363 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/da903x_bl.ko 2023-12-12T09:57:12.363 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/da9052_bl.ko 2023-12-12T09:57:12.364 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/gpio_backlight.ko 2023-12-12T09:57:12.364 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/kb3886_bl.ko 2023-12-12T09:57:12.364 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/lcd.ko 2023-12-12T09:57:12.364 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/lm3533_bl.ko 2023-12-12T09:57:12.364 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/lm3639_bl.ko 2023-12-12T09:57:12.364 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/lv5207lp.ko 2023-12-12T09:57:12.364 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/max8925_bl.ko 2023-12-12T09:57:12.364 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/pandora_bl.ko 2023-12-12T09:57:12.364 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/pcf50633-backlight.ko 2023-12-12T09:57:12.364 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/platform_lcd.ko 2023-12-12T09:57:12.364 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/wm831x_bl.ko 2023-12-12T09:57:12.364 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/ 2023-12-12T09:57:12.364 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters/ 2023-12-12T09:57:12.364 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters/ds2482.ko 2023-12-12T09:57:12.364 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 38985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters/ds2490.ko 2023-12-12T09:57:12.365 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters/matrox_w1.ko 2023-12-12T09:57:12.365 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12417 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters/w1-gpio.ko 2023-12-12T09:57:12.365 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/ 2023-12-12T09:57:12.365 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-12-12T09:57:12.365 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-12-12T09:57:12.365 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-12-12T09:57:12.365 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-12-12T09:57:12.365 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14153 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-12-12T09:57:12.365 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-12-12T09:57:12.365 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-12-12T09:57:12.365 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-12-12T09:57:12.365 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-12-12T09:57:12.365 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_smem.ko 2023-12-12T09:57:12.365 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 56425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_therm.ko 2023-12-12T09:57:12.365 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 102673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/wire.ko 2023-12-12T09:57:12.366 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/ 2023-12-12T09:57:12.366 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/acquirewdt.ko 2023-12-12T09:57:12.366 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19977 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/advantechwdt.ko 2023-12-12T09:57:12.366 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18561 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/alim1535_wdt.ko 2023-12-12T09:57:12.366 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/alim7101_wdt.ko 2023-12-12T09:57:12.366 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/cpu5wdt.ko 2023-12-12T09:57:12.366 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/da9052_wdt.ko 2023-12-12T09:57:12.366 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12777 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/da9055_wdt.ko 2023-12-12T09:57:12.366 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/da9063_wdt.ko 2023-12-12T09:57:12.366 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/dw_wdt.ko 2023-12-12T09:57:12.366 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/eurotechwdt.ko 2023-12-12T09:57:12.366 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/f71808e_wdt.ko 2023-12-12T09:57:12.366 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 27401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/hpwdt.ko 2023-12-12T09:57:12.366 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/i6300esb.ko 2023-12-12T09:57:12.367 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-12-12T09:57:12.367 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21913 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/iTCO_wdt.ko 2023-12-12T09:57:12.367 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/ib700wdt.ko 2023-12-12T09:57:12.367 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18689 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/ibmasr.ko 2023-12-12T09:57:12.367 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19713 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-12-12T09:57:12.367 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/it8712f_wdt.ko 2023-12-12T09:57:12.367 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/it87_wdt.ko 2023-12-12T09:57:12.367 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/kempld_wdt.ko 2023-12-12T09:57:12.367 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/machzwd.ko 2023-12-12T09:57:12.367 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/mena21_wdt.ko 2023-12-12T09:57:12.367 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13217 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/menf21bmc_wdt.ko 2023-12-12T09:57:12.367 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/nv_tco.ko 2023-12-12T09:57:12.367 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/of_xilinx_wdt.ko 2023-12-12T09:57:12.367 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22265 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/pc87413_wdt.ko 2023-12-12T09:57:12.368 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 38657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/pcwd_pci.ko 2023-12-12T09:57:12.368 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 31825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/pcwd_usb.ko 2023-12-12T09:57:12.368 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/retu_wdt.ko 2023-12-12T09:57:12.368 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sbc60xxwdt.ko 2023-12-12T09:57:12.368 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sbc_epx_c3.ko 2023-12-12T09:57:12.368 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-12-12T09:57:12.368 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sc1200wdt.ko 2023-12-12T09:57:12.368 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sch311x_wdt.ko 2023-12-12T09:57:12.368 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/smsc37b787_wdt.ko 2023-12-12T09:57:12.368 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/softdog.ko 2023-12-12T09:57:12.368 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sp5100_tco.ko 2023-12-12T09:57:12.368 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/twl4030_wdt.ko 2023-12-12T09:57:12.368 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/via_wdt.ko 2023-12-12T09:57:12.368 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-12-12T09:57:12.368 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/w83877f_wdt.ko 2023-12-12T09:57:12.369 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 25409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/w83977f_wdt.ko 2023-12-12T09:57:12.369 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/wafer5823wdt.ko 2023-12-12T09:57:12.369 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/wdt_pci.ko 2023-12-12T09:57:12.369 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/wm831x_wdt.ko 2023-12-12T09:57:12.369 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/wm8350_wdt.ko 2023-12-12T09:57:12.369 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/xen_wdt.ko 2023-12-12T09:57:12.369 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/ 2023-12-12T09:57:12.369 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-evtchn.ko 2023-12-12T09:57:12.369 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-gntalloc.ko 2023-12-12T09:57:12.369 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 47865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-gntdev.ko 2023-12-12T09:57:12.369 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-pciback/ 2023-12-12T09:57:12.369 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 176377 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-12-12T09:57:12.369 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 40121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-privcmd.ko 2023-12-12T09:57:12.369 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 71249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-scsiback.ko 2023-12-12T09:57:12.369 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xenfs/ 2023-12-12T09:57:12.369 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xenfs/xenfs.ko 2023-12-12T09:57:12.370 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ 2023-12-12T09:57:12.370 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/9p/ 2023-12-12T09:57:12.370 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 166425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/9p/9p.ko 2023-12-12T09:57:12.370 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/adfs/ 2023-12-12T09:57:12.370 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 61073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/adfs/adfs.ko 2023-12-12T09:57:12.370 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/affs/ 2023-12-12T09:57:12.370 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 163593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/affs/affs.ko 2023-12-12T09:57:12.370 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/afs/ 2023-12-12T09:57:12.370 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 932817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/afs/kafs.ko 2023-12-12T09:57:12.370 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/autofs/ 2023-12-12T09:57:12.370 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 101057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/autofs/autofs4.ko 2023-12-12T09:57:12.370 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/befs/ 2023-12-12T09:57:12.370 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 64545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/befs/befs.ko 2023-12-12T09:57:12.370 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/bfs/ 2023-12-12T09:57:12.371 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 41257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/bfs/bfs.ko 2023-12-12T09:57:12.371 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 34585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/binfmt_misc.ko 2023-12-12T09:57:12.371 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/btrfs/ 2023-12-12T09:57:12.371 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 3402729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/btrfs/btrfs.ko 2023-12-12T09:57:12.371 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cachefiles/ 2023-12-12T09:57:12.371 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 306009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cachefiles/cachefiles.ko 2023-12-12T09:57:12.420 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ceph/ 2023-12-12T09:57:12.420 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 1333017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ceph/ceph.ko 2023-12-12T09:57:12.421 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/coda/ 2023-12-12T09:57:12.421 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 100801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/coda/coda.ko 2023-12-12T09:57:12.421 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/configfs/ 2023-12-12T09:57:12.421 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 108393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/configfs/configfs.ko 2023-12-12T09:57:12.421 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cramfs/ 2023-12-12T09:57:12.421 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 29625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cramfs/cramfs.ko 2023-12-12T09:57:12.421 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/dlm/ 2023-12-12T09:57:12.421 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 642513 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/dlm/dlm.ko 2023-12-12T09:57:12.421 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/efs/ 2023-12-12T09:57:12.421 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 36649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/efs/efs.ko 2023-12-12T09:57:12.421 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/f2fs/ 2023-12-12T09:57:12.421 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 1505025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/f2fs/f2fs.ko 2023-12-12T09:57:12.421 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fat/ 2023-12-12T09:57:12.421 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 27929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fat/msdos.ko 2023-12-12T09:57:12.422 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/freevxfs/ 2023-12-12T09:57:12.422 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 42545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/freevxfs/freevxfs.ko 2023-12-12T09:57:12.422 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fscache/ 2023-12-12T09:57:12.422 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 226481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fscache/fscache.ko 2023-12-12T09:57:12.422 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fuse/ 2023-12-12T09:57:12.422 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fuse/cuse.ko 2023-12-12T09:57:12.422 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/gfs2/ 2023-12-12T09:57:12.422 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 1231529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/gfs2/gfs2.ko 2023-12-12T09:57:12.422 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfs/ 2023-12-12T09:57:12.422 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 141209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfs/hfs.ko 2023-12-12T09:57:12.422 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfsplus/ 2023-12-12T09:57:12.422 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 222817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfsplus/hfsplus.ko 2023-12-12T09:57:12.422 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hpfs/ 2023-12-12T09:57:12.422 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 192329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hpfs/hpfs.ko 2023-12-12T09:57:12.423 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/isofs/ 2023-12-12T09:57:12.423 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 74065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/isofs/isofs.ko 2023-12-12T09:57:12.423 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/jfs/ 2023-12-12T09:57:12.423 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 419497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/jfs/jfs.ko 2023-12-12T09:57:12.423 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/lockd/ 2023-12-12T09:57:12.423 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 280313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/lockd/lockd.ko 2023-12-12T09:57:12.423 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/minix/ 2023-12-12T09:57:12.423 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 89193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/minix/minix.ko 2023-12-12T09:57:12.423 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/netfs/ 2023-12-12T09:57:12.423 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 124649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/netfs/netfs.ko 2023-12-12T09:57:12.423 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/ 2023-12-12T09:57:12.423 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/blocklayout/ 2023-12-12T09:57:12.423 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 81449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-12-12T09:57:12.423 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/filelayout/ 2023-12-12T09:57:12.424 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 59449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-12-12T09:57:12.424 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/flexfilelayout/ 2023-12-12T09:57:12.424 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 117465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-12-12T09:57:12.424 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 1055721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/nfs.ko 2023-12-12T09:57:12.424 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 66441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/nfsv2.ko 2023-12-12T09:57:12.424 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 120177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/nfsv3.ko 2023-12-12T09:57:12.424 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 2042137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/nfsv4.ko 2023-12-12T09:57:12.424 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs_common/ 2023-12-12T09:57:12.424 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs_common/grace.ko 2023-12-12T09:57:12.424 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs_common/nfs_acl.ko 2023-12-12T09:57:12.424 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfsd/ 2023-12-12T09:57:12.424 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 1516873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfsd/nfsd.ko 2023-12-12T09:57:12.424 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nilfs2/ 2023-12-12T09:57:12.424 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 592833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nilfs2/nilfs2.ko 2023-12-12T09:57:12.424 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/ 2023-12-12T09:57:12.425 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-celtic.ko 2023-12-12T09:57:12.425 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-centeuro.ko 2023-12-12T09:57:12.425 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-croatian.ko 2023-12-12T09:57:12.425 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-cyrillic.ko 2023-12-12T09:57:12.425 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-gaelic.ko 2023-12-12T09:57:12.425 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-greek.ko 2023-12-12T09:57:12.425 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-iceland.ko 2023-12-12T09:57:12.425 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-inuit.ko 2023-12-12T09:57:12.425 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-roman.ko 2023-12-12T09:57:12.425 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-romanian.ko 2023-12-12T09:57:12.425 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-turkish.ko 2023-12-12T09:57:12.425 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_ascii.ko 2023-12-12T09:57:12.425 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp1250.ko 2023-12-12T09:57:12.426 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12233 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp1251.ko 2023-12-12T09:57:12.426 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp1255.ko 2023-12-12T09:57:12.426 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp737.ko 2023-12-12T09:57:12.426 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp775.ko 2023-12-12T09:57:12.426 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp850.ko 2023-12-12T09:57:12.426 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp852.ko 2023-12-12T09:57:12.426 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp855.ko 2023-12-12T09:57:12.426 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11913 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp857.ko 2023-12-12T09:57:12.426 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp860.ko 2023-12-12T09:57:12.426 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp861.ko 2023-12-12T09:57:12.426 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp862.ko 2023-12-12T09:57:12.426 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp863.ko 2023-12-12T09:57:12.426 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp864.ko 2023-12-12T09:57:12.426 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp865.ko 2023-12-12T09:57:12.426 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp866.ko 2023-12-12T09:57:12.427 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp869.ko 2023-12-12T09:57:12.427 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp874.ko 2023-12-12T09:57:12.427 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 94137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp932.ko 2023-12-12T09:57:12.427 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 142673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp936.ko 2023-12-12T09:57:12.427 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 165745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp949.ko 2023-12-12T09:57:12.427 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 118121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp950.ko 2023-12-12T09:57:12.427 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_euc-jp.ko 2023-12-12T09:57:12.427 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-1.ko 2023-12-12T09:57:12.427 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-13.ko 2023-12-12T09:57:12.427 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-14.ko 2023-12-12T09:57:12.427 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-15.ko 2023-12-12T09:57:12.427 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-2.ko 2023-12-12T09:57:12.427 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-3.ko 2023-12-12T09:57:12.427 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-4.ko 2023-12-12T09:57:12.427 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-5.ko 2023-12-12T09:57:12.428 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-6.ko 2023-12-12T09:57:12.428 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12233 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-7.ko 2023-12-12T09:57:12.428 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-9.ko 2023-12-12T09:57:12.428 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_koi8-r.ko 2023-12-12T09:57:12.428 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_koi8-ru.ko 2023-12-12T09:57:12.428 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_koi8-u.ko 2023-12-12T09:57:12.428 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_ucs2_utils.ko 2023-12-12T09:57:12.428 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_utf8.ko 2023-12-12T09:57:12.428 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ntfs/ 2023-12-12T09:57:12.428 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 219417 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ntfs/ntfs.ko 2023-12-12T09:57:12.428 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ 2023-12-12T09:57:12.428 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/cluster/ 2023-12-12T09:57:12.428 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 244409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-12-12T09:57:12.428 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlm/ 2023-12-12T09:57:12.429 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 440737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-12-12T09:57:12.429 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlmfs/ 2023-12-12T09:57:12.429 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 54049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-12-12T09:57:12.429 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 2592433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2.ko 2023-12-12T09:57:12.429 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-12-12T09:57:12.429 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 31729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-12-12T09:57:12.429 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 35897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-12-12T09:57:12.429 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/omfs/ 2023-12-12T09:57:12.429 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 53433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/omfs/omfs.ko 2023-12-12T09:57:12.429 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/overlayfs/ 2023-12-12T09:57:12.429 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 352161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/overlayfs/overlay.ko 2023-12-12T09:57:12.429 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/pstore/ 2023-12-12T09:57:12.429 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 54809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/pstore/ramoops.ko 2023-12-12T09:57:12.429 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/qnx4/ 2023-12-12T09:57:12.430 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/qnx4/qnx4.ko 2023-12-12T09:57:12.430 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/qnx6/ 2023-12-12T09:57:12.430 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 46689 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/qnx6/qnx6.ko 2023-12-12T09:57:12.430 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/quota/ 2023-12-12T09:57:12.430 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 30881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/quota/quota_tree.ko 2023-12-12T09:57:12.430 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/quota/quota_v1.ko 2023-12-12T09:57:12.430 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/quota/quota_v2.ko 2023-12-12T09:57:12.430 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/reiserfs/ 2023-12-12T09:57:12.430 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 532673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/reiserfs/reiserfs.ko 2023-12-12T09:57:12.430 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/romfs/ 2023-12-12T09:57:12.430 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28641 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/romfs/romfs.ko 2023-12-12T09:57:12.430 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/ 2023-12-12T09:57:12.430 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/client/ 2023-12-12T09:57:12.431 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 2668401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/client/cifs.ko 2023-12-12T09:57:12.431 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/common/ 2023-12-12T09:57:12.431 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/common/cifs_arc4.ko 2023-12-12T09:57:12.431 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/common/cifs_md4.ko 2023-12-12T09:57:12.431 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/squashfs/ 2023-12-12T09:57:12.431 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 134641 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/squashfs/squashfs.ko 2023-12-12T09:57:12.431 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/sysv/ 2023-12-12T09:57:12.431 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 90721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/sysv/sysv.ko 2023-12-12T09:57:12.431 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/udf/ 2023-12-12T09:57:12.431 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 247737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/udf/udf.ko 2023-12-12T09:57:12.431 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ufs/ 2023-12-12T09:57:12.431 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 162497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ufs/ufs.ko 2023-12-12T09:57:12.431 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/xfs/ 2023-12-12T09:57:12.432 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 4011017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/xfs/xfs.ko 2023-12-12T09:57:12.432 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/ 2023-12-12T09:57:12.432 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/locking/ 2023-12-12T09:57:12.432 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 75489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/locking/locktorture.ko 2023-12-12T09:57:12.432 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/time/ 2023-12-12T09:57:12.432 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/time/test_udelay.ko 2023-12-12T09:57:12.432 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 60553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/torture.ko 2023-12-12T09:57:12.432 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/ 2023-12-12T09:57:12.432 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 6833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crc-itu-t.ko 2023-12-12T09:57:12.432 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 6529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crc7.ko 2023-12-12T09:57:12.432 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crc8.ko 2023-12-12T09:57:12.432 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crypto/ 2023-12-12T09:57:12.432 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crypto/libarc4.ko 2023-12-12T09:57:12.432 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 37081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crypto/libdes.ko 2023-12-12T09:57:12.432 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/interval_tree_test.ko 2023-12-12T09:57:12.433 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/libcrc32c.ko 2023-12-12T09:57:12.433 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lru_cache.ko 2023-12-12T09:57:12.433 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lz4/ 2023-12-12T09:57:12.433 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 33801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lz4/lz4_compress.ko 2023-12-12T09:57:12.433 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lz4/lz4hc_compress.ko 2023-12-12T09:57:12.433 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/math/ 2023-12-12T09:57:12.433 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 6617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/math/cordic.ko 2023-12-12T09:57:12.433 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8233 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/memory-notifier-error-inject.ko 2023-12-12T09:57:12.433 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/notifier-error-inject.ko 2023-12-12T09:57:12.433 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/percpu_test.ko 2023-12-12T09:57:12.433 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/pm-notifier-error-inject.ko 2023-12-12T09:57:12.433 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/raid6/ 2023-12-12T09:57:12.433 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 143433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/raid6/raid6_pq.ko 2023-12-12T09:57:12.433 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/rbtree_test.ko 2023-12-12T09:57:12.434 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/reed_solomon/ 2023-12-12T09:57:12.434 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/reed_solomon/reed_solomon.ko 2023-12-12T09:57:12.434 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 38841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/test-kstrtox.ko 2023-12-12T09:57:12.434 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/test-string_helpers.ko 2023-12-12T09:57:12.434 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 4760425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/test_bpf.ko 2023-12-12T09:57:12.434 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 49089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/test_firmware.ko 2023-12-12T09:57:12.434 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 6369 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/test_module.ko 2023-12-12T09:57:12.434 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/test_user_copy.ko 2023-12-12T09:57:12.434 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/ts_bm.ko 2023-12-12T09:57:12.434 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/ts_fsm.ko 2023-12-12T09:57:12.434 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/ts_kmp.ko 2023-12-12T09:57:12.434 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/xz/ 2023-12-12T09:57:12.434 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/xz/xz_dec_test.ko 2023-12-12T09:57:12.434 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/mm/ 2023-12-12T09:57:12.435 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/mm/hwpoison-inject.ko 2023-12-12T09:57:12.435 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ 2023-12-12T09:57:12.435 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/ 2023-12-12T09:57:12.435 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 55737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/6lowpan.ko 2023-12-12T09:57:12.435 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_dest.ko 2023-12-12T09:57:12.435 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_fragment.ko 2023-12-12T09:57:12.435 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_hop.ko 2023-12-12T09:57:12.435 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 6985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_ipv6.ko 2023-12-12T09:57:12.435 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_mobility.ko 2023-12-12T09:57:12.435 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7001 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_routing.ko 2023-12-12T09:57:12.435 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_udp.ko 2023-12-12T09:57:12.435 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/ 2023-12-12T09:57:12.435 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 30385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/garp.ko 2023-12-12T09:57:12.435 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 34809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/mrp.ko 2023-12-12T09:57:12.435 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/p8022.ko 2023-12-12T09:57:12.436 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/psnap.ko 2023-12-12T09:57:12.436 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/stp.ko 2023-12-12T09:57:12.436 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/8021q/ 2023-12-12T09:57:12.436 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 81737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/8021q/8021q.ko 2023-12-12T09:57:12.436 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/ 2023-12-12T09:57:12.436 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 198337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet.ko 2023-12-12T09:57:12.436 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 35977 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet_fd.ko 2023-12-12T09:57:12.436 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26345 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet_rdma.ko 2023-12-12T09:57:12.436 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 32337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet_virtio.ko 2023-12-12T09:57:12.436 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/batman-adv/ 2023-12-12T09:57:12.436 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 649297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/batman-adv/batman-adv.ko 2023-12-12T09:57:12.436 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/ 2023-12-12T09:57:12.436 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 63809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/br_netfilter.ko 2023-12-12T09:57:12.436 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 777689 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/bridge.ko 2023-12-12T09:57:12.436 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ 2023-12-12T09:57:12.437 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-12-12T09:57:12.437 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_among.ko 2023-12-12T09:57:12.437 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_arp.ko 2023-12-12T09:57:12.437 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-12-12T09:57:12.437 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-12-12T09:57:12.437 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_ip.ko 2023-12-12T09:57:12.437 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-12-12T09:57:12.437 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_limit.ko 2023-12-12T09:57:12.437 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13217 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_log.ko 2023-12-12T09:57:12.437 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_mark.ko 2023-12-12T09:57:12.437 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-12-12T09:57:12.437 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8385 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-12-12T09:57:12.437 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-12-12T09:57:12.437 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-12-12T09:57:12.437 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_snat.ko 2023-12-12T09:57:12.438 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_stp.ko 2023-12-12T09:57:12.438 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-12-12T09:57:12.438 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-12-12T09:57:12.438 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-12-12T09:57:12.438 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-12-12T09:57:12.438 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 55929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtables.ko 2023-12-12T09:57:12.438 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-12-12T09:57:12.438 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13945 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-12-12T09:57:12.438 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ceph/ 2023-12-12T09:57:12.438 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 1046681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ceph/libceph.ko 2023-12-12T09:57:12.438 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/core/ 2023-12-12T09:57:12.438 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 125993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/core/pktgen.ko 2023-12-12T09:57:12.438 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/ 2023-12-12T09:57:12.438 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 194209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp.ko 2023-12-12T09:57:12.439 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp_diag.ko 2023-12-12T09:57:12.439 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 57881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp_ipv4.ko 2023-12-12T09:57:12.439 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 60337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp_ipv6.ko 2023-12-12T09:57:12.439 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/ 2023-12-12T09:57:12.439 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 390473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/dsa_core.ko 2023-12-12T09:57:12.439 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_brcm.ko 2023-12-12T09:57:12.439 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_dsa.ko 2023-12-12T09:57:12.439 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_none.ko 2023-12-12T09:57:12.439 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_trailer.ko 2023-12-12T09:57:12.439 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/hsr/ 2023-12-12T09:57:12.439 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 99729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/hsr/hsr.ko 2023-12-12T09:57:12.439 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/ 2023-12-12T09:57:12.439 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/6lowpan/ 2023-12-12T09:57:12.439 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 45233 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-12-12T09:57:12.440 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 254625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/ieee802154.ko 2023-12-12T09:57:12.440 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 47289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/ieee802154_socket.ko 2023-12-12T09:57:12.440 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ 2023-12-12T09:57:12.440 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ah4.ko 2023-12-12T09:57:12.440 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 38905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/esp4.ko 2023-12-12T09:57:12.440 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 48337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/fou.ko 2023-12-12T09:57:12.440 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/gre.ko 2023-12-12T09:57:12.440 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 48657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/inet_diag.ko 2023-12-12T09:57:12.440 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 60633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ip_gre.ko 2023-12-12T09:57:12.440 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 61225 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ip_tunnel.ko 2023-12-12T09:57:12.440 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 34505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ip_vti.ko 2023-12-12T09:57:12.440 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14001 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ipcomp.ko 2023-12-12T09:57:12.440 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ipip.ko 2023-12-12T09:57:12.440 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ 2023-12-12T09:57:12.440 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 37641 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/arp_tables.ko 2023-12-12T09:57:12.441 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-12-12T09:57:12.441 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-12-12T09:57:12.441 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 41609 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ip_tables.ko 2023-12-12T09:57:12.441 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-12-12T09:57:12.441 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2023-12-12T09:57:12.441 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-12-12T09:57:12.441 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-12-12T09:57:12.441 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-12-12T09:57:12.441 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11305 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_filter.ko 2023-12-12T09:57:12.441 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-12-12T09:57:12.441 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-12-12T09:57:12.441 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-12-12T09:57:12.441 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_security.ko 2023-12-12T09:57:12.441 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-12-12T09:57:12.442 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-12-12T09:57:12.442 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 27625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-12-12T09:57:12.442 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18161 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-12-12T09:57:12.442 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-12-12T09:57:12.442 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20561 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2023-12-12T09:57:12.442 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-12-12T09:57:12.442 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-12-12T09:57:12.442 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-12-12T09:57:12.442 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-12-12T09:57:12.442 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-12-12T09:57:12.442 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_bic.ko 2023-12-12T09:57:12.442 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_dctcp.ko 2023-12-12T09:57:12.442 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15369 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_diag.ko 2023-12-12T09:57:12.442 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_highspeed.ko 2023-12-12T09:57:12.443 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_htcp.ko 2023-12-12T09:57:12.443 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_hybla.ko 2023-12-12T09:57:12.443 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_illinois.ko 2023-12-12T09:57:12.443 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_lp.ko 2023-12-12T09:57:12.443 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_scalable.ko 2023-12-12T09:57:12.443 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_vegas.ko 2023-12-12T09:57:12.443 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_veno.ko 2023-12-12T09:57:12.443 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_westwood.ko 2023-12-12T09:57:12.443 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_yeah.ko 2023-12-12T09:57:12.443 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tunnel4.ko 2023-12-12T09:57:12.443 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/udp_diag.ko 2023-12-12T09:57:12.443 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 41665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/udp_tunnel.ko 2023-12-12T09:57:12.443 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11361 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/xfrm4_tunnel.ko 2023-12-12T09:57:12.443 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ 2023-12-12T09:57:12.444 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26377 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ah6.ko 2023-12-12T09:57:12.444 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 39537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/esp6.ko 2023-12-12T09:57:12.444 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/fou6.ko 2023-12-12T09:57:12.444 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 80897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ip6_gre.ko 2023-12-12T09:57:12.444 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 93577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ip6_tunnel.ko 2023-12-12T09:57:12.444 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-12-12T09:57:12.444 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 53273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ip6_vti.ko 2023-12-12T09:57:12.444 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ipcomp6.ko 2023-12-12T09:57:12.444 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19017 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/mip6.ko 2023-12-12T09:57:12.444 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ 2023-12-12T09:57:12.444 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 42169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-12-12T09:57:12.444 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2023-12-12T09:57:12.444 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-12-12T09:57:12.444 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-12-12T09:57:12.444 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-12-12T09:57:12.444 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-12-12T09:57:12.445 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-12-12T09:57:12.445 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-12-12T09:57:12.445 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8913 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-12-12T09:57:12.445 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-12-12T09:57:12.445 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-12-12T09:57:12.445 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-12-12T09:57:12.445 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-12-12T09:57:12.445 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11121 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-12-12T09:57:12.445 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-12-12T09:57:12.445 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-12-12T09:57:12.445 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-12-12T09:57:12.445 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 39113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-12-12T09:57:12.445 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-12-12T09:57:12.445 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 25945 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-12-12T09:57:12.446 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-12-12T09:57:12.446 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-12-12T09:57:12.446 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-12-12T09:57:12.446 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-12-12T09:57:12.446 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9009 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-12-12T09:57:12.446 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 74073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/sit.ko 2023-12-12T09:57:12.446 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/tunnel6.ko 2023-12-12T09:57:12.446 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/xfrm6_tunnel.ko 2023-12-12T09:57:12.446 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/key/ 2023-12-12T09:57:12.446 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 82833 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/key/af_key.ko 2023-12-12T09:57:12.446 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/ 2023-12-12T09:57:12.446 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 125281 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_core.ko 2023-12-12T09:57:12.446 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_debugfs.ko 2023-12-12T09:57:12.447 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 25953 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_eth.ko 2023-12-12T09:57:12.447 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 35569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_ip.ko 2023-12-12T09:57:12.447 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 36713 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_ip6.ko 2023-12-12T09:57:12.447 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 33001 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_netlink.ko 2023-12-12T09:57:12.447 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 53241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_ppp.ko 2023-12-12T09:57:12.447 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/lapb/ 2023-12-12T09:57:12.447 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 47977 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/lapb/lapb.ko 2023-12-12T09:57:12.447 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/llc/ 2023-12-12T09:57:12.447 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/llc/llc.ko 2023-12-12T09:57:12.447 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 267913 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/llc/llc2.ko 2023-12-12T09:57:12.447 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mac802154/ 2023-12-12T09:57:12.447 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 290417 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mac802154/mac802154.ko 2023-12-12T09:57:12.447 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mpls/ 2023-12-12T09:57:12.447 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mpls/mpls_gso.ko 2023-12-12T09:57:12.447 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ 2023-12-12T09:57:12.448 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ 2023-12-12T09:57:12.448 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 119585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set.ko 2023-12-12T09:57:12.448 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-12-12T09:57:12.448 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26913 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-12-12T09:57:12.448 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26369 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-12-12T09:57:12.448 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 100297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-12-12T09:57:12.448 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 101441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-12-12T09:57:12.448 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 102817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-12-12T09:57:12.448 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 103417 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-12-12T09:57:12.448 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 112849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-12-12T09:57:12.448 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 60329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-12-12T09:57:12.448 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 109593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-12-12T09:57:12.448 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 113129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-12-12T09:57:12.448 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 112585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-12-12T09:57:12.449 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 111585 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-12-12T09:57:12.449 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 114465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-12-12T09:57:12.449 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 30025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-12-12T09:57:12.449 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ 2023-12-12T09:57:12.449 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 411729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs.ko 2023-12-12T09:57:12.449 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-12-12T09:57:12.449 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-12-12T09:57:12.449 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-12-12T09:57:12.449 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-12-12T09:57:12.449 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-12-12T09:57:12.449 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7689 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-12-12T09:57:12.449 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7689 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-12-12T09:57:12.449 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10681 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-12-12T09:57:12.449 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9233 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-12-12T09:57:12.449 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-12-12T09:57:12.450 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-12-12T09:57:12.450 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7697 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-12-12T09:57:12.450 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10993 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-12-12T09:57:12.450 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 49257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conncount.ko 2023-12-12T09:57:12.450 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 408257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack.ko 2023-12-12T09:57:12.450 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-12-12T09:57:12.450 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-12-12T09:57:12.450 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 33761 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-12-12T09:57:12.450 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 118145 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_h323.ko 2023-12-12T09:57:12.450 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_irc.ko 2023-12-12T09:57:12.450 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-12-12T09:57:12.450 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 107233 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-12-12T09:57:12.450 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 33633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-12-12T09:57:12.450 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_sane.ko 2023-12-12T09:57:12.451 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 66641 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_sip.ko 2023-12-12T09:57:12.451 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11233 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-12-12T09:57:12.451 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-12-12T09:57:12.451 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10113 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_dup_netdev.ko 2023-12-12T09:57:12.451 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 89425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_flow_table.ko 2023-12-12T09:57:12.451 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9593 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_flow_table_inet.ko 2023-12-12T09:57:12.451 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 37129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_log_syslog.ko 2023-12-12T09:57:12.451 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 95353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat.ko 2023-12-12T09:57:12.451 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_amanda.ko 2023-12-12T09:57:12.451 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_ftp.ko 2023-12-12T09:57:12.451 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11857 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_irc.ko 2023-12-12T09:57:12.451 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28929 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_sip.ko 2023-12-12T09:57:12.451 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_tftp.ko 2023-12-12T09:57:12.451 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 44065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_synproxy_core.ko 2023-12-12T09:57:12.452 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 615649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_tables.ko 2023-12-12T09:57:12.452 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 42561 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink.ko 2023-12-12T09:57:12.452 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 30233 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_acct.ko 2023-12-12T09:57:12.452 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 30569 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_cttimeout.ko 2023-12-12T09:57:12.452 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 39785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_log.ko 2023-12-12T09:57:12.452 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_osf.ko 2023-12-12T09:57:12.452 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 49377 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_queue.ko 2023-12-12T09:57:12.452 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10457 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_chain_nat.ko 2023-12-12T09:57:12.452 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 33209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_compat.ko 2023-12-12T09:57:12.452 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 40721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_ct.ko 2023-12-12T09:57:12.452 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9601 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_dup_netdev.ko 2023-12-12T09:57:12.452 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_fib.ko 2023-12-12T09:57:12.452 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_fwd_netdev.ko 2023-12-12T09:57:12.452 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14185 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_hash.ko 2023-12-12T09:57:12.452 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_limit.ko 2023-12-12T09:57:12.453 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_log.ko 2023-12-12T09:57:12.453 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_masq.ko 2023-12-12T09:57:12.453 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_nat.ko 2023-12-12T09:57:12.453 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13673 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_numgen.ko 2023-12-12T09:57:12.453 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11841 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_osf.ko 2023-12-12T09:57:12.453 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_queue.ko 2023-12-12T09:57:12.453 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_redir.ko 2023-12-12T09:57:12.453 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_reject.ko 2023-12-12T09:57:12.453 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_reject_inet.ko 2023-12-12T09:57:12.453 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_socket.ko 2023-12-12T09:57:12.453 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20369 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_synproxy.ko 2023-12-12T09:57:12.453 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_tproxy.ko 2023-12-12T09:57:12.453 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 89313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/x_tables.ko 2023-12-12T09:57:12.453 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_AUDIT.ko 2023-12-12T09:57:12.453 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CHECKSUM.ko 2023-12-12T09:57:12.454 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CLASSIFY.ko 2023-12-12T09:57:12.454 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-12-12T09:57:12.454 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 18169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CT.ko 2023-12-12T09:57:12.454 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_DSCP.ko 2023-12-12T09:57:12.454 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_HL.ko 2023-12-12T09:57:12.454 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13369 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_HMARK.ko 2023-12-12T09:57:12.454 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 38873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_IDLETIMER.ko 2023-12-12T09:57:12.454 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13889 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_LED.ko 2023-12-12T09:57:12.454 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11489 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_LOG.ko 2023-12-12T09:57:12.454 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11753 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_MASQUERADE.ko 2023-12-12T09:57:12.454 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_NETMAP.ko 2023-12-12T09:57:12.454 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_NFLOG.ko 2023-12-12T09:57:12.454 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_NFQUEUE.ko 2023-12-12T09:57:12.454 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_RATEEST.ko 2023-12-12T09:57:12.455 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_REDIRECT.ko 2023-12-12T09:57:12.455 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 14337 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_SECMARK.ko 2023-12-12T09:57:12.455 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TCPMSS.ko 2023-12-12T09:57:12.455 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-12-12T09:57:12.455 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17361 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TEE.ko 2023-12-12T09:57:12.455 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TPROXY.ko 2023-12-12T09:57:12.455 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8321 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TRACE.ko 2023-12-12T09:57:12.455 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_addrtype.ko 2023-12-12T09:57:12.455 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_bpf.ko 2023-12-12T09:57:12.455 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_cgroup.ko 2023-12-12T09:57:12.455 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_cluster.ko 2023-12-12T09:57:12.455 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_comment.ko 2023-12-12T09:57:12.455 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10465 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connbytes.ko 2023-12-12T09:57:12.455 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connlabel.ko 2023-12-12T09:57:12.455 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connlimit.ko 2023-12-12T09:57:12.456 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13129 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connmark.ko 2023-12-12T09:57:12.456 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_conntrack.ko 2023-12-12T09:57:12.456 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_cpu.ko 2023-12-12T09:57:12.456 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_dccp.ko 2023-12-12T09:57:12.456 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_devgroup.ko 2023-12-12T09:57:12.456 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8801 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_dscp.ko 2023-12-12T09:57:12.456 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_ecn.ko 2023-12-12T09:57:12.456 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_esp.ko 2023-12-12T09:57:12.456 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 43289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_hashlimit.ko 2023-12-12T09:57:12.456 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_helper.ko 2023-12-12T09:57:12.456 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7865 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_hl.ko 2023-12-12T09:57:12.456 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11921 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_ipcomp.ko 2023-12-12T09:57:12.456 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_iprange.ko 2023-12-12T09:57:12.456 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11785 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_ipvs.ko 2023-12-12T09:57:12.457 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16041 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_l2tp.ko 2023-12-12T09:57:12.457 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8001 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_length.ko 2023-12-12T09:57:12.457 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10209 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_limit.ko 2023-12-12T09:57:12.457 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7545 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_mac.ko 2023-12-12T09:57:12.457 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_mark.ko 2023-12-12T09:57:12.457 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11825 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_multiport.ko 2023-12-12T09:57:12.457 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_nat.ko 2023-12-12T09:57:12.457 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_nfacct.ko 2023-12-12T09:57:12.457 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_osf.ko 2023-12-12T09:57:12.457 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_owner.ko 2023-12-12T09:57:12.457 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_physdev.ko 2023-12-12T09:57:12.457 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_pkttype.ko 2023-12-12T09:57:12.457 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11985 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_policy.ko 2023-12-12T09:57:12.457 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_quota.ko 2023-12-12T09:57:12.458 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_rateest.ko 2023-12-12T09:57:12.458 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_realm.ko 2023-12-12T09:57:12.458 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 36433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_recent.ko 2023-12-12T09:57:12.458 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13329 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_sctp.ko 2023-12-12T09:57:12.458 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 30089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_set.ko 2023-12-12T09:57:12.458 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 16089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_socket.ko 2023-12-12T09:57:12.458 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9505 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_state.ko 2023-12-12T09:57:12.458 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9473 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_statistic.ko 2023-12-12T09:57:12.458 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8809 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_string.ko 2023-12-12T09:57:12.458 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 8553 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_tcpmss.ko 2023-12-12T09:57:12.458 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15777 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_tcpudp.ko 2023-12-12T09:57:12.458 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_time.ko 2023-12-12T09:57:12.458 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_u32.ko 2023-12-12T09:57:12.458 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netlink/ 2023-12-12T09:57:12.458 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13969 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netlink/netlink_diag.ko 2023-12-12T09:57:12.459 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/nsh/ 2023-12-12T09:57:12.459 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 12425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/nsh/nsh.ko 2023-12-12T09:57:12.459 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/ 2023-12-12T09:57:12.459 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 380033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/openvswitch.ko 2023-12-12T09:57:12.459 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/vport-geneve.ko 2023-12-12T09:57:12.459 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/vport-gre.ko 2023-12-12T09:57:12.459 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 11793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/vport-vxlan.ko 2023-12-12T09:57:12.459 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/packet/ 2023-12-12T09:57:12.459 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13057 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/packet/af_packet_diag.ko 2023-12-12T09:57:12.459 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/phonet/ 2023-12-12T09:57:12.459 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 110201 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/phonet/phonet.ko 2023-12-12T09:57:12.459 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 54721 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/phonet/pn_pep.ko 2023-12-12T09:57:12.459 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds/ 2023-12-12T09:57:12.459 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 251481 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds/rds.ko 2023-12-12T09:57:12.460 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 164937 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds/rds_rdma.ko 2023-12-12T09:57:12.460 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 67377 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds/rds_tcp.ko 2023-12-12T09:57:12.460 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rxrpc/ 2023-12-12T09:57:12.460 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 819657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rxrpc/rxrpc.ko 2023-12-12T09:57:12.460 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/ 2023-12-12T09:57:12.460 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 32241 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_csum.ko 2023-12-12T09:57:12.460 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23577 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_gact.ko 2023-12-12T09:57:12.460 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26873 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_ipt.ko 2023-12-12T09:57:12.460 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 34097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_mirred.ko 2023-12-12T09:57:12.460 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_nat.ko 2023-12-12T09:57:12.460 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 43449 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_pedit.ko 2023-12-12T09:57:12.460 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 31961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_police.ko 2023-12-12T09:57:12.460 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_simple.ko 2023-12-12T09:57:12.460 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 35297 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_skbedit.ko 2023-12-12T09:57:12.460 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 36665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_vlan.ko 2023-12-12T09:57:12.461 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_basic.ko 2023-12-12T09:57:12.461 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 33961 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_bpf.ko 2023-12-12T09:57:12.461 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19169 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_cgroup.ko 2023-12-12T09:57:12.461 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 31401 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_flow.ko 2023-12-12T09:57:12.461 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 31769 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_fw.ko 2023-12-12T09:57:12.461 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 38425 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_route.ko 2023-12-12T09:57:12.461 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 61409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_u32.ko 2023-12-12T09:57:12.461 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7441 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_cmp.ko 2023-12-12T09:57:12.461 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 13409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_ipset.ko 2023-12-12T09:57:12.461 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 33289 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_meta.ko 2023-12-12T09:57:12.461 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_nbyte.ko 2023-12-12T09:57:12.461 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_text.ko 2023-12-12T09:57:12.461 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7249 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_u32.ko 2023-12-12T09:57:12.461 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 21649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_choke.ko 2023-12-12T09:57:12.461 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20849 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_codel.ko 2023-12-12T09:57:12.462 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 34633 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_drr.ko 2023-12-12T09:57:12.462 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 33609 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_fq.ko 2023-12-12T09:57:12.462 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 31617 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_fq_codel.ko 2023-12-12T09:57:12.462 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 35433 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_gred.ko 2023-12-12T09:57:12.462 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 49817 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_hfsc.ko 2023-12-12T09:57:12.462 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22089 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_hhf.ko 2023-12-12T09:57:12.462 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 66393 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_htb.ko 2023-12-12T09:57:12.462 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26073 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_ingress.ko 2023-12-12T09:57:12.462 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 30273 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_mqprio.ko 2023-12-12T09:57:12.462 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10793 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_mqprio_lib.ko 2023-12-12T09:57:12.462 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26065 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_multiq.ko 2023-12-12T09:57:12.462 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 36137 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_netem.ko 2023-12-12T09:57:12.462 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 27497 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_pie.ko 2023-12-12T09:57:12.462 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10625 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_plug.ko 2023-12-12T09:57:12.463 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 24729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_prio.ko 2023-12-12T09:57:12.463 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 48729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_qfq.ko 2023-12-12T09:57:12.463 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 32905 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_red.ko 2023-12-12T09:57:12.463 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 26881 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_sfb.ko 2023-12-12T09:57:12.463 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 31353 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_sfq.ko 2023-12-12T09:57:12.463 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28897 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_tbf.ko 2023-12-12T09:57:12.463 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 28105 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_teql.ko 2023-12-12T09:57:12.463 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sctp/ 2023-12-12T09:57:12.463 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 929745 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sctp/sctp.ko 2023-12-12T09:57:12.463 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 19033 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sctp/sctp_diag.ko 2023-12-12T09:57:12.463 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/ 2023-12-12T09:57:12.463 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/auth_gss/ 2023-12-12T09:57:12.463 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 336529 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-12-12T09:57:12.463 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 54737 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-12-12T09:57:12.463 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 1520097 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/sunrpc.ko 2023-12-12T09:57:12.463 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/xprtrdma/ 2023-12-12T09:57:12.464 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 707657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-12-12T09:57:12.464 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/tipc/ 2023-12-12T09:57:12.464 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10025 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/tipc/diag.ko 2023-12-12T09:57:12.464 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 862665 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/tipc/tipc.ko 2023-12-12T09:57:12.464 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/unix/ 2023-12-12T09:57:12.464 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15729 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/unix/unix_diag.ko 2023-12-12T09:57:12.464 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/ 2023-12-12T09:57:12.464 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 85409 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-12-12T09:57:12.464 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 68049 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-12-12T09:57:12.464 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 96193 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vsock.ko 2023-12-12T09:57:12.464 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 10705 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vsock_diag.ko 2023-12-12T09:57:12.464 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 17521 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vsock_loopback.ko 2023-12-12T09:57:12.464 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/x25/ 2023-12-12T09:57:12.464 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 125177 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/x25/x25.ko 2023-12-12T09:57:12.465 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/xfrm/ 2023-12-12T09:57:12.465 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 22657 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/xfrm/xfrm_algo.ko 2023-12-12T09:57:12.465 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 20649 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/xfrm/xfrm_ipcomp.ko 2023-12-12T09:57:12.465 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 102257 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/net/xfrm/xfrm_user.ko 2023-12-12T09:57:12.465 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/virt/ 2023-12-12T09:57:12.465 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/virt/lib/ 2023-12-12T09:57:12.465 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 15537 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/kernel/virt/lib/irqbypass.ko 2023-12-12T09:57:12.465 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 640081 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.alias 2023-12-12T09:57:12.465 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 624107 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.alias.bin 2023-12-12T09:57:12.465 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 7663 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.builtin 2023-12-12T09:57:12.465 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 23428 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.builtin.alias.bin 2023-12-12T09:57:12.465 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 9821 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.builtin.bin 2023-12-12T09:57:12.465 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 70004 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.builtin.modinfo 2023-12-12T09:57:12.465 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 146313 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.dep 2023-12-12T09:57:12.465 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 232548 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.dep.bin 2023-12-12T09:57:12.466 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 210 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.devname 2023-12-12T09:57:12.466 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 72606 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.order 2023-12-12T09:57:12.466 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 879 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.softdep 2023-12-12T09:57:12.466 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 254438 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.symbols 2023-12-12T09:57:12.466 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 309363 2023-12-08 17:49 ./lib/modules/6.6.0-gcd68252d7b4d/modules.symbols.bin 2023-12-12T09:57:12.466 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./usr/ 2023-12-12T09:57:12.466 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./usr/share/ 2023-12-12T09:57:12.466 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./usr/share/doc/ 2023-12-12T09:57:12.466 INFO:teuthology.orchestra.run.smithi078.stdout:drwxr-xr-x root/root 0 2023-12-08 17:49 ./usr/share/doc/linux-image-6.6.0-gcd68252d7b4d/ 2023-12-12T09:57:12.466 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 170 2023-12-08 17:49 ./usr/share/doc/linux-image-6.6.0-gcd68252d7b4d/changelog.Debian.gz 2023-12-12T09:57:12.466 INFO:teuthology.orchestra.run.smithi078.stdout:-rw-r--r-- root/root 691 2023-12-08 17:49 ./usr/share/doc/linux-image-6.6.0-gcd68252d7b4d/copyright 2023-12-12T09:57:12.467 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-gcd68252d7b4d 2023-12-12T09:57:12.467 INFO:teuthology.task.kernel:searching for kernel 6.6.0-gcd68252d7b4d 2023-12-12T09:57:12.467 DEBUG:teuthology.orchestra.run.smithi078:> egrep '(submenu|menuentry.*6.6.0-gcd68252d7b4d).*{' /boot/grub/grub.cfg 2023-12-12T09:57:12.474 INFO:teuthology.orchestra.run.smithi078.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-12-12T09:57:12.474 INFO:teuthology.orchestra.run.smithi078.stdout: menuentry 'Ubuntu, with Linux 6.6.0-gcd68252d7b4d' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-gcd68252d7b4d-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-12-12T09:57:12.474 INFO:teuthology.orchestra.run.smithi078.stdout: menuentry 'Ubuntu, with Linux 6.6.0-gcd68252d7b4d (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-gcd68252d7b4d-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-12-12T09:57:12.475 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2023-12-12T09:57:12.475 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.6.0-gcd68252d7b4d 2023-12-12T09:57:12.475 DEBUG:teuthology.orchestra.run.smithi078:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2023-12-12T09:57:12.517 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi078.front.sepia.ceph.com to complete... 2023-12-12T09:57:12.929 INFO:teuthology.orchestra.run.smithi078.stderr:Sourcing file `/etc/default/grub' 2023-12-12T09:57:12.930 INFO:teuthology.orchestra.run.smithi078.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-12-12T09:57:12.950 INFO:teuthology.orchestra.run.smithi078.stderr:Generating grub configuration file ... 2023-12-12T09:57:13.125 INFO:teuthology.orchestra.run.smithi078.stderr:Found linux image: /boot/vmlinuz-6.6.0-gcd68252d7b4d 2023-12-12T09:57:13.132 INFO:teuthology.orchestra.run.smithi078.stderr:Found initrd image: /boot/initrd.img-6.6.0-gcd68252d7b4d 2023-12-12T09:57:13.362 INFO:teuthology.orchestra.run.smithi078.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-12-12T09:57:13.366 INFO:teuthology.orchestra.run.smithi078.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-12-12T09:57:13.408 INFO:teuthology.orchestra.run.smithi078.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-12-12T09:57:13.414 INFO:teuthology.orchestra.run.smithi078.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-12-12T09:57:13.541 INFO:teuthology.orchestra.run.smithi078.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-12-12T09:57:13.541 INFO:teuthology.orchestra.run.smithi078.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-12-12T09:57:13.541 INFO:teuthology.orchestra.run.smithi078.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-12-12T09:57:13.566 INFO:teuthology.orchestra.run.smithi078.stderr:done 2023-12-12T09:57:42.846 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2023-12-12T09:57:42.847 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi187.front.sepia.ceph.com' 2023-12-12T09:57:42.848 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-12T09:57:44.686 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-12-12T09:57:44.686 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi078.front.sepia.ceph.com' 2023-12-12T09:57:44.687 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-12T09:58:01.319 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.187 2023-12-12T09:58:03.110 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.78 2023-12-12T09:58:10.326 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi187.front.sepia.ceph.com' 2023-12-12T09:58:10.327 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-12T09:58:12.113 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi078.front.sepia.ceph.com' 2023-12-12T09:58:12.113 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-12T09:58:13.378 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.187 2023-12-12T09:58:15.174 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.78 2023-12-12T09:58:25.386 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi187.front.sepia.ceph.com' 2023-12-12T09:58:25.387 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-12T09:58:27.175 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi078.front.sepia.ceph.com' 2023-12-12T09:58:27.176 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-12T09:58:43.810 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.187 2023-12-12T09:58:45.605 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.78 2023-12-12T09:58:58.822 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi187.front.sepia.ceph.com' 2023-12-12T09:58:58.823 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-12T09:58:59.178 DEBUG:teuthology.orchestra.run.smithi187:> true 2023-12-12T09:59:00.134 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi187.front.sepia.ceph.com' 2023-12-12T09:59:00.134 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.6.0-gcd68252d7b4d"... 2023-12-12T09:59:00.134 DEBUG:teuthology.orchestra.run.smithi187:> uname -r 2023-12-12T09:59:00.189 INFO:teuthology.orchestra.run.smithi187.stdout:6.6.0-gcd68252d7b4d 2023-12-12T09:59:00.189 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-gcd68252d7b4d vs 6.6.0-gcd68252d7b4d 2023-12-12T09:59:00.189 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-12-12T09:59:00.189 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-12-12T09:59:00.607 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi078.front.sepia.ceph.com' 2023-12-12T09:59:00.607 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-12T09:59:00.839 DEBUG:teuthology.orchestra.run.smithi078:> true 2023-12-12T09:59:01.190 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2023-12-12T09:59:01.190 DEBUG:teuthology.orchestra.run.smithi187:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-12-12T09:59:01.301 INFO:teuthology.orchestra.run.smithi187.stdout:ttyS1 2023-12-12T09:59:01.360 DEBUG:teuthology.parallel:result is None 2023-12-12T09:59:01.727 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi078.front.sepia.ceph.com' 2023-12-12T09:59:01.728 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.6.0-gcd68252d7b4d"... 2023-12-12T09:59:01.728 DEBUG:teuthology.orchestra.run.smithi078:> uname -r 2023-12-12T09:59:01.784 INFO:teuthology.orchestra.run.smithi078.stdout:6.6.0-gcd68252d7b4d 2023-12-12T09:59:01.784 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-gcd68252d7b4d vs 6.6.0-gcd68252d7b4d 2023-12-12T09:59:01.785 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-12-12T09:59:01.785 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-12-12T09:59:02.785 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-12-12T09:59:02.785 DEBUG:teuthology.orchestra.run.smithi078:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-12-12T09:59:02.881 INFO:teuthology.orchestra.run.smithi078.stdout:ttyS1 2023-12-12T09:59:02.938 DEBUG:teuthology.parallel:result is None 2023-12-12T09:59:02.939 INFO:teuthology.run_tasks:Running task internal.base... 2023-12-12T09:59:02.950 INFO:teuthology.task.internal:Creating test directory... 2023-12-12T09:59:02.951 DEBUG:teuthology.orchestra.run.smithi078:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-12T09:59:02.954 DEBUG:teuthology.orchestra.run.smithi187:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-12T09:59:02.963 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-12-12T09:59:03.054 INFO:teuthology.run_tasks:Running task internal.archive... 2023-12-12T09:59:03.177 INFO:teuthology.task.internal:Creating archive directory... 2023-12-12T09:59:03.177 DEBUG:teuthology.orchestra.run.smithi078:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-12T09:59:03.180 DEBUG:teuthology.orchestra.run.smithi187:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-12T09:59:03.209 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-12-12T09:59:03.322 INFO:teuthology.task.internal:Enabling coredump saving... 2023-12-12T09:59:03.323 DEBUG:teuthology.orchestra.run.smithi078:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-12T09:59:03.326 DEBUG:teuthology.orchestra.run.smithi187:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-12T09:59:03.355 INFO:teuthology.orchestra.run.smithi078.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-12T09:59:03.361 INFO:teuthology.orchestra.run.smithi187.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-12T09:59:03.369 INFO:teuthology.orchestra.run.smithi078.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-12T09:59:03.376 INFO:teuthology.orchestra.run.smithi187.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-12T09:59:03.378 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-12-12T09:59:03.479 INFO:teuthology.task.internal:Configuring sudo... 2023-12-12T09:59:03.479 DEBUG:teuthology.orchestra.run.smithi078:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-12T09:59:03.483 DEBUG:teuthology.orchestra.run.smithi187:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-12T09:59:03.507 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-12-12T09:59:03.640 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-12-12T09:59:03.641 DEBUG:teuthology.orchestra.run.smithi078:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-12T09:59:03.647 DEBUG:teuthology.orchestra.run.smithi187:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-12T09:59:03.657 DEBUG:teuthology.orchestra.run.smithi078:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-12T09:59:03.700 DEBUG:teuthology.orchestra.run.smithi078:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-12T09:59:03.752 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-12-12T09:59:03.753 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-12T09:59:03.820 DEBUG:teuthology.orchestra.run.smithi187:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-12T09:59:03.829 DEBUG:teuthology.orchestra.run.smithi187:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-12T09:59:03.886 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-12-12T09:59:03.886 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-12T09:59:03.963 DEBUG:teuthology.orchestra.run.smithi078:> sudo service rsyslog restart 2023-12-12T09:59:03.967 DEBUG:teuthology.orchestra.run.smithi187:> sudo service rsyslog restart 2023-12-12T09:59:04.099 INFO:teuthology.run_tasks:Running task internal.timer... 2023-12-12T09:59:04.106 INFO:teuthology.task.internal:Starting timer... 2023-12-12T09:59:04.107 INFO:teuthology.run_tasks:Running task pcp... 2023-12-12T09:59:04.137 INFO:teuthology.run_tasks:Running task selinux... 2023-12-12T09:59:04.206 DEBUG:teuthology.task.selinux:Excluding smithi078: OS 'ubuntu' does not support SELinux 2023-12-12T09:59:04.206 DEBUG:teuthology.task.selinux:Excluding smithi187: OS 'ubuntu' does not support SELinux 2023-12-12T09:59:04.206 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-12-12T09:59:04.206 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2023-12-12T09:59:04.207 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-12-12T09:59:04.207 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-12-12T09:59:04.360 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-12-12T09:59:04.360 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-12-12T09:59:04.379 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-12-12T09:59:04.380 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi078.front.sepia.ceph.com,smithi187.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-12-12T10:07:48.003 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi078.front.sepia.ceph.com'), Remote(name='ubuntu@smithi187.front.sepia.ceph.com')] 2023-12-12T10:07:48.005 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi078.front.sepia.ceph.com' 2023-12-12T10:07:48.006 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-12T10:07:48.096 DEBUG:teuthology.orchestra.run.smithi078:> true 2023-12-12T10:07:48.225 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi078.front.sepia.ceph.com' 2023-12-12T10:07:48.225 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi187.front.sepia.ceph.com' 2023-12-12T10:07:48.226 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-12T10:07:48.304 DEBUG:teuthology.orchestra.run.smithi187:> true 2023-12-12T10:07:48.441 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi187.front.sepia.ceph.com' 2023-12-12T10:07:48.442 INFO:teuthology.run_tasks:Running task clock... 2023-12-12T10:07:48.453 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-12-12T10:07:48.453 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-12T10:07:48.453 DEBUG:teuthology.orchestra.run.smithi078:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-12T10:07:48.457 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-12T10:07:48.457 DEBUG:teuthology.orchestra.run.smithi187:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-12T10:07:48.493 INFO:teuthology.orchestra.run.smithi078.stdout:12 Dec 10:07:48 ntpd[27980]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2023-12-12T10:07:48.493 INFO:teuthology.orchestra.run.smithi078.stdout:12 Dec 10:07:48 ntpd[27980]: Command line: ntpd -gq 2023-12-12T10:07:48.493 INFO:teuthology.orchestra.run.smithi078.stdout:12 Dec 10:07:48 ntpd[27980]: ---------------------------------------------------- 2023-12-12T10:07:48.493 INFO:teuthology.orchestra.run.smithi078.stdout:12 Dec 10:07:48 ntpd[27980]: ntp-4 is maintained by Network Time Foundation, 2023-12-12T10:07:48.493 INFO:teuthology.orchestra.run.smithi078.stdout:12 Dec 10:07:48 ntpd[27980]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2023-12-12T10:07:48.494 INFO:teuthology.orchestra.run.smithi078.stdout:12 Dec 10:07:48 ntpd[27980]: corporation. Support and training for ntp-4 are 2023-12-12T10:07:48.494 INFO:teuthology.orchestra.run.smithi078.stdout:12 Dec 10:07:48 ntpd[27980]: available at https://www.nwtime.org/support 2023-12-12T10:07:48.494 INFO:teuthology.orchestra.run.smithi078.stdout:12 Dec 10:07:48 ntpd[27980]: ---------------------------------------------------- 2023-12-12T10:07:48.494 INFO:teuthology.orchestra.run.smithi078.stdout:12 Dec 10:07:48 ntpd[27980]: proto: precision = 0.042 usec (-24) 2023-12-12T10:07:48.494 INFO:teuthology.orchestra.run.smithi078.stdout:12 Dec 10:07:48 ntpd[27980]: basedate set to 2022-02-04 2023-12-12T10:07:48.495 INFO:teuthology.orchestra.run.smithi078.stdout:12 Dec 10:07:48 ntpd[27980]: gps base set to 2022-02-06 (week 2196) 2023-12-12T10:07:48.495 INFO:teuthology.orchestra.run.smithi078.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-12-12T10:07:48.495 INFO:teuthology.orchestra.run.smithi078.stdout:12 Dec 10:07:48 ntpd[27980]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-12-12T10:07:48.495 INFO:teuthology.orchestra.run.smithi078.stderr:restrict ::: KOD does nothing without LIMITED. 2023-12-12T10:07:48.496 INFO:teuthology.orchestra.run.smithi078.stdout:12 Dec 10:07:48 ntpd[27980]: restrict ::: KOD does nothing without LIMITED. 2023-12-12T10:07:48.496 INFO:teuthology.orchestra.run.smithi078.stdout:12 Dec 10:07:48 ntpd[27980]: Listen and drop on 0 v6wildcard [::]:123 2023-12-12T10:07:48.497 INFO:teuthology.orchestra.run.smithi078.stdout:12 Dec 10:07:48 ntpd[27980]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-12-12T10:07:48.497 INFO:teuthology.orchestra.run.smithi078.stdout:12 Dec 10:07:48 ntpd[27980]: Listen normally on 2 lo 127.0.0.1:123 2023-12-12T10:07:48.497 INFO:teuthology.orchestra.run.smithi078.stdout:12 Dec 10:07:48 ntpd[27980]: Listen normally on 3 enp3s0f1 172.21.15.78:123 2023-12-12T10:07:48.498 INFO:teuthology.orchestra.run.smithi078.stdout:12 Dec 10:07:48 ntpd[27980]: Listen normally on 4 lo [::1]:123 2023-12-12T10:07:48.498 INFO:teuthology.orchestra.run.smithi078.stdout:12 Dec 10:07:48 ntpd[27980]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d4dd%5]:123 2023-12-12T10:07:48.499 INFO:teuthology.orchestra.run.smithi078.stdout:12 Dec 10:07:48 ntpd[27980]: Listening on routing socket on fd #22 for interface updates 2023-12-12T10:07:48.526 INFO:teuthology.orchestra.run.smithi187.stdout:12 Dec 10:07:48 ntpd[27982]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2023-12-12T10:07:48.526 INFO:teuthology.orchestra.run.smithi187.stdout:12 Dec 10:07:48 ntpd[27982]: Command line: ntpd -gq 2023-12-12T10:07:48.526 INFO:teuthology.orchestra.run.smithi187.stdout:12 Dec 10:07:48 ntpd[27982]: ---------------------------------------------------- 2023-12-12T10:07:48.526 INFO:teuthology.orchestra.run.smithi187.stdout:12 Dec 10:07:48 ntpd[27982]: ntp-4 is maintained by Network Time Foundation, 2023-12-12T10:07:48.526 INFO:teuthology.orchestra.run.smithi187.stdout:12 Dec 10:07:48 ntpd[27982]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2023-12-12T10:07:48.526 INFO:teuthology.orchestra.run.smithi187.stdout:12 Dec 10:07:48 ntpd[27982]: corporation. Support and training for ntp-4 are 2023-12-12T10:07:48.526 INFO:teuthology.orchestra.run.smithi187.stdout:12 Dec 10:07:48 ntpd[27982]: available at https://www.nwtime.org/support 2023-12-12T10:07:48.526 INFO:teuthology.orchestra.run.smithi187.stdout:12 Dec 10:07:48 ntpd[27982]: ---------------------------------------------------- 2023-12-12T10:07:48.527 INFO:teuthology.orchestra.run.smithi187.stdout:12 Dec 10:07:48 ntpd[27982]: proto: precision = 0.042 usec (-24) 2023-12-12T10:07:48.527 INFO:teuthology.orchestra.run.smithi187.stdout:12 Dec 10:07:48 ntpd[27982]: basedate set to 2022-02-04 2023-12-12T10:07:48.527 INFO:teuthology.orchestra.run.smithi187.stdout:12 Dec 10:07:48 ntpd[27982]: gps base set to 2022-02-06 (week 2196) 2023-12-12T10:07:48.527 INFO:teuthology.orchestra.run.smithi187.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-12-12T10:07:48.528 INFO:teuthology.orchestra.run.smithi187.stdout:12 Dec 10:07:48 ntpd[27982]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-12-12T10:07:48.528 INFO:teuthology.orchestra.run.smithi187.stdout:12 Dec 10:07:48 ntpd[27982]: restrict ::: KOD does nothing without LIMITED. 2023-12-12T10:07:48.528 INFO:teuthology.orchestra.run.smithi187.stderr:restrict ::: KOD does nothing without LIMITED. 2023-12-12T10:07:48.529 INFO:teuthology.orchestra.run.smithi187.stdout:12 Dec 10:07:48 ntpd[27982]: Listen and drop on 0 v6wildcard [::]:123 2023-12-12T10:07:48.529 INFO:teuthology.orchestra.run.smithi187.stdout:12 Dec 10:07:48 ntpd[27982]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-12-12T10:07:48.529 INFO:teuthology.orchestra.run.smithi187.stdout:12 Dec 10:07:48 ntpd[27982]: Listen normally on 2 lo 127.0.0.1:123 2023-12-12T10:07:48.529 INFO:teuthology.orchestra.run.smithi187.stdout:12 Dec 10:07:48 ntpd[27982]: Listen normally on 3 enp3s0f1 172.21.15.187:123 2023-12-12T10:07:48.529 INFO:teuthology.orchestra.run.smithi187.stdout:12 Dec 10:07:48 ntpd[27982]: Listen normally on 4 lo [::1]:123 2023-12-12T10:07:48.529 INFO:teuthology.orchestra.run.smithi187.stdout:12 Dec 10:07:48 ntpd[27982]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:77b1%5]:123 2023-12-12T10:07:48.529 INFO:teuthology.orchestra.run.smithi187.stdout:12 Dec 10:07:48 ntpd[27982]: Listening on routing socket on fd #22 for interface updates 2023-12-12T10:07:50.527 INFO:teuthology.orchestra.run.smithi187.stderr:12 Dec 10:07:50 ntpd[27982]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-12T10:07:50.527 INFO:teuthology.orchestra.run.smithi187.stderr:12 Dec 10:07:50 ntpd[27982]: can't open /var/log/ntpstats/rawstats.20231212: Permission denied 2023-12-12T10:07:50.527 INFO:teuthology.orchestra.run.smithi187.stderr:12 Dec 10:07:50 ntpd[27982]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-12T10:07:50.527 INFO:teuthology.orchestra.run.smithi187.stderr:12 Dec 10:07:50 ntpd[27982]: can't open /var/log/ntpstats/rawstats.20231212: Permission denied 2023-12-12T10:07:50.528 INFO:teuthology.orchestra.run.smithi187.stderr:12 Dec 10:07:50 ntpd[27982]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-12T10:07:50.528 INFO:teuthology.orchestra.run.smithi187.stderr:12 Dec 10:07:50 ntpd[27982]: can't open /var/log/ntpstats/peerstats.20231212: Permission denied 2023-12-12T10:07:51.494 INFO:teuthology.orchestra.run.smithi078.stderr:12 Dec 10:07:51 ntpd[27980]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-12T10:07:51.495 INFO:teuthology.orchestra.run.smithi078.stderr:12 Dec 10:07:51 ntpd[27980]: can't open /var/log/ntpstats/rawstats.20231212: Permission denied 2023-12-12T10:07:51.495 INFO:teuthology.orchestra.run.smithi078.stderr:12 Dec 10:07:51 ntpd[27980]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-12T10:07:51.495 INFO:teuthology.orchestra.run.smithi078.stderr:12 Dec 10:07:51 ntpd[27980]: can't open /var/log/ntpstats/rawstats.20231212: Permission denied 2023-12-12T10:07:51.495 INFO:teuthology.orchestra.run.smithi078.stderr:12 Dec 10:07:51 ntpd[27980]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-12T10:07:51.495 INFO:teuthology.orchestra.run.smithi078.stderr:12 Dec 10:07:51 ntpd[27980]: can't open /var/log/ntpstats/rawstats.20231212: Permission denied 2023-12-12T10:07:51.495 INFO:teuthology.orchestra.run.smithi078.stderr:12 Dec 10:07:51 ntpd[27980]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-12T10:07:51.495 INFO:teuthology.orchestra.run.smithi078.stderr:12 Dec 10:07:51 ntpd[27980]: can't open /var/log/ntpstats/peerstats.20231212: Permission denied 2023-12-12T10:07:51.495 INFO:teuthology.orchestra.run.smithi078.stderr:12 Dec 10:07:51 ntpd[27980]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-12T10:07:51.495 INFO:teuthology.orchestra.run.smithi078.stderr:12 Dec 10:07:51 ntpd[27980]: can't open /var/log/ntpstats/rawstats.20231212: Permission denied 2023-12-12T10:07:51.495 INFO:teuthology.orchestra.run.smithi078.stderr:12 Dec 10:07:51 ntpd[27980]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-12T10:07:51.495 INFO:teuthology.orchestra.run.smithi078.stderr:12 Dec 10:07:51 ntpd[27980]: can't open /var/log/ntpstats/peerstats.20231212: Permission denied 2023-12-12T10:07:51.526 INFO:teuthology.orchestra.run.smithi187.stderr:12 Dec 10:07:51 ntpd[27982]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-12T10:07:51.526 INFO:teuthology.orchestra.run.smithi187.stderr:12 Dec 10:07:51 ntpd[27982]: can't open /var/log/ntpstats/rawstats.20231212: Permission denied 2023-12-12T10:07:51.526 INFO:teuthology.orchestra.run.smithi187.stderr:12 Dec 10:07:51 ntpd[27982]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-12T10:07:51.527 INFO:teuthology.orchestra.run.smithi187.stderr:12 Dec 10:07:51 ntpd[27982]: can't open /var/log/ntpstats/rawstats.20231212: Permission denied 2023-12-12T10:07:51.527 INFO:teuthology.orchestra.run.smithi187.stderr:12 Dec 10:07:51 ntpd[27982]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-12T10:07:51.527 INFO:teuthology.orchestra.run.smithi187.stderr:12 Dec 10:07:51 ntpd[27982]: can't open /var/log/ntpstats/peerstats.20231212: Permission denied 2023-12-12T10:07:52.494 INFO:teuthology.orchestra.run.smithi078.stderr:12 Dec 10:07:52 ntpd[27980]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-12T10:07:52.494 INFO:teuthology.orchestra.run.smithi078.stderr:12 Dec 10:07:52 ntpd[27980]: can't open /var/log/ntpstats/rawstats.20231212: Permission denied 2023-12-12T10:07:52.526 INFO:teuthology.orchestra.run.smithi187.stderr:12 Dec 10:07:52 ntpd[27982]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-12T10:07:52.527 INFO:teuthology.orchestra.run.smithi187.stderr:12 Dec 10:07:52 ntpd[27982]: can't open /var/log/ntpstats/rawstats.20231212: Permission denied 2023-12-12T10:07:52.527 INFO:teuthology.orchestra.run.smithi187.stderr:12 Dec 10:07:52 ntpd[27982]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-12T10:07:52.527 INFO:teuthology.orchestra.run.smithi187.stderr:12 Dec 10:07:52 ntpd[27982]: can't open /var/log/ntpstats/rawstats.20231212: Permission denied 2023-12-12T10:07:52.527 INFO:teuthology.orchestra.run.smithi187.stderr:12 Dec 10:07:52 ntpd[27982]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-12T10:07:52.527 INFO:teuthology.orchestra.run.smithi187.stderr:12 Dec 10:07:52 ntpd[27982]: can't open /var/log/ntpstats/peerstats.20231212: Permission denied 2023-12-12T10:07:53.495 INFO:teuthology.orchestra.run.smithi078.stderr:12 Dec 10:07:53 ntpd[27980]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-12T10:07:53.496 INFO:teuthology.orchestra.run.smithi078.stderr:12 Dec 10:07:53 ntpd[27980]: can't open /var/log/ntpstats/rawstats.20231212: Permission denied 2023-12-12T10:07:53.496 INFO:teuthology.orchestra.run.smithi078.stderr:12 Dec 10:07:53 ntpd[27980]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-12T10:07:53.496 INFO:teuthology.orchestra.run.smithi078.stderr:12 Dec 10:07:53 ntpd[27980]: can't open /var/log/ntpstats/rawstats.20231212: Permission denied 2023-12-12T10:07:53.496 INFO:teuthology.orchestra.run.smithi078.stderr:12 Dec 10:07:53 ntpd[27980]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-12T10:07:53.496 INFO:teuthology.orchestra.run.smithi078.stderr:12 Dec 10:07:53 ntpd[27980]: can't open /var/log/ntpstats/rawstats.20231212: Permission denied 2023-12-12T10:07:53.496 INFO:teuthology.orchestra.run.smithi078.stderr:12 Dec 10:07:53 ntpd[27980]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-12T10:07:53.496 INFO:teuthology.orchestra.run.smithi078.stderr:12 Dec 10:07:53 ntpd[27980]: can't open /var/log/ntpstats/rawstats.20231212: Permission denied 2023-12-12T10:07:53.496 INFO:teuthology.orchestra.run.smithi078.stderr:12 Dec 10:07:53 ntpd[27980]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-12T10:07:53.496 INFO:teuthology.orchestra.run.smithi078.stderr:12 Dec 10:07:53 ntpd[27980]: can't open /var/log/ntpstats/peerstats.20231212: Permission denied 2023-12-12T10:07:53.496 INFO:teuthology.orchestra.run.smithi078.stderr:12 Dec 10:07:53 ntpd[27980]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-12T10:07:53.496 INFO:teuthology.orchestra.run.smithi078.stderr:12 Dec 10:07:53 ntpd[27980]: can't open /var/log/ntpstats/rawstats.20231212: Permission denied 2023-12-12T10:07:53.496 INFO:teuthology.orchestra.run.smithi078.stderr:12 Dec 10:07:53 ntpd[27980]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-12T10:07:53.496 INFO:teuthology.orchestra.run.smithi078.stderr:12 Dec 10:07:53 ntpd[27980]: can't open /var/log/ntpstats/peerstats.20231212: Permission denied 2023-12-12T10:07:53.496 INFO:teuthology.orchestra.run.smithi078.stderr:12 Dec 10:07:53 ntpd[27980]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-12T10:07:53.497 INFO:teuthology.orchestra.run.smithi078.stderr:12 Dec 10:07:53 ntpd[27980]: can't open /var/log/ntpstats/rawstats.20231212: Permission denied 2023-12-12T10:07:53.497 INFO:teuthology.orchestra.run.smithi078.stderr:12 Dec 10:07:53 ntpd[27980]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-12T10:07:53.497 INFO:teuthology.orchestra.run.smithi078.stderr:12 Dec 10:07:53 ntpd[27980]: can't open /var/log/ntpstats/peerstats.20231212: Permission denied 2023-12-12T10:07:53.527 INFO:teuthology.orchestra.run.smithi187.stderr:12 Dec 10:07:53 ntpd[27982]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-12T10:07:53.527 INFO:teuthology.orchestra.run.smithi187.stderr:12 Dec 10:07:53 ntpd[27982]: can't open /var/log/ntpstats/rawstats.20231212: Permission denied 2023-12-12T10:07:53.527 INFO:teuthology.orchestra.run.smithi187.stderr:12 Dec 10:07:53 ntpd[27982]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-12T10:07:53.527 INFO:teuthology.orchestra.run.smithi187.stderr:12 Dec 10:07:53 ntpd[27982]: can't open /var/log/ntpstats/rawstats.20231212: Permission denied 2023-12-12T10:07:53.528 INFO:teuthology.orchestra.run.smithi187.stderr:12 Dec 10:07:53 ntpd[27982]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-12T10:07:53.528 INFO:teuthology.orchestra.run.smithi187.stderr:12 Dec 10:07:53 ntpd[27982]: can't open /var/log/ntpstats/rawstats.20231212: Permission denied 2023-12-12T10:07:53.528 INFO:teuthology.orchestra.run.smithi187.stderr:12 Dec 10:07:53 ntpd[27982]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-12T10:07:53.528 INFO:teuthology.orchestra.run.smithi187.stderr:12 Dec 10:07:53 ntpd[27982]: can't open /var/log/ntpstats/rawstats.20231212: Permission denied 2023-12-12T10:07:53.528 INFO:teuthology.orchestra.run.smithi187.stderr:12 Dec 10:07:53 ntpd[27982]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-12T10:07:53.528 INFO:teuthology.orchestra.run.smithi187.stderr:12 Dec 10:07:53 ntpd[27982]: can't open /var/log/ntpstats/peerstats.20231212: Permission denied 2023-12-12T10:07:53.528 INFO:teuthology.orchestra.run.smithi187.stderr:12 Dec 10:07:53 ntpd[27982]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-12T10:07:53.528 INFO:teuthology.orchestra.run.smithi187.stderr:12 Dec 10:07:53 ntpd[27982]: can't open /var/log/ntpstats/rawstats.20231212: Permission denied 2023-12-12T10:07:53.528 INFO:teuthology.orchestra.run.smithi187.stderr:12 Dec 10:07:53 ntpd[27982]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-12T10:07:53.529 INFO:teuthology.orchestra.run.smithi187.stderr:12 Dec 10:07:53 ntpd[27982]: can't open /var/log/ntpstats/peerstats.20231212: Permission denied 2023-12-12T10:07:54.526 INFO:teuthology.orchestra.run.smithi187.stderr:12 Dec 10:07:54 ntpd[27982]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-12T10:07:54.527 INFO:teuthology.orchestra.run.smithi187.stderr:12 Dec 10:07:54 ntpd[27982]: can't open /var/log/ntpstats/rawstats.20231212: Permission denied 2023-12-12T10:07:54.527 INFO:teuthology.orchestra.run.smithi187.stderr:12 Dec 10:07:54 ntpd[27982]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-12T10:07:54.527 INFO:teuthology.orchestra.run.smithi187.stderr:12 Dec 10:07:54 ntpd[27982]: can't open /var/log/ntpstats/rawstats.20231212: Permission denied 2023-12-12T10:07:54.527 INFO:teuthology.orchestra.run.smithi187.stderr:12 Dec 10:07:54 ntpd[27982]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-12T10:07:54.527 INFO:teuthology.orchestra.run.smithi187.stderr:12 Dec 10:07:54 ntpd[27982]: can't open /var/log/ntpstats/peerstats.20231212: Permission denied 2023-12-12T10:07:55.495 INFO:teuthology.orchestra.run.smithi078.stderr:12 Dec 10:07:55 ntpd[27980]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-12T10:07:55.496 INFO:teuthology.orchestra.run.smithi078.stderr:12 Dec 10:07:55 ntpd[27980]: can't open /var/log/ntpstats/rawstats.20231212: Permission denied 2023-12-12T10:07:55.496 INFO:teuthology.orchestra.run.smithi078.stderr:12 Dec 10:07:55 ntpd[27980]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-12T10:07:55.496 INFO:teuthology.orchestra.run.smithi078.stderr:12 Dec 10:07:55 ntpd[27980]: can't open /var/log/ntpstats/rawstats.20231212: Permission denied 2023-12-12T10:07:55.496 INFO:teuthology.orchestra.run.smithi078.stderr:12 Dec 10:07:55 ntpd[27980]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-12T10:07:55.496 INFO:teuthology.orchestra.run.smithi078.stderr:12 Dec 10:07:55 ntpd[27980]: can't open /var/log/ntpstats/rawstats.20231212: Permission denied 2023-12-12T10:07:55.496 INFO:teuthology.orchestra.run.smithi078.stderr:12 Dec 10:07:55 ntpd[27980]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-12T10:07:55.496 INFO:teuthology.orchestra.run.smithi078.stderr:12 Dec 10:07:55 ntpd[27980]: can't open /var/log/ntpstats/rawstats.20231212: Permission denied 2023-12-12T10:07:55.496 INFO:teuthology.orchestra.run.smithi078.stderr:12 Dec 10:07:55 ntpd[27980]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-12T10:07:55.496 INFO:teuthology.orchestra.run.smithi078.stderr:12 Dec 10:07:55 ntpd[27980]: can't open /var/log/ntpstats/peerstats.20231212: Permission denied 2023-12-12T10:07:55.496 INFO:teuthology.orchestra.run.smithi078.stderr:12 Dec 10:07:55 ntpd[27980]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-12T10:07:55.496 INFO:teuthology.orchestra.run.smithi078.stderr:12 Dec 10:07:55 ntpd[27980]: can't open /var/log/ntpstats/rawstats.20231212: Permission denied 2023-12-12T10:07:55.496 INFO:teuthology.orchestra.run.smithi078.stderr:12 Dec 10:07:55 ntpd[27980]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-12T10:07:55.497 INFO:teuthology.orchestra.run.smithi078.stderr:12 Dec 10:07:55 ntpd[27980]: can't open /var/log/ntpstats/peerstats.20231212: Permission denied 2023-12-12T10:07:55.497 INFO:teuthology.orchestra.run.smithi078.stderr:12 Dec 10:07:55 ntpd[27980]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-12T10:07:55.497 INFO:teuthology.orchestra.run.smithi078.stderr:12 Dec 10:07:55 ntpd[27980]: can't open /var/log/ntpstats/rawstats.20231212: Permission denied 2023-12-12T10:07:55.497 INFO:teuthology.orchestra.run.smithi078.stderr:12 Dec 10:07:55 ntpd[27980]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-12T10:07:55.497 INFO:teuthology.orchestra.run.smithi078.stderr:12 Dec 10:07:55 ntpd[27980]: can't open /var/log/ntpstats/peerstats.20231212: Permission denied 2023-12-12T10:07:55.527 INFO:teuthology.orchestra.run.smithi187.stderr:12 Dec 10:07:55 ntpd[27982]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-12T10:07:55.527 INFO:teuthology.orchestra.run.smithi187.stderr:12 Dec 10:07:55 ntpd[27982]: can't open /var/log/ntpstats/rawstats.20231212: Permission denied 2023-12-12T10:07:55.528 INFO:teuthology.orchestra.run.smithi187.stderr:12 Dec 10:07:55 ntpd[27982]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-12T10:07:55.528 INFO:teuthology.orchestra.run.smithi187.stderr:12 Dec 10:07:55 ntpd[27982]: can't open /var/log/ntpstats/rawstats.20231212: Permission denied 2023-12-12T10:07:55.528 INFO:teuthology.orchestra.run.smithi187.stderr:12 Dec 10:07:55 ntpd[27982]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-12T10:07:55.528 INFO:teuthology.orchestra.run.smithi187.stderr:12 Dec 10:07:55 ntpd[27982]: can't open /var/log/ntpstats/rawstats.20231212: Permission denied 2023-12-12T10:07:55.528 INFO:teuthology.orchestra.run.smithi187.stderr:12 Dec 10:07:55 ntpd[27982]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-12T10:07:55.528 INFO:teuthology.orchestra.run.smithi187.stderr:12 Dec 10:07:55 ntpd[27982]: can't open /var/log/ntpstats/peerstats.20231212: Permission denied 2023-12-12T10:07:55.528 INFO:teuthology.orchestra.run.smithi187.stderr:12 Dec 10:07:55 ntpd[27982]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-12T10:07:55.528 INFO:teuthology.orchestra.run.smithi187.stderr:12 Dec 10:07:55 ntpd[27982]: can't open /var/log/ntpstats/rawstats.20231212: Permission denied 2023-12-12T10:07:55.528 INFO:teuthology.orchestra.run.smithi187.stderr:12 Dec 10:07:55 ntpd[27982]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-12T10:07:55.528 INFO:teuthology.orchestra.run.smithi187.stderr:12 Dec 10:07:55 ntpd[27982]: can't open /var/log/ntpstats/peerstats.20231212: Permission denied 2023-12-12T10:07:56.526 INFO:teuthology.orchestra.run.smithi187.stderr:12 Dec 10:07:56 ntpd[27982]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-12T10:07:56.526 INFO:teuthology.orchestra.run.smithi187.stderr:12 Dec 10:07:56 ntpd[27982]: can't open /var/log/ntpstats/rawstats.20231212: Permission denied 2023-12-12T10:07:56.527 INFO:teuthology.orchestra.run.smithi187.stderr:12 Dec 10:07:56 ntpd[27982]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-12T10:07:56.527 INFO:teuthology.orchestra.run.smithi187.stderr:12 Dec 10:07:56 ntpd[27982]: can't open /var/log/ntpstats/rawstats.20231212: Permission denied 2023-12-12T10:07:56.527 INFO:teuthology.orchestra.run.smithi187.stderr:12 Dec 10:07:56 ntpd[27982]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-12T10:07:56.527 INFO:teuthology.orchestra.run.smithi187.stderr:12 Dec 10:07:56 ntpd[27982]: can't open /var/log/ntpstats/peerstats.20231212: Permission denied 2023-12-12T10:07:56.527 INFO:teuthology.orchestra.run.smithi187.stdout:12 Dec 10:07:56 ntpd[27982]: ntpd: time slew -0.002120 s 2023-12-12T10:07:56.527 INFO:teuthology.orchestra.run.smithi187.stdout:ntpd: time slew -0.002120s 2023-12-12T10:07:56.528 INFO:teuthology.orchestra.run.smithi187.stderr:12 Dec 10:07:56 ntpd[27982]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-12-12T10:07:56.528 INFO:teuthology.orchestra.run.smithi187.stderr:12 Dec 10:07:56 ntpd[27982]: can't open /var/log/ntpstats/loopstats.20231212: Permission denied 2023-12-12T10:07:56.634 INFO:teuthology.orchestra.run.smithi187.stdout: remote refid st t when poll reach delay offset jitter 2023-12-12T10:07:56.635 INFO:teuthology.orchestra.run.smithi187.stdout:============================================================================== 2023-12-12T10:07:56.635 INFO:teuthology.orchestra.run.smithi187.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-12-12T10:07:56.635 INFO:teuthology.orchestra.run.smithi187.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-12-12T10:07:56.635 INFO:teuthology.orchestra.run.smithi187.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-12-12T10:07:56.635 INFO:teuthology.orchestra.run.smithi187.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-12-12T10:07:57.496 INFO:teuthology.orchestra.run.smithi078.stderr:12 Dec 10:07:57 ntpd[27980]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-12T10:07:57.496 INFO:teuthology.orchestra.run.smithi078.stderr:12 Dec 10:07:57 ntpd[27980]: can't open /var/log/ntpstats/rawstats.20231212: Permission denied 2023-12-12T10:07:57.496 INFO:teuthology.orchestra.run.smithi078.stderr:12 Dec 10:07:57 ntpd[27980]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-12T10:07:57.496 INFO:teuthology.orchestra.run.smithi078.stderr:12 Dec 10:07:57 ntpd[27980]: can't open /var/log/ntpstats/rawstats.20231212: Permission denied 2023-12-12T10:07:57.496 INFO:teuthology.orchestra.run.smithi078.stderr:12 Dec 10:07:57 ntpd[27980]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-12T10:07:57.496 INFO:teuthology.orchestra.run.smithi078.stderr:12 Dec 10:07:57 ntpd[27980]: can't open /var/log/ntpstats/rawstats.20231212: Permission denied 2023-12-12T10:07:57.496 INFO:teuthology.orchestra.run.smithi078.stderr:12 Dec 10:07:57 ntpd[27980]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-12-12T10:07:57.496 INFO:teuthology.orchestra.run.smithi078.stderr:12 Dec 10:07:57 ntpd[27980]: can't open /var/log/ntpstats/rawstats.20231212: Permission denied 2023-12-12T10:07:57.496 INFO:teuthology.orchestra.run.smithi078.stderr:12 Dec 10:07:57 ntpd[27980]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-12-12T10:07:57.496 INFO:teuthology.orchestra.run.smithi078.stderr:12 Dec 10:07:57 ntpd[27980]: can't open /var/log/ntpstats/peerstats.20231212: Permission denied 2023-12-12T10:07:57.497 INFO:teuthology.orchestra.run.smithi078.stdout:12 Dec 10:07:57 ntpd[27980]: ntpd: time slew +0.000530 s 2023-12-12T10:07:57.497 INFO:teuthology.orchestra.run.smithi078.stdout:ntpd: time slew +0.000530s 2023-12-12T10:07:57.497 INFO:teuthology.orchestra.run.smithi078.stderr:12 Dec 10:07:57 ntpd[27980]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-12-12T10:07:57.497 INFO:teuthology.orchestra.run.smithi078.stderr:12 Dec 10:07:57 ntpd[27980]: can't open /var/log/ntpstats/loopstats.20231212: Permission denied 2023-12-12T10:07:57.590 INFO:teuthology.orchestra.run.smithi078.stdout: remote refid st t when poll reach delay offset jitter 2023-12-12T10:07:57.590 INFO:teuthology.orchestra.run.smithi078.stdout:============================================================================== 2023-12-12T10:07:57.590 INFO:teuthology.orchestra.run.smithi078.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-12-12T10:07:57.590 INFO:teuthology.orchestra.run.smithi078.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-12-12T10:07:57.590 INFO:teuthology.orchestra.run.smithi078.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-12-12T10:07:57.590 INFO:teuthology.orchestra.run.smithi078.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-12-12T10:07:57.591 INFO:teuthology.run_tasks:Running task install... 2023-12-12T10:07:57.600 DEBUG:teuthology.task.install:project ceph 2023-12-12T10:07:57.601 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'f1fbf3c583d03e19f5e58eb618e78d8e10d075f9'}} 2023-12-12T10:07:57.601 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'f1fbf3c583d03e19f5e58eb618e78d8e10d075f9'} 2023-12-12T10:07:57.601 INFO:teuthology.task.install:Using flavor: default 2023-12-12T10:07:57.607 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-12-12T10:07:57.607 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-12-12T10:07:57.607 DEBUG:teuthology.orchestra.run.smithi078:> sudo apt-key list | grep Ceph 2023-12-12T10:07:57.608 DEBUG:teuthology.orchestra.run.smithi187:> sudo apt-key list | grep Ceph 2023-12-12T10:07:57.716 INFO:teuthology.orchestra.run.smithi187.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2023-12-12T10:07:57.740 INFO:teuthology.orchestra.run.smithi078.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2023-12-12T10:07:57.769 INFO:teuthology.orchestra.run.smithi187.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-12-12T10:07:57.770 INFO:teuthology.orchestra.run.smithi187.stdout:uid [ unknown] Ceph.com (release key) 2023-12-12T10:07:57.770 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-12-12T10:07:57.771 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-12-12T10:07:57.771 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=f1fbf3c583d03e19f5e58eb618e78d8e10d075f9 2023-12-12T10:07:57.793 INFO:teuthology.orchestra.run.smithi078.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-12-12T10:07:57.793 INFO:teuthology.orchestra.run.smithi078.stdout:uid [ unknown] Ceph.com (release key) 2023-12-12T10:07:57.794 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-12-12T10:07:57.794 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-12-12T10:07:57.794 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=f1fbf3c583d03e19f5e58eb618e78d8e10d075f9 2023-12-12T10:07:57.943 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231205.064351/f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/ubuntu/jammy/flavors/default/ 2023-12-12T10:07:57.943 INFO:teuthology.task.install.deb:Package version is 19.0.0-96-gf1fbf3c5-1jammy 2023-12-12T10:07:58.012 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231205.064351/f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/ubuntu/jammy/flavors/default/ 2023-12-12T10:07:58.012 INFO:teuthology.task.install.deb:Package version is 19.0.0-96-gf1fbf3c5-1jammy 2023-12-12T10:07:58.062 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-12-12T10:07:58.062 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-12-12T10:07:58.083 DEBUG:teuthology.orchestra.run.smithi078:> sudo apt-get update 2023-12-12T10:07:58.122 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-12-12T10:07:58.122 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-12-12T10:07:58.142 DEBUG:teuthology.orchestra.run.smithi187:> sudo apt-get update 2023-12-12T10:07:58.394 INFO:teuthology.orchestra.run.smithi078.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-12-12T10:07:58.405 INFO:teuthology.orchestra.run.smithi078.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-12-12T10:07:58.408 INFO:teuthology.orchestra.run.smithi078.stdout:Ign:3 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231205.064351/f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/ubuntu/jammy/flavors/default jammy InRelease 2023-12-12T10:07:58.459 INFO:teuthology.orchestra.run.smithi078.stdout:Get:4 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231205.064351/f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/ubuntu/jammy/flavors/default jammy Release [6,978 B] 2023-12-12T10:07:58.463 INFO:teuthology.orchestra.run.smithi187.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-12-12T10:07:58.464 INFO:teuthology.orchestra.run.smithi078.stdout:Hit:5 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-12-12T10:07:58.490 INFO:teuthology.orchestra.run.smithi187.stdout:Ign:2 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231205.064351/f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/ubuntu/jammy/flavors/default jammy InRelease 2023-12-12T10:07:58.506 INFO:teuthology.orchestra.run.smithi078.stdout:Ign:6 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231205.064351/f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/ubuntu/jammy/flavors/default jammy Release.gpg 2023-12-12T10:07:58.533 INFO:teuthology.orchestra.run.smithi187.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-12-12T10:07:58.543 INFO:teuthology.orchestra.run.smithi187.stdout:Get:4 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231205.064351/f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/ubuntu/jammy/flavors/default jammy Release [6,978 B] 2023-12-12T10:07:58.546 INFO:teuthology.orchestra.run.smithi078.stdout:Hit:7 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-12-12T10:07:58.557 INFO:teuthology.orchestra.run.smithi078.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231205.064351/f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.4 kB] 2023-12-12T10:07:58.596 INFO:teuthology.orchestra.run.smithi187.stdout:Ign:5 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231205.064351/f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/ubuntu/jammy/flavors/default jammy Release.gpg 2023-12-12T10:07:58.615 INFO:teuthology.orchestra.run.smithi187.stdout:Hit:6 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-12-12T10:07:58.626 INFO:teuthology.orchestra.run.smithi078.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231205.064351/f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,405 B] 2023-12-12T10:07:58.657 INFO:teuthology.orchestra.run.smithi187.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231205.064351/f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,405 B] 2023-12-12T10:07:58.728 INFO:teuthology.orchestra.run.smithi187.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231205.064351/f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.4 kB] 2023-12-12T10:07:58.832 INFO:teuthology.orchestra.run.smithi187.stdout:Hit:9 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-12-12T10:07:59.000 INFO:teuthology.orchestra.run.smithi078.stdout:Fetched 27.8 kB in 1s (39.8 kB/s) 2023-12-12T10:07:59.069 INFO:teuthology.orchestra.run.smithi187.stdout:Fetched 27.8 kB in 1s (39.8 kB/s) 2023-12-12T10:07:59.921 INFO:teuthology.orchestra.run.smithi078.stdout:Reading package lists... 2023-12-12T10:07:59.935 DEBUG:teuthology.orchestra.run.smithi078:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-96-gf1fbf3c5-1jammy cephadm=19.0.0-96-gf1fbf3c5-1jammy ceph-mds=19.0.0-96-gf1fbf3c5-1jammy ceph-mgr=19.0.0-96-gf1fbf3c5-1jammy ceph-common=19.0.0-96-gf1fbf3c5-1jammy ceph-fuse=19.0.0-96-gf1fbf3c5-1jammy ceph-test=19.0.0-96-gf1fbf3c5-1jammy ceph-volume=19.0.0-96-gf1fbf3c5-1jammy radosgw=19.0.0-96-gf1fbf3c5-1jammy python3-rados=19.0.0-96-gf1fbf3c5-1jammy python3-rgw=19.0.0-96-gf1fbf3c5-1jammy python3-cephfs=19.0.0-96-gf1fbf3c5-1jammy python3-rbd=19.0.0-96-gf1fbf3c5-1jammy libcephfs2=19.0.0-96-gf1fbf3c5-1jammy libcephfs-dev=19.0.0-96-gf1fbf3c5-1jammy librados2=19.0.0-96-gf1fbf3c5-1jammy librbd1=19.0.0-96-gf1fbf3c5-1jammy rbd-fuse=19.0.0-96-gf1fbf3c5-1jammy python3-cephfs=19.0.0-96-gf1fbf3c5-1jammy cephfs-shell=19.0.0-96-gf1fbf3c5-1jammy cephfs-top=19.0.0-96-gf1fbf3c5-1jammy cephfs-mirror=19.0.0-96-gf1fbf3c5-1jammy 2023-12-12T10:07:59.999 INFO:teuthology.orchestra.run.smithi187.stdout:Reading package lists... 2023-12-12T10:08:00.013 INFO:teuthology.orchestra.run.smithi078.stdout:Reading package lists... 2023-12-12T10:08:00.016 DEBUG:teuthology.orchestra.run.smithi187:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-96-gf1fbf3c5-1jammy cephadm=19.0.0-96-gf1fbf3c5-1jammy ceph-mds=19.0.0-96-gf1fbf3c5-1jammy ceph-mgr=19.0.0-96-gf1fbf3c5-1jammy ceph-common=19.0.0-96-gf1fbf3c5-1jammy ceph-fuse=19.0.0-96-gf1fbf3c5-1jammy ceph-test=19.0.0-96-gf1fbf3c5-1jammy ceph-volume=19.0.0-96-gf1fbf3c5-1jammy radosgw=19.0.0-96-gf1fbf3c5-1jammy python3-rados=19.0.0-96-gf1fbf3c5-1jammy python3-rgw=19.0.0-96-gf1fbf3c5-1jammy python3-cephfs=19.0.0-96-gf1fbf3c5-1jammy python3-rbd=19.0.0-96-gf1fbf3c5-1jammy libcephfs2=19.0.0-96-gf1fbf3c5-1jammy libcephfs-dev=19.0.0-96-gf1fbf3c5-1jammy librados2=19.0.0-96-gf1fbf3c5-1jammy librbd1=19.0.0-96-gf1fbf3c5-1jammy rbd-fuse=19.0.0-96-gf1fbf3c5-1jammy python3-cephfs=19.0.0-96-gf1fbf3c5-1jammy cephfs-shell=19.0.0-96-gf1fbf3c5-1jammy cephfs-top=19.0.0-96-gf1fbf3c5-1jammy cephfs-mirror=19.0.0-96-gf1fbf3c5-1jammy 2023-12-12T10:08:00.091 INFO:teuthology.orchestra.run.smithi187.stdout:Reading package lists... 2023-12-12T10:08:00.178 INFO:teuthology.orchestra.run.smithi078.stdout:Building dependency tree... 2023-12-12T10:08:00.180 INFO:teuthology.orchestra.run.smithi078.stdout:Reading state information... 2023-12-12T10:08:00.259 INFO:teuthology.orchestra.run.smithi187.stdout:Building dependency tree... 2023-12-12T10:08:00.259 INFO:teuthology.orchestra.run.smithi187.stdout:Reading state information... 2023-12-12T10:08:00.331 INFO:teuthology.orchestra.run.smithi078.stdout:The following packages were automatically installed and are no longer required: 2023-12-12T10:08:00.331 INFO:teuthology.orchestra.run.smithi078.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-12-12T10:08:00.331 INFO:teuthology.orchestra.run.smithi078.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-12-12T10:08:00.331 INFO:teuthology.orchestra.run.smithi078.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-12-12T10:08:00.331 INFO:teuthology.orchestra.run.smithi078.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-12-12T10:08:00.332 INFO:teuthology.orchestra.run.smithi078.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-12-12T10:08:00.332 INFO:teuthology.orchestra.run.smithi078.stdout:Use 'sudo apt autoremove' to remove them. 2023-12-12T10:08:00.332 INFO:teuthology.orchestra.run.smithi078.stdout:The following additional packages will be installed: 2023-12-12T10:08:00.332 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-12-12T10:08:00.333 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2023-12-12T10:08:00.333 INFO:teuthology.orchestra.run.smithi078.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2023-12-12T10:08:00.333 INFO:teuthology.orchestra.run.smithi078.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2023-12-12T10:08:00.334 INFO:teuthology.orchestra.run.smithi078.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2023-12-12T10:08:00.334 INFO:teuthology.orchestra.run.smithi078.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2023-12-12T10:08:00.334 INFO:teuthology.orchestra.run.smithi078.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2023-12-12T10:08:00.334 INFO:teuthology.orchestra.run.smithi078.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2023-12-12T10:08:00.334 INFO:teuthology.orchestra.run.smithi078.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2023-12-12T10:08:00.334 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2023-12-12T10:08:00.335 INFO:teuthology.orchestra.run.smithi078.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2023-12-12T10:08:00.335 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2023-12-12T10:08:00.335 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2023-12-12T10:08:00.335 INFO:teuthology.orchestra.run.smithi078.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2023-12-12T10:08:00.335 INFO:teuthology.orchestra.run.smithi078.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-12-12T10:08:00.335 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2023-12-12T10:08:00.335 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2023-12-12T10:08:00.335 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2023-12-12T10:08:00.335 INFO:teuthology.orchestra.run.smithi078.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2023-12-12T10:08:00.335 INFO:teuthology.orchestra.run.smithi078.stdout: python3-simplejson python3-singledispatch python3-sklearn 2023-12-12T10:08:00.335 INFO:teuthology.orchestra.run.smithi078.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2023-12-12T10:08:00.335 INFO:teuthology.orchestra.run.smithi078.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2023-12-12T10:08:00.335 INFO:teuthology.orchestra.run.smithi078.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2023-12-12T10:08:00.335 INFO:teuthology.orchestra.run.smithi078.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2023-12-12T10:08:00.335 INFO:teuthology.orchestra.run.smithi078.stdout:Suggested packages: 2023-12-12T10:08:00.335 INFO:teuthology.orchestra.run.smithi078.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2023-12-12T10:08:00.336 INFO:teuthology.orchestra.run.smithi078.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2023-12-12T10:08:00.336 INFO:teuthology.orchestra.run.smithi078.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2023-12-12T10:08:00.336 INFO:teuthology.orchestra.run.smithi078.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2023-12-12T10:08:00.336 INFO:teuthology.orchestra.run.smithi078.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2023-12-12T10:08:00.336 INFO:teuthology.orchestra.run.smithi078.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2023-12-12T10:08:00.336 INFO:teuthology.orchestra.run.smithi078.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2023-12-12T10:08:00.336 INFO:teuthology.orchestra.run.smithi078.stdout:Recommended packages: 2023-12-12T10:08:00.336 INFO:teuthology.orchestra.run.smithi078.stdout: btrfs-tools 2023-12-12T10:08:00.412 INFO:teuthology.orchestra.run.smithi187.stdout:The following packages were automatically installed and are no longer required: 2023-12-12T10:08:00.412 INFO:teuthology.orchestra.run.smithi187.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-12-12T10:08:00.412 INFO:teuthology.orchestra.run.smithi187.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-12-12T10:08:00.412 INFO:teuthology.orchestra.run.smithi187.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-12-12T10:08:00.412 INFO:teuthology.orchestra.run.smithi187.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-12-12T10:08:00.413 INFO:teuthology.orchestra.run.smithi187.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-12-12T10:08:00.413 INFO:teuthology.orchestra.run.smithi187.stdout:Use 'sudo apt autoremove' to remove them. 2023-12-12T10:08:00.413 INFO:teuthology.orchestra.run.smithi187.stdout:The following additional packages will be installed: 2023-12-12T10:08:00.413 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-12-12T10:08:00.414 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2023-12-12T10:08:00.414 INFO:teuthology.orchestra.run.smithi187.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2023-12-12T10:08:00.414 INFO:teuthology.orchestra.run.smithi187.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2023-12-12T10:08:00.415 INFO:teuthology.orchestra.run.smithi187.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2023-12-12T10:08:00.415 INFO:teuthology.orchestra.run.smithi187.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2023-12-12T10:08:00.415 INFO:teuthology.orchestra.run.smithi187.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2023-12-12T10:08:00.415 INFO:teuthology.orchestra.run.smithi187.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2023-12-12T10:08:00.415 INFO:teuthology.orchestra.run.smithi187.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2023-12-12T10:08:00.415 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2023-12-12T10:08:00.415 INFO:teuthology.orchestra.run.smithi187.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2023-12-12T10:08:00.416 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2023-12-12T10:08:00.416 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2023-12-12T10:08:00.416 INFO:teuthology.orchestra.run.smithi187.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2023-12-12T10:08:00.416 INFO:teuthology.orchestra.run.smithi187.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-12-12T10:08:00.416 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2023-12-12T10:08:00.416 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2023-12-12T10:08:00.416 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2023-12-12T10:08:00.416 INFO:teuthology.orchestra.run.smithi187.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2023-12-12T10:08:00.416 INFO:teuthology.orchestra.run.smithi187.stdout: python3-simplejson python3-singledispatch python3-sklearn 2023-12-12T10:08:00.416 INFO:teuthology.orchestra.run.smithi187.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2023-12-12T10:08:00.416 INFO:teuthology.orchestra.run.smithi187.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2023-12-12T10:08:00.416 INFO:teuthology.orchestra.run.smithi187.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2023-12-12T10:08:00.416 INFO:teuthology.orchestra.run.smithi187.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2023-12-12T10:08:00.417 INFO:teuthology.orchestra.run.smithi187.stdout:Suggested packages: 2023-12-12T10:08:00.417 INFO:teuthology.orchestra.run.smithi187.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2023-12-12T10:08:00.417 INFO:teuthology.orchestra.run.smithi187.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2023-12-12T10:08:00.417 INFO:teuthology.orchestra.run.smithi187.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2023-12-12T10:08:00.417 INFO:teuthology.orchestra.run.smithi187.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2023-12-12T10:08:00.417 INFO:teuthology.orchestra.run.smithi187.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2023-12-12T10:08:00.417 INFO:teuthology.orchestra.run.smithi187.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2023-12-12T10:08:00.417 INFO:teuthology.orchestra.run.smithi187.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2023-12-12T10:08:00.417 INFO:teuthology.orchestra.run.smithi187.stdout:Recommended packages: 2023-12-12T10:08:00.417 INFO:teuthology.orchestra.run.smithi187.stdout: btrfs-tools 2023-12-12T10:08:00.482 INFO:teuthology.orchestra.run.smithi078.stdout:The following NEW packages will be installed: 2023-12-12T10:08:00.482 INFO:teuthology.orchestra.run.smithi078.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-12-12T10:08:00.482 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-12-12T10:08:00.483 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-12-12T10:08:00.483 INFO:teuthology.orchestra.run.smithi078.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2023-12-12T10:08:00.483 INFO:teuthology.orchestra.run.smithi078.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2023-12-12T10:08:00.483 INFO:teuthology.orchestra.run.smithi078.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2023-12-12T10:08:00.483 INFO:teuthology.orchestra.run.smithi078.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2023-12-12T10:08:00.484 INFO:teuthology.orchestra.run.smithi078.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2023-12-12T10:08:00.484 INFO:teuthology.orchestra.run.smithi078.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2023-12-12T10:08:00.484 INFO:teuthology.orchestra.run.smithi078.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2023-12-12T10:08:00.484 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2023-12-12T10:08:00.484 INFO:teuthology.orchestra.run.smithi078.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2023-12-12T10:08:00.485 INFO:teuthology.orchestra.run.smithi078.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2023-12-12T10:08:00.485 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2023-12-12T10:08:00.485 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2023-12-12T10:08:00.485 INFO:teuthology.orchestra.run.smithi078.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2023-12-12T10:08:00.485 INFO:teuthology.orchestra.run.smithi078.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2023-12-12T10:08:00.485 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2023-12-12T10:08:00.486 INFO:teuthology.orchestra.run.smithi078.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2023-12-12T10:08:00.486 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2023-12-12T10:08:00.486 INFO:teuthology.orchestra.run.smithi078.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2023-12-12T10:08:00.486 INFO:teuthology.orchestra.run.smithi078.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-12-12T10:08:00.486 INFO:teuthology.orchestra.run.smithi078.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2023-12-12T10:08:00.486 INFO:teuthology.orchestra.run.smithi078.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2023-12-12T10:08:00.486 INFO:teuthology.orchestra.run.smithi078.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2023-12-12T10:08:00.487 INFO:teuthology.orchestra.run.smithi078.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2023-12-12T10:08:00.487 INFO:teuthology.orchestra.run.smithi078.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2023-12-12T10:08:00.487 INFO:teuthology.orchestra.run.smithi078.stdout: socat unzip xmlstarlet zip 2023-12-12T10:08:00.565 INFO:teuthology.orchestra.run.smithi187.stdout:The following NEW packages will be installed: 2023-12-12T10:08:00.565 INFO:teuthology.orchestra.run.smithi187.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-12-12T10:08:00.565 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-12-12T10:08:00.565 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-12-12T10:08:00.565 INFO:teuthology.orchestra.run.smithi187.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2023-12-12T10:08:00.565 INFO:teuthology.orchestra.run.smithi187.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2023-12-12T10:08:00.565 INFO:teuthology.orchestra.run.smithi187.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2023-12-12T10:08:00.565 INFO:teuthology.orchestra.run.smithi187.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2023-12-12T10:08:00.565 INFO:teuthology.orchestra.run.smithi187.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2023-12-12T10:08:00.565 INFO:teuthology.orchestra.run.smithi187.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2023-12-12T10:08:00.565 INFO:teuthology.orchestra.run.smithi187.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2023-12-12T10:08:00.565 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2023-12-12T10:08:00.566 INFO:teuthology.orchestra.run.smithi187.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2023-12-12T10:08:00.566 INFO:teuthology.orchestra.run.smithi187.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2023-12-12T10:08:00.566 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2023-12-12T10:08:00.566 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2023-12-12T10:08:00.566 INFO:teuthology.orchestra.run.smithi187.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2023-12-12T10:08:00.566 INFO:teuthology.orchestra.run.smithi187.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2023-12-12T10:08:00.566 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2023-12-12T10:08:00.566 INFO:teuthology.orchestra.run.smithi187.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2023-12-12T10:08:00.566 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2023-12-12T10:08:00.566 INFO:teuthology.orchestra.run.smithi187.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2023-12-12T10:08:00.566 INFO:teuthology.orchestra.run.smithi187.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-12-12T10:08:00.566 INFO:teuthology.orchestra.run.smithi187.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2023-12-12T10:08:00.566 INFO:teuthology.orchestra.run.smithi187.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2023-12-12T10:08:00.566 INFO:teuthology.orchestra.run.smithi187.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2023-12-12T10:08:00.567 INFO:teuthology.orchestra.run.smithi187.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2023-12-12T10:08:00.567 INFO:teuthology.orchestra.run.smithi187.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2023-12-12T10:08:00.567 INFO:teuthology.orchestra.run.smithi187.stdout: socat unzip xmlstarlet zip 2023-12-12T10:08:00.615 INFO:teuthology.orchestra.run.smithi078.stdout:0 upgraded, 124 newly installed, 0 to remove and 266 not upgraded. 2023-12-12T10:08:00.615 INFO:teuthology.orchestra.run.smithi078.stdout:Need to get 187 MB of archives. 2023-12-12T10:08:00.616 INFO:teuthology.orchestra.run.smithi078.stdout:After this operation, 835 MB of additional disk space will be used. 2023-12-12T10:08:00.616 INFO:teuthology.orchestra.run.smithi078.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2023-12-12T10:08:00.633 INFO:teuthology.orchestra.run.smithi078.stdout:Get:2 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231205.064351/f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-96-gf1fbf3c5-1jammy [3,467 kB] 2023-12-12T10:08:00.662 INFO:teuthology.orchestra.run.smithi078.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2023-12-12T10:08:00.697 INFO:teuthology.orchestra.run.smithi078.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2023-12-12T10:08:00.761 INFO:teuthology.orchestra.run.smithi187.stdout:0 upgraded, 124 newly installed, 0 to remove and 266 not upgraded. 2023-12-12T10:08:00.761 INFO:teuthology.orchestra.run.smithi187.stdout:Need to get 187 MB of archives. 2023-12-12T10:08:00.761 INFO:teuthology.orchestra.run.smithi187.stdout:After this operation, 835 MB of additional disk space will be used. 2023-12-12T10:08:00.761 INFO:teuthology.orchestra.run.smithi187.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2023-12-12T10:08:00.821 INFO:teuthology.orchestra.run.smithi078.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2023-12-12T10:08:00.843 INFO:teuthology.orchestra.run.smithi187.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2023-12-12T10:08:00.852 INFO:teuthology.orchestra.run.smithi078.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231205.064351/f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-96-gf1fbf3c5-1jammy [3,109 kB] 2023-12-12T10:08:00.887 INFO:teuthology.orchestra.run.smithi078.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2023-12-12T10:08:00.888 INFO:teuthology.orchestra.run.smithi187.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2023-12-12T10:08:00.895 INFO:teuthology.orchestra.run.smithi078.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2023-12-12T10:08:00.936 INFO:teuthology.orchestra.run.smithi078.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2023-12-12T10:08:00.947 INFO:teuthology.orchestra.run.smithi078.stdout:Get:10 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231205.064351/f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-96-gf1fbf3c5-1jammy [688 kB] 2023-12-12T10:08:00.967 INFO:teuthology.orchestra.run.smithi187.stdout:Get:4 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231205.064351/f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-96-gf1fbf3c5-1jammy [3,467 kB] 2023-12-12T10:08:00.970 INFO:teuthology.orchestra.run.smithi078.stdout:Get:11 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231205.064351/f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-96-gf1fbf3c5-1jammy [356 kB] 2023-12-12T10:08:00.981 INFO:teuthology.orchestra.run.smithi078.stdout:Get:12 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231205.064351/f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-96-gf1fbf3c5-1jammy [32.8 kB] 2023-12-12T10:08:00.982 INFO:teuthology.orchestra.run.smithi078.stdout:Get:13 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231205.064351/f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-96-gf1fbf3c5-1jammy [180 kB] 2023-12-12T10:08:00.987 INFO:teuthology.orchestra.run.smithi078.stdout:Get:14 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231205.064351/f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-96-gf1fbf3c5-1jammy [63.5 kB] 2023-12-12T10:08:00.989 INFO:teuthology.orchestra.run.smithi078.stdout:Get:15 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231205.064351/f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-96-gf1fbf3c5-1jammy [330 kB] 2023-12-12T10:08:01.001 INFO:teuthology.orchestra.run.smithi078.stdout:Get:16 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231205.064351/f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-96-gf1fbf3c5-1jammy [6,210 kB] 2023-12-12T10:08:01.054 INFO:teuthology.orchestra.run.smithi078.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2023-12-12T10:08:01.065 INFO:teuthology.orchestra.run.smithi078.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2023-12-12T10:08:01.094 INFO:teuthology.orchestra.run.smithi187.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2023-12-12T10:08:01.183 INFO:teuthology.orchestra.run.smithi078.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2023-12-12T10:08:01.185 INFO:teuthology.orchestra.run.smithi078.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2023-12-12T10:08:01.186 INFO:teuthology.orchestra.run.smithi078.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2023-12-12T10:08:01.192 INFO:teuthology.orchestra.run.smithi078.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2023-12-12T10:08:01.193 INFO:teuthology.orchestra.run.smithi187.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2023-12-12T10:08:01.194 INFO:teuthology.orchestra.run.smithi078.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2023-12-12T10:08:01.196 INFO:teuthology.orchestra.run.smithi078.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2023-12-12T10:08:01.197 INFO:teuthology.orchestra.run.smithi078.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2023-12-12T10:08:01.198 INFO:teuthology.orchestra.run.smithi078.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2023-12-12T10:08:01.200 INFO:teuthology.orchestra.run.smithi078.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.1 [174 kB] 2023-12-12T10:08:01.206 INFO:teuthology.orchestra.run.smithi187.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2023-12-12T10:08:01.209 INFO:teuthology.orchestra.run.smithi078.stdout:Get:28 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231205.064351/f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-96-gf1fbf3c5-1jammy [112 kB] 2023-12-12T10:08:01.211 INFO:teuthology.orchestra.run.smithi078.stdout:Get:29 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231205.064351/f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-96-gf1fbf3c5-1jammy [439 kB] 2023-12-12T10:08:01.212 INFO:teuthology.orchestra.run.smithi078.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2023-12-12T10:08:01.226 INFO:teuthology.orchestra.run.smithi078.stdout:Get:31 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231205.064351/f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-96-gf1fbf3c5-1jammy [22.5 MB] 2023-12-12T10:08:01.229 INFO:teuthology.orchestra.run.smithi078.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2023-12-12T10:08:01.230 INFO:teuthology.orchestra.run.smithi078.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2023-12-12T10:08:01.231 INFO:teuthology.orchestra.run.smithi078.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2023-12-12T10:08:01.232 INFO:teuthology.orchestra.run.smithi078.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2023-12-12T10:08:01.232 INFO:teuthology.orchestra.run.smithi078.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2023-12-12T10:08:01.232 INFO:teuthology.orchestra.run.smithi078.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2023-12-12T10:08:01.233 INFO:teuthology.orchestra.run.smithi078.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2023-12-12T10:08:01.239 INFO:teuthology.orchestra.run.smithi078.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2023-12-12T10:08:01.239 INFO:teuthology.orchestra.run.smithi078.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2023-12-12T10:08:01.259 INFO:teuthology.orchestra.run.smithi187.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2023-12-12T10:08:01.265 INFO:teuthology.orchestra.run.smithi078.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2023-12-12T10:08:01.269 INFO:teuthology.orchestra.run.smithi078.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2023-12-12T10:08:01.272 INFO:teuthology.orchestra.run.smithi078.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2023-12-12T10:08:01.272 INFO:teuthology.orchestra.run.smithi078.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2023-12-12T10:08:01.272 INFO:teuthology.orchestra.run.smithi078.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2023-12-12T10:08:01.272 INFO:teuthology.orchestra.run.smithi078.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-12-12T10:08:01.273 INFO:teuthology.orchestra.run.smithi078.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2023-12-12T10:08:01.273 INFO:teuthology.orchestra.run.smithi078.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2023-12-12T10:08:01.293 INFO:teuthology.orchestra.run.smithi078.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2023-12-12T10:08:01.294 INFO:teuthology.orchestra.run.smithi078.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2023-12-12T10:08:01.320 INFO:teuthology.orchestra.run.smithi078.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2023-12-12T10:08:01.329 INFO:teuthology.orchestra.run.smithi078.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2023-12-12T10:08:01.330 INFO:teuthology.orchestra.run.smithi078.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2023-12-12T10:08:01.330 INFO:teuthology.orchestra.run.smithi078.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2023-12-12T10:08:01.331 INFO:teuthology.orchestra.run.smithi078.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2023-12-12T10:08:01.332 INFO:teuthology.orchestra.run.smithi078.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2023-12-12T10:08:01.334 INFO:teuthology.orchestra.run.smithi078.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2023-12-12T10:08:01.335 INFO:teuthology.orchestra.run.smithi078.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2023-12-12T10:08:01.351 INFO:teuthology.orchestra.run.smithi078.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2023-12-12T10:08:01.351 INFO:teuthology.orchestra.run.smithi078.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2023-12-12T10:08:01.377 INFO:teuthology.orchestra.run.smithi078.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2023-12-12T10:08:01.378 INFO:teuthology.orchestra.run.smithi078.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2023-12-12T10:08:01.378 INFO:teuthology.orchestra.run.smithi078.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2023-12-12T10:08:01.381 INFO:teuthology.orchestra.run.smithi078.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2023-12-12T10:08:01.433 INFO:teuthology.orchestra.run.smithi187.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2023-12-12T10:08:01.443 INFO:teuthology.orchestra.run.smithi187.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2023-12-12T10:08:01.470 INFO:teuthology.orchestra.run.smithi187.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2023-12-12T10:08:01.474 INFO:teuthology.orchestra.run.smithi078.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2023-12-12T10:08:01.475 INFO:teuthology.orchestra.run.smithi078.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2023-12-12T10:08:01.477 INFO:teuthology.orchestra.run.smithi078.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-12-12T10:08:01.478 INFO:teuthology.orchestra.run.smithi078.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2023-12-12T10:08:01.478 INFO:teuthology.orchestra.run.smithi187.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2023-12-12T10:08:01.479 INFO:teuthology.orchestra.run.smithi078.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2023-12-12T10:08:01.513 INFO:teuthology.orchestra.run.smithi078.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2023-12-12T10:08:01.515 INFO:teuthology.orchestra.run.smithi078.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2023-12-12T10:08:01.516 INFO:teuthology.orchestra.run.smithi078.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2023-12-12T10:08:01.542 INFO:teuthology.orchestra.run.smithi078.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2023-12-12T10:08:01.543 INFO:teuthology.orchestra.run.smithi078.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2023-12-12T10:08:01.543 INFO:teuthology.orchestra.run.smithi078.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2023-12-12T10:08:01.544 INFO:teuthology.orchestra.run.smithi078.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2023-12-12T10:08:01.564 INFO:teuthology.orchestra.run.smithi078.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2023-12-12T10:08:01.564 INFO:teuthology.orchestra.run.smithi078.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2023-12-12T10:08:01.565 INFO:teuthology.orchestra.run.smithi078.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2023-12-12T10:08:01.566 INFO:teuthology.orchestra.run.smithi078.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2023-12-12T10:08:01.569 INFO:teuthology.orchestra.run.smithi078.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2023-12-12T10:08:01.593 INFO:teuthology.orchestra.run.smithi078.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2023-12-12T10:08:01.595 INFO:teuthology.orchestra.run.smithi078.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2023-12-12T10:08:01.597 INFO:teuthology.orchestra.run.smithi078.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2023-12-12T10:08:01.600 INFO:teuthology.orchestra.run.smithi078.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2023-12-12T10:08:01.604 INFO:teuthology.orchestra.run.smithi078.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2023-12-12T10:08:01.626 INFO:teuthology.orchestra.run.smithi078.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2023-12-12T10:08:01.627 INFO:teuthology.orchestra.run.smithi078.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2023-12-12T10:08:01.627 INFO:teuthology.orchestra.run.smithi078.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2023-12-12T10:08:01.633 INFO:teuthology.orchestra.run.smithi078.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2023-12-12T10:08:01.633 INFO:teuthology.orchestra.run.smithi078.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2023-12-12T10:08:01.643 INFO:teuthology.orchestra.run.smithi187.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2023-12-12T10:08:01.658 INFO:teuthology.orchestra.run.smithi078.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2023-12-12T10:08:01.658 INFO:teuthology.orchestra.run.smithi078.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-12-12T10:08:01.659 INFO:teuthology.orchestra.run.smithi078.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2023-12-12T10:08:01.659 INFO:teuthology.orchestra.run.smithi078.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2023-12-12T10:08:01.661 INFO:teuthology.orchestra.run.smithi078.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2023-12-12T10:08:01.688 INFO:teuthology.orchestra.run.smithi078.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2023-12-12T10:08:01.699 INFO:teuthology.orchestra.run.smithi078.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2023-12-12T10:08:01.699 INFO:teuthology.orchestra.run.smithi078.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2023-12-12T10:08:01.700 INFO:teuthology.orchestra.run.smithi078.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2023-12-12T10:08:01.702 INFO:teuthology.orchestra.run.smithi078.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2023-12-12T10:08:01.726 INFO:teuthology.orchestra.run.smithi078.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2023-12-12T10:08:02.058 INFO:teuthology.orchestra.run.smithi078.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231205.064351/f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-96-gf1fbf3c5-1jammy [6,900 kB] 2023-12-12T10:08:02.208 INFO:teuthology.orchestra.run.smithi078.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231205.064351/f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-96-gf1fbf3c5-1jammy [238 kB] 2023-12-12T10:08:02.213 INFO:teuthology.orchestra.run.smithi078.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231205.064351/f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-96-gf1fbf3c5-1jammy [124 kB] 2023-12-12T10:08:02.217 INFO:teuthology.orchestra.run.smithi078.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231205.064351/f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-96-gf1fbf3c5-1jammy [1,494 kB] 2023-12-12T10:08:02.230 INFO:teuthology.orchestra.run.smithi187.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2023-12-12T10:08:02.245 INFO:teuthology.orchestra.run.smithi187.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2023-12-12T10:08:02.261 INFO:teuthology.orchestra.run.smithi187.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2023-12-12T10:08:02.267 INFO:teuthology.orchestra.run.smithi078.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231205.064351/f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-96-gf1fbf3c5-1jammy [9,956 kB] 2023-12-12T10:08:02.269 INFO:teuthology.orchestra.run.smithi187.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2023-12-12T10:08:02.269 INFO:teuthology.orchestra.run.smithi187.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2023-12-12T10:08:02.286 INFO:teuthology.orchestra.run.smithi187.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.1 [174 kB] 2023-12-12T10:08:02.324 INFO:teuthology.orchestra.run.smithi187.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2023-12-12T10:08:02.338 INFO:teuthology.orchestra.run.smithi187.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2023-12-12T10:08:02.341 INFO:teuthology.orchestra.run.smithi187.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2023-12-12T10:08:02.342 INFO:teuthology.orchestra.run.smithi187.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2023-12-12T10:08:02.512 INFO:teuthology.orchestra.run.smithi187.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2023-12-12T10:08:02.595 INFO:teuthology.orchestra.run.smithi187.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2023-12-12T10:08:02.603 INFO:teuthology.orchestra.run.smithi078.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231205.064351/f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-96-gf1fbf3c5-1jammy [31.8 MB] 2023-12-12T10:08:02.618 INFO:teuthology.orchestra.run.smithi187.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2023-12-12T10:08:02.676 INFO:teuthology.orchestra.run.smithi187.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2023-12-12T10:08:02.724 INFO:teuthology.orchestra.run.smithi187.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2023-12-12T10:08:02.746 INFO:teuthology.orchestra.run.smithi187.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2023-12-12T10:08:02.768 INFO:teuthology.orchestra.run.smithi187.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2023-12-12T10:08:02.941 INFO:teuthology.orchestra.run.smithi187.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2023-12-12T10:08:02.957 INFO:teuthology.orchestra.run.smithi187.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2023-12-12T10:08:02.964 INFO:teuthology.orchestra.run.smithi187.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2023-12-12T10:08:02.969 INFO:teuthology.orchestra.run.smithi187.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2023-12-12T10:08:03.154 INFO:teuthology.orchestra.run.smithi187.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-12-12T10:08:03.237 INFO:teuthology.orchestra.run.smithi187.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2023-12-12T10:08:03.251 INFO:teuthology.orchestra.run.smithi187.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2023-12-12T10:08:03.437 INFO:teuthology.orchestra.run.smithi187.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2023-12-12T10:08:03.488 INFO:teuthology.orchestra.run.smithi187.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2023-12-12T10:08:03.501 INFO:teuthology.orchestra.run.smithi187.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2023-12-12T10:08:03.660 INFO:teuthology.orchestra.run.smithi187.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2023-12-12T10:08:03.661 INFO:teuthology.orchestra.run.smithi187.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2023-12-12T10:08:03.665 INFO:teuthology.orchestra.run.smithi187.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2023-12-12T10:08:03.670 INFO:teuthology.orchestra.run.smithi187.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2023-12-12T10:08:03.673 INFO:teuthology.orchestra.run.smithi078.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231205.064351/f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-96-gf1fbf3c5-1jammy [14.0 kB] 2023-12-12T10:08:03.673 INFO:teuthology.orchestra.run.smithi078.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231205.064351/f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-96-gf1fbf3c5-1jammy [839 kB] 2023-12-12T10:08:03.685 INFO:teuthology.orchestra.run.smithi187.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2023-12-12T10:08:03.690 INFO:teuthology.orchestra.run.smithi078.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231205.064351/f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-96-gf1fbf3c5-1jammy [2,143 kB] 2023-12-12T10:08:03.763 INFO:teuthology.orchestra.run.smithi078.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231205.064351/f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-96-gf1fbf3c5-1jammy [827 kB] 2023-12-12T10:08:03.789 INFO:teuthology.orchestra.run.smithi078.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231205.064351/f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-96-gf1fbf3c5-1jammy [139 kB] 2023-12-12T10:08:03.794 INFO:teuthology.orchestra.run.smithi078.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231205.064351/f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-96-gf1fbf3c5-1jammy [1,904 kB] 2023-12-12T10:08:03.859 INFO:teuthology.orchestra.run.smithi078.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231205.064351/f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-96-gf1fbf3c5-1jammy [8,625 kB] 2023-12-12T10:08:03.871 INFO:teuthology.orchestra.run.smithi187.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2023-12-12T10:08:04.135 INFO:teuthology.orchestra.run.smithi187.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2023-12-12T10:08:04.150 INFO:teuthology.orchestra.run.smithi078.stdout:Get:116 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231205.064351/f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-96-gf1fbf3c5-1jammy [14.2 kB] 2023-12-12T10:08:04.150 INFO:teuthology.orchestra.run.smithi078.stdout:Get:117 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231205.064351/f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-96-gf1fbf3c5-1jammy [48.7 MB] 2023-12-12T10:08:04.265 INFO:teuthology.orchestra.run.smithi187.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2023-12-12T10:08:04.306 INFO:teuthology.orchestra.run.smithi187.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2023-12-12T10:08:04.394 INFO:teuthology.orchestra.run.smithi187.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2023-12-12T10:08:04.404 INFO:teuthology.orchestra.run.smithi187.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2023-12-12T10:08:04.416 INFO:teuthology.orchestra.run.smithi187.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2023-12-12T10:08:04.458 INFO:teuthology.orchestra.run.smithi187.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2023-12-12T10:08:04.724 INFO:teuthology.orchestra.run.smithi187.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2023-12-12T10:08:04.725 INFO:teuthology.orchestra.run.smithi187.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2023-12-12T10:08:04.727 INFO:teuthology.orchestra.run.smithi187.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-12-12T10:08:04.892 INFO:teuthology.orchestra.run.smithi187.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2023-12-12T10:08:05.237 INFO:teuthology.orchestra.run.smithi187.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2023-12-12T10:08:05.646 INFO:teuthology.orchestra.run.smithi187.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2023-12-12T10:08:05.656 INFO:teuthology.orchestra.run.smithi187.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2023-12-12T10:08:05.656 INFO:teuthology.orchestra.run.smithi187.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2023-12-12T10:08:05.732 INFO:teuthology.orchestra.run.smithi187.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2023-12-12T10:08:05.732 INFO:teuthology.orchestra.run.smithi187.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2023-12-12T10:08:05.733 INFO:teuthology.orchestra.run.smithi187.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2023-12-12T10:08:05.734 INFO:teuthology.orchestra.run.smithi187.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2023-12-12T10:08:05.735 INFO:teuthology.orchestra.run.smithi187.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2023-12-12T10:08:05.736 INFO:teuthology.orchestra.run.smithi187.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2023-12-12T10:08:05.794 INFO:teuthology.orchestra.run.smithi078.stdout:Get:118 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231205.064351/f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-96-gf1fbf3c5-1jammy [121 kB] 2023-12-12T10:08:05.796 INFO:teuthology.orchestra.run.smithi078.stdout:Get:119 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231205.064351/f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-96-gf1fbf3c5-1jammy [225 kB] 2023-12-12T10:08:05.798 INFO:teuthology.orchestra.run.smithi078.stdout:Get:120 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231205.064351/f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-96-gf1fbf3c5-1jammy [34.0 kB] 2023-12-12T10:08:05.798 INFO:teuthology.orchestra.run.smithi078.stdout:Get:121 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231205.064351/f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-96-gf1fbf3c5-1jammy [23.4 kB] 2023-12-12T10:08:05.799 INFO:teuthology.orchestra.run.smithi078.stdout:Get:122 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231205.064351/f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-96-gf1fbf3c5-1jammy [38.3 kB] 2023-12-12T10:08:05.799 INFO:teuthology.orchestra.run.smithi078.stdout:Get:123 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231205.064351/f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-96-gf1fbf3c5-1jammy [12.3 MB] 2023-12-12T10:08:05.900 INFO:teuthology.orchestra.run.smithi187.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2023-12-12T10:08:06.114 INFO:teuthology.orchestra.run.smithi187.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2023-12-12T10:08:06.208 INFO:teuthology.orchestra.run.smithi078.stdout:Get:124 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231205.064351/f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-96-gf1fbf3c5-1jammy [91.3 kB] 2023-12-12T10:08:06.444 INFO:teuthology.orchestra.run.smithi187.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2023-12-12T10:08:06.491 INFO:teuthology.orchestra.run.smithi187.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2023-12-12T10:08:06.517 INFO:teuthology.orchestra.run.smithi187.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2023-12-12T10:08:06.517 INFO:teuthology.orchestra.run.smithi187.stdout:Get:73 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231205.064351/f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-96-gf1fbf3c5-1jammy [3,109 kB] 2023-12-12T10:08:06.526 INFO:teuthology.orchestra.run.smithi187.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2023-12-12T10:08:06.571 INFO:teuthology.orchestra.run.smithi187.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2023-12-12T10:08:06.597 INFO:teuthology.orchestra.run.smithi187.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2023-12-12T10:08:06.599 INFO:teuthology.orchestra.run.smithi187.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2023-12-12T10:08:06.606 INFO:teuthology.orchestra.run.smithi187.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2023-12-12T10:08:06.609 INFO:teuthology.orchestra.run.smithi187.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2023-12-12T10:08:06.805 INFO:teuthology.orchestra.run.smithi187.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2023-12-12T10:08:06.836 INFO:teuthology.orchestra.run.smithi078.stdout:Fetched 187 MB in 6s (32.7 MB/s) 2023-12-12T10:08:06.980 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-pyperclip. 2023-12-12T10:08:07.049 INFO:teuthology.orchestra.run.smithi078.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132930 files and directories currently installed.) 2023-12-12T10:08:07.052 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2023-12-12T10:08:07.065 INFO:teuthology.orchestra.run.smithi187.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2023-12-12T10:08:07.095 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2023-12-12T10:08:07.335 INFO:teuthology.orchestra.run.smithi187.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2023-12-12T10:08:07.337 INFO:teuthology.orchestra.run.smithi187.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-12-12T10:08:07.354 INFO:teuthology.orchestra.run.smithi187.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2023-12-12T10:08:07.359 INFO:teuthology.orchestra.run.smithi187.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2023-12-12T10:08:07.398 INFO:teuthology.orchestra.run.smithi187.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2023-12-12T10:08:07.406 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-wcwidth. 2023-12-12T10:08:07.413 INFO:teuthology.orchestra.run.smithi187.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2023-12-12T10:08:07.420 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2023-12-12T10:08:07.465 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2023-12-12T10:08:07.503 INFO:teuthology.orchestra.run.smithi187.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2023-12-12T10:08:07.505 INFO:teuthology.orchestra.run.smithi187.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2023-12-12T10:08:07.506 INFO:teuthology.orchestra.run.smithi187.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2023-12-12T10:08:07.687 INFO:teuthology.orchestra.run.smithi187.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2023-12-12T10:08:07.784 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-cmd2. 2023-12-12T10:08:07.797 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2023-12-12T10:08:07.834 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2023-12-12T10:08:07.960 INFO:teuthology.orchestra.run.smithi187.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2023-12-12T10:08:08.137 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2023-12-12T10:08:08.150 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2023-12-12T10:08:08.253 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-12-12T10:08:08.369 INFO:teuthology.orchestra.run.smithi187.stdout:Get:93 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231205.064351/f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-96-gf1fbf3c5-1jammy [688 kB] 2023-12-12T10:08:08.624 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-12-12T10:08:08.638 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2023-12-12T10:08:08.684 INFO:teuthology.orchestra.run.smithi187.stdout:Get:94 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231205.064351/f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-96-gf1fbf3c5-1jammy [356 kB] 2023-12-12T10:08:08.724 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2023-12-12T10:08:08.813 INFO:teuthology.orchestra.run.smithi187.stdout:Get:95 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231205.064351/f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-96-gf1fbf3c5-1jammy [32.8 kB] 2023-12-12T10:08:08.849 INFO:teuthology.orchestra.run.smithi187.stdout:Get:96 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231205.064351/f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-96-gf1fbf3c5-1jammy [180 kB] 2023-12-12T10:08:08.898 INFO:teuthology.orchestra.run.smithi187.stdout:Get:97 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231205.064351/f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-96-gf1fbf3c5-1jammy [63.5 kB] 2023-12-12T10:08:08.950 INFO:teuthology.orchestra.run.smithi187.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231205.064351/f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-96-gf1fbf3c5-1jammy [330 kB] 2023-12-12T10:08:09.084 INFO:teuthology.orchestra.run.smithi187.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231205.064351/f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-96-gf1fbf3c5-1jammy [6,210 kB] 2023-12-12T10:08:09.126 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-12-12T10:08:09.141 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2023-12-12T10:08:09.210 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-12-12T10:08:09.780 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-12-12T10:08:09.795 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-12-12T10:08:09.855 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-12-12T10:08:10.283 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-12-12T10:08:10.298 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-12-12T10:08:10.349 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-12-12T10:08:10.769 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-12-12T10:08:10.784 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-12-12T10:08:10.836 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-12-12T10:08:11.280 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2023-12-12T10:08:11.295 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2023-12-12T10:08:11.347 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-12-12T10:08:11.488 INFO:teuthology.orchestra.run.smithi187.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231205.064351/f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-96-gf1fbf3c5-1jammy [112 kB] 2023-12-12T10:08:11.529 INFO:teuthology.orchestra.run.smithi187.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231205.064351/f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-96-gf1fbf3c5-1jammy [439 kB] 2023-12-12T10:08:11.698 INFO:teuthology.orchestra.run.smithi187.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231205.064351/f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-96-gf1fbf3c5-1jammy [22.5 MB] 2023-12-12T10:08:11.708 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package librados2. 2023-12-12T10:08:11.723 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../010-librados2_19.0.0-96-gf1fbf3c5-1jammy_amd64.deb ... 2023-12-12T10:08:11.767 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking librados2 (19.0.0-96-gf1fbf3c5-1jammy) ... 2023-12-12T10:08:12.269 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package librbd1. 2023-12-12T10:08:12.284 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../011-librbd1_19.0.0-96-gf1fbf3c5-1jammy_amd64.deb ... 2023-12-12T10:08:12.335 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking librbd1 (19.0.0-96-gf1fbf3c5-1jammy) ... 2023-12-12T10:08:12.822 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libcephfs2. 2023-12-12T10:08:12.836 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-96-gf1fbf3c5-1jammy_amd64.deb ... 2023-12-12T10:08:12.888 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libcephfs2 (19.0.0-96-gf1fbf3c5-1jammy) ... 2023-12-12T10:08:13.249 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-rados. 2023-12-12T10:08:13.264 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../013-python3-rados_19.0.0-96-gf1fbf3c5-1jammy_amd64.deb ... 2023-12-12T10:08:13.316 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-rados (19.0.0-96-gf1fbf3c5-1jammy) ... 2023-12-12T10:08:13.668 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-12-12T10:08:13.683 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-96-gf1fbf3c5-1jammy_all.deb ... 2023-12-12T10:08:13.726 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-ceph-argparse (19.0.0-96-gf1fbf3c5-1jammy) ... 2023-12-12T10:08:14.054 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-cephfs. 2023-12-12T10:08:14.069 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-96-gf1fbf3c5-1jammy_amd64.deb ... 2023-12-12T10:08:14.121 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-cephfs (19.0.0-96-gf1fbf3c5-1jammy) ... 2023-12-12T10:08:14.498 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-ceph-common. 2023-12-12T10:08:14.513 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-96-gf1fbf3c5-1jammy_all.deb ... 2023-12-12T10:08:14.565 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-ceph-common (19.0.0-96-gf1fbf3c5-1jammy) ... 2023-12-12T10:08:14.984 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-prettytable. 2023-12-12T10:08:14.998 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2023-12-12T10:08:15.051 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2023-12-12T10:08:15.337 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-rbd. 2023-12-12T10:08:15.351 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-96-gf1fbf3c5-1jammy_amd64.deb ... 2023-12-12T10:08:15.395 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-rbd (19.0.0-96-gf1fbf3c5-1jammy) ... 2023-12-12T10:08:16.015 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-12-12T10:08:16.030 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2023-12-12T10:08:16.090 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2023-12-12T10:08:16.426 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libreadline-dev:amd64. 2023-12-12T10:08:16.441 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2023-12-12T10:08:16.493 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2023-12-12T10:08:16.837 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2023-12-12T10:08:16.852 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2023-12-12T10:08:16.913 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2023-12-12T10:08:17.257 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package lua5.1. 2023-12-12T10:08:17.272 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2023-12-12T10:08:17.315 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2023-12-12T10:08:17.701 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package lua-any. 2023-12-12T10:08:17.716 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2023-12-12T10:08:17.768 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking lua-any (27ubuntu1) ... 2023-12-12T10:08:18.070 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package zip. 2023-12-12T10:08:18.084 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2023-12-12T10:08:18.129 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking zip (3.0-12build2) ... 2023-12-12T10:08:18.465 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package unzip. 2023-12-12T10:08:18.480 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.1_amd64.deb ... 2023-12-12T10:08:18.532 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking unzip (6.0-26ubuntu3.1) ... 2023-12-12T10:08:18.718 INFO:teuthology.orchestra.run.smithi187.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231205.064351/f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-96-gf1fbf3c5-1jammy [6,900 kB] 2023-12-12T10:08:19.018 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package luarocks. 2023-12-12T10:08:19.033 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2023-12-12T10:08:19.085 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2023-12-12T10:08:19.509 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package librgw2. 2023-12-12T10:08:19.523 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../027-librgw2_19.0.0-96-gf1fbf3c5-1jammy_amd64.deb ... 2023-12-12T10:08:19.568 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking librgw2 (19.0.0-96-gf1fbf3c5-1jammy) ... 2023-12-12T10:08:20.117 INFO:teuthology.orchestra.run.smithi187.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231205.064351/f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-96-gf1fbf3c5-1jammy [238 kB] 2023-12-12T10:08:20.145 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-rgw. 2023-12-12T10:08:20.158 INFO:teuthology.orchestra.run.smithi187.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231205.064351/f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-96-gf1fbf3c5-1jammy [124 kB] 2023-12-12T10:08:20.159 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../028-python3-rgw_19.0.0-96-gf1fbf3c5-1jammy_amd64.deb ... 2023-12-12T10:08:20.171 INFO:teuthology.orchestra.run.smithi187.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231205.064351/f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-96-gf1fbf3c5-1jammy [1,494 kB] 2023-12-12T10:08:20.203 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-rgw (19.0.0-96-gf1fbf3c5-1jammy) ... 2023-12-12T10:08:20.418 INFO:teuthology.orchestra.run.smithi187.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231205.064351/f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-96-gf1fbf3c5-1jammy [9,956 kB] 2023-12-12T10:08:20.564 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package liboath0:amd64. 2023-12-12T10:08:20.578 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2023-12-12T10:08:20.623 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2023-12-12T10:08:21.259 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libradosstriper1. 2023-12-12T10:08:21.273 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../030-libradosstriper1_19.0.0-96-gf1fbf3c5-1jammy_amd64.deb ... 2023-12-12T10:08:21.317 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libradosstriper1 (19.0.0-96-gf1fbf3c5-1jammy) ... 2023-12-12T10:08:21.770 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-common. 2023-12-12T10:08:21.785 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../031-ceph-common_19.0.0-96-gf1fbf3c5-1jammy_amd64.deb ... 2023-12-12T10:08:21.829 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-common (19.0.0-96-gf1fbf3c5-1jammy) ... 2023-12-12T10:08:22.198 INFO:teuthology.orchestra.run.smithi187.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231205.064351/f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-96-gf1fbf3c5-1jammy [31.8 MB] 2023-12-12T10:08:22.869 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-base. 2023-12-12T10:08:22.884 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../032-ceph-base_19.0.0-96-gf1fbf3c5-1jammy_amd64.deb ... 2023-12-12T10:08:22.972 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-base (19.0.0-96-gf1fbf3c5-1jammy) ... 2023-12-12T10:08:23.715 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-jaraco.functools. 2023-12-12T10:08:23.729 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2023-12-12T10:08:23.774 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2023-12-12T10:08:24.093 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-cheroot. 2023-12-12T10:08:24.107 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2023-12-12T10:08:24.151 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-12-12T10:08:24.504 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-jaraco.classes. 2023-12-12T10:08:24.518 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2023-12-12T10:08:24.563 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2023-12-12T10:08:24.891 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-jaraco.text. 2023-12-12T10:08:24.904 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2023-12-12T10:08:24.949 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2023-12-12T10:08:25.219 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-jaraco.collections. 2023-12-12T10:08:25.232 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2023-12-12T10:08:25.277 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2023-12-12T10:08:25.597 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-tempora. 2023-12-12T10:08:25.611 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2023-12-12T10:08:25.655 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-tempora (4.1.2-1) ... 2023-12-12T10:08:25.991 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-portend. 2023-12-12T10:08:26.006 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2023-12-12T10:08:26.050 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-portend (3.0.0-1) ... 2023-12-12T10:08:26.378 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-zc.lockfile. 2023-12-12T10:08:26.393 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2023-12-12T10:08:26.428 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2023-12-12T10:08:26.706 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-cherrypy3. 2023-12-12T10:08:26.721 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2023-12-12T10:08:26.782 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2023-12-12T10:08:27.135 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-natsort. 2023-12-12T10:08:27.149 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2023-12-12T10:08:27.193 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-natsort (8.0.2-1) ... 2023-12-12T10:08:27.546 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-logutils. 2023-12-12T10:08:27.561 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2023-12-12T10:08:27.604 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-logutils (0.3.3-8) ... 2023-12-12T10:08:27.747 INFO:teuthology.orchestra.run.smithi187.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231205.064351/f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-96-gf1fbf3c5-1jammy [14.0 kB] 2023-12-12T10:08:27.747 INFO:teuthology.orchestra.run.smithi187.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231205.064351/f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-96-gf1fbf3c5-1jammy [839 kB] 2023-12-12T10:08:27.857 INFO:teuthology.orchestra.run.smithi187.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231205.064351/f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-96-gf1fbf3c5-1jammy [2,143 kB] 2023-12-12T10:08:27.891 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-markupsafe. 2023-12-12T10:08:27.905 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2023-12-12T10:08:27.940 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2023-12-12T10:08:28.185 INFO:teuthology.orchestra.run.smithi187.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231205.064351/f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-96-gf1fbf3c5-1jammy [827 kB] 2023-12-12T10:08:28.277 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-mako. 2023-12-12T10:08:28.292 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2023-12-12T10:08:28.318 INFO:teuthology.orchestra.run.smithi187.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231205.064351/f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-96-gf1fbf3c5-1jammy [139 kB] 2023-12-12T10:08:28.327 INFO:teuthology.orchestra.run.smithi187.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231205.064351/f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-96-gf1fbf3c5-1jammy [1,904 kB] 2023-12-12T10:08:28.343 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-12-12T10:08:28.638 INFO:teuthology.orchestra.run.smithi187.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231205.064351/f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-96-gf1fbf3c5-1jammy [8,625 kB] 2023-12-12T10:08:28.672 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-simplegeneric. 2023-12-12T10:08:28.687 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2023-12-12T10:08:28.747 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-12-12T10:08:29.026 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-singledispatch. 2023-12-12T10:08:29.040 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2023-12-12T10:08:29.075 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2023-12-12T10:08:29.403 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-webob. 2023-12-12T10:08:29.418 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2023-12-12T10:08:29.461 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2023-12-12T10:08:29.848 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-waitress. 2023-12-12T10:08:29.862 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2023-12-12T10:08:29.909 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2023-12-12T10:08:30.130 INFO:teuthology.orchestra.run.smithi187.stdout:Get:116 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231205.064351/f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-96-gf1fbf3c5-1jammy [14.2 kB] 2023-12-12T10:08:30.130 INFO:teuthology.orchestra.run.smithi187.stdout:Get:117 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231205.064351/f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-96-gf1fbf3c5-1jammy [48.7 MB] 2023-12-12T10:08:30.226 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-tempita. 2023-12-12T10:08:30.240 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2023-12-12T10:08:30.284 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2023-12-12T10:08:30.579 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-paste. 2023-12-12T10:08:30.594 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2023-12-12T10:08:30.654 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2023-12-12T10:08:30.957 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-12-12T10:08:30.971 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2023-12-12T10:08:31.015 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2023-12-12T10:08:31.352 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-pastedeploy. 2023-12-12T10:08:31.366 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2023-12-12T10:08:31.410 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2023-12-12T10:08:31.713 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-webtest. 2023-12-12T10:08:31.727 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2023-12-12T10:08:31.765 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-webtest (2.0.35-1) ... 2023-12-12T10:08:32.041 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-pecan. 2023-12-12T10:08:32.056 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2023-12-12T10:08:32.107 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2023-12-12T10:08:32.429 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-certifi. 2023-12-12T10:08:32.444 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2023-12-12T10:08:32.479 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2023-12-12T10:08:32.807 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-idna. 2023-12-12T10:08:32.821 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2023-12-12T10:08:32.882 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-idna (3.3-1) ... 2023-12-12T10:08:33.235 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-urllib3. 2023-12-12T10:08:33.250 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2023-12-12T10:08:33.294 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2023-12-12T10:08:34.322 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-requests. 2023-12-12T10:08:34.337 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2023-12-12T10:08:34.380 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-12-12T10:08:34.717 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-werkzeug. 2023-12-12T10:08:34.731 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2023-12-12T10:08:34.775 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-12-12T10:08:35.079 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-12-12T10:08:35.093 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.0.0-96-gf1fbf3c5-1jammy_all.deb ... 2023-12-12T10:08:35.128 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-mgr-modules-core (19.0.0-96-gf1fbf3c5-1jammy) ... 2023-12-12T10:08:35.533 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-12-12T10:08:35.547 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.0.0-96-gf1fbf3c5-1jammy_amd64.deb ... 2023-12-12T10:08:35.591 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-96-gf1fbf3c5-1jammy) ... 2023-12-12T10:08:35.944 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-bcrypt. 2023-12-12T10:08:35.959 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2023-12-12T10:08:36.002 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2023-12-12T10:08:36.556 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-openssl. 2023-12-12T10:08:36.571 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2023-12-12T10:08:36.639 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-openssl (21.0.0-1) ... 2023-12-12T10:08:36.933 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-mgr. 2023-12-12T10:08:36.947 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../065-ceph-mgr_19.0.0-96-gf1fbf3c5-1jammy_amd64.deb ... 2023-12-12T10:08:36.992 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-mgr (19.0.0-96-gf1fbf3c5-1jammy) ... 2023-12-12T10:08:37.343 INFO:teuthology.orchestra.run.smithi187.stdout:Get:118 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231205.064351/f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-96-gf1fbf3c5-1jammy [121 kB] 2023-12-12T10:08:37.344 INFO:teuthology.orchestra.run.smithi187.stdout:Get:119 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231205.064351/f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-96-gf1fbf3c5-1jammy [225 kB] 2023-12-12T10:08:37.379 INFO:teuthology.orchestra.run.smithi187.stdout:Get:120 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231205.064351/f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-96-gf1fbf3c5-1jammy [34.0 kB] 2023-12-12T10:08:37.379 INFO:teuthology.orchestra.run.smithi187.stdout:Get:121 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231205.064351/f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-96-gf1fbf3c5-1jammy [23.4 kB] 2023-12-12T10:08:37.380 INFO:teuthology.orchestra.run.smithi187.stdout:Get:122 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231205.064351/f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-96-gf1fbf3c5-1jammy [38.3 kB] 2023-12-12T10:08:37.381 INFO:teuthology.orchestra.run.smithi187.stdout:Get:123 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231205.064351/f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-96-gf1fbf3c5-1jammy [12.3 MB] 2023-12-12T10:08:37.403 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-mon. 2023-12-12T10:08:37.418 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../066-ceph-mon_19.0.0-96-gf1fbf3c5-1jammy_amd64.deb ... 2023-12-12T10:08:37.462 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-mon (19.0.0-96-gf1fbf3c5-1jammy) ... 2023-12-12T10:08:38.291 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-osd. 2023-12-12T10:08:38.305 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../067-ceph-osd_19.0.0-96-gf1fbf3c5-1jammy_amd64.deb ... 2023-12-12T10:08:38.349 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-osd (19.0.0-96-gf1fbf3c5-1jammy) ... 2023-12-12T10:08:38.741 INFO:teuthology.orchestra.run.smithi187.stdout:Get:124 https://3.chacra.ceph.com/r/ceph/wip-mchangir-testing-20231205.064351/f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-96-gf1fbf3c5-1jammy [91.3 kB] 2023-12-12T10:08:39.391 INFO:teuthology.orchestra.run.smithi187.stdout:Fetched 187 MB in 38s (4,892 kB/s) 2023-12-12T10:08:39.544 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph. 2023-12-12T10:08:39.552 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-pyperclip. 2023-12-12T10:08:39.559 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../068-ceph_19.0.0-96-gf1fbf3c5-1jammy_amd64.deb ... 2023-12-12T10:08:39.602 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph (19.0.0-96-gf1fbf3c5-1jammy) ... 2023-12-12T10:08:39.620 INFO:teuthology.orchestra.run.smithi187.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132930 files and directories currently installed.) 2023-12-12T10:08:39.623 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2023-12-12T10:08:39.668 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2023-12-12T10:08:39.930 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-fuse. 2023-12-12T10:08:39.945 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../069-ceph-fuse_19.0.0-96-gf1fbf3c5-1jammy_amd64.deb ... 2023-12-12T10:08:39.979 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-wcwidth. 2023-12-12T10:08:39.988 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-fuse (19.0.0-96-gf1fbf3c5-1jammy) ... 2023-12-12T10:08:39.992 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2023-12-12T10:08:40.037 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2023-12-12T10:08:40.366 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-mds. 2023-12-12T10:08:40.380 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../070-ceph-mds_19.0.0-96-gf1fbf3c5-1jammy_amd64.deb ... 2023-12-12T10:08:40.390 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-cmd2. 2023-12-12T10:08:40.404 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2023-12-12T10:08:40.424 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-mds (19.0.0-96-gf1fbf3c5-1jammy) ... 2023-12-12T10:08:40.448 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2023-12-12T10:08:40.776 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2023-12-12T10:08:40.777 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package cephadm. 2023-12-12T10:08:40.791 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2023-12-12T10:08:40.792 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../071-cephadm_19.0.0-96-gf1fbf3c5-1jammy_amd64.deb ... 2023-12-12T10:08:40.836 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking cephadm (19.0.0-96-gf1fbf3c5-1jammy) ... 2023-12-12T10:08:40.860 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-12-12T10:08:41.129 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-12-12T10:08:41.145 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2023-12-12T10:08:41.180 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2023-12-12T10:08:41.180 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-asyncssh. 2023-12-12T10:08:41.195 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2023-12-12T10:08:41.238 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2023-12-12T10:08:41.549 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-12-12T10:08:41.564 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2023-12-12T10:08:41.574 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python-babel-localedata. 2023-12-12T10:08:41.589 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2023-12-12T10:08:41.616 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-12-12T10:08:41.633 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-12-12T10:08:42.194 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-12-12T10:08:42.210 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-12-12T10:08:42.269 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-12-12T10:08:42.688 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-babel. 2023-12-12T10:08:42.702 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2023-12-12T10:08:42.746 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2023-12-12T10:08:42.764 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-12-12T10:08:42.779 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-12-12T10:08:42.822 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-12-12T10:08:43.074 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-jinja2. 2023-12-12T10:08:43.088 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1_all.deb ... 2023-12-12T10:08:43.133 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2023-12-12T10:08:43.217 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-12-12T10:08:43.234 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-12-12T10:08:43.283 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-12-12T10:08:43.511 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-12-12T10:08:43.525 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.0.0-96-gf1fbf3c5-1jammy_all.deb ... 2023-12-12T10:08:43.569 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-mgr-cephadm (19.0.0-96-gf1fbf3c5-1jammy) ... 2023-12-12T10:08:43.720 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2023-12-12T10:08:43.735 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2023-12-12T10:08:43.786 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-12-12T10:08:43.897 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-repoze.lru. 2023-12-12T10:08:43.911 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2023-12-12T10:08:43.980 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-12-12T10:08:44.148 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package librados2. 2023-12-12T10:08:44.162 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../010-librados2_19.0.0-96-gf1fbf3c5-1jammy_amd64.deb ... 2023-12-12T10:08:44.200 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-routes. 2023-12-12T10:08:44.206 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking librados2 (19.0.0-96-gf1fbf3c5-1jammy) ... 2023-12-12T10:08:44.214 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2023-12-12T10:08:44.258 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2023-12-12T10:08:44.579 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-12-12T10:08:44.592 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.0.0-96-gf1fbf3c5-1jammy_all.deb ... 2023-12-12T10:08:44.625 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package librbd1. 2023-12-12T10:08:44.628 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-mgr-dashboard (19.0.0-96-gf1fbf3c5-1jammy) ... 2023-12-12T10:08:44.640 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../011-librbd1_19.0.0-96-gf1fbf3c5-1jammy_amd64.deb ... 2023-12-12T10:08:44.675 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking librbd1 (19.0.0-96-gf1fbf3c5-1jammy) ... 2023-12-12T10:08:45.006 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2023-12-12T10:08:45.020 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2023-12-12T10:08:45.056 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-12-12T10:08:45.112 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libcephfs2. 2023-12-12T10:08:45.126 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-96-gf1fbf3c5-1jammy_amd64.deb ... 2023-12-12T10:08:45.170 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libcephfs2 (19.0.0-96-gf1fbf3c5-1jammy) ... 2023-12-12T10:08:45.472 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-rados. 2023-12-12T10:08:45.487 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../013-python3-rados_19.0.0-96-gf1fbf3c5-1jammy_amd64.deb ... 2023-12-12T10:08:45.510 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-joblib. 2023-12-12T10:08:45.524 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2023-12-12T10:08:45.530 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-rados (19.0.0-96-gf1fbf3c5-1jammy) ... 2023-12-12T10:08:45.560 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2023-12-12T10:08:45.849 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-12-12T10:08:45.864 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-96-gf1fbf3c5-1jammy_all.deb ... 2023-12-12T10:08:45.899 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-ceph-argparse (19.0.0-96-gf1fbf3c5-1jammy) ... 2023-12-12T10:08:45.938 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-threadpoolctl. 2023-12-12T10:08:45.952 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2023-12-12T10:08:46.074 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2023-12-12T10:08:46.160 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-cephfs. 2023-12-12T10:08:46.175 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-96-gf1fbf3c5-1jammy_amd64.deb ... 2023-12-12T10:08:46.218 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-cephfs (19.0.0-96-gf1fbf3c5-1jammy) ... 2023-12-12T10:08:46.372 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-sklearn. 2023-12-12T10:08:46.386 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2023-12-12T10:08:46.444 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2023-12-12T10:08:46.529 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-ceph-common. 2023-12-12T10:08:46.544 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-96-gf1fbf3c5-1jammy_all.deb ... 2023-12-12T10:08:46.613 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-ceph-common (19.0.0-96-gf1fbf3c5-1jammy) ... 2023-12-12T10:08:46.924 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-prettytable. 2023-12-12T10:08:46.939 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2023-12-12T10:08:46.982 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2023-12-12T10:08:47.128 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-12-12T10:08:47.142 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.0.0-96-gf1fbf3c5-1jammy_all.deb ... 2023-12-12T10:08:47.186 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-96-gf1fbf3c5-1jammy) ... 2023-12-12T10:08:47.277 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-rbd. 2023-12-12T10:08:47.291 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-96-gf1fbf3c5-1jammy_amd64.deb ... 2023-12-12T10:08:47.335 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-rbd (19.0.0-96-gf1fbf3c5-1jammy) ... 2023-12-12T10:08:47.688 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-12-12T10:08:47.703 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2023-12-12T10:08:47.738 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2023-12-12T10:08:48.040 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libreadline-dev:amd64. 2023-12-12T10:08:48.055 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2023-12-12T10:08:48.098 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2023-12-12T10:08:48.149 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-cachetools. 2023-12-12T10:08:48.164 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2023-12-12T10:08:48.198 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2023-12-12T10:08:48.443 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2023-12-12T10:08:48.458 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2023-12-12T10:08:48.502 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2023-12-12T10:08:48.526 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-pyasn1. 2023-12-12T10:08:48.541 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2023-12-12T10:08:48.584 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2023-12-12T10:08:48.855 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package lua5.1. 2023-12-12T10:08:48.870 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2023-12-12T10:08:48.913 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2023-12-12T10:08:48.930 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-12-12T10:08:48.945 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2023-12-12T10:08:48.988 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2023-12-12T10:08:49.182 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package lua-any. 2023-12-12T10:08:49.198 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2023-12-12T10:08:49.241 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking lua-any (27ubuntu1) ... 2023-12-12T10:08:49.299 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-rsa. 2023-12-12T10:08:49.314 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2023-12-12T10:08:49.383 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-rsa (4.8-1) ... 2023-12-12T10:08:49.518 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package zip. 2023-12-12T10:08:49.533 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2023-12-12T10:08:49.576 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking zip (3.0-12build2) ... 2023-12-12T10:08:49.795 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-google-auth. 2023-12-12T10:08:49.811 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2023-12-12T10:08:49.861 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2023-12-12T10:08:49.921 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package unzip. 2023-12-12T10:08:49.936 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.1_amd64.deb ... 2023-12-12T10:08:49.979 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking unzip (6.0-26ubuntu3.1) ... 2023-12-12T10:08:50.123 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-12-12T10:08:50.138 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2023-12-12T10:08:50.182 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-12-12T10:08:50.416 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package luarocks. 2023-12-12T10:08:50.431 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2023-12-12T10:08:50.474 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2023-12-12T10:08:50.493 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-websocket. 2023-12-12T10:08:50.507 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2023-12-12T10:08:50.551 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-websocket (1.2.3-1) ... 2023-12-12T10:08:50.905 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-kubernetes. 2023-12-12T10:08:50.920 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2023-12-12T10:08:50.949 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package librgw2. 2023-12-12T10:08:50.963 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../027-librgw2_19.0.0-96-gf1fbf3c5-1jammy_amd64.deb ... 2023-12-12T10:08:50.963 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2023-12-12T10:08:51.025 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking librgw2 (19.0.0-96-gf1fbf3c5-1jammy) ... 2023-12-12T10:08:51.562 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-rgw. 2023-12-12T10:08:51.576 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../028-python3-rgw_19.0.0-96-gf1fbf3c5-1jammy_amd64.deb ... 2023-12-12T10:08:51.619 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-12-12T10:08:51.628 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-rgw (19.0.0-96-gf1fbf3c5-1jammy) ... 2023-12-12T10:08:51.633 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.0.0-96-gf1fbf3c5-1jammy_all.deb ... 2023-12-12T10:08:51.668 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-96-gf1fbf3c5-1jammy) ... 2023-12-12T10:08:52.090 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package liboath0:amd64. 2023-12-12T10:08:52.105 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2023-12-12T10:08:52.263 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libonig5:amd64. 2023-12-12T10:08:52.264 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2023-12-12T10:08:52.277 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2023-12-12T10:08:52.338 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2023-12-12T10:08:52.675 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libjq1:amd64. 2023-12-12T10:08:52.689 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2023-12-12T10:08:52.733 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-12-12T10:08:52.734 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libradosstriper1. 2023-12-12T10:08:52.749 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../030-libradosstriper1_19.0.0-96-gf1fbf3c5-1jammy_amd64.deb ... 2023-12-12T10:08:52.801 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libradosstriper1 (19.0.0-96-gf1fbf3c5-1jammy) ... 2023-12-12T10:08:52.994 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package jq. 2023-12-12T10:08:53.008 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2023-12-12T10:08:53.044 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2023-12-12T10:08:53.313 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package socat. 2023-12-12T10:08:53.327 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2023-12-12T10:08:53.371 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package ceph-common. 2023-12-12T10:08:53.372 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2023-12-12T10:08:53.386 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../031-ceph-common_19.0.0-96-gf1fbf3c5-1jammy_amd64.deb ... 2023-12-12T10:08:53.437 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking ceph-common (19.0.0-96-gf1fbf3c5-1jammy) ... 2023-12-12T10:08:53.667 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package xmlstarlet. 2023-12-12T10:08:53.681 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2023-12-12T10:08:53.750 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2023-12-12T10:08:54.080 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-test. 2023-12-12T10:08:54.093 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../099-ceph-test_19.0.0-96-gf1fbf3c5-1jammy_amd64.deb ... 2023-12-12T10:08:54.138 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-test (19.0.0-96-gf1fbf3c5-1jammy) ... 2023-12-12T10:08:54.518 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package ceph-base. 2023-12-12T10:08:54.533 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../032-ceph-base_19.0.0-96-gf1fbf3c5-1jammy_amd64.deb ... 2023-12-12T10:08:54.585 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking ceph-base (19.0.0-96-gf1fbf3c5-1jammy) ... 2023-12-12T10:08:55.247 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-jaraco.functools. 2023-12-12T10:08:55.261 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2023-12-12T10:08:55.297 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2023-12-12T10:08:55.650 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-cheroot. 2023-12-12T10:08:55.664 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2023-12-12T10:08:55.708 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-12-12T10:08:56.062 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-jaraco.classes. 2023-12-12T10:08:56.075 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-volume. 2023-12-12T10:08:56.076 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2023-12-12T10:08:56.090 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../100-ceph-volume_19.0.0-96-gf1fbf3c5-1jammy_all.deb ... 2023-12-12T10:08:56.120 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2023-12-12T10:08:56.133 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-volume (19.0.0-96-gf1fbf3c5-1jammy) ... 2023-12-12T10:08:56.462 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-jaraco.text. 2023-12-12T10:08:56.477 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2023-12-12T10:08:56.523 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2023-12-12T10:08:56.538 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package cephfs-mirror. 2023-12-12T10:08:56.553 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../101-cephfs-mirror_19.0.0-96-gf1fbf3c5-1jammy_amd64.deb ... 2023-12-12T10:08:56.596 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking cephfs-mirror (19.0.0-96-gf1fbf3c5-1jammy) ... 2023-12-12T10:08:56.793 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-jaraco.collections. 2023-12-12T10:08:56.807 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2023-12-12T10:08:56.842 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2023-12-12T10:08:56.932 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-colorama. 2023-12-12T10:08:56.948 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2023-12-12T10:08:56.990 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-colorama (0.4.4-1) ... 2023-12-12T10:08:57.179 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-tempora. 2023-12-12T10:08:57.194 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2023-12-12T10:08:57.237 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-tempora (4.1.2-1) ... 2023-12-12T10:08:57.268 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package cephfs-shell. 2023-12-12T10:08:57.283 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../103-cephfs-shell_19.0.0-96-gf1fbf3c5-1jammy_all.deb ... 2023-12-12T10:08:57.318 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking cephfs-shell (19.0.0-96-gf1fbf3c5-1jammy) ... 2023-12-12T10:08:57.562 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package cephfs-top. 2023-12-12T10:08:57.573 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-portend. 2023-12-12T10:08:57.577 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../104-cephfs-top_19.0.0-96-gf1fbf3c5-1jammy_all.deb ... 2023-12-12T10:08:57.588 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2023-12-12T10:08:57.621 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking cephfs-top (19.0.0-96-gf1fbf3c5-1jammy) ... 2023-12-12T10:08:57.631 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-portend (3.0.0-1) ... 2023-12-12T10:08:57.898 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libcephfs-dev. 2023-12-12T10:08:57.914 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../105-libcephfs-dev_19.0.0-96-gf1fbf3c5-1jammy_amd64.deb ... 2023-12-12T10:08:57.956 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libcephfs-dev (19.0.0-96-gf1fbf3c5-1jammy) ... 2023-12-12T10:08:57.977 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-zc.lockfile. 2023-12-12T10:08:57.992 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2023-12-12T10:08:58.026 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2023-12-12T10:08:58.293 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package lua-socket:amd64. 2023-12-12T10:08:58.308 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2023-12-12T10:08:58.329 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-cherrypy3. 2023-12-12T10:08:58.344 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2023-12-12T10:08:58.351 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2023-12-12T10:08:58.388 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2023-12-12T10:08:58.706 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package lua-sec:amd64. 2023-12-12T10:08:58.721 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2023-12-12T10:08:58.758 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-natsort. 2023-12-12T10:08:58.764 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2023-12-12T10:08:58.772 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2023-12-12T10:08:58.808 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-natsort (8.0.2-1) ... 2023-12-12T10:08:59.077 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-logutils. 2023-12-12T10:08:59.093 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2023-12-12T10:08:59.109 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package nvme-cli. 2023-12-12T10:08:59.124 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2023-12-12T10:08:59.169 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-logutils (0.3.3-8) ... 2023-12-12T10:08:59.176 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2023-12-12T10:08:59.480 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-markupsafe. 2023-12-12T10:08:59.495 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2023-12-12T10:08:59.523 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package pkg-config. 2023-12-12T10:08:59.537 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2023-12-12T10:08:59.538 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2023-12-12T10:08:59.581 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2023-12-12T10:08:59.866 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-mako. 2023-12-12T10:08:59.867 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-12-12T10:08:59.881 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2023-12-12T10:08:59.882 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2023-12-12T10:08:59.925 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-12-12T10:08:59.926 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2023-12-12T10:09:00.278 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-simplegeneric. 2023-12-12T10:09:00.293 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2023-12-12T10:09:00.336 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-12-12T10:09:00.381 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-iniconfig. 2023-12-12T10:09:00.395 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2023-12-12T10:09:00.439 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2023-12-12T10:09:00.640 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-singledispatch. 2023-12-12T10:09:00.655 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2023-12-12T10:09:00.698 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2023-12-12T10:09:00.784 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-pastescript. 2023-12-12T10:09:00.798 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2023-12-12T10:09:00.842 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-12-12T10:09:01.017 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-webob. 2023-12-12T10:09:01.032 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2023-12-12T10:09:01.075 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2023-12-12T10:09:01.212 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-pluggy. 2023-12-12T10:09:01.227 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2023-12-12T10:09:01.270 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2023-12-12T10:09:01.454 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-waitress. 2023-12-12T10:09:01.468 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2023-12-12T10:09:01.515 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2023-12-12T10:09:01.573 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-psutil. 2023-12-12T10:09:01.589 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2023-12-12T10:09:01.623 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2023-12-12T10:09:01.831 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-tempita. 2023-12-12T10:09:01.846 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2023-12-12T10:09:01.881 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2023-12-12T10:09:01.959 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-py. 2023-12-12T10:09:01.974 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2023-12-12T10:09:02.043 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-py (1.10.0-1) ... 2023-12-12T10:09:02.134 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-paste. 2023-12-12T10:09:02.150 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2023-12-12T10:09:02.184 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2023-12-12T10:09:02.371 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-pygments. 2023-12-12T10:09:02.385 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2023-12-12T10:09:02.429 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2023-12-12T10:09:02.538 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-12-12T10:09:02.552 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2023-12-12T10:09:02.596 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2023-12-12T10:09:02.867 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-pyinotify. 2023-12-12T10:09:02.881 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2023-12-12T10:09:02.899 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-pastedeploy. 2023-12-12T10:09:02.914 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2023-12-12T10:09:02.925 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2023-12-12T10:09:02.948 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2023-12-12T10:09:03.228 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-toml. 2023-12-12T10:09:03.242 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2023-12-12T10:09:03.285 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-webtest. 2023-12-12T10:09:03.286 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-toml (0.10.2-1) ... 2023-12-12T10:09:03.300 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2023-12-12T10:09:03.343 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-webtest (2.0.35-1) ... 2023-12-12T10:09:03.615 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-pytest. 2023-12-12T10:09:03.629 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2023-12-12T10:09:03.673 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2023-12-12T10:09:03.688 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-pecan. 2023-12-12T10:09:03.703 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2023-12-12T10:09:03.746 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2023-12-12T10:09:04.026 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-simplejson. 2023-12-12T10:09:04.040 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2023-12-12T10:09:04.084 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2023-12-12T10:09:04.137 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-certifi. 2023-12-12T10:09:04.150 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2023-12-12T10:09:04.192 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2023-12-12T10:09:04.354 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-12-12T10:09:04.368 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2023-12-12T10:09:04.445 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2023-12-12T10:09:04.537 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-idna. 2023-12-12T10:09:04.552 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2023-12-12T10:09:04.596 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-idna (3.3-1) ... 2023-12-12T10:09:04.857 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-urllib3. 2023-12-12T10:09:04.872 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2023-12-12T10:09:04.907 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2023-12-12T10:09:05.149 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package radosgw. 2023-12-12T10:09:05.164 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../122-radosgw_19.0.0-96-gf1fbf3c5-1jammy_amd64.deb ... 2023-12-12T10:09:05.199 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking radosgw (19.0.0-96-gf1fbf3c5-1jammy) ... 2023-12-12T10:09:05.218 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-requests. 2023-12-12T10:09:05.234 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2023-12-12T10:09:05.277 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-12-12T10:09:05.622 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-werkzeug. 2023-12-12T10:09:05.637 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2023-12-12T10:09:05.680 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-12-12T10:09:05.794 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package rbd-fuse. 2023-12-12T10:09:05.809 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../123-rbd-fuse_19.0.0-96-gf1fbf3c5-1jammy_amd64.deb ... 2023-12-12T10:09:05.852 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking rbd-fuse (19.0.0-96-gf1fbf3c5-1jammy) ... 2023-12-12T10:09:05.950 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-12-12T10:09:05.965 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.0.0-96-gf1fbf3c5-1jammy_all.deb ... 2023-12-12T10:09:05.999 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking ceph-mgr-modules-core (19.0.0-96-gf1fbf3c5-1jammy) ... 2023-12-12T10:09:06.162 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2023-12-12T10:09:06.405 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-12-12T10:09:06.420 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.0.0-96-gf1fbf3c5-1jammy_amd64.deb ... 2023-12-12T10:09:06.433 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2023-12-12T10:09:06.463 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-96-gf1fbf3c5-1jammy) ... 2023-12-12T10:09:06.559 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2023-12-12T10:09:06.799 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-bcrypt. 2023-12-12T10:09:06.805 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2023-12-12T10:09:06.814 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2023-12-12T10:09:06.849 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2023-12-12T10:09:07.127 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-openssl. 2023-12-12T10:09:07.141 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2023-12-12T10:09:07.186 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2023-12-12T10:09:07.218 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-openssl (21.0.0-1) ... 2023-12-12T10:09:07.538 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package ceph-mgr. 2023-12-12T10:09:07.553 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../065-ceph-mgr_19.0.0-96-gf1fbf3c5-1jammy_amd64.deb ... 2023-12-12T10:09:07.596 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking ceph-mgr (19.0.0-96-gf1fbf3c5-1jammy) ... 2023-12-12T10:09:07.773 INFO:teuthology.orchestra.run.smithi078.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2023-12-12T10:09:07.824 INFO:teuthology.orchestra.run.smithi078.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2023-12-12T10:09:07.878 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up cephadm (19.0.0-96-gf1fbf3c5-1jammy) ... 2023-12-12T10:09:08.119 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package ceph-mon. 2023-12-12T10:09:08.134 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../066-ceph-mon_19.0.0-96-gf1fbf3c5-1jammy_amd64.deb ... 2023-12-12T10:09:08.183 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking ceph-mon (19.0.0-96-gf1fbf3c5-1jammy) ... 2023-12-12T10:09:08.434 INFO:teuthology.orchestra.run.smithi078.stdout:Adding system user cephadm....done 2023-12-12T10:09:08.593 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2023-12-12T10:09:08.861 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2023-12-12T10:09:09.104 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package ceph-osd. 2023-12-12T10:09:09.118 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../067-ceph-osd_19.0.0-96-gf1fbf3c5-1jammy_amd64.deb ... 2023-12-12T10:09:09.120 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2023-12-12T10:09:09.170 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking ceph-osd (19.0.0-96-gf1fbf3c5-1jammy) ... 2023-12-12T10:09:09.280 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2023-12-12T10:09:09.531 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-12-12T10:09:09.791 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2023-12-12T10:09:09.917 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-py (1.10.0-1) ... 2023-12-12T10:09:10.252 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2023-12-12T10:09:10.423 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package ceph. 2023-12-12T10:09:10.438 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../068-ceph_19.0.0-96-gf1fbf3c5-1jammy_amd64.deb ... 2023-12-12T10:09:10.490 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking ceph (19.0.0-96-gf1fbf3c5-1jammy) ... 2023-12-12T10:09:10.620 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-cachetools (5.0.0-1) ... 2023-12-12T10:09:10.905 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-colorama (0.4.4-1) ... 2023-12-12T10:09:10.909 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package ceph-fuse. 2023-12-12T10:09:10.924 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../069-ceph-fuse_19.0.0-96-gf1fbf3c5-1jammy_amd64.deb ... 2023-12-12T10:09:10.976 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking ceph-fuse (19.0.0-96-gf1fbf3c5-1jammy) ... 2023-12-12T10:09:11.190 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-openssl (21.0.0-1) ... 2023-12-12T10:09:11.446 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package ceph-mds. 2023-12-12T10:09:11.461 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../070-ceph-mds_19.0.0-96-gf1fbf3c5-1jammy_amd64.deb ... 2023-12-12T10:09:11.474 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up unzip (6.0-26ubuntu3.1) ... 2023-12-12T10:09:11.537 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking ceph-mds (19.0.0-96-gf1fbf3c5-1jammy) ... 2023-12-12T10:09:11.751 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2023-12-12T10:09:11.957 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package cephadm. 2023-12-12T10:09:11.972 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../071-cephadm_19.0.0-96-gf1fbf3c5-1jammy_amd64.deb ... 2023-12-12T10:09:12.010 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2023-12-12T10:09:12.015 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking cephadm (19.0.0-96-gf1fbf3c5-1jammy) ... 2023-12-12T10:09:12.262 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2023-12-12T10:09:12.410 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-asyncssh. 2023-12-12T10:09:12.425 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2023-12-12T10:09:12.476 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2023-12-12T10:09:12.521 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-ceph-argparse (19.0.0-96-gf1fbf3c5-1jammy) ... 2023-12-12T10:09:12.822 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-12-12T10:09:12.863 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python-babel-localedata. 2023-12-12T10:09:12.878 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2023-12-12T10:09:12.929 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-12-12T10:09:12.940 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2023-12-12T10:09:13.066 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2023-12-12T10:09:13.376 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2023-12-12T10:09:13.501 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2023-12-12T10:09:13.786 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2023-12-12T10:09:13.959 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-babel. 2023-12-12T10:09:13.973 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2023-12-12T10:09:14.017 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2023-12-12T10:09:14.178 INFO:teuthology.orchestra.run.smithi078.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2023-12-12T10:09:14.233 INFO:teuthology.orchestra.run.smithi078.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2023-12-12T10:09:14.281 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-12-12T10:09:14.387 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-jinja2. 2023-12-12T10:09:14.399 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2023-12-12T10:09:14.401 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1_all.deb ... 2023-12-12T10:09:14.445 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2023-12-12T10:09:14.767 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-12-12T10:09:14.824 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-12-12T10:09:14.838 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.0.0-96-gf1fbf3c5-1jammy_all.deb ... 2023-12-12T10:09:14.882 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking ceph-mgr-cephadm (19.0.0-96-gf1fbf3c5-1jammy) ... 2023-12-12T10:09:14.884 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-natsort (8.0.2-1) ... 2023-12-12T10:09:15.144 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2023-12-12T10:09:15.244 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-repoze.lru. 2023-12-12T10:09:15.259 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2023-12-12T10:09:15.302 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-12-12T10:09:15.406 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2023-12-12T10:09:15.621 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-routes. 2023-12-12T10:09:15.637 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2023-12-12T10:09:15.680 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2023-12-12T10:09:15.738 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up zip (3.0-12build2) ... 2023-12-12T10:09:15.848 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2023-12-12T10:09:16.024 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-12-12T10:09:16.040 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.0.0-96-gf1fbf3c5-1jammy_all.deb ... 2023-12-12T10:09:16.082 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking ceph-mgr-dashboard (19.0.0-96-gf1fbf3c5-1jammy) ... 2023-12-12T10:09:16.519 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2023-12-12T10:09:16.533 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2023-12-12T10:09:16.549 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2023-12-12T10:09:16.577 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-12-12T10:09:16.826 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2023-12-12T10:09:16.960 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2023-12-12T10:09:17.061 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2023-12-12T10:09:17.089 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-joblib. 2023-12-12T10:09:17.103 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2023-12-12T10:09:17.147 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2023-12-12T10:09:17.354 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2023-12-12T10:09:17.493 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-threadpoolctl. 2023-12-12T10:09:17.506 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2023-12-12T10:09:17.628 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2023-12-12T10:09:17.772 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-certifi (2020.6.20-1) ... 2023-12-12T10:09:17.956 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-sklearn. 2023-12-12T10:09:17.970 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2023-12-12T10:09:18.014 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2023-12-12T10:09:18.031 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2023-12-12T10:09:18.433 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-12-12T10:09:18.724 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-12-12T10:09:18.734 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2023-12-12T10:09:18.738 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.0.0-96-gf1fbf3c5-1jammy_all.deb ... 2023-12-12T10:09:18.782 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-96-gf1fbf3c5-1jammy) ... 2023-12-12T10:09:19.036 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-12-12T10:09:19.379 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2023-12-12T10:09:19.638 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2023-12-12T10:09:19.773 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-ceph-common (19.0.0-96-gf1fbf3c5-1jammy) ... 2023-12-12T10:09:19.777 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-cachetools. 2023-12-12T10:09:19.793 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2023-12-12T10:09:19.836 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2023-12-12T10:09:20.099 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-idna (3.3-1) ... 2023-12-12T10:09:20.164 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-pyasn1. 2023-12-12T10:09:20.180 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2023-12-12T10:09:20.222 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2023-12-12T10:09:20.442 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2023-12-12T10:09:20.584 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-12-12T10:09:20.599 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2023-12-12T10:09:20.633 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2023-12-12T10:09:20.970 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-rsa. 2023-12-12T10:09:20.985 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2023-12-12T10:09:21.028 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-rsa (4.8-1) ... 2023-12-12T10:09:21.365 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-google-auth. 2023-12-12T10:09:21.381 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2023-12-12T10:09:21.415 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2023-12-12T10:09:21.665 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2023-12-12T10:09:21.710 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-12-12T10:09:21.726 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2023-12-12T10:09:21.793 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-12-12T10:09:21.941 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-12-12T10:09:22.076 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-toml (0.10.2-1) ... 2023-12-12T10:09:22.113 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-websocket. 2023-12-12T10:09:22.129 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2023-12-12T10:09:22.171 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-websocket (1.2.3-1) ... 2023-12-12T10:09:22.344 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2023-12-12T10:09:22.470 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2023-12-12T10:09:22.525 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-kubernetes. 2023-12-12T10:09:22.540 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2023-12-12T10:09:22.586 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2023-12-12T10:09:22.595 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2023-12-12T10:09:22.972 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2023-12-12T10:09:23.249 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2023-12-12T10:09:23.480 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-12-12T10:09:23.495 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.0.0-96-gf1fbf3c5-1jammy_all.deb ... 2023-12-12T10:09:23.508 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-12-12T10:09:23.539 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-96-gf1fbf3c5-1jammy) ... 2023-12-12T10:09:23.659 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2023-12-12T10:09:23.875 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libonig5:amd64. 2023-12-12T10:09:23.889 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2023-12-12T10:09:23.925 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2023-12-12T10:09:23.977 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2023-12-12T10:09:24.220 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-logutils (0.3.3-8) ... 2023-12-12T10:09:24.278 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libjq1:amd64. 2023-12-12T10:09:24.292 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2023-12-12T10:09:24.328 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-12-12T10:09:24.488 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-tempora (4.1.2-1) ... 2023-12-12T10:09:24.606 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package jq. 2023-12-12T10:09:24.621 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2023-12-12T10:09:24.665 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2023-12-12T10:09:24.739 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-12-12T10:09:24.950 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package socat. 2023-12-12T10:09:24.965 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2023-12-12T10:09:25.007 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-prettytable (2.5.0-2) ... 2023-12-12T10:09:25.008 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2023-12-12T10:09:25.262 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package xmlstarlet. 2023-12-12T10:09:25.277 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2023-12-12T10:09:25.311 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2023-12-12T10:09:25.316 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-12-12T10:09:25.442 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-websocket (1.2.3-1) ... 2023-12-12T10:09:25.674 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package ceph-test. 2023-12-12T10:09:25.688 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../099-ceph-test_19.0.0-96-gf1fbf3c5-1jammy_amd64.deb ... 2023-12-12T10:09:25.724 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking ceph-test (19.0.0-96-gf1fbf3c5-1jammy) ... 2023-12-12T10:09:25.735 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2023-12-12T10:09:25.836 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-12-12T10:09:26.121 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2023-12-12T10:09:26.413 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2023-12-12T10:09:26.681 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2023-12-12T10:09:26.808 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2023-12-12T10:09:26.933 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2023-12-12T10:09:27.055 INFO:teuthology.orchestra.run.smithi078.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2023-12-12T10:09:27.294 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-12-12T10:09:27.394 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2023-12-12T10:09:27.578 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package ceph-volume. 2023-12-12T10:09:27.594 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../100-ceph-volume_19.0.0-96-gf1fbf3c5-1jammy_all.deb ... 2023-12-12T10:09:27.636 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking ceph-volume (19.0.0-96-gf1fbf3c5-1jammy) ... 2023-12-12T10:09:27.779 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2023-12-12T10:09:27.990 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package cephfs-mirror. 2023-12-12T10:09:28.006 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../101-cephfs-mirror_19.0.0-96-gf1fbf3c5-1jammy_amd64.deb ... 2023-12-12T10:09:28.039 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up lua-any (27ubuntu1) ... 2023-12-12T10:09:28.048 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking cephfs-mirror (19.0.0-96-gf1fbf3c5-1jammy) ... 2023-12-12T10:09:28.173 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-portend (3.0.0-1) ... 2023-12-12T10:09:28.368 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-colorama. 2023-12-12T10:09:28.384 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2023-12-12T10:09:28.426 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-colorama (0.4.4-1) ... 2023-12-12T10:09:28.466 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-12-12T10:09:28.592 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2023-12-12T10:09:28.721 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package cephfs-shell. 2023-12-12T10:09:28.736 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../103-cephfs-shell_19.0.0-96-gf1fbf3c5-1jammy_all.deb ... 2023-12-12T10:09:28.787 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking cephfs-shell (19.0.0-96-gf1fbf3c5-1jammy) ... 2023-12-12T10:09:28.910 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2023-12-12T10:09:29.048 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package cephfs-top. 2023-12-12T10:09:29.064 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../104-cephfs-top_19.0.0-96-gf1fbf3c5-1jammy_all.deb ... 2023-12-12T10:09:29.132 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking cephfs-top (19.0.0-96-gf1fbf3c5-1jammy) ... 2023-12-12T10:09:29.237 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-12-12T10:09:29.384 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libcephfs-dev. 2023-12-12T10:09:29.400 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../105-libcephfs-dev_19.0.0-96-gf1fbf3c5-1jammy_amd64.deb ... 2023-12-12T10:09:29.442 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libcephfs-dev (19.0.0-96-gf1fbf3c5-1jammy) ... 2023-12-12T10:09:29.504 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2023-12-12T10:09:29.716 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-rsa (4.8-1) ... 2023-12-12T10:09:29.753 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package lua-socket:amd64. 2023-12-12T10:09:29.769 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2023-12-12T10:09:29.803 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2023-12-12T10:09:30.009 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-webtest (2.0.35-1) ... 2023-12-12T10:09:30.158 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package lua-sec:amd64. 2023-12-12T10:09:30.174 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2023-12-12T10:09:30.216 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2023-12-12T10:09:30.277 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-12-12T10:09:30.528 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2023-12-12T10:09:30.603 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package nvme-cli. 2023-12-12T10:09:30.619 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2023-12-12T10:09:30.661 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2023-12-12T10:09:30.913 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-12-12T10:09:31.052 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package pkg-config. 2023-12-12T10:09:31.067 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2023-12-12T10:09:31.102 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2023-12-12T10:09:31.206 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2023-12-12T10:09:31.396 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-12-12T10:09:31.412 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2023-12-12T10:09:31.454 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2023-12-12T10:09:31.559 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-12-12T10:09:31.668 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up librados2 (19.0.0-96-gf1fbf3c5-1jammy) ... 2023-12-12T10:09:31.769 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libsqlite3-mod-ceph (19.0.0-96-gf1fbf3c5-1jammy) ... 2023-12-12T10:09:31.912 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2023-12-12T10:09:31.916 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-iniconfig. 2023-12-12T10:09:31.931 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2023-12-12T10:09:31.974 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2023-12-12T10:09:32.249 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libcephfs2 (19.0.0-96-gf1fbf3c5-1jammy) ... 2023-12-12T10:09:32.285 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-pastescript. 2023-12-12T10:09:32.301 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2023-12-12T10:09:32.343 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-12-12T10:09:32.400 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libradosstriper1 (19.0.0-96-gf1fbf3c5-1jammy) ... 2023-12-12T10:09:32.526 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-google-auth (1.5.1-3) ... 2023-12-12T10:09:32.663 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-pluggy. 2023-12-12T10:09:32.679 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2023-12-12T10:09:32.737 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2023-12-12T10:09:32.811 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up librbd1 (19.0.0-96-gf1fbf3c5-1jammy) ... 2023-12-12T10:09:32.912 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-mgr-modules-core (19.0.0-96-gf1fbf3c5-1jammy) ... 2023-12-12T10:09:33.025 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-psutil. 2023-12-12T10:09:33.030 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-fuse (19.0.0-96-gf1fbf3c5-1jammy) ... 2023-12-12T10:09:33.040 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2023-12-12T10:09:33.082 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2023-12-12T10:09:33.239 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-12-12T10:09:33.239 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-12-12T10:09:33.443 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-py. 2023-12-12T10:09:33.460 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2023-12-12T10:09:33.502 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-py (1.10.0-1) ... 2023-12-12T10:09:33.855 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-pygments. 2023-12-12T10:09:33.864 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libcephfs-dev (19.0.0-96-gf1fbf3c5-1jammy) ... 2023-12-12T10:09:33.870 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2023-12-12T10:09:33.913 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2023-12-12T10:09:33.990 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-rados (19.0.0-96-gf1fbf3c5-1jammy) ... 2023-12-12T10:09:34.116 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up librgw2 (19.0.0-96-gf1fbf3c5-1jammy) ... 2023-12-12T10:09:34.268 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up cephfs-top (19.0.0-96-gf1fbf3c5-1jammy) ... 2023-12-12T10:09:34.385 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2023-12-12T10:09:34.392 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-pyinotify. 2023-12-12T10:09:34.407 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2023-12-12T10:09:34.450 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2023-12-12T10:09:34.761 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-toml. 2023-12-12T10:09:34.776 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2023-12-12T10:09:34.819 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-toml (0.10.2-1) ... 2023-12-12T10:09:35.147 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-pytest. 2023-12-12T10:09:35.162 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2023-12-12T10:09:35.205 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2023-12-12T10:09:35.559 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package python3-simplejson. 2023-12-12T10:09:35.574 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2023-12-12T10:09:35.617 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2023-12-12T10:09:35.664 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-rbd (19.0.0-96-gf1fbf3c5-1jammy) ... 2023-12-12T10:09:35.790 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up rbd-fuse (19.0.0-96-gf1fbf3c5-1jammy) ... 2023-12-12T10:09:35.894 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-12-12T10:09:35.910 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2023-12-12T10:09:35.916 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-rgw (19.0.0-96-gf1fbf3c5-1jammy) ... 2023-12-12T10:09:35.952 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2023-12-12T10:09:36.042 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-cephfs (19.0.0-96-gf1fbf3c5-1jammy) ... 2023-12-12T10:09:36.194 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up cephfs-shell (19.0.0-96-gf1fbf3c5-1jammy) ... 2023-12-12T10:09:36.320 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-common (19.0.0-96-gf1fbf3c5-1jammy) ... 2023-12-12T10:09:36.631 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package radosgw. 2023-12-12T10:09:36.646 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../122-radosgw_19.0.0-96-gf1fbf3c5-1jammy_amd64.deb ... 2023-12-12T10:09:36.689 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking radosgw (19.0.0-96-gf1fbf3c5-1jammy) ... 2023-12-12T10:09:36.881 INFO:teuthology.orchestra.run.smithi078.stdout:Adding group ceph....done 2023-12-12T10:09:37.293 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package rbd-fuse. 2023-12-12T10:09:37.307 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../123-rbd-fuse_19.0.0-96-gf1fbf3c5-1jammy_amd64.deb ... 2023-12-12T10:09:37.308 INFO:teuthology.orchestra.run.smithi078.stdout:Adding system user ceph....done 2023-12-12T10:09:37.342 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking rbd-fuse (19.0.0-96-gf1fbf3c5-1jammy) ... 2023-12-12T10:09:37.486 INFO:teuthology.orchestra.run.smithi078.stdout:Setting system user ceph properties....done 2023-12-12T10:09:37.500 INFO:teuthology.orchestra.run.smithi078.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-12-12T10:09:37.636 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2023-12-12T10:09:37.641 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-12-12T10:09:37.897 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2023-12-12T10:09:38.015 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2023-12-12T10:09:38.057 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-12-12T10:09:38.297 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2023-12-12T10:09:38.709 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2023-12-12T10:09:38.818 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up cephfs-mirror (19.0.0-96-gf1fbf3c5-1jammy) ... 2023-12-12T10:09:39.034 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-12-12T10:09:39.034 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-12-12T10:09:39.305 INFO:teuthology.orchestra.run.smithi187.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2023-12-12T10:09:39.352 INFO:teuthology.orchestra.run.smithi187.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2023-12-12T10:09:39.391 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up cephadm (19.0.0-96-gf1fbf3c5-1jammy) ... 2023-12-12T10:09:39.669 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-test (19.0.0-96-gf1fbf3c5-1jammy) ... 2023-12-12T10:09:39.795 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up radosgw (19.0.0-96-gf1fbf3c5-1jammy) ... 2023-12-12T10:09:40.012 INFO:teuthology.orchestra.run.smithi187.stdout:Adding system user cephadm....done 2023-12-12T10:09:40.189 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2023-12-12T10:09:40.346 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-12-12T10:09:40.347 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-12-12T10:09:40.474 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2023-12-12T10:09:40.733 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2023-12-12T10:09:40.867 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2023-12-12T10:09:40.964 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-base (19.0.0-96-gf1fbf3c5-1jammy) ... 2023-12-12T10:09:41.127 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-12-12T10:09:41.352 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-12-12T10:09:41.427 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2023-12-12T10:09:41.553 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-py (1.10.0-1) ... 2023-12-12T10:09:41.855 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2023-12-12T10:09:41.991 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-mds (19.0.0-96-gf1fbf3c5-1jammy) ... 2023-12-12T10:09:42.206 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-12-12T10:09:42.206 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-12-12T10:09:42.249 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-cachetools (5.0.0-1) ... 2023-12-12T10:09:42.500 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-colorama (0.4.4-1) ... 2023-12-12T10:09:42.784 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-openssl (21.0.0-1) ... 2023-12-12T10:09:42.809 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-mgr (19.0.0-96-gf1fbf3c5-1jammy) ... 2023-12-12T10:09:43.041 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-12-12T10:09:43.041 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-12-12T10:09:43.069 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up unzip (6.0-26ubuntu3.1) ... 2023-12-12T10:09:43.354 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2023-12-12T10:09:43.677 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-osd (19.0.0-96-gf1fbf3c5-1jammy) ... 2023-12-12T10:09:43.680 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2023-12-12T10:09:43.948 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2023-12-12T10:09:43.994 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-12-12T10:09:43.995 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-12-12T10:09:44.207 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-ceph-argparse (19.0.0-96-gf1fbf3c5-1jammy) ... 2023-12-12T10:09:44.458 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-12-12T10:09:44.576 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2023-12-12T10:09:44.579 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-mgr-k8sevents (19.0.0-96-gf1fbf3c5-1jammy) ... 2023-12-12T10:09:44.689 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-96-gf1fbf3c5-1jammy) ... 2023-12-12T10:09:44.702 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2023-12-12T10:09:44.839 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-mon (19.0.0-96-gf1fbf3c5-1jammy) ... 2023-12-12T10:09:44.994 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2023-12-12T10:09:45.048 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-12-12T10:09:45.049 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-12-12T10:09:45.104 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2023-12-12T10:09:45.363 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2023-12-12T10:09:45.683 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-mgr-cephadm (19.0.0-96-gf1fbf3c5-1jammy) ... 2023-12-12T10:09:45.785 INFO:teuthology.orchestra.run.smithi187.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2023-12-12T10:09:45.842 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph (19.0.0-96-gf1fbf3c5-1jammy) ... 2023-12-12T10:09:45.853 INFO:teuthology.orchestra.run.smithi187.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2023-12-12T10:09:45.900 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-12-12T10:09:45.985 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-mgr-dashboard (19.0.0-96-gf1fbf3c5-1jammy) ... 2023-12-12T10:09:46.017 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2023-12-12T10:09:46.129 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-volume (19.0.0-96-gf1fbf3c5-1jammy) ... 2023-12-12T10:09:46.394 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-12-12T10:09:46.489 INFO:teuthology.orchestra.run.smithi078.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2023-12-12T10:09:46.519 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-natsort (8.0.2-1) ... 2023-12-12T10:09:46.598 INFO:teuthology.orchestra.run.smithi078.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-12-12T10:09:46.784 INFO:teuthology.orchestra.run.smithi078.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-12-12T10:09:46.821 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2023-12-12T10:09:47.088 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2023-12-12T10:09:47.424 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up zip (3.0-12build2) ... 2023-12-12T10:09:47.583 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2023-12-12T10:09:47.910 INFO:teuthology.orchestra.run.smithi078.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-12-12T10:09:48.251 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2023-12-12T10:09:48.519 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2023-12-12T10:09:48.619 INFO:teuthology.orchestra.run.smithi078.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-12-12T10:09:48.623 DEBUG:teuthology.orchestra.run.smithi078:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-12-12T10:09:48.645 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2023-12-12T10:09:48.698 INFO:teuthology.orchestra.run.smithi078.stdout:Reading package lists... 2023-12-12T10:09:48.771 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2023-12-12T10:09:48.865 INFO:teuthology.orchestra.run.smithi078.stdout:Building dependency tree... 2023-12-12T10:09:48.865 INFO:teuthology.orchestra.run.smithi078.stdout:Reading state information... 2023-12-12T10:09:49.014 INFO:teuthology.orchestra.run.smithi078.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2023-12-12T10:09:49.015 INFO:teuthology.orchestra.run.smithi078.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-12-12T10:09:49.015 INFO:teuthology.orchestra.run.smithi078.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2023-12-12T10:09:49.015 INFO:teuthology.orchestra.run.smithi078.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-12-12T10:09:49.015 INFO:teuthology.orchestra.run.smithi078.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-12-12T10:09:49.015 INFO:teuthology.orchestra.run.smithi078.stdout:The following packages were automatically installed and are no longer required: 2023-12-12T10:09:49.015 INFO:teuthology.orchestra.run.smithi078.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-12-12T10:09:49.015 INFO:teuthology.orchestra.run.smithi078.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-12-12T10:09:49.015 INFO:teuthology.orchestra.run.smithi078.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-12-12T10:09:49.015 INFO:teuthology.orchestra.run.smithi078.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-12-12T10:09:49.015 INFO:teuthology.orchestra.run.smithi078.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-12-12T10:09:49.015 INFO:teuthology.orchestra.run.smithi078.stdout:Use 'sudo apt autoremove' to remove them. 2023-12-12T10:09:49.016 INFO:teuthology.orchestra.run.smithi078.stdout:The following additional packages will be installed: 2023-12-12T10:09:49.016 INFO:teuthology.orchestra.run.smithi078.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2023-12-12T10:09:49.016 INFO:teuthology.orchestra.run.smithi078.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2023-12-12T10:09:49.016 INFO:teuthology.orchestra.run.smithi078.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2023-12-12T10:09:49.016 INFO:teuthology.orchestra.run.smithi078.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2023-12-12T10:09:49.017 INFO:teuthology.orchestra.run.smithi078.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2023-12-12T10:09:49.017 INFO:teuthology.orchestra.run.smithi078.stdout:Suggested packages: 2023-12-12T10:09:49.017 INFO:teuthology.orchestra.run.smithi078.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2023-12-12T10:09:49.017 INFO:teuthology.orchestra.run.smithi078.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2023-12-12T10:09:49.017 INFO:teuthology.orchestra.run.smithi078.stdout: libengine-pkcs11-openssl 2023-12-12T10:09:49.066 INFO:teuthology.orchestra.run.smithi078.stdout:The following NEW packages will be installed: 2023-12-12T10:09:49.067 INFO:teuthology.orchestra.run.smithi078.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2023-12-12T10:09:49.067 INFO:teuthology.orchestra.run.smithi078.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2023-12-12T10:09:49.068 INFO:teuthology.orchestra.run.smithi078.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2023-12-12T10:09:49.068 INFO:teuthology.orchestra.run.smithi078.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2023-12-12T10:09:49.068 INFO:teuthology.orchestra.run.smithi078.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2023-12-12T10:09:49.068 INFO:teuthology.orchestra.run.smithi078.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2023-12-12T10:09:49.068 INFO:teuthology.orchestra.run.smithi078.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-12-12T10:09:49.069 INFO:teuthology.orchestra.run.smithi078.stdout:The following packages will be upgraded: 2023-12-12T10:09:49.069 INFO:teuthology.orchestra.run.smithi078.stdout: libssl3 2023-12-12T10:09:49.122 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2023-12-12T10:09:49.253 INFO:teuthology.orchestra.run.smithi078.stdout:1 upgraded, 39 newly installed, 0 to remove and 265 not upgraded. 2023-12-12T10:09:49.253 INFO:teuthology.orchestra.run.smithi078.stdout:Need to get 54.6 MB of archives. 2023-12-12T10:09:49.253 INFO:teuthology.orchestra.run.smithi078.stdout:After this operation, 202 MB of additional disk space will be used. 2023-12-12T10:09:49.253 INFO:teuthology.orchestra.run.smithi078.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2023-12-12T10:09:49.532 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-certifi (2020.6.20-1) ... 2023-12-12T10:09:49.749 INFO:teuthology.orchestra.run.smithi078.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.12 [1,901 kB] 2023-12-12T10:09:49.783 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2023-12-12T10:09:50.008 INFO:teuthology.orchestra.run.smithi078.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2023-12-12T10:09:50.042 INFO:teuthology.orchestra.run.smithi078.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2023-12-12T10:09:50.044 INFO:teuthology.orchestra.run.smithi078.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2023-12-12T10:09:50.049 INFO:teuthology.orchestra.run.smithi078.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2023-12-12T10:09:50.052 INFO:teuthology.orchestra.run.smithi078.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2023-12-12T10:09:50.053 INFO:teuthology.orchestra.run.smithi078.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2023-12-12T10:09:50.056 INFO:teuthology.orchestra.run.smithi078.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2023-12-12T10:09:50.058 INFO:teuthology.orchestra.run.smithi078.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2023-12-12T10:09:50.059 INFO:teuthology.orchestra.run.smithi078.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2023-12-12T10:09:50.184 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-12-12T10:09:50.223 INFO:teuthology.orchestra.run.smithi078.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2023-12-12T10:09:50.486 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2023-12-12T10:09:50.559 INFO:teuthology.orchestra.run.smithi078.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2023-12-12T10:09:50.812 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-12-12T10:09:51.154 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2023-12-12T10:09:51.423 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2023-12-12T10:09:51.582 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-ceph-common (19.0.0-96-gf1fbf3c5-1jammy) ... 2023-12-12T10:09:51.625 INFO:teuthology.orchestra.run.smithi078.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2023-12-12T10:09:51.626 INFO:teuthology.orchestra.run.smithi078.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2023-12-12T10:09:51.627 INFO:teuthology.orchestra.run.smithi078.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.2 [263 kB] 2023-12-12T10:09:51.630 INFO:teuthology.orchestra.run.smithi078.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2023-12-12T10:09:51.630 INFO:teuthology.orchestra.run.smithi078.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2023-12-12T10:09:51.634 INFO:teuthology.orchestra.run.smithi078.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.10-0ubuntu0.22.04.1 [143 kB] 2023-12-12T10:09:51.636 INFO:teuthology.orchestra.run.smithi078.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2023-12-12T10:09:51.656 INFO:teuthology.orchestra.run.smithi078.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2023-12-12T10:09:51.656 INFO:teuthology.orchestra.run.smithi078.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.12 [2,373 kB] 2023-12-12T10:09:51.883 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-idna (3.3-1) ... 2023-12-12T10:09:51.899 INFO:teuthology.orchestra.run.smithi078.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2023-12-12T10:09:51.981 INFO:teuthology.orchestra.run.smithi078.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.2 [1,094 kB] 2023-12-12T10:09:52.251 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2023-12-12T10:09:52.459 INFO:teuthology.orchestra.run.smithi078.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2023-12-12T10:09:52.589 INFO:teuthology.orchestra.run.smithi078.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2023-12-12T10:09:52.600 INFO:teuthology.orchestra.run.smithi078.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2023-12-12T10:09:52.600 INFO:teuthology.orchestra.run.smithi078.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2023-12-12T10:09:52.602 INFO:teuthology.orchestra.run.smithi078.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2023-12-12T10:09:52.602 INFO:teuthology.orchestra.run.smithi078.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.10-0ubuntu0.22.04.1 [1,223 kB] 2023-12-12T10:09:52.637 INFO:teuthology.orchestra.run.smithi078.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2023-12-12T10:09:52.640 INFO:teuthology.orchestra.run.smithi078.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.10-0ubuntu0.22.04.1 [16.1 MB] 2023-12-12T10:09:53.082 INFO:teuthology.orchestra.run.smithi078.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2023-12-12T10:09:53.246 INFO:teuthology.orchestra.run.smithi078.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2023-12-12T10:09:53.329 INFO:teuthology.orchestra.run.smithi078.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2023-12-12T10:09:53.329 INFO:teuthology.orchestra.run.smithi078.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2023-12-12T10:09:53.413 INFO:teuthology.orchestra.run.smithi078.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2023-12-12T10:09:53.420 INFO:teuthology.orchestra.run.smithi078.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2023-12-12T10:09:53.774 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2023-12-12T10:09:53.928 INFO:teuthology.orchestra.run.smithi078.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2023-12-12T10:09:53.928 INFO:teuthology.orchestra.run.smithi078.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2023-12-12T10:09:54.058 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-12-12T10:09:54.193 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-toml (0.10.2-1) ... 2023-12-12T10:09:54.285 INFO:teuthology.orchestra.run.smithi078.stdout:Preconfiguring packages ... 2023-12-12T10:09:54.425 INFO:teuthology.orchestra.run.smithi078.stdout:Fetched 54.6 MB in 5s (11.3 MB/s) 2023-12-12T10:09:54.519 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2023-12-12T10:09:54.567 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package flex. 2023-12-12T10:09:54.640 INFO:teuthology.orchestra.run.smithi078.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140565 files and directories currently installed.) 2023-12-12T10:09:54.643 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2023-12-12T10:09:54.645 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2023-12-12T10:09:54.683 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking flex (2.6.4-8build2) ... 2023-12-12T10:09:54.779 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2023-12-12T10:09:55.081 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2023-12-12T10:09:55.260 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.12_amd64.deb ... 2023-12-12T10:09:55.382 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2023-12-12T10:09:55.472 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.12) over (3.0.2-0ubuntu1.7) ... 2023-12-12T10:09:55.641 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-12-12T10:09:55.767 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2023-12-12T10:09:55.855 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.12) ... 2023-12-12T10:09:56.085 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2023-12-12T10:09:56.353 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-logutils (0.3.3-8) ... 2023-12-12T10:09:56.456 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package bison. 2023-12-12T10:09:56.529 INFO:teuthology.orchestra.run.smithi078.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140638 files and directories currently installed.) 2023-12-12T10:09:56.532 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2023-12-12T10:09:56.575 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2023-12-12T10:09:56.620 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-tempora (4.1.2-1) ... 2023-12-12T10:09:56.888 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-12-12T10:09:56.987 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-12-12T10:09:57.001 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2023-12-12T10:09:57.036 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2023-12-12T10:09:57.181 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-prettytable (2.5.0-2) ... 2023-12-12T10:09:57.381 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package dump. 2023-12-12T10:09:57.396 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2023-12-12T10:09:57.439 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking dump (0.4b47-3) ... 2023-12-12T10:09:57.457 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-12-12T10:09:57.583 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-websocket (1.2.3-1) ... 2023-12-12T10:09:57.726 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package indent. 2023-12-12T10:09:57.740 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2023-12-12T10:09:57.785 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2023-12-12T10:09:57.876 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2023-12-12T10:09:58.002 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-12-12T10:09:58.087 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-12-12T10:09:58.101 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2023-12-12T10:09:58.145 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2023-12-12T10:09:58.311 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2023-12-12T10:09:58.515 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-12-12T10:09:58.530 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2023-12-12T10:09:58.573 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2023-12-12T10:09:58.604 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2023-12-12T10:09:58.843 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-12-12T10:09:58.855 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2023-12-12T10:09:58.857 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2023-12-12T10:09:58.893 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2023-12-12T10:09:58.981 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2023-12-12T10:09:59.107 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2023-12-12T10:09:59.221 INFO:teuthology.orchestra.run.smithi187.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2023-12-12T10:09:59.229 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libfl2:amd64. 2023-12-12T10:09:59.244 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2023-12-12T10:09:59.312 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2023-12-12T10:09:59.459 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-12-12T10:09:59.565 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libfl-dev:amd64. 2023-12-12T10:09:59.580 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2023-12-12T10:09:59.584 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2023-12-12T10:09:59.623 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2023-12-12T10:09:59.901 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libjson-perl. 2023-12-12T10:09:59.916 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2023-12-12T10:09:59.950 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libjson-perl (4.04000-1) ... 2023-12-12T10:10:00.003 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2023-12-12T10:10:00.278 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libllvm14:amd64. 2023-12-12T10:10:00.294 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2023-12-12T10:10:00.304 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up lua-any (27ubuntu1) ... 2023-12-12T10:10:00.337 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-12-12T10:10:00.421 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-portend (3.0.0-1) ... 2023-12-12T10:10:00.731 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-12-12T10:10:00.857 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2023-12-12T10:10:01.208 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2023-12-12T10:10:01.526 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-12-12T10:10:01.697 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-12-12T10:10:01.713 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-12-12T10:10:01.747 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-12-12T10:10:01.810 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2023-12-12T10:10:02.000 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libmbim-proxy. 2023-12-12T10:10:02.015 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-12-12T10:10:02.038 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-rsa (4.8-1) ... 2023-12-12T10:10:02.058 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-12-12T10:10:02.340 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-webtest (2.0.35-1) ... 2023-12-12T10:10:02.386 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-12-12T10:10:02.401 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-12-12T10:10:02.444 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-12-12T10:10:02.616 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-12-12T10:10:02.788 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libndp0:amd64. 2023-12-12T10:10:02.804 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2023-12-12T10:10:02.863 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2023-12-12T10:10:02.884 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2023-12-12T10:10:03.166 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libnm0:amd64. 2023-12-12T10:10:03.181 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2023-12-12T10:10:03.216 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-12-12T10:10:03.277 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-12-12T10:10:03.570 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2023-12-12T10:10:03.577 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libpq5:amd64. 2023-12-12T10:10:03.591 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../16-libpq5_14.10-0ubuntu0.22.04.1_amd64.deb ... 2023-12-12T10:10:03.635 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libpq5:amd64 (14.10-0ubuntu0.22.04.1) ... 2023-12-12T10:10:03.940 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-12-12T10:10:04.004 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-12-12T10:10:04.019 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-12-12T10:10:04.063 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-12-12T10:10:04.065 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up librados2 (19.0.0-96-gf1fbf3c5-1jammy) ... 2023-12-12T10:10:04.216 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libsqlite3-mod-ceph (19.0.0-96-gf1fbf3c5-1jammy) ... 2023-12-12T10:10:04.342 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2023-12-12T10:10:04.398 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libqmi-proxy. 2023-12-12T10:10:04.413 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-12-12T10:10:04.457 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-12-12T10:10:04.684 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-12-12T10:10:04.686 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libcephfs2 (19.0.0-96-gf1fbf3c5-1jammy) ... 2023-12-12T10:10:04.698 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.12_amd64.deb ... 2023-12-12T10:10:04.759 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2023-12-12T10:10:04.788 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libradosstriper1 (19.0.0-96-gf1fbf3c5-1jammy) ... 2023-12-12T10:10:04.922 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-google-auth (1.5.1-3) ... 2023-12-12T10:10:05.257 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up librbd1 (19.0.0-96-gf1fbf3c5-1jammy) ... 2023-12-12T10:10:05.279 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-12-12T10:10:05.293 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2023-12-12T10:10:05.337 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2023-12-12T10:10:05.383 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up ceph-mgr-modules-core (19.0.0-96-gf1fbf3c5-1jammy) ... 2023-12-12T10:10:05.542 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up ceph-fuse (19.0.0-96-gf1fbf3c5-1jammy) ... 2023-12-12T10:10:05.706 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package modemmanager. 2023-12-12T10:10:05.721 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-12-12T10:10:05.754 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-12-12T10:10:05.754 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-12-12T10:10:05.765 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-12-12T10:10:06.385 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libcephfs-dev (19.0.0-96-gf1fbf3c5-1jammy) ... 2023-12-12T10:10:06.446 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package network-manager. 2023-12-12T10:10:06.461 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2023-12-12T10:10:06.494 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-rados (19.0.0-96-gf1fbf3c5-1jammy) ... 2023-12-12T10:10:06.504 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2023-12-12T10:10:06.603 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up librgw2 (19.0.0-96-gf1fbf3c5-1jammy) ... 2023-12-12T10:10:06.705 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up cephfs-top (19.0.0-96-gf1fbf3c5-1jammy) ... 2023-12-12T10:10:06.881 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2023-12-12T10:10:07.186 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ppp. 2023-12-12T10:10:07.202 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2023-12-12T10:10:07.534 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2023-12-12T10:10:07.882 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package pptp-linux. 2023-12-12T10:10:07.896 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2023-12-12T10:10:07.940 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2023-12-12T10:10:08.159 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-rbd (19.0.0-96-gf1fbf3c5-1jammy) ... 2023-12-12T10:10:08.235 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package network-manager-pptp. 2023-12-12T10:10:08.249 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2023-12-12T10:10:08.285 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2023-12-12T10:10:08.285 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up rbd-fuse (19.0.0-96-gf1fbf3c5-1jammy) ... 2023-12-12T10:10:08.411 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-rgw (19.0.0-96-gf1fbf3c5-1jammy) ... 2023-12-12T10:10:08.537 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up python3-cephfs (19.0.0-96-gf1fbf3c5-1jammy) ... 2023-12-12T10:10:08.583 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package postgresql-client-common. 2023-12-12T10:10:08.597 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2023-12-12T10:10:08.645 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking postgresql-client-common (238) ... 2023-12-12T10:10:08.689 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up cephfs-shell (19.0.0-96-gf1fbf3c5-1jammy) ... 2023-12-12T10:10:08.798 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up ceph-common (19.0.0-96-gf1fbf3c5-1jammy) ... 2023-12-12T10:10:08.932 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package postgresql-client-14. 2023-12-12T10:10:08.947 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../27-postgresql-client-14_14.10-0ubuntu0.22.04.1_amd64.deb ... 2023-12-12T10:10:09.374 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking postgresql-client-14 (14.10-0ubuntu0.22.04.1) ... 2023-12-12T10:10:09.394 INFO:teuthology.orchestra.run.smithi187.stdout:Adding group ceph....done 2023-12-12T10:10:09.794 INFO:teuthology.orchestra.run.smithi187.stdout:Adding system user ceph....done 2023-12-12T10:10:10.014 INFO:teuthology.orchestra.run.smithi187.stdout:Setting system user ceph properties....done 2023-12-12T10:10:10.034 INFO:teuthology.orchestra.run.smithi187.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-12-12T10:10:10.037 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package postgresql-common. 2023-12-12T10:10:10.053 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2023-12-12T10:10:10.132 INFO:teuthology.orchestra.run.smithi078.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-12-12T10:10:10.170 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking postgresql-common (238) ... 2023-12-12T10:10:10.178 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-12-12T10:10:10.552 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-12-12T10:10:10.678 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package postgresql-14. 2023-12-12T10:10:10.693 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../29-postgresql-14_14.10-0ubuntu0.22.04.1_amd64.deb ... 2023-12-12T10:10:10.739 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking postgresql-14 (14.10-0ubuntu0.22.04.1) ... 2023-12-12T10:10:11.400 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up cephfs-mirror (19.0.0-96-gf1fbf3c5-1jammy) ... 2023-12-12T10:10:11.617 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-12-12T10:10:11.617 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-12-12T10:10:11.830 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package postgresql. 2023-12-12T10:10:11.845 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2023-12-12T10:10:11.888 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking postgresql (14+238) ... 2023-12-12T10:10:12.165 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package postgresql-client. 2023-12-12T10:10:12.180 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2023-12-12T10:10:12.224 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking postgresql-client (14+238) ... 2023-12-12T10:10:12.251 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up ceph-test (19.0.0-96-gf1fbf3c5-1jammy) ... 2023-12-12T10:10:12.377 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up radosgw (19.0.0-96-gf1fbf3c5-1jammy) ... 2023-12-12T10:10:12.450 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package postgresql-contrib. 2023-12-12T10:10:12.465 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2023-12-12T10:10:12.509 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking postgresql-contrib (14+238) ... 2023-12-12T10:10:12.845 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package tcl8.6. 2023-12-12T10:10:12.860 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2023-12-12T10:10:12.883 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-12-12T10:10:12.883 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-12-12T10:10:12.895 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2023-12-12T10:10:13.164 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package tcl. 2023-12-12T10:10:13.179 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2023-12-12T10:10:13.227 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking tcl (8.6.11+1build2) ... 2023-12-12T10:10:13.528 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up ceph-base (19.0.0-96-gf1fbf3c5-1jammy) ... 2023-12-12T10:10:13.583 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package wpasupplicant. 2023-12-12T10:10:13.602 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2023-12-12T10:10:13.641 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2023-12-12T10:10:13.916 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-12-12T10:10:14.021 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-12-12T10:10:14.036 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2023-12-12T10:10:14.079 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2023-12-12T10:10:14.490 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package usb-modeswitch. 2023-12-12T10:10:14.506 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2023-12-12T10:10:14.557 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2023-12-12T10:10:14.591 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up ceph-mds (19.0.0-96-gf1fbf3c5-1jammy) ... 2023-12-12T10:10:14.824 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-12-12T10:10:14.824 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-12-12T10:10:14.842 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up postgresql-client-common (238) ... 2023-12-12T10:10:15.080 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up flex (2.6.4-8build2) ... 2023-12-12T10:10:15.205 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2023-12-12T10:10:15.332 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libpq5:amd64 (14.10-0ubuntu0.22.04.1) ... 2023-12-12T10:10:15.460 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up ceph-mgr (19.0.0-96-gf1fbf3c5-1jammy) ... 2023-12-12T10:10:15.482 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2023-12-12T10:10:15.608 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2023-12-12T10:10:15.673 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-12-12T10:10:15.674 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-12-12T10:10:15.734 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up postgresql-client-14 (14.10-0ubuntu0.22.04.1) ... 2023-12-12T10:10:16.353 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up ceph-osd (19.0.0-96-gf1fbf3c5-1jammy) ... 2023-12-12T10:10:16.681 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-12-12T10:10:16.682 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-12-12T10:10:16.740 INFO:teuthology.orchestra.run.smithi078.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-12-12T10:10:16.839 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2023-12-12T10:10:17.234 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-12-12T10:10:17.234 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-12-12T10:10:17.329 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up ceph-mgr-k8sevents (19.0.0-96-gf1fbf3c5-1jammy) ... 2023-12-12T10:10:17.430 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-96-gf1fbf3c5-1jammy) ... 2023-12-12T10:10:17.565 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up ceph-mon (19.0.0-96-gf1fbf3c5-1jammy) ... 2023-12-12T10:10:17.799 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-12-12T10:10:17.799 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-12-12T10:10:17.975 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2023-12-12T10:10:18.085 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2023-12-12T10:10:18.211 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2023-12-12T10:10:18.370 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2023-12-12T10:10:18.416 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up ceph-mgr-cephadm (19.0.0-96-gf1fbf3c5-1jammy) ... 2023-12-12T10:10:18.496 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2023-12-12T10:10:18.584 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up ceph (19.0.0-96-gf1fbf3c5-1jammy) ... 2023-12-12T10:10:18.622 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-12-12T10:10:18.709 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up ceph-mgr-dashboard (19.0.0-96-gf1fbf3c5-1jammy) ... 2023-12-12T10:10:18.748 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2023-12-12T10:10:18.852 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up ceph-volume (19.0.0-96-gf1fbf3c5-1jammy) ... 2023-12-12T10:10:19.230 INFO:teuthology.orchestra.run.smithi187.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2023-12-12T10:10:19.339 INFO:teuthology.orchestra.run.smithi187.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-12-12T10:10:19.516 INFO:teuthology.orchestra.run.smithi187.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-12-12T10:10:19.883 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-12-12T10:10:20.088 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up dump (0.4b47-3) ... 2023-12-12T10:10:20.183 INFO:teuthology.orchestra.run.smithi078.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-12-12T10:10:20.247 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-12-12T10:10:20.407 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2023-12-12T10:10:20.533 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up tcl (8.6.11+1build2) ... 2023-12-12T10:10:20.659 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libjson-perl (4.04000-1) ... 2023-12-12T10:10:20.756 INFO:teuthology.orchestra.run.smithi187.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-12-12T10:10:20.793 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2023-12-12T10:10:20.891 INFO:teuthology.orchestra.run.smithi078.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2023-12-12T10:10:20.961 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2023-12-12T10:10:21.062 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2023-12-12T10:10:21.239 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2023-12-12T10:10:21.398 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-12-12T10:10:21.458 INFO:teuthology.orchestra.run.smithi187.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-12-12T10:10:21.463 DEBUG:teuthology.orchestra.run.smithi187:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-12-12T10:10:21.523 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2023-12-12T10:10:21.538 INFO:teuthology.orchestra.run.smithi187.stdout:Reading package lists... 2023-12-12T10:10:21.692 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up postgresql-client (14+238) ... 2023-12-12T10:10:21.707 INFO:teuthology.orchestra.run.smithi187.stdout:Building dependency tree... 2023-12-12T10:10:21.708 INFO:teuthology.orchestra.run.smithi187.stdout:Reading state information... 2023-12-12T10:10:21.793 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2023-12-12T10:10:21.861 INFO:teuthology.orchestra.run.smithi187.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2023-12-12T10:10:21.861 INFO:teuthology.orchestra.run.smithi187.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-12-12T10:10:21.861 INFO:teuthology.orchestra.run.smithi187.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2023-12-12T10:10:21.862 INFO:teuthology.orchestra.run.smithi187.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-12-12T10:10:21.862 INFO:teuthology.orchestra.run.smithi187.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-12-12T10:10:21.862 INFO:teuthology.orchestra.run.smithi187.stdout:The following packages were automatically installed and are no longer required: 2023-12-12T10:10:21.862 INFO:teuthology.orchestra.run.smithi187.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-12-12T10:10:21.862 INFO:teuthology.orchestra.run.smithi187.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-12-12T10:10:21.862 INFO:teuthology.orchestra.run.smithi187.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-12-12T10:10:21.862 INFO:teuthology.orchestra.run.smithi187.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-12-12T10:10:21.863 INFO:teuthology.orchestra.run.smithi187.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-12-12T10:10:21.863 INFO:teuthology.orchestra.run.smithi187.stdout:Use 'sudo apt autoremove' to remove them. 2023-12-12T10:10:21.863 INFO:teuthology.orchestra.run.smithi187.stdout:The following additional packages will be installed: 2023-12-12T10:10:21.863 INFO:teuthology.orchestra.run.smithi187.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2023-12-12T10:10:21.863 INFO:teuthology.orchestra.run.smithi187.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2023-12-12T10:10:21.864 INFO:teuthology.orchestra.run.smithi187.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2023-12-12T10:10:21.864 INFO:teuthology.orchestra.run.smithi187.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2023-12-12T10:10:21.864 INFO:teuthology.orchestra.run.smithi187.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2023-12-12T10:10:21.864 INFO:teuthology.orchestra.run.smithi187.stdout:Suggested packages: 2023-12-12T10:10:21.864 INFO:teuthology.orchestra.run.smithi187.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2023-12-12T10:10:21.864 INFO:teuthology.orchestra.run.smithi187.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2023-12-12T10:10:21.865 INFO:teuthology.orchestra.run.smithi187.stdout: libengine-pkcs11-openssl 2023-12-12T10:10:21.914 INFO:teuthology.orchestra.run.smithi187.stdout:The following NEW packages will be installed: 2023-12-12T10:10:21.915 INFO:teuthology.orchestra.run.smithi187.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2023-12-12T10:10:21.915 INFO:teuthology.orchestra.run.smithi187.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2023-12-12T10:10:21.915 INFO:teuthology.orchestra.run.smithi187.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2023-12-12T10:10:21.916 INFO:teuthology.orchestra.run.smithi187.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2023-12-12T10:10:21.916 INFO:teuthology.orchestra.run.smithi187.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2023-12-12T10:10:21.916 INFO:teuthology.orchestra.run.smithi187.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2023-12-12T10:10:21.916 INFO:teuthology.orchestra.run.smithi187.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-12-12T10:10:21.917 INFO:teuthology.orchestra.run.smithi187.stdout:The following packages will be upgraded: 2023-12-12T10:10:21.917 INFO:teuthology.orchestra.run.smithi187.stdout: libssl3 2023-12-12T10:10:21.973 INFO:teuthology.orchestra.run.smithi187.stdout:1 upgraded, 39 newly installed, 0 to remove and 265 not upgraded. 2023-12-12T10:10:21.973 INFO:teuthology.orchestra.run.smithi187.stdout:Need to get 54.6 MB of archives. 2023-12-12T10:10:21.973 INFO:teuthology.orchestra.run.smithi187.stdout:After this operation, 202 MB of additional disk space will be used. 2023-12-12T10:10:21.973 INFO:teuthology.orchestra.run.smithi187.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2023-12-12T10:10:22.076 INFO:teuthology.orchestra.run.smithi187.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.12 [1,901 kB] 2023-12-12T10:10:22.130 INFO:teuthology.orchestra.run.smithi187.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2023-12-12T10:10:22.138 INFO:teuthology.orchestra.run.smithi187.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2023-12-12T10:10:22.138 INFO:teuthology.orchestra.run.smithi187.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2023-12-12T10:10:22.140 INFO:teuthology.orchestra.run.smithi187.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2023-12-12T10:10:22.141 INFO:teuthology.orchestra.run.smithi187.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2023-12-12T10:10:22.142 INFO:teuthology.orchestra.run.smithi187.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2023-12-12T10:10:22.143 INFO:teuthology.orchestra.run.smithi187.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2023-12-12T10:10:22.144 INFO:teuthology.orchestra.run.smithi187.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2023-12-12T10:10:22.144 INFO:teuthology.orchestra.run.smithi187.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2023-12-12T10:10:22.149 INFO:teuthology.orchestra.run.smithi187.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2023-12-12T10:10:22.161 INFO:teuthology.orchestra.run.smithi187.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2023-12-12T10:10:22.387 INFO:teuthology.orchestra.run.smithi187.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2023-12-12T10:10:22.389 INFO:teuthology.orchestra.run.smithi187.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2023-12-12T10:10:22.389 INFO:teuthology.orchestra.run.smithi187.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.2 [263 kB] 2023-12-12T10:10:22.392 INFO:teuthology.orchestra.run.smithi187.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2023-12-12T10:10:22.393 INFO:teuthology.orchestra.run.smithi187.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2023-12-12T10:10:22.397 INFO:teuthology.orchestra.run.smithi187.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.10-0ubuntu0.22.04.1 [143 kB] 2023-12-12T10:10:22.399 INFO:teuthology.orchestra.run.smithi187.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2023-12-12T10:10:22.406 INFO:teuthology.orchestra.run.smithi187.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2023-12-12T10:10:22.406 INFO:teuthology.orchestra.run.smithi187.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.12 [2,373 kB] 2023-12-12T10:10:22.428 INFO:teuthology.orchestra.run.smithi187.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2023-12-12T10:10:22.429 INFO:teuthology.orchestra.run.smithi187.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.2 [1,094 kB] 2023-12-12T10:10:22.439 INFO:teuthology.orchestra.run.smithi187.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2023-12-12T10:10:22.441 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:10:22.441 INFO:teuthology.orchestra.run.smithi078.stdout:The following network interfaces were found in /etc/network/interfaces 2023-12-12T10:10:22.441 INFO:teuthology.orchestra.run.smithi078.stdout:which means they are currently configured by ifupdown: 2023-12-12T10:10:22.441 INFO:teuthology.orchestra.run.smithi078.stdout:- enp3s0f1 2023-12-12T10:10:22.441 INFO:teuthology.orchestra.run.smithi078.stdout:If you want to manage those interfaces with NetworkManager instead 2023-12-12T10:10:22.441 INFO:teuthology.orchestra.run.smithi078.stdout:remove their configuration from /etc/network/interfaces. 2023-12-12T10:10:22.441 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:10:22.461 INFO:teuthology.orchestra.run.smithi187.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2023-12-12T10:10:22.465 INFO:teuthology.orchestra.run.smithi187.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2023-12-12T10:10:22.465 INFO:teuthology.orchestra.run.smithi187.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2023-12-12T10:10:22.466 INFO:teuthology.orchestra.run.smithi187.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2023-12-12T10:10:22.467 INFO:teuthology.orchestra.run.smithi187.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.10-0ubuntu0.22.04.1 [1,223 kB] 2023-12-12T10:10:22.479 INFO:teuthology.orchestra.run.smithi187.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2023-12-12T10:10:22.481 INFO:teuthology.orchestra.run.smithi187.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.10-0ubuntu0.22.04.1 [16.1 MB] 2023-12-12T10:10:22.575 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-12-12T10:10:22.633 INFO:teuthology.orchestra.run.smithi187.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2023-12-12T10:10:22.633 INFO:teuthology.orchestra.run.smithi187.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2023-12-12T10:10:22.633 INFO:teuthology.orchestra.run.smithi187.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2023-12-12T10:10:22.633 INFO:teuthology.orchestra.run.smithi187.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2023-12-12T10:10:22.634 INFO:teuthology.orchestra.run.smithi187.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2023-12-12T10:10:22.634 INFO:teuthology.orchestra.run.smithi187.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2023-12-12T10:10:22.646 INFO:teuthology.orchestra.run.smithi187.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2023-12-12T10:10:22.647 INFO:teuthology.orchestra.run.smithi187.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2023-12-12T10:10:22.963 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-12-12T10:10:23.025 INFO:teuthology.orchestra.run.smithi187.stdout:Preconfiguring packages ... 2023-12-12T10:10:23.184 INFO:teuthology.orchestra.run.smithi187.stdout:Fetched 54.6 MB in 1s (75.7 MB/s) 2023-12-12T10:10:23.325 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package flex. 2023-12-12T10:10:23.379 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-12-12T10:10:23.399 INFO:teuthology.orchestra.run.smithi187.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140565 files and directories currently installed.) 2023-12-12T10:10:23.402 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2023-12-12T10:10:23.457 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking flex (2.6.4-8build2) ... 2023-12-12T10:10:23.985 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.12_amd64.deb ... 2023-12-12T10:10:24.079 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-12-12T10:10:24.171 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.12) over (3.0.2-0ubuntu1.7) ... 2023-12-12T10:10:24.230 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2023-12-12T10:10:24.381 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2023-12-12T10:10:24.507 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up postgresql-common (238) ... 2023-12-12T10:10:24.604 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.12) ... 2023-12-12T10:10:25.155 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package bison. 2023-12-12T10:10:25.228 INFO:teuthology.orchestra.run.smithi187.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140638 files and directories currently installed.) 2023-12-12T10:10:25.232 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2023-12-12T10:10:25.282 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2023-12-12T10:10:25.515 INFO:teuthology.orchestra.run.smithi078.stdout:Adding user postgres to group ssl-cert 2023-12-12T10:10:25.693 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-12-12T10:10:25.707 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2023-12-12T10:10:25.751 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2023-12-12T10:10:25.783 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:10:25.783 INFO:teuthology.orchestra.run.smithi078.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-12-12T10:10:26.037 INFO:teuthology.orchestra.run.smithi078.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-12-12T10:10:26.037 INFO:teuthology.orchestra.run.smithi078.stdout:Removing obsolete dictionary files: 2023-12-12T10:10:26.132 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package dump. 2023-12-12T10:10:26.147 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2023-12-12T10:10:26.196 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking dump (0.4b47-3) ... 2023-12-12T10:10:26.466 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package indent. 2023-12-12T10:10:26.480 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2023-12-12T10:10:26.524 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2023-12-12T10:10:26.733 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-12-12T10:10:26.785 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-12-12T10:10:26.800 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2023-12-12T10:10:26.835 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2023-12-12T10:10:27.188 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-12-12T10:10:27.203 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2023-12-12T10:10:27.247 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2023-12-12T10:10:27.301 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up postgresql-14 (14.10-0ubuntu0.22.04.1) ... 2023-12-12T10:10:27.541 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-12-12T10:10:27.557 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2023-12-12T10:10:27.607 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2023-12-12T10:10:27.644 INFO:teuthology.orchestra.run.smithi078.stdout:Creating new PostgreSQL cluster 14/main ... 2023-12-12T10:10:27.665 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2023-12-12T10:10:27.711 INFO:teuthology.orchestra.run.smithi078.stdout:The files belonging to this database system will be owned by user "postgres". 2023-12-12T10:10:27.711 INFO:teuthology.orchestra.run.smithi078.stdout:This user must also own the server process. 2023-12-12T10:10:27.711 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:10:27.711 INFO:teuthology.orchestra.run.smithi078.stdout:The database cluster will be initialized with locale "en_US". 2023-12-12T10:10:27.711 INFO:teuthology.orchestra.run.smithi078.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-12-12T10:10:27.711 INFO:teuthology.orchestra.run.smithi078.stdout:The default text search configuration will be set to "english". 2023-12-12T10:10:27.711 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:10:27.711 INFO:teuthology.orchestra.run.smithi078.stdout:Data page checksums are disabled. 2023-12-12T10:10:27.712 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:10:27.712 INFO:teuthology.orchestra.run.smithi078.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2023-12-12T10:10:27.712 INFO:teuthology.orchestra.run.smithi078.stdout:creating subdirectories ... ok 2023-12-12T10:10:27.712 INFO:teuthology.orchestra.run.smithi078.stdout:selecting dynamic shared memory implementation ... posix 2023-12-12T10:10:27.736 INFO:teuthology.orchestra.run.smithi078.stdout:selecting default max_connections ... 100 2023-12-12T10:10:27.772 INFO:teuthology.orchestra.run.smithi078.stdout:selecting default shared_buffers ... 128MB 2023-12-12T10:10:27.785 INFO:teuthology.orchestra.run.smithi078.stdout:selecting default time zone ... Etc/UTC 2023-12-12T10:10:27.786 INFO:teuthology.orchestra.run.smithi078.stdout:creating configuration files ... ok 2023-12-12T10:10:27.952 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libfl2:amd64. 2023-12-12T10:10:27.954 INFO:teuthology.orchestra.run.smithi078.stdout:running bootstrap script ... ok 2023-12-12T10:10:27.968 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2023-12-12T10:10:28.002 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2023-12-12T10:10:28.246 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libfl-dev:amd64. 2023-12-12T10:10:28.262 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2023-12-12T10:10:28.296 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2023-12-12T10:10:28.549 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libjson-perl. 2023-12-12T10:10:28.565 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2023-12-12T10:10:28.586 INFO:teuthology.orchestra.run.smithi078.stdout:performing post-bootstrap initialization ... ok 2023-12-12T10:10:28.607 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libjson-perl (4.04000-1) ... 2023-12-12T10:10:28.918 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libllvm14:amd64. 2023-12-12T10:10:28.934 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2023-12-12T10:10:28.968 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-12-12T10:10:29.199 INFO:teuthology.orchestra.run.smithi078.stdout:syncing data to disk ... ok 2023-12-12T10:10:29.732 INFO:teuthology.orchestra.run.smithi078.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-12-12T10:10:30.346 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-12-12T10:10:30.362 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-12-12T10:10:30.404 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-12-12T10:10:30.640 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libmbim-proxy. 2023-12-12T10:10:30.656 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-12-12T10:10:30.699 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-12-12T10:10:31.043 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-12-12T10:10:31.059 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-12-12T10:10:31.101 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-12-12T10:10:31.504 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libndp0:amd64. 2023-12-12T10:10:31.520 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2023-12-12T10:10:31.562 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2023-12-12T10:10:31.907 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libnm0:amd64. 2023-12-12T10:10:31.922 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2023-12-12T10:10:31.965 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-12-12T10:10:32.309 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libpq5:amd64. 2023-12-12T10:10:32.325 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../16-libpq5_14.10-0ubuntu0.22.04.1_amd64.deb ... 2023-12-12T10:10:32.367 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libpq5:amd64 (14.10-0ubuntu0.22.04.1) ... 2023-12-12T10:10:32.700 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-12-12T10:10:32.720 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-12-12T10:10:32.736 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-12-12T10:10:32.778 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-12-12T10:10:32.809 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up postgresql-contrib (14+238) ... 2023-12-12T10:10:32.968 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up postgresql (14+238) ... 2023-12-12T10:10:33.081 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libqmi-proxy. 2023-12-12T10:10:33.094 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-12-12T10:10:33.097 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-12-12T10:10:33.173 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-12-12T10:10:33.220 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-12-12T10:10:33.433 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-12-12T10:10:33.449 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.12_amd64.deb ... 2023-12-12T10:10:33.479 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-12-12T10:10:33.479 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-12-12T10:10:33.491 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2023-12-12T10:10:33.970 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-12-12T10:10:33.984 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2023-12-12T10:10:34.061 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2023-12-12T10:10:34.248 INFO:teuthology.orchestra.run.smithi078.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-12-12T10:10:34.406 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package modemmanager. 2023-12-12T10:10:34.421 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-12-12T10:10:34.464 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-12-12T10:10:34.616 INFO:teuthology.orchestra.run.smithi078.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-12-12T10:10:34.784 INFO:teuthology.orchestra.run.smithi078.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-12-12T10:10:35.053 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package network-manager. 2023-12-12T10:10:35.070 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2023-12-12T10:10:35.112 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2023-12-12T10:10:35.727 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package ppp. 2023-12-12T10:10:35.742 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2023-12-12T10:10:36.097 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2023-12-12T10:10:36.187 INFO:teuthology.orchestra.run.smithi078.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2023-12-12T10:10:36.287 INFO:teuthology.orchestra.run.smithi078.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-12-12T10:10:36.440 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package pptp-linux. 2023-12-12T10:10:36.454 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2023-12-12T10:10:36.506 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2023-12-12T10:10:36.794 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package network-manager-pptp. 2023-12-12T10:10:36.807 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2023-12-12T10:10:36.849 INFO:teuthology.orchestra.run.smithi078.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-12-12T10:10:36.850 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2023-12-12T10:10:36.856 DEBUG:teuthology.parallel:result is None 2023-12-12T10:10:37.137 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package postgresql-client-common. 2023-12-12T10:10:37.152 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2023-12-12T10:10:37.220 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking postgresql-client-common (238) ... 2023-12-12T10:10:37.515 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package postgresql-client-14. 2023-12-12T10:10:37.531 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../27-postgresql-client-14_14.10-0ubuntu0.22.04.1_amd64.deb ... 2023-12-12T10:10:37.565 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking postgresql-client-14 (14.10-0ubuntu0.22.04.1) ... 2023-12-12T10:10:38.153 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package postgresql-common. 2023-12-12T10:10:38.168 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2023-12-12T10:10:38.221 INFO:teuthology.orchestra.run.smithi187.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-12-12T10:10:38.252 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking postgresql-common (238) ... 2023-12-12T10:10:38.760 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package postgresql-14. 2023-12-12T10:10:38.775 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../29-postgresql-14_14.10-0ubuntu0.22.04.1_amd64.deb ... 2023-12-12T10:10:38.821 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking postgresql-14 (14.10-0ubuntu0.22.04.1) ... 2023-12-12T10:10:40.022 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package postgresql. 2023-12-12T10:10:40.037 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2023-12-12T10:10:40.080 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking postgresql (14+238) ... 2023-12-12T10:10:40.282 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package postgresql-client. 2023-12-12T10:10:40.297 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2023-12-12T10:10:40.340 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking postgresql-client (14+238) ... 2023-12-12T10:10:40.609 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package postgresql-contrib. 2023-12-12T10:10:40.624 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2023-12-12T10:10:40.668 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking postgresql-contrib (14+238) ... 2023-12-12T10:10:41.003 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package tcl8.6. 2023-12-12T10:10:41.018 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2023-12-12T10:10:41.061 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2023-12-12T10:10:41.372 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package tcl. 2023-12-12T10:10:41.388 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2023-12-12T10:10:41.435 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking tcl (8.6.11+1build2) ... 2023-12-12T10:10:41.800 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package wpasupplicant. 2023-12-12T10:10:41.816 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2023-12-12T10:10:41.925 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2023-12-12T10:10:42.296 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-12-12T10:10:42.312 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2023-12-12T10:10:42.354 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2023-12-12T10:10:42.774 INFO:teuthology.orchestra.run.smithi187.stdout:Selecting previously unselected package usb-modeswitch. 2023-12-12T10:10:42.790 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2023-12-12T10:10:42.841 INFO:teuthology.orchestra.run.smithi187.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2023-12-12T10:10:43.118 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up postgresql-client-common (238) ... 2023-12-12T10:10:43.338 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up flex (2.6.4-8build2) ... 2023-12-12T10:10:43.464 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2023-12-12T10:10:43.590 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libpq5:amd64 (14.10-0ubuntu0.22.04.1) ... 2023-12-12T10:10:43.699 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2023-12-12T10:10:43.809 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2023-12-12T10:10:43.935 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up postgresql-client-14 (14.10-0ubuntu0.22.04.1) ... 2023-12-12T10:10:44.983 INFO:teuthology.orchestra.run.smithi187.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-12-12T10:10:45.066 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2023-12-12T10:10:45.840 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-12-12T10:10:45.840 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-12-12T10:10:46.502 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2023-12-12T10:10:46.628 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2023-12-12T10:10:46.754 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2023-12-12T10:10:46.905 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2023-12-12T10:10:47.014 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2023-12-12T10:10:47.115 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-12-12T10:10:47.217 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2023-12-12T10:10:47.922 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-12-12T10:10:48.031 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up dump (0.4b47-3) ... 2023-12-12T10:10:48.118 INFO:teuthology.orchestra.run.smithi187.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-12-12T10:10:48.208 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-12-12T10:10:48.309 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2023-12-12T10:10:48.435 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up tcl (8.6.11+1build2) ... 2023-12-12T10:10:48.561 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libjson-perl (4.04000-1) ... 2023-12-12T10:10:48.712 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2023-12-12T10:10:48.802 INFO:teuthology.orchestra.run.smithi187.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2023-12-12T10:10:48.872 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2023-12-12T10:10:48.998 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2023-12-12T10:10:49.183 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2023-12-12T10:10:49.284 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-12-12T10:10:49.401 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2023-12-12T10:10:49.603 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up postgresql-client (14+238) ... 2023-12-12T10:10:49.729 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2023-12-12T10:10:50.341 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-12-12T10:10:50.341 INFO:teuthology.orchestra.run.smithi187.stdout:The following network interfaces were found in /etc/network/interfaces 2023-12-12T10:10:50.341 INFO:teuthology.orchestra.run.smithi187.stdout:which means they are currently configured by ifupdown: 2023-12-12T10:10:50.341 INFO:teuthology.orchestra.run.smithi187.stdout:- enp3s0f1 2023-12-12T10:10:50.342 INFO:teuthology.orchestra.run.smithi187.stdout:If you want to manage those interfaces with NetworkManager instead 2023-12-12T10:10:50.342 INFO:teuthology.orchestra.run.smithi187.stdout:remove their configuration from /etc/network/interfaces. 2023-12-12T10:10:50.342 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-12-12T10:10:50.475 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-12-12T10:10:50.884 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-12-12T10:10:51.301 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-12-12T10:10:51.990 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-12-12T10:10:52.158 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2023-12-12T10:10:52.334 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2023-12-12T10:10:52.476 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up postgresql-common (238) ... 2023-12-12T10:10:53.429 INFO:teuthology.orchestra.run.smithi187.stdout:Adding user postgres to group ssl-cert 2023-12-12T10:10:53.732 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-12-12T10:10:53.732 INFO:teuthology.orchestra.run.smithi187.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-12-12T10:10:53.996 INFO:teuthology.orchestra.run.smithi187.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-12-12T10:10:53.996 INFO:teuthology.orchestra.run.smithi187.stdout:Removing obsolete dictionary files: 2023-12-12T10:10:54.754 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-12-12T10:10:55.228 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up postgresql-14 (14.10-0ubuntu0.22.04.1) ... 2023-12-12T10:10:55.567 INFO:teuthology.orchestra.run.smithi187.stdout:Creating new PostgreSQL cluster 14/main ... 2023-12-12T10:10:55.582 INFO:teuthology.orchestra.run.smithi187.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2023-12-12T10:10:55.635 INFO:teuthology.orchestra.run.smithi187.stdout:The files belonging to this database system will be owned by user "postgres". 2023-12-12T10:10:55.635 INFO:teuthology.orchestra.run.smithi187.stdout:This user must also own the server process. 2023-12-12T10:10:55.635 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-12-12T10:10:55.635 INFO:teuthology.orchestra.run.smithi187.stdout:The database cluster will be initialized with locale "en_US". 2023-12-12T10:10:55.635 INFO:teuthology.orchestra.run.smithi187.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-12-12T10:10:55.635 INFO:teuthology.orchestra.run.smithi187.stdout:The default text search configuration will be set to "english". 2023-12-12T10:10:55.635 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-12-12T10:10:55.635 INFO:teuthology.orchestra.run.smithi187.stdout:Data page checksums are disabled. 2023-12-12T10:10:55.635 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-12-12T10:10:55.635 INFO:teuthology.orchestra.run.smithi187.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2023-12-12T10:10:55.636 INFO:teuthology.orchestra.run.smithi187.stdout:creating subdirectories ... ok 2023-12-12T10:10:55.636 INFO:teuthology.orchestra.run.smithi187.stdout:selecting dynamic shared memory implementation ... posix 2023-12-12T10:10:55.660 INFO:teuthology.orchestra.run.smithi187.stdout:selecting default max_connections ... 100 2023-12-12T10:10:55.695 INFO:teuthology.orchestra.run.smithi187.stdout:selecting default shared_buffers ... 128MB 2023-12-12T10:10:55.709 INFO:teuthology.orchestra.run.smithi187.stdout:selecting default time zone ... Etc/UTC 2023-12-12T10:10:55.709 INFO:teuthology.orchestra.run.smithi187.stdout:creating configuration files ... ok 2023-12-12T10:10:55.878 INFO:teuthology.orchestra.run.smithi187.stdout:running bootstrap script ... ok 2023-12-12T10:10:56.507 INFO:teuthology.orchestra.run.smithi187.stdout:performing post-bootstrap initialization ... ok 2023-12-12T10:10:57.218 INFO:teuthology.orchestra.run.smithi187.stdout:syncing data to disk ... ok 2023-12-12T10:10:57.759 INFO:teuthology.orchestra.run.smithi187.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-12-12T10:11:01.044 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-12-12T10:11:01.162 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up postgresql-contrib (14+238) ... 2023-12-12T10:11:01.296 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up postgresql (14+238) ... 2023-12-12T10:11:01.422 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-12-12T10:11:01.548 INFO:teuthology.orchestra.run.smithi187.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-12-12T10:11:01.836 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-12-12T10:11:01.837 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-12-12T10:11:02.558 INFO:teuthology.orchestra.run.smithi187.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-12-12T10:11:02.910 INFO:teuthology.orchestra.run.smithi187.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-12-12T10:11:03.095 INFO:teuthology.orchestra.run.smithi187.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-12-12T10:11:04.706 INFO:teuthology.orchestra.run.smithi187.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2023-12-12T10:11:04.848 INFO:teuthology.orchestra.run.smithi187.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-12-12T10:11:05.409 INFO:teuthology.orchestra.run.smithi187.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-12-12T10:11:05.416 DEBUG:teuthology.parallel:result is None 2023-12-12T10:11:05.417 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=f1fbf3c583d03e19f5e58eb618e78d8e10d075f9 2023-12-12T10:11:05.566 DEBUG:teuthology.orchestra.run.smithi078:> dpkg-query -W -f '${Version}' ceph 2023-12-12T10:11:05.590 INFO:teuthology.orchestra.run.smithi078.stdout:19.0.0-96-gf1fbf3c5-1jammy 2023-12-12T10:11:05.591 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-96-gf1fbf3c5-1jammy 2023-12-12T10:11:05.591 INFO:teuthology.task.install:The correct ceph version 19.0.0-96-gf1fbf3c5-1jammy is installed. 2023-12-12T10:11:05.592 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=f1fbf3c583d03e19f5e58eb618e78d8e10d075f9 2023-12-12T10:11:05.732 DEBUG:teuthology.orchestra.run.smithi187:> dpkg-query -W -f '${Version}' ceph 2023-12-12T10:11:05.755 INFO:teuthology.orchestra.run.smithi187.stdout:19.0.0-96-gf1fbf3c5-1jammy 2023-12-12T10:11:05.755 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-96-gf1fbf3c5-1jammy 2023-12-12T10:11:05.756 INFO:teuthology.task.install:The correct ceph version 19.0.0-96-gf1fbf3c5-1jammy is installed. 2023-12-12T10:11:05.757 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-12-12T10:11:05.758 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-12-12T10:11:05.758 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-12T10:11:05.781 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-12-12T10:11:05.781 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-12T10:11:05.819 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-12-12T10:11:05.819 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-12-12T10:11:05.819 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/usr/bin/daemon-helper 2023-12-12T10:11:05.843 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-12T10:11:05.907 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-12-12T10:11:05.907 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/usr/bin/daemon-helper 2023-12-12T10:11:05.927 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-12T10:11:05.989 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-12-12T10:11:05.989 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-12-12T10:11:05.989 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-12T10:11:06.011 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-12T10:11:06.074 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-12-12T10:11:06.074 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-12T10:11:06.094 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-12T10:11:06.157 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-12-12T10:11:06.158 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-12-12T10:11:06.158 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/usr/bin/stdin-killer 2023-12-12T10:11:06.180 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-12T10:11:06.242 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-12-12T10:11:06.242 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/usr/bin/stdin-killer 2023-12-12T10:11:06.262 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-12T10:11:06.324 INFO:teuthology.run_tasks:Running task ceph... 2023-12-12T10:11:06.393 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-12-12T10:11:06.393 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 777 /var/log/ceph 2023-12-12T10:11:06.397 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod 777 /var/log/ceph 2023-12-12T10:11:06.418 INFO:tasks.ceph:Disabling ceph logrotate... 2023-12-12T10:11:06.419 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -f -- /etc/logrotate.d/ceph 2023-12-12T10:11:06.460 DEBUG:teuthology.orchestra.run.smithi187:> sudo rm -f -- /etc/logrotate.d/ceph 2023-12-12T10:11:06.480 INFO:tasks.ceph:Creating extra log directories... 2023-12-12T10:11:06.480 DEBUG:teuthology.orchestra.run.smithi078:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-12-12T10:11:06.525 DEBUG:teuthology.orchestra.run.smithi187:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-12-12T10:11:06.552 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-12-12T10:11:06.552 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-12-12T10:11:06.552 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-12-12T10:11:06.552 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-12-12T10:11:06.552 DEBUG:teuthology.orchestra.run.smithi078:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-12-12T10:11:06.594 DEBUG:teuthology.orchestra.run.smithi078:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-12-12T10:11:06.691 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-12-12T10:11:06.691 DEBUG:teuthology.orchestra.run.smithi187:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-12-12T10:11:06.700 DEBUG:teuthology.orchestra.run.smithi187:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-12-12T10:11:06.797 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-12-12T10:11:06.797 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-12-12T10:11:06.797 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/mchangir-2023-12-12_08:46:52-fs-wip-mchangir-testing-20231205.064351-testing-default-smithi/7488242', 'branch': 'wip-mchangir-testing-20231205.064351', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev}', 'email': 'mchangir@redhat.com', 'first_in_suite': False, 'job_id': '7488242', 'kernel': {'flavor': 'default', 'kdb': True, 'sha1': 'cd68252d7b4d7802f3cae7f5945b38e9b20dad4c'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'mchangir-2023-12-12_08:46:52-fs-wip-mchangir-testing-20231205.064351-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-mchangir-testing-20231205.064351'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': 'f1fbf3c583d03e19f5e58eb618e78d8e10d075f9'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'f1fbf3c583d03e19f5e58eb618e78d8e10d075f9'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-mchangir-testing-20231205.064351', 'sha1': 'f1fbf3c583d03e19f5e58eb618e78d8e10d075f9'}}, 'owner': 'mchangir', 'priority': 1000, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 5473, 'sha1': 'f1fbf3c583d03e19f5e58eb618e78d8e10d075f9', 'sleep_before_teardown': 0, 'subset': '600/1024', 'suite': 'fs', 'suite_branch': 'wip-mchangir-testing-20231205.064351', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'f1fbf3c583d03e19f5e58eb618e78d8e10d075f9', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi078.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBK/zlvJHDqEnPl6Dvp8Mv0S2RJ3kT0EukCv3Yxfv+tuVMZqWIVmF0fa1gFxjFMR6lRz0x4V94Th7G/aYJcD1aW4=', 'smithi187.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCAFaGbbwyvMrg/EarDZihOcX6SBrTXZ9VyF3YFNk8Q1aF8/j7z0M+UVdoAS1IBXUvTaGRP6BEKBAdqaF/lrC9o='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'flavor': 'default', 'kdb': True, 'sha1': 'cd68252d7b4d7802f3cae7f5945b38e9b20dad4c'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'f1fbf3c583d03e19f5e58eb618e78d8e10d075f9'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': 'f1fbf3c583d03e19f5e58eb618e78d8e10d075f9', 'cluster': 'ceph'}}, {'ceph-fuse': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.tests_from_xfstests_dev']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73', 'timestamp': '2023-12-12_08:46:52', 'tube': 'smithi', 'user': 'mchangir', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.232157'} 2023-12-12T10:11:06.798 DEBUG:teuthology.orchestra.run.smithi078:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-12-12T10:11:06.801 DEBUG:teuthology.orchestra.run.smithi187:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-12-12T10:11:06.846 DEBUG:teuthology.orchestra.run.smithi078:> sudo install -d -m0777 -- /var/run/ceph 2023-12-12T10:11:06.856 DEBUG:teuthology.orchestra.run.smithi187:> sudo install -d -m0777 -- /var/run/ceph 2023-12-12T10:11:06.913 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-12-12T10:11:06.913 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/scratch_devs of=/dev/stdout 2023-12-12T10:11:06.926 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-12-12T10:11:06.926 DEBUG:teuthology.orchestra.run.smithi078:> stat /dev/vg_nvme/lv_1 2023-12-12T10:11:06.978 INFO:teuthology.orchestra.run.smithi078.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-12-12T10:11:06.978 INFO:teuthology.orchestra.run.smithi078.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-12T10:11:06.978 INFO:teuthology.orchestra.run.smithi078.stdout:Device: 5h/5d Inode: 904 Links: 1 2023-12-12T10:11:06.978 INFO:teuthology.orchestra.run.smithi078.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-12T10:11:06.978 INFO:teuthology.orchestra.run.smithi078.stdout:Access: 2023-12-12 10:04:12.371804940 +0000 2023-12-12T10:11:06.978 INFO:teuthology.orchestra.run.smithi078.stdout:Modify: 2023-12-12 10:04:11.979808440 +0000 2023-12-12T10:11:06.978 INFO:teuthology.orchestra.run.smithi078.stdout:Change: 2023-12-12 10:04:11.979808440 +0000 2023-12-12T10:11:06.978 INFO:teuthology.orchestra.run.smithi078.stdout: Birth: 2023-12-12 10:04:11.979808440 +0000 2023-12-12T10:11:06.979 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-12-12T10:11:07.040 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records in 2023-12-12T10:11:07.040 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records out 2023-12-12T10:11:07.040 INFO:teuthology.orchestra.run.smithi078.stderr:512 bytes copied, 0.000380104 s, 1.3 MB/s 2023-12-12T10:11:07.042 DEBUG:teuthology.orchestra.run.smithi078:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-12-12T10:11:07.096 DEBUG:teuthology.orchestra.run.smithi078:> stat /dev/vg_nvme/lv_2 2023-12-12T10:11:07.146 INFO:teuthology.orchestra.run.smithi078.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-12-12T10:11:07.146 INFO:teuthology.orchestra.run.smithi078.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-12T10:11:07.146 INFO:teuthology.orchestra.run.smithi078.stdout:Device: 5h/5d Inode: 920 Links: 1 2023-12-12T10:11:07.146 INFO:teuthology.orchestra.run.smithi078.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-12T10:11:07.146 INFO:teuthology.orchestra.run.smithi078.stdout:Access: 2023-12-12 10:04:13.075798652 +0000 2023-12-12T10:11:07.146 INFO:teuthology.orchestra.run.smithi078.stdout:Modify: 2023-12-12 10:04:12.655802402 +0000 2023-12-12T10:11:07.146 INFO:teuthology.orchestra.run.smithi078.stdout:Change: 2023-12-12 10:04:12.655802402 +0000 2023-12-12T10:11:07.146 INFO:teuthology.orchestra.run.smithi078.stdout: Birth: 2023-12-12 10:04:12.655802402 +0000 2023-12-12T10:11:07.147 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-12-12T10:11:07.208 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records in 2023-12-12T10:11:07.209 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records out 2023-12-12T10:11:07.209 INFO:teuthology.orchestra.run.smithi078.stderr:512 bytes copied, 0.000394361 s, 1.3 MB/s 2023-12-12T10:11:07.211 DEBUG:teuthology.orchestra.run.smithi078:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-12-12T10:11:07.264 DEBUG:teuthology.orchestra.run.smithi078:> stat /dev/vg_nvme/lv_3 2023-12-12T10:11:07.314 INFO:teuthology.orchestra.run.smithi078.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-12-12T10:11:07.315 INFO:teuthology.orchestra.run.smithi078.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-12T10:11:07.315 INFO:teuthology.orchestra.run.smithi078.stdout:Device: 5h/5d Inode: 937 Links: 1 2023-12-12T10:11:07.315 INFO:teuthology.orchestra.run.smithi078.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-12T10:11:07.315 INFO:teuthology.orchestra.run.smithi078.stdout:Access: 2023-12-12 10:04:13.787792291 +0000 2023-12-12T10:11:07.315 INFO:teuthology.orchestra.run.smithi078.stdout:Modify: 2023-12-12 10:04:13.379795937 +0000 2023-12-12T10:11:07.315 INFO:teuthology.orchestra.run.smithi078.stdout:Change: 2023-12-12 10:04:13.379795937 +0000 2023-12-12T10:11:07.315 INFO:teuthology.orchestra.run.smithi078.stdout: Birth: 2023-12-12 10:04:13.379795937 +0000 2023-12-12T10:11:07.315 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-12-12T10:11:07.376 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records in 2023-12-12T10:11:07.376 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records out 2023-12-12T10:11:07.376 INFO:teuthology.orchestra.run.smithi078.stderr:512 bytes copied, 0.000374415 s, 1.4 MB/s 2023-12-12T10:11:07.378 DEBUG:teuthology.orchestra.run.smithi078:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-12-12T10:11:07.432 DEBUG:teuthology.orchestra.run.smithi078:> stat /dev/vg_nvme/lv_4 2023-12-12T10:11:07.486 INFO:teuthology.orchestra.run.smithi078.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-12-12T10:11:07.486 INFO:teuthology.orchestra.run.smithi078.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-12T10:11:07.486 INFO:teuthology.orchestra.run.smithi078.stdout:Device: 5h/5d Inode: 955 Links: 1 2023-12-12T10:11:07.486 INFO:teuthology.orchestra.run.smithi078.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-12T10:11:07.486 INFO:teuthology.orchestra.run.smithi078.stdout:Access: 2023-12-12 10:04:14.455786326 +0000 2023-12-12T10:11:07.486 INFO:teuthology.orchestra.run.smithi078.stdout:Modify: 2023-12-12 10:04:14.055789899 +0000 2023-12-12T10:11:07.486 INFO:teuthology.orchestra.run.smithi078.stdout:Change: 2023-12-12 10:04:14.055789899 +0000 2023-12-12T10:11:07.486 INFO:teuthology.orchestra.run.smithi078.stdout: Birth: 2023-12-12 10:04:14.055789899 +0000 2023-12-12T10:11:07.487 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-12-12T10:11:07.548 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records in 2023-12-12T10:11:07.548 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records out 2023-12-12T10:11:07.548 INFO:teuthology.orchestra.run.smithi078.stderr:512 bytes copied, 0.000381156 s, 1.3 MB/s 2023-12-12T10:11:07.550 DEBUG:teuthology.orchestra.run.smithi078:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-12-12T10:11:07.604 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-12T10:11:07.604 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-12-12T10:11:07.604 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/scratch_devs of=/dev/stdout 2023-12-12T10:11:07.613 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-12-12T10:11:07.613 DEBUG:teuthology.orchestra.run.smithi187:> stat /dev/vg_nvme/lv_1 2023-12-12T10:11:07.662 INFO:teuthology.orchestra.run.smithi187.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-12-12T10:11:07.662 INFO:teuthology.orchestra.run.smithi187.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-12T10:11:07.662 INFO:teuthology.orchestra.run.smithi187.stdout:Device: 5h/5d Inode: 902 Links: 1 2023-12-12T10:11:07.662 INFO:teuthology.orchestra.run.smithi187.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-12T10:11:07.662 INFO:teuthology.orchestra.run.smithi187.stdout:Access: 2023-12-12 10:04:11.529799043 +0000 2023-12-12T10:11:07.662 INFO:teuthology.orchestra.run.smithi187.stdout:Modify: 2023-12-12 10:04:11.117802723 +0000 2023-12-12T10:11:07.662 INFO:teuthology.orchestra.run.smithi187.stdout:Change: 2023-12-12 10:04:11.117802723 +0000 2023-12-12T10:11:07.662 INFO:teuthology.orchestra.run.smithi187.stdout: Birth: 2023-12-12 10:04:11.117802723 +0000 2023-12-12T10:11:07.663 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-12-12T10:11:07.724 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records in 2023-12-12T10:11:07.724 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records out 2023-12-12T10:11:07.724 INFO:teuthology.orchestra.run.smithi187.stderr:512 bytes copied, 0.000366062 s, 1.4 MB/s 2023-12-12T10:11:07.726 DEBUG:teuthology.orchestra.run.smithi187:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-12-12T10:11:07.780 DEBUG:teuthology.orchestra.run.smithi187:> stat /dev/vg_nvme/lv_2 2023-12-12T10:11:07.830 INFO:teuthology.orchestra.run.smithi187.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-12-12T10:11:07.830 INFO:teuthology.orchestra.run.smithi187.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-12T10:11:07.830 INFO:teuthology.orchestra.run.smithi187.stdout:Device: 5h/5d Inode: 921 Links: 1 2023-12-12T10:11:07.830 INFO:teuthology.orchestra.run.smithi187.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-12T10:11:07.830 INFO:teuthology.orchestra.run.smithi187.stdout:Access: 2023-12-12 10:04:12.197793077 +0000 2023-12-12T10:11:07.830 INFO:teuthology.orchestra.run.smithi187.stdout:Modify: 2023-12-12 10:04:11.785796757 +0000 2023-12-12T10:11:07.830 INFO:teuthology.orchestra.run.smithi187.stdout:Change: 2023-12-12 10:04:11.785796757 +0000 2023-12-12T10:11:07.830 INFO:teuthology.orchestra.run.smithi187.stdout: Birth: 2023-12-12 10:04:11.785796757 +0000 2023-12-12T10:11:07.831 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-12-12T10:11:07.893 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records in 2023-12-12T10:11:07.893 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records out 2023-12-12T10:11:07.893 INFO:teuthology.orchestra.run.smithi187.stderr:512 bytes copied, 0.000372909 s, 1.4 MB/s 2023-12-12T10:11:07.894 DEBUG:teuthology.orchestra.run.smithi187:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-12-12T10:11:07.948 DEBUG:teuthology.orchestra.run.smithi187:> stat /dev/vg_nvme/lv_3 2023-12-12T10:11:07.998 INFO:teuthology.orchestra.run.smithi187.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-12-12T10:11:07.998 INFO:teuthology.orchestra.run.smithi187.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-12T10:11:07.998 INFO:teuthology.orchestra.run.smithi187.stdout:Device: 5h/5d Inode: 936 Links: 1 2023-12-12T10:11:07.998 INFO:teuthology.orchestra.run.smithi187.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-12T10:11:07.998 INFO:teuthology.orchestra.run.smithi187.stdout:Access: 2023-12-12 10:04:12.849787253 +0000 2023-12-12T10:11:07.999 INFO:teuthology.orchestra.run.smithi187.stdout:Modify: 2023-12-12 10:04:12.449790826 +0000 2023-12-12T10:11:07.999 INFO:teuthology.orchestra.run.smithi187.stdout:Change: 2023-12-12 10:04:12.449790826 +0000 2023-12-12T10:11:07.999 INFO:teuthology.orchestra.run.smithi187.stdout: Birth: 2023-12-12 10:04:12.449790826 +0000 2023-12-12T10:11:07.999 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-12-12T10:11:08.060 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records in 2023-12-12T10:11:08.060 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records out 2023-12-12T10:11:08.060 INFO:teuthology.orchestra.run.smithi187.stderr:512 bytes copied, 0.000368194 s, 1.4 MB/s 2023-12-12T10:11:08.061 DEBUG:teuthology.orchestra.run.smithi187:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-12-12T10:11:08.116 DEBUG:teuthology.orchestra.run.smithi187:> stat /dev/vg_nvme/lv_4 2023-12-12T10:11:08.166 INFO:teuthology.orchestra.run.smithi187.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-12-12T10:11:08.166 INFO:teuthology.orchestra.run.smithi187.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-12T10:11:08.166 INFO:teuthology.orchestra.run.smithi187.stdout:Device: 5h/5d Inode: 952 Links: 1 2023-12-12T10:11:08.167 INFO:teuthology.orchestra.run.smithi187.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-12T10:11:08.167 INFO:teuthology.orchestra.run.smithi187.stdout:Access: 2023-12-12 10:04:13.525781215 +0000 2023-12-12T10:11:08.167 INFO:teuthology.orchestra.run.smithi187.stdout:Modify: 2023-12-12 10:04:13.129784752 +0000 2023-12-12T10:11:08.167 INFO:teuthology.orchestra.run.smithi187.stdout:Change: 2023-12-12 10:04:13.129784752 +0000 2023-12-12T10:11:08.167 INFO:teuthology.orchestra.run.smithi187.stdout: Birth: 2023-12-12 10:04:13.129784752 +0000 2023-12-12T10:11:08.168 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-12-12T10:11:08.232 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records in 2023-12-12T10:11:08.232 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records out 2023-12-12T10:11:08.232 INFO:teuthology.orchestra.run.smithi187.stderr:512 bytes copied, 0.000380467 s, 1.3 MB/s 2023-12-12T10:11:08.234 DEBUG:teuthology.orchestra.run.smithi187:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-12-12T10:11:08.292 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-12T10:11:08.292 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi078.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi187.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-12-12T10:11:08.292 INFO:tasks.ceph:Generating config... 2023-12-12T10:11:08.293 INFO:tasks.ceph:[client] client mount timeout = 600 2023-12-12T10:11:08.293 INFO:tasks.ceph:[client] debug client = 20 2023-12-12T10:11:08.293 INFO:tasks.ceph:[client] debug ms = 1 2023-12-12T10:11:08.293 INFO:tasks.ceph:[client] pid file = 2023-12-12T10:11:08.293 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-12-12T10:11:08.293 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-12-12T10:11:08.293 INFO:tasks.ceph:[mds] debug mds = 20 2023-12-12T10:11:08.293 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-12-12T10:11:08.294 INFO:tasks.ceph:[mds] debug ms = 1 2023-12-12T10:11:08.294 INFO:tasks.ceph:[mds] mds debug frag = True 2023-12-12T10:11:08.294 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-12-12T10:11:08.294 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-12-12T10:11:08.294 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-12-12T10:11:08.294 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-12-12T10:11:08.294 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-12-12T10:11:08.294 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-12-12T10:11:08.294 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-12-12T10:11:08.294 INFO:tasks.ceph:[mgr] debug ms = 1 2023-12-12T10:11:08.294 INFO:tasks.ceph:[mon] debug mon = 20 2023-12-12T10:11:08.294 INFO:tasks.ceph:[mon] debug ms = 1 2023-12-12T10:11:08.294 INFO:tasks.ceph:[mon] debug paxos = 20 2023-12-12T10:11:08.294 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-12-12T10:11:08.295 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-12-12T10:11:08.295 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-12-12T10:11:08.295 INFO:tasks.ceph:[osd] debug bluefs = 20 2023-12-12T10:11:08.295 INFO:tasks.ceph:[osd] debug bluestore = 20 2023-12-12T10:11:08.295 INFO:tasks.ceph:[osd] debug ms = 1 2023-12-12T10:11:08.295 INFO:tasks.ceph:[osd] debug osd = 20 2023-12-12T10:11:08.295 INFO:tasks.ceph:[osd] debug rocksdb = 10 2023-12-12T10:11:08.295 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-12-12T10:11:08.295 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-12-12T10:11:08.295 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-12-12T10:11:08.295 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-12-12T10:11:08.295 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-12-12T10:11:08.295 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-12-12T10:11:08.296 INFO:tasks.ceph:Setting up mon.a... 2023-12-12T10:11:08.296 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-12-12T10:11:08.342 INFO:teuthology.orchestra.run.smithi078.stdout:creating /etc/ceph/ceph.keyring 2023-12-12T10:11:08.358 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-12-12T10:11:08.406 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-12T10:11:08.469 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.78'), ('mon.b', '172.21.15.187'), ('mon.c', '[v2:172.21.15.187:3301,v1:172.21.15.187:6790]')] 2023-12-12T10:11:08.470 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.78,172.21.15.187,[v2:172.21.15.187:3301,v1:172.21.15.187:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-12-12T10:11:08.471 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-12-12T10:11:08.471 DEBUG:teuthology.orchestra.run.smithi078:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-12-12T10:11:08.526 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.78 --add b 172.21.15.187 --addv c '[v2:172.21.15.187:3301,v1:172.21.15.187:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-12-12T10:11:08.615 INFO:teuthology.orchestra.run.smithi078.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-12-12T10:11:08.616 INFO:teuthology.orchestra.run.smithi078.stdout:monmaptool: generated fsid fc81937c-bd26-483c-952b-d1324fcb0c9e 2023-12-12T10:11:08.616 INFO:teuthology.orchestra.run.smithi078.stdout:setting min_mon_release = pacific 2023-12-12T10:11:08.616 INFO:teuthology.orchestra.run.smithi078.stdout:epoch 0 2023-12-12T10:11:08.616 INFO:teuthology.orchestra.run.smithi078.stdout:fsid fc81937c-bd26-483c-952b-d1324fcb0c9e 2023-12-12T10:11:08.616 INFO:teuthology.orchestra.run.smithi078.stdout:last_changed 2023-12-12T10:11:08.616259+0000 2023-12-12T10:11:08.616 INFO:teuthology.orchestra.run.smithi078.stdout:created 2023-12-12T10:11:08.616259+0000 2023-12-12T10:11:08.616 INFO:teuthology.orchestra.run.smithi078.stdout:min_mon_release 16 (pacific) 2023-12-12T10:11:08.616 INFO:teuthology.orchestra.run.smithi078.stdout:election_strategy: 1 2023-12-12T10:11:08.616 INFO:teuthology.orchestra.run.smithi078.stdout:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2023-12-12T10:11:08.616 INFO:teuthology.orchestra.run.smithi078.stdout:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2023-12-12T10:11:08.616 INFO:teuthology.orchestra.run.smithi078.stdout:2: [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] mon.c 2023-12-12T10:11:08.616 INFO:teuthology.orchestra.run.smithi078.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-12-12T10:11:08.618 DEBUG:teuthology.orchestra.run.smithi078:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-12-12T10:11:08.627 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID fc81937c-bd26-483c-952b-d1324fcb0c9e... 2023-12-12T10:11:08.628 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-12-12T10:11:08.672 DEBUG:teuthology.orchestra.run.smithi187:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-12-12T10:11:08.712 INFO:teuthology.orchestra.run.smithi078.stdout:[global] 2023-12-12T10:11:08.713 INFO:teuthology.orchestra.run.smithi078.stdout: chdir = "" 2023-12-12T10:11:08.713 INFO:teuthology.orchestra.run.smithi078.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-12-12T10:11:08.713 INFO:teuthology.orchestra.run.smithi078.stdout: auth supported = cephx 2023-12-12T10:11:08.713 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:11:08.713 INFO:teuthology.orchestra.run.smithi078.stdout: filestore xattr use omap = true 2023-12-12T10:11:08.713 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:11:08.713 INFO:teuthology.orchestra.run.smithi078.stdout: mon clock drift allowed = 1.000 2023-12-12T10:11:08.713 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:11:08.713 INFO:teuthology.orchestra.run.smithi078.stdout: osd crush chooseleaf type = 0 2023-12-12T10:11:08.713 INFO:teuthology.orchestra.run.smithi078.stdout: auth debug = true 2023-12-12T10:11:08.713 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:11:08.713 INFO:teuthology.orchestra.run.smithi078.stdout: ms die on old message = true 2023-12-12T10:11:08.713 INFO:teuthology.orchestra.run.smithi078.stdout: ms die on bug = true 2023-12-12T10:11:08.713 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:11:08.714 INFO:teuthology.orchestra.run.smithi078.stdout: mon max pg per osd = 10000 # >= luminous 2023-12-12T10:11:08.714 INFO:teuthology.orchestra.run.smithi078.stdout: mon pg warn max object skew = 0 2023-12-12T10:11:08.714 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:11:08.714 INFO:teuthology.orchestra.run.smithi078.stdout: # disable pg_autoscaler by default for new pools 2023-12-12T10:11:08.714 INFO:teuthology.orchestra.run.smithi078.stdout: osd_pool_default_pg_autoscale_mode = off 2023-12-12T10:11:08.714 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:11:08.714 INFO:teuthology.orchestra.run.smithi078.stdout: osd pool default size = 2 2023-12-12T10:11:08.714 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:11:08.714 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd allow primary affinity = true 2023-12-12T10:11:08.714 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd allow pg remap = true 2023-12-12T10:11:08.714 INFO:teuthology.orchestra.run.smithi078.stdout: mon warn on legacy crush tunables = false 2023-12-12T10:11:08.715 INFO:teuthology.orchestra.run.smithi078.stdout: mon warn on crush straw calc version zero = false 2023-12-12T10:11:08.715 INFO:teuthology.orchestra.run.smithi078.stdout: mon warn on no sortbitwise = false 2023-12-12T10:11:08.715 INFO:teuthology.orchestra.run.smithi078.stdout: mon warn on osd down out interval zero = false 2023-12-12T10:11:08.715 INFO:teuthology.orchestra.run.smithi078.stdout: mon warn on too few osds = false 2023-12-12T10:11:08.715 INFO:teuthology.orchestra.run.smithi078.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-12-12T10:11:08.715 INFO:teuthology.orchestra.run.smithi078.stdout: mon_warn_on_pool_no_redundancy = false 2023-12-12T10:11:08.715 INFO:teuthology.orchestra.run.smithi078.stdout: mon_allow_pool_size_one = true 2023-12-12T10:11:08.715 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:11:08.715 INFO:teuthology.orchestra.run.smithi078.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-12-12T10:11:08.715 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:11:08.715 INFO:teuthology.orchestra.run.smithi078.stdout: osd default data pool replay window = 5 2023-12-12T10:11:08.715 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:11:08.715 INFO:teuthology.orchestra.run.smithi078.stdout: mon allow pool delete = true 2023-12-12T10:11:08.715 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:11:08.715 INFO:teuthology.orchestra.run.smithi078.stdout: mon cluster log file level = debug 2023-12-12T10:11:08.716 INFO:teuthology.orchestra.run.smithi078.stdout: debug asserts on shutdown = true 2023-12-12T10:11:08.716 INFO:teuthology.orchestra.run.smithi078.stdout: mon health detail to clog = false 2023-12-12T10:11:08.716 INFO:teuthology.orchestra.run.smithi078.stdout: mon host = "172.21.15.78,172.21.15.187,[v2:172.21.15.187:3301,v1:172.21.15.187:6790]" 2023-12-12T10:11:08.716 INFO:teuthology.orchestra.run.smithi078.stdout: fsid = fc81937c-bd26-483c-952b-d1324fcb0c9e 2023-12-12T10:11:08.716 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:11:08.716 INFO:teuthology.orchestra.run.smithi078.stdout:[osd] 2023-12-12T10:11:08.716 INFO:teuthology.orchestra.run.smithi078.stdout: osd journal size = 100 2023-12-12T10:11:08.716 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:11:08.716 INFO:teuthology.orchestra.run.smithi078.stdout: osd scrub load threshold = 5.0 2023-12-12T10:11:08.716 INFO:teuthology.orchestra.run.smithi078.stdout: osd scrub max interval = 600 2023-12-12T10:11:08.716 INFO:teuthology.orchestra.run.smithi078.stdout: osd mclock profile = high_recovery_ops 2023-12-12T10:11:08.716 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:11:08.716 INFO:teuthology.orchestra.run.smithi078.stdout: osd recover clone overlap = true 2023-12-12T10:11:08.716 INFO:teuthology.orchestra.run.smithi078.stdout: osd recovery max chunk = 1048576 2023-12-12T10:11:08.716 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:11:08.717 INFO:teuthology.orchestra.run.smithi078.stdout: osd debug shutdown = true 2023-12-12T10:11:08.717 INFO:teuthology.orchestra.run.smithi078.stdout: osd debug op order = true 2023-12-12T10:11:08.717 INFO:teuthology.orchestra.run.smithi078.stdout: osd debug verify stray on activate = true 2023-12-12T10:11:08.717 INFO:teuthology.orchestra.run.smithi078.stdout: osd debug trim objects = true 2023-12-12T10:11:08.718 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:11:08.718 INFO:teuthology.orchestra.run.smithi078.stdout: osd open classes on start = true 2023-12-12T10:11:08.718 INFO:teuthology.orchestra.run.smithi078.stdout: osd debug pg log writeout = true 2023-12-12T10:11:08.718 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:11:08.718 INFO:teuthology.orchestra.run.smithi078.stdout: osd deep scrub update digest min age = 30 2023-12-12T10:11:08.718 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:11:08.718 INFO:teuthology.orchestra.run.smithi078.stdout: osd map max advance = 10 2023-12-12T10:11:08.719 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:11:08.719 INFO:teuthology.orchestra.run.smithi078.stdout: journal zero on create = true 2023-12-12T10:11:08.719 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:11:08.719 INFO:teuthology.orchestra.run.smithi078.stdout: filestore ondisk finisher threads = 3 2023-12-12T10:11:08.719 INFO:teuthology.orchestra.run.smithi078.stdout: filestore apply finisher threads = 3 2023-12-12T10:11:08.719 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:11:08.719 INFO:teuthology.orchestra.run.smithi078.stdout: bdev debug aio = true 2023-12-12T10:11:08.719 INFO:teuthology.orchestra.run.smithi078.stdout: osd debug misdirected ops = true 2023-12-12T10:11:08.719 INFO:teuthology.orchestra.run.smithi078.stdout: bluestore block size = 96636764160 2023-12-12T10:11:08.719 INFO:teuthology.orchestra.run.smithi078.stdout: bluestore fsck on mount = True 2023-12-12T10:11:08.719 INFO:teuthology.orchestra.run.smithi078.stdout: debug bluefs = 20 2023-12-12T10:11:08.719 INFO:teuthology.orchestra.run.smithi078.stdout: debug bluestore = 20 2023-12-12T10:11:08.719 INFO:teuthology.orchestra.run.smithi078.stdout: debug ms = 1 2023-12-12T10:11:08.719 INFO:teuthology.orchestra.run.smithi078.stdout: debug osd = 20 2023-12-12T10:11:08.719 INFO:teuthology.orchestra.run.smithi078.stdout: debug rocksdb = 10 2023-12-12T10:11:08.720 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd backfillfull_ratio = 0.85 2023-12-12T10:11:08.720 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd full ratio = 0.9 2023-12-12T10:11:08.720 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd nearfull ratio = 0.8 2023-12-12T10:11:08.720 INFO:teuthology.orchestra.run.smithi078.stdout: osd failsafe full ratio = 0.95 2023-12-12T10:11:08.720 INFO:teuthology.orchestra.run.smithi078.stdout: osd objectstore = bluestore 2023-12-12T10:11:08.720 INFO:teuthology.orchestra.run.smithi078.stdout: osd op complaint time = 180 2023-12-12T10:11:08.720 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:11:08.720 INFO:teuthology.orchestra.run.smithi078.stdout:[mgr] 2023-12-12T10:11:08.720 INFO:teuthology.orchestra.run.smithi078.stdout: debug ms = 1 2023-12-12T10:11:08.720 INFO:teuthology.orchestra.run.smithi078.stdout: debug mgr = 20 2023-12-12T10:11:08.720 INFO:teuthology.orchestra.run.smithi078.stdout: debug mon = 20 2023-12-12T10:11:08.720 INFO:teuthology.orchestra.run.smithi078.stdout: debug auth = 20 2023-12-12T10:11:08.720 INFO:teuthology.orchestra.run.smithi078.stdout: mon reweight min pgs per osd = 4 2023-12-12T10:11:08.720 INFO:teuthology.orchestra.run.smithi078.stdout: mon reweight min bytes per osd = 10 2023-12-12T10:11:08.720 INFO:teuthology.orchestra.run.smithi078.stdout: mgr/telemetry/nag = false 2023-12-12T10:11:08.721 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:11:08.721 INFO:teuthology.orchestra.run.smithi078.stdout:[mon] 2023-12-12T10:11:08.721 INFO:teuthology.orchestra.run.smithi078.stdout: debug ms = 1 2023-12-12T10:11:08.721 INFO:teuthology.orchestra.run.smithi078.stdout: debug mon = 20 2023-12-12T10:11:08.721 INFO:teuthology.orchestra.run.smithi078.stdout: debug paxos = 20 2023-12-12T10:11:08.721 INFO:teuthology.orchestra.run.smithi078.stdout: debug auth = 20 2023-12-12T10:11:08.721 INFO:teuthology.orchestra.run.smithi078.stdout: mon data avail warn = 5 2023-12-12T10:11:08.721 INFO:teuthology.orchestra.run.smithi078.stdout: mon mgr mkfs grace = 240 2023-12-12T10:11:08.721 INFO:teuthology.orchestra.run.smithi078.stdout: mon reweight min pgs per osd = 4 2023-12-12T10:11:08.721 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd reporter subtree level = osd 2023-12-12T10:11:08.721 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd prime pg temp = true 2023-12-12T10:11:08.721 INFO:teuthology.orchestra.run.smithi078.stdout: mon reweight min bytes per osd = 10 2023-12-12T10:11:08.721 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:11:08.721 INFO:teuthology.orchestra.run.smithi078.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-12-12T10:11:08.721 INFO:teuthology.orchestra.run.smithi078.stdout: auth mon ticket ttl = 660 # 11m 2023-12-12T10:11:08.722 INFO:teuthology.orchestra.run.smithi078.stdout: auth service ticket ttl = 240 # 4m 2023-12-12T10:11:08.722 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:11:08.722 INFO:teuthology.orchestra.run.smithi078.stdout: # don't complain about insecure global_id in the test suite 2023-12-12T10:11:08.722 INFO:teuthology.orchestra.run.smithi078.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-12-12T10:11:08.722 INFO:teuthology.orchestra.run.smithi078.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-12-12T10:11:08.722 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:11:08.722 INFO:teuthology.orchestra.run.smithi078.stdout: # 1m isn't quite enough 2023-12-12T10:11:08.722 INFO:teuthology.orchestra.run.smithi078.stdout: mon_down_mkfs_grace = 2m 2023-12-12T10:11:08.722 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:11:08.722 INFO:teuthology.orchestra.run.smithi078.stdout: mon_warn_on_filestore_osds = false 2023-12-12T10:11:08.722 INFO:teuthology.orchestra.run.smithi078.stdout: mon op complaint time = 120 2023-12-12T10:11:08.722 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:11:08.722 INFO:teuthology.orchestra.run.smithi078.stdout:[client] 2023-12-12T10:11:08.722 INFO:teuthology.orchestra.run.smithi078.stdout: rgw cache enabled = true 2023-12-12T10:11:08.723 INFO:teuthology.orchestra.run.smithi078.stdout: rgw enable ops log = true 2023-12-12T10:11:08.723 INFO:teuthology.orchestra.run.smithi078.stdout: rgw enable usage log = true 2023-12-12T10:11:08.723 INFO:teuthology.orchestra.run.smithi078.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-12-12T10:11:08.723 INFO:teuthology.orchestra.run.smithi078.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-12-12T10:11:08.723 INFO:teuthology.orchestra.run.smithi078.stdout: client mount timeout = 600 2023-12-12T10:11:08.723 INFO:teuthology.orchestra.run.smithi078.stdout: debug client = 20 2023-12-12T10:11:08.723 INFO:teuthology.orchestra.run.smithi078.stdout: debug ms = 1 2023-12-12T10:11:08.723 INFO:teuthology.orchestra.run.smithi078.stdout: pid file = "" 2023-12-12T10:11:08.723 INFO:teuthology.orchestra.run.smithi078.stdout: rados mon op timeout = 900 2023-12-12T10:11:08.723 INFO:teuthology.orchestra.run.smithi078.stdout: rados osd op timeout = 900 2023-12-12T10:11:08.723 INFO:teuthology.orchestra.run.smithi078.stdout:[mon.a] 2023-12-12T10:11:08.723 INFO:teuthology.orchestra.run.smithi078.stdout:[mon.b] 2023-12-12T10:11:08.723 INFO:teuthology.orchestra.run.smithi078.stdout:[mon.c] 2023-12-12T10:11:08.723 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.a] 2023-12-12T10:11:08.724 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.c] 2023-12-12T10:11:08.724 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.b] 2023-12-12T10:11:08.724 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.d] 2023-12-12T10:11:08.724 INFO:teuthology.orchestra.run.smithi078.stdout:[mds] 2023-12-12T10:11:08.724 INFO:teuthology.orchestra.run.smithi078.stdout: debug mds = 20 2023-12-12T10:11:08.724 INFO:teuthology.orchestra.run.smithi078.stdout: debug mds balancer = 20 2023-12-12T10:11:08.724 INFO:teuthology.orchestra.run.smithi078.stdout: debug ms = 1 2023-12-12T10:11:08.724 INFO:teuthology.orchestra.run.smithi078.stdout: mds debug frag = True 2023-12-12T10:11:08.724 INFO:teuthology.orchestra.run.smithi078.stdout: mds debug scatterstat = True 2023-12-12T10:11:08.725 INFO:teuthology.orchestra.run.smithi078.stdout: mds op complaint time = 180 2023-12-12T10:11:08.725 INFO:teuthology.orchestra.run.smithi078.stdout: mds verify scatter = True 2023-12-12T10:11:08.725 INFO:teuthology.orchestra.run.smithi078.stdout: osd op complaint time = 180 2023-12-12T10:11:08.725 INFO:teuthology.orchestra.run.smithi078.stdout: rados mon op timeout = 900 2023-12-12T10:11:08.725 INFO:teuthology.orchestra.run.smithi078.stdout: rados osd op timeout = 900 2023-12-12T10:11:08.726 INFO:teuthology.orchestra.run.smithi187.stdout:[global] 2023-12-12T10:11:08.726 INFO:teuthology.orchestra.run.smithi187.stdout: chdir = "" 2023-12-12T10:11:08.726 INFO:teuthology.orchestra.run.smithi187.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-12-12T10:11:08.726 INFO:teuthology.orchestra.run.smithi187.stdout: auth supported = cephx 2023-12-12T10:11:08.726 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-12-12T10:11:08.726 INFO:teuthology.orchestra.run.smithi187.stdout: filestore xattr use omap = true 2023-12-12T10:11:08.726 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-12-12T10:11:08.726 INFO:teuthology.orchestra.run.smithi187.stdout: mon clock drift allowed = 1.000 2023-12-12T10:11:08.727 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-12-12T10:11:08.727 INFO:teuthology.orchestra.run.smithi187.stdout: osd crush chooseleaf type = 0 2023-12-12T10:11:08.727 INFO:teuthology.orchestra.run.smithi187.stdout: auth debug = true 2023-12-12T10:11:08.727 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-12-12T10:11:08.727 INFO:teuthology.orchestra.run.smithi187.stdout: ms die on old message = true 2023-12-12T10:11:08.727 INFO:teuthology.orchestra.run.smithi187.stdout: ms die on bug = true 2023-12-12T10:11:08.727 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-12-12T10:11:08.727 INFO:teuthology.orchestra.run.smithi187.stdout: mon max pg per osd = 10000 # >= luminous 2023-12-12T10:11:08.728 INFO:teuthology.orchestra.run.smithi187.stdout: mon pg warn max object skew = 0 2023-12-12T10:11:08.728 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-12-12T10:11:08.728 INFO:teuthology.orchestra.run.smithi187.stdout: # disable pg_autoscaler by default for new pools 2023-12-12T10:11:08.728 INFO:teuthology.orchestra.run.smithi187.stdout: osd_pool_default_pg_autoscale_mode = off 2023-12-12T10:11:08.728 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-12-12T10:11:08.728 INFO:teuthology.orchestra.run.smithi187.stdout: osd pool default size = 2 2023-12-12T10:11:08.729 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-12-12T10:11:08.729 INFO:teuthology.orchestra.run.smithi187.stdout: mon osd allow primary affinity = true 2023-12-12T10:11:08.729 INFO:teuthology.orchestra.run.smithi187.stdout: mon osd allow pg remap = true 2023-12-12T10:11:08.729 INFO:teuthology.orchestra.run.smithi187.stdout: mon warn on legacy crush tunables = false 2023-12-12T10:11:08.729 INFO:teuthology.orchestra.run.smithi187.stdout: mon warn on crush straw calc version zero = false 2023-12-12T10:11:08.729 INFO:teuthology.orchestra.run.smithi187.stdout: mon warn on no sortbitwise = false 2023-12-12T10:11:08.729 INFO:teuthology.orchestra.run.smithi187.stdout: mon warn on osd down out interval zero = false 2023-12-12T10:11:08.730 INFO:teuthology.orchestra.run.smithi187.stdout: mon warn on too few osds = false 2023-12-12T10:11:08.730 INFO:teuthology.orchestra.run.smithi187.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-12-12T10:11:08.730 INFO:teuthology.orchestra.run.smithi187.stdout: mon_warn_on_pool_no_redundancy = false 2023-12-12T10:11:08.730 INFO:teuthology.orchestra.run.smithi187.stdout: mon_allow_pool_size_one = true 2023-12-12T10:11:08.730 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-12-12T10:11:08.730 INFO:teuthology.orchestra.run.smithi187.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-12-12T10:11:08.730 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-12-12T10:11:08.730 INFO:teuthology.orchestra.run.smithi187.stdout: osd default data pool replay window = 5 2023-12-12T10:11:08.731 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-12-12T10:11:08.731 INFO:teuthology.orchestra.run.smithi187.stdout: mon allow pool delete = true 2023-12-12T10:11:08.731 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-12-12T10:11:08.731 INFO:teuthology.orchestra.run.smithi187.stdout: mon cluster log file level = debug 2023-12-12T10:11:08.731 INFO:teuthology.orchestra.run.smithi187.stdout: debug asserts on shutdown = true 2023-12-12T10:11:08.731 INFO:teuthology.orchestra.run.smithi187.stdout: mon health detail to clog = false 2023-12-12T10:11:08.731 INFO:teuthology.orchestra.run.smithi187.stdout: mon host = "172.21.15.78,172.21.15.187,[v2:172.21.15.187:3301,v1:172.21.15.187:6790]" 2023-12-12T10:11:08.731 INFO:teuthology.orchestra.run.smithi187.stdout: fsid = fc81937c-bd26-483c-952b-d1324fcb0c9e 2023-12-12T10:11:08.732 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-12-12T10:11:08.732 INFO:teuthology.orchestra.run.smithi187.stdout:[osd] 2023-12-12T10:11:08.732 INFO:teuthology.orchestra.run.smithi187.stdout: osd journal size = 100 2023-12-12T10:11:08.732 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-12-12T10:11:08.732 INFO:teuthology.orchestra.run.smithi187.stdout: osd scrub load threshold = 5.0 2023-12-12T10:11:08.732 INFO:teuthology.orchestra.run.smithi187.stdout: osd scrub max interval = 600 2023-12-12T10:11:08.732 INFO:teuthology.orchestra.run.smithi187.stdout: osd mclock profile = high_recovery_ops 2023-12-12T10:11:08.733 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-12-12T10:11:08.733 INFO:teuthology.orchestra.run.smithi187.stdout: osd recover clone overlap = true 2023-12-12T10:11:08.733 INFO:teuthology.orchestra.run.smithi187.stdout: osd recovery max chunk = 1048576 2023-12-12T10:11:08.733 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-12-12T10:11:08.733 INFO:teuthology.orchestra.run.smithi187.stdout: osd debug shutdown = true 2023-12-12T10:11:08.733 INFO:teuthology.orchestra.run.smithi187.stdout: osd debug op order = true 2023-12-12T10:11:08.733 INFO:teuthology.orchestra.run.smithi187.stdout: osd debug verify stray on activate = true 2023-12-12T10:11:08.734 INFO:teuthology.orchestra.run.smithi187.stdout: osd debug trim objects = true 2023-12-12T10:11:08.734 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-12-12T10:11:08.734 INFO:teuthology.orchestra.run.smithi187.stdout: osd open classes on start = true 2023-12-12T10:11:08.734 INFO:teuthology.orchestra.run.smithi187.stdout: osd debug pg log writeout = true 2023-12-12T10:11:08.734 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-12-12T10:11:08.734 INFO:teuthology.orchestra.run.smithi187.stdout: osd deep scrub update digest min age = 30 2023-12-12T10:11:08.735 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-12-12T10:11:08.735 INFO:teuthology.orchestra.run.smithi187.stdout: osd map max advance = 10 2023-12-12T10:11:08.735 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-12-12T10:11:08.735 INFO:teuthology.orchestra.run.smithi187.stdout: journal zero on create = true 2023-12-12T10:11:08.735 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-12-12T10:11:08.735 INFO:teuthology.orchestra.run.smithi187.stdout: filestore ondisk finisher threads = 3 2023-12-12T10:11:08.735 INFO:teuthology.orchestra.run.smithi187.stdout: filestore apply finisher threads = 3 2023-12-12T10:11:08.735 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-12-12T10:11:08.735 INFO:teuthology.orchestra.run.smithi187.stdout: bdev debug aio = true 2023-12-12T10:11:08.735 INFO:teuthology.orchestra.run.smithi187.stdout: osd debug misdirected ops = true 2023-12-12T10:11:08.735 INFO:teuthology.orchestra.run.smithi187.stdout: bluestore block size = 96636764160 2023-12-12T10:11:08.735 INFO:teuthology.orchestra.run.smithi187.stdout: bluestore fsck on mount = True 2023-12-12T10:11:08.736 INFO:teuthology.orchestra.run.smithi187.stdout: debug bluefs = 20 2023-12-12T10:11:08.736 INFO:teuthology.orchestra.run.smithi187.stdout: debug bluestore = 20 2023-12-12T10:11:08.736 INFO:teuthology.orchestra.run.smithi187.stdout: debug ms = 1 2023-12-12T10:11:08.736 INFO:teuthology.orchestra.run.smithi187.stdout: debug osd = 20 2023-12-12T10:11:08.736 INFO:teuthology.orchestra.run.smithi187.stdout: debug rocksdb = 10 2023-12-12T10:11:08.736 INFO:teuthology.orchestra.run.smithi187.stdout: mon osd backfillfull_ratio = 0.85 2023-12-12T10:11:08.736 INFO:teuthology.orchestra.run.smithi187.stdout: mon osd full ratio = 0.9 2023-12-12T10:11:08.736 INFO:teuthology.orchestra.run.smithi187.stdout: mon osd nearfull ratio = 0.8 2023-12-12T10:11:08.736 INFO:teuthology.orchestra.run.smithi187.stdout: osd failsafe full ratio = 0.95 2023-12-12T10:11:08.736 INFO:teuthology.orchestra.run.smithi187.stdout: osd objectstore = bluestore 2023-12-12T10:11:08.736 INFO:teuthology.orchestra.run.smithi187.stdout: osd op complaint time = 180 2023-12-12T10:11:08.736 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-12-12T10:11:08.736 INFO:teuthology.orchestra.run.smithi187.stdout:[mgr] 2023-12-12T10:11:08.736 INFO:teuthology.orchestra.run.smithi187.stdout: debug ms = 1 2023-12-12T10:11:08.736 INFO:teuthology.orchestra.run.smithi187.stdout: debug mgr = 20 2023-12-12T10:11:08.737 INFO:teuthology.orchestra.run.smithi187.stdout: debug mon = 20 2023-12-12T10:11:08.737 INFO:teuthology.orchestra.run.smithi187.stdout: debug auth = 20 2023-12-12T10:11:08.737 INFO:teuthology.orchestra.run.smithi187.stdout: mon reweight min pgs per osd = 4 2023-12-12T10:11:08.737 INFO:teuthology.orchestra.run.smithi187.stdout: mon reweight min bytes per osd = 10 2023-12-12T10:11:08.737 INFO:teuthology.orchestra.run.smithi187.stdout: mgr/telemetry/nag = false 2023-12-12T10:11:08.737 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-12-12T10:11:08.737 INFO:teuthology.orchestra.run.smithi187.stdout:[mon] 2023-12-12T10:11:08.737 INFO:teuthology.orchestra.run.smithi187.stdout: debug ms = 1 2023-12-12T10:11:08.737 INFO:teuthology.orchestra.run.smithi187.stdout: debug mon = 20 2023-12-12T10:11:08.737 INFO:teuthology.orchestra.run.smithi187.stdout: debug paxos = 20 2023-12-12T10:11:08.737 INFO:teuthology.orchestra.run.smithi187.stdout: debug auth = 20 2023-12-12T10:11:08.737 INFO:teuthology.orchestra.run.smithi187.stdout: mon data avail warn = 5 2023-12-12T10:11:08.737 INFO:teuthology.orchestra.run.smithi187.stdout: mon mgr mkfs grace = 240 2023-12-12T10:11:08.737 INFO:teuthology.orchestra.run.smithi187.stdout: mon reweight min pgs per osd = 4 2023-12-12T10:11:08.737 INFO:teuthology.orchestra.run.smithi187.stdout: mon osd reporter subtree level = osd 2023-12-12T10:11:08.738 INFO:teuthology.orchestra.run.smithi187.stdout: mon osd prime pg temp = true 2023-12-12T10:11:08.738 INFO:teuthology.orchestra.run.smithi187.stdout: mon reweight min bytes per osd = 10 2023-12-12T10:11:08.738 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-12-12T10:11:08.738 INFO:teuthology.orchestra.run.smithi187.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-12-12T10:11:08.738 INFO:teuthology.orchestra.run.smithi187.stdout: auth mon ticket ttl = 660 # 11m 2023-12-12T10:11:08.738 INFO:teuthology.orchestra.run.smithi187.stdout: auth service ticket ttl = 240 # 4m 2023-12-12T10:11:08.738 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-12-12T10:11:08.738 INFO:teuthology.orchestra.run.smithi187.stdout: # don't complain about insecure global_id in the test suite 2023-12-12T10:11:08.738 INFO:teuthology.orchestra.run.smithi187.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-12-12T10:11:08.738 INFO:teuthology.orchestra.run.smithi187.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-12-12T10:11:08.738 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-12-12T10:11:08.738 INFO:teuthology.orchestra.run.smithi187.stdout: # 1m isn't quite enough 2023-12-12T10:11:08.738 INFO:teuthology.orchestra.run.smithi187.stdout: mon_down_mkfs_grace = 2m 2023-12-12T10:11:08.738 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-12-12T10:11:08.738 INFO:teuthology.orchestra.run.smithi187.stdout: mon_warn_on_filestore_osds = false 2023-12-12T10:11:08.739 INFO:teuthology.orchestra.run.smithi187.stdout: mon op complaint time = 120 2023-12-12T10:11:08.739 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-12-12T10:11:08.739 INFO:teuthology.orchestra.run.smithi187.stdout:[client] 2023-12-12T10:11:08.739 INFO:teuthology.orchestra.run.smithi187.stdout: rgw cache enabled = true 2023-12-12T10:11:08.739 INFO:teuthology.orchestra.run.smithi187.stdout: rgw enable ops log = true 2023-12-12T10:11:08.739 INFO:teuthology.orchestra.run.smithi187.stdout: rgw enable usage log = true 2023-12-12T10:11:08.739 INFO:teuthology.orchestra.run.smithi187.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-12-12T10:11:08.739 INFO:teuthology.orchestra.run.smithi187.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-12-12T10:11:08.739 INFO:teuthology.orchestra.run.smithi187.stdout: client mount timeout = 600 2023-12-12T10:11:08.739 INFO:teuthology.orchestra.run.smithi187.stdout: debug client = 20 2023-12-12T10:11:08.739 INFO:teuthology.orchestra.run.smithi187.stdout: debug ms = 1 2023-12-12T10:11:08.739 INFO:teuthology.orchestra.run.smithi187.stdout: pid file = "" 2023-12-12T10:11:08.739 INFO:teuthology.orchestra.run.smithi187.stdout: rados mon op timeout = 900 2023-12-12T10:11:08.739 INFO:teuthology.orchestra.run.smithi187.stdout: rados osd op timeout = 900 2023-12-12T10:11:08.739 INFO:teuthology.orchestra.run.smithi187.stdout:[mon.a] 2023-12-12T10:11:08.740 INFO:teuthology.orchestra.run.smithi187.stdout:[mon.b] 2023-12-12T10:11:08.740 INFO:teuthology.orchestra.run.smithi187.stdout:[mon.c] 2023-12-12T10:11:08.740 INFO:teuthology.orchestra.run.smithi187.stdout:[mds.a] 2023-12-12T10:11:08.740 INFO:teuthology.orchestra.run.smithi187.stdout:[mds.c] 2023-12-12T10:11:08.740 INFO:teuthology.orchestra.run.smithi187.stdout:[mds.b] 2023-12-12T10:11:08.740 INFO:teuthology.orchestra.run.smithi187.stdout:[mds.d] 2023-12-12T10:11:08.740 INFO:teuthology.orchestra.run.smithi187.stdout:[mds] 2023-12-12T10:11:08.740 INFO:teuthology.orchestra.run.smithi187.stdout: debug mds = 20 2023-12-12T10:11:08.740 INFO:teuthology.orchestra.run.smithi187.stdout: debug mds balancer = 20 2023-12-12T10:11:08.740 INFO:teuthology.orchestra.run.smithi187.stdout: debug ms = 1 2023-12-12T10:11:08.740 INFO:teuthology.orchestra.run.smithi187.stdout: mds debug frag = True 2023-12-12T10:11:08.740 INFO:teuthology.orchestra.run.smithi187.stdout: mds debug scatterstat = True 2023-12-12T10:11:08.740 INFO:teuthology.orchestra.run.smithi187.stdout: mds op complaint time = 180 2023-12-12T10:11:08.740 INFO:teuthology.orchestra.run.smithi187.stdout: mds verify scatter = True 2023-12-12T10:11:08.740 INFO:teuthology.orchestra.run.smithi187.stdout: osd op complaint time = 180 2023-12-12T10:11:08.740 INFO:teuthology.orchestra.run.smithi187.stdout: rados mon op timeout = 900 2023-12-12T10:11:08.741 INFO:teuthology.orchestra.run.smithi187.stdout: rados osd op timeout = 900 2023-12-12T10:11:08.742 INFO:tasks.ceph:Creating admin key on mon.a... 2023-12-12T10:11:08.742 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-12-12T10:11:08.841 INFO:tasks.ceph:Copying monmap to all nodes... 2023-12-12T10:11:08.842 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-12-12T10:11:08.842 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-12-12T10:11:08.851 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-12-12T10:11:08.851 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-12-12T10:11:08.902 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi078.front.sepia.ceph.com 2023-12-12T10:11:08.902 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-12-12T10:11:08.902 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/etc/ceph/ceph.keyring 2023-12-12T10:11:08.902 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-12T10:11:08.977 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-12-12T10:11:08.977 DEBUG:teuthology.orchestra.run.smithi078:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-12-12T10:11:09.029 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi187.front.sepia.ceph.com 2023-12-12T10:11:09.030 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-12-12T10:11:09.030 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/etc/ceph/ceph.keyring 2023-12-12T10:11:09.030 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-12T10:11:09.065 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-12-12T10:11:09.066 DEBUG:teuthology.orchestra.run.smithi187:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-12-12T10:11:09.118 INFO:tasks.ceph:Setting up mon nodes... 2023-12-12T10:11:09.118 INFO:tasks.ceph:Setting up mgr nodes... 2023-12-12T10:11:09.118 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-12-12T10:11:09.174 INFO:teuthology.orchestra.run.smithi078.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-12-12T10:11:09.179 DEBUG:teuthology.orchestra.run.smithi187:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-12-12T10:11:09.237 INFO:teuthology.orchestra.run.smithi187.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-12-12T10:11:09.258 INFO:tasks.ceph:Setting up mds nodes... 2023-12-12T10:11:09.259 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-12-12T10:11:09.315 INFO:teuthology.orchestra.run.smithi078.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-12-12T10:11:09.319 DEBUG:teuthology.orchestra.run.smithi078:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-12-12T10:11:09.340 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-12-12T10:11:09.436 INFO:teuthology.orchestra.run.smithi078.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-12-12T10:11:09.441 DEBUG:teuthology.orchestra.run.smithi078:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-12-12T10:11:09.462 DEBUG:teuthology.orchestra.run.smithi187:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-12-12T10:11:09.520 INFO:teuthology.orchestra.run.smithi187.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-12-12T10:11:09.524 DEBUG:teuthology.orchestra.run.smithi187:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-12-12T10:11:09.545 DEBUG:teuthology.orchestra.run.smithi187:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-12-12T10:11:09.645 INFO:teuthology.orchestra.run.smithi187.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-12-12T10:11:09.649 DEBUG:teuthology.orchestra.run.smithi187:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-12-12T10:11:09.669 INFO:tasks.ceph_client:Setting up client nodes... 2023-12-12T10:11:09.669 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-12-12T10:11:09.713 INFO:teuthology.orchestra.run.smithi078.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-12-12T10:11:09.730 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-12-12T10:11:09.820 INFO:teuthology.orchestra.run.smithi078.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-12-12T10:11:09.837 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-12-12T10:11:09.881 INFO:teuthology.orchestra.run.smithi187.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-12-12T10:11:09.898 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-12-12T10:11:09.988 INFO:teuthology.orchestra.run.smithi187.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-12-12T10:11:10.005 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-12-12T10:11:10.005 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi078.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi187.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-12-12T10:11:10.005 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-12-12T10:11:10.025 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-12T10:11:10.026 INFO:tasks.ceph:role: osd.0 2023-12-12T10:11:10.026 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi078.front.sepia.ceph.com 2023-12-12T10:11:10.026 DEBUG:teuthology.orchestra.run.smithi078:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-12-12T10:11:10.096 INFO:teuthology.orchestra.run.smithi078.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-12-12T10:11:10.097 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-12T10:11:10.097 INFO:teuthology.orchestra.run.smithi078.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-12T10:11:10.097 INFO:teuthology.orchestra.run.smithi078.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-12-12T10:11:10.097 INFO:teuthology.orchestra.run.smithi078.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-12T10:11:10.097 INFO:teuthology.orchestra.run.smithi078.stdout: = sunit=0 swidth=0 blks 2023-12-12T10:11:10.097 INFO:teuthology.orchestra.run.smithi078.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-12T10:11:10.097 INFO:teuthology.orchestra.run.smithi078.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-12-12T10:11:10.097 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-12T10:11:10.097 INFO:teuthology.orchestra.run.smithi078.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-12T10:11:10.567 INFO:teuthology.orchestra.run.smithi078.stdout:Discarding blocks...Done. 2023-12-12T10:11:10.570 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi078.front.sepia.ceph.com -o noatime 2023-12-12T10:11:10.570 DEBUG:teuthology.orchestra.run.smithi078:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-12-12T10:11:10.681 DEBUG:teuthology.orchestra.run.smithi078:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-12-12T10:11:10.698 INFO:teuthology.orchestra.run.smithi078.stderr:sudo: /sbin/restorecon: command not found 2023-12-12T10:11:10.699 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-12T10:11:10.700 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-12-12T10:11:10.766 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-12T10:11:10.766 INFO:tasks.ceph:role: osd.1 2023-12-12T10:11:10.766 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi078.front.sepia.ceph.com 2023-12-12T10:11:10.766 DEBUG:teuthology.orchestra.run.smithi078:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-12-12T10:11:10.843 INFO:teuthology.orchestra.run.smithi078.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-12-12T10:11:10.843 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-12T10:11:10.843 INFO:teuthology.orchestra.run.smithi078.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-12T10:11:10.843 INFO:teuthology.orchestra.run.smithi078.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-12-12T10:11:10.843 INFO:teuthology.orchestra.run.smithi078.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-12T10:11:10.843 INFO:teuthology.orchestra.run.smithi078.stdout: = sunit=0 swidth=0 blks 2023-12-12T10:11:10.843 INFO:teuthology.orchestra.run.smithi078.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-12T10:11:10.843 INFO:teuthology.orchestra.run.smithi078.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-12-12T10:11:10.843 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-12T10:11:10.843 INFO:teuthology.orchestra.run.smithi078.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-12T10:11:11.352 INFO:teuthology.orchestra.run.smithi078.stdout:Discarding blocks...Done. 2023-12-12T10:11:11.355 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi078.front.sepia.ceph.com -o noatime 2023-12-12T10:11:11.356 DEBUG:teuthology.orchestra.run.smithi078:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-12-12T10:11:11.511 DEBUG:teuthology.orchestra.run.smithi078:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-12-12T10:11:11.529 INFO:teuthology.orchestra.run.smithi078.stderr:sudo: /sbin/restorecon: command not found 2023-12-12T10:11:11.529 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-12T10:11:11.530 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-12-12T10:11:11.598 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-12T10:11:11.598 INFO:tasks.ceph:role: osd.2 2023-12-12T10:11:11.598 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi078.front.sepia.ceph.com 2023-12-12T10:11:11.598 DEBUG:teuthology.orchestra.run.smithi078:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-12-12T10:11:11.669 INFO:teuthology.orchestra.run.smithi078.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-12-12T10:11:11.670 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-12T10:11:11.670 INFO:teuthology.orchestra.run.smithi078.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-12T10:11:11.670 INFO:teuthology.orchestra.run.smithi078.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-12-12T10:11:11.670 INFO:teuthology.orchestra.run.smithi078.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-12T10:11:11.670 INFO:teuthology.orchestra.run.smithi078.stdout: = sunit=0 swidth=0 blks 2023-12-12T10:11:11.670 INFO:teuthology.orchestra.run.smithi078.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-12T10:11:11.670 INFO:teuthology.orchestra.run.smithi078.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-12-12T10:11:11.670 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-12T10:11:11.670 INFO:teuthology.orchestra.run.smithi078.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-12T10:11:12.136 INFO:teuthology.orchestra.run.smithi078.stdout:Discarding blocks...Done. 2023-12-12T10:11:12.140 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi078.front.sepia.ceph.com -o noatime 2023-12-12T10:11:12.140 DEBUG:teuthology.orchestra.run.smithi078:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-12-12T10:11:12.239 DEBUG:teuthology.orchestra.run.smithi078:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-12-12T10:11:12.257 INFO:teuthology.orchestra.run.smithi078.stderr:sudo: /sbin/restorecon: command not found 2023-12-12T10:11:12.258 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-12T10:11:12.259 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-12-12T10:11:12.323 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-12T10:11:12.323 INFO:tasks.ceph:role: osd.3 2023-12-12T10:11:12.323 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi078.front.sepia.ceph.com 2023-12-12T10:11:12.323 DEBUG:teuthology.orchestra.run.smithi078:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-12-12T10:11:12.394 INFO:teuthology.orchestra.run.smithi078.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-12-12T10:11:12.394 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-12T10:11:12.394 INFO:teuthology.orchestra.run.smithi078.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-12T10:11:12.395 INFO:teuthology.orchestra.run.smithi078.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-12-12T10:11:12.395 INFO:teuthology.orchestra.run.smithi078.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-12T10:11:12.395 INFO:teuthology.orchestra.run.smithi078.stdout: = sunit=0 swidth=0 blks 2023-12-12T10:11:12.395 INFO:teuthology.orchestra.run.smithi078.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-12T10:11:12.395 INFO:teuthology.orchestra.run.smithi078.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-12-12T10:11:12.395 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-12T10:11:12.395 INFO:teuthology.orchestra.run.smithi078.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-12T10:11:12.837 INFO:teuthology.orchestra.run.smithi078.stdout:Discarding blocks...Done. 2023-12-12T10:11:12.839 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi078.front.sepia.ceph.com -o noatime 2023-12-12T10:11:12.840 DEBUG:teuthology.orchestra.run.smithi078:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-12-12T10:11:12.948 DEBUG:teuthology.orchestra.run.smithi078:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-12-12T10:11:12.965 INFO:teuthology.orchestra.run.smithi078.stderr:sudo: /sbin/restorecon: command not found 2023-12-12T10:11:12.966 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-12T10:11:12.966 DEBUG:teuthology.orchestra.run.smithi078:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-12T10:11:13.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:13.097+0000 7f3a5b36e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-12-12T10:11:13.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:13.097+0000 7f3a5b36e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-12-12T10:11:13.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:13.097+0000 7f3a5b36e640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-12-12T10:11:13.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:13.097+0000 7f3a5b36e640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-12-12T10:11:13.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:13.097+0000 7f3a5b36e640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-12-12T10:11:13.103 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:13.101+0000 7f3a5b36e640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-12-12T10:11:16.101 DEBUG:teuthology.orchestra.run.smithi078:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-12-12T10:11:16.122 DEBUG:teuthology.orchestra.run.smithi078:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-12T10:11:16.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:16.221+0000 7ff3ac9c6640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-12-12T10:11:16.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:16.221+0000 7ff3ac9c6640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-12-12T10:11:16.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:16.221+0000 7ff3ac9c6640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-12-12T10:11:16.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:16.221+0000 7ff3ac9c6640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-12-12T10:11:16.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:16.221+0000 7ff3ac9c6640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-12-12T10:11:16.226 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:16.225+0000 7ff3ac9c6640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-12-12T10:11:19.213 DEBUG:teuthology.orchestra.run.smithi078:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-12-12T10:11:19.234 DEBUG:teuthology.orchestra.run.smithi078:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-12T10:11:19.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:19.328+0000 7fd63cc22640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-12-12T10:11:19.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:19.328+0000 7fd63cc22640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-12-12T10:11:19.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:19.328+0000 7fd63cc22640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-12-12T10:11:19.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:19.328+0000 7fd63cc22640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-12-12T10:11:19.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:19.328+0000 7fd63cc22640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-12-12T10:11:19.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:19.328+0000 7fd63cc22640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-12-12T10:11:22.324 DEBUG:teuthology.orchestra.run.smithi078:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-12-12T10:11:22.345 DEBUG:teuthology.orchestra.run.smithi078:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-12T10:11:22.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:22.440+0000 7fa63fee0640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-12-12T10:11:22.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:22.440+0000 7fa63fee0640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-12-12T10:11:22.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:22.440+0000 7fa63fee0640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-12-12T10:11:22.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:22.440+0000 7fa63fee0640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-12-12T10:11:22.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:22.440+0000 7fa63fee0640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-12-12T10:11:22.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:22.440+0000 7fa63fee0640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-12-12T10:11:25.424 DEBUG:teuthology.orchestra.run.smithi078:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-12-12T10:11:25.445 DEBUG:teuthology.orchestra.run.smithi187:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-12-12T10:11:25.468 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-12T10:11:25.468 INFO:tasks.ceph:role: osd.4 2023-12-12T10:11:25.468 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi187.front.sepia.ceph.com 2023-12-12T10:11:25.468 DEBUG:teuthology.orchestra.run.smithi187:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-12-12T10:11:25.539 INFO:teuthology.orchestra.run.smithi187.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-12-12T10:11:25.540 INFO:teuthology.orchestra.run.smithi187.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-12T10:11:25.540 INFO:teuthology.orchestra.run.smithi187.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-12T10:11:25.540 INFO:teuthology.orchestra.run.smithi187.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-12-12T10:11:25.540 INFO:teuthology.orchestra.run.smithi187.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-12T10:11:25.540 INFO:teuthology.orchestra.run.smithi187.stdout: = sunit=0 swidth=0 blks 2023-12-12T10:11:25.540 INFO:teuthology.orchestra.run.smithi187.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-12T10:11:25.540 INFO:teuthology.orchestra.run.smithi187.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-12-12T10:11:25.540 INFO:teuthology.orchestra.run.smithi187.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-12T10:11:25.540 INFO:teuthology.orchestra.run.smithi187.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-12T10:11:26.012 INFO:teuthology.orchestra.run.smithi187.stdout:Discarding blocks...Done. 2023-12-12T10:11:26.015 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi187.front.sepia.ceph.com -o noatime 2023-12-12T10:11:26.016 DEBUG:teuthology.orchestra.run.smithi187:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-12-12T10:11:26.196 DEBUG:teuthology.orchestra.run.smithi187:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-12-12T10:11:26.214 INFO:teuthology.orchestra.run.smithi187.stderr:sudo: /sbin/restorecon: command not found 2023-12-12T10:11:26.215 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-12T10:11:26.215 DEBUG:teuthology.orchestra.run.smithi187:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-12-12T10:11:26.283 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-12T10:11:26.283 INFO:tasks.ceph:role: osd.5 2023-12-12T10:11:26.283 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi187.front.sepia.ceph.com 2023-12-12T10:11:26.284 DEBUG:teuthology.orchestra.run.smithi187:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-12-12T10:11:26.359 INFO:teuthology.orchestra.run.smithi187.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-12-12T10:11:26.359 INFO:teuthology.orchestra.run.smithi187.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-12T10:11:26.359 INFO:teuthology.orchestra.run.smithi187.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-12T10:11:26.359 INFO:teuthology.orchestra.run.smithi187.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-12-12T10:11:26.359 INFO:teuthology.orchestra.run.smithi187.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-12T10:11:26.359 INFO:teuthology.orchestra.run.smithi187.stdout: = sunit=0 swidth=0 blks 2023-12-12T10:11:26.359 INFO:teuthology.orchestra.run.smithi187.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-12T10:11:26.359 INFO:teuthology.orchestra.run.smithi187.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-12-12T10:11:26.360 INFO:teuthology.orchestra.run.smithi187.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-12T10:11:26.360 INFO:teuthology.orchestra.run.smithi187.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-12T10:11:26.782 INFO:teuthology.orchestra.run.smithi187.stdout:Discarding blocks...Done. 2023-12-12T10:11:26.785 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi187.front.sepia.ceph.com -o noatime 2023-12-12T10:11:26.785 DEBUG:teuthology.orchestra.run.smithi187:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-12-12T10:11:26.890 DEBUG:teuthology.orchestra.run.smithi187:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-12-12T10:11:26.907 INFO:teuthology.orchestra.run.smithi187.stderr:sudo: /sbin/restorecon: command not found 2023-12-12T10:11:26.908 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-12T10:11:26.909 DEBUG:teuthology.orchestra.run.smithi187:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-12-12T10:11:26.974 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-12T10:11:26.975 INFO:tasks.ceph:role: osd.6 2023-12-12T10:11:26.975 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi187.front.sepia.ceph.com 2023-12-12T10:11:26.975 DEBUG:teuthology.orchestra.run.smithi187:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-12-12T10:11:27.045 INFO:teuthology.orchestra.run.smithi187.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-12-12T10:11:27.046 INFO:teuthology.orchestra.run.smithi187.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-12T10:11:27.046 INFO:teuthology.orchestra.run.smithi187.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-12T10:11:27.046 INFO:teuthology.orchestra.run.smithi187.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-12-12T10:11:27.046 INFO:teuthology.orchestra.run.smithi187.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-12T10:11:27.046 INFO:teuthology.orchestra.run.smithi187.stdout: = sunit=0 swidth=0 blks 2023-12-12T10:11:27.046 INFO:teuthology.orchestra.run.smithi187.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-12T10:11:27.046 INFO:teuthology.orchestra.run.smithi187.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-12-12T10:11:27.046 INFO:teuthology.orchestra.run.smithi187.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-12T10:11:27.046 INFO:teuthology.orchestra.run.smithi187.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-12T10:11:27.513 INFO:teuthology.orchestra.run.smithi187.stdout:Discarding blocks...Done. 2023-12-12T10:11:27.516 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi187.front.sepia.ceph.com -o noatime 2023-12-12T10:11:27.516 DEBUG:teuthology.orchestra.run.smithi187:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-12-12T10:11:27.670 DEBUG:teuthology.orchestra.run.smithi187:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-12-12T10:11:27.688 INFO:teuthology.orchestra.run.smithi187.stderr:sudo: /sbin/restorecon: command not found 2023-12-12T10:11:27.689 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-12T10:11:27.689 DEBUG:teuthology.orchestra.run.smithi187:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-12-12T10:11:27.759 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-12T10:11:27.760 INFO:tasks.ceph:role: osd.7 2023-12-12T10:11:27.760 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi187.front.sepia.ceph.com 2023-12-12T10:11:27.760 DEBUG:teuthology.orchestra.run.smithi187:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-12-12T10:11:27.830 INFO:teuthology.orchestra.run.smithi187.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-12-12T10:11:27.830 INFO:teuthology.orchestra.run.smithi187.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-12T10:11:27.830 INFO:teuthology.orchestra.run.smithi187.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-12T10:11:27.831 INFO:teuthology.orchestra.run.smithi187.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-12-12T10:11:27.831 INFO:teuthology.orchestra.run.smithi187.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-12T10:11:27.831 INFO:teuthology.orchestra.run.smithi187.stdout: = sunit=0 swidth=0 blks 2023-12-12T10:11:27.831 INFO:teuthology.orchestra.run.smithi187.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-12T10:11:27.831 INFO:teuthology.orchestra.run.smithi187.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-12-12T10:11:27.831 INFO:teuthology.orchestra.run.smithi187.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-12T10:11:27.831 INFO:teuthology.orchestra.run.smithi187.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-12T10:11:28.315 INFO:teuthology.orchestra.run.smithi187.stdout:Discarding blocks...Done. 2023-12-12T10:11:28.318 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi187.front.sepia.ceph.com -o noatime 2023-12-12T10:11:28.319 DEBUG:teuthology.orchestra.run.smithi187:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-12-12T10:11:28.478 DEBUG:teuthology.orchestra.run.smithi187:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-12-12T10:11:28.497 INFO:teuthology.orchestra.run.smithi187.stderr:sudo: /sbin/restorecon: command not found 2023-12-12T10:11:28.497 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-12T10:11:28.498 DEBUG:teuthology.orchestra.run.smithi187:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-12T10:11:28.636 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:28.628+0000 7f9ee36f9640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-12-12T10:11:28.636 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:28.628+0000 7f9ee36f9640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-12-12T10:11:28.637 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:28.628+0000 7f9ee36f9640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-12-12T10:11:28.637 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:28.628+0000 7f9ee36f9640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-12-12T10:11:28.637 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:28.628+0000 7f9ee36f9640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-12-12T10:11:28.639 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:28.632+0000 7f9ee36f9640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-12-12T10:11:31.629 DEBUG:teuthology.orchestra.run.smithi187:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-12-12T10:11:31.650 DEBUG:teuthology.orchestra.run.smithi187:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-12T10:11:31.747 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:31.740+0000 7fe77b738640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-12-12T10:11:31.748 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:31.740+0000 7fe77b738640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-12-12T10:11:31.748 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:31.740+0000 7fe77b738640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-12-12T10:11:31.748 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:31.740+0000 7fe77b738640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-12-12T10:11:31.748 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:31.740+0000 7fe77b738640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-12-12T10:11:31.749 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:31.740+0000 7fe77b738640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-12-12T10:11:34.749 DEBUG:teuthology.orchestra.run.smithi187:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-12-12T10:11:34.770 DEBUG:teuthology.orchestra.run.smithi187:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-12T10:11:34.868 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:34.860+0000 7fc5a7a9e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-12-12T10:11:34.869 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:34.860+0000 7fc5a7a9e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-12-12T10:11:34.869 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:34.860+0000 7fc5a7a9e640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-12-12T10:11:34.869 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:34.860+0000 7fc5a7a9e640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-12-12T10:11:34.870 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:34.860+0000 7fc5a7a9e640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-12-12T10:11:34.870 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:34.864+0000 7fc5a7a9e640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-12-12T10:11:36.799 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T10:11:36.803 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T10:11:37.856 DEBUG:teuthology.orchestra.run.smithi187:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-12-12T10:11:37.877 DEBUG:teuthology.orchestra.run.smithi187:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-12T10:11:37.974 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:37.968+0000 7f87dd56e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-12-12T10:11:37.975 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:37.968+0000 7f87dd56e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-12-12T10:11:37.975 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:37.968+0000 7f87dd56e640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-12-12T10:11:37.975 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:37.968+0000 7f87dd56e640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-12-12T10:11:37.975 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:37.968+0000 7f87dd56e640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-12-12T10:11:37.976 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:37.968+0000 7f87dd56e640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-12-12T10:11:40.980 DEBUG:teuthology.orchestra.run.smithi187:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-12-12T10:11:41.002 INFO:tasks.ceph:Reading keys from all nodes... 2023-12-12T10:11:41.002 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-12-12T10:11:41.002 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-12-12T10:11:41.024 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-12-12T10:11:41.025 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-12-12T10:11:41.087 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-12-12T10:11:41.087 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-12-12T10:11:41.151 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-12-12T10:11:41.151 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-12-12T10:11:41.215 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-12-12T10:11:41.215 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-12-12T10:11:41.283 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-12-12T10:11:41.284 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-12-12T10:11:41.350 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-12-12T10:11:41.351 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-12-12T10:11:41.414 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-12-12T10:11:41.415 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-12-12T10:11:41.435 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-12-12T10:11:41.435 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-12-12T10:11:41.497 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-12-12T10:11:41.497 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-12-12T10:11:41.557 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-12-12T10:11:41.557 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-12-12T10:11:41.624 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-12-12T10:11:41.624 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-12-12T10:11:41.685 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-12-12T10:11:41.685 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-12-12T10:11:41.749 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-12-12T10:11:41.749 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-12-12T10:11:41.809 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-12-12T10:11:41.809 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-12-12T10:11:41.818 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-12-12T10:11:41.819 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-12-12T10:11:41.870 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-12-12T10:11:41.870 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-12-12T10:11:41.879 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-12-12T10:11:41.879 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-12-12T10:11:41.934 INFO:tasks.ceph:Adding keys to all mons... 2023-12-12T10:11:41.934 DEBUG:teuthology.orchestra.run.smithi078:> sudo tee -a /etc/ceph/ceph.keyring 2023-12-12T10:11:41.937 DEBUG:teuthology.orchestra.run.smithi187:> sudo tee -a /etc/ceph/ceph.keyring 2023-12-12T10:11:41.985 INFO:teuthology.orchestra.run.smithi078.stdout:[mgr.y] 2023-12-12T10:11:41.985 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQC9MXhlkyRwChAAs+qyqXewUeMJCk4wb5karA== 2023-12-12T10:11:41.985 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.a] 2023-12-12T10:11:41.985 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQC9MXhl9jLUEhAApdljSVpok5F0hiRP2zOrHw== 2023-12-12T10:11:41.986 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.c] 2023-12-12T10:11:41.986 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQC9MXhlPncKGhAAqLdE0ZFUkmDYyZjNiHasIg== 2023-12-12T10:11:41.986 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.0] 2023-12-12T10:11:41.986 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQDBMXhlx8boBRAAcI7xK/k/mqAZ4v40kgfXpA== 2023-12-12T10:11:41.986 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.1] 2023-12-12T10:11:41.986 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQDEMXhltRBsDRAAf+fuh4ShmFR2ePtiQKdRgw== 2023-12-12T10:11:41.986 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.2] 2023-12-12T10:11:41.986 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQDHMXhlvm7JExAAgHaGX0EjAqZf0WQ/lPsR/g== 2023-12-12T10:11:41.986 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.3] 2023-12-12T10:11:41.986 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQDKMXhlFktwGhAA+1TmvEYdPEKwZ68amhEodg== 2023-12-12T10:11:41.986 INFO:teuthology.orchestra.run.smithi078.stdout:[mgr.x] 2023-12-12T10:11:41.986 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQC9MXhl8XMNDhAATAoK79OFyqhqJrtBKqLbvg== 2023-12-12T10:11:41.986 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.b] 2023-12-12T10:11:41.987 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQC9MXhljP3pHhAA4G39b2V4Ss3HHgiSovCiTg== 2023-12-12T10:11:41.987 INFO:teuthology.orchestra.run.smithi078.stdout:[mds.d] 2023-12-12T10:11:41.987 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQC9MXhl20VVJhAAzcJ9IWPIA8/OYLC2LSCo0Q== 2023-12-12T10:11:41.987 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.4] 2023-12-12T10:11:41.987 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQDQMXhlZG3GJRAAhvNGOPLGeX6mMB3t9xEj7w== 2023-12-12T10:11:41.987 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.5] 2023-12-12T10:11:41.987 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQDTMXhlNAFwLBAAmp85VURm5enm2MtSCOUEHg== 2023-12-12T10:11:41.987 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.6] 2023-12-12T10:11:41.987 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQDWMXhlI0aoMxAA/U9uyt/vGAlvtWVVgzf/yg== 2023-12-12T10:11:41.987 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.7] 2023-12-12T10:11:41.987 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQDZMXhlifvzORAAzssIwFAoRndB0Nll7RBmqg== 2023-12-12T10:11:41.987 INFO:teuthology.orchestra.run.smithi078.stdout:[client.0] 2023-12-12T10:11:41.987 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQC9MXhlbW+PKhAAckuiPNqUk5U7bz+jhw/xLA== 2023-12-12T10:11:41.987 INFO:teuthology.orchestra.run.smithi078.stdout:[client.2] 2023-12-12T10:11:41.988 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQC9MXhlS0PyMBAAaQhxEPiqOOJUhwLxkad3Rw== 2023-12-12T10:11:41.988 INFO:teuthology.orchestra.run.smithi078.stdout:[client.1] 2023-12-12T10:11:41.988 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQC9MXhlDwRkNBAA3jpUbIHYb/ScB4g37WDdIQ== 2023-12-12T10:11:41.988 INFO:teuthology.orchestra.run.smithi078.stdout:[client.3] 2023-12-12T10:11:41.988 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQC9MXhlxoXFOhAAL4yd3Yg5ZW/LywH2s+qCLQ== 2023-12-12T10:11:41.999 INFO:teuthology.orchestra.run.smithi187.stdout:[mgr.y] 2023-12-12T10:11:42.000 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQC9MXhlkyRwChAAs+qyqXewUeMJCk4wb5karA== 2023-12-12T10:11:42.000 INFO:teuthology.orchestra.run.smithi187.stdout:[mds.a] 2023-12-12T10:11:42.000 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQC9MXhl9jLUEhAApdljSVpok5F0hiRP2zOrHw== 2023-12-12T10:11:42.000 INFO:teuthology.orchestra.run.smithi187.stdout:[mds.c] 2023-12-12T10:11:42.000 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQC9MXhlPncKGhAAqLdE0ZFUkmDYyZjNiHasIg== 2023-12-12T10:11:42.000 INFO:teuthology.orchestra.run.smithi187.stdout:[osd.0] 2023-12-12T10:11:42.000 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQDBMXhlx8boBRAAcI7xK/k/mqAZ4v40kgfXpA== 2023-12-12T10:11:42.000 INFO:teuthology.orchestra.run.smithi187.stdout:[osd.1] 2023-12-12T10:11:42.000 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQDEMXhltRBsDRAAf+fuh4ShmFR2ePtiQKdRgw== 2023-12-12T10:11:42.000 INFO:teuthology.orchestra.run.smithi187.stdout:[osd.2] 2023-12-12T10:11:42.001 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQDHMXhlvm7JExAAgHaGX0EjAqZf0WQ/lPsR/g== 2023-12-12T10:11:42.001 INFO:teuthology.orchestra.run.smithi187.stdout:[osd.3] 2023-12-12T10:11:42.001 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQDKMXhlFktwGhAA+1TmvEYdPEKwZ68amhEodg== 2023-12-12T10:11:42.001 INFO:teuthology.orchestra.run.smithi187.stdout:[mgr.x] 2023-12-12T10:11:42.001 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQC9MXhl8XMNDhAATAoK79OFyqhqJrtBKqLbvg== 2023-12-12T10:11:42.001 INFO:teuthology.orchestra.run.smithi187.stdout:[mds.b] 2023-12-12T10:11:42.001 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQC9MXhljP3pHhAA4G39b2V4Ss3HHgiSovCiTg== 2023-12-12T10:11:42.001 INFO:teuthology.orchestra.run.smithi187.stdout:[mds.d] 2023-12-12T10:11:42.001 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQC9MXhl20VVJhAAzcJ9IWPIA8/OYLC2LSCo0Q== 2023-12-12T10:11:42.001 INFO:teuthology.orchestra.run.smithi187.stdout:[osd.4] 2023-12-12T10:11:42.001 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQDQMXhlZG3GJRAAhvNGOPLGeX6mMB3t9xEj7w== 2023-12-12T10:11:42.001 INFO:teuthology.orchestra.run.smithi187.stdout:[osd.5] 2023-12-12T10:11:42.002 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQDTMXhlNAFwLBAAmp85VURm5enm2MtSCOUEHg== 2023-12-12T10:11:42.002 INFO:teuthology.orchestra.run.smithi187.stdout:[osd.6] 2023-12-12T10:11:42.002 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQDWMXhlI0aoMxAA/U9uyt/vGAlvtWVVgzf/yg== 2023-12-12T10:11:42.002 INFO:teuthology.orchestra.run.smithi187.stdout:[osd.7] 2023-12-12T10:11:42.002 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQDZMXhlifvzORAAzssIwFAoRndB0Nll7RBmqg== 2023-12-12T10:11:42.002 INFO:teuthology.orchestra.run.smithi187.stdout:[client.0] 2023-12-12T10:11:42.002 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQC9MXhlbW+PKhAAckuiPNqUk5U7bz+jhw/xLA== 2023-12-12T10:11:42.002 INFO:teuthology.orchestra.run.smithi187.stdout:[client.2] 2023-12-12T10:11:42.002 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQC9MXhlS0PyMBAAaQhxEPiqOOJUhwLxkad3Rw== 2023-12-12T10:11:42.002 INFO:teuthology.orchestra.run.smithi187.stdout:[client.1] 2023-12-12T10:11:42.002 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQC9MXhlDwRkNBAA3jpUbIHYb/ScB4g37WDdIQ== 2023-12-12T10:11:42.003 INFO:teuthology.orchestra.run.smithi187.stdout:[client.3] 2023-12-12T10:11:42.003 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQC9MXhlxoXFOhAAL4yd3Yg5ZW/LywH2s+qCLQ== 2023-12-12T10:11:42.004 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-12T10:11:42.037 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-12T10:11:42.099 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-12T10:11:42.102 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-12T10:11:42.159 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-12T10:11:42.162 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-12T10:11:42.222 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-12T10:11:42.225 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-12T10:11:42.279 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-12T10:11:42.283 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-12T10:11:42.338 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-12T10:11:42.341 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-12T10:11:42.395 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-12T10:11:42.399 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-12T10:11:42.452 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-12T10:11:42.457 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-12T10:11:42.511 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-12T10:11:42.514 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-12T10:11:42.571 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-12T10:11:42.574 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-12T10:11:42.634 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-12T10:11:42.638 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-12T10:11:42.692 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-12T10:11:42.696 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-12T10:11:42.750 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-12T10:11:42.753 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-12T10:11:42.807 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-12T10:11:42.811 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-12T10:11:42.865 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-12T10:11:42.868 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-12T10:11:42.925 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-12T10:11:42.929 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-12T10:11:42.985 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-12T10:11:42.989 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-12T10:11:43.046 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-12T10:11:43.052 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-12T10:11:43.109 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-12-12T10:11:43.109 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-12-12T10:11:43.130 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-12-12T10:11:43.243 DEBUG:teuthology.orchestra.run.smithi078:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-12-12T10:11:43.264 DEBUG:teuthology.orchestra.run.smithi187:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-12-12T10:11:43.285 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-12-12T10:11:43.400 DEBUG:teuthology.orchestra.run.smithi187:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-12-12T10:11:43.421 DEBUG:teuthology.orchestra.run.smithi187:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-12-12T10:11:43.487 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-12-12T10:11:43.600 DEBUG:teuthology.orchestra.run.smithi187:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-12-12T10:11:43.621 DEBUG:teuthology.orchestra.run.smithi078:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-12-12T10:11:43.625 DEBUG:teuthology.orchestra.run.smithi187:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-12-12T10:11:43.677 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-12-12T10:11:43.678 INFO:tasks.ceph.mon.a:Restarting daemon 2023-12-12T10:11:43.678 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-12-12T10:11:43.681 INFO:tasks.ceph.mon.a:Started 2023-12-12T10:11:43.681 INFO:tasks.ceph.mon.b:Restarting daemon 2023-12-12T10:11:43.682 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-12-12T10:11:43.728 INFO:tasks.ceph.mon.b:Started 2023-12-12T10:11:43.729 INFO:tasks.ceph.mon.c:Restarting daemon 2023-12-12T10:11:43.729 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-12-12T10:11:43.732 INFO:tasks.ceph.mon.c:Started 2023-12-12T10:11:43.732 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-12-12T10:11:43.732 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-12-12T10:11:43.732 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-12-12T10:11:43.736 INFO:tasks.ceph.mgr.y:Started 2023-12-12T10:11:43.736 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-12-12T10:11:43.736 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-12-12T10:11:43.739 INFO:tasks.ceph.mgr.x:Started 2023-12-12T10:11:43.739 INFO:tasks.ceph:Setting crush tunables to default 2023-12-12T10:11:43.740 DEBUG:teuthology.orchestra.run.smithi078:> sudo ceph --cluster ceph osd crush tunables default 2023-12-12T10:11:43.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:43.876+0000 7f288ddc1640 1 Processor -- start 2023-12-12T10:11:43.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:43.876+0000 7f288ddc1640 1 -- start start 2023-12-12T10:11:43.881 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:43.876+0000 7f288ddc1640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f288806cf60 0x7f288815f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:11:43.881 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:43.876+0000 7f288ddc1640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f288815b390 0x7f288815b840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:11:43.881 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:43.876+0000 7f288ddc1640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28880cea30 con 0x7f28880cb4b0 2023-12-12T10:11:43.881 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:43.876+0000 7f288ddc1640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f288815bd80 con 0x7f288806cf60 2023-12-12T10:11:43.881 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:43.876+0000 7f288ddc1640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f288815bfc0 con 0x7f288815b390 2023-12-12T10:11:43.881 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:43.876+0000 7f2886ffd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f288806cf60 0x7f288815f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:11:43.881 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:43.876+0000 7f2886ffd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f288806cf60 0x7f288815f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59686/0 (socket says 172.21.15.78:59686) 2023-12-12T10:11:43.881 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:43.876+0000 7f2886ffd640 1 -- 172.21.15.78:0/1950675755 learned_addr learned my addr 172.21.15.78:0/1950675755 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:11:43.881 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:43.876+0000 7f2886ffd640 1 -- 172.21.15.78:0/1950675755 >> v2:172.21.15.78:3300/0 conn(0x7f288806cf60 msgr2=0x7f288815f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-12-12T10:11:43.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:43.876+0000 7f2886ffd640 1 -- 172.21.15.78:0/1950675755 >> v2:172.21.15.78:3300/0 conn(0x7f288806cf60 msgr2=0x7f288815f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-12T10:11:43.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:43.876+0000 7f2886ffd640 1 --2- 172.21.15.78:0/1950675755 >> v2:172.21.15.78:3300/0 conn(0x7f288806cf60 0x7f288815f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-12T10:11:43.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:43.876+0000 7f2886ffd640 1 --2- 172.21.15.78:0/1950675755 >> v2:172.21.15.78:3300/0 conn(0x7f288806cf60 0x7f288815f500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-12T10:11:43.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:43.876+0000 7f2887fff640 1 --2- 172.21.15.78:0/1950675755 >> v2:172.21.15.187:3300/0 conn(0x7f288815b390 0x7f288815b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:11:43.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:43.876+0000 7f2887fff640 1 -- 172.21.15.78:0/1950675755 >> v2:172.21.15.187:3300/0 conn(0x7f288815b390 msgr2=0x7f288815b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-12-12T10:11:43.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:43.876+0000 7f2887fff640 1 -- 172.21.15.78:0/1950675755 >> v2:172.21.15.187:3300/0 conn(0x7f288815b390 msgr2=0x7f288815b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-12T10:11:43.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:43.876+0000 7f2887fff640 1 --2- 172.21.15.78:0/1950675755 >> v2:172.21.15.187:3300/0 conn(0x7f288815b390 0x7f288815b840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-12T10:11:43.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:43.876+0000 7f2887fff640 1 --2- 172.21.15.78:0/1950675755 >> v2:172.21.15.187:3300/0 conn(0x7f288815b390 0x7f288815b840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-12T10:11:44.057 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:44.052+0000 7f28867fc640 1 -- 172.21.15.78:0/1950675755 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 270063151 0 0) 0x7f28880cea30 con 0x7f28880cb4b0 2023-12-12T10:11:44.057 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:44.052+0000 7f28867fc640 1 -- 172.21.15.78:0/1950675755 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2870003530 con 0x7f28880cb4b0 2023-12-12T10:11:44.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:44.060+0000 7f28867fc640 1 -- 172.21.15.78:0/1950675755 <== mon.1 v1:172.21.15.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2913411319 0 0) 0x7f2870003530 con 0x7f28880cb4b0 2023-12-12T10:11:44.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:44.060+0000 7f28867fc640 1 -- 172.21.15.78:0/1950675755 >> v2:172.21.15.187:3300/0 conn(0x7f288815b390 msgr2=0x7f288815b840 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-12T10:11:44.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:44.060+0000 7f28867fc640 1 --2- 172.21.15.78:0/1950675755 >> v2:172.21.15.187:3300/0 conn(0x7f288815b390 0x7f288815b840 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:11:44.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:44.060+0000 7f28867fc640 1 -- 172.21.15.78:0/1950675755 >> v2:172.21.15.78:3300/0 conn(0x7f288806cf60 msgr2=0x7f288815f500 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-12T10:11:44.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:44.060+0000 7f28867fc640 1 --2- 172.21.15.78:0/1950675755 >> v2:172.21.15.78:3300/0 conn(0x7f288806cf60 0x7f288815f500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:11:44.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:44.060+0000 7f28867fc640 1 -- 172.21.15.78:0/1950675755 --> v1:172.21.15.187:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f288815c2a0 con 0x7f28880cb4b0 2023-12-12T10:11:44.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:44.060+0000 7f28867fc640 1 -- 172.21.15.78:0/1950675755 <== mon.1 v1:172.21.15.187:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 465499599 0 0) 0x7f2878001680 con 0x7f28880cb4b0 2023-12-12T10:11:44.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:44.060+0000 7f28867fc640 1 -- 172.21.15.78:0/1950675755 >> v1:172.21.15.187:6789/0 conn(0x7f28880cb4b0 legacy=0x7f288806c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:11:44.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:44.060+0000 7f28867fc640 1 --2- 172.21.15.78:0/1950675755 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f28700039d0 0x7f2870003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:11:44.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:44.060+0000 7f28867fc640 1 --2- 172.21.15.78:0/1950675755 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28700047d0 0x7f2870004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:11:44.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:44.060+0000 7f28867fc640 1 --2- 172.21.15.78:0/1950675755 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f28700051e0 0x7f287000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:11:44.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:44.060+0000 7f28867fc640 1 -- 172.21.15.78:0/1950675755 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f288815bd80 con 0x7f28700047d0 2023-12-12T10:11:44.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:44.060+0000 7f28867fc640 1 -- 172.21.15.78:0/1950675755 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f288815bfc0 con 0x7f28700051e0 2023-12-12T10:11:44.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:44.060+0000 7f28867fc640 1 -- 172.21.15.78:0/1950675755 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f287000c190 con 0x7f28700039d0 2023-12-12T10:11:44.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:44.060+0000 7f2886ffd640 1 --2- 172.21.15.78:0/1950675755 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28700047d0 0x7f2870004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:11:44.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:44.060+0000 7f28877fe640 1 --2- 172.21.15.78:0/1950675755 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f28700039d0 0x7f2870003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:11:44.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:44.060+0000 7f2887fff640 1 --2- 172.21.15.78:0/1950675755 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f28700051e0 0x7f287000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:11:44.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:44.060+0000 7f2886ffd640 1 -- 172.21.15.78:0/1950675755 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f28700039d0 msgr2=0x7f2870003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:11:44.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:44.060+0000 7f2886ffd640 1 --2- 172.21.15.78:0/1950675755 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f28700039d0 0x7f2870003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:11:44.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:44.060+0000 7f2886ffd640 1 -- 172.21.15.78:0/1950675755 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f28700051e0 msgr2=0x7f287000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:11:44.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:44.060+0000 7f2886ffd640 1 --2- 172.21.15.78:0/1950675755 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f28700051e0 0x7f287000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:11:44.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:44.060+0000 7f2886ffd640 1 -- 172.21.15.78:0/1950675755 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2870003530 con 0x7f28700047d0 2023-12-12T10:11:44.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:44.060+0000 7f2887fff640 1 -- 172.21.15.78:0/1950675755 reap_dead start 2023-12-12T10:11:44.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:44.064+0000 7f2886ffd640 1 --2- 172.21.15.78:0/1950675755 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28700047d0 0x7f2870004c50 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f287c0095f0 tx=0x7f287c0209b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab8c9e9d0bd2ed8a server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:11:44.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:44.064+0000 7f28867fc640 1 -- 172.21.15.78:0/1950675755 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f287c0a9880 con 0x7f28700047d0 2023-12-12T10:11:44.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:44.064+0000 7f28867fc640 1 -- 172.21.15.78:0/1950675755 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f287c0a99e0 con 0x7f28700047d0 2023-12-12T10:11:44.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:44.064+0000 7f28867fc640 1 -- 172.21.15.78:0/1950675755 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f287c0a9d90 con 0x7f28700047d0 2023-12-12T10:11:44.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:44.064+0000 7f288ddc1640 1 -- 172.21.15.78:0/1950675755 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28700047d0 msgr2=0x7f2870004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:11:44.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:44.064+0000 7f288ddc1640 1 --2- 172.21.15.78:0/1950675755 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28700047d0 0x7f2870004c50 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f287c0095f0 tx=0x7f287c0209b0 comp rx=0 tx=0).stop 2023-12-12T10:11:44.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:44.064+0000 7f288ddc1640 1 -- 172.21.15.78:0/1950675755 shutdown_connections 2023-12-12T10:11:44.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:44.064+0000 7f288ddc1640 1 --2- 172.21.15.78:0/1950675755 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28700047d0 0x7f2870004c50 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:11:44.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:44.064+0000 7f288ddc1640 1 -- 172.21.15.78:0/1950675755 >> 172.21.15.78:0/1950675755 conn(0x7f288806a710 msgr2=0x7f288806ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:11:44.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:44.064+0000 7f288ddc1640 1 -- 172.21.15.78:0/1950675755 shutdown_connections 2023-12-12T10:11:44.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:44.064+0000 7f288ddc1640 1 -- 172.21.15.78:0/1950675755 wait complete. 2023-12-12T10:11:44.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:44.068+0000 7f288ddc1640 1 Processor -- start 2023-12-12T10:11:44.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:44.068+0000 7f288ddc1640 1 -- start start 2023-12-12T10:11:44.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:44.068+0000 7f288ddc1640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28700047d0 0x7f28880c49b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:11:44.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:44.068+0000 7f288ddc1640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f288814ae70 0x7f28881f1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:11:44.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:44.068+0000 7f288ddc1640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f288814b2f0 0x7f28881f2530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:11:44.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:44.068+0000 7f288ddc1640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28881e4cf0 con 0x7f28700047d0 2023-12-12T10:11:44.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:44.068+0000 7f288ddc1640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28880c50b0 con 0x7f288814ae70 2023-12-12T10:11:44.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:44.068+0000 7f288ddc1640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28880c5390 con 0x7f288814b2f0 2023-12-12T10:11:44.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:44.068+0000 7f28877fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28700047d0 0x7f28880c49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:11:44.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:44.068+0000 7f2886ffd640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f288814ae70 0x7f28881f1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:11:44.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:44.068+0000 7f2887fff640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f288814b2f0 0x7f28881f2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:11:44.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:44.068+0000 7f28877fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28700047d0 0x7f28880c49b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59714/0 (socket says 172.21.15.78:59714) 2023-12-12T10:11:44.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:44.068+0000 7f28877fe640 1 -- 172.21.15.78:0/2240160792 learned_addr learned my addr 172.21.15.78:0/2240160792 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:11:44.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:44.068+0000 7f28877fe640 1 -- 172.21.15.78:0/2240160792 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f288814b2f0 msgr2=0x7f28881f2530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:11:44.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:44.068+0000 7f28877fe640 1 --2- 172.21.15.78:0/2240160792 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f288814b2f0 0x7f28881f2530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:11:44.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:44.068+0000 7f28877fe640 1 -- 172.21.15.78:0/2240160792 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f288814ae70 msgr2=0x7f28881f1ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:11:44.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:44.068+0000 7f28877fe640 1 --2- 172.21.15.78:0/2240160792 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f288814ae70 0x7f28881f1ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:11:44.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:44.068+0000 7f28877fe640 1 -- 172.21.15.78:0/2240160792 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28881e4910 con 0x7f28700047d0 2023-12-12T10:11:44.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:44.068+0000 7f28877fe640 1 --2- 172.21.15.78:0/2240160792 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28700047d0 0x7f28880c49b0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f287800f810 tx=0x7f287800fcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:11:44.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:44.068+0000 7f286ffff640 1 -- 172.21.15.78:0/2240160792 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28780052e0 con 0x7f28700047d0 2023-12-12T10:11:44.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:44.068+0000 7f286ffff640 1 -- 172.21.15.78:0/2240160792 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2878005460 con 0x7f28700047d0 2023-12-12T10:11:44.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:44.068+0000 7f288ddc1640 1 -- 172.21.15.78:0/2240160792 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28881f31b0 con 0x7f28700047d0 2023-12-12T10:11:44.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:44.068+0000 7f286ffff640 1 -- 172.21.15.78:0/2240160792 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f287800d970 con 0x7f28700047d0 2023-12-12T10:11:44.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:44.068+0000 7f288ddc1640 1 -- 172.21.15.78:0/2240160792 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28881f2a70 con 0x7f28700047d0 2023-12-12T10:11:44.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:44.068+0000 7f286ffff640 1 -- 172.21.15.78:0/2240160792 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f2878003600 con 0x7f28700047d0 2023-12-12T10:11:44.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:44.068+0000 7f286ffff640 1 -- 172.21.15.78:0/2240160792 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f287801d460 con 0x7f28700047d0 2023-12-12T10:11:44.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:44.072+0000 7f288ddc1640 1 -- 172.21.15.78:0/2240160792 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28880671f0 con 0x7f28700047d0 2023-12-12T10:11:44.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:44.072+0000 7f286ffff640 1 -- 172.21.15.78:0/2240160792 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f2878003a90 con 0x7f28700047d0 2023-12-12T10:11:44.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:44.132+0000 7f288ddc1640 1 -- 172.21.15.78:0/2240160792 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f28881e4e30 con 0x7f28700047d0 2023-12-12T10:11:44.140 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:44.136+0000 7f286ffff640 1 -- 172.21.15.78:0/2240160792 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f28881e4e30 con 0x7f28700047d0 2023-12-12T10:11:44.140 INFO:teuthology.orchestra.run.smithi078.stderr:adjusted tunables profile to default 2023-12-12T10:11:44.141 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:44.136+0000 7f288ddc1640 1 -- 172.21.15.78:0/2240160792 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28700047d0 msgr2=0x7f28880c49b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:11:44.142 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:44.136+0000 7f288ddc1640 1 --2- 172.21.15.78:0/2240160792 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28700047d0 0x7f28880c49b0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f287800f810 tx=0x7f287800fcd0 comp rx=0 tx=0).stop 2023-12-12T10:11:44.142 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:44.136+0000 7f288ddc1640 1 -- 172.21.15.78:0/2240160792 shutdown_connections 2023-12-12T10:11:44.142 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:44.136+0000 7f288ddc1640 1 --2- 172.21.15.78:0/2240160792 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f288814b2f0 0x7f28881f2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:11:44.142 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:44.136+0000 7f288ddc1640 1 --2- 172.21.15.78:0/2240160792 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f288814ae70 0x7f28881f1ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:11:44.142 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:44.136+0000 7f288ddc1640 1 --2- 172.21.15.78:0/2240160792 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f28700047d0 0x7f28880c49b0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:11:44.142 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:44.136+0000 7f288ddc1640 1 -- 172.21.15.78:0/2240160792 >> 172.21.15.78:0/2240160792 conn(0x7f288806a710 msgr2=0x7f28880b00a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:11:44.142 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:44.136+0000 7f288ddc1640 1 -- 172.21.15.78:0/2240160792 shutdown_connections 2023-12-12T10:11:44.142 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:44.136+0000 7f288ddc1640 1 -- 172.21.15.78:0/2240160792 wait complete. 2023-12-12T10:11:44.160 INFO:tasks.ceph:check_enable_crimson: False 2023-12-12T10:11:44.160 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-12-12T10:11:44.161 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-12-12T10:11:44.161 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-12-12T10:11:44.181 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-12-12T10:11:44.181 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-12-12T10:11:44.246 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-12-12T10:11:44.246 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-12-12T10:11:44.258 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-12-12T10:11:44.252+0000 7f7a71591180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-12T10:11:44.277 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-12-12T10:11:44.277 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-12-12T10:11:44.290 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-12-12T10:11:44.284+0000 7fd80c6cf180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-12T10:11:44.342 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-12-12T10:11:44.342 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-12-12T10:11:44.363 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-12-12T10:11:44.363 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-12-12T10:11:44.425 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-12-12T10:11:44.425 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-12-12T10:11:44.489 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-12-12T10:11:44.490 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-12-12T10:11:44.554 DEBUG:teuthology.orchestra.run.smithi187:> sudo ceph --cluster ceph osd new 22dfdedf-5f6c-4b20-9f6c-30517a1db70a 0 2023-12-12T10:11:44.737 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:44.728+0000 7f11ec1aa640 1 Processor -- start 2023-12-12T10:11:44.738 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:44.728+0000 7f11ec1aa640 1 -- start start 2023-12-12T10:11:44.739 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:44.732+0000 7f11ec1aa640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f11e40d0be0 0x7f11e40d1040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:11:44.740 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:44.732+0000 7f11ec1aa640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f11e40d15d0 0x7f11e40d1a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:11:44.740 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:44.732+0000 7f11ec1aa640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11e40d04f0 con 0x7f11e4160890 2023-12-12T10:11:44.740 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:44.732+0000 7f11ec1aa640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11e40d1fc0 con 0x7f11e40d15d0 2023-12-12T10:11:44.740 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:44.732+0000 7f11ec1aa640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11e40cdc20 con 0x7f11e40d0be0 2023-12-12T10:11:44.740 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:44.732+0000 7f11e9745640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f11e40d0be0 0x7f11e40d1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:11:44.740 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:44.732+0000 7f11ea747640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f11e40d15d0 0x7f11e40d1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:11:44.740 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:44.732+0000 7f11e9745640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f11e40d0be0 0x7f11e40d1040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.187:48890/0 (socket says 172.21.15.187:48890) 2023-12-12T10:11:44.740 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:44.732+0000 7f11e9745640 1 -- 172.21.15.187:0/1511770031 learned_addr learned my addr 172.21.15.187:0/1511770031 (peer_addr_for_me v2:172.21.15.187:0/0) 2023-12-12T10:11:44.740 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:44.732+0000 7f11e9745640 1 -- 172.21.15.187:0/1511770031 >> v2:172.21.15.187:3300/0 conn(0x7f11e40d15d0 msgr2=0x7f11e40d1a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:11:44.740 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:44.732+0000 7f11e9745640 1 --2- 172.21.15.187:0/1511770031 >> v2:172.21.15.187:3300/0 conn(0x7f11e40d15d0 0x7f11e40d1a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:11:44.740 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:44.732+0000 7f11e9745640 1 -- 172.21.15.187:0/1511770031 >> v1:172.21.15.78:6789/0 conn(0x7f11e4160890 legacy=0x7f11e40b5e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:11:44.740 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:44.732+0000 7f11e9745640 1 -- 172.21.15.187:0/1511770031 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11e40cfc50 con 0x7f11e40d0be0 2023-12-12T10:11:44.742 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:44.736+0000 7f11e9745640 1 --2- 172.21.15.187:0/1511770031 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f11e40d0be0 0x7f11e40d1040 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f11d4009870 tx=0x7f11d401c4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3b3eb8973897a25d server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:11:44.743 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:44.736+0000 7f11e8f44640 1 -- 172.21.15.187:0/1511770031 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11d40aa5f0 con 0x7f11e40d0be0 2023-12-12T10:11:44.743 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:44.736+0000 7f11e8f44640 1 -- 172.21.15.187:0/1511770031 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11d40aa750 con 0x7f11e40d0be0 2023-12-12T10:11:44.743 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:44.736+0000 7f11e8f44640 1 -- 172.21.15.187:0/1511770031 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11d40aaae0 con 0x7f11e40d0be0 2023-12-12T10:11:44.744 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:44.736+0000 7f11ec1aa640 1 -- 172.21.15.187:0/1511770031 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f11e40d0be0 msgr2=0x7f11e40d1040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:11:44.744 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:44.736+0000 7f11ec1aa640 1 --2- 172.21.15.187:0/1511770031 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f11e40d0be0 0x7f11e40d1040 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f11d4009870 tx=0x7f11d401c4d0 comp rx=0 tx=0).stop 2023-12-12T10:11:44.744 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:44.736+0000 7f11ec1aa640 1 -- 172.21.15.187:0/1511770031 shutdown_connections 2023-12-12T10:11:44.744 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:44.736+0000 7f11ec1aa640 1 --2- 172.21.15.187:0/1511770031 >> v2:172.21.15.187:3300/0 conn(0x7f11e40d15d0 0x7f11e40d1a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:11:44.744 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:44.736+0000 7f11ec1aa640 1 --2- 172.21.15.187:0/1511770031 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f11e40d0be0 0x7f11e40d1040 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:11:44.744 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:44.736+0000 7f11ec1aa640 1 -- 172.21.15.187:0/1511770031 >> 172.21.15.187:0/1511770031 conn(0x7f11e409c2f0 msgr2=0x7f11e40d3010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:11:44.744 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:44.736+0000 7f11ec1aa640 1 -- 172.21.15.187:0/1511770031 shutdown_connections 2023-12-12T10:11:44.744 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:44.736+0000 7f11ec1aa640 1 -- 172.21.15.187:0/1511770031 wait complete. 2023-12-12T10:11:44.745 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:44.736+0000 7f11ec1aa640 1 Processor -- start 2023-12-12T10:11:44.745 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:44.736+0000 7f11ec1aa640 1 -- start start 2023-12-12T10:11:44.746 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:44.740+0000 7f11ec1aa640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f11e40d0be0 0x7f11e406c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:11:44.746 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:44.740+0000 7f11ec1aa640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f11e40d15d0 0x7f11e40ca0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:11:44.746 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:44.740+0000 7f11ec1aa640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f11e4160890 0x7f11e40b6220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:11:44.746 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:44.740+0000 7f11ec1aa640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11e406c9d0 con 0x7f11e4160890 2023-12-12T10:11:44.747 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:44.740+0000 7f11ec1aa640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11e413aa40 con 0x7f11e40d0be0 2023-12-12T10:11:44.747 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:44.740+0000 7f11ec1aa640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11e40b6f80 con 0x7f11e40d15d0 2023-12-12T10:11:44.748 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:44.740+0000 7f11e9f46640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f11e40d0be0 0x7f11e406c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:11:44.748 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:44.740+0000 7f11e9745640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f11e40d15d0 0x7f11e40ca0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:11:44.749 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:44.740+0000 7f11e9f46640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f11e40d0be0 0x7f11e406c490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.187:52720/0 (socket says 172.21.15.187:52720) 2023-12-12T10:11:44.749 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:44.740+0000 7f11e9745640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f11e40d15d0 0x7f11e40ca0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.187:48898/0 (socket says 172.21.15.187:48898) 2023-12-12T10:11:44.749 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:44.740+0000 7f11e9f46640 1 -- 172.21.15.187:0/339173175 learned_addr learned my addr 172.21.15.187:0/339173175 (peer_addr_for_me v2:172.21.15.187:0/0) 2023-12-12T10:11:44.749 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:44.740+0000 7f11ea747640 1 --2- 172.21.15.187:0/339173175 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f11e4160890 0x7f11e40b6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:11:44.749 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:44.740+0000 7f11e9745640 1 -- 172.21.15.187:0/339173175 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f11e40d0be0 msgr2=0x7f11e406c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:11:44.749 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:44.740+0000 7f11e9745640 1 --2- 172.21.15.187:0/339173175 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f11e40d0be0 0x7f11e406c490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:11:44.749 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:44.740+0000 7f11e9745640 1 -- 172.21.15.187:0/339173175 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f11e4160890 msgr2=0x7f11e40b6220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:11:44.749 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:44.740+0000 7f11e9745640 1 --2- 172.21.15.187:0/339173175 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f11e4160890 0x7f11e40b6220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:11:44.749 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:44.740+0000 7f11e9745640 1 -- 172.21.15.187:0/339173175 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11d40094d0 con 0x7f11e40d15d0 2023-12-12T10:11:44.749 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:44.740+0000 7f11e9f46640 1 --2- 172.21.15.187:0/339173175 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f11e40d0be0 0x7f11e406c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-12T10:11:44.749 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:44.740+0000 7f11e9745640 1 --2- 172.21.15.187:0/339173175 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f11e40d15d0 0x7f11e40ca0e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f11d40ab000 tx=0x7f11d401ad10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:11:44.749 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:44.740+0000 7f11da7fc640 1 -- 172.21.15.187:0/339173175 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11d40bd5f0 con 0x7f11e40d15d0 2023-12-12T10:11:44.749 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:44.740+0000 7f11da7fc640 1 -- 172.21.15.187:0/339173175 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11d40bd770 con 0x7f11e40d15d0 2023-12-12T10:11:44.750 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:44.740+0000 7f11da7fc640 1 -- 172.21.15.187:0/339173175 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11d40bdb20 con 0x7f11e40d15d0 2023-12-12T10:11:44.750 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:44.740+0000 7f11ec1aa640 1 -- 172.21.15.187:0/339173175 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11e40b7260 con 0x7f11e40d15d0 2023-12-12T10:11:44.750 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:44.740+0000 7f11ec1aa640 1 -- 172.21.15.187:0/339173175 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11e40b7820 con 0x7f11e40d15d0 2023-12-12T10:11:44.750 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:44.740+0000 7f11da7fc640 1 -- 172.21.15.187:0/339173175 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f11d40b36f0 con 0x7f11e40d15d0 2023-12-12T10:11:44.750 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:44.740+0000 7f11da7fc640 1 -- 172.21.15.187:0/339173175 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f11d40a7070 con 0x7f11e40d15d0 2023-12-12T10:11:44.750 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:44.740+0000 7f11ec1aa640 1 -- 172.21.15.187:0/339173175 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11e4067530 con 0x7f11e40d15d0 2023-12-12T10:11:44.766 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:44.760+0000 7f11da7fc640 1 -- 172.21.15.187:0/339173175 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f11d40c3060 con 0x7f11e40d15d0 2023-12-12T10:11:44.796 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-12-12T10:11:44.792+0000 7f7a71591180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-12T10:11:44.827 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-12-12T10:11:44.820+0000 7fd80c6cf180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-12T10:11:44.832 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:44.824+0000 7f11ec1aa640 1 -- 172.21.15.187:0/339173175 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "osd new", "uuid": "22dfdedf-5f6c-4b20-9f6c-30517a1db70a", "id": 0} v 0) v1 -- 0x7f11e40d0690 con 0x7f11e40d15d0 2023-12-12T10:11:44.839 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:44.832+0000 7f11da7fc640 1 -- 172.21.15.187:0/339173175 <== mon.2 v2:172.21.15.187:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "22dfdedf-5f6c-4b20-9f6c-30517a1db70a", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f11e40d04f0 con 0x7f11e40d15d0 2023-12-12T10:11:44.839 INFO:teuthology.orchestra.run.smithi187.stdout:0 2023-12-12T10:11:44.840 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:44.832+0000 7f11ec1aa640 1 -- 172.21.15.187:0/339173175 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f11e40d15d0 msgr2=0x7f11e40ca0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:11:44.840 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:44.832+0000 7f11ec1aa640 1 --2- 172.21.15.187:0/339173175 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f11e40d15d0 0x7f11e40ca0e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f11d40ab000 tx=0x7f11d401ad10 comp rx=0 tx=0).stop 2023-12-12T10:11:44.840 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:44.832+0000 7f11ec1aa640 1 -- 172.21.15.187:0/339173175 shutdown_connections 2023-12-12T10:11:44.840 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:44.832+0000 7f11ec1aa640 1 --2- 172.21.15.187:0/339173175 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f11e4160890 0x7f11e40b6220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:11:44.840 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:44.832+0000 7f11ec1aa640 1 --2- 172.21.15.187:0/339173175 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f11e40d15d0 0x7f11e40ca0e0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:11:44.840 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:44.832+0000 7f11ec1aa640 1 --2- 172.21.15.187:0/339173175 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f11e40d0be0 0x7f11e406c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:11:44.840 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:44.832+0000 7f11ec1aa640 1 -- 172.21.15.187:0/339173175 >> 172.21.15.187:0/339173175 conn(0x7f11e409c2f0 msgr2=0x7f11e415fb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:11:44.841 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:44.832+0000 7f11ec1aa640 1 -- 172.21.15.187:0/339173175 shutdown_connections 2023-12-12T10:11:44.841 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:44.832+0000 7f11ec1aa640 1 -- 172.21.15.187:0/339173175 wait complete. 2023-12-12T10:11:44.858 DEBUG:teuthology.orchestra.run.smithi187:> sudo ceph --cluster ceph osd new be34a7f3-a69a-462e-9ddf-5e537448dba2 1 2023-12-12T10:11:44.996 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-12-12T10:11:44.992+0000 7f7a71591180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-12T10:11:44.996 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:44.988+0000 7f3b1bc32640 1 Processor -- start 2023-12-12T10:11:44.996 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:44.988+0000 7f3b1bc32640 1 -- start start 2023-12-12T10:11:44.998 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:44.988+0000 7f3b1bc32640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f3b140d0be0 0x7f3b140d1040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:11:44.998 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:44.988+0000 7f3b1bc32640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3b140d15d0 0x7f3b140d1a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:11:44.998 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:44.988+0000 7f3b1bc32640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b140d04f0 con 0x7f3b14160890 2023-12-12T10:11:44.998 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:44.988+0000 7f3b1bc32640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b140d1fc0 con 0x7f3b140d0be0 2023-12-12T10:11:44.998 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:44.988+0000 7f3b1bc32640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b140cdc20 con 0x7f3b140d15d0 2023-12-12T10:11:44.999 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:44.988+0000 7f3b1a1cf640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3b140d15d0 0x7f3b140d1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:11:44.999 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:44.988+0000 7f3b191cd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f3b140d0be0 0x7f3b140d1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:11:44.999 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:44.992+0000 7f3b191cd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f3b140d0be0 0x7f3b140d1040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.187:55664/0 (socket says 172.21.15.187:55664) 2023-12-12T10:11:44.999 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:44.992+0000 7f3b199ce640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f3b14160890 0x7f3b140b5e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.187:49768/0 (socket says 172.21.15.187:49768) 2023-12-12T10:11:44.999 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:44.992+0000 7f3b191cd640 1 -- 172.21.15.187:0/1637408771 learned_addr learned my addr 172.21.15.187:0/1637408771 (peer_addr_for_me v2:172.21.15.187:0/0) 2023-12-12T10:11:44.999 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:44.992+0000 7f3b1a1cf640 1 -- 172.21.15.187:0/1637408771 >> v2:172.21.15.78:3300/0 conn(0x7f3b140d0be0 msgr2=0x7f3b140d1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:11:44.999 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:44.992+0000 7f3b1a1cf640 1 --2- 172.21.15.187:0/1637408771 >> v2:172.21.15.78:3300/0 conn(0x7f3b140d0be0 0x7f3b140d1040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:11:44.999 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:44.992+0000 7f3b1a1cf640 1 -- 172.21.15.187:0/1637408771 >> v1:172.21.15.78:6789/0 conn(0x7f3b14160890 legacy=0x7f3b140b5e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:11:44.999 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:44.992+0000 7f3b1a1cf640 1 -- 172.21.15.187:0/1637408771 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b140cfc50 con 0x7f3b140d15d0 2023-12-12T10:11:45.002 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:44.996+0000 7f3b1a1cf640 1 --2- 172.21.15.187:0/1637408771 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3b140d15d0 0x7f3b140d1a80 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f3b0c009d90 tx=0x7f3b0c01c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f73ea94408be8967 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:11:45.003 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:44.996+0000 7f3b189cc640 1 -- 172.21.15.187:0/1637408771 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b0c0a59e0 con 0x7f3b140d15d0 2023-12-12T10:11:45.003 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:44.996+0000 7f3b189cc640 1 -- 172.21.15.187:0/1637408771 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b0c0a5b40 con 0x7f3b140d15d0 2023-12-12T10:11:45.003 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:44.996+0000 7f3b189cc640 1 -- 172.21.15.187:0/1637408771 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b0c0ad440 con 0x7f3b140d15d0 2023-12-12T10:11:45.004 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:44.996+0000 7f3b1bc32640 1 -- 172.21.15.187:0/1637408771 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3b140d15d0 msgr2=0x7f3b140d1a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:11:45.004 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:44.996+0000 7f3b1bc32640 1 --2- 172.21.15.187:0/1637408771 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3b140d15d0 0x7f3b140d1a80 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f3b0c009d90 tx=0x7f3b0c01c920 comp rx=0 tx=0).stop 2023-12-12T10:11:45.004 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:44.996+0000 7f3b1bc32640 1 -- 172.21.15.187:0/1637408771 shutdown_connections 2023-12-12T10:11:45.005 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:44.996+0000 7f3b1bc32640 1 --2- 172.21.15.187:0/1637408771 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3b140d15d0 0x7f3b140d1a80 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:11:45.005 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:44.996+0000 7f3b1bc32640 1 --2- 172.21.15.187:0/1637408771 >> v2:172.21.15.78:3300/0 conn(0x7f3b140d0be0 0x7f3b140d1040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:11:45.005 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:44.996+0000 7f3b1bc32640 1 -- 172.21.15.187:0/1637408771 >> 172.21.15.187:0/1637408771 conn(0x7f3b1409c2f0 msgr2=0x7f3b140d3010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:11:45.005 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:44.996+0000 7f3b1bc32640 1 -- 172.21.15.187:0/1637408771 shutdown_connections 2023-12-12T10:11:45.005 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:44.996+0000 7f3b1bc32640 1 -- 172.21.15.187:0/1637408771 wait complete. 2023-12-12T10:11:45.006 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.000+0000 7f3b1bc32640 1 Processor -- start 2023-12-12T10:11:45.006 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.000+0000 7f3b1bc32640 1 -- start start 2023-12-12T10:11:45.009 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.000+0000 7f3b1bc32640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3b140d0be0 0x7f3b1414ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:11:45.009 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.000+0000 7f3b1bc32640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b140d15d0 0x7f3b1414ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:11:45.009 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.000+0000 7f3b1bc32640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3b14160890 0x7f3b140c9540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:11:45.009 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.000+0000 7f3b1bc32640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b140c77f0 con 0x7f3b140d15d0 2023-12-12T10:11:45.009 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.000+0000 7f3b1bc32640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b1414f970 con 0x7f3b140d0be0 2023-12-12T10:11:45.009 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.000+0000 7f3b1bc32640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b140b5f10 con 0x7f3b14160890 2023-12-12T10:11:45.009 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.000+0000 7f3b199ce640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3b140d0be0 0x7f3b1414ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:11:45.009 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.000+0000 7f3b1a1cf640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3b14160890 0x7f3b140c9540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:11:45.009 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.000+0000 7f3b1a1cf640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3b14160890 0x7f3b140c9540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.187:48908/0 (socket says 172.21.15.187:48908) 2023-12-12T10:11:45.009 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.000+0000 7f3b1a1cf640 1 -- 172.21.15.187:0/426064566 learned_addr learned my addr 172.21.15.187:0/426064566 (peer_addr_for_me v2:172.21.15.187:0/0) 2023-12-12T10:11:45.009 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.000+0000 7f3b191cd640 1 --2- 172.21.15.187:0/426064566 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b140d15d0 0x7f3b1414ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:11:45.009 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.000+0000 7f3b1a1cf640 1 -- 172.21.15.187:0/426064566 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3b140d0be0 msgr2=0x7f3b1414ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:11:45.010 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.000+0000 7f3b1a1cf640 1 --2- 172.21.15.187:0/426064566 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3b140d0be0 0x7f3b1414ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:11:45.010 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.000+0000 7f3b1a1cf640 1 -- 172.21.15.187:0/426064566 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b140d15d0 msgr2=0x7f3b1414ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:11:45.010 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.000+0000 7f3b1a1cf640 1 --2- 172.21.15.187:0/426064566 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b140d15d0 0x7f3b1414ede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:11:45.010 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.000+0000 7f3b1a1cf640 1 -- 172.21.15.187:0/426064566 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b0c009a70 con 0x7f3b14160890 2023-12-12T10:11:45.010 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.000+0000 7f3b199ce640 1 --2- 172.21.15.187:0/426064566 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3b140d0be0 0x7f3b1414ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-12T10:11:45.010 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.000+0000 7f3b1a1cf640 1 --2- 172.21.15.187:0/426064566 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3b14160890 0x7f3b140c9540 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f3b0c0b0040 tx=0x7f3b0c0196c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:11:45.010 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.000+0000 7f3b0a7fc640 1 -- 172.21.15.187:0/426064566 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b0c0add90 con 0x7f3b14160890 2023-12-12T10:11:45.010 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.000+0000 7f3b0a7fc640 1 -- 172.21.15.187:0/426064566 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b0c009450 con 0x7f3b14160890 2023-12-12T10:11:45.010 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.000+0000 7f3b1bc32640 1 -- 172.21.15.187:0/426064566 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b140c7a00 con 0x7f3b14160890 2023-12-12T10:11:45.010 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.000+0000 7f3b0a7fc640 1 -- 172.21.15.187:0/426064566 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b0c0b9690 con 0x7f3b14160890 2023-12-12T10:11:45.010 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.000+0000 7f3b1bc32640 1 -- 172.21.15.187:0/426064566 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b140b61b0 con 0x7f3b14160890 2023-12-12T10:11:45.010 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.000+0000 7f3b0a7fc640 1 -- 172.21.15.187:0/426064566 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f3b0c0b9af0 con 0x7f3b14160890 2023-12-12T10:11:45.010 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.000+0000 7f3b0a7fc640 1 -- 172.21.15.187:0/426064566 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f3b0c0b7400 con 0x7f3b14160890 2023-12-12T10:11:45.011 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.000+0000 7f3b1bc32640 1 -- 172.21.15.187:0/426064566 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b14067530 con 0x7f3b14160890 2023-12-12T10:11:45.012 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.004+0000 7f3b0a7fc640 1 -- 172.21.15.187:0/426064566 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f3b0c0bd020 con 0x7f3b14160890 2023-12-12T10:11:45.034 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-12-12T10:11:45.028+0000 7fd80c6cf180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-12T10:11:45.079 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.072+0000 7f3b1bc32640 1 -- 172.21.15.187:0/426064566 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "osd new", "uuid": "be34a7f3-a69a-462e-9ddf-5e537448dba2", "id": 1} v 0) v1 -- 0x7f3b140d0690 con 0x7f3b14160890 2023-12-12T10:11:45.086 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.080+0000 7f3b0a7fc640 1 -- 172.21.15.187:0/426064566 <== mon.2 v2:172.21.15.187:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "be34a7f3-a69a-462e-9ddf-5e537448dba2", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f3b0c0b2070 con 0x7f3b14160890 2023-12-12T10:11:45.087 INFO:teuthology.orchestra.run.smithi187.stdout:1 2023-12-12T10:11:45.088 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.080+0000 7f3b1bc32640 1 -- 172.21.15.187:0/426064566 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3b14160890 msgr2=0x7f3b140c9540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:11:45.088 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.080+0000 7f3b1bc32640 1 --2- 172.21.15.187:0/426064566 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3b14160890 0x7f3b140c9540 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f3b0c0b0040 tx=0x7f3b0c0196c0 comp rx=0 tx=0).stop 2023-12-12T10:11:45.088 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.080+0000 7f3b1bc32640 1 -- 172.21.15.187:0/426064566 shutdown_connections 2023-12-12T10:11:45.088 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.080+0000 7f3b1bc32640 1 --2- 172.21.15.187:0/426064566 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3b14160890 0x7f3b140c9540 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:11:45.088 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.080+0000 7f3b1bc32640 1 --2- 172.21.15.187:0/426064566 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b140d15d0 0x7f3b1414ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:11:45.088 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.080+0000 7f3b1bc32640 1 --2- 172.21.15.187:0/426064566 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3b140d0be0 0x7f3b1414ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:11:45.088 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.080+0000 7f3b1bc32640 1 -- 172.21.15.187:0/426064566 >> 172.21.15.187:0/426064566 conn(0x7f3b1409c2f0 msgr2=0x7f3b14158a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:11:45.088 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.080+0000 7f3b1bc32640 1 -- 172.21.15.187:0/426064566 shutdown_connections 2023-12-12T10:11:45.088 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.080+0000 7f3b1bc32640 1 -- 172.21.15.187:0/426064566 wait complete. 2023-12-12T10:11:45.107 DEBUG:teuthology.orchestra.run.smithi187:> sudo ceph --cluster ceph osd new 55b381de-5f56-4b14-80f7-e6e41e084a13 2 2023-12-12T10:11:45.242 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.236+0000 7f5adfc9a640 1 Processor -- start 2023-12-12T10:11:45.243 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.236+0000 7f5adfc9a640 1 -- start start 2023-12-12T10:11:45.245 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.236+0000 7f5adfc9a640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f5ad8160890 0x7f5ad80b5e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:11:45.245 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.236+0000 7f5adfc9a640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f5ad80d0be0 0x7f5ad80d1040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:11:45.245 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.236+0000 7f5adfc9a640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ad80d04f0 con 0x7f5ad80d15d0 2023-12-12T10:11:45.245 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.236+0000 7f5adfc9a640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ad80b63a0 con 0x7f5ad80d0be0 2023-12-12T10:11:45.245 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.236+0000 7f5adfc9a640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ad80cdc20 con 0x7f5ad8160890 2023-12-12T10:11:45.245 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.236+0000 7f5adda36640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f5ad8160890 0x7f5ad80b5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:11:45.245 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.236+0000 7f5ade237640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f5ad80d15d0 0x7f5ad80ce3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.187:33448/0 (socket says 172.21.15.187:33448) 2023-12-12T10:11:45.245 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.236+0000 7f5ade237640 1 -- 172.21.15.187:0/1053125052 learned_addr learned my addr 172.21.15.187:0/1053125052 (peer_addr_for_me v1:172.21.15.187:0/0) 2023-12-12T10:11:45.245 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.236+0000 7f5add235640 1 --2- 172.21.15.187:0/1053125052 >> v2:172.21.15.78:3300/0 conn(0x7f5ad80d0be0 0x7f5ad80d1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:11:45.246 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.236+0000 7f5adda36640 1 -- 172.21.15.187:0/1053125052 >> v2:172.21.15.78:3300/0 conn(0x7f5ad80d0be0 msgr2=0x7f5ad80d1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:11:45.246 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.236+0000 7f5adda36640 1 --2- 172.21.15.187:0/1053125052 >> v2:172.21.15.78:3300/0 conn(0x7f5ad80d0be0 0x7f5ad80d1040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:11:45.246 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.236+0000 7f5adda36640 1 -- 172.21.15.187:0/1053125052 >> v1:172.21.15.187:6789/0 conn(0x7f5ad80d15d0 legacy=0x7f5ad80ce3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:11:45.246 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.236+0000 7f5adda36640 1 -- 172.21.15.187:0/1053125052 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ad80cfc50 con 0x7f5ad8160890 2023-12-12T10:11:45.248 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.240+0000 7f5adda36640 1 --2- 172.21.15.187:0/1053125052 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5ad8160890 0x7f5ad80b5e60 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f5ad808d720 tx=0x7f5ad401c430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ae98b6b29da5ac6 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:11:45.248 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.240+0000 7f5adca34640 1 -- 172.21.15.187:0/1053125052 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad40a7070 con 0x7f5ad8160890 2023-12-12T10:11:45.248 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.240+0000 7f5adca34640 1 -- 172.21.15.187:0/1053125052 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ad40ab430 con 0x7f5ad8160890 2023-12-12T10:11:45.249 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.240+0000 7f5adca34640 1 -- 172.21.15.187:0/1053125052 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad40ab7c0 con 0x7f5ad8160890 2023-12-12T10:11:45.250 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.240+0000 7f5adfc9a640 1 -- 172.21.15.187:0/1053125052 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5ad8160890 msgr2=0x7f5ad80b5e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:11:45.250 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.240+0000 7f5adfc9a640 1 --2- 172.21.15.187:0/1053125052 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5ad8160890 0x7f5ad80b5e60 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f5ad808d720 tx=0x7f5ad401c430 comp rx=0 tx=0).stop 2023-12-12T10:11:45.250 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.240+0000 7f5adfc9a640 1 -- 172.21.15.187:0/1053125052 shutdown_connections 2023-12-12T10:11:45.250 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.240+0000 7f5adfc9a640 1 --2- 172.21.15.187:0/1053125052 >> v2:172.21.15.78:3300/0 conn(0x7f5ad80d0be0 0x7f5ad80d1040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:11:45.250 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.240+0000 7f5adfc9a640 1 --2- 172.21.15.187:0/1053125052 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5ad8160890 0x7f5ad80b5e60 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:11:45.250 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.240+0000 7f5adfc9a640 1 -- 172.21.15.187:0/1053125052 >> 172.21.15.187:0/1053125052 conn(0x7f5ad809c2f0 msgr2=0x7f5ad80d3010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:11:45.250 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.244+0000 7f5adfc9a640 1 -- 172.21.15.187:0/1053125052 shutdown_connections 2023-12-12T10:11:45.250 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.244+0000 7f5adfc9a640 1 -- 172.21.15.187:0/1053125052 wait complete. 2023-12-12T10:11:45.251 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.244+0000 7f5adfc9a640 1 Processor -- start 2023-12-12T10:11:45.251 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.244+0000 7f5adfc9a640 1 -- start start 2023-12-12T10:11:45.254 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.244+0000 7f5adfc9a640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5ad80d0be0 0x7f5ad80c95a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:11:45.255 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.244+0000 7f5adfc9a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5ad80d15d0 0x7f5ad81502d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:11:45.255 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.244+0000 7f5adfc9a640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5ad8160890 0x7f5ad806c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:11:45.255 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.244+0000 7f5adfc9a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad8150b80 con 0x7f5ad80d15d0 2023-12-12T10:11:45.255 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.244+0000 7f5adfc9a640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad8150dd0 con 0x7f5ad80d0be0 2023-12-12T10:11:45.255 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.244+0000 7f5adfc9a640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad81510b0 con 0x7f5ad8160890 2023-12-12T10:11:45.255 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.244+0000 7f5adda36640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5ad80d0be0 0x7f5ad80c95a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:11:45.255 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.244+0000 7f5ade237640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5ad8160890 0x7f5ad806c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:11:45.255 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.244+0000 7f5adda36640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5ad80d0be0 0x7f5ad80c95a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.187:52756/0 (socket says 172.21.15.187:52756) 2023-12-12T10:11:45.255 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.244+0000 7f5adda36640 1 -- 172.21.15.187:0/3542589128 learned_addr learned my addr 172.21.15.187:0/3542589128 (peer_addr_for_me v2:172.21.15.187:0/0) 2023-12-12T10:11:45.255 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.244+0000 7f5add235640 1 --2- 172.21.15.187:0/3542589128 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5ad80d15d0 0x7f5ad81502d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:11:45.255 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.244+0000 7f5ade237640 1 -- 172.21.15.187:0/3542589128 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5ad80d0be0 msgr2=0x7f5ad80c95a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:11:45.256 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.244+0000 7f5ade237640 1 --2- 172.21.15.187:0/3542589128 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5ad80d0be0 0x7f5ad80c95a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:11:45.256 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.244+0000 7f5ade237640 1 -- 172.21.15.187:0/3542589128 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5ad80d15d0 msgr2=0x7f5ad81502d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:11:45.256 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.244+0000 7f5ade237640 1 --2- 172.21.15.187:0/3542589128 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5ad80d15d0 0x7f5ad81502d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:11:45.256 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.244+0000 7f5ade237640 1 -- 172.21.15.187:0/3542589128 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ad4009420 con 0x7f5ad8160890 2023-12-12T10:11:45.256 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.244+0000 7f5adda36640 1 --2- 172.21.15.187:0/3542589128 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5ad80d0be0 0x7f5ad80c95a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-12T10:11:45.256 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.244+0000 7f5ade237640 1 --2- 172.21.15.187:0/3542589128 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5ad8160890 0x7f5ad806c460 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f5ad000caa0 tx=0x7f5ad000cf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:11:45.256 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.248+0000 7f5ace7fc640 1 -- 172.21.15.187:0/3542589128 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad000ac00 con 0x7f5ad8160890 2023-12-12T10:11:45.256 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.248+0000 7f5ace7fc640 1 -- 172.21.15.187:0/3542589128 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ad000ad60 con 0x7f5ad8160890 2023-12-12T10:11:45.256 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.248+0000 7f5adfc9a640 1 -- 172.21.15.187:0/3542589128 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ad8151390 con 0x7f5ad8160890 2023-12-12T10:11:45.256 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.248+0000 7f5ace7fc640 1 -- 172.21.15.187:0/3542589128 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad0012600 con 0x7f5ad8160890 2023-12-12T10:11:45.256 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.248+0000 7f5adfc9a640 1 -- 172.21.15.187:0/3542589128 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ad8150810 con 0x7f5ad8160890 2023-12-12T10:11:45.256 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.248+0000 7f5ace7fc640 1 -- 172.21.15.187:0/3542589128 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f5ad0012a60 con 0x7f5ad8160890 2023-12-12T10:11:45.256 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.248+0000 7f5ace7fc640 1 -- 172.21.15.187:0/3542589128 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f5ad0012d10 con 0x7f5ad8160890 2023-12-12T10:11:45.257 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.248+0000 7f5adfc9a640 1 -- 172.21.15.187:0/3542589128 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ad8067530 con 0x7f5ad8160890 2023-12-12T10:11:45.257 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.248+0000 7f5ace7fc640 1 -- 172.21.15.187:0/3542589128 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f5ad0021060 con 0x7f5ad8160890 2023-12-12T10:11:45.323 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.316+0000 7f5adfc9a640 1 -- 172.21.15.187:0/3542589128 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "osd new", "uuid": "55b381de-5f56-4b14-80f7-e6e41e084a13", "id": 2} v 0) v1 -- 0x7f5ad80c9e80 con 0x7f5ad8160890 2023-12-12T10:11:45.330 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.324+0000 7f5ace7fc640 1 -- 172.21.15.187:0/3542589128 <== mon.2 v2:172.21.15.187:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "55b381de-5f56-4b14-80f7-e6e41e084a13", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f5ad0017070 con 0x7f5ad8160890 2023-12-12T10:11:45.331 INFO:teuthology.orchestra.run.smithi187.stdout:2 2023-12-12T10:11:45.332 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.324+0000 7f5adfc9a640 1 -- 172.21.15.187:0/3542589128 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5ad8160890 msgr2=0x7f5ad806c460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:11:45.332 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.324+0000 7f5adfc9a640 1 --2- 172.21.15.187:0/3542589128 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5ad8160890 0x7f5ad806c460 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f5ad000caa0 tx=0x7f5ad000cf60 comp rx=0 tx=0).stop 2023-12-12T10:11:45.332 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.324+0000 7f5adfc9a640 1 -- 172.21.15.187:0/3542589128 shutdown_connections 2023-12-12T10:11:45.332 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.324+0000 7f5adfc9a640 1 --2- 172.21.15.187:0/3542589128 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5ad8160890 0x7f5ad806c460 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:11:45.332 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.324+0000 7f5adfc9a640 1 --2- 172.21.15.187:0/3542589128 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5ad80d15d0 0x7f5ad81502d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:11:45.332 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.324+0000 7f5adfc9a640 1 --2- 172.21.15.187:0/3542589128 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5ad80d0be0 0x7f5ad80c95a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:11:45.333 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.324+0000 7f5adfc9a640 1 -- 172.21.15.187:0/3542589128 >> 172.21.15.187:0/3542589128 conn(0x7f5ad809c2f0 msgr2=0x7f5ad80b7900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:11:45.333 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.324+0000 7f5adfc9a640 1 -- 172.21.15.187:0/3542589128 shutdown_connections 2023-12-12T10:11:45.333 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.324+0000 7f5adfc9a640 1 -- 172.21.15.187:0/3542589128 wait complete. 2023-12-12T10:11:45.350 DEBUG:teuthology.orchestra.run.smithi187:> sudo ceph --cluster ceph osd new d7682de1-25cb-4cec-869f-8851c28b0e6d 3 2023-12-12T10:11:45.488 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.480+0000 7fa79bdd8640 1 Processor -- start 2023-12-12T10:11:45.488 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.480+0000 7fa79bdd8640 1 -- start start 2023-12-12T10:11:45.489 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.480+0000 7fa79bdd8640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa794160890 0x7fa7940b5e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:11:45.489 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.480+0000 7fa79bdd8640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fa7940d1ce0 0x7fa7940d1040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:11:45.490 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.480+0000 7fa79bdd8640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7940d04f0 con 0x7fa7940d0be0 2023-12-12T10:11:45.490 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.480+0000 7fa79bdd8640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7940b63a0 con 0x7fa794160890 2023-12-12T10:11:45.490 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.480+0000 7fa79bdd8640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7940cdc20 con 0x7fa7940d1ce0 2023-12-12T10:11:45.490 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.480+0000 7fa79a375640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fa7940d1ce0 0x7fa7940d1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:11:45.490 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.480+0000 7fa79a375640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fa7940d1ce0 0x7fa7940d1040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.187:52766/0 (socket says 172.21.15.187:52766) 2023-12-12T10:11:45.490 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.480+0000 7fa79a375640 1 -- 172.21.15.187:0/585420163 learned_addr learned my addr 172.21.15.187:0/585420163 (peer_addr_for_me v2:172.21.15.187:0/0) 2023-12-12T10:11:45.490 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.480+0000 7fa799b74640 1 --2- 172.21.15.187:0/585420163 >> v2:172.21.15.78:3300/0 conn(0x7fa794160890 0x7fa7940b5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:11:45.490 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.484+0000 7fa799b74640 1 -- 172.21.15.187:0/585420163 >> v2:172.21.15.187:3300/0 conn(0x7fa7940d1ce0 msgr2=0x7fa7940d1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:11:45.491 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.484+0000 7fa799b74640 1 --2- 172.21.15.187:0/585420163 >> v2:172.21.15.187:3300/0 conn(0x7fa7940d1ce0 0x7fa7940d1040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:11:45.491 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.484+0000 7fa799b74640 1 -- 172.21.15.187:0/585420163 >> v1:172.21.15.187:6789/0 conn(0x7fa7940d0be0 legacy=0x7fa7940d15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:11:45.491 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.484+0000 7fa799b74640 1 -- 172.21.15.187:0/585420163 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7940cfc50 con 0x7fa794160890 2023-12-12T10:11:45.493 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.484+0000 7fa799b74640 1 --2- 172.21.15.187:0/585420163 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa794160890 0x7fa7940b5e60 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa79408d5c0 tx=0x7fa79001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1754ee2534a7ec9 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:11:45.493 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.484+0000 7fa798b72640 1 -- 172.21.15.187:0/585420163 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7900a7070 con 0x7fa794160890 2023-12-12T10:11:45.493 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.484+0000 7fa798b72640 1 -- 172.21.15.187:0/585420163 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7900ab430 con 0x7fa794160890 2023-12-12T10:11:45.493 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.484+0000 7fa798b72640 1 -- 172.21.15.187:0/585420163 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7900ab7c0 con 0x7fa794160890 2023-12-12T10:11:45.494 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.488+0000 7fa79bdd8640 1 -- 172.21.15.187:0/585420163 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa794160890 msgr2=0x7fa7940b5e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:11:45.494 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.488+0000 7fa79bdd8640 1 --2- 172.21.15.187:0/585420163 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa794160890 0x7fa7940b5e60 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa79408d5c0 tx=0x7fa79001c430 comp rx=0 tx=0).stop 2023-12-12T10:11:45.494 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.488+0000 7fa79bdd8640 1 -- 172.21.15.187:0/585420163 shutdown_connections 2023-12-12T10:11:45.494 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.488+0000 7fa79bdd8640 1 --2- 172.21.15.187:0/585420163 >> v2:172.21.15.187:3300/0 conn(0x7fa7940d1ce0 0x7fa7940d1040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:11:45.494 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.488+0000 7fa79bdd8640 1 --2- 172.21.15.187:0/585420163 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa794160890 0x7fa7940b5e60 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:11:45.494 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.488+0000 7fa79bdd8640 1 -- 172.21.15.187:0/585420163 >> 172.21.15.187:0/585420163 conn(0x7fa79409c2f0 msgr2=0x7fa7940d3010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:11:45.495 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.488+0000 7fa79bdd8640 1 -- 172.21.15.187:0/585420163 shutdown_connections 2023-12-12T10:11:45.495 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.488+0000 7fa79bdd8640 1 -- 172.21.15.187:0/585420163 wait complete. 2023-12-12T10:11:45.496 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.488+0000 7fa79bdd8640 1 Processor -- start 2023-12-12T10:11:45.496 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.488+0000 7fa79bdd8640 1 -- start start 2023-12-12T10:11:45.497 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.488+0000 7fa79bdd8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa7940d0be0 0x7fa7941502c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:11:45.497 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.488+0000 7fa79bdd8640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa7940d1ce0 0x7fa7941535e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:11:45.497 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.488+0000 7fa79bdd8640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa794160890 0x7fa794153b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:11:45.497 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.488+0000 7fa79bdd8640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7940c9ac0 con 0x7fa7940d0be0 2023-12-12T10:11:45.497 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.488+0000 7fa79bdd8640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7940c97e0 con 0x7fa7940d1ce0 2023-12-12T10:11:45.497 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.488+0000 7fa79bdd8640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa794157960 con 0x7fa794160890 2023-12-12T10:11:45.498 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.488+0000 7fa799373640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa7940d1ce0 0x7fa7941535e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:11:45.498 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.488+0000 7fa799373640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa7940d1ce0 0x7fa7941535e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.187:52780/0 (socket says 172.21.15.187:52780) 2023-12-12T10:11:45.498 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.488+0000 7fa799b74640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa7940d0be0 0x7fa7941502c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:11:45.498 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.488+0000 7fa799373640 1 -- 172.21.15.187:0/2421241753 learned_addr learned my addr 172.21.15.187:0/2421241753 (peer_addr_for_me v2:172.21.15.187:0/0) 2023-12-12T10:11:45.498 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.488+0000 7fa79a375640 1 --2- 172.21.15.187:0/2421241753 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa794160890 0x7fa794153b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:11:45.499 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.488+0000 7fa799b74640 1 -- 172.21.15.187:0/2421241753 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa794160890 msgr2=0x7fa794153b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:11:45.499 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.488+0000 7fa799b74640 1 --2- 172.21.15.187:0/2421241753 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa794160890 0x7fa794153b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:11:45.499 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.488+0000 7fa799b74640 1 -- 172.21.15.187:0/2421241753 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa7940d1ce0 msgr2=0x7fa7941535e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:11:45.499 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.488+0000 7fa799b74640 1 --2- 172.21.15.187:0/2421241753 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa7940d1ce0 0x7fa7941535e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:11:45.499 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.488+0000 7fa799b74640 1 -- 172.21.15.187:0/2421241753 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa790009420 con 0x7fa7940d0be0 2023-12-12T10:11:45.499 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.488+0000 7fa79a375640 1 --2- 172.21.15.187:0/2421241753 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa794160890 0x7fa794153b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-12T10:11:45.499 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.492+0000 7fa799b74640 1 --2- 172.21.15.187:0/2421241753 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa7940d0be0 0x7fa7941502c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fa7900ac000 tx=0x7fa79001ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:11:45.500 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.492+0000 7fa78a7fc640 1 -- 172.21.15.187:0/2421241753 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7900b5810 con 0x7fa7940d0be0 2023-12-12T10:11:45.500 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.492+0000 7fa78a7fc640 1 -- 172.21.15.187:0/2421241753 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7900b5990 con 0x7fa7940d0be0 2023-12-12T10:11:45.500 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.492+0000 7fa78a7fc640 1 -- 172.21.15.187:0/2421241753 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7900b5d40 con 0x7fa7940d0be0 2023-12-12T10:11:45.500 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.492+0000 7fa79bdd8640 1 -- 172.21.15.187:0/2421241753 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa794157c40 con 0x7fa7940d0be0 2023-12-12T10:11:45.500 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.492+0000 7fa79bdd8640 1 -- 172.21.15.187:0/2421241753 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7940c8ab0 con 0x7fa7940d0be0 2023-12-12T10:11:45.500 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.492+0000 7fa78a7fc640 1 -- 172.21.15.187:0/2421241753 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fa7900bf710 con 0x7fa7940d0be0 2023-12-12T10:11:45.500 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.492+0000 7fa78a7fc640 1 -- 172.21.15.187:0/2421241753 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7fa7900b4390 con 0x7fa7940d0be0 2023-12-12T10:11:45.500 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.492+0000 7fa79bdd8640 1 -- 172.21.15.187:0/2421241753 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa794157aa0 con 0x7fa7940d0be0 2023-12-12T10:11:45.514 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.508+0000 7fa78a7fc640 1 -- 172.21.15.187:0/2421241753 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7fa794157aa0 con 0x7fa7940d0be0 2023-12-12T10:11:45.580 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.572+0000 7fa79bdd8640 1 -- 172.21.15.187:0/2421241753 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d7682de1-25cb-4cec-869f-8851c28b0e6d", "id": 3} v 0) v1 -- 0x7fa794067530 con 0x7fa7940d0be0 2023-12-12T10:11:45.584 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.576+0000 7fa78a7fc640 1 -- 172.21.15.187:0/2421241753 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d7682de1-25cb-4cec-869f-8851c28b0e6d", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa7900cd0b0 con 0x7fa7940d0be0 2023-12-12T10:11:45.584 INFO:teuthology.orchestra.run.smithi187.stdout:3 2023-12-12T10:11:45.586 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.576+0000 7fa79bdd8640 1 -- 172.21.15.187:0/2421241753 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa7940d0be0 msgr2=0x7fa7941502c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:11:45.586 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.576+0000 7fa79bdd8640 1 --2- 172.21.15.187:0/2421241753 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa7940d0be0 0x7fa7941502c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fa7900ac000 tx=0x7fa79001ac70 comp rx=0 tx=0).stop 2023-12-12T10:11:45.586 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.576+0000 7fa79bdd8640 1 -- 172.21.15.187:0/2421241753 shutdown_connections 2023-12-12T10:11:45.586 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.576+0000 7fa79bdd8640 1 --2- 172.21.15.187:0/2421241753 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa794160890 0x7fa794153b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:11:45.586 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.576+0000 7fa79bdd8640 1 --2- 172.21.15.187:0/2421241753 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa7940d1ce0 0x7fa7941535e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:11:45.586 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.576+0000 7fa79bdd8640 1 --2- 172.21.15.187:0/2421241753 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa7940d0be0 0x7fa7941502c0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:11:45.586 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.576+0000 7fa79bdd8640 1 -- 172.21.15.187:0/2421241753 >> 172.21.15.187:0/2421241753 conn(0x7fa79409c2f0 msgr2=0x7fa79406c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:11:45.586 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.576+0000 7fa79bdd8640 1 -- 172.21.15.187:0/2421241753 shutdown_connections 2023-12-12T10:11:45.587 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.576+0000 7fa79bdd8640 1 -- 172.21.15.187:0/2421241753 wait complete. 2023-12-12T10:11:45.606 DEBUG:teuthology.orchestra.run.smithi187:> sudo ceph --cluster ceph osd new 8279815a-d6c7-4199-871e-d28971b9dc07 4 2023-12-12T10:11:45.634 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-12-12T10:11:45.632+0000 7f7a71591180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-12T10:11:45.696 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-12-12T10:11:45.692+0000 7f7a71591180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-12T10:11:45.704 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-12-12T10:11:45.696+0000 7fd80c6cf180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-12T10:11:45.743 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.736+0000 7fc1ada6b640 1 Processor -- start 2023-12-12T10:11:45.744 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.736+0000 7fc1ada6b640 1 -- start start 2023-12-12T10:11:45.745 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.736+0000 7fc1ada6b640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fc1a80d0be0 0x7fc1a80d1040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:11:45.745 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.736+0000 7fc1ada6b640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1a80d04f0 con 0x7fc1a80d15d0 2023-12-12T10:11:45.745 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.736+0000 7fc1ada6b640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1a80cdc20 con 0x7fc1a8160890 2023-12-12T10:11:45.745 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.736+0000 7fc1ada6b640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1a80cfc50 con 0x7fc1a80d0be0 2023-12-12T10:11:45.746 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.736+0000 7fc1a6ffd640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fc1a80d0be0 0x7fc1a80d1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:11:45.746 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.736+0000 7fc1a6ffd640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fc1a80d0be0 0x7fc1a80d1040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.187:52786/0 (socket says 172.21.15.187:52786) 2023-12-12T10:11:45.746 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.736+0000 7fc1a6ffd640 1 -- 172.21.15.187:0/1107869919 learned_addr learned my addr 172.21.15.187:0/1107869919 (peer_addr_for_me v2:172.21.15.187:0/0) 2023-12-12T10:11:45.746 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.736+0000 7fc1a6ffd640 1 -- 172.21.15.187:0/1107869919 >> v1:172.21.15.187:6789/0 conn(0x7fc1a8160890 legacy=0x7fc1a80b5e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:11:45.746 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.736+0000 7fc1a6ffd640 1 -- 172.21.15.187:0/1107869919 >> v1:172.21.15.78:6789/0 conn(0x7fc1a80d15d0 legacy=0x7fc1a80ce3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:11:45.746 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.736+0000 7fc1a6ffd640 1 -- 172.21.15.187:0/1107869919 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1a80cff30 con 0x7fc1a80d0be0 2023-12-12T10:11:45.748 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.740+0000 7fc1a6ffd640 1 --2- 172.21.15.187:0/1107869919 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc1a80d0be0 0x7fc1a80d1040 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc19c009870 tx=0x7fc19c01c510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e587a8c6c49a27b server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:11:45.748 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.740+0000 7fc1a67fc640 1 -- 172.21.15.187:0/1107869919 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc19c0aa670 con 0x7fc1a80d0be0 2023-12-12T10:11:45.748 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.740+0000 7fc1a67fc640 1 -- 172.21.15.187:0/1107869919 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc19c0aa7d0 con 0x7fc1a80d0be0 2023-12-12T10:11:45.748 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.740+0000 7fc1a67fc640 1 -- 172.21.15.187:0/1107869919 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc19c0aab60 con 0x7fc1a80d0be0 2023-12-12T10:11:45.749 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.740+0000 7fc1ada6b640 1 -- 172.21.15.187:0/1107869919 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc1a80d0be0 msgr2=0x7fc1a80d1040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:11:45.749 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.740+0000 7fc1ada6b640 1 --2- 172.21.15.187:0/1107869919 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc1a80d0be0 0x7fc1a80d1040 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc19c009870 tx=0x7fc19c01c510 comp rx=0 tx=0).stop 2023-12-12T10:11:45.749 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.740+0000 7fc1ada6b640 1 -- 172.21.15.187:0/1107869919 shutdown_connections 2023-12-12T10:11:45.750 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.740+0000 7fc1ada6b640 1 --2- 172.21.15.187:0/1107869919 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc1a80d0be0 0x7fc1a80d1040 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:11:45.750 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.740+0000 7fc1ada6b640 1 -- 172.21.15.187:0/1107869919 >> 172.21.15.187:0/1107869919 conn(0x7fc1a809c2f0 msgr2=0x7fc1a80d3010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:11:45.750 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.740+0000 7fc1ada6b640 1 -- 172.21.15.187:0/1107869919 shutdown_connections 2023-12-12T10:11:45.750 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.740+0000 7fc1ada6b640 1 -- 172.21.15.187:0/1107869919 wait complete. 2023-12-12T10:11:45.751 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.744+0000 7fc1ada6b640 1 Processor -- start 2023-12-12T10:11:45.751 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.744+0000 7fc1ada6b640 1 -- start start 2023-12-12T10:11:45.754 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.744+0000 7fc1ada6b640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc1a80d0be0 0x7fc1a8158670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:11:45.754 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.744+0000 7fc1ada6b640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc1a80d15d0 0x7fc1a80cb380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:11:45.754 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.744+0000 7fc1ada6b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc1a8160890 0x7fc1a80cb8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:11:45.754 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.744+0000 7fc1ada6b640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1a80b05b0 con 0x7fc1a8160890 2023-12-12T10:11:45.755 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.744+0000 7fc1ada6b640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1a80c82d0 con 0x7fc1a80d15d0 2023-12-12T10:11:45.755 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.744+0000 7fc1ada6b640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1a80b3840 con 0x7fc1a80d0be0 2023-12-12T10:11:45.755 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.744+0000 7fc1a77fe640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc1a80d0be0 0x7fc1a8158670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:11:45.755 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.744+0000 7fc1a6ffd640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc1a80d15d0 0x7fc1a80cb380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:11:45.755 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.744+0000 7fc1a77fe640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc1a80d0be0 0x7fc1a8158670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.187:48934/0 (socket says 172.21.15.187:48934) 2023-12-12T10:11:45.755 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.744+0000 7fc1a6ffd640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc1a80d15d0 0x7fc1a80cb380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.187:52800/0 (socket says 172.21.15.187:52800) 2023-12-12T10:11:45.755 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.744+0000 7fc1a77fe640 1 -- 172.21.15.187:0/1874025528 learned_addr learned my addr 172.21.15.187:0/1874025528 (peer_addr_for_me v2:172.21.15.187:0/0) 2023-12-12T10:11:45.755 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.744+0000 7fc1a7fff640 1 --2- 172.21.15.187:0/1874025528 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc1a8160890 0x7fc1a80cb8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:11:45.755 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.744+0000 7fc1a6ffd640 1 -- 172.21.15.187:0/1874025528 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc1a80d0be0 msgr2=0x7fc1a8158670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:11:45.755 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.744+0000 7fc1a6ffd640 1 --2- 172.21.15.187:0/1874025528 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc1a80d0be0 0x7fc1a8158670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:11:45.755 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.744+0000 7fc1a6ffd640 1 -- 172.21.15.187:0/1874025528 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc1a8160890 msgr2=0x7fc1a80cb8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:11:45.755 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.744+0000 7fc1a6ffd640 1 --2- 172.21.15.187:0/1874025528 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc1a8160890 0x7fc1a80cb8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:11:45.755 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.744+0000 7fc1a6ffd640 1 -- 172.21.15.187:0/1874025528 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc19c0094d0 con 0x7fc1a80d15d0 2023-12-12T10:11:45.755 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.744+0000 7fc1a6ffd640 1 --2- 172.21.15.187:0/1874025528 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc1a80d15d0 0x7fc1a80cb380 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc1a808bbc0 tx=0x7fc19c01ad50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:11:45.756 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.748+0000 7fc18ffff640 1 -- 172.21.15.187:0/1874025528 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc19c0b38c0 con 0x7fc1a80d15d0 2023-12-12T10:11:45.756 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.748+0000 7fc18ffff640 1 -- 172.21.15.187:0/1874025528 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc19c0b3a40 con 0x7fc1a80d15d0 2023-12-12T10:11:45.756 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.748+0000 7fc18ffff640 1 -- 172.21.15.187:0/1874025528 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc19c0b3df0 con 0x7fc1a80d15d0 2023-12-12T10:11:45.756 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.748+0000 7fc1ada6b640 1 -- 172.21.15.187:0/1874025528 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1a80c79a0 con 0x7fc1a80d15d0 2023-12-12T10:11:45.756 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.748+0000 7fc1ada6b640 1 -- 172.21.15.187:0/1874025528 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1a80c7f60 con 0x7fc1a80d15d0 2023-12-12T10:11:45.756 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.748+0000 7fc18ffff640 1 -- 172.21.15.187:0/1874025528 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fc19c0bd740 con 0x7fc1a80d15d0 2023-12-12T10:11:45.756 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.748+0000 7fc18ffff640 1 -- 172.21.15.187:0/1874025528 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7fc19c0b2a20 con 0x7fc1a80d15d0 2023-12-12T10:11:45.757 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-12-12T10:11:45.752+0000 7f7a71591180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-12T10:11:45.757 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.748+0000 7fc1ada6b640 1 -- 172.21.15.187:0/1874025528 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1a80c8440 con 0x7fc1a80d15d0 2023-12-12T10:11:45.758 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.752+0000 7fc18ffff640 1 -- 172.21.15.187:0/1874025528 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7fc19c0b2c80 con 0x7fc1a80d15d0 2023-12-12T10:11:45.771 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-12-12T10:11:45.764+0000 7fd80c6cf180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-12T10:11:45.824 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.816+0000 7fc1ada6b640 1 -- 172.21.15.187:0/1874025528 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "osd new", "uuid": "8279815a-d6c7-4199-871e-d28971b9dc07", "id": 4} v 0) v1 -- 0x7fc1a8067530 con 0x7fc1a80d15d0 2023-12-12T10:11:45.830 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.824+0000 7fc18ffff640 1 -- 172.21.15.187:0/1874025528 <== mon.1 v2:172.21.15.187:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8279815a-d6c7-4199-871e-d28971b9dc07", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc19c0b2510 con 0x7fc1a80d15d0 2023-12-12T10:11:45.830 INFO:teuthology.orchestra.run.smithi187.stdout:4 2023-12-12T10:11:45.832 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.824+0000 7fc1ada6b640 1 -- 172.21.15.187:0/1874025528 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc1a80d15d0 msgr2=0x7fc1a80cb380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:11:45.832 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.824+0000 7fc1ada6b640 1 --2- 172.21.15.187:0/1874025528 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc1a80d15d0 0x7fc1a80cb380 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fc1a808bbc0 tx=0x7fc19c01ad50 comp rx=0 tx=0).stop 2023-12-12T10:11:45.832 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.824+0000 7fc1ada6b640 1 -- 172.21.15.187:0/1874025528 shutdown_connections 2023-12-12T10:11:45.832 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.824+0000 7fc1ada6b640 1 --2- 172.21.15.187:0/1874025528 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc1a8160890 0x7fc1a80cb8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:11:45.832 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.824+0000 7fc1ada6b640 1 --2- 172.21.15.187:0/1874025528 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc1a80d15d0 0x7fc1a80cb380 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:11:45.832 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.824+0000 7fc1ada6b640 1 --2- 172.21.15.187:0/1874025528 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc1a80d0be0 0x7fc1a8158670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:11:45.832 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.824+0000 7fc1ada6b640 1 -- 172.21.15.187:0/1874025528 >> 172.21.15.187:0/1874025528 conn(0x7fc1a809c2f0 msgr2=0x7fc1a80b48a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:11:45.833 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.824+0000 7fc1ada6b640 1 -- 172.21.15.187:0/1874025528 shutdown_connections 2023-12-12T10:11:45.833 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.824+0000 7fc1ada6b640 1 -- 172.21.15.187:0/1874025528 wait complete. 2023-12-12T10:11:45.833 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-12-12T10:11:45.824+0000 7fd80c6cf180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-12T10:11:45.845 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-12-12T10:11:45.840+0000 7f7a71591180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-12T10:11:45.850 DEBUG:teuthology.orchestra.run.smithi187:> sudo ceph --cluster ceph osd new 0a714c65-f8ce-4340-968f-11a799677ef3 5 2023-12-12T10:11:45.905 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-12-12T10:11:45.900+0000 7f7a71591180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-12T10:11:45.924 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-12-12T10:11:45.916+0000 7fd80c6cf180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-12T10:11:45.986 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.980+0000 7f5c8672a640 1 Processor -- start 2023-12-12T10:11:45.987 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-12-12T10:11:45.980+0000 7fd80c6cf180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-12T10:11:45.987 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.980+0000 7f5c8672a640 1 -- start start 2023-12-12T10:11:45.988 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.980+0000 7f5c8672a640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f5c800ce6b0 0x7f5c800d1670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:11:45.988 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.980+0000 7f5c8672a640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5c800d1bb0 0x7f5c800b2f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:11:45.988 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.980+0000 7f5c8672a640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c8015d870 con 0x7f5c8015d490 2023-12-12T10:11:45.989 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.980+0000 7f5c8672a640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c800b2af0 con 0x7f5c800ce6b0 2023-12-12T10:11:45.989 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.980+0000 7f5c8672a640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c800d2040 con 0x7f5c800d1bb0 2023-12-12T10:11:45.989 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.980+0000 7f5c7f7fe640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f5c800ce6b0 0x7f5c800d1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:11:45.989 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.980+0000 7f5c84cc7640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5c800d1bb0 0x7f5c800b2f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:11:45.989 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.980+0000 7f5c7f7fe640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f5c800ce6b0 0x7f5c800d1670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.187:52808/0 (socket says 172.21.15.187:52808) 2023-12-12T10:11:45.989 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.980+0000 7f5c84cc7640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5c800d1bb0 0x7f5c800b2f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.187:48948/0 (socket says 172.21.15.187:48948) 2023-12-12T10:11:45.989 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.980+0000 7f5c7f7fe640 1 -- 172.21.15.187:0/1997385536 learned_addr learned my addr 172.21.15.187:0/1997385536 (peer_addr_for_me v2:172.21.15.187:0/0) 2023-12-12T10:11:45.989 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.980+0000 7f5c7f7fe640 1 -- 172.21.15.187:0/1997385536 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5c800d1bb0 msgr2=0x7f5c800b2f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:11:45.989 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.980+0000 7f5c7f7fe640 1 --2- 172.21.15.187:0/1997385536 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5c800d1bb0 0x7f5c800b2f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:11:45.989 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.980+0000 7f5c7effd640 1 -- 172.21.15.187:0/1997385536 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3326742706 0 0) 0x7f5c8015d870 con 0x7f5c8015d490 2023-12-12T10:11:45.989 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.980+0000 7f5c7f7fe640 1 -- 172.21.15.187:0/1997385536 >> v1:172.21.15.78:6789/0 conn(0x7f5c8015d490 legacy=0x7f5c800d0e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:11:45.989 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.980+0000 7f5c7f7fe640 1 -- 172.21.15.187:0/1997385536 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c800cebb0 con 0x7f5c800ce6b0 2023-12-12T10:11:45.989 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.980+0000 7f5c84cc7640 1 --2- 172.21.15.187:0/1997385536 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5c800d1bb0 0x7f5c800b2f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-12T10:11:45.991 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.984+0000 7f5c7f7fe640 1 --2- 172.21.15.187:0/1997385536 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5c800ce6b0 0x7f5c800d1670 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f5c74009870 tx=0x7f5c7401c540 comp rx=0 tx=0).ready entity=mon.1 client_cookie=858360195228e6b8 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:11:45.991 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.984+0000 7f5c7effd640 1 -- 172.21.15.187:0/1997385536 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c740a7070 con 0x7f5c800ce6b0 2023-12-12T10:11:45.991 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.984+0000 7f5c7effd640 1 -- 172.21.15.187:0/1997385536 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c740ab430 con 0x7f5c800ce6b0 2023-12-12T10:11:45.992 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.984+0000 7f5c7effd640 1 -- 172.21.15.187:0/1997385536 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c740ab7c0 con 0x7f5c800ce6b0 2023-12-12T10:11:45.992 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.984+0000 7f5c8672a640 1 -- 172.21.15.187:0/1997385536 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5c800ce6b0 msgr2=0x7f5c800d1670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:11:45.992 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.984+0000 7f5c8672a640 1 --2- 172.21.15.187:0/1997385536 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5c800ce6b0 0x7f5c800d1670 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f5c74009870 tx=0x7f5c7401c540 comp rx=0 tx=0).stop 2023-12-12T10:11:45.993 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.984+0000 7f5c8672a640 1 -- 172.21.15.187:0/1997385536 shutdown_connections 2023-12-12T10:11:45.993 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.984+0000 7f5c8672a640 1 --2- 172.21.15.187:0/1997385536 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5c800d1bb0 0x7f5c800b2f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:11:45.993 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.984+0000 7f5c8672a640 1 --2- 172.21.15.187:0/1997385536 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5c800ce6b0 0x7f5c800d1670 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:11:45.993 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.984+0000 7f5c8672a640 1 -- 172.21.15.187:0/1997385536 >> 172.21.15.187:0/1997385536 conn(0x7f5c800d3090 msgr2=0x7f5c800d34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:11:45.993 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.984+0000 7f5c8672a640 1 -- 172.21.15.187:0/1997385536 shutdown_connections 2023-12-12T10:11:45.993 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.984+0000 7f5c8672a640 1 -- 172.21.15.187:0/1997385536 wait complete. 2023-12-12T10:11:45.994 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-12-12T10:11:45.988+0000 7f7a71591180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-12T10:11:45.994 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.988+0000 7f5c8672a640 1 Processor -- start 2023-12-12T10:11:45.994 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.988+0000 7f5c8672a640 1 -- start start 2023-12-12T10:11:45.996 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.988+0000 7f5c8672a640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5c800ce6b0 0x7f5c8015b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:11:45.996 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.988+0000 7f5c8672a640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5c800d1bb0 0x7f5c800b5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:11:45.996 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.988+0000 7f5c8672a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5c8015d490 0x7f5c80156bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:11:45.996 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.988+0000 7f5c8672a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c80157ba0 con 0x7f5c8015d490 2023-12-12T10:11:45.996 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.988+0000 7f5c8672a640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c8014dee0 con 0x7f5c800d1bb0 2023-12-12T10:11:45.996 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.988+0000 7f5c8672a640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c801575e0 con 0x7f5c800ce6b0 2023-12-12T10:11:45.997 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.988+0000 7f5c7f7fe640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5c800d1bb0 0x7f5c800b5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:11:45.997 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.988+0000 7f5c7f7fe640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5c800d1bb0 0x7f5c800b5150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.187:52824/0 (socket says 172.21.15.187:52824) 2023-12-12T10:11:45.997 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.988+0000 7f5c7f7fe640 1 -- 172.21.15.187:0/451321978 learned_addr learned my addr 172.21.15.187:0/451321978 (peer_addr_for_me v2:172.21.15.187:0/0) 2023-12-12T10:11:45.997 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.988+0000 7f5c84cc7640 1 --2- 172.21.15.187:0/451321978 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5c8015d490 0x7f5c80156bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:11:45.997 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.988+0000 7f5c7ffff640 1 --2- 172.21.15.187:0/451321978 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5c800ce6b0 0x7f5c8015b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:11:45.997 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.988+0000 7f5c7f7fe640 1 -- 172.21.15.187:0/451321978 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5c800ce6b0 msgr2=0x7f5c8015b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:11:45.997 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.988+0000 7f5c7f7fe640 1 --2- 172.21.15.187:0/451321978 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5c800ce6b0 0x7f5c8015b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:11:45.997 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.988+0000 7f5c7f7fe640 1 -- 172.21.15.187:0/451321978 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5c8015d490 msgr2=0x7f5c80156bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:11:45.997 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.988+0000 7f5c7f7fe640 1 --2- 172.21.15.187:0/451321978 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5c8015d490 0x7f5c80156bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:11:45.997 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.988+0000 7f5c7f7fe640 1 -- 172.21.15.187:0/451321978 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c78009a70 con 0x7f5c800d1bb0 2023-12-12T10:11:45.997 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.988+0000 7f5c7ffff640 1 --2- 172.21.15.187:0/451321978 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5c800ce6b0 0x7f5c8015b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T10:11:45.997 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.988+0000 7f5c7f7fe640 1 --2- 172.21.15.187:0/451321978 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5c800d1bb0 0x7f5c800b5150 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f5c740ad040 tx=0x7f5c740192e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:11:45.998 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.988+0000 7f5c7cff9640 1 -- 172.21.15.187:0/451321978 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c740bc070 con 0x7f5c800d1bb0 2023-12-12T10:11:45.998 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.988+0000 7f5c7cff9640 1 -- 172.21.15.187:0/451321978 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c740b4420 con 0x7f5c800d1bb0 2023-12-12T10:11:45.999 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.988+0000 7f5c7cff9640 1 -- 172.21.15.187:0/451321978 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c740b47f0 con 0x7f5c800d1bb0 2023-12-12T10:11:45.999 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.988+0000 7f5c8672a640 1 -- 172.21.15.187:0/451321978 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c740094d0 con 0x7f5c800d1bb0 2023-12-12T10:11:45.999 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.988+0000 7f5c8672a640 1 -- 172.21.15.187:0/451321978 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c8014db70 con 0x7f5c800d1bb0 2023-12-12T10:11:45.999 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.988+0000 7f5c7cff9640 1 -- 172.21.15.187:0/451321978 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f5c740b4c50 con 0x7f5c800d1bb0 2023-12-12T10:11:45.999 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.988+0000 7f5c7cff9640 1 -- 172.21.15.187:0/451321978 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f5c740c1b90 con 0x7f5c800d1bb0 2023-12-12T10:11:45.999 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.992+0000 7f5c8672a640 1 -- 172.21.15.187:0/451321978 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c80068610 con 0x7f5c800d1bb0 2023-12-12T10:11:46.000 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:45.992+0000 7f5c7cff9640 1 -- 172.21.15.187:0/451321978 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f5c740c1df0 con 0x7f5c800d1bb0 2023-12-12T10:11:46.059 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-12-12T10:11:46.056+0000 7f7a71591180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-12T10:11:46.068 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.060+0000 7f5c8672a640 1 -- 172.21.15.187:0/451321978 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "osd new", "uuid": "0a714c65-f8ce-4340-968f-11a799677ef3", "id": 5} v 0) v1 -- 0x7f5c800b1f70 con 0x7f5c800d1bb0 2023-12-12T10:11:46.073 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.064+0000 7f5c7cff9640 1 -- 172.21.15.187:0/451321978 <== mon.1 v2:172.21.15.187:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0a714c65-f8ce-4340-968f-11a799677ef3", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f5c740c14e0 con 0x7f5c800d1bb0 2023-12-12T10:11:46.073 INFO:teuthology.orchestra.run.smithi187.stdout:5 2023-12-12T10:11:46.075 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.068+0000 7f5c8672a640 1 -- 172.21.15.187:0/451321978 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5c800d1bb0 msgr2=0x7f5c800b5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:11:46.075 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.068+0000 7f5c8672a640 1 --2- 172.21.15.187:0/451321978 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5c800d1bb0 0x7f5c800b5150 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f5c740ad040 tx=0x7f5c740192e0 comp rx=0 tx=0).stop 2023-12-12T10:11:46.075 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.068+0000 7f5c8672a640 1 -- 172.21.15.187:0/451321978 shutdown_connections 2023-12-12T10:11:46.075 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.068+0000 7f5c8672a640 1 --2- 172.21.15.187:0/451321978 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5c8015d490 0x7f5c80156bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:11:46.075 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.068+0000 7f5c8672a640 1 --2- 172.21.15.187:0/451321978 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5c800d1bb0 0x7f5c800b5150 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:11:46.075 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.068+0000 7f5c8672a640 1 --2- 172.21.15.187:0/451321978 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5c800ce6b0 0x7f5c8015b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:11:46.075 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.068+0000 7f5c8672a640 1 -- 172.21.15.187:0/451321978 >> 172.21.15.187:0/451321978 conn(0x7f5c800d3090 msgr2=0x7f5c800d0000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:11:46.075 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.068+0000 7f5c8672a640 1 -- 172.21.15.187:0/451321978 shutdown_connections 2023-12-12T10:11:46.075 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.068+0000 7f5c8672a640 1 -- 172.21.15.187:0/451321978 wait complete. 2023-12-12T10:11:46.084 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-12-12T10:11:46.076+0000 7fd80c6cf180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-12T10:11:46.094 DEBUG:teuthology.orchestra.run.smithi187:> sudo ceph --cluster ceph osd new d0bba9ab-f7ee-449e-8999-1c0cf7e6d53c 6 2023-12-12T10:11:46.151 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-12-12T10:11:46.144+0000 7fd80c6cf180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-12T10:11:46.212 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-12-12T10:11:46.208+0000 7f7a71591180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-12T10:11:46.231 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.224+0000 7fb5642d6640 1 Processor -- start 2023-12-12T10:11:46.231 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.224+0000 7fb5642d6640 1 -- start start 2023-12-12T10:11:46.232 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.224+0000 7fb5642d6640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb55c0d1ce0 0x7fb55c0d1040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:11:46.232 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.224+0000 7fb5642d6640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb55c0d04f0 con 0x7fb55c160890 2023-12-12T10:11:46.232 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.224+0000 7fb5642d6640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb55c0cdc20 con 0x7fb55c0d0be0 2023-12-12T10:11:46.233 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.224+0000 7fb5642d6640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb55c0cfc50 con 0x7fb55c0d1ce0 2023-12-12T10:11:46.233 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.224+0000 7fb561871640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7fb55c0d0be0 0x7fb55c0d15d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.187:33468/0 (socket says 172.21.15.187:33468) 2023-12-12T10:11:46.233 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.224+0000 7fb561871640 1 -- 172.21.15.187:0/3628933240 learned_addr learned my addr 172.21.15.187:0/3628933240 (peer_addr_for_me v1:172.21.15.187:0/0) 2023-12-12T10:11:46.233 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.224+0000 7fb562873640 1 --2- 172.21.15.187:0/3628933240 >> v2:172.21.15.78:3300/0 conn(0x7fb55c0d1ce0 0x7fb55c0d1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:11:46.234 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.224+0000 7fb561070640 1 -- 172.21.15.187:0/3628933240 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1830345385 0 0) 0x7fb55c0cdc20 con 0x7fb55c0d0be0 2023-12-12T10:11:46.234 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.224+0000 7fb561070640 1 -- 172.21.15.187:0/3628933240 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb548003530 con 0x7fb55c0d0be0 2023-12-12T10:11:46.234 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.224+0000 7fb561070640 1 -- 172.21.15.187:0/3628933240 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 548486425 0 0) 0x7fb558001120 con 0x7fb55c160890 2023-12-12T10:11:46.234 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.224+0000 7fb561070640 1 -- 172.21.15.187:0/3628933240 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb55c0cdc20 con 0x7fb55c160890 2023-12-12T10:11:46.234 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.224+0000 7fb562873640 1 -- 172.21.15.187:0/3628933240 >> v1:172.21.15.187:6789/0 conn(0x7fb55c0d0be0 legacy=0x7fb55c0d15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:11:46.234 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.224+0000 7fb562873640 1 -- 172.21.15.187:0/3628933240 >> v1:172.21.15.78:6789/0 conn(0x7fb55c160890 legacy=0x7fb55c0b5e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:11:46.234 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.224+0000 7fb562873640 1 -- 172.21.15.187:0/3628933240 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb55c0cff30 con 0x7fb55c0d1ce0 2023-12-12T10:11:46.236 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.228+0000 7fb562873640 1 --2- 172.21.15.187:0/3628933240 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb55c0d1ce0 0x7fb55c0d1040 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fb554009d90 tx=0x7fb55401c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6b81e4088b688c2 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:11:46.237 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.228+0000 7fb561070640 1 -- 172.21.15.187:0/3628933240 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5540a59e0 con 0x7fb55c0d1ce0 2023-12-12T10:11:46.237 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.228+0000 7fb561070640 1 -- 172.21.15.187:0/3628933240 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5540a5b40 con 0x7fb55c0d1ce0 2023-12-12T10:11:46.237 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.228+0000 7fb561070640 1 -- 172.21.15.187:0/3628933240 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5540ad440 con 0x7fb55c0d1ce0 2023-12-12T10:11:46.237 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.228+0000 7fb5642d6640 1 -- 172.21.15.187:0/3628933240 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb55c0d1ce0 msgr2=0x7fb55c0d1040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:11:46.237 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.228+0000 7fb5642d6640 1 --2- 172.21.15.187:0/3628933240 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb55c0d1ce0 0x7fb55c0d1040 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fb554009d90 tx=0x7fb55401c920 comp rx=0 tx=0).stop 2023-12-12T10:11:46.238 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.228+0000 7fb5642d6640 1 -- 172.21.15.187:0/3628933240 shutdown_connections 2023-12-12T10:11:46.238 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.228+0000 7fb5642d6640 1 --2- 172.21.15.187:0/3628933240 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb55c0d1ce0 0x7fb55c0d1040 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:11:46.239 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.228+0000 7fb5642d6640 1 -- 172.21.15.187:0/3628933240 >> 172.21.15.187:0/3628933240 conn(0x7fb55c09c2f0 msgr2=0x7fb55c0d3010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:11:46.239 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.228+0000 7fb5642d6640 1 -- 172.21.15.187:0/3628933240 shutdown_connections 2023-12-12T10:11:46.239 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.228+0000 7fb5642d6640 1 -- 172.21.15.187:0/3628933240 wait complete. 2023-12-12T10:11:46.239 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.232+0000 7fb5642d6640 1 Processor -- start 2023-12-12T10:11:46.239 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.232+0000 7fb5642d6640 1 -- start start 2023-12-12T10:11:46.241 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.232+0000 7fb5642d6640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb55c0d0be0 0x7fb55c157e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:11:46.241 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.232+0000 7fb5642d6640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb55c0d1ce0 0x7fb55c158690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:11:46.241 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.232+0000 7fb5642d6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb55c160890 0x7fb55c0b25a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:11:46.241 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.232+0000 7fb5642d6640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb55c0b2e10 con 0x7fb55c160890 2023-12-12T10:11:46.242 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.232+0000 7fb5642d6640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb55c0b30f0 con 0x7fb55c0d1ce0 2023-12-12T10:11:46.242 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.232+0000 7fb5642d6640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb55c0b33d0 con 0x7fb55c0d0be0 2023-12-12T10:11:46.242 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.232+0000 7fb561871640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb55c0d1ce0 0x7fb55c158690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:11:46.242 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.232+0000 7fb562072640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb55c0d0be0 0x7fb55c157e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:11:46.242 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.232+0000 7fb561871640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb55c0d1ce0 0x7fb55c158690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.187:52830/0 (socket says 172.21.15.187:52830) 2023-12-12T10:11:46.242 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.232+0000 7fb562873640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb55c160890 0x7fb55c0b25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:11:46.242 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.232+0000 7fb562072640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb55c0d0be0 0x7fb55c157e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.187:48960/0 (socket says 172.21.15.187:48960) 2023-12-12T10:11:46.242 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.232+0000 7fb561871640 1 -- 172.21.15.187:0/359817015 learned_addr learned my addr 172.21.15.187:0/359817015 (peer_addr_for_me v2:172.21.15.187:0/0) 2023-12-12T10:11:46.242 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.232+0000 7fb561871640 1 -- 172.21.15.187:0/359817015 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb55c0d0be0 msgr2=0x7fb55c157e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:11:46.242 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.232+0000 7fb561871640 1 --2- 172.21.15.187:0/359817015 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb55c0d0be0 0x7fb55c157e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:11:46.242 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.232+0000 7fb561871640 1 -- 172.21.15.187:0/359817015 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb55c160890 msgr2=0x7fb55c0b25a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:11:46.242 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.232+0000 7fb561871640 1 --2- 172.21.15.187:0/359817015 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb55c160890 0x7fb55c0b25a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:11:46.242 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.232+0000 7fb561871640 1 -- 172.21.15.187:0/359817015 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb554009a70 con 0x7fb55c0d1ce0 2023-12-12T10:11:46.242 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.232+0000 7fb562072640 1 --2- 172.21.15.187:0/359817015 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb55c0d0be0 0x7fb55c157e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-12T10:11:46.243 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.232+0000 7fb561871640 1 --2- 172.21.15.187:0/359817015 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb55c0d1ce0 0x7fb55c158690 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fb54c00c4d0 tx=0x7fb54c00c990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:11:46.243 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.232+0000 7fb552ffd640 1 -- 172.21.15.187:0/359817015 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb54c005cf0 con 0x7fb55c0d1ce0 2023-12-12T10:11:46.243 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.232+0000 7fb552ffd640 1 -- 172.21.15.187:0/359817015 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb54c005e50 con 0x7fb55c0d1ce0 2023-12-12T10:11:46.243 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.232+0000 7fb552ffd640 1 -- 172.21.15.187:0/359817015 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb54c0072b0 con 0x7fb55c0d1ce0 2023-12-12T10:11:46.243 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.232+0000 7fb5642d6640 1 -- 172.21.15.187:0/359817015 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb55c0b36b0 con 0x7fb55c0d1ce0 2023-12-12T10:11:46.243 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.236+0000 7fb5642d6640 1 -- 172.21.15.187:0/359817015 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb55c0b2ae0 con 0x7fb55c0d1ce0 2023-12-12T10:11:46.244 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.236+0000 7fb552ffd640 1 -- 172.21.15.187:0/359817015 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fb54c01c440 con 0x7fb55c0d1ce0 2023-12-12T10:11:46.244 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.236+0000 7fb552ffd640 1 -- 172.21.15.187:0/359817015 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7fb54c0129f0 con 0x7fb55c0d1ce0 2023-12-12T10:11:46.244 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.236+0000 7fb5642d6640 1 -- 172.21.15.187:0/359817015 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb55c067530 con 0x7fb55c0d1ce0 2023-12-12T10:11:46.245 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.236+0000 7fb552ffd640 1 -- 172.21.15.187:0/359817015 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7fb54c017070 con 0x7fb55c0d1ce0 2023-12-12T10:11:46.282 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-12-12T10:11:46.276+0000 7f7a71591180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-12T10:11:46.309 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-12-12T10:11:46.300+0000 7fd80c6cf180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-12T10:11:46.310 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.304+0000 7fb5642d6640 1 -- 172.21.15.187:0/359817015 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d0bba9ab-f7ee-449e-8999-1c0cf7e6d53c", "id": 6} v 0) v1 -- 0x7fb55c15db40 con 0x7fb55c0d1ce0 2023-12-12T10:11:46.315 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.308+0000 7fb552ffd640 1 -- 172.21.15.187:0/359817015 <== mon.1 v2:172.21.15.187:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d0bba9ab-f7ee-449e-8999-1c0cf7e6d53c", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fb54c012530 con 0x7fb55c0d1ce0 2023-12-12T10:11:46.315 INFO:teuthology.orchestra.run.smithi187.stdout:6 2023-12-12T10:11:46.316 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.308+0000 7fb5642d6640 1 -- 172.21.15.187:0/359817015 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb55c0d1ce0 msgr2=0x7fb55c158690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:11:46.316 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.308+0000 7fb5642d6640 1 --2- 172.21.15.187:0/359817015 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb55c0d1ce0 0x7fb55c158690 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fb54c00c4d0 tx=0x7fb54c00c990 comp rx=0 tx=0).stop 2023-12-12T10:11:46.316 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.308+0000 7fb5642d6640 1 -- 172.21.15.187:0/359817015 shutdown_connections 2023-12-12T10:11:46.316 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.308+0000 7fb5642d6640 1 --2- 172.21.15.187:0/359817015 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb55c160890 0x7fb55c0b25a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:11:46.316 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.308+0000 7fb5642d6640 1 --2- 172.21.15.187:0/359817015 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb55c0d1ce0 0x7fb55c158690 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:11:46.316 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.308+0000 7fb5642d6640 1 --2- 172.21.15.187:0/359817015 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb55c0d0be0 0x7fb55c157e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:11:46.316 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.308+0000 7fb5642d6640 1 -- 172.21.15.187:0/359817015 >> 172.21.15.187:0/359817015 conn(0x7fb55c09c2f0 msgr2=0x7fb55c0cc0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:11:46.317 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.308+0000 7fb5642d6640 1 -- 172.21.15.187:0/359817015 shutdown_connections 2023-12-12T10:11:46.317 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.308+0000 7fb5642d6640 1 -- 172.21.15.187:0/359817015 wait complete. 2023-12-12T10:11:46.334 DEBUG:teuthology.orchestra.run.smithi187:> sudo ceph --cluster ceph osd new efe5e0d9-2f87-4889-a27a-e2a95a632302 7 2023-12-12T10:11:46.383 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-12-12T10:11:46.376+0000 7fd80c6cf180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-12T10:11:46.473 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.464+0000 7f237dac9640 1 Processor -- start 2023-12-12T10:11:46.473 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.464+0000 7f237dac9640 1 -- start start 2023-12-12T10:11:46.474 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.468+0000 7f237dac9640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f2378160890 0x7f23780b5e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:11:46.474 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.468+0000 7f237dac9640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f23780d1ce0 0x7f23780d1040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:11:46.474 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.468+0000 7f237dac9640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23780d04f0 con 0x7f23780d0be0 2023-12-12T10:11:46.474 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.468+0000 7f237dac9640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23780b63a0 con 0x7f23780d1ce0 2023-12-12T10:11:46.475 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.468+0000 7f237dac9640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23780cdc20 con 0x7f2378160890 2023-12-12T10:11:46.475 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.468+0000 7f23777fe640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f2378160890 0x7f23780b5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:11:46.475 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.468+0000 7f23777fe640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f2378160890 0x7f23780b5e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.187:52838/0 (socket says 172.21.15.187:52838) 2023-12-12T10:11:46.475 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.468+0000 7f23777fe640 1 -- 172.21.15.187:0/1214524999 learned_addr learned my addr 172.21.15.187:0/1214524999 (peer_addr_for_me v2:172.21.15.187:0/0) 2023-12-12T10:11:46.475 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.468+0000 7f2377fff640 1 --2- 172.21.15.187:0/1214524999 >> v2:172.21.15.78:3300/0 conn(0x7f23780d1ce0 0x7f23780d1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:11:46.476 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.468+0000 7f23777fe640 1 -- 172.21.15.187:0/1214524999 >> v2:172.21.15.78:3300/0 conn(0x7f23780d1ce0 msgr2=0x7f23780d1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:11:46.476 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.468+0000 7f23777fe640 1 --2- 172.21.15.187:0/1214524999 >> v2:172.21.15.78:3300/0 conn(0x7f23780d1ce0 0x7f23780d1040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:11:46.476 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.468+0000 7f23777fe640 1 -- 172.21.15.187:0/1214524999 >> v1:172.21.15.187:6789/0 conn(0x7f23780d0be0 legacy=0x7f23780d15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:11:46.476 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.468+0000 7f23777fe640 1 -- 172.21.15.187:0/1214524999 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23780cfc50 con 0x7f2378160890 2023-12-12T10:11:46.478 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.472+0000 7f23777fe640 1 --2- 172.21.15.187:0/1214524999 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2378160890 0x7f23780b5e60 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f237808d720 tx=0x7f236801c4d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d740a0af4aebae84 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:11:46.478 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.472+0000 7f23767fc640 1 -- 172.21.15.187:0/1214524999 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23680aa430 con 0x7f2378160890 2023-12-12T10:11:46.478 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.472+0000 7f23767fc640 1 -- 172.21.15.187:0/1214524999 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23680aa590 con 0x7f2378160890 2023-12-12T10:11:46.478 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.472+0000 7f23767fc640 1 -- 172.21.15.187:0/1214524999 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23680aa920 con 0x7f2378160890 2023-12-12T10:11:46.479 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.472+0000 7f237dac9640 1 -- 172.21.15.187:0/1214524999 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2378160890 msgr2=0x7f23780b5e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:11:46.479 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.472+0000 7f237dac9640 1 --2- 172.21.15.187:0/1214524999 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2378160890 0x7f23780b5e60 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f237808d720 tx=0x7f236801c4d0 comp rx=0 tx=0).stop 2023-12-12T10:11:46.479 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.472+0000 7f237dac9640 1 -- 172.21.15.187:0/1214524999 shutdown_connections 2023-12-12T10:11:46.479 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.472+0000 7f237dac9640 1 --2- 172.21.15.187:0/1214524999 >> v2:172.21.15.78:3300/0 conn(0x7f23780d1ce0 0x7f23780d1040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:11:46.480 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.472+0000 7f237dac9640 1 --2- 172.21.15.187:0/1214524999 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2378160890 0x7f23780b5e60 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:11:46.480 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.472+0000 7f237dac9640 1 -- 172.21.15.187:0/1214524999 >> 172.21.15.187:0/1214524999 conn(0x7f237809c2f0 msgr2=0x7f23780d3010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:11:46.480 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.472+0000 7f237dac9640 1 -- 172.21.15.187:0/1214524999 shutdown_connections 2023-12-12T10:11:46.480 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.472+0000 7f237dac9640 1 -- 172.21.15.187:0/1214524999 wait complete. 2023-12-12T10:11:46.480 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.472+0000 7f237dac9640 1 Processor -- start 2023-12-12T10:11:46.480 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.472+0000 7f237dac9640 1 -- start start 2023-12-12T10:11:46.483 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.472+0000 7f237dac9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23780d0be0 0x7f23780c76c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:11:46.483 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.472+0000 7f237dac9640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f23780d1ce0 0x7f237814dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:11:46.483 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.476+0000 7f237dac9640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2378160890 0x7f23780b78c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:11:46.483 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.476+0000 7f237dac9640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23780c7c00 con 0x7f23780d0be0 2023-12-12T10:11:46.483 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.476+0000 7f237dac9640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23780b82a0 con 0x7f2378160890 2023-12-12T10:11:46.483 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.476+0000 7f237dac9640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23780c6be0 con 0x7f23780d1ce0 2023-12-12T10:11:46.484 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.476+0000 7f2377fff640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2378160890 0x7f23780b78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:11:46.484 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.476+0000 7f2376ffd640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f23780d1ce0 0x7f237814dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:11:46.484 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.476+0000 7f2377fff640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2378160890 0x7f23780b78c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.187:52846/0 (socket says 172.21.15.187:52846) 2023-12-12T10:11:46.484 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.476+0000 7f2377fff640 1 -- 172.21.15.187:0/1298890242 learned_addr learned my addr 172.21.15.187:0/1298890242 (peer_addr_for_me v2:172.21.15.187:0/0) 2023-12-12T10:11:46.484 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.476+0000 7f23777fe640 1 --2- 172.21.15.187:0/1298890242 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23780d0be0 0x7f23780c76c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:11:46.484 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.476+0000 7f2377fff640 1 -- 172.21.15.187:0/1298890242 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f23780d1ce0 msgr2=0x7f237814dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:11:46.484 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.476+0000 7f2377fff640 1 --2- 172.21.15.187:0/1298890242 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f23780d1ce0 0x7f237814dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:11:46.484 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.476+0000 7f2377fff640 1 -- 172.21.15.187:0/1298890242 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23780d0be0 msgr2=0x7f23780c76c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:11:46.484 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.476+0000 7f2377fff640 1 --2- 172.21.15.187:0/1298890242 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23780d0be0 0x7f23780c76c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:11:46.484 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.476+0000 7f2377fff640 1 -- 172.21.15.187:0/1298890242 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23680094d0 con 0x7f2378160890 2023-12-12T10:11:46.484 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.476+0000 7f2376ffd640 1 --2- 172.21.15.187:0/1298890242 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f23780d1ce0 0x7f237814dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-12T10:11:46.484 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.476+0000 7f2377fff640 1 --2- 172.21.15.187:0/1298890242 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2378160890 0x7f23780b78c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f2370009e30 tx=0x7f237000c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:11:46.484 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.476+0000 7f235ffff640 1 -- 172.21.15.187:0/1298890242 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2370009ca0 con 0x7f2378160890 2023-12-12T10:11:46.484 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.476+0000 7f235ffff640 1 -- 172.21.15.187:0/1298890242 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f237000f040 con 0x7f2378160890 2023-12-12T10:11:46.485 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.476+0000 7f235ffff640 1 -- 172.21.15.187:0/1298890242 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23700146c0 con 0x7f2378160890 2023-12-12T10:11:46.485 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.476+0000 7f237dac9640 1 -- 172.21.15.187:0/1298890242 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23780c6ec0 con 0x7f2378160890 2023-12-12T10:11:46.485 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.476+0000 7f237dac9640 1 -- 172.21.15.187:0/1298890242 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23780b8580 con 0x7f2378160890 2023-12-12T10:11:46.485 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.476+0000 7f235ffff640 1 -- 172.21.15.187:0/1298890242 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f2370014b20 con 0x7f2378160890 2023-12-12T10:11:46.485 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.476+0000 7f235ffff640 1 -- 172.21.15.187:0/1298890242 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f2370014dd0 con 0x7f2378160890 2023-12-12T10:11:46.485 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.476+0000 7f237dac9640 1 -- 172.21.15.187:0/1298890242 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2378067530 con 0x7f2378160890 2023-12-12T10:11:46.486 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.480+0000 7f235ffff640 1 -- 172.21.15.187:0/1298890242 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f237003bce0 con 0x7f2378160890 2023-12-12T10:11:46.552 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.544+0000 7f237dac9640 1 -- 172.21.15.187:0/1298890242 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "osd new", "uuid": "efe5e0d9-2f87-4889-a27a-e2a95a632302", "id": 7} v 0) v1 -- 0x7f23780d0690 con 0x7f2378160890 2023-12-12T10:11:46.557 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.548+0000 7f235ffff640 1 -- 172.21.15.187:0/1298890242 <== mon.1 v2:172.21.15.187:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "efe5e0d9-2f87-4889-a27a-e2a95a632302", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f237002a070 con 0x7f2378160890 2023-12-12T10:11:46.557 INFO:teuthology.orchestra.run.smithi187.stdout:7 2023-12-12T10:11:46.558 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.552+0000 7f237dac9640 1 -- 172.21.15.187:0/1298890242 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2378160890 msgr2=0x7f23780b78c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:11:46.558 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.552+0000 7f237dac9640 1 --2- 172.21.15.187:0/1298890242 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2378160890 0x7f23780b78c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f2370009e30 tx=0x7f237000c490 comp rx=0 tx=0).stop 2023-12-12T10:11:46.558 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.552+0000 7f237dac9640 1 -- 172.21.15.187:0/1298890242 shutdown_connections 2023-12-12T10:11:46.558 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.552+0000 7f237dac9640 1 --2- 172.21.15.187:0/1298890242 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2378160890 0x7f23780b78c0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:11:46.559 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.552+0000 7f237dac9640 1 --2- 172.21.15.187:0/1298890242 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f23780d1ce0 0x7f237814dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:11:46.559 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.552+0000 7f237dac9640 1 --2- 172.21.15.187:0/1298890242 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f23780d0be0 0x7f23780c76c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:11:46.559 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.552+0000 7f237dac9640 1 -- 172.21.15.187:0/1298890242 >> 172.21.15.187:0/1298890242 conn(0x7f237809c2f0 msgr2=0x7f23781589c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:11:46.559 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.552+0000 7f237dac9640 1 -- 172.21.15.187:0/1298890242 shutdown_connections 2023-12-12T10:11:46.559 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:11:46.552+0000 7f237dac9640 1 -- 172.21.15.187:0/1298890242 wait complete. 2023-12-12T10:11:46.576 INFO:tasks.ceph.osd.0:Restarting daemon 2023-12-12T10:11:46.576 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-12-12T10:11:46.580 INFO:tasks.ceph.osd.0:Started 2023-12-12T10:11:46.580 INFO:tasks.ceph.osd.1:Restarting daemon 2023-12-12T10:11:46.580 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-12-12T10:11:46.584 INFO:tasks.ceph.osd.1:Started 2023-12-12T10:11:46.584 INFO:tasks.ceph.osd.2:Restarting daemon 2023-12-12T10:11:46.584 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-12-12T10:11:46.587 INFO:tasks.ceph.osd.2:Started 2023-12-12T10:11:46.587 INFO:tasks.ceph.osd.3:Restarting daemon 2023-12-12T10:11:46.587 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-12-12T10:11:46.591 INFO:tasks.ceph.osd.3:Started 2023-12-12T10:11:46.591 INFO:tasks.ceph.osd.4:Restarting daemon 2023-12-12T10:11:46.591 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-12-12T10:11:46.595 INFO:tasks.ceph.osd.4:Started 2023-12-12T10:11:46.595 INFO:tasks.ceph.osd.5:Restarting daemon 2023-12-12T10:11:46.595 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-12-12T10:11:46.598 INFO:tasks.ceph.osd.5:Started 2023-12-12T10:11:46.599 INFO:tasks.ceph.osd.6:Restarting daemon 2023-12-12T10:11:46.599 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-12-12T10:11:46.602 INFO:tasks.ceph.osd.6:Started 2023-12-12T10:11:46.602 INFO:tasks.ceph.osd.7:Restarting daemon 2023-12-12T10:11:46.602 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-12-12T10:11:46.607 INFO:tasks.ceph.osd.7:Started 2023-12-12T10:11:46.607 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T10:11:46.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:46.812+0000 7f0e42f72640 1 Processor -- start 2023-12-12T10:11:46.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:46.812+0000 7f0e42f72640 1 -- start start 2023-12-12T10:11:46.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:46.812+0000 7f0e42f72640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f0e3c15d3c0 0x7f0e3c0d3b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:11:46.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:46.812+0000 7f0e42f72640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f0e3c0ce670 0x7f0e3c0d15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:11:46.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:46.812+0000 7f0e42f72640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e3c0b3250 con 0x7f0e3c0d1ae0 2023-12-12T10:11:46.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:46.812+0000 7f0e42f72640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e3c0d1f70 con 0x7f0e3c15d3c0 2023-12-12T10:11:46.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:46.812+0000 7f0e42f72640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e3c0cee50 con 0x7f0e3c0ce670 2023-12-12T10:11:46.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:46.812+0000 7f0e40d0e640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f0e3c15d3c0 0x7f0e3c0d3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:11:46.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:46.812+0000 7f0e40d0e640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f0e3c15d3c0 0x7f0e3c0d3b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59748/0 (socket says 172.21.15.78:59748) 2023-12-12T10:11:46.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:46.812+0000 7f0e40d0e640 1 -- 172.21.15.78:0/1818629680 learned_addr learned my addr 172.21.15.78:0/1818629680 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:11:46.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:46.812+0000 7f0e4150f640 1 --1- 172.21.15.78:0/1818629680 >> v1:172.21.15.78:6789/0 conn(0x7f0e3c0d1ae0 0x7f0e3c0cf680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:53556/0 (socket says 172.21.15.78:53556) 2023-12-12T10:11:46.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:46.812+0000 7f0e3bfff640 1 --2- 172.21.15.78:0/1818629680 >> v2:172.21.15.187:3300/0 conn(0x7f0e3c0ce670 0x7f0e3c0d15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:11:46.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:46.812+0000 7f0e40d0e640 1 -- 172.21.15.78:0/1818629680 >> v2:172.21.15.187:3300/0 conn(0x7f0e3c0ce670 msgr2=0x7f0e3c0d15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:11:46.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:46.812+0000 7f0e40d0e640 1 --2- 172.21.15.78:0/1818629680 >> v2:172.21.15.187:3300/0 conn(0x7f0e3c0ce670 0x7f0e3c0d15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:11:46.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:46.812+0000 7f0e40d0e640 1 -- 172.21.15.78:0/1818629680 >> v1:172.21.15.78:6789/0 conn(0x7f0e3c0d1ae0 legacy=0x7f0e3c0cf680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:11:46.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:46.812+0000 7f0e40d0e640 1 -- 172.21.15.78:0/1818629680 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e3c0b2920 con 0x7f0e3c15d3c0 2023-12-12T10:11:46.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:46.812+0000 7f0e3b7fe640 1 -- 172.21.15.78:0/1818629680 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3957114958 0 0) 0x7f0e3c0b3250 con 0x7f0e3c0d1ae0 2023-12-12T10:11:46.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:46.816+0000 7f0e40d0e640 1 --2- 172.21.15.78:0/1818629680 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0e3c15d3c0 0x7f0e3c0d3b10 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f0e30009870 tx=0x7f0e3001ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=268c2368daa1608b server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:11:46.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:46.816+0000 7f0e3b7fe640 1 -- 172.21.15.78:0/1818629680 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e300a89f0 con 0x7f0e3c15d3c0 2023-12-12T10:11:46.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:46.816+0000 7f0e3b7fe640 1 -- 172.21.15.78:0/1818629680 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e300a8b50 con 0x7f0e3c15d3c0 2023-12-12T10:11:46.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:46.816+0000 7f0e3b7fe640 1 -- 172.21.15.78:0/1818629680 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e300b0440 con 0x7f0e3c15d3c0 2023-12-12T10:11:46.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:46.816+0000 7f0e42f72640 1 -- 172.21.15.78:0/1818629680 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0e3c15d3c0 msgr2=0x7f0e3c0d3b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:11:46.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:46.816+0000 7f0e42f72640 1 --2- 172.21.15.78:0/1818629680 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0e3c15d3c0 0x7f0e3c0d3b10 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f0e30009870 tx=0x7f0e3001ecf0 comp rx=0 tx=0).stop 2023-12-12T10:11:46.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:46.816+0000 7f0e42f72640 1 -- 172.21.15.78:0/1818629680 shutdown_connections 2023-12-12T10:11:46.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:46.816+0000 7f0e42f72640 1 --2- 172.21.15.78:0/1818629680 >> v2:172.21.15.187:3300/0 conn(0x7f0e3c0ce670 0x7f0e3c0d15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:11:46.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:46.816+0000 7f0e42f72640 1 --2- 172.21.15.78:0/1818629680 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0e3c15d3c0 0x7f0e3c0d3b10 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:11:46.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:46.816+0000 7f0e42f72640 1 -- 172.21.15.78:0/1818629680 >> 172.21.15.78:0/1818629680 conn(0x7f0e3c09c2a0 msgr2=0x7f0e3c0d2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:11:46.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:46.816+0000 7f0e42f72640 1 -- 172.21.15.78:0/1818629680 shutdown_connections 2023-12-12T10:11:46.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:46.816+0000 7f0e42f72640 1 -- 172.21.15.78:0/1818629680 wait complete. 2023-12-12T10:11:46.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:46.820+0000 7f0e42f72640 1 Processor -- start 2023-12-12T10:11:46.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:46.820+0000 7f0e42f72640 1 -- start start 2023-12-12T10:11:46.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:46.820+0000 7f0e42f72640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0e3c0ce670 0x7f0e3c14cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:11:46.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:46.820+0000 7f0e42f72640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0e3c0d1ae0 0x7f0e3c0b8400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:11:46.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:46.820+0000 7f0e42f72640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0e3c15d3c0 0x7f0e3c0cc9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:11:46.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:46.820+0000 7f0e42f72640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e3c0b8940 con 0x7f0e3c0ce670 2023-12-12T10:11:46.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:46.820+0000 7f0e42f72640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e3c0ccf20 con 0x7f0e3c0d1ae0 2023-12-12T10:11:46.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:46.820+0000 7f0e42f72640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e3c0b8bc0 con 0x7f0e3c15d3c0 2023-12-12T10:11:46.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:46.820+0000 7f0e40d0e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0e3c0ce670 0x7f0e3c14cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:11:46.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:46.820+0000 7f0e40d0e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0e3c0ce670 0x7f0e3c14cb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59752/0 (socket says 172.21.15.78:59752) 2023-12-12T10:11:46.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:46.820+0000 7f0e40d0e640 1 -- 172.21.15.78:0/4061053997 learned_addr learned my addr 172.21.15.78:0/4061053997 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:11:46.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:46.820+0000 7f0e3bfff640 1 --2- 172.21.15.78:0/4061053997 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0e3c0d1ae0 0x7f0e3c0b8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:11:46.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:46.820+0000 7f0e4150f640 1 --2- 172.21.15.78:0/4061053997 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0e3c15d3c0 0x7f0e3c0cc9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:11:46.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:46.820+0000 7f0e40d0e640 1 -- 172.21.15.78:0/4061053997 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0e3c15d3c0 msgr2=0x7f0e3c0cc9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:11:46.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:46.820+0000 7f0e40d0e640 1 --2- 172.21.15.78:0/4061053997 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0e3c15d3c0 0x7f0e3c0cc9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:11:46.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:46.820+0000 7f0e40d0e640 1 -- 172.21.15.78:0/4061053997 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0e3c0d1ae0 msgr2=0x7f0e3c0b8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:11:46.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:46.820+0000 7f0e40d0e640 1 --2- 172.21.15.78:0/4061053997 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0e3c0d1ae0 0x7f0e3c0b8400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:11:46.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:46.820+0000 7f0e40d0e640 1 -- 172.21.15.78:0/4061053997 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e300094d0 con 0x7f0e3c0ce670 2023-12-12T10:11:46.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:46.820+0000 7f0e40d0e640 1 --2- 172.21.15.78:0/4061053997 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0e3c0ce670 0x7f0e3c14cb40 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f0e300b3040 tx=0x7f0e3001ba90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:11:46.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:46.820+0000 7f0e397fa640 1 -- 172.21.15.78:0/4061053997 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e300be070 con 0x7f0e3c0ce670 2023-12-12T10:11:46.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:46.820+0000 7f0e397fa640 1 -- 172.21.15.78:0/4061053997 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e300ba400 con 0x7f0e3c0ce670 2023-12-12T10:11:46.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:46.820+0000 7f0e42f72640 1 -- 172.21.15.78:0/4061053997 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e3c0cbc20 con 0x7f0e3c0ce670 2023-12-12T10:11:46.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:46.820+0000 7f0e397fa640 1 -- 172.21.15.78:0/4061053997 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e300ba7d0 con 0x7f0e3c0ce670 2023-12-12T10:11:46.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:46.820+0000 7f0e42f72640 1 -- 172.21.15.78:0/4061053997 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e3c0cc1e0 con 0x7f0e3c0ce670 2023-12-12T10:11:46.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:46.820+0000 7f0e397fa640 1 -- 172.21.15.78:0/4061053997 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f0e300bac30 con 0x7f0e3c0ce670 2023-12-12T10:11:46.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:46.820+0000 7f0e397fa640 1 -- 172.21.15.78:0/4061053997 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f0e300c3be0 con 0x7f0e3c0ce670 2023-12-12T10:11:46.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:46.824+0000 7f0e42f72640 1 -- 172.21.15.78:0/4061053997 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e3c067530 con 0x7f0e3c0ce670 2023-12-12T10:11:46.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:46.824+0000 7f0e397fa640 1 -- 172.21.15.78:0/4061053997 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f0e300b5070 con 0x7f0e3c0ce670 2023-12-12T10:11:46.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:46.880+0000 7f0e42f72640 1 -- 172.21.15.78:0/4061053997 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0e3c0cd480 con 0x7f0e3c0ce670 2023-12-12T10:11:46.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:46.880+0000 7f0e397fa640 1 -- 172.21.15.78:0/4061053997 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f0e300d0090 con 0x7f0e3c0ce670 2023-12-12T10:11:46.885 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:11:46.885 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":10,"fsid":"fc81937c-bd26-483c-952b-d1324fcb0c9e","created":"2023-12-12T10:11:44.020214+0000","modified":"2023-12-12T10:11:46.553610+0000","last_up_change":"0.000000","last_in_change":"2023-12-12T10:11:46.553610+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"22dfdedf-5f6c-4b20-9f6c-30517a1db70a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"be34a7f3-a69a-462e-9ddf-5e537448dba2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"55b381de-5f56-4b14-80f7-e6e41e084a13","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"d7682de1-25cb-4cec-869f-8851c28b0e6d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"8279815a-d6c7-4199-871e-d28971b9dc07","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"0a714c65-f8ce-4340-968f-11a799677ef3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"d0bba9ab-f7ee-449e-8999-1c0cf7e6d53c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"efe5e0d9-2f87-4889-a27a-e2a95a632302","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T10:11:46.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:46.880+0000 7f0e42f72640 1 -- 172.21.15.78:0/4061053997 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0e3c0ce670 msgr2=0x7f0e3c14cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:11:46.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:46.880+0000 7f0e42f72640 1 --2- 172.21.15.78:0/4061053997 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0e3c0ce670 0x7f0e3c14cb40 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f0e300b3040 tx=0x7f0e3001ba90 comp rx=0 tx=0).stop 2023-12-12T10:11:46.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:46.880+0000 7f0e42f72640 1 -- 172.21.15.78:0/4061053997 shutdown_connections 2023-12-12T10:11:46.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:46.880+0000 7f0e42f72640 1 --2- 172.21.15.78:0/4061053997 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0e3c15d3c0 0x7f0e3c0cc9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:11:46.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:46.880+0000 7f0e42f72640 1 --2- 172.21.15.78:0/4061053997 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0e3c0d1ae0 0x7f0e3c0b8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:11:46.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:46.880+0000 7f0e42f72640 1 --2- 172.21.15.78:0/4061053997 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0e3c0ce670 0x7f0e3c14cb40 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:11:46.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:46.880+0000 7f0e42f72640 1 -- 172.21.15.78:0/4061053997 >> 172.21.15.78:0/4061053997 conn(0x7f0e3c09c2a0 msgr2=0x7f0e3c0b3e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:11:46.887 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:46.880+0000 7f0e42f72640 1 -- 172.21.15.78:0/4061053997 shutdown_connections 2023-12-12T10:11:46.887 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:11:46.884+0000 7f0e42f72640 1 -- 172.21.15.78:0/4061053997 wait complete. 2023-12-12T10:11:46.905 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-12-12T10:11:46.905 INFO:tasks.ceph:Waiting for OSDs to come up 2023-12-12T10:11:46.953 INFO:tasks.ceph.mgr.y.smithi078.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-12-12T10:11:46.953 INFO:tasks.ceph.mgr.y.smithi078.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-12-12T10:11:46.953 INFO:tasks.ceph.mgr.y.smithi078.stderr: from numpy import show_config as show_numpy_config 2023-12-12T10:11:46.991 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-12-12T10:11:46.988+0000 7f7a71591180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-12-12T10:11:47.085 INFO:tasks.ceph.mgr.x.smithi187.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-12-12T10:11:47.085 INFO:tasks.ceph.mgr.x.smithi187.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-12-12T10:11:47.085 INFO:tasks.ceph.mgr.x.smithi187.stderr: from numpy import show_config as show_numpy_config 2023-12-12T10:11:47.127 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-12-12T10:11:47.120+0000 7fd80c6cf180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-12-12T10:11:47.128 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-12-12T10:11:47.123+0000 7f7a71591180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-12T10:11:47.235 INFO:tasks.ceph.osd.5.smithi187.stderr:2023-12-12T10:11:47.228+0000 7f3641b53640 -1 Falling back to public interface 2023-12-12T10:11:47.262 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-12-12T10:11:47.256+0000 7fd80c6cf180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-12T10:11:47.263 INFO:tasks.ceph.osd.4.smithi187.stderr:2023-12-12T10:11:47.256+0000 7fcf62731640 -1 Falling back to public interface 2023-12-12T10:11:47.267 INFO:tasks.ceph.osd.1.smithi078.stderr:2023-12-12T10:11:47.263+0000 7fda0bcb8640 -1 Falling back to public interface 2023-12-12T10:11:47.271 INFO:tasks.ceph.osd.6.smithi187.stderr:2023-12-12T10:11:47.264+0000 7fb91a872640 -1 Falling back to public interface 2023-12-12T10:11:47.275 INFO:tasks.ceph.osd.0.smithi078.stderr:2023-12-12T10:11:47.271+0000 7f726ba2b640 -1 Falling back to public interface 2023-12-12T10:11:47.279 INFO:tasks.ceph.osd.7.smithi187.stderr:2023-12-12T10:11:47.272+0000 7f9c7802b640 -1 Falling back to public interface 2023-12-12T10:11:47.299 INFO:tasks.ceph.osd.2.smithi078.stderr:2023-12-12T10:11:47.295+0000 7effff472640 -1 Falling back to public interface 2023-12-12T10:11:47.299 INFO:tasks.ceph.osd.3.smithi078.stderr:2023-12-12T10:11:47.295+0000 7f238f705640 -1 Falling back to public interface 2023-12-12T10:11:47.314 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-12-12T10:11:47.311+0000 7f7a71591180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-12T10:11:47.387 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-12-12T10:11:47.383+0000 7f7a71591180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-12T10:11:47.448 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-12-12T10:11:47.440+0000 7fd80c6cf180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-12T10:11:47.520 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-12-12T10:11:47.512+0000 7fd80c6cf180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-12T10:11:47.525 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-12-12T10:11:47.519+0000 7f7a71591180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-12T10:11:47.660 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-12-12T10:11:47.652+0000 7fd80c6cf180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-12T10:11:47.712 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-12-12T10:11:47.841 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:47.835+0000 7fe55a72a640 1 Processor -- start 2023-12-12T10:11:47.841 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:47.835+0000 7fe55a72a640 1 -- start start 2023-12-12T10:11:47.842 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:47.835+0000 7fe55a72a640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fe55415d1f0 0x7fe5540ce680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:11:47.842 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:47.835+0000 7fe55a72a640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe5541613f0 0x7fe5540cebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:11:47.842 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:47.835+0000 7fe55a72a640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe55415d5d0 con 0x7fe5540d1d00 2023-12-12T10:11:47.842 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:47.835+0000 7fe55a72a640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5540d18e0 con 0x7fe55415d1f0 2023-12-12T10:11:47.842 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:47.835+0000 7fe55a72a640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe554161ad0 con 0x7fe5541613f0 2023-12-12T10:11:47.842 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:47.835+0000 7fe5537fe640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fe5540d1d00 0x7fe554160ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:53570/0 (socket says 172.21.15.78:53570) 2023-12-12T10:11:47.842 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:47.839+0000 7fe5537fe640 1 -- 172.21.15.78:0/740309116 learned_addr learned my addr 172.21.15.78:0/740309116 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-12-12T10:11:47.843 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:47.839+0000 7fe553fff640 1 --2- 172.21.15.78:0/740309116 >> v2:172.21.15.187:3300/0 conn(0x7fe55415d1f0 0x7fe5540ce680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:11:47.843 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:47.839+0000 7fe558cc7640 1 --2- 172.21.15.78:0/740309116 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe5541613f0 0x7fe5540cebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:11:47.843 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:47.839+0000 7fe552ffd640 1 -- 172.21.15.78:0/740309116 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1917376238 0 0) 0x7fe55415d5d0 con 0x7fe5540d1d00 2023-12-12T10:11:47.843 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:47.839+0000 7fe552ffd640 1 -- 172.21.15.78:0/740309116 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe53c003530 con 0x7fe5540d1d00 2023-12-12T10:11:47.844 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:47.839+0000 7fe553fff640 1 -- 172.21.15.78:0/740309116 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe5541613f0 msgr2=0x7fe5540cebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:11:47.844 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:47.839+0000 7fe553fff640 1 --2- 172.21.15.78:0/740309116 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe5541613f0 0x7fe5540cebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:11:47.844 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:47.839+0000 7fe553fff640 1 -- 172.21.15.78:0/740309116 >> v1:172.21.15.78:6789/0 conn(0x7fe5540d1d00 legacy=0x7fe554160ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:11:47.844 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:47.839+0000 7fe553fff640 1 -- 172.21.15.78:0/740309116 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5540d0c60 con 0x7fe55415d1f0 2023-12-12T10:11:47.844 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:47.839+0000 7fe558cc7640 1 --2- 172.21.15.78:0/740309116 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe5541613f0 0x7fe5540cebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-12T10:11:47.846 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:47.839+0000 7fe553fff640 1 --2- 172.21.15.78:0/740309116 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe55415d1f0 0x7fe5540ce680 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fe5440097c0 tx=0x7fe54401c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=64c59d404098e41c server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:11:47.846 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:47.839+0000 7fe552ffd640 1 -- 172.21.15.78:0/740309116 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5440ab650 con 0x7fe55415d1f0 2023-12-12T10:11:47.846 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:47.839+0000 7fe552ffd640 1 -- 172.21.15.78:0/740309116 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5440ab7b0 con 0x7fe55415d1f0 2023-12-12T10:11:47.846 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:47.839+0000 7fe552ffd640 1 -- 172.21.15.78:0/740309116 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5440abb40 con 0x7fe55415d1f0 2023-12-12T10:11:47.847 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:47.843+0000 7fe55a72a640 1 -- 172.21.15.78:0/740309116 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe55415d1f0 msgr2=0x7fe5540ce680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:11:47.847 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:47.843+0000 7fe55a72a640 1 --2- 172.21.15.78:0/740309116 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe55415d1f0 0x7fe5540ce680 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fe5440097c0 tx=0x7fe54401c450 comp rx=0 tx=0).stop 2023-12-12T10:11:47.847 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:47.843+0000 7fe55a72a640 1 -- 172.21.15.78:0/740309116 shutdown_connections 2023-12-12T10:11:47.847 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:47.843+0000 7fe55a72a640 1 --2- 172.21.15.78:0/740309116 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe5541613f0 0x7fe5540cebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:11:47.847 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:47.843+0000 7fe55a72a640 1 --2- 172.21.15.78:0/740309116 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe55415d1f0 0x7fe5540ce680 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:11:47.847 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:47.843+0000 7fe55a72a640 1 -- 172.21.15.78:0/740309116 >> 172.21.15.78:0/740309116 conn(0x7fe5540d2ff0 msgr2=0x7fe5540d3400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:11:47.847 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:47.843+0000 7fe55a72a640 1 -- 172.21.15.78:0/740309116 shutdown_connections 2023-12-12T10:11:47.847 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:47.843+0000 7fe55a72a640 1 -- 172.21.15.78:0/740309116 wait complete. 2023-12-12T10:11:47.848 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:47.843+0000 7fe55a72a640 1 Processor -- start 2023-12-12T10:11:47.849 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:47.843+0000 7fe55a72a640 1 -- start start 2023-12-12T10:11:47.851 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:47.843+0000 7fe55a72a640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe5540d1d00 0x7fe554157b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:11:47.851 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:47.843+0000 7fe55a72a640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe55415d1f0 0x7fe554160180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:11:47.851 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:47.843+0000 7fe55a72a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe5541613f0 0x7fe5540cc520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:11:47.851 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:47.843+0000 7fe55a72a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe554159210 con 0x7fe5541613f0 2023-12-12T10:11:47.851 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:47.843+0000 7fe55a72a640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe554158600 con 0x7fe5540d1d00 2023-12-12T10:11:47.851 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:47.843+0000 7fe55a72a640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5541588e0 con 0x7fe55415d1f0 2023-12-12T10:11:47.852 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:47.843+0000 7fe558cc7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe5541613f0 0x7fe5540cc520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:11:47.852 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:47.843+0000 7fe558cc7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe5541613f0 0x7fe5540cc520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59756/0 (socket says 172.21.15.78:59756) 2023-12-12T10:11:47.852 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:47.843+0000 7fe558cc7640 1 -- 172.21.15.78:0/1733967819 learned_addr learned my addr 172.21.15.78:0/1733967819 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:11:47.852 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:47.843+0000 7fe553fff640 1 --2- 172.21.15.78:0/1733967819 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe5540d1d00 0x7fe554157b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:11:47.852 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:47.843+0000 7fe5537fe640 1 --2- 172.21.15.78:0/1733967819 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe55415d1f0 0x7fe554160180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:11:47.852 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:47.847+0000 7fe558cc7640 1 -- 172.21.15.78:0/1733967819 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe55415d1f0 msgr2=0x7fe554160180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:11:47.852 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:47.847+0000 7fe558cc7640 1 --2- 172.21.15.78:0/1733967819 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe55415d1f0 0x7fe554160180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:11:47.852 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:47.847+0000 7fe558cc7640 1 -- 172.21.15.78:0/1733967819 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe5540d1d00 msgr2=0x7fe554157b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:11:47.852 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:47.847+0000 7fe558cc7640 1 --2- 172.21.15.78:0/1733967819 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe5540d1d00 0x7fe554157b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:11:47.852 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:47.847+0000 7fe558cc7640 1 -- 172.21.15.78:0/1733967819 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe54c009a70 con 0x7fe5541613f0 2023-12-12T10:11:47.852 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:47.847+0000 7fe553fff640 1 --2- 172.21.15.78:0/1733967819 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe5540d1d00 0x7fe554157b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-12T10:11:47.852 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:47.847+0000 7fe558cc7640 1 --2- 172.21.15.78:0/1733967819 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe5541613f0 0x7fe5540cc520 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fe54c00efc0 tx=0x7fe54c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:11:47.852 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:47.847+0000 7fe550ff9640 1 -- 172.21.15.78:0/1733967819 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe54c00cd30 con 0x7fe5541613f0 2023-12-12T10:11:47.852 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:47.847+0000 7fe550ff9640 1 -- 172.21.15.78:0/1733967819 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe54c00f040 con 0x7fe5541613f0 2023-12-12T10:11:47.852 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:47.847+0000 7fe550ff9640 1 -- 172.21.15.78:0/1733967819 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe54c003be0 con 0x7fe5541613f0 2023-12-12T10:11:47.853 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:47.847+0000 7fe55a72a640 1 -- 172.21.15.78:0/1733967819 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe544009420 con 0x7fe5541613f0 2023-12-12T10:11:47.853 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:47.847+0000 7fe55a72a640 1 -- 172.21.15.78:0/1733967819 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe554158ea0 con 0x7fe5541613f0 2023-12-12T10:11:47.853 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:47.847+0000 7fe550ff9640 1 -- 172.21.15.78:0/1733967819 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fe54c014780 con 0x7fe5541613f0 2023-12-12T10:11:47.853 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:47.847+0000 7fe550ff9640 1 -- 172.21.15.78:0/1733967819 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fe54c014a30 con 0x7fe5541613f0 2023-12-12T10:11:47.853 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:47.847+0000 7fe55a72a640 1 -- 172.21.15.78:0/1733967819 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5541593c0 con 0x7fe5541613f0 2023-12-12T10:11:47.854 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:47.851+0000 7fe550ff9640 1 -- 172.21.15.78:0/1733967819 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7fe5541593c0 con 0x7fe5541613f0 2023-12-12T10:11:47.912 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:47.907+0000 7fe55a72a640 1 -- 172.21.15.78:0/1733967819 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe554067530 con 0x7fe5541613f0 2023-12-12T10:11:47.912 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:47.907+0000 7fe550ff9640 1 -- 172.21.15.78:0/1733967819 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fe54c018030 con 0x7fe5541613f0 2023-12-12T10:11:47.912 INFO:teuthology.misc.health.smithi078.stdout: 2023-12-12T10:11:47.913 INFO:teuthology.misc.health.smithi078.stdout:{"epoch":10,"fsid":"fc81937c-bd26-483c-952b-d1324fcb0c9e","created":"2023-12-12T10:11:44.020214+0000","modified":"2023-12-12T10:11:46.553610+0000","last_up_change":"0.000000","last_in_change":"2023-12-12T10:11:46.553610+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"22dfdedf-5f6c-4b20-9f6c-30517a1db70a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"be34a7f3-a69a-462e-9ddf-5e537448dba2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"55b381de-5f56-4b14-80f7-e6e41e084a13","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"d7682de1-25cb-4cec-869f-8851c28b0e6d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"8279815a-d6c7-4199-871e-d28971b9dc07","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"0a714c65-f8ce-4340-968f-11a799677ef3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"d0bba9ab-f7ee-449e-8999-1c0cf7e6d53c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"efe5e0d9-2f87-4889-a27a-e2a95a632302","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T10:11:47.913 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:47.907+0000 7fe55a72a640 1 -- 172.21.15.78:0/1733967819 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe5541613f0 msgr2=0x7fe5540cc520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:11:47.914 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:47.907+0000 7fe55a72a640 1 --2- 172.21.15.78:0/1733967819 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe5541613f0 0x7fe5540cc520 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fe54c00efc0 tx=0x7fe54c00c490 comp rx=0 tx=0).stop 2023-12-12T10:11:47.914 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:47.907+0000 7fe55a72a640 1 -- 172.21.15.78:0/1733967819 shutdown_connections 2023-12-12T10:11:47.914 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:47.907+0000 7fe55a72a640 1 --2- 172.21.15.78:0/1733967819 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe5541613f0 0x7fe5540cc520 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:11:47.914 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:47.907+0000 7fe55a72a640 1 --2- 172.21.15.78:0/1733967819 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe55415d1f0 0x7fe554160180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:11:47.914 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:47.907+0000 7fe55a72a640 1 --2- 172.21.15.78:0/1733967819 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe5540d1d00 0x7fe554157b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:11:47.914 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:47.907+0000 7fe55a72a640 1 -- 172.21.15.78:0/1733967819 >> 172.21.15.78:0/1733967819 conn(0x7fe5540d2ff0 msgr2=0x7fe55406c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:11:47.914 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:47.907+0000 7fe55a72a640 1 -- 172.21.15.78:0/1733967819 shutdown_connections 2023-12-12T10:11:47.914 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:47.907+0000 7fe55a72a640 1 -- 172.21.15.78:0/1733967819 wait complete. 2023-12-12T10:11:47.932 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-12-12T10:11:48.216 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-12-12T10:11:48.211+0000 7f7a71591180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-12T10:11:48.303 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-12-12T10:11:48.299+0000 7f7a71591180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-12T10:11:48.341 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-12-12T10:11:48.332+0000 7fd80c6cf180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-12T10:11:48.428 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-12-12T10:11:48.420+0000 7fd80c6cf180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-12T10:11:48.492 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-12-12T10:11:48.487+0000 7f7a71591180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-12T10:11:48.578 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-12-12T10:11:48.571+0000 7f7a71591180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-12T10:11:48.618 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-12-12T10:11:48.612+0000 7fd80c6cf180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-12T10:11:48.703 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-12-12T10:11:48.696+0000 7fd80c6cf180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-12T10:11:48.905 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-12-12T10:11:48.899+0000 7f7a71591180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-12T10:11:48.974 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-12-12T10:11:48.967+0000 7f7a71591180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-12T10:11:49.038 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-12-12T10:11:49.032+0000 7fd80c6cf180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-12T10:11:49.107 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-12-12T10:11:49.100+0000 7fd80c6cf180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-12T10:11:49.995 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-12-12T10:11:49.991+0000 7f7a18e0a640 -1 mgr.server handle_report got status from non-daemon mon.b 2023-12-12T10:11:49.998 INFO:tasks.ceph.mgr.y.smithi078.stderr:2023-12-12T10:11:49.991+0000 7f7a18e0a640 -1 mgr.server handle_report got status from non-daemon mon.c 2023-12-12T10:11:51.068 INFO:tasks.ceph.osd.5.smithi187.stderr:2023-12-12T10:11:51.060+0000 7f3641b53640 -1 osd.5 0 log_to_monitors true 2023-12-12T10:11:51.126 INFO:tasks.ceph.osd.4.smithi187.stderr:2023-12-12T10:11:51.120+0000 7fcf62731640 -1 osd.4 0 log_to_monitors true 2023-12-12T10:11:51.210 INFO:tasks.ceph.osd.0.smithi078.stderr:2023-12-12T10:11:51.203+0000 7f726ba2b640 -1 osd.0 0 log_to_monitors true 2023-12-12T10:11:51.246 INFO:tasks.ceph.osd.2.smithi078.stderr:2023-12-12T10:11:51.239+0000 7effff472640 -1 osd.2 0 log_to_monitors true 2023-12-12T10:11:51.266 INFO:tasks.ceph.osd.6.smithi187.stderr:2023-12-12T10:11:51.260+0000 7fb91a872640 -1 osd.6 0 log_to_monitors true 2023-12-12T10:11:51.271 INFO:tasks.ceph.osd.7.smithi187.stderr:2023-12-12T10:11:51.264+0000 7f9c7802b640 -1 osd.7 0 log_to_monitors true 2023-12-12T10:11:51.473 INFO:tasks.ceph.osd.1.smithi078.stderr:2023-12-12T10:11:51.467+0000 7fda0bcb8640 -1 osd.1 0 log_to_monitors true 2023-12-12T10:11:51.584 INFO:tasks.ceph.osd.3.smithi078.stderr:2023-12-12T10:11:51.579+0000 7f238f705640 -1 osd.3 0 log_to_monitors true 2023-12-12T10:11:54.739 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-12-12T10:11:54.950 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:54.943+0000 7fd8ddd0f640 1 Processor -- start 2023-12-12T10:11:54.950 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:54.943+0000 7fd8ddd0f640 1 -- start start 2023-12-12T10:11:54.954 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:54.947+0000 7fd8ddd0f640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd8d80cfbe0 0x7fd8d80b5e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:11:54.954 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:54.947+0000 7fd8ddd0f640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fd8d80b3f20 0x7fd8d80d1330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:11:54.954 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:54.947+0000 7fd8ddd0f640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8d80d0bc0 con 0x7fd8d80d3700 2023-12-12T10:11:54.954 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:54.947+0000 7fd8ddd0f640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8d80b6380 con 0x7fd8d80cfbe0 2023-12-12T10:11:54.954 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:54.947+0000 7fd8ddd0f640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8d80ce700 con 0x7fd8d80b3f20 2023-12-12T10:11:54.954 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:54.947+0000 7fd8d6ffd640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fd8d80d3700 0x7fd8d8160360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:46016/0 (socket says 172.21.15.78:46016) 2023-12-12T10:11:54.954 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:54.947+0000 7fd8d6ffd640 1 -- 172.21.15.78:0/4231643581 learned_addr learned my addr 172.21.15.78:0/4231643581 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-12-12T10:11:54.954 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:54.947+0000 7fd8d7fff640 1 --2- 172.21.15.78:0/4231643581 >> v2:172.21.15.187:3300/0 conn(0x7fd8d80b3f20 0x7fd8d80d1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:11:54.954 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:54.947+0000 7fd8d77fe640 1 --2- 172.21.15.78:0/4231643581 >> v2:172.21.15.78:3300/0 conn(0x7fd8d80cfbe0 0x7fd8d80b5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:11:54.956 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:54.947+0000 7fd8d67fc640 1 -- 172.21.15.78:0/4231643581 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4283436176 0 0) 0x7fd8d80d0bc0 con 0x7fd8d80d3700 2023-12-12T10:11:54.956 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:54.951+0000 7fd8d67fc640 1 -- 172.21.15.78:0/4231643581 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd8c4003530 con 0x7fd8d80d3700 2023-12-12T10:11:54.956 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:54.951+0000 7fd8d67fc640 1 -- 172.21.15.78:0/4231643581 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3755271598 0 0) 0x7fd8c4003530 con 0x7fd8d80d3700 2023-12-12T10:11:54.956 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:54.951+0000 7fd8d67fc640 1 -- 172.21.15.78:0/4231643581 >> v2:172.21.15.187:3300/0 conn(0x7fd8d80b3f20 msgr2=0x7fd8d80d1330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:11:54.956 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:54.951+0000 7fd8d67fc640 1 --2- 172.21.15.78:0/4231643581 >> v2:172.21.15.187:3300/0 conn(0x7fd8d80b3f20 0x7fd8d80d1330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:11:54.956 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:54.951+0000 7fd8d67fc640 1 -- 172.21.15.78:0/4231643581 >> v2:172.21.15.78:3300/0 conn(0x7fd8d80cfbe0 msgr2=0x7fd8d80b5e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:11:54.956 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:54.951+0000 7fd8d67fc640 1 --2- 172.21.15.78:0/4231643581 >> v2:172.21.15.78:3300/0 conn(0x7fd8d80cfbe0 0x7fd8d80b5e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:11:54.956 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:54.951+0000 7fd8d67fc640 1 -- 172.21.15.78:0/4231643581 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8d80ce9e0 con 0x7fd8d80d3700 2023-12-12T10:11:54.956 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:54.951+0000 7fd8d67fc640 1 -- 172.21.15.78:0/4231643581 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 465499599 0 0) 0x7fd8c8001680 con 0x7fd8d80d3700 2023-12-12T10:11:54.956 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:54.951+0000 7fd8d67fc640 1 -- 172.21.15.78:0/4231643581 >> v1:172.21.15.78:6789/0 conn(0x7fd8d80d3700 legacy=0x7fd8d8160360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:11:54.957 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:54.951+0000 7fd8d67fc640 1 --2- 172.21.15.78:0/4231643581 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd8c4003980 0x7fd8c4003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:11:54.957 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:54.951+0000 7fd8d67fc640 1 --2- 172.21.15.78:0/4231643581 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd8c40047d0 0x7fd8c4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:11:54.957 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:54.951+0000 7fd8d67fc640 1 --2- 172.21.15.78:0/4231643581 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8c4005190 0x7fd8c40141a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:11:54.957 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:54.951+0000 7fd8d67fc640 1 -- 172.21.15.78:0/4231643581 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d80b6380 con 0x7fd8c4005190 2023-12-12T10:11:54.957 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:54.951+0000 7fd8d67fc640 1 -- 172.21.15.78:0/4231643581 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d80ce700 con 0x7fd8c4003980 2023-12-12T10:11:54.957 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:54.951+0000 7fd8d67fc640 1 -- 172.21.15.78:0/4231643581 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c4014870 con 0x7fd8c40047d0 2023-12-12T10:11:54.957 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:54.951+0000 7fd8d7fff640 1 --2- 172.21.15.78:0/4231643581 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8c4005190 0x7fd8c40141a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:11:54.957 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:54.951+0000 7fd8d77fe640 1 --2- 172.21.15.78:0/4231643581 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd8c4003980 0x7fd8c4003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:11:54.958 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:54.951+0000 7fd8d6ffd640 1 --2- 172.21.15.78:0/4231643581 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd8c40047d0 0x7fd8c4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:11:54.958 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:54.951+0000 7fd8d7fff640 1 -- 172.21.15.78:0/4231643581 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd8c40047d0 msgr2=0x7fd8c4004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:11:54.958 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:54.951+0000 7fd8d7fff640 1 --2- 172.21.15.78:0/4231643581 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd8c40047d0 0x7fd8c4004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:11:54.958 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:54.951+0000 7fd8d7fff640 1 -- 172.21.15.78:0/4231643581 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd8c4003980 msgr2=0x7fd8c4003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:11:54.958 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:54.951+0000 7fd8d7fff640 1 --2- 172.21.15.78:0/4231643581 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd8c4003980 0x7fd8c4003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:11:54.958 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:54.951+0000 7fd8d7fff640 1 -- 172.21.15.78:0/4231643581 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8d80ce9e0 con 0x7fd8c4005190 2023-12-12T10:11:54.958 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:54.951+0000 7fd8d6ffd640 1 --2- 172.21.15.78:0/4231643581 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd8c40047d0 0x7fd8c4004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T10:11:54.960 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:54.955+0000 7fd8d7fff640 1 -- 172.21.15.78:0/4231643581 reap_dead start 2023-12-12T10:11:54.961 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:54.955+0000 7fd8d7fff640 1 --2- 172.21.15.78:0/4231643581 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8c4005190 0x7fd8c40141a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd8d0009fc0 tx=0x7fd8d001cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=912e8cd84989e08c server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:11:54.961 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:54.955+0000 7fd8d67fc640 1 -- 172.21.15.78:0/4231643581 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8d00a5c60 con 0x7fd8c4005190 2023-12-12T10:11:54.961 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:54.955+0000 7fd8d67fc640 1 -- 172.21.15.78:0/4231643581 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8d000f040 con 0x7fd8c4005190 2023-12-12T10:11:54.961 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:54.955+0000 7fd8d67fc640 1 -- 172.21.15.78:0/4231643581 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8d00039a0 con 0x7fd8c4005190 2023-12-12T10:11:54.961 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:54.955+0000 7fd8ddd0f640 1 -- 172.21.15.78:0/4231643581 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8c4005190 msgr2=0x7fd8c40141a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:11:54.962 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:54.955+0000 7fd8ddd0f640 1 --2- 172.21.15.78:0/4231643581 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8c4005190 0x7fd8c40141a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd8d0009fc0 tx=0x7fd8d001cc70 comp rx=0 tx=0).stop 2023-12-12T10:11:54.963 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:54.959+0000 7fd8ddd0f640 1 -- 172.21.15.78:0/4231643581 shutdown_connections 2023-12-12T10:11:54.963 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:54.959+0000 7fd8ddd0f640 1 --2- 172.21.15.78:0/4231643581 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8c4005190 0x7fd8c40141a0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:11:54.963 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:54.959+0000 7fd8ddd0f640 1 -- 172.21.15.78:0/4231643581 >> 172.21.15.78:0/4231643581 conn(0x7fd8d809c2c0 msgr2=0x7fd8d80d2ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:11:54.963 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:54.959+0000 7fd8ddd0f640 1 -- 172.21.15.78:0/4231643581 shutdown_connections 2023-12-12T10:11:54.965 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:54.959+0000 7fd8ddd0f640 1 -- 172.21.15.78:0/4231643581 wait complete. 2023-12-12T10:11:54.967 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:54.963+0000 7fd8ddd0f640 1 Processor -- start 2023-12-12T10:11:54.968 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:54.963+0000 7fd8ddd0f640 1 -- start start 2023-12-12T10:11:54.970 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:54.963+0000 7fd8ddd0f640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd8c4005190 0x7fd8d80b7460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:11:54.971 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:54.967+0000 7fd8ddd0f640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd8d815acf0 0x7fd8d8153e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:11:54.972 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:54.967+0000 7fd8ddd0f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8d8158650 0x7fd8d8158ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:11:54.972 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:54.967+0000 7fd8ddd0f640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d80cae50 con 0x7fd8d8158650 2023-12-12T10:11:54.972 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:54.967+0000 7fd8ddd0f640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d81f1a30 con 0x7fd8d815acf0 2023-12-12T10:11:54.972 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:54.967+0000 7fd8ddd0f640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8d8159010 con 0x7fd8c4005190 2023-12-12T10:11:54.973 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:54.967+0000 7fd8d6ffd640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd8d815acf0 0x7fd8d8153e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:11:54.973 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:54.967+0000 7fd8d77fe640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd8c4005190 0x7fd8d80b7460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:11:54.974 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:54.967+0000 7fd8d77fe640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd8c4005190 0x7fd8d80b7460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.78:60922/0 (socket says 172.21.15.78:60922) 2023-12-12T10:11:54.974 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:54.967+0000 7fd8d77fe640 1 -- 172.21.15.78:0/2510909229 learned_addr learned my addr 172.21.15.78:0/2510909229 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:11:54.974 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:54.967+0000 7fd8d7fff640 1 --2- 172.21.15.78:0/2510909229 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8d8158650 0x7fd8d8158ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:11:54.974 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:54.967+0000 7fd8d6ffd640 1 -- 172.21.15.78:0/2510909229 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd8c4005190 msgr2=0x7fd8d80b7460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:11:54.974 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:54.967+0000 7fd8d6ffd640 1 --2- 172.21.15.78:0/2510909229 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd8c4005190 0x7fd8d80b7460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:11:54.975 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:54.967+0000 7fd8d6ffd640 1 -- 172.21.15.78:0/2510909229 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8d8158650 msgr2=0x7fd8d8158ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:11:54.975 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:54.967+0000 7fd8d6ffd640 1 --2- 172.21.15.78:0/2510909229 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8d8158650 0x7fd8d8158ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:11:54.975 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:54.967+0000 7fd8d6ffd640 1 -- 172.21.15.78:0/2510909229 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8d8154350 con 0x7fd8d815acf0 2023-12-12T10:11:54.975 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:54.971+0000 7fd8d6ffd640 1 --2- 172.21.15.78:0/2510909229 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd8d815acf0 0x7fd8d8153e10 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fd8c8000c10 tx=0x7fd8c800dc50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:11:54.975 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:54.971+0000 7fd8cffff640 1 -- 172.21.15.78:0/2510909229 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8c80074e0 con 0x7fd8d815acf0 2023-12-12T10:11:54.976 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:54.971+0000 7fd8cffff640 1 -- 172.21.15.78:0/2510909229 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8c8007640 con 0x7fd8d815acf0 2023-12-12T10:11:54.976 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:54.971+0000 7fd8cffff640 1 -- 172.21.15.78:0/2510909229 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8c8004a10 con 0x7fd8d815acf0 2023-12-12T10:11:54.976 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:54.971+0000 7fd8ddd0f640 1 -- 172.21.15.78:0/2510909229 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8d80b7a40 con 0x7fd8d815acf0 2023-12-12T10:11:54.976 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:54.971+0000 7fd8ddd0f640 1 -- 172.21.15.78:0/2510909229 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8d80b8000 con 0x7fd8d815acf0 2023-12-12T10:11:54.980 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:54.975+0000 7fd8cffff640 1 -- 172.21.15.78:0/2510909229 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 4) v1 ==== 85796+0+0 (secure 0 0 0) 0x7fd8c8004b70 con 0x7fd8d815acf0 2023-12-12T10:11:54.981 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:54.975+0000 7fd8ddd0f640 1 -- 172.21.15.78:0/2510909229 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8d80caf90 con 0x7fd8d815acf0 2023-12-12T10:11:54.982 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:54.975+0000 7fd8cffff640 1 --2- 172.21.15.78:0/2510909229 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fd8b8066430 0x7fd8b80688f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:11:54.982 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:54.975+0000 7fd8cffff640 1 -- 172.21.15.78:0/2510909229 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2231+0+0 (secure 0 0 0) 0x7fd8c8082be0 con 0x7fd8d815acf0 2023-12-12T10:11:54.983 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:54.979+0000 7fd8d77fe640 1 --2- 172.21.15.78:0/2510909229 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fd8b8066430 0x7fd8b80688f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:11:54.984 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:54.979+0000 7fd8d77fe640 1 --2- 172.21.15.78:0/2510909229 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fd8b8066430 0x7fd8b80688f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fd8c0009ab0 tx=0x7fd8c0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:11:54.999 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:54.991+0000 7fd8cffff640 1 -- 172.21.15.78:0/2510909229 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd8d80caf90 con 0x7fd8d815acf0 2023-12-12T10:11:55.231 INFO:tasks.ceph.osd.4.smithi187.stderr:2023-12-12T10:11:55.224+0000 7fcf5eeec640 -1 osd.4 0 waiting for initial osdmap 2023-12-12T10:11:55.268 INFO:tasks.ceph.osd.4.smithi187.stderr:2023-12-12T10:11:55.260+0000 7fcf56515640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-12T10:11:55.334 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:55.327+0000 7fd8ddd0f640 1 -- 172.21.15.78:0/2510909229 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd8d80caf90 con 0x7fd8d815acf0 2023-12-12T10:11:55.342 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:55.339+0000 7fd8cffff640 1 -- 172.21.15.78:0/2510909229 <== mon.1 v2:172.21.15.187:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fd8d80caf90 con 0x7fd8d815acf0 2023-12-12T10:11:55.344 INFO:teuthology.misc.health.smithi078.stdout: 2023-12-12T10:11:55.344 INFO:teuthology.misc.health.smithi078.stdout:{"epoch":12,"fsid":"fc81937c-bd26-483c-952b-d1324fcb0c9e","created":"2023-12-12T10:11:44.020214+0000","modified":"2023-12-12T10:11:52.995373+0000","last_up_change":"0.000000","last_in_change":"2023-12-12T10:11:46.553610+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"22dfdedf-5f6c-4b20-9f6c-30517a1db70a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"be34a7f3-a69a-462e-9ddf-5e537448dba2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"55b381de-5f56-4b14-80f7-e6e41e084a13","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"d7682de1-25cb-4cec-869f-8851c28b0e6d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"8279815a-d6c7-4199-871e-d28971b9dc07","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"0a714c65-f8ce-4340-968f-11a799677ef3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"d0bba9ab-f7ee-449e-8999-1c0cf7e6d53c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"efe5e0d9-2f87-4889-a27a-e2a95a632302","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T10:11:55.348 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:55.343+0000 7fd8ddd0f640 1 -- 172.21.15.78:0/2510909229 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fd8b8066430 msgr2=0x7fd8b80688f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:11:55.349 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:55.343+0000 7fd8ddd0f640 1 --2- 172.21.15.78:0/2510909229 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fd8b8066430 0x7fd8b80688f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fd8c0009ab0 tx=0x7fd8c0008040 comp rx=0 tx=0).stop 2023-12-12T10:11:55.349 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:55.343+0000 7fd8ddd0f640 1 -- 172.21.15.78:0/2510909229 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd8d815acf0 msgr2=0x7fd8d8153e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:11:55.349 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:55.343+0000 7fd8ddd0f640 1 --2- 172.21.15.78:0/2510909229 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd8d815acf0 0x7fd8d8153e10 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fd8c8000c10 tx=0x7fd8c800dc50 comp rx=0 tx=0).stop 2023-12-12T10:11:55.349 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:55.343+0000 7fd8ddd0f640 1 -- 172.21.15.78:0/2510909229 shutdown_connections 2023-12-12T10:11:55.349 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:55.343+0000 7fd8ddd0f640 1 --2- 172.21.15.78:0/2510909229 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fd8b8066430 0x7fd8b80688f0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:11:55.349 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:55.343+0000 7fd8ddd0f640 1 --2- 172.21.15.78:0/2510909229 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8d8158650 0x7fd8d8158ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:11:55.349 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:55.343+0000 7fd8ddd0f640 1 --2- 172.21.15.78:0/2510909229 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd8d815acf0 0x7fd8d8153e10 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:11:55.349 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:55.343+0000 7fd8ddd0f640 1 --2- 172.21.15.78:0/2510909229 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd8c4005190 0x7fd8d80b7460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:11:55.349 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:55.343+0000 7fd8ddd0f640 1 -- 172.21.15.78:0/2510909229 >> 172.21.15.78:0/2510909229 conn(0x7fd8d809c2c0 msgr2=0x7fd8d806b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:11:55.350 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:55.343+0000 7fd8ddd0f640 1 -- 172.21.15.78:0/2510909229 shutdown_connections 2023-12-12T10:11:55.350 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:11:55.343+0000 7fd8ddd0f640 1 -- 172.21.15.78:0/2510909229 wait complete. 2023-12-12T10:11:55.375 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-12-12T10:11:55.429 INFO:tasks.ceph.osd.6.smithi187.stderr:2023-12-12T10:11:55.420+0000 7fb91681d640 -1 osd.6 0 waiting for initial osdmap 2023-12-12T10:11:55.464 INFO:tasks.ceph.osd.6.smithi187.stderr:2023-12-12T10:11:55.456+0000 7fb90e658640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-12T10:11:55.486 INFO:tasks.ceph.osd.7.smithi187.stderr:2023-12-12T10:11:55.480+0000 7f9c735b3640 -1 osd.7 0 waiting for initial osdmap 2023-12-12T10:11:55.492 INFO:tasks.ceph.osd.5.smithi187.stderr:2023-12-12T10:11:55.484+0000 7f363e30e640 -1 osd.5 0 waiting for initial osdmap 2023-12-12T10:11:55.511 INFO:tasks.ceph.osd.5.smithi187.stderr:2023-12-12T10:11:55.504+0000 7f3635937640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-12T10:11:55.511 INFO:tasks.ceph.osd.7.smithi187.stderr:2023-12-12T10:11:55.504+0000 7f9c6b3ee640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-12T10:11:55.579 INFO:tasks.ceph.osd.2.smithi078.stderr:2023-12-12T10:11:55.575+0000 7efffb41b640 -1 osd.2 0 waiting for initial osdmap 2023-12-12T10:11:55.591 INFO:tasks.ceph.osd.3.smithi078.stderr:2023-12-12T10:11:55.587+0000 7f238b6ae640 -1 osd.3 0 waiting for initial osdmap 2023-12-12T10:11:55.599 INFO:tasks.ceph.osd.1.smithi078.stderr:2023-12-12T10:11:55.591+0000 7fda07c61640 -1 osd.1 0 waiting for initial osdmap 2023-12-12T10:11:55.611 INFO:tasks.ceph.osd.2.smithi078.stderr:2023-12-12T10:11:55.607+0000 7efff3256640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-12T10:11:55.623 INFO:tasks.ceph.osd.1.smithi078.stderr:2023-12-12T10:11:55.619+0000 7fd9ffa9c640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-12T10:11:55.628 INFO:tasks.ceph.osd.0.smithi078.stderr:2023-12-12T10:11:55.623+0000 7f72677b2640 -1 osd.0 0 waiting for initial osdmap 2023-12-12T10:11:55.635 INFO:tasks.ceph.osd.3.smithi078.stderr:2023-12-12T10:11:55.631+0000 7f23834e9640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-12T10:11:55.668 INFO:tasks.ceph.osd.0.smithi078.stderr:2023-12-12T10:11:55.663+0000 7f725eddb640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-12T10:12:02.182 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-12-12T10:12:02.318 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:12:02.315+0000 7fa64359e640 1 Processor -- start 2023-12-12T10:12:02.319 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:12:02.315+0000 7fa64359e640 1 -- start start 2023-12-12T10:12:02.320 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:12:02.315+0000 7fa64359e640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fa6440d1ab0 0x7fa6440d38e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:02.320 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:12:02.315+0000 7fa64359e640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa64415d660 con 0x7fa64415d280 2023-12-12T10:12:02.320 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:12:02.315+0000 7fa64359e640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6440ce650 con 0x7fa6440ceae0 2023-12-12T10:12:02.320 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:12:02.315+0000 7fa64359e640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6440cdd20 con 0x7fa6440d1ab0 2023-12-12T10:12:02.320 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:12:02.315+0000 7fa64259c640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fa64415d280 0x7fa6440d13a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:44424/0 (socket says 172.21.15.78:44424) 2023-12-12T10:12:02.320 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:12:02.315+0000 7fa64259c640 1 -- 172.21.15.78:0/3583113227 learned_addr learned my addr 172.21.15.78:0/3583113227 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-12-12T10:12:02.322 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:12:02.315+0000 7fa641d9b640 1 --2- 172.21.15.78:0/3583113227 >> v2:172.21.15.187:3300/0 conn(0x7fa6440d1ab0 0x7fa6440d38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:02.322 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:12:02.315+0000 7fa64159a640 1 -- 172.21.15.78:0/3583113227 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2173223951 0 0) 0x7fa64415d660 con 0x7fa64415d280 2023-12-12T10:12:02.322 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:12:02.315+0000 7fa64159a640 1 -- 172.21.15.78:0/3583113227 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa62c003530 con 0x7fa64415d280 2023-12-12T10:12:02.322 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:12:02.315+0000 7fa64159a640 1 -- 172.21.15.78:0/3583113227 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3667300391 0 0) 0x7fa6440ce650 con 0x7fa6440ceae0 2023-12-12T10:12:02.322 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:12:02.315+0000 7fa64159a640 1 -- 172.21.15.78:0/3583113227 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa64415d660 con 0x7fa6440ceae0 2023-12-12T10:12:02.322 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:12:02.315+0000 7fa64159a640 1 -- 172.21.15.78:0/3583113227 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4076632904 0 0) 0x7fa62c003530 con 0x7fa64415d280 2023-12-12T10:12:02.322 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:12:02.315+0000 7fa64159a640 1 -- 172.21.15.78:0/3583113227 >> v2:172.21.15.187:3300/0 conn(0x7fa6440d1ab0 msgr2=0x7fa6440d38e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:02.323 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:12:02.315+0000 7fa64159a640 1 --2- 172.21.15.78:0/3583113227 >> v2:172.21.15.187:3300/0 conn(0x7fa6440d1ab0 0x7fa6440d38e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:02.323 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:12:02.315+0000 7fa64159a640 1 -- 172.21.15.78:0/3583113227 >> v1:172.21.15.187:6789/0 conn(0x7fa6440ceae0 legacy=0x7fa6440b2280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:02.323 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:12:02.315+0000 7fa64159a640 1 -- 172.21.15.78:0/3583113227 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6440ce000 con 0x7fa64415d280 2023-12-12T10:12:02.323 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:12:02.315+0000 7fa64159a640 1 -- 172.21.15.78:0/3583113227 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 465499599 0 0) 0x7fa634001680 con 0x7fa64415d280 2023-12-12T10:12:02.323 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:12:02.315+0000 7fa64159a640 1 -- 172.21.15.78:0/3583113227 >> v1:172.21.15.78:6789/0 conn(0x7fa64415d280 legacy=0x7fa6440d13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:02.323 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:12:02.315+0000 7fa64159a640 1 --2- 172.21.15.78:0/3583113227 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa62c003b10 0x7fa62c003f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:02.323 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:12:02.315+0000 7fa64159a640 1 --2- 172.21.15.78:0/3583113227 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa62c0047d0 0x7fa62c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:02.323 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:12:02.315+0000 7fa64159a640 1 --2- 172.21.15.78:0/3583113227 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa62c005190 0x7fa62c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:02.323 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:12:02.315+0000 7fa64159a640 1 -- 172.21.15.78:0/3583113227 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6440cdd20 con 0x7fa62c0047d0 2023-12-12T10:12:02.323 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:12:02.315+0000 7fa64159a640 1 -- 172.21.15.78:0/3583113227 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa62c00bf80 con 0x7fa62c003b10 2023-12-12T10:12:02.323 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:12:02.315+0000 7fa64159a640 1 -- 172.21.15.78:0/3583113227 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa62c00c140 con 0x7fa62c005190 2023-12-12T10:12:02.323 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:12:02.315+0000 7fa641d9b640 1 --2- 172.21.15.78:0/3583113227 >> v2:172.21.15.187:3300/0 conn(0x7fa6440d1ab0 0x7fa6440d38e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-12T10:12:02.323 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:12:02.315+0000 7fa64259c640 1 --2- 172.21.15.78:0/3583113227 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa62c003b10 0x7fa62c003f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:02.323 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:12:02.315+0000 7fa641d9b640 1 --2- 172.21.15.78:0/3583113227 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa62c0047d0 0x7fa62c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:02.324 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:12:02.315+0000 7fa642d9d640 1 --2- 172.21.15.78:0/3583113227 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa62c005190 0x7fa62c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:02.324 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:12:02.315+0000 7fa641d9b640 1 -- 172.21.15.78:0/3583113227 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa62c005190 msgr2=0x7fa62c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:02.324 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:12:02.315+0000 7fa641d9b640 1 --2- 172.21.15.78:0/3583113227 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa62c005190 0x7fa62c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:02.324 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:12:02.315+0000 7fa641d9b640 1 -- 172.21.15.78:0/3583113227 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa62c003b10 msgr2=0x7fa62c003f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:02.324 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:12:02.315+0000 7fa641d9b640 1 --2- 172.21.15.78:0/3583113227 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa62c003b10 0x7fa62c003f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:02.324 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:12:02.315+0000 7fa641d9b640 1 -- 172.21.15.78:0/3583113227 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa62c003530 con 0x7fa62c0047d0 2023-12-12T10:12:02.324 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:12:02.315+0000 7fa642d9d640 1 -- 172.21.15.78:0/3583113227 reap_dead start 2023-12-12T10:12:02.324 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:12:02.319+0000 7fa641d9b640 1 --2- 172.21.15.78:0/3583113227 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa62c0047d0 0x7fa62c004c50 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa638009c60 tx=0x7fa63801cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66c1ca645e975e8d server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:02.325 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:12:02.319+0000 7fa64159a640 1 -- 172.21.15.78:0/3583113227 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa638004020 con 0x7fa62c0047d0 2023-12-12T10:12:02.325 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:12:02.319+0000 7fa64159a640 1 -- 172.21.15.78:0/3583113227 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa638004180 con 0x7fa62c0047d0 2023-12-12T10:12:02.325 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:12:02.319+0000 7fa64159a640 1 -- 172.21.15.78:0/3583113227 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6380a5720 con 0x7fa62c0047d0 2023-12-12T10:12:02.326 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:12:02.319+0000 7fa64359e640 1 -- 172.21.15.78:0/3583113227 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa62c0047d0 msgr2=0x7fa62c004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:02.326 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:12:02.319+0000 7fa64359e640 1 --2- 172.21.15.78:0/3583113227 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa62c0047d0 0x7fa62c004c50 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa638009c60 tx=0x7fa63801cb70 comp rx=0 tx=0).stop 2023-12-12T10:12:02.326 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:12:02.319+0000 7fa64359e640 1 -- 172.21.15.78:0/3583113227 shutdown_connections 2023-12-12T10:12:02.326 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:12:02.319+0000 7fa64359e640 1 --2- 172.21.15.78:0/3583113227 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa62c0047d0 0x7fa62c004c50 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:02.326 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:12:02.319+0000 7fa64359e640 1 -- 172.21.15.78:0/3583113227 >> 172.21.15.78:0/3583113227 conn(0x7fa6440d2dc0 msgr2=0x7fa6440d31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:02.326 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:12:02.319+0000 7fa64359e640 1 -- 172.21.15.78:0/3583113227 shutdown_connections 2023-12-12T10:12:02.326 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:12:02.319+0000 7fa64359e640 1 -- 172.21.15.78:0/3583113227 wait complete. 2023-12-12T10:12:02.331 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:12:02.323+0000 7fa64359e640 1 Processor -- start 2023-12-12T10:12:02.331 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:12:02.323+0000 7fa64359e640 1 -- start start 2023-12-12T10:12:02.331 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:12:02.323+0000 7fa64359e640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa62c0047d0 0x7fa6440c5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:02.331 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:12:02.323+0000 7fa64359e640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa6441f32d0 0x7fa6440c8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:02.332 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:12:02.323+0000 7fa64359e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa6441f3750 0x7fa6440c8fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:02.332 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:12:02.323+0000 7fa64359e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa644147ea0 con 0x7fa6441f3750 2023-12-12T10:12:02.332 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:12:02.323+0000 7fa64359e640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6440c5eb0 con 0x7fa6441f32d0 2023-12-12T10:12:02.332 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:12:02.323+0000 7fa64359e640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa644148cc0 con 0x7fa62c0047d0 2023-12-12T10:12:02.332 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:12:02.323+0000 7fa642d9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa6441f3750 0x7fa6440c8fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:02.332 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:12:02.323+0000 7fa642d9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa6441f3750 0x7fa6440c8fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54572/0 (socket says 172.21.15.78:54572) 2023-12-12T10:12:02.332 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:12:02.323+0000 7fa642d9d640 1 -- 172.21.15.78:0/2178708923 learned_addr learned my addr 172.21.15.78:0/2178708923 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:02.332 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:12:02.323+0000 7fa64259c640 1 --2- 172.21.15.78:0/2178708923 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa62c0047d0 0x7fa6440c5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:02.333 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:12:02.323+0000 7fa641d9b640 1 --2- 172.21.15.78:0/2178708923 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa6441f32d0 0x7fa6440c8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:02.333 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:12:02.323+0000 7fa642d9d640 1 -- 172.21.15.78:0/2178708923 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa62c0047d0 msgr2=0x7fa6440c5970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:02.333 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:12:02.323+0000 7fa642d9d640 1 --2- 172.21.15.78:0/2178708923 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa62c0047d0 0x7fa6440c5970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:02.333 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:12:02.323+0000 7fa642d9d640 1 -- 172.21.15.78:0/2178708923 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa6441f32d0 msgr2=0x7fa6440c8aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:02.333 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:12:02.323+0000 7fa642d9d640 1 --2- 172.21.15.78:0/2178708923 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa6441f32d0 0x7fa6440c8aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:02.333 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:12:02.323+0000 7fa642d9d640 1 -- 172.21.15.78:0/2178708923 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6441480b0 con 0x7fa6441f3750 2023-12-12T10:12:02.333 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:12:02.323+0000 7fa641d9b640 1 --2- 172.21.15.78:0/2178708923 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa6441f32d0 0x7fa6440c8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T10:12:02.333 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:12:02.323+0000 7fa642d9d640 1 --2- 172.21.15.78:0/2178708923 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa6441f3750 0x7fa6440c8fe0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa6440d1150 tx=0x7fa63c00ff70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:02.333 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:12:02.323+0000 7fa632ffd640 1 -- 172.21.15.78:0/2178708923 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa63c006d70 con 0x7fa6441f3750 2023-12-12T10:12:02.333 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:12:02.323+0000 7fa632ffd640 1 -- 172.21.15.78:0/2178708923 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa63c003980 con 0x7fa6441f3750 2023-12-12T10:12:02.333 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:12:02.323+0000 7fa632ffd640 1 -- 172.21.15.78:0/2178708923 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa63c003d30 con 0x7fa6441f3750 2023-12-12T10:12:02.333 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:12:02.323+0000 7fa64359e640 1 -- 172.21.15.78:0/2178708923 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa644148390 con 0x7fa6441f3750 2023-12-12T10:12:02.333 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:12:02.327+0000 7fa64359e640 1 -- 172.21.15.78:0/2178708923 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa644148950 con 0x7fa6441f3750 2023-12-12T10:12:02.334 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:12:02.327+0000 7fa64359e640 1 -- 172.21.15.78:0/2178708923 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6440745a0 con 0x7fa6441f3750 2023-12-12T10:12:02.334 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:12:02.327+0000 7fa632ffd640 1 -- 172.21.15.78:0/2178708923 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa63c00d770 con 0x7fa6441f3750 2023-12-12T10:12:02.334 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:12:02.327+0000 7fa632ffd640 1 --2- 172.21.15.78:0/2178708923 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fa6240664a0 0x7fa624068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:02.335 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:12:02.327+0000 7fa632ffd640 1 -- 172.21.15.78:0/2178708923 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa63c082cd0 con 0x7fa6441f3750 2023-12-12T10:12:02.335 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:12:02.327+0000 7fa64259c640 1 --2- 172.21.15.78:0/2178708923 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fa6240664a0 0x7fa624068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:02.335 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:12:02.331+0000 7fa64259c640 1 --2- 172.21.15.78:0/2178708923 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fa6240664a0 0x7fa624068960 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa634007c40 tx=0x7fa634009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:02.338 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:12:02.335+0000 7fa632ffd640 1 -- 172.21.15.78:0/2178708923 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa63c050490 con 0x7fa6441f3750 2023-12-12T10:12:02.495 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:12:02.491+0000 7fa64359e640 1 -- 172.21.15.78:0/2178708923 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa6440d1180 con 0x7fa6441f3750 2023-12-12T10:12:02.496 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:12:02.491+0000 7fa632ffd640 1 -- 172.21.15.78:0/2178708923 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12814 (secure 0 0 0) 0x7fa63c019090 con 0x7fa6441f3750 2023-12-12T10:12:02.496 INFO:teuthology.misc.health.smithi078.stdout: 2023-12-12T10:12:02.496 INFO:teuthology.misc.health.smithi078.stdout:{"epoch":16,"fsid":"fc81937c-bd26-483c-952b-d1324fcb0c9e","created":"2023-12-12T10:11:44.020214+0000","modified":"2023-12-12T10:11:59.304703+0000","last_up_change":"2023-12-12T10:11:56.278318+0000","last_in_change":"2023-12-12T10:11:46.553610+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T10:11:57.053584+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"22dfdedf-5f6c-4b20-9f6c-30517a1db70a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6809","nonce":3345683600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6811","nonce":3345683600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6815","nonce":3345683600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6813","nonce":3345683600}]},"public_addr":"172.21.15.78:6809/3345683600","cluster_addr":"172.21.15.78:6811/3345683600","heartbeat_back_addr":"172.21.15.78:6815/3345683600","heartbeat_front_addr":"172.21.15.78:6813/3345683600","state":["exists","up"]},{"osd":1,"uuid":"be34a7f3-a69a-462e-9ddf-5e537448dba2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6801","nonce":962652768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6803","nonce":962652768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6807","nonce":962652768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6805","nonce":962652768}]},"public_addr":"172.21.15.78:6801/962652768","cluster_addr":"172.21.15.78:6803/962652768","heartbeat_back_addr":"172.21.15.78:6807/962652768","heartbeat_front_addr":"172.21.15.78:6805/962652768","state":["exists","up"]},{"osd":2,"uuid":"55b381de-5f56-4b14-80f7-e6e41e084a13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6818","nonce":2910206054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6822","nonce":2910206054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6829","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6831","nonce":2910206054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6826","nonce":2910206054}]},"public_addr":"172.21.15.78:6818/2910206054","cluster_addr":"172.21.15.78:6822/2910206054","heartbeat_back_addr":"172.21.15.78:6831/2910206054","heartbeat_front_addr":"172.21.15.78:6826/2910206054","state":["exists","up"]},{"osd":3,"uuid":"d7682de1-25cb-4cec-869f-8851c28b0e6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6819","nonce":3750796703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6821","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6823","nonce":3750796703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6830","nonce":3750796703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6825","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6827","nonce":3750796703}]},"public_addr":"172.21.15.78:6819/3750796703","cluster_addr":"172.21.15.78:6823/3750796703","heartbeat_back_addr":"172.21.15.78:6830/3750796703","heartbeat_front_addr":"172.21.15.78:6827/3750796703","state":["exists","up"]},{"osd":4,"uuid":"8279815a-d6c7-4199-871e-d28971b9dc07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6809","nonce":2944277204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6811","nonce":2944277204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6815","nonce":2944277204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6813","nonce":2944277204}]},"public_addr":"172.21.15.187:6809/2944277204","cluster_addr":"172.21.15.187:6811/2944277204","heartbeat_back_addr":"172.21.15.187:6815/2944277204","heartbeat_front_addr":"172.21.15.187:6813/2944277204","state":["exists","up"]},{"osd":5,"uuid":"0a714c65-f8ce-4340-968f-11a799677ef3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6801","nonce":185858620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6803","nonce":185858620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6807","nonce":185858620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6805","nonce":185858620}]},"public_addr":"172.21.15.187:6801/185858620","cluster_addr":"172.21.15.187:6803/185858620","heartbeat_back_addr":"172.21.15.187:6807/185858620","heartbeat_front_addr":"172.21.15.187:6805/185858620","state":["exists","up"]},{"osd":6,"uuid":"d0bba9ab-f7ee-449e-8999-1c0cf7e6d53c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6817","nonce":4213392126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6819","nonce":4213392126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6824","nonce":4213392126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6821","nonce":4213392126}]},"public_addr":"172.21.15.187:6817/4213392126","cluster_addr":"172.21.15.187:6819/4213392126","heartbeat_back_addr":"172.21.15.187:6824/4213392126","heartbeat_front_addr":"172.21.15.187:6821/4213392126","state":["exists","up"]},{"osd":7,"uuid":"efe5e0d9-2f87-4889-a27a-e2a95a632302","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6823","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6825","nonce":85774004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6827","nonce":85774004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6831","nonce":85774004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6829","nonce":85774004}]},"public_addr":"172.21.15.187:6825/85774004","cluster_addr":"172.21.15.187:6827/85774004","heartbeat_back_addr":"172.21.15.187:6831/85774004","heartbeat_front_addr":"172.21.15.187:6829/85774004","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.214447+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.448899+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.293107+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.564184+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.175026+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.097717+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.261141+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.287681+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T10:12:02.498 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:12:02.491+0000 7fa64359e640 1 -- 172.21.15.78:0/2178708923 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fa6240664a0 msgr2=0x7fa624068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:02.498 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:12:02.491+0000 7fa64359e640 1 --2- 172.21.15.78:0/2178708923 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fa6240664a0 0x7fa624068960 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa634007c40 tx=0x7fa634009040 comp rx=0 tx=0).stop 2023-12-12T10:12:02.498 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:12:02.491+0000 7fa64359e640 1 -- 172.21.15.78:0/2178708923 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa6441f3750 msgr2=0x7fa6440c8fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:02.498 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:12:02.491+0000 7fa64359e640 1 --2- 172.21.15.78:0/2178708923 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa6441f3750 0x7fa6440c8fe0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa6440d1150 tx=0x7fa63c00ff70 comp rx=0 tx=0).stop 2023-12-12T10:12:02.498 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:12:02.491+0000 7fa64359e640 1 -- 172.21.15.78:0/2178708923 shutdown_connections 2023-12-12T10:12:02.498 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:12:02.491+0000 7fa64359e640 1 --2- 172.21.15.78:0/2178708923 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fa6240664a0 0x7fa624068960 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:02.499 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:12:02.491+0000 7fa64359e640 1 --2- 172.21.15.78:0/2178708923 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa6441f3750 0x7fa6440c8fe0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:02.499 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:12:02.491+0000 7fa64359e640 1 --2- 172.21.15.78:0/2178708923 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa6441f32d0 0x7fa6440c8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:02.499 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:12:02.491+0000 7fa64359e640 1 --2- 172.21.15.78:0/2178708923 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa62c0047d0 0x7fa6440c5970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:02.499 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:12:02.491+0000 7fa64359e640 1 -- 172.21.15.78:0/2178708923 >> 172.21.15.78:0/2178708923 conn(0x7fa6440d2dc0 msgr2=0x7fa64406c720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:02.499 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:12:02.491+0000 7fa64359e640 1 -- 172.21.15.78:0/2178708923 shutdown_connections 2023-12-12T10:12:02.499 INFO:teuthology.misc.health.smithi078.stderr:2023-12-12T10:12:02.491+0000 7fa64359e640 1 -- 172.21.15.78:0/2178708923 wait complete. 2023-12-12T10:12:02.516 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-12-12T10:12:02.516 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-12-12T10:12:02.516 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-12T10:12:02.516 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-12T10:12:02.521 INFO:tasks.ceph.mds.a:Started 2023-12-12T10:12:02.522 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-12T10:12:02.522 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-12T10:12:02.525 INFO:tasks.ceph.mds.c:Started 2023-12-12T10:12:02.525 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-12T10:12:02.525 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-12T10:12:02.530 INFO:tasks.ceph.mds.b:Started 2023-12-12T10:12:02.530 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-12T10:12:02.530 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-12T10:12:02.533 INFO:tasks.ceph.mds.d:Started 2023-12-12T10:12:02.534 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-12-12T10:12:02.536 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T10:12:02.638 INFO:tasks.ceph.mds.b.smithi187.stdout:starting mds.b at 2023-12-12T10:12:02.639 INFO:tasks.ceph.mds.d.smithi187.stdout:starting mds.d at 2023-12-12T10:12:02.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:02.675+0000 7f7898868640 1 Processor -- start 2023-12-12T10:12:02.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:02.675+0000 7f7898868640 1 -- start start 2023-12-12T10:12:02.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:02.675+0000 7f7898868640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f789415d3c0 0x7f78940d3b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:02.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:02.675+0000 7f7898868640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f78940d1cb0 0x7f78940b36e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:02.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:02.675+0000 7f7898868640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78940b3250 con 0x7f78940ce670 2023-12-12T10:12:02.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:02.675+0000 7f7898868640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78940cee50 con 0x7f789415d3c0 2023-12-12T10:12:02.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:02.675+0000 7f7898868640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78940b2920 con 0x7f78940d1cb0 2023-12-12T10:12:02.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:02.675+0000 7f7891d9b640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f78940ce670 0x7f78940d15a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:44430/0 (socket says 172.21.15.78:44430) 2023-12-12T10:12:02.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:02.675+0000 7f7891d9b640 1 -- 172.21.15.78:0/580666412 learned_addr learned my addr 172.21.15.78:0/580666412 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-12-12T10:12:02.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:02.675+0000 7f7892d9d640 1 --2- 172.21.15.78:0/580666412 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f78940d1cb0 0x7f78940b36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:02.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:02.675+0000 7f789259c640 1 --2- 172.21.15.78:0/580666412 >> v2:172.21.15.187:3300/0 conn(0x7f789415d3c0 0x7f78940d3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:02.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:02.675+0000 7f789259c640 1 -- 172.21.15.78:0/580666412 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f78940d1cb0 msgr2=0x7f78940b36e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:02.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:02.675+0000 7f789259c640 1 --2- 172.21.15.78:0/580666412 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f78940d1cb0 0x7f78940b36e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:02.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:02.675+0000 7f789259c640 1 -- 172.21.15.78:0/580666412 >> v1:172.21.15.78:6789/0 conn(0x7f78940ce670 legacy=0x7f78940d15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:02.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:02.675+0000 7f789259c640 1 -- 172.21.15.78:0/580666412 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78940b2c00 con 0x7f789415d3c0 2023-12-12T10:12:02.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:02.679+0000 7f789259c640 1 --2- 172.21.15.78:0/580666412 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f789415d3c0 0x7f78940d3b10 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f78840097c0 tx=0x7f788401ec70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a77095e8834407a6 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:02.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:02.679+0000 7f789159a640 1 -- 172.21.15.78:0/580666412 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78840a8970 con 0x7f789415d3c0 2023-12-12T10:12:02.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:02.679+0000 7f789159a640 1 -- 172.21.15.78:0/580666412 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78840a8ad0 con 0x7f789415d3c0 2023-12-12T10:12:02.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:02.679+0000 7f789159a640 1 -- 172.21.15.78:0/580666412 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78840a8e60 con 0x7f789415d3c0 2023-12-12T10:12:02.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:02.679+0000 7f7898868640 1 -- 172.21.15.78:0/580666412 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f789415d3c0 msgr2=0x7f78940d3b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:02.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:02.679+0000 7f7898868640 1 --2- 172.21.15.78:0/580666412 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f789415d3c0 0x7f78940d3b10 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f78840097c0 tx=0x7f788401ec70 comp rx=0 tx=0).stop 2023-12-12T10:12:02.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:02.679+0000 7f7898868640 1 -- 172.21.15.78:0/580666412 shutdown_connections 2023-12-12T10:12:02.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:02.679+0000 7f7898868640 1 --2- 172.21.15.78:0/580666412 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f78940d1cb0 0x7f78940b36e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:02.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:02.679+0000 7f7898868640 1 --2- 172.21.15.78:0/580666412 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f789415d3c0 0x7f78940d3b10 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:02.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:02.679+0000 7f7898868640 1 -- 172.21.15.78:0/580666412 >> 172.21.15.78:0/580666412 conn(0x7f789409c2a0 msgr2=0x7f78940d2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:02.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:02.679+0000 7f7898868640 1 -- 172.21.15.78:0/580666412 shutdown_connections 2023-12-12T10:12:02.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:02.679+0000 7f7898868640 1 -- 172.21.15.78:0/580666412 wait complete. 2023-12-12T10:12:02.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:02.683+0000 7f7898868640 1 Processor -- start 2023-12-12T10:12:02.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:02.683+0000 7f7898868640 1 -- start start 2023-12-12T10:12:02.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:02.683+0000 7f7898868640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f78940ce670 0x7f7894157620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:02.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:02.683+0000 7f7898868640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f78940d1cb0 0x7f78940b7130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:02.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:02.683+0000 7f7898868640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f789415d3c0 0x7f789415b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:02.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:02.683+0000 7f7898868640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f789415f040 con 0x7f78940ce670 2023-12-12T10:12:02.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:02.683+0000 7f7898868640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7894157b60 con 0x7f78940d1cb0 2023-12-12T10:12:02.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:02.683+0000 7f7898868640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78940b7670 con 0x7f789415d3c0 2023-12-12T10:12:02.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:02.683+0000 7f789259c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f78940ce670 0x7f7894157620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:02.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:02.683+0000 7f789259c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f78940ce670 0x7f7894157620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54586/0 (socket says 172.21.15.78:54586) 2023-12-12T10:12:02.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:02.683+0000 7f789259c640 1 -- 172.21.15.78:0/1607647924 learned_addr learned my addr 172.21.15.78:0/1607647924 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:02.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:02.683+0000 7f7892d9d640 1 --2- 172.21.15.78:0/1607647924 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f789415d3c0 0x7f789415b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:02.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:02.683+0000 7f7891d9b640 1 --2- 172.21.15.78:0/1607647924 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f78940d1cb0 0x7f78940b7130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:02.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:02.683+0000 7f789259c640 1 -- 172.21.15.78:0/1607647924 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f789415d3c0 msgr2=0x7f789415b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:02.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:02.683+0000 7f789259c640 1 --2- 172.21.15.78:0/1607647924 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f789415d3c0 0x7f789415b2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:02.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:02.683+0000 7f789259c640 1 -- 172.21.15.78:0/1607647924 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f78940d1cb0 msgr2=0x7f78940b7130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:02.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:02.683+0000 7f789259c640 1 --2- 172.21.15.78:0/1607647924 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f78940d1cb0 0x7f78940b7130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:02.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:02.683+0000 7f789259c640 1 -- 172.21.15.78:0/1607647924 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7884009420 con 0x7f78940ce670 2023-12-12T10:12:02.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:02.683+0000 7f789259c640 1 --2- 172.21.15.78:0/1607647924 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f78940ce670 0x7f7894157620 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f788401c8a0 tx=0x7f788401ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:02.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:02.767+0000 7f7882ffd640 1 -- 172.21.15.78:0/1607647924 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78840b9630 con 0x7f78940ce670 2023-12-12T10:12:02.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:02.767+0000 7f7882ffd640 1 -- 172.21.15.78:0/1607647924 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78840b97b0 con 0x7f78940ce670 2023-12-12T10:12:02.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:02.767+0000 7f7898868640 1 -- 172.21.15.78:0/1607647924 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78941f6820 con 0x7f78940ce670 2023-12-12T10:12:02.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:02.767+0000 7f7882ffd640 1 -- 172.21.15.78:0/1607647924 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78840b9b60 con 0x7f78940ce670 2023-12-12T10:12:02.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:02.767+0000 7f7898868640 1 -- 172.21.15.78:0/1607647924 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78941f6de0 con 0x7f78940ce670 2023-12-12T10:12:02.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:02.767+0000 7f7898868640 1 -- 172.21.15.78:0/1607647924 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7894067530 con 0x7f78940ce670 2023-12-12T10:12:02.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:02.767+0000 7f7882ffd640 1 -- 172.21.15.78:0/1607647924 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f78840b7040 con 0x7f78940ce670 2023-12-12T10:12:02.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:02.767+0000 7f7882ffd640 1 --2- 172.21.15.78:0/1607647924 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f7874066470 0x7f7874068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:02.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:02.767+0000 7f7882ffd640 1 -- 172.21.15.78:0/1607647924 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7884121af0 con 0x7f78940ce670 2023-12-12T10:12:02.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:02.767+0000 7f7891d9b640 1 --2- 172.21.15.78:0/1607647924 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f7874066470 0x7f7874068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:02.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:02.771+0000 7f7891d9b640 1 --2- 172.21.15.78:0/1607647924 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f7874066470 0x7f7874068930 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f789406cfa0 tx=0x7f7888009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:02.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:02.775+0000 7f7882ffd640 1 -- 172.21.15.78:0/1607647924 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f78840ef360 con 0x7f78940ce670 2023-12-12T10:12:02.931 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:02.927+0000 7f7898868640 1 -- 172.21.15.78:0/1607647924 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f78940d1380 con 0x7f78940ce670 2023-12-12T10:12:02.932 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:02.927+0000 7f7882ffd640 1 -- 172.21.15.78:0/1607647924 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12814 (secure 0 0 0) 0x7f78840f2980 con 0x7f78940ce670 2023-12-12T10:12:02.932 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:12:02.933 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":16,"fsid":"fc81937c-bd26-483c-952b-d1324fcb0c9e","created":"2023-12-12T10:11:44.020214+0000","modified":"2023-12-12T10:11:59.304703+0000","last_up_change":"2023-12-12T10:11:56.278318+0000","last_in_change":"2023-12-12T10:11:46.553610+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T10:11:57.053584+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"22dfdedf-5f6c-4b20-9f6c-30517a1db70a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6809","nonce":3345683600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6811","nonce":3345683600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6815","nonce":3345683600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6813","nonce":3345683600}]},"public_addr":"172.21.15.78:6809/3345683600","cluster_addr":"172.21.15.78:6811/3345683600","heartbeat_back_addr":"172.21.15.78:6815/3345683600","heartbeat_front_addr":"172.21.15.78:6813/3345683600","state":["exists","up"]},{"osd":1,"uuid":"be34a7f3-a69a-462e-9ddf-5e537448dba2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6801","nonce":962652768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6803","nonce":962652768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6807","nonce":962652768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6805","nonce":962652768}]},"public_addr":"172.21.15.78:6801/962652768","cluster_addr":"172.21.15.78:6803/962652768","heartbeat_back_addr":"172.21.15.78:6807/962652768","heartbeat_front_addr":"172.21.15.78:6805/962652768","state":["exists","up"]},{"osd":2,"uuid":"55b381de-5f56-4b14-80f7-e6e41e084a13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6818","nonce":2910206054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6822","nonce":2910206054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6829","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6831","nonce":2910206054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6826","nonce":2910206054}]},"public_addr":"172.21.15.78:6818/2910206054","cluster_addr":"172.21.15.78:6822/2910206054","heartbeat_back_addr":"172.21.15.78:6831/2910206054","heartbeat_front_addr":"172.21.15.78:6826/2910206054","state":["exists","up"]},{"osd":3,"uuid":"d7682de1-25cb-4cec-869f-8851c28b0e6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6819","nonce":3750796703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6821","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6823","nonce":3750796703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6830","nonce":3750796703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6825","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6827","nonce":3750796703}]},"public_addr":"172.21.15.78:6819/3750796703","cluster_addr":"172.21.15.78:6823/3750796703","heartbeat_back_addr":"172.21.15.78:6830/3750796703","heartbeat_front_addr":"172.21.15.78:6827/3750796703","state":["exists","up"]},{"osd":4,"uuid":"8279815a-d6c7-4199-871e-d28971b9dc07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6809","nonce":2944277204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6811","nonce":2944277204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6815","nonce":2944277204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6813","nonce":2944277204}]},"public_addr":"172.21.15.187:6809/2944277204","cluster_addr":"172.21.15.187:6811/2944277204","heartbeat_back_addr":"172.21.15.187:6815/2944277204","heartbeat_front_addr":"172.21.15.187:6813/2944277204","state":["exists","up"]},{"osd":5,"uuid":"0a714c65-f8ce-4340-968f-11a799677ef3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6801","nonce":185858620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6803","nonce":185858620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6807","nonce":185858620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6805","nonce":185858620}]},"public_addr":"172.21.15.187:6801/185858620","cluster_addr":"172.21.15.187:6803/185858620","heartbeat_back_addr":"172.21.15.187:6807/185858620","heartbeat_front_addr":"172.21.15.187:6805/185858620","state":["exists","up"]},{"osd":6,"uuid":"d0bba9ab-f7ee-449e-8999-1c0cf7e6d53c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6817","nonce":4213392126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6819","nonce":4213392126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6824","nonce":4213392126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6821","nonce":4213392126}]},"public_addr":"172.21.15.187:6817/4213392126","cluster_addr":"172.21.15.187:6819/4213392126","heartbeat_back_addr":"172.21.15.187:6824/4213392126","heartbeat_front_addr":"172.21.15.187:6821/4213392126","state":["exists","up"]},{"osd":7,"uuid":"efe5e0d9-2f87-4889-a27a-e2a95a632302","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6823","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6825","nonce":85774004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6827","nonce":85774004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6831","nonce":85774004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6829","nonce":85774004}]},"public_addr":"172.21.15.187:6825/85774004","cluster_addr":"172.21.15.187:6827/85774004","heartbeat_back_addr":"172.21.15.187:6831/85774004","heartbeat_front_addr":"172.21.15.187:6829/85774004","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.214447+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.448899+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.293107+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.564184+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.175026+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.097717+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.261141+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.287681+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T10:12:02.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:02.927+0000 7f7898868640 1 -- 172.21.15.78:0/1607647924 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f7874066470 msgr2=0x7f7874068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:02.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:02.927+0000 7f7898868640 1 --2- 172.21.15.78:0/1607647924 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f7874066470 0x7f7874068930 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f789406cfa0 tx=0x7f7888009040 comp rx=0 tx=0).stop 2023-12-12T10:12:02.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:02.927+0000 7f7898868640 1 -- 172.21.15.78:0/1607647924 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f78940ce670 msgr2=0x7f7894157620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:02.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:02.927+0000 7f7898868640 1 --2- 172.21.15.78:0/1607647924 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f78940ce670 0x7f7894157620 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f788401c8a0 tx=0x7f788401ba10 comp rx=0 tx=0).stop 2023-12-12T10:12:02.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:02.931+0000 7f7898868640 1 -- 172.21.15.78:0/1607647924 shutdown_connections 2023-12-12T10:12:02.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:02.931+0000 7f7898868640 1 --2- 172.21.15.78:0/1607647924 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f7874066470 0x7f7874068930 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:02.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:02.931+0000 7f7898868640 1 --2- 172.21.15.78:0/1607647924 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f789415d3c0 0x7f789415b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:02.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:02.931+0000 7f7898868640 1 --2- 172.21.15.78:0/1607647924 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f78940d1cb0 0x7f78940b7130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:02.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:02.931+0000 7f7898868640 1 --2- 172.21.15.78:0/1607647924 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f78940ce670 0x7f7894157620 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:02.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:02.931+0000 7f7898868640 1 -- 172.21.15.78:0/1607647924 >> 172.21.15.78:0/1607647924 conn(0x7f789409c2a0 msgr2=0x7f78940d15a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:02.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:02.931+0000 7f7898868640 1 -- 172.21.15.78:0/1607647924 shutdown_connections 2023-12-12T10:12:02.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:02.931+0000 7f7898868640 1 -- 172.21.15.78:0/1607647924 wait complete. 2023-12-12T10:12:02.954 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-12T10:11:57.053584+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-12T10:12:02.955 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-12T10:12:03.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.091+0000 7fae83501640 1 Processor -- start 2023-12-12T10:12:03.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.095+0000 7fae83501640 1 -- start start 2023-12-12T10:12:03.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.095+0000 7fae83501640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fae7c143770 0x7fae7c0cdf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:03.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.095+0000 7fae83501640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fae7c071610 0x7fae7c15d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:03.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.095+0000 7fae83501640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae7c070a70 con 0x7fae7c0b1e20 2023-12-12T10:12:03.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.095+0000 7fae83501640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae7c070440 con 0x7fae7c071610 2023-12-12T10:12:03.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.095+0000 7fae83501640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae7c143b50 con 0x7fae7c143770 2023-12-12T10:12:03.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.095+0000 7fae81a9e640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fae7c071610 0x7fae7c15d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:03.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.095+0000 7fae81a9e640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fae7c071610 0x7fae7c15d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54594/0 (socket says 172.21.15.78:54594) 2023-12-12T10:12:03.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.095+0000 7fae81a9e640 1 -- 172.21.15.78:0/1806607975 learned_addr learned my addr 172.21.15.78:0/1806607975 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:03.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.095+0000 7fae8129d640 1 --2- 172.21.15.78:0/1806607975 >> v2:172.21.15.187:3300/0 conn(0x7fae7c143770 0x7fae7c0cdf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:03.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.095+0000 7fae81a9e640 1 -- 172.21.15.78:0/1806607975 >> v2:172.21.15.187:3300/0 conn(0x7fae7c143770 msgr2=0x7fae7c0cdf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:03.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.095+0000 7fae81a9e640 1 --2- 172.21.15.78:0/1806607975 >> v2:172.21.15.187:3300/0 conn(0x7fae7c143770 0x7fae7c0cdf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:03.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.095+0000 7fae81a9e640 1 -- 172.21.15.78:0/1806607975 >> v1:172.21.15.187:6789/0 conn(0x7fae7c0b1e20 legacy=0x7fae7c070f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:03.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.095+0000 7fae81a9e640 1 -- 172.21.15.78:0/1806607975 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae7c0ce620 con 0x7fae7c071610 2023-12-12T10:12:03.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.095+0000 7fae8129d640 1 --2- 172.21.15.78:0/1806607975 >> v2:172.21.15.187:3300/0 conn(0x7fae7c143770 0x7fae7c0cdf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T10:12:03.103 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.099+0000 7fae81a9e640 1 --2- 172.21.15.78:0/1806607975 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae7c071610 0x7fae7c15d910 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fae7c06b500 tx=0x7fae7401c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50e16301b6d1bc7e server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:03.103 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.099+0000 7fae73fff640 1 -- 172.21.15.78:0/1806607975 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae740a5710 con 0x7fae7c071610 2023-12-12T10:12:03.103 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.099+0000 7fae73fff640 1 -- 172.21.15.78:0/1806607975 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae740a5870 con 0x7fae7c071610 2023-12-12T10:12:03.104 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.099+0000 7fae73fff640 1 -- 172.21.15.78:0/1806607975 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae740a5c00 con 0x7fae7c071610 2023-12-12T10:12:03.104 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.099+0000 7fae83501640 1 -- 172.21.15.78:0/1806607975 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae7c071610 msgr2=0x7fae7c15d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:03.104 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.099+0000 7fae83501640 1 --2- 172.21.15.78:0/1806607975 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae7c071610 0x7fae7c15d910 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fae7c06b500 tx=0x7fae7401c940 comp rx=0 tx=0).stop 2023-12-12T10:12:03.105 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.099+0000 7fae83501640 1 -- 172.21.15.78:0/1806607975 shutdown_connections 2023-12-12T10:12:03.105 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.099+0000 7fae83501640 1 --2- 172.21.15.78:0/1806607975 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae7c071610 0x7fae7c15d910 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:03.105 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.099+0000 7fae83501640 1 --2- 172.21.15.78:0/1806607975 >> v2:172.21.15.187:3300/0 conn(0x7fae7c143770 0x7fae7c0cdf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:03.105 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.099+0000 7fae83501640 1 -- 172.21.15.78:0/1806607975 >> 172.21.15.78:0/1806607975 conn(0x7fae7c06a710 msgr2=0x7fae7c06ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:03.105 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.099+0000 7fae83501640 1 -- 172.21.15.78:0/1806607975 shutdown_connections 2023-12-12T10:12:03.105 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.099+0000 7fae83501640 1 -- 172.21.15.78:0/1806607975 wait complete. 2023-12-12T10:12:03.106 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.099+0000 7fae83501640 1 Processor -- start 2023-12-12T10:12:03.106 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.103+0000 7fae83501640 1 -- start start 2023-12-12T10:12:03.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.103+0000 7fae83501640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae7c071610 0x7fae7c1539f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:03.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.103+0000 7fae83501640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fae7c0b1e20 0x7fae7c0adc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:03.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.103+0000 7fae83501640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fae7c143770 0x7fae7c0cd410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:03.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.103+0000 7fae83501640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae7c154280 con 0x7fae7c071610 2023-12-12T10:12:03.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.103+0000 7fae83501640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae7c154560 con 0x7fae7c0b1e20 2023-12-12T10:12:03.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.103+0000 7fae83501640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae7c154840 con 0x7fae7c143770 2023-12-12T10:12:03.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.103+0000 7fae8129d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae7c071610 0x7fae7c1539f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:03.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.103+0000 7fae8129d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae7c071610 0x7fae7c1539f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54604/0 (socket says 172.21.15.78:54604) 2023-12-12T10:12:03.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.103+0000 7fae8129d640 1 -- 172.21.15.78:0/1017774775 learned_addr learned my addr 172.21.15.78:0/1017774775 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:03.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.103+0000 7fae80a9c640 1 --2- 172.21.15.78:0/1017774775 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fae7c0b1e20 0x7fae7c0adc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:03.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.103+0000 7fae81a9e640 1 --2- 172.21.15.78:0/1017774775 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fae7c143770 0x7fae7c0cd410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:03.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.103+0000 7fae8129d640 1 -- 172.21.15.78:0/1017774775 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fae7c143770 msgr2=0x7fae7c0cd410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:03.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.103+0000 7fae8129d640 1 --2- 172.21.15.78:0/1017774775 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fae7c143770 0x7fae7c0cd410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:03.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.103+0000 7fae8129d640 1 -- 172.21.15.78:0/1017774775 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fae7c0b1e20 msgr2=0x7fae7c0adc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:03.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.103+0000 7fae8129d640 1 --2- 172.21.15.78:0/1017774775 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fae7c0b1e20 0x7fae7c0adc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:03.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.103+0000 7fae8129d640 1 -- 172.21.15.78:0/1017774775 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae74009b30 con 0x7fae7c071610 2023-12-12T10:12:03.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.103+0000 7fae8129d640 1 --2- 172.21.15.78:0/1017774775 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae7c071610 0x7fae7c1539f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fae7800d800 tx=0x7fae7800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:03.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.103+0000 7fae71ffb640 1 -- 172.21.15.78:0/1017774775 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae7800b6c0 con 0x7fae7c071610 2023-12-12T10:12:03.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.103+0000 7fae71ffb640 1 -- 172.21.15.78:0/1017774775 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae7800b820 con 0x7fae7c071610 2023-12-12T10:12:03.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.103+0000 7fae71ffb640 1 -- 172.21.15.78:0/1017774775 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae7800bbd0 con 0x7fae7c071610 2023-12-12T10:12:03.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.103+0000 7fae83501640 1 -- 172.21.15.78:0/1017774775 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae7c154b20 con 0x7fae7c071610 2023-12-12T10:12:03.111 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.103+0000 7fae83501640 1 -- 172.21.15.78:0/1017774775 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae7c153f30 con 0x7fae7c071610 2023-12-12T10:12:03.111 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.103+0000 7fae83501640 1 -- 172.21.15.78:0/1017774775 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae7c0671f0 con 0x7fae7c071610 2023-12-12T10:12:03.111 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.107+0000 7fae71ffb640 1 -- 172.21.15.78:0/1017774775 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fae7800bd30 con 0x7fae7c071610 2023-12-12T10:12:03.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.107+0000 7fae71ffb640 1 --2- 172.21.15.78:0/1017774775 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fae60066470 0x7fae60068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:03.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.107+0000 7fae71ffb640 1 -- 172.21.15.78:0/1017774775 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fae78083f80 con 0x7fae7c071610 2023-12-12T10:12:03.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.107+0000 7fae80a9c640 1 --2- 172.21.15.78:0/1017774775 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fae60066470 0x7fae60068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:03.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.107+0000 7fae80a9c640 1 --2- 172.21.15.78:0/1017774775 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fae60066470 0x7fae60068930 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fae7c0b0080 tx=0x7fae6c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:03.116 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.111+0000 7fae71ffb640 1 -- 172.21.15.78:0/1017774775 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fae78051760 con 0x7fae7c071610 2023-12-12T10:12:03.173 INFO:tasks.ceph.mds.a.smithi078.stdout:starting mds.a at 2023-12-12T10:12:03.174 INFO:tasks.ceph.mds.c.smithi078.stdout:starting mds.c at 2023-12-12T10:12:03.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.275+0000 7fae83501640 1 -- 172.21.15.78:0/1017774775 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fae7c067530 con 0x7fae7c071610 2023-12-12T10:12:03.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.275+0000 7fae71ffb640 1 -- 172.21.15.78:0/1017774775 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7fae78054d80 con 0x7fae7c071610 2023-12-12T10:12:03.282 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2023-12-12T10:12:03.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.279+0000 7fae83501640 1 -- 172.21.15.78:0/1017774775 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fae60066470 msgr2=0x7fae60068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:03.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.279+0000 7fae83501640 1 --2- 172.21.15.78:0/1017774775 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fae60066470 0x7fae60068930 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fae7c0b0080 tx=0x7fae6c009040 comp rx=0 tx=0).stop 2023-12-12T10:12:03.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.279+0000 7fae83501640 1 -- 172.21.15.78:0/1017774775 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae7c071610 msgr2=0x7fae7c1539f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:03.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.279+0000 7fae83501640 1 --2- 172.21.15.78:0/1017774775 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae7c071610 0x7fae7c1539f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fae7800d800 tx=0x7fae7800dcc0 comp rx=0 tx=0).stop 2023-12-12T10:12:03.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.279+0000 7fae83501640 1 -- 172.21.15.78:0/1017774775 shutdown_connections 2023-12-12T10:12:03.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.279+0000 7fae83501640 1 --2- 172.21.15.78:0/1017774775 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fae60066470 0x7fae60068930 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:03.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.279+0000 7fae83501640 1 --2- 172.21.15.78:0/1017774775 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fae7c143770 0x7fae7c0cd410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:03.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.279+0000 7fae83501640 1 --2- 172.21.15.78:0/1017774775 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fae7c0b1e20 0x7fae7c0adc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:03.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.279+0000 7fae83501640 1 --2- 172.21.15.78:0/1017774775 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae7c071610 0x7fae7c1539f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:03.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.279+0000 7fae83501640 1 -- 172.21.15.78:0/1017774775 >> 172.21.15.78:0/1017774775 conn(0x7fae7c06a710 msgr2=0x7fae7c0b28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:03.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.279+0000 7fae83501640 1 -- 172.21.15.78:0/1017774775 shutdown_connections 2023-12-12T10:12:03.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.279+0000 7fae83501640 1 -- 172.21.15.78:0/1017774775 wait complete. 2023-12-12T10:12:03.303 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-12T10:12:03.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.435+0000 7fb3c24c9640 1 Processor -- start 2023-12-12T10:12:03.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.435+0000 7fb3c24c9640 1 -- start start 2023-12-12T10:12:03.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.435+0000 7fb3c24c9640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb3bc071bf0 0x7fb3bc072030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:03.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.435+0000 7fb3c24c9640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fb3bc13f550 0x7fb3bc13f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:03.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.435+0000 7fb3c24c9640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3bc0705a0 con 0x7fb3bc13ceb0 2023-12-12T10:12:03.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.435+0000 7fb3c24c9640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3bc140410 con 0x7fb3bc071bf0 2023-12-12T10:12:03.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.435+0000 7fb3c24c9640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3bc0cdc90 con 0x7fb3bc13f550 2023-12-12T10:12:03.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.435+0000 7fb3bb7fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb3bc071bf0 0x7fb3bc072030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:03.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.435+0000 7fb3bb7fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb3bc071bf0 0x7fb3bc072030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54646/0 (socket says 172.21.15.78:54646) 2023-12-12T10:12:03.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.435+0000 7fb3bb7fe640 1 -- 172.21.15.78:0/2137256991 learned_addr learned my addr 172.21.15.78:0/2137256991 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:03.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.435+0000 7fb3c0a66640 1 --2- 172.21.15.78:0/2137256991 >> v2:172.21.15.187:3300/0 conn(0x7fb3bc13f550 0x7fb3bc13f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:03.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.439+0000 7fb3bb7fe640 1 -- 172.21.15.78:0/2137256991 >> v2:172.21.15.187:3300/0 conn(0x7fb3bc13f550 msgr2=0x7fb3bc13f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:03.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.439+0000 7fb3bb7fe640 1 --2- 172.21.15.78:0/2137256991 >> v2:172.21.15.187:3300/0 conn(0x7fb3bc13f550 0x7fb3bc13f9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:03.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.439+0000 7fb3bb7fe640 1 -- 172.21.15.78:0/2137256991 >> v1:172.21.15.187:6789/0 conn(0x7fb3bc13ceb0 legacy=0x7fb3bc13d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:03.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.439+0000 7fb3bb7fe640 1 -- 172.21.15.78:0/2137256991 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3bc13ff00 con 0x7fb3bc071bf0 2023-12-12T10:12:03.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.439+0000 7fb3bb7fe640 1 --2- 172.21.15.78:0/2137256991 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb3bc071bf0 0x7fb3bc072030 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb3bc072d70 tx=0x7fb3b001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0e225685a860c56 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:03.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.439+0000 7fb3baffd640 1 -- 172.21.15.78:0/2137256991 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b00ab600 con 0x7fb3bc071bf0 2023-12-12T10:12:03.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.439+0000 7fb3baffd640 1 -- 172.21.15.78:0/2137256991 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3b00a7050 con 0x7fb3bc071bf0 2023-12-12T10:12:03.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.439+0000 7fb3baffd640 1 -- 172.21.15.78:0/2137256991 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b00ab980 con 0x7fb3bc071bf0 2023-12-12T10:12:03.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.439+0000 7fb3c24c9640 1 -- 172.21.15.78:0/2137256991 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb3bc071bf0 msgr2=0x7fb3bc072030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:03.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.439+0000 7fb3c24c9640 1 --2- 172.21.15.78:0/2137256991 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb3bc071bf0 0x7fb3bc072030 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb3bc072d70 tx=0x7fb3b001c500 comp rx=0 tx=0).stop 2023-12-12T10:12:03.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.439+0000 7fb3c24c9640 1 -- 172.21.15.78:0/2137256991 shutdown_connections 2023-12-12T10:12:03.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.439+0000 7fb3c24c9640 1 --2- 172.21.15.78:0/2137256991 >> v2:172.21.15.187:3300/0 conn(0x7fb3bc13f550 0x7fb3bc13f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:03.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.439+0000 7fb3c24c9640 1 --2- 172.21.15.78:0/2137256991 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb3bc071bf0 0x7fb3bc072030 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:03.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.439+0000 7fb3c24c9640 1 -- 172.21.15.78:0/2137256991 >> 172.21.15.78:0/2137256991 conn(0x7fb3bc06c5d0 msgr2=0x7fb3bc06c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:03.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.443+0000 7fb3c24c9640 1 -- 172.21.15.78:0/2137256991 shutdown_connections 2023-12-12T10:12:03.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.443+0000 7fb3c24c9640 1 -- 172.21.15.78:0/2137256991 wait complete. 2023-12-12T10:12:03.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.443+0000 7fb3c24c9640 1 Processor -- start 2023-12-12T10:12:03.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.443+0000 7fb3c24c9640 1 -- start start 2023-12-12T10:12:03.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.443+0000 7fb3c24c9640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb3bc071bf0 0x7fb3bc0b1b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:03.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.443+0000 7fb3c24c9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb3bc13ceb0 0x7fb3bc1347c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:03.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.443+0000 7fb3c24c9640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb3bc13f550 0x7fb3bc1513b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:03.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.443+0000 7fb3c24c9640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3bc141ad0 con 0x7fb3bc13ceb0 2023-12-12T10:12:03.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.443+0000 7fb3c24c9640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3bc134d00 con 0x7fb3bc13f550 2023-12-12T10:12:03.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.443+0000 7fb3c24c9640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3bc153930 con 0x7fb3bc071bf0 2023-12-12T10:12:03.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.443+0000 7fb3bb7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb3bc13ceb0 0x7fb3bc1347c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:03.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.443+0000 7fb3bb7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb3bc13ceb0 0x7fb3bc1347c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54648/0 (socket says 172.21.15.78:54648) 2023-12-12T10:12:03.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.443+0000 7fb3bb7fe640 1 -- 172.21.15.78:0/3692958310 learned_addr learned my addr 172.21.15.78:0/3692958310 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:03.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.443+0000 7fb3bbfff640 1 --2- 172.21.15.78:0/3692958310 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb3bc071bf0 0x7fb3bc0b1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:03.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.443+0000 7fb3c0a66640 1 --2- 172.21.15.78:0/3692958310 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb3bc13f550 0x7fb3bc1513b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:03.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.443+0000 7fb3bb7fe640 1 -- 172.21.15.78:0/3692958310 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb3bc071bf0 msgr2=0x7fb3bc0b1b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:03.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.443+0000 7fb3bb7fe640 1 --2- 172.21.15.78:0/3692958310 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb3bc071bf0 0x7fb3bc0b1b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:03.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.443+0000 7fb3bb7fe640 1 -- 172.21.15.78:0/3692958310 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb3bc13f550 msgr2=0x7fb3bc1513b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:03.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.443+0000 7fb3bb7fe640 1 --2- 172.21.15.78:0/3692958310 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb3bc13f550 0x7fb3bc1513b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:03.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.443+0000 7fb3bb7fe640 1 -- 172.21.15.78:0/3692958310 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3b00094d0 con 0x7fb3bc13ceb0 2023-12-12T10:12:03.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.443+0000 7fb3bbfff640 1 --2- 172.21.15.78:0/3692958310 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb3bc071bf0 0x7fb3bc0b1b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T10:12:03.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.443+0000 7fb3c0a66640 1 --2- 172.21.15.78:0/3692958310 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb3bc13f550 0x7fb3bc1513b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T10:12:03.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.447+0000 7fb3bb7fe640 1 --2- 172.21.15.78:0/3692958310 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb3bc13ceb0 0x7fb3bc1347c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb3b001a130 tx=0x7fb3b00192a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:03.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.447+0000 7fb3b8ff9640 1 -- 172.21.15.78:0/3692958310 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b00b4420 con 0x7fb3bc13ceb0 2023-12-12T10:12:03.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.447+0000 7fb3b8ff9640 1 -- 172.21.15.78:0/3692958310 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3b00b4580 con 0x7fb3bc13ceb0 2023-12-12T10:12:03.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.447+0000 7fb3b8ff9640 1 -- 172.21.15.78:0/3692958310 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b00b4910 con 0x7fb3bc13ceb0 2023-12-12T10:12:03.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.447+0000 7fb3c24c9640 1 -- 172.21.15.78:0/3692958310 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3bc153c10 con 0x7fb3bc13ceb0 2023-12-12T10:12:03.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.447+0000 7fb3c24c9640 1 -- 172.21.15.78:0/3692958310 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3bc153ef0 con 0x7fb3bc13ceb0 2023-12-12T10:12:03.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.447+0000 7fb3c24c9640 1 -- 172.21.15.78:0/3692958310 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3bc0671f0 con 0x7fb3bc13ceb0 2023-12-12T10:12:03.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.447+0000 7fb3b8ff9640 1 -- 172.21.15.78:0/3692958310 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb3b00b2070 con 0x7fb3bc13ceb0 2023-12-12T10:12:03.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.447+0000 7fb3b8ff9640 1 --2- 172.21.15.78:0/3692958310 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fb3a8066470 0x7fb3a8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:03.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.447+0000 7fb3b8ff9640 1 -- 172.21.15.78:0/3692958310 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb3b011cce0 con 0x7fb3bc13ceb0 2023-12-12T10:12:03.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.447+0000 7fb3bbfff640 1 --2- 172.21.15.78:0/3692958310 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fb3a8066470 0x7fb3a8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:03.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.451+0000 7fb3bbfff640 1 --2- 172.21.15.78:0/3692958310 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fb3a8066470 0x7fb3a8068930 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb3ac000f70 tx=0x7fb3ac009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:03.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.451+0000 7fb3b8ff9640 1 -- 172.21.15.78:0/3692958310 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb3b00ea4a0 con 0x7fb3bc13ceb0 2023-12-12T10:12:03.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.635+0000 7fb3c24c9640 1 -- 172.21.15.78:0/3692958310 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb3bc141c10 con 0x7fb3bc13ceb0 2023-12-12T10:12:03.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.635+0000 7fb3b8ff9640 1 -- 172.21.15.78:0/3692958310 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1327 (secure 0 0 0) 0x7fb3b00b0540 con 0x7fb3bc13ceb0 2023-12-12T10:12:03.641 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:12:03.641 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/3747609982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":3747609982},{"type":"v1","addr":"172.21.15.187:6834","nonce":3747609982}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-12-12T10:12:03.641 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 2 2023-12-12T10:12:03.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.635+0000 7fb3c24c9640 1 -- 172.21.15.78:0/3692958310 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fb3a8066470 msgr2=0x7fb3a8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:03.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.635+0000 7fb3c24c9640 1 --2- 172.21.15.78:0/3692958310 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fb3a8066470 0x7fb3a8068930 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb3ac000f70 tx=0x7fb3ac009040 comp rx=0 tx=0).stop 2023-12-12T10:12:03.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.635+0000 7fb3c24c9640 1 -- 172.21.15.78:0/3692958310 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb3bc13ceb0 msgr2=0x7fb3bc1347c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:03.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.635+0000 7fb3c24c9640 1 --2- 172.21.15.78:0/3692958310 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb3bc13ceb0 0x7fb3bc1347c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb3b001a130 tx=0x7fb3b00192a0 comp rx=0 tx=0).stop 2023-12-12T10:12:03.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.639+0000 7fb3c24c9640 1 -- 172.21.15.78:0/3692958310 shutdown_connections 2023-12-12T10:12:03.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.639+0000 7fb3c24c9640 1 --2- 172.21.15.78:0/3692958310 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fb3a8066470 0x7fb3a8068930 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:03.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.639+0000 7fb3c24c9640 1 --2- 172.21.15.78:0/3692958310 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb3bc13f550 0x7fb3bc1513b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:03.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.639+0000 7fb3c24c9640 1 --2- 172.21.15.78:0/3692958310 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb3bc13ceb0 0x7fb3bc1347c0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:03.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.639+0000 7fb3c24c9640 1 --2- 172.21.15.78:0/3692958310 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb3bc071bf0 0x7fb3bc0b1b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:03.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.639+0000 7fb3c24c9640 1 -- 172.21.15.78:0/3692958310 >> 172.21.15.78:0/3692958310 conn(0x7fb3bc06c5d0 msgr2=0x7fb3bc13bed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:03.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.639+0000 7fb3c24c9640 1 -- 172.21.15.78:0/3692958310 shutdown_connections 2023-12-12T10:12:03.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:03.639+0000 7fb3c24c9640 1 -- 172.21.15.78:0/3692958310 wait complete. 2023-12-12T10:12:05.662 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-12T10:12:05.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:05.803+0000 7f9799be7640 1 Processor -- start 2023-12-12T10:12:05.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:05.803+0000 7f9799be7640 1 -- start start 2023-12-12T10:12:05.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:05.807+0000 7f9799be7640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f97940ade10 0x7f97940ce5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:05.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:05.807+0000 7f9799be7640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f97940cb7e0 0x7f97940b40c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:05.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:05.807+0000 7f9799be7640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97940b4a50 con 0x7f97940b4600 2023-12-12T10:12:05.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:05.807+0000 7f9799be7640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97940ae1f0 con 0x7f97940ade10 2023-12-12T10:12:05.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:05.807+0000 7f9799be7640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f979415c410 con 0x7f97940cb7e0 2023-12-12T10:12:05.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:05.807+0000 7f97937fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f97940ade10 0x7f97940ce5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:05.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:05.807+0000 7f97937fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f97940ade10 0x7f97940ce5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54654/0 (socket says 172.21.15.78:54654) 2023-12-12T10:12:05.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:05.807+0000 7f97937fe640 1 -- 172.21.15.78:0/1479876486 learned_addr learned my addr 172.21.15.78:0/1479876486 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:05.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:05.807+0000 7f9792ffd640 1 --2- 172.21.15.78:0/1479876486 >> v2:172.21.15.187:3300/0 conn(0x7f97940cb7e0 0x7f97940b40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:05.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:05.807+0000 7f97937fe640 1 -- 172.21.15.78:0/1479876486 >> v2:172.21.15.187:3300/0 conn(0x7f97940cb7e0 msgr2=0x7f97940b40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:05.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:05.807+0000 7f97937fe640 1 --2- 172.21.15.78:0/1479876486 >> v2:172.21.15.187:3300/0 conn(0x7f97940cb7e0 0x7f97940b40c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:05.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:05.807+0000 7f97937fe640 1 -- 172.21.15.78:0/1479876486 >> v1:172.21.15.187:6789/0 conn(0x7f97940b4600 legacy=0x7f97941580a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:05.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:05.807+0000 7f97937fe640 1 -- 172.21.15.78:0/1479876486 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97940ceb00 con 0x7f97940ade10 2023-12-12T10:12:05.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:05.807+0000 7f9792ffd640 1 --2- 172.21.15.78:0/1479876486 >> v2:172.21.15.187:3300/0 conn(0x7f97940cb7e0 0x7f97940b40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T10:12:05.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:05.811+0000 7f97937fe640 1 --2- 172.21.15.78:0/1479876486 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f97940ade10 0x7f97940ce5c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9794072d90 tx=0x7f978401c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc6ce081ae5f40a4 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:05.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:05.811+0000 7f97927fc640 1 -- 172.21.15.78:0/1479876486 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97840ac410 con 0x7f97940ade10 2023-12-12T10:12:05.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:05.811+0000 7f97927fc640 1 -- 172.21.15.78:0/1479876486 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97840ac570 con 0x7f97940ade10 2023-12-12T10:12:05.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:05.811+0000 7f97927fc640 1 -- 172.21.15.78:0/1479876486 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97840ac900 con 0x7f97940ade10 2023-12-12T10:12:05.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:05.811+0000 7f9799be7640 1 -- 172.21.15.78:0/1479876486 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f97940ade10 msgr2=0x7f97940ce5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:05.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:05.811+0000 7f9799be7640 1 --2- 172.21.15.78:0/1479876486 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f97940ade10 0x7f97940ce5c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9794072d90 tx=0x7f978401c4c0 comp rx=0 tx=0).stop 2023-12-12T10:12:05.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:05.811+0000 7f9799be7640 1 -- 172.21.15.78:0/1479876486 shutdown_connections 2023-12-12T10:12:05.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:05.811+0000 7f9799be7640 1 --2- 172.21.15.78:0/1479876486 >> v2:172.21.15.187:3300/0 conn(0x7f97940cb7e0 0x7f97940b40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:05.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:05.811+0000 7f9799be7640 1 --2- 172.21.15.78:0/1479876486 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f97940ade10 0x7f97940ce5c0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:05.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:05.811+0000 7f9799be7640 1 -- 172.21.15.78:0/1479876486 >> 172.21.15.78:0/1479876486 conn(0x7f979406c5d0 msgr2=0x7f979406c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:05.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:05.811+0000 7f9799be7640 1 -- 172.21.15.78:0/1479876486 shutdown_connections 2023-12-12T10:12:05.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:05.811+0000 7f9799be7640 1 -- 172.21.15.78:0/1479876486 wait complete. 2023-12-12T10:12:05.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:05.811+0000 7f9799be7640 1 Processor -- start 2023-12-12T10:12:05.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:05.811+0000 7f9799be7640 1 -- start start 2023-12-12T10:12:05.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:05.811+0000 7f9799be7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f97940ade10 0x7f9794149b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:05.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:05.811+0000 7f9799be7640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f97940b4600 0x7f9794135de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:05.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:05.815+0000 7f9799be7640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f97940cb7e0 0x7f9794136320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:05.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:05.815+0000 7f9799be7640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f979414fdc0 con 0x7f97940ade10 2023-12-12T10:12:05.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:05.815+0000 7f9799be7640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9794133d50 con 0x7f97940b4600 2023-12-12T10:12:05.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:05.815+0000 7f9799be7640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9794134030 con 0x7f97940cb7e0 2023-12-12T10:12:05.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:05.815+0000 7f97937fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f97940ade10 0x7f9794149b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:05.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:05.815+0000 7f97937fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f97940ade10 0x7f9794149b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54670/0 (socket says 172.21.15.78:54670) 2023-12-12T10:12:05.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:05.815+0000 7f97937fe640 1 -- 172.21.15.78:0/1077334430 learned_addr learned my addr 172.21.15.78:0/1077334430 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:05.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:05.815+0000 7f9792ffd640 1 --2- 172.21.15.78:0/1077334430 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f97940b4600 0x7f9794135de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:05.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:05.815+0000 7f9793fff640 1 --2- 172.21.15.78:0/1077334430 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f97940cb7e0 0x7f9794136320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:05.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:05.815+0000 7f97937fe640 1 -- 172.21.15.78:0/1077334430 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f97940cb7e0 msgr2=0x7f9794136320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:05.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:05.815+0000 7f97937fe640 1 --2- 172.21.15.78:0/1077334430 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f97940cb7e0 0x7f9794136320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:05.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:05.815+0000 7f97937fe640 1 -- 172.21.15.78:0/1077334430 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f97940b4600 msgr2=0x7f9794135de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:05.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:05.815+0000 7f97937fe640 1 --2- 172.21.15.78:0/1077334430 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f97940b4600 0x7f9794135de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:05.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:05.815+0000 7f97937fe640 1 -- 172.21.15.78:0/1077334430 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97840094d0 con 0x7f97940ade10 2023-12-12T10:12:05.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:05.815+0000 7f97937fe640 1 --2- 172.21.15.78:0/1077334430 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f97940ade10 0x7f9794149b00 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f97840af040 tx=0x7f9784019260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:05.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:05.815+0000 7f977bfff640 1 -- 172.21.15.78:0/1077334430 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97840acea0 con 0x7f97940ade10 2023-12-12T10:12:05.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:05.815+0000 7f977bfff640 1 -- 172.21.15.78:0/1077334430 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97840b5630 con 0x7f97940ade10 2023-12-12T10:12:05.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:05.815+0000 7f9799be7640 1 -- 172.21.15.78:0/1077334430 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9794134310 con 0x7f97940ade10 2023-12-12T10:12:05.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:05.815+0000 7f977bfff640 1 -- 172.21.15.78:0/1077334430 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97840ac410 con 0x7f97940ade10 2023-12-12T10:12:05.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:05.815+0000 7f9799be7640 1 -- 172.21.15.78:0/1077334430 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f979414a040 con 0x7f97940ade10 2023-12-12T10:12:05.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:05.815+0000 7f9799be7640 1 -- 172.21.15.78:0/1077334430 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97940671f0 con 0x7f97940ade10 2023-12-12T10:12:05.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:05.815+0000 7f977bfff640 1 -- 172.21.15.78:0/1077334430 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f97840b3070 con 0x7f97940ade10 2023-12-12T10:12:05.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:05.815+0000 7f977bfff640 1 --2- 172.21.15.78:0/1077334430 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f9780066470 0x7f9780068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:05.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:05.819+0000 7f977bfff640 1 -- 172.21.15.78:0/1077334430 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f978411e180 con 0x7f97940ade10 2023-12-12T10:12:05.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:05.819+0000 7f9792ffd640 1 --2- 172.21.15.78:0/1077334430 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f9780066470 0x7f9780068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:05.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:05.819+0000 7f9792ffd640 1 --2- 172.21.15.78:0/1077334430 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f9780066470 0x7f9780068930 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9788006fd0 tx=0x7f9788008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:05.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:05.823+0000 7f977bfff640 1 -- 172.21.15.78:0/1077334430 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f97840eb8b0 con 0x7f97940ade10 2023-12-12T10:12:06.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.003+0000 7f9799be7640 1 -- 172.21.15.78:0/1077334430 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f97940b4a50 con 0x7f97940ade10 2023-12-12T10:12:06.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.003+0000 7f977bfff640 1 -- 172.21.15.78:0/1077334430 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3697 (secure 0 0 0) 0x7f97940b4a50 con 0x7f97940ade10 2023-12-12T10:12:06.008 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:12:06.008 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/3747609982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":3747609982},{"type":"v1","addr":"172.21.15.187:6834","nonce":3747609982}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4282,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/3245919280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":3245919280},{"type":"v1","addr":"172.21.15.187:6835","nonce":3245919280}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4293,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/3902814576","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":3902814576},{"type":"v1","addr":"172.21.15.78:6835","nonce":3902814576}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4296,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/739552946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":739552946},{"type":"v1","addr":"172.21.15.78:6837","nonce":739552946}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2023-12-12T10:12:06.009 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 3 2023-12-12T10:12:06.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.003+0000 7f9799be7640 1 -- 172.21.15.78:0/1077334430 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f9780066470 msgr2=0x7f9780068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:06.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.003+0000 7f9799be7640 1 --2- 172.21.15.78:0/1077334430 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f9780066470 0x7f9780068930 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9788006fd0 tx=0x7f9788008040 comp rx=0 tx=0).stop 2023-12-12T10:12:06.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.003+0000 7f9799be7640 1 -- 172.21.15.78:0/1077334430 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f97940ade10 msgr2=0x7f9794149b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:06.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.003+0000 7f9799be7640 1 --2- 172.21.15.78:0/1077334430 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f97940ade10 0x7f9794149b00 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f97840af040 tx=0x7f9784019260 comp rx=0 tx=0).stop 2023-12-12T10:12:06.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.003+0000 7f9799be7640 1 -- 172.21.15.78:0/1077334430 shutdown_connections 2023-12-12T10:12:06.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.003+0000 7f9799be7640 1 --2- 172.21.15.78:0/1077334430 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f9780066470 0x7f9780068930 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:06.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.003+0000 7f9799be7640 1 --2- 172.21.15.78:0/1077334430 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f97940cb7e0 0x7f9794136320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:06.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.003+0000 7f9799be7640 1 --2- 172.21.15.78:0/1077334430 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f97940b4600 0x7f9794135de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:06.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.003+0000 7f9799be7640 1 --2- 172.21.15.78:0/1077334430 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f97940ade10 0x7f9794149b00 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:06.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.003+0000 7f9799be7640 1 -- 172.21.15.78:0/1077334430 >> 172.21.15.78:0/1077334430 conn(0x7f979406c5d0 msgr2=0x7f9794153b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:06.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.003+0000 7f9799be7640 1 -- 172.21.15.78:0/1077334430 shutdown_connections 2023-12-12T10:12:06.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.007+0000 7f9799be7640 1 -- 172.21.15.78:0/1077334430 wait complete. 2023-12-12T10:12:06.030 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T10:12:06.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.163+0000 7f1b77f3e640 1 Processor -- start 2023-12-12T10:12:06.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.163+0000 7f1b77f3e640 1 -- start start 2023-12-12T10:12:06.170 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.163+0000 7f1b77f3e640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f1b700b47d0 0x7f1b701580a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:06.170 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.163+0000 7f1b77f3e640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b700ae1f0 con 0x7f1b700cb7e0 2023-12-12T10:12:06.170 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.163+0000 7f1b77f3e640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b7015c410 con 0x7f1b700ade10 2023-12-12T10:12:06.170 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.163+0000 7f1b77f3e640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b7015b800 con 0x7f1b700b47d0 2023-12-12T10:12:06.170 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.163+0000 7f1b754d9640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f1b700cb7e0 0x7f1b700b40c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:44458/0 (socket says 172.21.15.78:44458) 2023-12-12T10:12:06.170 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.163+0000 7f1b754d9640 1 -- 172.21.15.78:0/507399659 learned_addr learned my addr 172.21.15.78:0/507399659 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-12-12T10:12:06.170 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.163+0000 7f1b764db640 1 --2- 172.21.15.78:0/507399659 >> v2:172.21.15.187:3300/0 conn(0x7f1b700b47d0 0x7f1b701580a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:06.172 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.167+0000 7f1b74cd8640 1 -- 172.21.15.78:0/507399659 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4075090286 0 0) 0x7f1b700ae1f0 con 0x7f1b700cb7e0 2023-12-12T10:12:06.172 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.167+0000 7f1b74cd8640 1 -- 172.21.15.78:0/507399659 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b5c003530 con 0x7f1b700cb7e0 2023-12-12T10:12:06.172 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.167+0000 7f1b74cd8640 1 -- 172.21.15.78:0/507399659 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1995128711 0 0) 0x7f1b7015c410 con 0x7f1b700ade10 2023-12-12T10:12:06.172 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.167+0000 7f1b74cd8640 1 -- 172.21.15.78:0/507399659 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b700ae1f0 con 0x7f1b700ade10 2023-12-12T10:12:06.172 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.167+0000 7f1b74cd8640 1 -- 172.21.15.78:0/507399659 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4073932481 0 0) 0x7f1b5c003530 con 0x7f1b700cb7e0 2023-12-12T10:12:06.172 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.167+0000 7f1b74cd8640 1 -- 172.21.15.78:0/507399659 >> v2:172.21.15.187:3300/0 conn(0x7f1b700b47d0 msgr2=0x7f1b701580a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:06.173 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.167+0000 7f1b74cd8640 1 --2- 172.21.15.78:0/507399659 >> v2:172.21.15.187:3300/0 conn(0x7f1b700b47d0 0x7f1b701580a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:06.173 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.167+0000 7f1b74cd8640 1 -- 172.21.15.78:0/507399659 >> v1:172.21.15.187:6789/0 conn(0x7f1b700ade10 legacy=0x7f1b700ce5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:06.173 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.167+0000 7f1b74cd8640 1 -- 172.21.15.78:0/507399659 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b7015bae0 con 0x7f1b700cb7e0 2023-12-12T10:12:06.173 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.167+0000 7f1b74cd8640 1 -- 172.21.15.78:0/507399659 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 465499599 0 0) 0x7f1b60001680 con 0x7f1b700cb7e0 2023-12-12T10:12:06.173 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.167+0000 7f1b74cd8640 1 -- 172.21.15.78:0/507399659 >> v1:172.21.15.78:6789/0 conn(0x7f1b700cb7e0 legacy=0x7f1b700b40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:06.173 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.167+0000 7f1b74cd8640 1 --2- 172.21.15.78:0/507399659 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1b5c003b10 0x7f1b5c003f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:06.173 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.167+0000 7f1b74cd8640 1 --2- 172.21.15.78:0/507399659 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1b5c0047d0 0x7f1b5c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:06.173 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.167+0000 7f1b74cd8640 1 --2- 172.21.15.78:0/507399659 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1b5c005190 0x7f1b5c00fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:06.173 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.167+0000 7f1b74cd8640 1 -- 172.21.15.78:0/507399659 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b7015b800 con 0x7f1b5c005190 2023-12-12T10:12:06.173 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.167+0000 7f1b74cd8640 1 -- 172.21.15.78:0/507399659 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b5c010420 con 0x7f1b5c0047d0 2023-12-12T10:12:06.173 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.167+0000 7f1b74cd8640 1 -- 172.21.15.78:0/507399659 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b5c0105e0 con 0x7f1b5c003b10 2023-12-12T10:12:06.173 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.167+0000 7f1b764db640 1 --2- 172.21.15.78:0/507399659 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1b5c005190 0x7f1b5c00fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:06.173 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.167+0000 7f1b754d9640 1 --2- 172.21.15.78:0/507399659 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1b5c0047d0 0x7f1b5c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:06.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.167+0000 7f1b75cda640 1 --2- 172.21.15.78:0/507399659 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1b5c003b10 0x7f1b5c003f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:06.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.167+0000 7f1b764db640 1 -- 172.21.15.78:0/507399659 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1b5c003b10 msgr2=0x7f1b5c003f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:06.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.167+0000 7f1b764db640 1 --2- 172.21.15.78:0/507399659 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1b5c003b10 0x7f1b5c003f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:06.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.167+0000 7f1b764db640 1 -- 172.21.15.78:0/507399659 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1b5c0047d0 msgr2=0x7f1b5c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:06.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.167+0000 7f1b764db640 1 --2- 172.21.15.78:0/507399659 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1b5c0047d0 0x7f1b5c004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:06.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.167+0000 7f1b764db640 1 -- 172.21.15.78:0/507399659 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b5c003530 con 0x7f1b5c005190 2023-12-12T10:12:06.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.167+0000 7f1b75cda640 1 --2- 172.21.15.78:0/507399659 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1b5c003b10 0x7f1b5c003f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T10:12:06.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.167+0000 7f1b764db640 1 -- 172.21.15.78:0/507399659 reap_dead start 2023-12-12T10:12:06.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.171+0000 7f1b764db640 1 --2- 172.21.15.78:0/507399659 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1b5c005190 0x7f1b5c00fda0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1b7006e6a0 tx=0x7f1b6801cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3271e026da9f7751 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:06.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.171+0000 7f1b74cd8640 1 -- 172.21.15.78:0/507399659 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b60007ea0 con 0x7f1b5c005190 2023-12-12T10:12:06.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.171+0000 7f1b74cd8640 1 -- 172.21.15.78:0/507399659 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b6800f040 con 0x7f1b5c005190 2023-12-12T10:12:06.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.171+0000 7f1b74cd8640 1 -- 172.21.15.78:0/507399659 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b680a5d60 con 0x7f1b5c005190 2023-12-12T10:12:06.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.171+0000 7f1b77f3e640 1 -- 172.21.15.78:0/507399659 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1b5c005190 msgr2=0x7f1b5c00fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:06.176 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.171+0000 7f1b77f3e640 1 --2- 172.21.15.78:0/507399659 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1b5c005190 0x7f1b5c00fda0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1b7006e6a0 tx=0x7f1b6801cc40 comp rx=0 tx=0).stop 2023-12-12T10:12:06.176 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.171+0000 7f1b77f3e640 1 -- 172.21.15.78:0/507399659 shutdown_connections 2023-12-12T10:12:06.176 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.171+0000 7f1b77f3e640 1 --2- 172.21.15.78:0/507399659 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1b5c005190 0x7f1b5c00fda0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:06.176 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.171+0000 7f1b77f3e640 1 -- 172.21.15.78:0/507399659 >> 172.21.15.78:0/507399659 conn(0x7f1b7006c5d0 msgr2=0x7f1b7006c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:06.176 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.171+0000 7f1b77f3e640 1 -- 172.21.15.78:0/507399659 shutdown_connections 2023-12-12T10:12:06.176 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.171+0000 7f1b77f3e640 1 -- 172.21.15.78:0/507399659 wait complete. 2023-12-12T10:12:06.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.171+0000 7f1b77f3e640 1 Processor -- start 2023-12-12T10:12:06.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.171+0000 7f1b77f3e640 1 -- start start 2023-12-12T10:12:06.179 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.171+0000 7f1b77f3e640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1b5c005190 0x7f1b700c3d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:06.180 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.171+0000 7f1b77f3e640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1b700ab020 0x7f1b7014e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:06.180 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.171+0000 7f1b77f3e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1b700c5480 0x7f1b70071380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:06.180 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.171+0000 7f1b77f3e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b700c5060 con 0x7f1b700c5480 2023-12-12T10:12:06.180 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.171+0000 7f1b77f3e640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b700ab4a0 con 0x7f1b5c005190 2023-12-12T10:12:06.180 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.171+0000 7f1b77f3e640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b700c43e0 con 0x7f1b700ab020 2023-12-12T10:12:06.180 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.175+0000 7f1b764db640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1b700c5480 0x7f1b70071380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:06.180 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.175+0000 7f1b764db640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1b700c5480 0x7f1b70071380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54700/0 (socket says 172.21.15.78:54700) 2023-12-12T10:12:06.180 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.175+0000 7f1b764db640 1 -- 172.21.15.78:0/139027381 learned_addr learned my addr 172.21.15.78:0/139027381 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:06.180 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.175+0000 7f1b75cda640 1 --2- 172.21.15.78:0/139027381 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1b5c005190 0x7f1b700c3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:06.180 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.175+0000 7f1b754d9640 1 --2- 172.21.15.78:0/139027381 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1b700ab020 0x7f1b7014e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:06.180 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.175+0000 7f1b764db640 1 -- 172.21.15.78:0/139027381 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1b700ab020 msgr2=0x7f1b7014e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:06.180 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.175+0000 7f1b764db640 1 --2- 172.21.15.78:0/139027381 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1b700ab020 0x7f1b7014e6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:06.180 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.175+0000 7f1b764db640 1 -- 172.21.15.78:0/139027381 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1b5c005190 msgr2=0x7f1b700c3d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:06.181 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.175+0000 7f1b764db640 1 --2- 172.21.15.78:0/139027381 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1b5c005190 0x7f1b700c3d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:06.181 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.175+0000 7f1b764db640 1 -- 172.21.15.78:0/139027381 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b700c46c0 con 0x7f1b700c5480 2023-12-12T10:12:06.181 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.175+0000 7f1b764db640 1 --2- 172.21.15.78:0/139027381 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1b700c5480 0x7f1b70071380 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1b6801ca70 tx=0x7f1b68009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:06.181 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.175+0000 7f1b667fc640 1 -- 172.21.15.78:0/139027381 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b680ad850 con 0x7f1b700c5480 2023-12-12T10:12:06.181 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.175+0000 7f1b667fc640 1 -- 172.21.15.78:0/139027381 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b680ad9b0 con 0x7f1b700c5480 2023-12-12T10:12:06.181 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.175+0000 7f1b77f3e640 1 -- 172.21.15.78:0/139027381 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b700c49a0 con 0x7f1b700c5480 2023-12-12T10:12:06.181 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.175+0000 7f1b667fc640 1 -- 172.21.15.78:0/139027381 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b680add60 con 0x7f1b700c5480 2023-12-12T10:12:06.181 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.175+0000 7f1b77f3e640 1 -- 172.21.15.78:0/139027381 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b7014ec10 con 0x7f1b700c5480 2023-12-12T10:12:06.181 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.175+0000 7f1b77f3e640 1 -- 172.21.15.78:0/139027381 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b700671f0 con 0x7f1b700c5480 2023-12-12T10:12:06.182 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.175+0000 7f1b667fc640 1 -- 172.21.15.78:0/139027381 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f1b680b4040 con 0x7f1b700c5480 2023-12-12T10:12:06.183 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.179+0000 7f1b667fc640 1 --2- 172.21.15.78:0/139027381 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f1b54066470 0x7f1b54068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:06.183 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.179+0000 7f1b667fc640 1 -- 172.21.15.78:0/139027381 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f1b6811e610 con 0x7f1b700c5480 2023-12-12T10:12:06.183 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.179+0000 7f1b75cda640 1 --2- 172.21.15.78:0/139027381 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f1b54066470 0x7f1b54068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:06.183 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.179+0000 7f1b75cda640 1 --2- 172.21.15.78:0/139027381 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f1b54066470 0x7f1b54068930 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1b6c0012b0 tx=0x7f1b6c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:06.187 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.183+0000 7f1b667fc640 1 -- 172.21.15.78:0/139027381 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1b680ebe80 con 0x7f1b700c5480 2023-12-12T10:12:06.361 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.355+0000 7f1b77f3e640 1 -- 172.21.15.78:0/139027381 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1b700c51a0 con 0x7f1b700c5480 2023-12-12T10:12:06.362 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.355+0000 7f1b667fc640 1 -- 172.21.15.78:0/139027381 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12814 (secure 0 0 0) 0x7f1b700c51a0 con 0x7f1b700c5480 2023-12-12T10:12:06.362 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:12:06.362 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":16,"fsid":"fc81937c-bd26-483c-952b-d1324fcb0c9e","created":"2023-12-12T10:11:44.020214+0000","modified":"2023-12-12T10:11:59.304703+0000","last_up_change":"2023-12-12T10:11:56.278318+0000","last_in_change":"2023-12-12T10:11:46.553610+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T10:11:57.053584+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"22dfdedf-5f6c-4b20-9f6c-30517a1db70a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6809","nonce":3345683600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6811","nonce":3345683600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6815","nonce":3345683600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6813","nonce":3345683600}]},"public_addr":"172.21.15.78:6809/3345683600","cluster_addr":"172.21.15.78:6811/3345683600","heartbeat_back_addr":"172.21.15.78:6815/3345683600","heartbeat_front_addr":"172.21.15.78:6813/3345683600","state":["exists","up"]},{"osd":1,"uuid":"be34a7f3-a69a-462e-9ddf-5e537448dba2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6801","nonce":962652768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6803","nonce":962652768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6807","nonce":962652768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6805","nonce":962652768}]},"public_addr":"172.21.15.78:6801/962652768","cluster_addr":"172.21.15.78:6803/962652768","heartbeat_back_addr":"172.21.15.78:6807/962652768","heartbeat_front_addr":"172.21.15.78:6805/962652768","state":["exists","up"]},{"osd":2,"uuid":"55b381de-5f56-4b14-80f7-e6e41e084a13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6818","nonce":2910206054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6822","nonce":2910206054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6829","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6831","nonce":2910206054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6826","nonce":2910206054}]},"public_addr":"172.21.15.78:6818/2910206054","cluster_addr":"172.21.15.78:6822/2910206054","heartbeat_back_addr":"172.21.15.78:6831/2910206054","heartbeat_front_addr":"172.21.15.78:6826/2910206054","state":["exists","up"]},{"osd":3,"uuid":"d7682de1-25cb-4cec-869f-8851c28b0e6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6819","nonce":3750796703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6821","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6823","nonce":3750796703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6830","nonce":3750796703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6825","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6827","nonce":3750796703}]},"public_addr":"172.21.15.78:6819/3750796703","cluster_addr":"172.21.15.78:6823/3750796703","heartbeat_back_addr":"172.21.15.78:6830/3750796703","heartbeat_front_addr":"172.21.15.78:6827/3750796703","state":["exists","up"]},{"osd":4,"uuid":"8279815a-d6c7-4199-871e-d28971b9dc07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6809","nonce":2944277204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6811","nonce":2944277204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6815","nonce":2944277204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6813","nonce":2944277204}]},"public_addr":"172.21.15.187:6809/2944277204","cluster_addr":"172.21.15.187:6811/2944277204","heartbeat_back_addr":"172.21.15.187:6815/2944277204","heartbeat_front_addr":"172.21.15.187:6813/2944277204","state":["exists","up"]},{"osd":5,"uuid":"0a714c65-f8ce-4340-968f-11a799677ef3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6801","nonce":185858620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6803","nonce":185858620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6807","nonce":185858620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6805","nonce":185858620}]},"public_addr":"172.21.15.187:6801/185858620","cluster_addr":"172.21.15.187:6803/185858620","heartbeat_back_addr":"172.21.15.187:6807/185858620","heartbeat_front_addr":"172.21.15.187:6805/185858620","state":["exists","up"]},{"osd":6,"uuid":"d0bba9ab-f7ee-449e-8999-1c0cf7e6d53c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6817","nonce":4213392126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6819","nonce":4213392126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6824","nonce":4213392126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6821","nonce":4213392126}]},"public_addr":"172.21.15.187:6817/4213392126","cluster_addr":"172.21.15.187:6819/4213392126","heartbeat_back_addr":"172.21.15.187:6824/4213392126","heartbeat_front_addr":"172.21.15.187:6821/4213392126","state":["exists","up"]},{"osd":7,"uuid":"efe5e0d9-2f87-4889-a27a-e2a95a632302","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6823","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6825","nonce":85774004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6827","nonce":85774004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6831","nonce":85774004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6829","nonce":85774004}]},"public_addr":"172.21.15.187:6825/85774004","cluster_addr":"172.21.15.187:6827/85774004","heartbeat_back_addr":"172.21.15.187:6831/85774004","heartbeat_front_addr":"172.21.15.187:6829/85774004","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.214447+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.448899+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.293107+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.564184+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.175026+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.097717+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.261141+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.287681+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T10:12:06.364 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.359+0000 7f1b77f3e640 1 -- 172.21.15.78:0/139027381 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f1b54066470 msgr2=0x7f1b54068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:06.364 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.359+0000 7f1b77f3e640 1 --2- 172.21.15.78:0/139027381 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f1b54066470 0x7f1b54068930 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f1b6c0012b0 tx=0x7f1b6c009040 comp rx=0 tx=0).stop 2023-12-12T10:12:06.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.359+0000 7f1b77f3e640 1 -- 172.21.15.78:0/139027381 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1b700c5480 msgr2=0x7f1b70071380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:06.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.359+0000 7f1b77f3e640 1 --2- 172.21.15.78:0/139027381 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1b700c5480 0x7f1b70071380 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1b6801ca70 tx=0x7f1b68009750 comp rx=0 tx=0).stop 2023-12-12T10:12:06.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.359+0000 7f1b77f3e640 1 -- 172.21.15.78:0/139027381 shutdown_connections 2023-12-12T10:12:06.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.359+0000 7f1b77f3e640 1 --2- 172.21.15.78:0/139027381 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f1b54066470 0x7f1b54068930 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:06.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.359+0000 7f1b77f3e640 1 --2- 172.21.15.78:0/139027381 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1b700c5480 0x7f1b70071380 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:06.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.359+0000 7f1b77f3e640 1 --2- 172.21.15.78:0/139027381 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1b700ab020 0x7f1b7014e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:06.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.359+0000 7f1b77f3e640 1 --2- 172.21.15.78:0/139027381 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1b5c005190 0x7f1b700c3d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:06.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.359+0000 7f1b77f3e640 1 -- 172.21.15.78:0/139027381 >> 172.21.15.78:0/139027381 conn(0x7f1b7006c5d0 msgr2=0x7f1b700cafa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:06.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.359+0000 7f1b77f3e640 1 -- 172.21.15.78:0/139027381 shutdown_connections 2023-12-12T10:12:06.365 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.359+0000 7f1b77f3e640 1 -- 172.21.15.78:0/139027381 wait complete. 2023-12-12T10:12:06.383 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-12T10:11:57.053584+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-12T10:12:06.383 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-12T10:12:06.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.519+0000 7f17fcfbd640 1 Processor -- start 2023-12-12T10:12:06.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.519+0000 7f17fcfbd640 1 -- start start 2023-12-12T10:12:06.526 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.519+0000 7f17fcfbd640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f17f8143770 0x7f17f80cdf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:06.526 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.519+0000 7f17fcfbd640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f17f80b1e20 0x7f17f8070f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:06.526 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.519+0000 7f17fcfbd640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17f8070a70 con 0x7f17f80b2280 2023-12-12T10:12:06.526 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.519+0000 7f17fcfbd640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17f815e920 con 0x7f17f80b1e20 2023-12-12T10:12:06.526 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.519+0000 7f17fcfbd640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17f8070440 con 0x7f17f8143770 2023-12-12T10:12:06.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.523+0000 7f17effff640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f17f80b1e20 0x7f17f8070f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:06.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.523+0000 7f17f659c640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f17f8143770 0x7f17f80cdf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:06.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.523+0000 7f17effff640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f17f80b1e20 0x7f17f8070f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.78:51472/0 (socket says 172.21.15.78:51472) 2023-12-12T10:12:06.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.523+0000 7f17effff640 1 -- 172.21.15.78:0/355332176 learned_addr learned my addr 172.21.15.78:0/355332176 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:06.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.523+0000 7f17f659c640 1 --2- 172.21.15.78:0/355332176 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f17f8143770 0x7f17f80cdf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.78:54722/0 (socket says 172.21.15.78:54722) 2023-12-12T10:12:06.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.523+0000 7f17effff640 1 -- 172.21.15.78:0/355332176 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f17f8143770 msgr2=0x7f17f80cdf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:06.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.523+0000 7f17effff640 1 --2- 172.21.15.78:0/355332176 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f17f8143770 0x7f17f80cdf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:06.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.523+0000 7f17effff640 1 -- 172.21.15.78:0/355332176 >> v1:172.21.15.187:6789/0 conn(0x7f17f80b2280 legacy=0x7f17f815a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:06.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.523+0000 7f17effff640 1 -- 172.21.15.78:0/355332176 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17f8143b50 con 0x7f17f80b1e20 2023-12-12T10:12:06.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.523+0000 7f17effff640 1 --2- 172.21.15.78:0/355332176 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f17f80b1e20 0x7f17f8070f00 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f17e0009870 tx=0x7f17e001c4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5bc9ff2c65f8ed1d server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:06.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.527+0000 7f17f5d9b640 1 -- 172.21.15.78:0/355332176 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17e00aa610 con 0x7f17f80b1e20 2023-12-12T10:12:06.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.527+0000 7f17f5d9b640 1 -- 172.21.15.78:0/355332176 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17e00a6040 con 0x7f17f80b1e20 2023-12-12T10:12:06.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.527+0000 7f17f5d9b640 1 -- 172.21.15.78:0/355332176 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17e00aa990 con 0x7f17f80b1e20 2023-12-12T10:12:06.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.527+0000 7f17fcfbd640 1 -- 172.21.15.78:0/355332176 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f17f80b1e20 msgr2=0x7f17f8070f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:06.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.527+0000 7f17fcfbd640 1 --2- 172.21.15.78:0/355332176 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f17f80b1e20 0x7f17f8070f00 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f17e0009870 tx=0x7f17e001c4b0 comp rx=0 tx=0).stop 2023-12-12T10:12:06.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.527+0000 7f17fcfbd640 1 -- 172.21.15.78:0/355332176 shutdown_connections 2023-12-12T10:12:06.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.527+0000 7f17fcfbd640 1 --2- 172.21.15.78:0/355332176 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f17f80b1e20 0x7f17f8070f00 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:06.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.527+0000 7f17fcfbd640 1 --2- 172.21.15.78:0/355332176 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f17f8143770 0x7f17f80cdf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:06.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.527+0000 7f17fcfbd640 1 -- 172.21.15.78:0/355332176 >> 172.21.15.78:0/355332176 conn(0x7f17f806a710 msgr2=0x7f17f806ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:06.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.527+0000 7f17fcfbd640 1 -- 172.21.15.78:0/355332176 shutdown_connections 2023-12-12T10:12:06.532 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.527+0000 7f17fcfbd640 1 -- 172.21.15.78:0/355332176 wait complete. 2023-12-12T10:12:06.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.527+0000 7f17fcfbd640 1 Processor -- start 2023-12-12T10:12:06.533 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.527+0000 7f17fcfbd640 1 -- start start 2023-12-12T10:12:06.534 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.527+0000 7f17fcfbd640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f17f80b1e20 0x7f17f8159730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:06.534 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.527+0000 7f17fcfbd640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f17f80b2280 0x7f17f813f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:06.534 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.527+0000 7f17fcfbd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17f8143770 0x7f17f813fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:06.534 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.527+0000 7f17fcfbd640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17f8136120 con 0x7f17f8143770 2023-12-12T10:12:06.534 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.527+0000 7f17fcfbd640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17f81416c0 con 0x7f17f80b1e20 2023-12-12T10:12:06.534 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.527+0000 7f17fcfbd640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17f8141960 con 0x7f17f80b2280 2023-12-12T10:12:06.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.527+0000 7f17f6d9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17f8143770 0x7f17f813fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:06.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.527+0000 7f17f6d9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17f8143770 0x7f17f813fb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54716/0 (socket says 172.21.15.78:54716) 2023-12-12T10:12:06.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.531+0000 7f17f6d9d640 1 -- 172.21.15.78:0/2144611219 learned_addr learned my addr 172.21.15.78:0/2144611219 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:06.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.531+0000 7f17f659c640 1 --2- 172.21.15.78:0/2144611219 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f17f80b1e20 0x7f17f8159730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:06.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.531+0000 7f17effff640 1 --2- 172.21.15.78:0/2144611219 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f17f80b2280 0x7f17f813f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:06.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.531+0000 7f17f6d9d640 1 -- 172.21.15.78:0/2144611219 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f17f80b2280 msgr2=0x7f17f813f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:06.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.531+0000 7f17f6d9d640 1 --2- 172.21.15.78:0/2144611219 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f17f80b2280 0x7f17f813f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:06.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.531+0000 7f17f6d9d640 1 -- 172.21.15.78:0/2144611219 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f17f80b1e20 msgr2=0x7f17f8159730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:06.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.531+0000 7f17f6d9d640 1 --2- 172.21.15.78:0/2144611219 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f17f80b1e20 0x7f17f8159730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:06.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.531+0000 7f17f6d9d640 1 -- 172.21.15.78:0/2144611219 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17e00094d0 con 0x7f17f8143770 2023-12-12T10:12:06.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.531+0000 7f17f6d9d640 1 --2- 172.21.15.78:0/2144611219 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17f8143770 0x7f17f813fb90 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f17f000c770 tx=0x7f17f000cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:06.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.531+0000 7f17eeffd640 1 -- 172.21.15.78:0/2144611219 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f0003b80 con 0x7f17f8143770 2023-12-12T10:12:06.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.531+0000 7f17eeffd640 1 -- 172.21.15.78:0/2144611219 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17f0003ce0 con 0x7f17f8143770 2023-12-12T10:12:06.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.531+0000 7f17eeffd640 1 -- 172.21.15.78:0/2144611219 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f000aa90 con 0x7f17f8143770 2023-12-12T10:12:06.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.531+0000 7f17fcfbd640 1 -- 172.21.15.78:0/2144611219 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17f8141c40 con 0x7f17f8143770 2023-12-12T10:12:06.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.531+0000 7f17fcfbd640 1 -- 172.21.15.78:0/2144611219 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17f8142200 con 0x7f17f8143770 2023-12-12T10:12:06.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.531+0000 7f17fcfbd640 1 -- 172.21.15.78:0/2144611219 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17f80671f0 con 0x7f17f8143770 2023-12-12T10:12:06.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.531+0000 7f17eeffd640 1 -- 172.21.15.78:0/2144611219 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f17f000abf0 con 0x7f17f8143770 2023-12-12T10:12:06.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.531+0000 7f17eeffd640 1 --2- 172.21.15.78:0/2144611219 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f17d8066470 0x7f17d8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:06.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.531+0000 7f17eeffd640 1 -- 172.21.15.78:0/2144611219 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f17f00837b0 con 0x7f17f8143770 2023-12-12T10:12:06.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.531+0000 7f17f659c640 1 --2- 172.21.15.78:0/2144611219 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f17d8066470 0x7f17d8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:06.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.535+0000 7f17f659c640 1 --2- 172.21.15.78:0/2144611219 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f17d8066470 0x7f17d8068930 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f17e8009ac0 tx=0x7f17e8009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:06.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.535+0000 7f17eeffd640 1 -- 172.21.15.78:0/2144611219 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f17f00510a0 con 0x7f17f8143770 2023-12-12T10:12:06.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.687+0000 7f17fcfbd640 1 -- 172.21.15.78:0/2144611219 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f17f8139960 con 0x7f17f8143770 2023-12-12T10:12:06.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.687+0000 7f17eeffd640 1 -- 172.21.15.78:0/2144611219 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f17f8139960 con 0x7f17f8143770 2023-12-12T10:12:06.694 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2023-12-12T10:12:06.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.691+0000 7f17fcfbd640 1 -- 172.21.15.78:0/2144611219 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f17d8066470 msgr2=0x7f17d8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:06.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.691+0000 7f17fcfbd640 1 --2- 172.21.15.78:0/2144611219 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f17d8066470 0x7f17d8068930 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f17e8009ac0 tx=0x7f17e8009190 comp rx=0 tx=0).stop 2023-12-12T10:12:06.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.691+0000 7f17fcfbd640 1 -- 172.21.15.78:0/2144611219 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17f8143770 msgr2=0x7f17f813fb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:06.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.691+0000 7f17fcfbd640 1 --2- 172.21.15.78:0/2144611219 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17f8143770 0x7f17f813fb90 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f17f000c770 tx=0x7f17f000cc30 comp rx=0 tx=0).stop 2023-12-12T10:12:06.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.691+0000 7f17fcfbd640 1 -- 172.21.15.78:0/2144611219 shutdown_connections 2023-12-12T10:12:06.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.691+0000 7f17fcfbd640 1 --2- 172.21.15.78:0/2144611219 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f17d8066470 0x7f17d8068930 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:06.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.691+0000 7f17fcfbd640 1 --2- 172.21.15.78:0/2144611219 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f17f8143770 0x7f17f813fb90 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:06.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.691+0000 7f17fcfbd640 1 --2- 172.21.15.78:0/2144611219 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f17f80b2280 0x7f17f813f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:06.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.691+0000 7f17fcfbd640 1 --2- 172.21.15.78:0/2144611219 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f17f80b1e20 0x7f17f8159730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:06.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.691+0000 7f17fcfbd640 1 -- 172.21.15.78:0/2144611219 >> 172.21.15.78:0/2144611219 conn(0x7f17f806a710 msgr2=0x7f17f806cff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:06.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.691+0000 7f17fcfbd640 1 -- 172.21.15.78:0/2144611219 shutdown_connections 2023-12-12T10:12:06.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.691+0000 7f17fcfbd640 1 -- 172.21.15.78:0/2144611219 wait complete. 2023-12-12T10:12:06.714 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-12T10:12:06.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.847+0000 7f1656ad6640 1 Processor -- start 2023-12-12T10:12:06.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.847+0000 7f1656ad6640 1 -- start start 2023-12-12T10:12:06.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.851+0000 7f1656ad6640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f165015d0c0 0x7f16500cf070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:06.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.851+0000 7f1656ad6640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f165006f660 0x7f16500d0050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:06.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.851+0000 7f1656ad6640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f165015d4a0 0x7f16500cd6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:06.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.851+0000 7f1656ad6640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16500ce7f0 con 0x7f165015d4a0 2023-12-12T10:12:06.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.851+0000 7f1656ad6640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f165006e5c0 con 0x7f165006f660 2023-12-12T10:12:06.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.851+0000 7f1656ad6640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f165006e8a0 con 0x7f165015d0c0 2023-12-12T10:12:06.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.851+0000 7f1655073640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f165015d4a0 0x7f16500cd6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:06.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.851+0000 7f1655073640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f165015d4a0 0x7f16500cd6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54732/0 (socket says 172.21.15.78:54732) 2023-12-12T10:12:06.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.851+0000 7f1655073640 1 -- 172.21.15.78:0/1349131162 learned_addr learned my addr 172.21.15.78:0/1349131162 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:06.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.851+0000 7f1647fff640 1 --2- 172.21.15.78:0/1349131162 >> v2:172.21.15.187:3300/0 conn(0x7f165006f660 0x7f16500d0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:06.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.851+0000 7f1655073640 1 -- 172.21.15.78:0/1349131162 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f165015d0c0 msgr2=0x7f16500cf070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:06.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.851+0000 7f1655073640 1 --2- 172.21.15.78:0/1349131162 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f165015d0c0 0x7f16500cf070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:06.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.851+0000 7f1655073640 1 -- 172.21.15.78:0/1349131162 >> v2:172.21.15.187:3300/0 conn(0x7f165006f660 msgr2=0x7f16500d0050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:06.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.851+0000 7f1655073640 1 --2- 172.21.15.78:0/1349131162 >> v2:172.21.15.187:3300/0 conn(0x7f165006f660 0x7f16500d0050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:06.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.851+0000 7f1655073640 1 -- 172.21.15.78:0/1349131162 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f165006eb80 con 0x7f165015d4a0 2023-12-12T10:12:06.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.851+0000 7f1647fff640 1 --2- 172.21.15.78:0/1349131162 >> v2:172.21.15.187:3300/0 conn(0x7f165006f660 0x7f16500d0050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T10:12:06.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.851+0000 7f1655073640 1 --2- 172.21.15.78:0/1349131162 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f165015d4a0 0x7f16500cd6b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1650067310 tx=0x7f164801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9f0440992484958 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:06.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.855+0000 7f16477fe640 1 -- 172.21.15.78:0/1349131162 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16480a5730 con 0x7f165015d4a0 2023-12-12T10:12:06.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.855+0000 7f16477fe640 1 -- 172.21.15.78:0/1349131162 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16480a5890 con 0x7f165015d4a0 2023-12-12T10:12:06.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.855+0000 7f16477fe640 1 -- 172.21.15.78:0/1349131162 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16480a5c20 con 0x7f165015d4a0 2023-12-12T10:12:06.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.855+0000 7f1656ad6640 1 -- 172.21.15.78:0/1349131162 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f165015d4a0 msgr2=0x7f16500cd6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:06.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.855+0000 7f1656ad6640 1 --2- 172.21.15.78:0/1349131162 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f165015d4a0 0x7f16500cd6b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1650067310 tx=0x7f164801c9a0 comp rx=0 tx=0).stop 2023-12-12T10:12:06.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.855+0000 7f1656ad6640 1 -- 172.21.15.78:0/1349131162 shutdown_connections 2023-12-12T10:12:06.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.855+0000 7f1656ad6640 1 --2- 172.21.15.78:0/1349131162 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f165015d4a0 0x7f16500cd6b0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:06.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.855+0000 7f1656ad6640 1 --2- 172.21.15.78:0/1349131162 >> v2:172.21.15.187:3300/0 conn(0x7f165006f660 0x7f16500d0050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:06.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.855+0000 7f1656ad6640 1 --2- 172.21.15.78:0/1349131162 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f165015d0c0 0x7f16500cf070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:06.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.855+0000 7f1656ad6640 1 -- 172.21.15.78:0/1349131162 >> 172.21.15.78:0/1349131162 conn(0x7f16500d0e30 msgr2=0x7f16500d1240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:06.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.855+0000 7f1656ad6640 1 -- 172.21.15.78:0/1349131162 shutdown_connections 2023-12-12T10:12:06.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.855+0000 7f1656ad6640 1 -- 172.21.15.78:0/1349131162 wait complete. 2023-12-12T10:12:06.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.855+0000 7f1656ad6640 1 Processor -- start 2023-12-12T10:12:06.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.855+0000 7f1656ad6640 1 -- start start 2023-12-12T10:12:06.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.855+0000 7f1656ad6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f165006f660 0x7f1650158c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:06.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.855+0000 7f1656ad6640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f165015d0c0 0x7f16501580e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:06.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.855+0000 7f1656ad6640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f165015d4a0 0x7f16501537f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:06.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.855+0000 7f1656ad6640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1650159570 con 0x7f165006f660 2023-12-12T10:12:06.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.855+0000 7f1656ad6640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f165015ac70 con 0x7f165015d4a0 2023-12-12T10:12:06.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.855+0000 7f1656ad6640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f165015af50 con 0x7f165015d0c0 2023-12-12T10:12:06.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.855+0000 7f1654872640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f165006f660 0x7f1650158c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:06.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.859+0000 7f1654872640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f165006f660 0x7f1650158c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54734/0 (socket says 172.21.15.78:54734) 2023-12-12T10:12:06.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.859+0000 7f1654872640 1 -- 172.21.15.78:0/170840069 learned_addr learned my addr 172.21.15.78:0/170840069 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:06.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.859+0000 7f1647fff640 1 --2- 172.21.15.78:0/170840069 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f165015d0c0 0x7f16501580e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:06.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.859+0000 7f1655073640 1 --2- 172.21.15.78:0/170840069 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f165015d4a0 0x7f16501537f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:06.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.859+0000 7f1654872640 1 -- 172.21.15.78:0/170840069 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f165015d0c0 msgr2=0x7f16501580e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:06.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.859+0000 7f1654872640 1 --2- 172.21.15.78:0/170840069 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f165015d0c0 0x7f16501580e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:06.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.859+0000 7f1654872640 1 -- 172.21.15.78:0/170840069 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f165015d4a0 msgr2=0x7f16501537f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:06.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.859+0000 7f1654872640 1 --2- 172.21.15.78:0/170840069 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f165015d4a0 0x7f16501537f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:06.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.859+0000 7f1654872640 1 -- 172.21.15.78:0/170840069 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1648009b30 con 0x7f165006f660 2023-12-12T10:12:06.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.859+0000 7f1654872640 1 --2- 172.21.15.78:0/170840069 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f165006f660 0x7f1650158c70 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f164c00b550 tx=0x7f164c00ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:06.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.859+0000 7f16457fa640 1 -- 172.21.15.78:0/170840069 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f164c010870 con 0x7f165006f660 2023-12-12T10:12:06.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.859+0000 7f16457fa640 1 -- 172.21.15.78:0/170840069 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f164c0109f0 con 0x7f165006f660 2023-12-12T10:12:06.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.859+0000 7f16457fa640 1 -- 172.21.15.78:0/170840069 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f164c010da0 con 0x7f165006f660 2023-12-12T10:12:06.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.859+0000 7f1656ad6640 1 -- 172.21.15.78:0/170840069 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f165015b230 con 0x7f165006f660 2023-12-12T10:12:06.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.859+0000 7f1656ad6640 1 -- 172.21.15.78:0/170840069 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f165015a960 con 0x7f165006f660 2023-12-12T10:12:06.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.859+0000 7f1656ad6640 1 -- 172.21.15.78:0/170840069 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1650067530 con 0x7f165006f660 2023-12-12T10:12:06.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.859+0000 7f16457fa640 1 -- 172.21.15.78:0/170840069 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f164c00f3c0 con 0x7f165006f660 2023-12-12T10:12:06.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.859+0000 7f16457fa640 1 --2- 172.21.15.78:0/170840069 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f163c066470 0x7f163c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:06.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.859+0000 7f16457fa640 1 -- 172.21.15.78:0/170840069 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f164c083a70 con 0x7f165006f660 2023-12-12T10:12:06.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.863+0000 7f1647fff640 1 --2- 172.21.15.78:0/170840069 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f163c066470 0x7f163c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:06.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.863+0000 7f1647fff640 1 --2- 172.21.15.78:0/170840069 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f163c066470 0x7f163c068930 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f165015c2f0 tx=0x7f1640008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:06.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:06.863+0000 7f16457fa640 1 -- 172.21.15.78:0/170840069 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f164c0512f0 con 0x7f165006f660 2023-12-12T10:12:06.997 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T10:12:07.001 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T10:12:07.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.015+0000 7f1656ad6640 1 -- 172.21.15.78:0/170840069 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f16500d0950 con 0x7f165006f660 2023-12-12T10:12:07.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.019+0000 7f16457fa640 1 -- 172.21.15.78:0/170840069 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) v1 ==== 84+0+65 (secure 0 0 0) 0x7f164c014060 con 0x7f165006f660 2023-12-12T10:12:07.022 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:12:07.023 INFO:teuthology.orchestra.run.smithi078.stdout:[ 2023-12-12T10:12:07.023 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-12-12T10:12:07.023 INFO:teuthology.orchestra.run.smithi078.stdout: "poolnum": 1, 2023-12-12T10:12:07.023 INFO:teuthology.orchestra.run.smithi078.stdout: "poolname": ".mgr" 2023-12-12T10:12:07.023 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-12-12T10:12:07.023 INFO:teuthology.orchestra.run.smithi078.stdout:] 2023-12-12T10:12:07.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.019+0000 7f1656ad6640 1 -- 172.21.15.78:0/170840069 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f163c066470 msgr2=0x7f163c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:07.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.019+0000 7f1656ad6640 1 --2- 172.21.15.78:0/170840069 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f163c066470 0x7f163c068930 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f165015c2f0 tx=0x7f1640008040 comp rx=0 tx=0).stop 2023-12-12T10:12:07.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.019+0000 7f1656ad6640 1 -- 172.21.15.78:0/170840069 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f165006f660 msgr2=0x7f1650158c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:07.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.019+0000 7f1656ad6640 1 --2- 172.21.15.78:0/170840069 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f165006f660 0x7f1650158c70 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f164c00b550 tx=0x7f164c00ba10 comp rx=0 tx=0).stop 2023-12-12T10:12:07.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.019+0000 7f1656ad6640 1 -- 172.21.15.78:0/170840069 shutdown_connections 2023-12-12T10:12:07.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.019+0000 7f1656ad6640 1 --2- 172.21.15.78:0/170840069 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f163c066470 0x7f163c068930 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:07.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.019+0000 7f1656ad6640 1 --2- 172.21.15.78:0/170840069 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f165015d4a0 0x7f16501537f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:07.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.019+0000 7f1656ad6640 1 --2- 172.21.15.78:0/170840069 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f165015d0c0 0x7f16501580e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:07.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.019+0000 7f1656ad6640 1 --2- 172.21.15.78:0/170840069 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f165006f660 0x7f1650158c70 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:07.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.019+0000 7f1656ad6640 1 -- 172.21.15.78:0/170840069 >> 172.21.15.78:0/170840069 conn(0x7f16500d0e30 msgr2=0x7f16500af820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:07.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.019+0000 7f1656ad6640 1 -- 172.21.15.78:0/170840069 shutdown_connections 2023-12-12T10:12:07.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.019+0000 7f1656ad6640 1 -- 172.21.15.78:0/170840069 wait complete. 2023-12-12T10:12:07.043 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-12T10:12:07.043 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-12T10:12:07.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.239+0000 7f87c38bb640 1 Processor -- start 2023-12-12T10:12:07.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.243+0000 7f87c38bb640 1 -- start start 2023-12-12T10:12:07.247 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.243+0000 7f87c38bb640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f87bc15d070 0x7f87bc15d450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:07.247 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.243+0000 7f87c38bb640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f87bc0d3730 0x7f87bc0cf980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:07.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.243+0000 7f87c38bb640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87bc0d3ef0 con 0x7f87bc0cfec0 2023-12-12T10:12:07.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.243+0000 7f87c38bb640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87bc0d0330 con 0x7f87bc0d3730 2023-12-12T10:12:07.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.243+0000 7f87c38bb640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87bc0ce6e0 con 0x7f87bc15d070 2023-12-12T10:12:07.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.243+0000 7f87c1e58640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f87bc0cfec0 0x7f87bc0b2ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:44470/0 (socket says 172.21.15.78:44470) 2023-12-12T10:12:07.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.243+0000 7f87c1e58640 1 -- 172.21.15.78:0/1945370765 learned_addr learned my addr 172.21.15.78:0/1945370765 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-12-12T10:12:07.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.243+0000 7f87c0e56640 1 --2- 172.21.15.78:0/1945370765 >> v2:172.21.15.187:3300/0 conn(0x7f87bc0d3730 0x7f87bc0cf980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:07.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.243+0000 7f87b3fff640 1 -- 172.21.15.78:0/1945370765 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 503402515 0 0) 0x7f87bc0d3ef0 con 0x7f87bc0cfec0 2023-12-12T10:12:07.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.243+0000 7f87c1657640 1 --2- 172.21.15.78:0/1945370765 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f87bc15d070 0x7f87bc15d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:07.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.243+0000 7f87b3fff640 1 -- 172.21.15.78:0/1945370765 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87a8003530 con 0x7f87bc0cfec0 2023-12-12T10:12:07.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.243+0000 7f87b3fff640 1 -- 172.21.15.78:0/1945370765 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 470654432 0 0) 0x7f87a8003530 con 0x7f87bc0cfec0 2023-12-12T10:12:07.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.243+0000 7f87b3fff640 1 -- 172.21.15.78:0/1945370765 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f87bc15d070 msgr2=0x7f87bc15d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:07.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.243+0000 7f87b3fff640 1 --2- 172.21.15.78:0/1945370765 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f87bc15d070 0x7f87bc15d450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:07.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.243+0000 7f87b3fff640 1 -- 172.21.15.78:0/1945370765 >> v2:172.21.15.187:3300/0 conn(0x7f87bc0d3730 msgr2=0x7f87bc0cf980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:07.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.243+0000 7f87b3fff640 1 --2- 172.21.15.78:0/1945370765 >> v2:172.21.15.187:3300/0 conn(0x7f87bc0d3730 0x7f87bc0cf980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:07.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.243+0000 7f87b3fff640 1 -- 172.21.15.78:0/1945370765 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87bc0ce9c0 con 0x7f87bc0cfec0 2023-12-12T10:12:07.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.243+0000 7f87b3fff640 1 -- 172.21.15.78:0/1945370765 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 465499599 0 0) 0x7f87b4001a00 con 0x7f87bc0cfec0 2023-12-12T10:12:07.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.243+0000 7f87b3fff640 1 -- 172.21.15.78:0/1945370765 >> v1:172.21.15.78:6789/0 conn(0x7f87bc0cfec0 legacy=0x7f87bc0b2ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:07.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.243+0000 7f87b3fff640 1 --2- 172.21.15.78:0/1945370765 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f87a8003980 0x7f87a8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:07.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.243+0000 7f87b3fff640 1 --2- 172.21.15.78:0/1945370765 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f87bc15d070 0x7f87a80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:07.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.243+0000 7f87b3fff640 1 --2- 172.21.15.78:0/1945370765 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f87a8004d10 0x7f87a8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:07.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.243+0000 7f87b3fff640 1 -- 172.21.15.78:0/1945370765 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87bc0d0330 con 0x7f87a8003980 2023-12-12T10:12:07.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.243+0000 7f87b3fff640 1 -- 172.21.15.78:0/1945370765 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87bc0ce6e0 con 0x7f87a8004d10 2023-12-12T10:12:07.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.243+0000 7f87b3fff640 1 -- 172.21.15.78:0/1945370765 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87a800b990 con 0x7f87bc15d070 2023-12-12T10:12:07.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.243+0000 7f87c1657640 1 --2- 172.21.15.78:0/1945370765 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f87a8003980 0x7f87a8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:07.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.243+0000 7f87c0e56640 1 --2- 172.21.15.78:0/1945370765 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f87bc15d070 0x7f87a80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:07.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.243+0000 7f87c1e58640 1 --2- 172.21.15.78:0/1945370765 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f87a8004d10 0x7f87a8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:07.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.243+0000 7f87c1657640 1 -- 172.21.15.78:0/1945370765 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f87bc15d070 msgr2=0x7f87a80047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:07.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.243+0000 7f87c1657640 1 --2- 172.21.15.78:0/1945370765 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f87bc15d070 0x7f87a80047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:07.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.243+0000 7f87c1657640 1 -- 172.21.15.78:0/1945370765 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f87a8004d10 msgr2=0x7f87a8005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:07.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.243+0000 7f87c1657640 1 --2- 172.21.15.78:0/1945370765 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f87a8004d10 0x7f87a8005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:07.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.243+0000 7f87c1657640 1 -- 172.21.15.78:0/1945370765 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87a8003530 con 0x7f87a8003980 2023-12-12T10:12:07.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.247+0000 7f87c1657640 1 --2- 172.21.15.78:0/1945370765 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f87a8003980 0x7f87a8003da0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f87b8009ae0 tx=0x7f87b801ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e02abaf0aa1d643 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:07.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.247+0000 7f87b3fff640 1 -- 172.21.15.78:0/1945370765 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87b80a6510 con 0x7f87a8003980 2023-12-12T10:12:07.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.247+0000 7f87b3fff640 1 -- 172.21.15.78:0/1945370765 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87b80a6670 con 0x7f87a8003980 2023-12-12T10:12:07.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.247+0000 7f87b3fff640 1 -- 172.21.15.78:0/1945370765 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87b80a6a20 con 0x7f87a8003980 2023-12-12T10:12:07.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.247+0000 7f87c38bb640 1 -- 172.21.15.78:0/1945370765 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f87a8003980 msgr2=0x7f87a8003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:07.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.247+0000 7f87c38bb640 1 --2- 172.21.15.78:0/1945370765 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f87a8003980 0x7f87a8003da0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f87b8009ae0 tx=0x7f87b801ca20 comp rx=0 tx=0).stop 2023-12-12T10:12:07.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.247+0000 7f87c1e58640 1 -- 172.21.15.78:0/1945370765 reap_dead start 2023-12-12T10:12:07.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.247+0000 7f87c38bb640 1 -- 172.21.15.78:0/1945370765 shutdown_connections 2023-12-12T10:12:07.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.247+0000 7f87c38bb640 1 -- 172.21.15.78:0/1945370765 >> 172.21.15.78:0/1945370765 conn(0x7f87bc09c360 msgr2=0x7f87bc0d3020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:07.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.247+0000 7f87c38bb640 1 -- 172.21.15.78:0/1945370765 shutdown_connections 2023-12-12T10:12:07.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.247+0000 7f87c38bb640 1 -- 172.21.15.78:0/1945370765 wait complete. 2023-12-12T10:12:07.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.251+0000 7f87c38bb640 1 Processor -- start 2023-12-12T10:12:07.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.251+0000 7f87c38bb640 1 -- start start 2023-12-12T10:12:07.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.251+0000 7f87c38bb640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f87a8003980 0x7f87bc0ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:07.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.251+0000 7f87c38bb640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f87bc0cb4f0 0x7f87bc0c7de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:07.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.251+0000 7f87c38bb640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f87bc14c3d0 0x7f87bc15e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:07.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.251+0000 7f87c38bb640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87bc0cba20 con 0x7f87a8003980 2023-12-12T10:12:07.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.251+0000 7f87c38bb640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87bc0cbd00 con 0x7f87bc0cb4f0 2023-12-12T10:12:07.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.251+0000 7f87c38bb640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87bc0cbfe0 con 0x7f87bc14c3d0 2023-12-12T10:12:07.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.251+0000 7f87c1657640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f87a8003980 0x7f87bc0ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:07.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.251+0000 7f87c1657640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f87a8003980 0x7f87bc0ccac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54738/0 (socket says 172.21.15.78:54738) 2023-12-12T10:12:07.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.251+0000 7f87c1657640 1 -- 172.21.15.78:0/3027538133 learned_addr learned my addr 172.21.15.78:0/3027538133 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:07.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.251+0000 7f87c1657640 1 -- 172.21.15.78:0/3027538133 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f87bc14c3d0 msgr2=0x7f87bc15e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:07.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.251+0000 7f87c1657640 1 --2- 172.21.15.78:0/3027538133 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f87bc14c3d0 0x7f87bc15e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:07.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.251+0000 7f87c1657640 1 -- 172.21.15.78:0/3027538133 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f87bc0cb4f0 msgr2=0x7f87bc0c7de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:07.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.251+0000 7f87c1657640 1 --2- 172.21.15.78:0/3027538133 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f87bc0cb4f0 0x7f87bc0c7de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:07.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.251+0000 7f87c1657640 1 -- 172.21.15.78:0/3027538133 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87bc0cc2c0 con 0x7f87a8003980 2023-12-12T10:12:07.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.251+0000 7f87c1657640 1 --2- 172.21.15.78:0/3027538133 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f87a8003980 0x7f87bc0ccac0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f87b80b0040 tx=0x7f87a8005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:07.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.251+0000 7f87b1ffb640 1 -- 172.21.15.78:0/3027538133 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87b800f000 con 0x7f87a8003980 2023-12-12T10:12:07.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.251+0000 7f87b1ffb640 1 -- 172.21.15.78:0/3027538133 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87b8004020 con 0x7f87a8003980 2023-12-12T10:12:07.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.251+0000 7f87c38bb640 1 -- 172.21.15.78:0/3027538133 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87bc0cc5a0 con 0x7f87a8003980 2023-12-12T10:12:07.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.251+0000 7f87b1ffb640 1 -- 172.21.15.78:0/3027538133 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87b80043b0 con 0x7f87a8003980 2023-12-12T10:12:07.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.251+0000 7f87c38bb640 1 -- 172.21.15.78:0/3027538133 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87bc14c850 con 0x7f87a8003980 2023-12-12T10:12:07.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.251+0000 7f87c38bb640 1 -- 172.21.15.78:0/3027538133 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87bc0671f0 con 0x7f87a8003980 2023-12-12T10:12:07.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.255+0000 7f87b1ffb640 1 -- 172.21.15.78:0/3027538133 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f87b80a67e0 con 0x7f87a8003980 2023-12-12T10:12:07.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.255+0000 7f87b1ffb640 1 --2- 172.21.15.78:0/3027538133 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f87a00664f0 0x7f87a00689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:07.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.255+0000 7f87b1ffb640 1 -- 172.21.15.78:0/3027538133 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f87b80aa070 con 0x7f87a8003980 2023-12-12T10:12:07.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.255+0000 7f87c0e56640 1 --2- 172.21.15.78:0/3027538133 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f87a00664f0 0x7f87a00689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:07.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.255+0000 7f87c0e56640 1 --2- 172.21.15.78:0/3027538133 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f87a00664f0 0x7f87a00689b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f87ac006e90 tx=0x7f87ac006e00 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:07.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.259+0000 7f87b1ffb640 1 -- 172.21.15.78:0/3027538133 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f87b80eb560 con 0x7f87a8003980 2023-12-12T10:12:07.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.407+0000 7f87c38bb640 1 -- 172.21.15.78:0/3027538133 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f87bc0736a0 con 0x7f87a8003980 2023-12-12T10:12:07.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.791+0000 7f87b1ffb640 1 -- 172.21.15.78:0/3027538133 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) v1 ==== 138+0+0 (secure 0 0 0) 0x7f87b80be070 con 0x7f87a8003980 2023-12-12T10:12:07.798 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_metadata' created 2023-12-12T10:12:07.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.795+0000 7f87c38bb640 1 -- 172.21.15.78:0/3027538133 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f87a00664f0 msgr2=0x7f87a00689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:07.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.795+0000 7f87c38bb640 1 --2- 172.21.15.78:0/3027538133 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f87a00664f0 0x7f87a00689b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f87ac006e90 tx=0x7f87ac006e00 comp rx=0 tx=0).stop 2023-12-12T10:12:07.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.795+0000 7f87c38bb640 1 -- 172.21.15.78:0/3027538133 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f87a8003980 msgr2=0x7f87bc0ccac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:07.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.795+0000 7f87c38bb640 1 --2- 172.21.15.78:0/3027538133 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f87a8003980 0x7f87bc0ccac0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f87b80b0040 tx=0x7f87a8005800 comp rx=0 tx=0).stop 2023-12-12T10:12:07.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.795+0000 7f87c38bb640 1 -- 172.21.15.78:0/3027538133 shutdown_connections 2023-12-12T10:12:07.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.795+0000 7f87c38bb640 1 --2- 172.21.15.78:0/3027538133 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f87a00664f0 0x7f87a00689b0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:07.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.795+0000 7f87c38bb640 1 --2- 172.21.15.78:0/3027538133 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f87bc14c3d0 0x7f87bc15e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:07.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.795+0000 7f87c38bb640 1 --2- 172.21.15.78:0/3027538133 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f87bc0cb4f0 0x7f87bc0c7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:07.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.795+0000 7f87c38bb640 1 --2- 172.21.15.78:0/3027538133 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f87a8003980 0x7f87bc0ccac0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:07.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.795+0000 7f87c38bb640 1 -- 172.21.15.78:0/3027538133 >> 172.21.15.78:0/3027538133 conn(0x7f87bc09c360 msgr2=0x7f87bc0aff80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:07.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.795+0000 7f87c38bb640 1 -- 172.21.15.78:0/3027538133 shutdown_connections 2023-12-12T10:12:07.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.795+0000 7f87c38bb640 1 -- 172.21.15.78:0/3027538133 wait complete. 2023-12-12T10:12:07.826 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2023-12-12T10:12:07.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.963+0000 7f3e8379d640 1 Processor -- start 2023-12-12T10:12:07.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.963+0000 7f3e8379d640 1 -- start start 2023-12-12T10:12:07.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.967+0000 7f3e8379d640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f3e7c0cb4b0 0x7f3e7c15f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:07.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.967+0000 7f3e8379d640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3e7c15baa0 0x7f3e7c06ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:07.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.967+0000 7f3e8379d640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e7c0cea30 con 0x7f3e7c06c850 2023-12-12T10:12:07.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.967+0000 7f3e8379d640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e7c06d200 con 0x7f3e7c0cb4b0 2023-12-12T10:12:07.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.967+0000 7f3e8379d640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e7c15bfc0 con 0x7f3e7c15baa0 2023-12-12T10:12:07.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.967+0000 7f3e81539640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f3e7c0cb4b0 0x7f3e7c15f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:07.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.967+0000 7f3e81d3a640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3e7c15baa0 0x7f3e7c06ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:07.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.967+0000 7f3e81539640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f3e7c0cb4b0 0x7f3e7c15f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.78:51542/0 (socket says 172.21.15.78:51542) 2023-12-12T10:12:07.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.967+0000 7f3e81539640 1 -- 172.21.15.78:0/2122280774 learned_addr learned my addr 172.21.15.78:0/2122280774 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:07.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.967+0000 7f3e80d38640 1 --1- 172.21.15.78:0/2122280774 >> v1:172.21.15.187:6789/0 conn(0x7f3e7c06c850 0x7f3e7c15b390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.78:35160/0 (socket says 172.21.15.78:35160) 2023-12-12T10:12:07.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.967+0000 7f3e81539640 1 -- 172.21.15.78:0/2122280774 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3e7c15baa0 msgr2=0x7f3e7c06ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:07.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.967+0000 7f3e81539640 1 --2- 172.21.15.78:0/2122280774 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3e7c15baa0 0x7f3e7c06ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:07.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.967+0000 7f3e81539640 1 -- 172.21.15.78:0/2122280774 >> v1:172.21.15.187:6789/0 conn(0x7f3e7c06c850 legacy=0x7f3e7c15b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:07.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.967+0000 7f3e81539640 1 -- 172.21.15.78:0/2122280774 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e7c15c2a0 con 0x7f3e7c0cb4b0 2023-12-12T10:12:07.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.971+0000 7f3e81539640 1 --2- 172.21.15.78:0/2122280774 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3e7c0cb4b0 0x7f3e7c15f500 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3e78009870 tx=0x7f3e7801c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ec05788b0680ee server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:07.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.971+0000 7f3e73fff640 1 -- 172.21.15.78:0/2122280774 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e780ab680 con 0x7f3e7c0cb4b0 2023-12-12T10:12:07.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.971+0000 7f3e73fff640 1 -- 172.21.15.78:0/2122280774 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e780ab7e0 con 0x7f3e7c0cb4b0 2023-12-12T10:12:07.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.971+0000 7f3e73fff640 1 -- 172.21.15.78:0/2122280774 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e780abb70 con 0x7f3e7c0cb4b0 2023-12-12T10:12:07.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.971+0000 7f3e8379d640 1 -- 172.21.15.78:0/2122280774 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3e7c0cb4b0 msgr2=0x7f3e7c15f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:07.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.971+0000 7f3e8379d640 1 --2- 172.21.15.78:0/2122280774 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3e7c0cb4b0 0x7f3e7c15f500 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3e78009870 tx=0x7f3e7801c480 comp rx=0 tx=0).stop 2023-12-12T10:12:07.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.971+0000 7f3e8379d640 1 -- 172.21.15.78:0/2122280774 shutdown_connections 2023-12-12T10:12:07.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.971+0000 7f3e8379d640 1 --2- 172.21.15.78:0/2122280774 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3e7c15baa0 0x7f3e7c06ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:07.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.971+0000 7f3e8379d640 1 --2- 172.21.15.78:0/2122280774 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3e7c0cb4b0 0x7f3e7c15f500 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:07.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.971+0000 7f3e8379d640 1 -- 172.21.15.78:0/2122280774 >> 172.21.15.78:0/2122280774 conn(0x7f3e7c06a710 msgr2=0x7f3e7c06ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:07.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.971+0000 7f3e8379d640 1 -- 172.21.15.78:0/2122280774 shutdown_connections 2023-12-12T10:12:07.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.971+0000 7f3e8379d640 1 -- 172.21.15.78:0/2122280774 wait complete. 2023-12-12T10:12:07.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.971+0000 7f3e8379d640 1 Processor -- start 2023-12-12T10:12:07.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.975+0000 7f3e8379d640 1 -- start start 2023-12-12T10:12:07.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.975+0000 7f3e8379d640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3e7c06c850 0x7f3e7c14dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:07.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.975+0000 7f3e8379d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3e7c0cb4b0 0x7f3e7c150eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:07.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.975+0000 7f3e8379d640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3e7c15baa0 0x7f3e7c154b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:07.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.975+0000 7f3e8379d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e7c14ca40 con 0x7f3e7c0cb4b0 2023-12-12T10:12:07.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.975+0000 7f3e8379d640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e7c14cd20 con 0x7f3e7c06c850 2023-12-12T10:12:07.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.975+0000 7f3e8379d640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e7c14d000 con 0x7f3e7c15baa0 2023-12-12T10:12:07.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.975+0000 7f3e80d38640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3e7c0cb4b0 0x7f3e7c150eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:07.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.975+0000 7f3e80d38640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3e7c0cb4b0 0x7f3e7c150eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54748/0 (socket says 172.21.15.78:54748) 2023-12-12T10:12:07.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.975+0000 7f3e80d38640 1 -- 172.21.15.78:0/3730946271 learned_addr learned my addr 172.21.15.78:0/3730946271 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:07.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.975+0000 7f3e81539640 1 --2- 172.21.15.78:0/3730946271 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3e7c06c850 0x7f3e7c14dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:07.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.975+0000 7f3e81d3a640 1 --2- 172.21.15.78:0/3730946271 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3e7c15baa0 0x7f3e7c154b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:07.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.975+0000 7f3e80d38640 1 -- 172.21.15.78:0/3730946271 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3e7c15baa0 msgr2=0x7f3e7c154b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:07.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.975+0000 7f3e80d38640 1 --2- 172.21.15.78:0/3730946271 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3e7c15baa0 0x7f3e7c154b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:07.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.975+0000 7f3e80d38640 1 -- 172.21.15.78:0/3730946271 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3e7c06c850 msgr2=0x7f3e7c14dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:07.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.975+0000 7f3e80d38640 1 --2- 172.21.15.78:0/3730946271 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3e7c06c850 0x7f3e7c14dae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:07.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.975+0000 7f3e80d38640 1 -- 172.21.15.78:0/3730946271 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e780094d0 con 0x7f3e7c0cb4b0 2023-12-12T10:12:07.982 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.975+0000 7f3e80d38640 1 --2- 172.21.15.78:0/3730946271 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3e7c0cb4b0 0x7f3e7c150eb0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3e6c00c490 tx=0x7f3e6c00c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:07.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.975+0000 7f3e71ffb640 1 -- 172.21.15.78:0/3730946271 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e6c007480 con 0x7f3e7c0cb4b0 2023-12-12T10:12:07.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.975+0000 7f3e71ffb640 1 -- 172.21.15.78:0/3730946271 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e6c0075e0 con 0x7f3e7c0cb4b0 2023-12-12T10:12:07.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.975+0000 7f3e71ffb640 1 -- 172.21.15.78:0/3730946271 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e6c004a10 con 0x7f3e7c0cb4b0 2023-12-12T10:12:07.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.975+0000 7f3e8379d640 1 -- 172.21.15.78:0/3730946271 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e7c14d2e0 con 0x7f3e7c0cb4b0 2023-12-12T10:12:07.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.975+0000 7f3e8379d640 1 -- 172.21.15.78:0/3730946271 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e7c1513f0 con 0x7f3e7c0cb4b0 2023-12-12T10:12:07.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.975+0000 7f3e8379d640 1 -- 172.21.15.78:0/3730946271 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e7c0671f0 con 0x7f3e7c0cb4b0 2023-12-12T10:12:07.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.979+0000 7f3e71ffb640 1 -- 172.21.15.78:0/3730946271 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3e6c004b70 con 0x7f3e7c0cb4b0 2023-12-12T10:12:07.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.979+0000 7f3e71ffb640 1 --2- 172.21.15.78:0/3730946271 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f3e60066470 0x7f3e60068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:07.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.979+0000 7f3e71ffb640 1 -- 172.21.15.78:0/3730946271 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f3e6c082e80 con 0x7f3e7c0cb4b0 2023-12-12T10:12:07.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.979+0000 7f3e81539640 1 --2- 172.21.15.78:0/3730946271 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f3e60066470 0x7f3e60068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:07.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.979+0000 7f3e81539640 1 --2- 172.21.15.78:0/3730946271 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f3e60066470 0x7f3e60068930 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3e780af000 tx=0x7f3e780a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:07.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:07.983+0000 7f3e71ffb640 1 -- 172.21.15.78:0/3730946271 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3e6c0504e0 con 0x7f3e7c0cb4b0 2023-12-12T10:12:08.140 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:08.135+0000 7f3e8379d640 1 -- 172.21.15.78:0/3730946271 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7f3e7c067530 con 0x7f3e7c0cb4b0 2023-12-12T10:12:08.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:08.803+0000 7f3e71ffb640 1 -- 172.21.15.78:0/3730946271 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v18) v1 ==== 171+0+0 (secure 0 0 0) 0x7f3e6c018020 con 0x7f3e7c0cb4b0 2023-12-12T10:12:08.807 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_data' created 2023-12-12T10:12:08.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:08.803+0000 7f3e8379d640 1 -- 172.21.15.78:0/3730946271 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f3e60066470 msgr2=0x7f3e60068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:08.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:08.803+0000 7f3e8379d640 1 --2- 172.21.15.78:0/3730946271 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f3e60066470 0x7f3e60068930 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3e780af000 tx=0x7f3e780a7000 comp rx=0 tx=0).stop 2023-12-12T10:12:08.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:08.803+0000 7f3e8379d640 1 -- 172.21.15.78:0/3730946271 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3e7c0cb4b0 msgr2=0x7f3e7c150eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:08.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:08.803+0000 7f3e8379d640 1 --2- 172.21.15.78:0/3730946271 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3e7c0cb4b0 0x7f3e7c150eb0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3e6c00c490 tx=0x7f3e6c00c950 comp rx=0 tx=0).stop 2023-12-12T10:12:08.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:08.803+0000 7f3e8379d640 1 -- 172.21.15.78:0/3730946271 shutdown_connections 2023-12-12T10:12:08.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:08.803+0000 7f3e8379d640 1 --2- 172.21.15.78:0/3730946271 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f3e60066470 0x7f3e60068930 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:08.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:08.803+0000 7f3e8379d640 1 --2- 172.21.15.78:0/3730946271 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3e7c15baa0 0x7f3e7c154b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:08.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:08.803+0000 7f3e8379d640 1 --2- 172.21.15.78:0/3730946271 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3e7c0cb4b0 0x7f3e7c150eb0 secure :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3e6c00c490 tx=0x7f3e6c00c950 comp rx=0 tx=0).stop 2023-12-12T10:12:08.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:08.803+0000 7f3e8379d640 1 --2- 172.21.15.78:0/3730946271 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3e7c06c850 0x7f3e7c14dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:08.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:08.803+0000 7f3e8379d640 1 -- 172.21.15.78:0/3730946271 >> 172.21.15.78:0/3730946271 conn(0x7f3e7c06a710 msgr2=0x7f3e7c0cc7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:08.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:08.807+0000 7f3e8379d640 1 -- 172.21.15.78:0/3730946271 shutdown_connections 2023-12-12T10:12:08.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:08.807+0000 7f3e8379d640 1 -- 172.21.15.78:0/3730946271 wait complete. 2023-12-12T10:12:08.856 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-12T10:12:08.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:08.995+0000 7f0405d65640 1 Processor -- start 2023-12-12T10:12:09.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:08.995+0000 7f0405d65640 1 -- start start 2023-12-12T10:12:09.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:08.995+0000 7f0405d65640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f040006cf60 0x7f040015f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:09.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:08.995+0000 7f0405d65640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04000cea30 con 0x7f040015b390 2023-12-12T10:12:09.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:08.995+0000 7f0405d65640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f040015bfc0 con 0x7f04000cb4b0 2023-12-12T10:12:09.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:08.995+0000 7f0405d65640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f040015c2a0 con 0x7f040006cf60 2023-12-12T10:12:09.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:08.995+0000 7f03feffd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f040006cf60 0x7f040015f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:09.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:08.995+0000 7f03feffd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f040006cf60 0x7f040015f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54762/0 (socket says 172.21.15.78:54762) 2023-12-12T10:12:09.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:08.995+0000 7f03feffd640 1 -- 172.21.15.78:0/2327941084 learned_addr learned my addr 172.21.15.78:0/2327941084 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:09.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:08.995+0000 7f03fffff640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f040015b390 0x7f04000714e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:44478/0 (socket says 172.21.15.78:44478) 2023-12-12T10:12:09.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:08.995+0000 7f03feffd640 1 -- 172.21.15.78:0/2327941084 >> v1:172.21.15.187:6789/0 conn(0x7f04000cb4b0 legacy=0x7f040006c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:09.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:08.995+0000 7f03feffd640 1 -- 172.21.15.78:0/2327941084 >> v1:172.21.15.78:6789/0 conn(0x7f040015b390 legacy=0x7f04000714e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:09.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:08.995+0000 7f03feffd640 1 -- 172.21.15.78:0/2327941084 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f040015ea20 con 0x7f040006cf60 2023-12-12T10:12:09.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:08.999+0000 7f03feffd640 1 --2- 172.21.15.78:0/2327941084 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f040006cf60 0x7f040015f500 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f03f4009870 tx=0x7f03f401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3fad0f11f6f2297 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:09.005 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:08.999+0000 7f03fe7fc640 1 -- 172.21.15.78:0/2327941084 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03f40ab680 con 0x7f040006cf60 2023-12-12T10:12:09.005 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:08.999+0000 7f03fe7fc640 1 -- 172.21.15.78:0/2327941084 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03f40ab7e0 con 0x7f040006cf60 2023-12-12T10:12:09.005 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:08.999+0000 7f03fe7fc640 1 -- 172.21.15.78:0/2327941084 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03f40abb70 con 0x7f040006cf60 2023-12-12T10:12:09.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:08.999+0000 7f0405d65640 1 -- 172.21.15.78:0/2327941084 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f040006cf60 msgr2=0x7f040015f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:09.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:08.999+0000 7f0405d65640 1 --2- 172.21.15.78:0/2327941084 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f040006cf60 0x7f040015f500 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f03f4009870 tx=0x7f03f401c480 comp rx=0 tx=0).stop 2023-12-12T10:12:09.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:08.999+0000 7f0405d65640 1 -- 172.21.15.78:0/2327941084 shutdown_connections 2023-12-12T10:12:09.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:08.999+0000 7f0405d65640 1 --2- 172.21.15.78:0/2327941084 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f040006cf60 0x7f040015f500 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:09.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:08.999+0000 7f0405d65640 1 -- 172.21.15.78:0/2327941084 >> 172.21.15.78:0/2327941084 conn(0x7f040006a710 msgr2=0x7f040006ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:09.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:08.999+0000 7f0405d65640 1 -- 172.21.15.78:0/2327941084 shutdown_connections 2023-12-12T10:12:09.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:08.999+0000 7f0405d65640 1 -- 172.21.15.78:0/2327941084 wait complete. 2023-12-12T10:12:09.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:09.003+0000 7f0405d65640 1 Processor -- start 2023-12-12T10:12:09.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:09.003+0000 7f0405d65640 1 -- start start 2023-12-12T10:12:09.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:09.003+0000 7f0405d65640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f040006cf60 0x7f0400144d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:09.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:09.003+0000 7f0405d65640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f04000cb4b0 0x7f04001fb110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:09.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:09.003+0000 7f0405d65640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f040015b390 0x7f040014d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:09.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:09.003+0000 7f0405d65640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04001fa700 con 0x7f04000cb4b0 2023-12-12T10:12:09.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:09.003+0000 7f0405d65640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0400145240 con 0x7f040015b390 2023-12-12T10:12:09.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:09.003+0000 7f0405d65640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0400154b00 con 0x7f040006cf60 2023-12-12T10:12:09.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:09.003+0000 7f03feffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f04000cb4b0 0x7f04001fb110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:09.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:09.003+0000 7f03feffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f04000cb4b0 0x7f04001fb110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54764/0 (socket says 172.21.15.78:54764) 2023-12-12T10:12:09.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:09.003+0000 7f03feffd640 1 -- 172.21.15.78:0/2113912363 learned_addr learned my addr 172.21.15.78:0/2113912363 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:09.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:09.003+0000 7f03fffff640 1 --2- 172.21.15.78:0/2113912363 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f040015b390 0x7f040014d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:09.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:09.003+0000 7f03ff7fe640 1 --2- 172.21.15.78:0/2113912363 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f040006cf60 0x7f0400144d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:09.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:09.003+0000 7f03feffd640 1 -- 172.21.15.78:0/2113912363 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f040006cf60 msgr2=0x7f0400144d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:09.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:09.003+0000 7f03feffd640 1 --2- 172.21.15.78:0/2113912363 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f040006cf60 0x7f0400144d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:09.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:09.003+0000 7f03feffd640 1 -- 172.21.15.78:0/2113912363 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f040015b390 msgr2=0x7f040014d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:09.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:09.003+0000 7f03feffd640 1 --2- 172.21.15.78:0/2113912363 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f040015b390 0x7f040014d410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:09.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:09.003+0000 7f03feffd640 1 -- 172.21.15.78:0/2113912363 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03f40094d0 con 0x7f04000cb4b0 2023-12-12T10:12:09.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:09.003+0000 7f03feffd640 1 --2- 172.21.15.78:0/2113912363 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f04000cb4b0 0x7f04001fb110 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f03f40ad040 tx=0x7f03f401acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:09.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:09.003+0000 7f03e7fff640 1 -- 172.21.15.78:0/2113912363 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03f40b48c0 con 0x7f04000cb4b0 2023-12-12T10:12:09.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:09.003+0000 7f03e7fff640 1 -- 172.21.15.78:0/2113912363 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03f40b4a40 con 0x7f04000cb4b0 2023-12-12T10:12:09.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:09.003+0000 7f03e7fff640 1 -- 172.21.15.78:0/2113912363 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03f40b4df0 con 0x7f04000cb4b0 2023-12-12T10:12:09.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:09.003+0000 7f0405d65640 1 -- 172.21.15.78:0/2113912363 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0400154da0 con 0x7f04000cb4b0 2023-12-12T10:12:09.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:09.003+0000 7f0405d65640 1 -- 172.21.15.78:0/2113912363 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04001fa910 con 0x7f04000cb4b0 2023-12-12T10:12:09.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:09.007+0000 7f0405d65640 1 -- 172.21.15.78:0/2113912363 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04000671f0 con 0x7f04000cb4b0 2023-12-12T10:12:09.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:09.007+0000 7f03e7fff640 1 -- 172.21.15.78:0/2113912363 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f03f40c7440 con 0x7f04000cb4b0 2023-12-12T10:12:09.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:09.007+0000 7f03e7fff640 1 --2- 172.21.15.78:0/2113912363 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f03ec066470 0x7f03ec068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:09.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:09.007+0000 7f03e7fff640 1 -- 172.21.15.78:0/2113912363 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f03f411ed20 con 0x7f04000cb4b0 2023-12-12T10:12:09.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:09.007+0000 7f03ff7fe640 1 --2- 172.21.15.78:0/2113912363 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f03ec066470 0x7f03ec068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:09.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:09.007+0000 7f03ff7fe640 1 --2- 172.21.15.78:0/2113912363 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f03ec066470 0x7f03ec068930 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f03f0007fd0 tx=0x7f03f0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:09.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:09.011+0000 7f03e7fff640 1 -- 172.21.15.78:0/2113912363 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f03f40ec2a0 con 0x7f04000cb4b0 2023-12-12T10:12:09.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:09.195+0000 7f0405d65640 1 -- 172.21.15.78:0/2113912363 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f0400155280 con 0x7f04000cb4b0 2023-12-12T10:12:09.911 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:09.907+0000 7f03e7fff640 1 -- 172.21.15.78:0/2113912363 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f0400155280 con 0x7f04000cb4b0 2023-12-12T10:12:09.911 INFO:teuthology.orchestra.run.smithi078.stderr:new fs with metadata pool 2 and data pool 3 2023-12-12T10:12:09.913 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:09.907+0000 7f0405d65640 1 -- 172.21.15.78:0/2113912363 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f03ec066470 msgr2=0x7f03ec068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:09.913 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:09.907+0000 7f0405d65640 1 --2- 172.21.15.78:0/2113912363 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f03ec066470 0x7f03ec068930 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f03f0007fd0 tx=0x7f03f0009040 comp rx=0 tx=0).stop 2023-12-12T10:12:09.914 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:09.907+0000 7f0405d65640 1 -- 172.21.15.78:0/2113912363 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f04000cb4b0 msgr2=0x7f04001fb110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:09.914 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:09.907+0000 7f0405d65640 1 --2- 172.21.15.78:0/2113912363 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f04000cb4b0 0x7f04001fb110 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f03f40ad040 tx=0x7f03f401acc0 comp rx=0 tx=0).stop 2023-12-12T10:12:09.914 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:09.907+0000 7f0405d65640 1 -- 172.21.15.78:0/2113912363 shutdown_connections 2023-12-12T10:12:09.914 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:09.907+0000 7f0405d65640 1 --2- 172.21.15.78:0/2113912363 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f03ec066470 0x7f03ec068930 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:09.914 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:09.907+0000 7f0405d65640 1 --2- 172.21.15.78:0/2113912363 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f040015b390 0x7f040014d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:09.914 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:09.907+0000 7f0405d65640 1 --2- 172.21.15.78:0/2113912363 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f04000cb4b0 0x7f04001fb110 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:09.914 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:09.907+0000 7f0405d65640 1 --2- 172.21.15.78:0/2113912363 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f040006cf60 0x7f0400144d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:09.914 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:09.907+0000 7f0405d65640 1 -- 172.21.15.78:0/2113912363 >> 172.21.15.78:0/2113912363 conn(0x7f040006a710 msgr2=0x7f040014e440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:09.914 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:09.907+0000 7f0405d65640 1 -- 172.21.15.78:0/2113912363 shutdown_connections 2023-12-12T10:12:09.915 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:09.907+0000 7f0405d65640 1 -- 172.21.15.78:0/2113912363 wait complete. 2023-12-12T10:12:09.939 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2023-12-12T10:12:09.940 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2023-12-12T10:12:10.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.075+0000 7f9be079d640 1 Processor -- start 2023-12-12T10:12:10.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.079+0000 7f9be079d640 1 -- start start 2023-12-12T10:12:10.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.079+0000 7f9be079d640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f9bd80cb670 0x7f9bd80ce500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:10.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.079+0000 7f9be079d640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9bd815bdd0 0x7f9bd8071490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:10.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.079+0000 7f9be079d640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bd806d750 con 0x7f9bd80719d0 2023-12-12T10:12:10.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.079+0000 7f9be079d640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bd8071e60 con 0x7f9bd80cb670 2023-12-12T10:12:10.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.079+0000 7f9be079d640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bd8072370 con 0x7f9bd815bdd0 2023-12-12T10:12:10.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.079+0000 7f9bde539640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f9bd80cb670 0x7f9bd80ce500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:10.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.079+0000 7f9bde539640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f9bd80cb670 0x7f9bd80ce500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43178/0 (socket says 172.21.15.78:43178) 2023-12-12T10:12:10.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.079+0000 7f9bde539640 1 -- 172.21.15.78:0/379978734 learned_addr learned my addr 172.21.15.78:0/379978734 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:10.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.079+0000 7f9bddd38640 1 --2- 172.21.15.78:0/379978734 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9bd815bdd0 0x7f9bd8071490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:10.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.079+0000 7f9bde539640 1 -- 172.21.15.78:0/379978734 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9bd815bdd0 msgr2=0x7f9bd8071490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:10.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.079+0000 7f9bde539640 1 --2- 172.21.15.78:0/379978734 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9bd815bdd0 0x7f9bd8071490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:10.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.079+0000 7f9bde539640 1 -- 172.21.15.78:0/379978734 >> v1:172.21.15.78:6789/0 conn(0x7f9bd80719d0 legacy=0x7f9bd815e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:10.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.079+0000 7f9bde539640 1 -- 172.21.15.78:0/379978734 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bd80ceb30 con 0x7f9bd80cb670 2023-12-12T10:12:10.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.083+0000 7f9bde539640 1 --2- 172.21.15.78:0/379978734 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9bd80cb670 0x7f9bd80ce500 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9bd4009870 tx=0x7f9bd401c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a51b8b0d52208f4e server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:10.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.083+0000 7f9bdd537640 1 -- 172.21.15.78:0/379978734 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bd40a7070 con 0x7f9bd80cb670 2023-12-12T10:12:10.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.083+0000 7f9bdd537640 1 -- 172.21.15.78:0/379978734 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bd40ab430 con 0x7f9bd80cb670 2023-12-12T10:12:10.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.083+0000 7f9bdd537640 1 -- 172.21.15.78:0/379978734 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bd40ab7c0 con 0x7f9bd80cb670 2023-12-12T10:12:10.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.083+0000 7f9be079d640 1 -- 172.21.15.78:0/379978734 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9bd80cb670 msgr2=0x7f9bd80ce500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:10.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.083+0000 7f9be079d640 1 --2- 172.21.15.78:0/379978734 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9bd80cb670 0x7f9bd80ce500 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9bd4009870 tx=0x7f9bd401c510 comp rx=0 tx=0).stop 2023-12-12T10:12:10.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.083+0000 7f9be079d640 1 -- 172.21.15.78:0/379978734 shutdown_connections 2023-12-12T10:12:10.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.083+0000 7f9be079d640 1 --2- 172.21.15.78:0/379978734 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9bd815bdd0 0x7f9bd8071490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:10.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.083+0000 7f9be079d640 1 --2- 172.21.15.78:0/379978734 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9bd80cb670 0x7f9bd80ce500 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:10.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.083+0000 7f9be079d640 1 -- 172.21.15.78:0/379978734 >> 172.21.15.78:0/379978734 conn(0x7f9bd806a710 msgr2=0x7f9bd806ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:10.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.083+0000 7f9be079d640 1 -- 172.21.15.78:0/379978734 shutdown_connections 2023-12-12T10:12:10.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.083+0000 7f9be079d640 1 -- 172.21.15.78:0/379978734 wait complete. 2023-12-12T10:12:10.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.083+0000 7f9be079d640 1 Processor -- start 2023-12-12T10:12:10.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.083+0000 7f9be079d640 1 -- start start 2023-12-12T10:12:10.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.087+0000 7f9be079d640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9bd80719d0 0x7f9bd814a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:10.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.087+0000 7f9be079d640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9bd80cb670 0x7f9bd8159fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:10.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.087+0000 7f9be079d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9bd815bdd0 0x7f9bd815a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:10.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.087+0000 7f9be079d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bd8138c20 con 0x7f9bd815bdd0 2023-12-12T10:12:10.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.087+0000 7f9be079d640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bd81508a0 con 0x7f9bd80cb670 2023-12-12T10:12:10.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.087+0000 7f9be079d640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bd81382f0 con 0x7f9bd80719d0 2023-12-12T10:12:10.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.087+0000 7f9bded3a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9bd815bdd0 0x7f9bd815a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:10.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.087+0000 7f9bded3a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9bd815bdd0 0x7f9bd815a510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43192/0 (socket says 172.21.15.78:43192) 2023-12-12T10:12:10.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.087+0000 7f9bded3a640 1 -- 172.21.15.78:0/4194688868 learned_addr learned my addr 172.21.15.78:0/4194688868 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:10.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.087+0000 7f9bddd38640 1 --2- 172.21.15.78:0/4194688868 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9bd80cb670 0x7f9bd8159fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:10.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.087+0000 7f9bde539640 1 --2- 172.21.15.78:0/4194688868 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9bd80719d0 0x7f9bd814a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:10.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.087+0000 7f9bded3a640 1 -- 172.21.15.78:0/4194688868 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9bd80719d0 msgr2=0x7f9bd814a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:10.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.087+0000 7f9bded3a640 1 --2- 172.21.15.78:0/4194688868 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9bd80719d0 0x7f9bd814a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:10.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.087+0000 7f9bded3a640 1 -- 172.21.15.78:0/4194688868 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9bd80cb670 msgr2=0x7f9bd8159fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:10.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.087+0000 7f9bded3a640 1 --2- 172.21.15.78:0/4194688868 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9bd80cb670 0x7f9bd8159fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:10.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.087+0000 7f9bded3a640 1 -- 172.21.15.78:0/4194688868 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bd40094d0 con 0x7f9bd815bdd0 2023-12-12T10:12:10.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.087+0000 7f9bde539640 1 --2- 172.21.15.78:0/4194688868 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9bd80719d0 0x7f9bd814a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T10:12:10.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.087+0000 7f9bddd38640 1 --2- 172.21.15.78:0/4194688868 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9bd80cb670 0x7f9bd8159fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T10:12:10.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.087+0000 7f9bded3a640 1 --2- 172.21.15.78:0/4194688868 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9bd815bdd0 0x7f9bd815a510 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9bd000c6c0 tx=0x7f9bd000cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:10.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.087+0000 7f9bceffd640 1 -- 172.21.15.78:0/4194688868 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bd0003b80 con 0x7f9bd815bdd0 2023-12-12T10:12:10.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.087+0000 7f9bceffd640 1 -- 172.21.15.78:0/4194688868 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bd0003ce0 con 0x7f9bd815bdd0 2023-12-12T10:12:10.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.087+0000 7f9bceffd640 1 -- 172.21.15.78:0/4194688868 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bd00052f0 con 0x7f9bd815bdd0 2023-12-12T10:12:10.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.087+0000 7f9be079d640 1 -- 172.21.15.78:0/4194688868 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bd80ccfd0 con 0x7f9bd815bdd0 2023-12-12T10:12:10.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.087+0000 7f9be079d640 1 -- 172.21.15.78:0/4194688868 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bd81388b0 con 0x7f9bd815bdd0 2023-12-12T10:12:10.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.087+0000 7f9be079d640 1 -- 172.21.15.78:0/4194688868 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bd80671f0 con 0x7f9bd815bdd0 2023-12-12T10:12:10.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.087+0000 7f9bceffd640 1 -- 172.21.15.78:0/4194688868 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9bd0005450 con 0x7f9bd815bdd0 2023-12-12T10:12:10.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.091+0000 7f9bceffd640 1 --2- 172.21.15.78:0/4194688868 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f9bbc066470 0x7f9bbc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:10.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.091+0000 7f9bceffd640 1 -- 172.21.15.78:0/4194688868 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9bd0083c60 con 0x7f9bd815bdd0 2023-12-12T10:12:10.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.091+0000 7f9bde539640 1 --2- 172.21.15.78:0/4194688868 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f9bbc066470 0x7f9bbc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:10.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.091+0000 7f9bde539640 1 --2- 172.21.15.78:0/4194688868 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f9bbc066470 0x7f9bbc068930 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9bd40af000 tx=0x7f9bd4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:10.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.095+0000 7f9bceffd640 1 -- 172.21.15.78:0/4194688868 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9bd00510d0 con 0x7f9bd815bdd0 2023-12-12T10:12:10.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.251+0000 7f9be079d640 1 -- 172.21.15.78:0/4194688868 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7f9bd8067530 con 0x7f9bd815bdd0 2023-12-12T10:12:10.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.807+0000 7f9bceffd640 1 -- 172.21.15.78:0/4194688868 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v20) v1 ==== 157+0+0 (secure 0 0 0) 0x7f9bd00546f0 con 0x7f9bd815bdd0 2023-12-12T10:12:10.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.811+0000 7f9be079d640 1 -- 172.21.15.78:0/4194688868 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f9bbc066470 msgr2=0x7f9bbc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:10.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.811+0000 7f9be079d640 1 --2- 172.21.15.78:0/4194688868 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f9bbc066470 0x7f9bbc068930 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9bd40af000 tx=0x7f9bd4008040 comp rx=0 tx=0).stop 2023-12-12T10:12:10.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.811+0000 7f9be079d640 1 -- 172.21.15.78:0/4194688868 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9bd815bdd0 msgr2=0x7f9bd815a510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:10.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.811+0000 7f9be079d640 1 --2- 172.21.15.78:0/4194688868 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9bd815bdd0 0x7f9bd815a510 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9bd000c6c0 tx=0x7f9bd000cb80 comp rx=0 tx=0).stop 2023-12-12T10:12:10.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.811+0000 7f9be079d640 1 -- 172.21.15.78:0/4194688868 shutdown_connections 2023-12-12T10:12:10.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.811+0000 7f9be079d640 1 --2- 172.21.15.78:0/4194688868 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f9bbc066470 0x7f9bbc068930 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:10.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.811+0000 7f9be079d640 1 --2- 172.21.15.78:0/4194688868 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9bd815bdd0 0x7f9bd815a510 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:10.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.811+0000 7f9be079d640 1 --2- 172.21.15.78:0/4194688868 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9bd80cb670 0x7f9bd8159fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:10.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.811+0000 7f9be079d640 1 --2- 172.21.15.78:0/4194688868 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9bd80719d0 0x7f9bd814a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:10.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.811+0000 7f9be079d640 1 -- 172.21.15.78:0/4194688868 >> 172.21.15.78:0/4194688868 conn(0x7f9bd806a710 msgr2=0x7f9bd815e870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:10.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.811+0000 7f9be079d640 1 -- 172.21.15.78:0/4194688868 shutdown_connections 2023-12-12T10:12:10.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.811+0000 7f9be079d640 1 -- 172.21.15.78:0/4194688868 wait complete. 2023-12-12T10:12:10.837 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2023-12-12T10:12:10.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.979+0000 7fa5ba1f5640 1 Processor -- start 2023-12-12T10:12:10.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.979+0000 7fa5ba1f5640 1 -- start start 2023-12-12T10:12:10.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.979+0000 7fa5ba1f5640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa5b406ba20 0x7fa5b40b3d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:10.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.979+0000 7fa5ba1f5640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5b415dab0 con 0x7fa5b40ce420 2023-12-12T10:12:10.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.979+0000 7fa5ba1f5640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5b406beb0 con 0x7fa5b415d420 2023-12-12T10:12:10.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.979+0000 7fa5ba1f5640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5b415d810 con 0x7fa5b406ba20 2023-12-12T10:12:10.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.979+0000 7fa5b2ffd640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fa5b40ce420 0x7fa5b4160de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:56238/0 (socket says 172.21.15.78:56238) 2023-12-12T10:12:10.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.979+0000 7fa5b2ffd640 1 -- 172.21.15.78:0/3612735316 learned_addr learned my addr 172.21.15.78:0/3612735316 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-12-12T10:12:10.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.983+0000 7fa5b3fff640 1 --2- 172.21.15.78:0/3612735316 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa5b406ba20 0x7fa5b40b3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:10.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.983+0000 7fa5b27fc640 1 -- 172.21.15.78:0/3612735316 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1069504148 0 0) 0x7fa5b415dab0 con 0x7fa5b40ce420 2023-12-12T10:12:10.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.983+0000 7fa5b27fc640 1 -- 172.21.15.78:0/3612735316 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa59c003530 con 0x7fa5b40ce420 2023-12-12T10:12:10.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.983+0000 7fa5b27fc640 1 -- 172.21.15.78:0/3612735316 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1714434729 0 0) 0x7fa5b406beb0 con 0x7fa5b415d420 2023-12-12T10:12:10.988 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.983+0000 7fa5b27fc640 1 -- 172.21.15.78:0/3612735316 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa5b415dab0 con 0x7fa5b415d420 2023-12-12T10:12:10.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.983+0000 7fa5b27fc640 1 -- 172.21.15.78:0/3612735316 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2931665909 0 0) 0x7fa59c003530 con 0x7fa5b40ce420 2023-12-12T10:12:10.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.983+0000 7fa5b27fc640 1 -- 172.21.15.78:0/3612735316 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa5b406ba20 msgr2=0x7fa5b40b3d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:10.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.983+0000 7fa5b27fc640 1 --2- 172.21.15.78:0/3612735316 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa5b406ba20 0x7fa5b40b3d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:10.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.983+0000 7fa5b27fc640 1 -- 172.21.15.78:0/3612735316 >> v1:172.21.15.187:6789/0 conn(0x7fa5b415d420 legacy=0x7fa5b415df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:10.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.983+0000 7fa5b27fc640 1 -- 172.21.15.78:0/3612735316 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5b40b2750 con 0x7fa5b40ce420 2023-12-12T10:12:10.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.983+0000 7fa5b27fc640 1 -- 172.21.15.78:0/3612735316 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 465499599 0 0) 0x7fa5a8001680 con 0x7fa5b40ce420 2023-12-12T10:12:10.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.983+0000 7fa5b3fff640 1 --2- 172.21.15.78:0/3612735316 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa5b406ba20 0x7fa5b40b3d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-12T10:12:10.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.983+0000 7fa5b27fc640 1 -- 172.21.15.78:0/3612735316 >> v1:172.21.15.78:6789/0 conn(0x7fa5b40ce420 legacy=0x7fa5b4160de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:10.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.983+0000 7fa5b27fc640 1 --2- 172.21.15.78:0/3612735316 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa59c003b40 0x7fa59c003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:10.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.983+0000 7fa5b27fc640 1 --2- 172.21.15.78:0/3612735316 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa59c0047d0 0x7fa59c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:10.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.983+0000 7fa5b27fc640 1 --2- 172.21.15.78:0/3612735316 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa5b406ba20 0x7fa59c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:10.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.983+0000 7fa5b27fc640 1 -- 172.21.15.78:0/3612735316 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5b415d810 con 0x7fa59c003b40 2023-12-12T10:12:10.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.983+0000 7fa5b27fc640 1 -- 172.21.15.78:0/3612735316 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa59c00b9f0 con 0x7fa59c0047d0 2023-12-12T10:12:10.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.983+0000 7fa5b27fc640 1 -- 172.21.15.78:0/3612735316 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa59c00bbb0 con 0x7fa5b406ba20 2023-12-12T10:12:10.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.983+0000 7fa5b37fe640 1 --2- 172.21.15.78:0/3612735316 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa59c003b40 0x7fa59c003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:10.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.983+0000 7fa5b3fff640 1 --2- 172.21.15.78:0/3612735316 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa5b406ba20 0x7fa59c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:10.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.983+0000 7fa5b2ffd640 1 --2- 172.21.15.78:0/3612735316 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa59c0047d0 0x7fa59c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:10.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.983+0000 7fa5b37fe640 1 -- 172.21.15.78:0/3612735316 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa5b406ba20 msgr2=0x7fa59c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:10.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.983+0000 7fa5b37fe640 1 --2- 172.21.15.78:0/3612735316 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa5b406ba20 0x7fa59c005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:10.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.983+0000 7fa5b37fe640 1 -- 172.21.15.78:0/3612735316 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa59c0047d0 msgr2=0x7fa59c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:10.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.983+0000 7fa5b37fe640 1 --2- 172.21.15.78:0/3612735316 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa59c0047d0 0x7fa59c004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:10.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.983+0000 7fa5b37fe640 1 -- 172.21.15.78:0/3612735316 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5ac009a70 con 0x7fa59c003b40 2023-12-12T10:12:10.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.983+0000 7fa5b3fff640 1 --2- 172.21.15.78:0/3612735316 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa5b406ba20 0x7fa59c005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T10:12:10.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.987+0000 7fa5b37fe640 1 --2- 172.21.15.78:0/3612735316 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa59c003b40 0x7fa59c003f40 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa5a4007fd0 tx=0x7fa5a401c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19f2a06ea83bcb1 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:10.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.987+0000 7fa5b27fc640 1 -- 172.21.15.78:0/3612735316 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5a40052d0 con 0x7fa59c003b40 2023-12-12T10:12:10.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.987+0000 7fa5b27fc640 1 -- 172.21.15.78:0/3612735316 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5a4005450 con 0x7fa59c003b40 2023-12-12T10:12:10.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.987+0000 7fa5b27fc640 1 -- 172.21.15.78:0/3612735316 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5a4003840 con 0x7fa59c003b40 2023-12-12T10:12:10.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.987+0000 7fa5ba1f5640 1 -- 172.21.15.78:0/3612735316 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa59c003b40 msgr2=0x7fa59c003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:10.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.987+0000 7fa5ba1f5640 1 --2- 172.21.15.78:0/3612735316 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa59c003b40 0x7fa59c003f40 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa5a4007fd0 tx=0x7fa5a401c4f0 comp rx=0 tx=0).stop 2023-12-12T10:12:10.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.987+0000 7fa5b3fff640 1 -- 172.21.15.78:0/3612735316 reap_dead start 2023-12-12T10:12:10.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.987+0000 7fa5ba1f5640 1 -- 172.21.15.78:0/3612735316 shutdown_connections 2023-12-12T10:12:10.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.987+0000 7fa5ba1f5640 1 -- 172.21.15.78:0/3612735316 >> 172.21.15.78:0/3612735316 conn(0x7fa5b40cf480 msgr2=0x7fa5b40cf890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:10.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.987+0000 7fa5ba1f5640 1 -- 172.21.15.78:0/3612735316 shutdown_connections 2023-12-12T10:12:10.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.987+0000 7fa5ba1f5640 1 -- 172.21.15.78:0/3612735316 wait complete. 2023-12-12T10:12:10.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.987+0000 7fa5ba1f5640 1 Processor -- start 2023-12-12T10:12:10.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.987+0000 7fa5ba1f5640 1 -- start start 2023-12-12T10:12:10.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.991+0000 7fa5ba1f5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa59c003b40 0x7fa5b41573e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:10.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.991+0000 7fa5ba1f5640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa5b4153da0 0x7fa5b40aeee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:10.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.991+0000 7fa5ba1f5640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa5b40af420 0x7fa5b4153100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:10.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.991+0000 7fa5ba1f5640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5b40af8c0 con 0x7fa59c003b40 2023-12-12T10:12:10.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.991+0000 7fa5ba1f5640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5b40afba0 con 0x7fa5b40af420 2023-12-12T10:12:10.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.991+0000 7fa5ba1f5640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5b40afe80 con 0x7fa5b4153da0 2023-12-12T10:12:10.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.991+0000 7fa5b37fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa59c003b40 0x7fa5b41573e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:10.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.991+0000 7fa5b37fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa59c003b40 0x7fa5b41573e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43198/0 (socket says 172.21.15.78:43198) 2023-12-12T10:12:10.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.991+0000 7fa5b37fe640 1 -- 172.21.15.78:0/825259312 learned_addr learned my addr 172.21.15.78:0/825259312 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:10.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.991+0000 7fa5b37fe640 1 -- 172.21.15.78:0/825259312 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa5b4153da0 msgr2=0x7fa5b40aeee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:10.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.991+0000 7fa5b37fe640 1 --2- 172.21.15.78:0/825259312 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa5b4153da0 0x7fa5b40aeee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:10.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.991+0000 7fa5b37fe640 1 -- 172.21.15.78:0/825259312 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa5b40af420 msgr2=0x7fa5b4153100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:10.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.991+0000 7fa5b37fe640 1 --2- 172.21.15.78:0/825259312 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa5b40af420 0x7fa5b4153100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:10.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.991+0000 7fa5b37fe640 1 -- 172.21.15.78:0/825259312 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5b40b0160 con 0x7fa59c003b40 2023-12-12T10:12:10.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.991+0000 7fa5b37fe640 1 --2- 172.21.15.78:0/825259312 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa59c003b40 0x7fa5b41573e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa5a40ae040 tx=0x7fa59c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:10.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.991+0000 7fa59bfff640 1 -- 172.21.15.78:0/825259312 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5a40052d0 con 0x7fa59c003b40 2023-12-12T10:12:10.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.991+0000 7fa59bfff640 1 -- 172.21.15.78:0/825259312 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5a4003c80 con 0x7fa59c003b40 2023-12-12T10:12:10.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.991+0000 7fa59bfff640 1 -- 172.21.15.78:0/825259312 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5a40067e0 con 0x7fa59c003b40 2023-12-12T10:12:10.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.991+0000 7fa5ba1f5640 1 -- 172.21.15.78:0/825259312 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5b40b0440 con 0x7fa59c003b40 2023-12-12T10:12:10.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.991+0000 7fa5ba1f5640 1 -- 172.21.15.78:0/825259312 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5b4157af0 con 0x7fa59c003b40 2023-12-12T10:12:10.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.991+0000 7fa5ba1f5640 1 -- 172.21.15.78:0/825259312 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5b40665f0 con 0x7fa59c003b40 2023-12-12T10:12:10.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.991+0000 7fa59bfff640 1 -- 172.21.15.78:0/825259312 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa5a40b2050 con 0x7fa59c003b40 2023-12-12T10:12:10.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.995+0000 7fa59bfff640 1 --2- 172.21.15.78:0/825259312 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fa5a0066470 0x7fa5a0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:10.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.995+0000 7fa59bfff640 1 -- 172.21.15.78:0/825259312 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5935+0+0 (secure 0 0 0) 0x7fa5a411d220 con 0x7fa59c003b40 2023-12-12T10:12:10.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.995+0000 7fa5b2ffd640 1 --2- 172.21.15.78:0/825259312 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fa5a0066470 0x7fa5a0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:10.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.995+0000 7fa5b2ffd640 1 --2- 172.21.15.78:0/825259312 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fa5a0066470 0x7fa5a0068930 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa5a8001210 tx=0x7fa5a8001120 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:11.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:10.999+0000 7fa59bfff640 1 -- 172.21.15.78:0/825259312 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa5a40ea790 con 0x7fa59c003b40 2023-12-12T10:12:11.153 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:11.147+0000 7fa5ba1f5640 1 -- 172.21.15.78:0/825259312 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fa5b40b05d0 con 0x7fa59c003b40 2023-12-12T10:12:12.933 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:12.927+0000 7fa59bfff640 1 -- 172.21.15.78:0/825259312 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v22) v1 ==== 228+0+0 (secure 0 0 0) 0x7fa5a40eddb0 con 0x7fa59c003b40 2023-12-12T10:12:12.933 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_data_ec' created 2023-12-12T10:12:12.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:12.931+0000 7fa5ba1f5640 1 -- 172.21.15.78:0/825259312 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fa5a0066470 msgr2=0x7fa5a0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:12.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:12.931+0000 7fa5ba1f5640 1 --2- 172.21.15.78:0/825259312 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fa5a0066470 0x7fa5a0068930 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa5a8001210 tx=0x7fa5a8001120 comp rx=0 tx=0).stop 2023-12-12T10:12:12.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:12.931+0000 7fa5ba1f5640 1 -- 172.21.15.78:0/825259312 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa59c003b40 msgr2=0x7fa5b41573e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:12.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:12.931+0000 7fa5ba1f5640 1 --2- 172.21.15.78:0/825259312 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa59c003b40 0x7fa5b41573e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa5a40ae040 tx=0x7fa59c005800 comp rx=0 tx=0).stop 2023-12-12T10:12:12.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:12.931+0000 7fa5ba1f5640 1 -- 172.21.15.78:0/825259312 shutdown_connections 2023-12-12T10:12:12.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:12.931+0000 7fa5ba1f5640 1 --2- 172.21.15.78:0/825259312 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fa5a0066470 0x7fa5a0068930 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:12.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:12.931+0000 7fa5ba1f5640 1 --2- 172.21.15.78:0/825259312 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa5b40af420 0x7fa5b4153100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:12.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:12.931+0000 7fa5ba1f5640 1 --2- 172.21.15.78:0/825259312 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa5b4153da0 0x7fa5b40aeee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:12.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:12.931+0000 7fa5ba1f5640 1 --2- 172.21.15.78:0/825259312 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa59c003b40 0x7fa5b41573e0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:12.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:12.931+0000 7fa5ba1f5640 1 -- 172.21.15.78:0/825259312 >> 172.21.15.78:0/825259312 conn(0x7fa5b40cf480 msgr2=0x7fa5b4070a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:12.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:12.931+0000 7fa5ba1f5640 1 -- 172.21.15.78:0/825259312 shutdown_connections 2023-12-12T10:12:12.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:12.931+0000 7fa5ba1f5640 1 -- 172.21.15.78:0/825259312 wait complete. 2023-12-12T10:12:12.966 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2023-12-12T10:12:13.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:13.103+0000 7fb18d85a640 1 Processor -- start 2023-12-12T10:12:13.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:13.103+0000 7fb18d85a640 1 -- start start 2023-12-12T10:12:13.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:13.103+0000 7fb18d85a640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb18815d100 0x7fb1880d3730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:13.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:13.103+0000 7fb18d85a640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fb1880cff70 0x7fb1880c71f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:13.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:13.103+0000 7fb18d85a640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1880c6d10 con 0x7fb1880d3c70 2023-12-12T10:12:13.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:13.103+0000 7fb18d85a640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1880d1fd0 con 0x7fb1880cff70 2023-12-12T10:12:13.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:13.103+0000 7fb18d85a640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1880d1730 con 0x7fb18815d100 2023-12-12T10:12:13.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:13.103+0000 7fb186ffd640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb18815d100 0x7fb1880d3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:13.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:13.103+0000 7fb186ffd640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb18815d100 0x7fb1880d3730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.78:50480/0 (socket says 172.21.15.78:50480) 2023-12-12T10:12:13.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:13.103+0000 7fb186ffd640 1 -- 172.21.15.78:0/3362014827 learned_addr learned my addr 172.21.15.78:0/3362014827 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:13.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:13.103+0000 7fb1877fe640 1 --2- 172.21.15.78:0/3362014827 >> v2:172.21.15.187:3300/0 conn(0x7fb1880cff70 0x7fb1880c71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:13.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:13.103+0000 7fb186ffd640 1 -- 172.21.15.78:0/3362014827 >> v2:172.21.15.187:3300/0 conn(0x7fb1880cff70 msgr2=0x7fb1880c71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:13.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:13.103+0000 7fb186ffd640 1 --2- 172.21.15.78:0/3362014827 >> v2:172.21.15.187:3300/0 conn(0x7fb1880cff70 0x7fb1880c71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:13.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:13.103+0000 7fb186ffd640 1 -- 172.21.15.78:0/3362014827 >> v1:172.21.15.187:6789/0 conn(0x7fb1880d3c70 legacy=0x7fb1880cf860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:13.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:13.103+0000 7fb186ffd640 1 -- 172.21.15.78:0/3362014827 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1880d1a10 con 0x7fb18815d100 2023-12-12T10:12:13.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:13.107+0000 7fb186ffd640 1 --2- 172.21.15.78:0/3362014827 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb18815d100 0x7fb1880d3730 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fb178009870 tx=0x7fb17801c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6d77cccc726f9125 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:13.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:13.107+0000 7fb1867fc640 1 -- 172.21.15.78:0/3362014827 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1780a6040 con 0x7fb18815d100 2023-12-12T10:12:13.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:13.107+0000 7fb1867fc640 1 -- 172.21.15.78:0/3362014827 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1780aa600 con 0x7fb18815d100 2023-12-12T10:12:13.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:13.107+0000 7fb1867fc640 1 -- 172.21.15.78:0/3362014827 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1780aa990 con 0x7fb18815d100 2023-12-12T10:12:13.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:13.107+0000 7fb18d85a640 1 -- 172.21.15.78:0/3362014827 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb18815d100 msgr2=0x7fb1880d3730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:13.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:13.107+0000 7fb18d85a640 1 --2- 172.21.15.78:0/3362014827 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb18815d100 0x7fb1880d3730 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fb178009870 tx=0x7fb17801c480 comp rx=0 tx=0).stop 2023-12-12T10:12:13.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:13.107+0000 7fb18d85a640 1 -- 172.21.15.78:0/3362014827 shutdown_connections 2023-12-12T10:12:13.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:13.107+0000 7fb18d85a640 1 --2- 172.21.15.78:0/3362014827 >> v2:172.21.15.187:3300/0 conn(0x7fb1880cff70 0x7fb1880c71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:13.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:13.107+0000 7fb18d85a640 1 --2- 172.21.15.78:0/3362014827 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb18815d100 0x7fb1880d3730 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:13.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:13.107+0000 7fb18d85a640 1 -- 172.21.15.78:0/3362014827 >> 172.21.15.78:0/3362014827 conn(0x7fb18809c360 msgr2=0x7fb1880d3020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:13.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:13.107+0000 7fb18d85a640 1 -- 172.21.15.78:0/3362014827 shutdown_connections 2023-12-12T10:12:13.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:13.107+0000 7fb18d85a640 1 -- 172.21.15.78:0/3362014827 wait complete. 2023-12-12T10:12:13.116 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:13.111+0000 7fb18d85a640 1 Processor -- start 2023-12-12T10:12:13.116 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:13.111+0000 7fb18d85a640 1 -- start start 2023-12-12T10:12:13.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:13.111+0000 7fb18d85a640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb1880cff70 0x7fb188155520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:13.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:13.111+0000 7fb18d85a640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb1880d3c70 0x7fb1880ccd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:13.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:13.111+0000 7fb18d85a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb18815d100 0x7fb1880ca970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:13.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:13.111+0000 7fb18d85a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb18815bfe0 con 0x7fb18815d100 2023-12-12T10:12:13.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:13.111+0000 7fb18d85a640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb18815c2c0 con 0x7fb1880d3c70 2023-12-12T10:12:13.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:13.111+0000 7fb18d85a640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb18815c5a0 con 0x7fb1880cff70 2023-12-12T10:12:13.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:13.111+0000 7fb1877fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb18815d100 0x7fb1880ca970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:13.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:13.111+0000 7fb17e7fc640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb1880d3c70 0x7fb1880ccd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:13.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:13.111+0000 7fb1877fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb18815d100 0x7fb1880ca970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43206/0 (socket says 172.21.15.78:43206) 2023-12-12T10:12:13.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:13.111+0000 7fb1877fe640 1 -- 172.21.15.78:0/1148842159 learned_addr learned my addr 172.21.15.78:0/1148842159 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:13.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:13.111+0000 7fb186ffd640 1 --2- 172.21.15.78:0/1148842159 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb1880cff70 0x7fb188155520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:13.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:13.111+0000 7fb17e7fc640 1 -- 172.21.15.78:0/1148842159 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb1880cff70 msgr2=0x7fb188155520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:13.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:13.111+0000 7fb17e7fc640 1 --2- 172.21.15.78:0/1148842159 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb1880cff70 0x7fb188155520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:13.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:13.111+0000 7fb17e7fc640 1 -- 172.21.15.78:0/1148842159 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb18815d100 msgr2=0x7fb1880ca970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:13.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:13.111+0000 7fb17e7fc640 1 --2- 172.21.15.78:0/1148842159 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb18815d100 0x7fb1880ca970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:13.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:13.111+0000 7fb17e7fc640 1 -- 172.21.15.78:0/1148842159 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1780094d0 con 0x7fb1880d3c70 2023-12-12T10:12:13.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:13.111+0000 7fb1877fe640 1 --2- 172.21.15.78:0/1148842159 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb18815d100 0x7fb1880ca970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-12T10:12:13.121 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:13.111+0000 7fb17e7fc640 1 --2- 172.21.15.78:0/1148842159 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb1880d3c70 0x7fb1880ccd50 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb170000f70 tx=0x7fb17000c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:13.121 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:13.115+0000 7fb184ff9640 1 -- 172.21.15.78:0/1148842159 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1700052d0 con 0x7fb1880d3c70 2023-12-12T10:12:13.121 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:13.115+0000 7fb184ff9640 1 -- 172.21.15.78:0/1148842159 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb170005430 con 0x7fb1880d3c70 2023-12-12T10:12:13.121 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:13.115+0000 7fb184ff9640 1 -- 172.21.15.78:0/1148842159 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb170003840 con 0x7fb1880d3c70 2023-12-12T10:12:13.121 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:13.115+0000 7fb18d85a640 1 -- 172.21.15.78:0/1148842159 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb18815c880 con 0x7fb1880d3c70 2023-12-12T10:12:13.121 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:13.115+0000 7fb18d85a640 1 -- 172.21.15.78:0/1148842159 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb188155a60 con 0x7fb1880d3c70 2023-12-12T10:12:13.121 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:13.115+0000 7fb18d85a640 1 -- 172.21.15.78:0/1148842159 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1880671f0 con 0x7fb1880d3c70 2023-12-12T10:12:13.122 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:13.115+0000 7fb184ff9640 1 -- 172.21.15.78:0/1148842159 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb1700039a0 con 0x7fb1880d3c70 2023-12-12T10:12:13.122 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:13.115+0000 7fb184ff9640 1 --2- 172.21.15.78:0/1148842159 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fb168066470 0x7fb168068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:13.122 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:13.115+0000 7fb184ff9640 1 -- 172.21.15.78:0/1148842159 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6428+0+0 (secure 0 0 0) 0x7fb1700835f0 con 0x7fb1880d3c70 2023-12-12T10:12:13.123 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:13.115+0000 7fb186ffd640 1 --2- 172.21.15.78:0/1148842159 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fb168066470 0x7fb168068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:13.123 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:13.119+0000 7fb186ffd640 1 --2- 172.21.15.78:0/1148842159 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fb168066470 0x7fb168068930 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb1780ae000 tx=0x7fb1780b5040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:13.127 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:13.123+0000 7fb184ff9640 1 -- 172.21.15.78:0/1148842159 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb1700507b0 con 0x7fb1880d3c70 2023-12-12T10:12:13.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:13.271+0000 7fb18d85a640 1 -- 172.21.15.78:0/1148842159 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7fb18815c400 con 0x7fb1880d3c70 2023-12-12T10:12:13.789 INFO:tasks.ceph.mds.c.smithi078.stderr:2023-12-12T10:12:13.787+0000 7f94984e5640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-12T10:12:13.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:13.939+0000 7fb184ff9640 1 -- 172.21.15.78:0/1148842159 <== mon.1 v2:172.21.15.187:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v23) v1 ==== 169+0+0 (secure 0 0 0) 0x7fb18815c400 con 0x7fb1880d3c70 2023-12-12T10:12:13.947 INFO:teuthology.orchestra.run.smithi078.stderr:set pool 4 allow_ec_overwrites to true 2023-12-12T10:12:13.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:13.951+0000 7fb18d85a640 1 -- 172.21.15.78:0/1148842159 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fb168066470 msgr2=0x7fb168068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:13.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:13.951+0000 7fb18d85a640 1 --2- 172.21.15.78:0/1148842159 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fb168066470 0x7fb168068930 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb1780ae000 tx=0x7fb1780b5040 comp rx=0 tx=0).stop 2023-12-12T10:12:13.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:13.951+0000 7fb18d85a640 1 -- 172.21.15.78:0/1148842159 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb1880d3c70 msgr2=0x7fb1880ccd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:13.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:13.951+0000 7fb18d85a640 1 --2- 172.21.15.78:0/1148842159 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb1880d3c70 0x7fb1880ccd50 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb170000f70 tx=0x7fb17000c890 comp rx=0 tx=0).stop 2023-12-12T10:12:13.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:13.959+0000 7fb18d85a640 1 -- 172.21.15.78:0/1148842159 shutdown_connections 2023-12-12T10:12:13.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:13.959+0000 7fb18d85a640 1 --2- 172.21.15.78:0/1148842159 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fb168066470 0x7fb168068930 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:13.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:13.959+0000 7fb18d85a640 1 --2- 172.21.15.78:0/1148842159 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb18815d100 0x7fb1880ca970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:13.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:13.959+0000 7fb18d85a640 1 --2- 172.21.15.78:0/1148842159 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb1880d3c70 0x7fb1880ccd50 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:13.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:13.959+0000 7fb18d85a640 1 --2- 172.21.15.78:0/1148842159 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb1880cff70 0x7fb188155520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:13.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:13.959+0000 7fb18d85a640 1 -- 172.21.15.78:0/1148842159 >> 172.21.15.78:0/1148842159 conn(0x7fb18809c360 msgr2=0x7fb18806ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:13.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:13.959+0000 7fb18d85a640 1 -- 172.21.15.78:0/1148842159 shutdown_connections 2023-12-12T10:12:13.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:13.963+0000 7fb18d85a640 1 -- 172.21.15.78:0/1148842159 wait complete. 2023-12-12T10:12:13.997 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2023-12-12T10:12:14.144 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:14.139+0000 7f89f8209640 1 Processor -- start 2023-12-12T10:12:14.144 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:14.139+0000 7f89f8209640 1 -- start start 2023-12-12T10:12:14.145 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:14.139+0000 7f89f8209640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f89f015d080 0x7f89f006ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:14.146 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:14.139+0000 7f89f8209640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89f006bf50 con 0x7f89f0160da0 2023-12-12T10:12:14.146 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:14.139+0000 7f89f8209640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89f006b580 con 0x7f89f00cca80 2023-12-12T10:12:14.146 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:14.139+0000 7f89f8209640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89f006af50 con 0x7f89f015d080 2023-12-12T10:12:14.146 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:14.139+0000 7f89f57a4640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f89f0160da0 0x7f89f00cc370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:56252/0 (socket says 172.21.15.78:56252) 2023-12-12T10:12:14.146 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:14.139+0000 7f89f57a4640 1 -- 172.21.15.78:0/2432903660 learned_addr learned my addr 172.21.15.78:0/2432903660 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-12-12T10:12:14.146 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:14.139+0000 7f89f5fa5640 1 --2- 172.21.15.78:0/2432903660 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f89f015d080 0x7f89f006ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:14.147 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:14.139+0000 7f89f4fa3640 1 -- 172.21.15.78:0/2432903660 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 90298140 0 0) 0x7f89e0001120 con 0x7f89f0160da0 2023-12-12T10:12:14.147 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:14.139+0000 7f89f4fa3640 1 -- 172.21.15.78:0/2432903660 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89dc003530 con 0x7f89f0160da0 2023-12-12T10:12:14.147 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:14.143+0000 7f89f4fa3640 1 -- 172.21.15.78:0/2432903660 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3414731090 0 0) 0x7f89f006b580 con 0x7f89f00cca80 2023-12-12T10:12:14.147 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:14.143+0000 7f89f4fa3640 1 -- 172.21.15.78:0/2432903660 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89e0001120 con 0x7f89f00cca80 2023-12-12T10:12:14.147 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:14.143+0000 7f89f5fa5640 1 -- 172.21.15.78:0/2432903660 >> v1:172.21.15.187:6789/0 conn(0x7f89f00cca80 legacy=0x7f89f006d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:14.147 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:14.143+0000 7f89f5fa5640 1 -- 172.21.15.78:0/2432903660 >> v1:172.21.15.78:6789/0 conn(0x7f89f0160da0 legacy=0x7f89f00cc370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:14.147 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:14.143+0000 7f89f5fa5640 1 -- 172.21.15.78:0/2432903660 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89f006a900 con 0x7f89f015d080 2023-12-12T10:12:14.149 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:14.143+0000 7f89f5fa5640 1 --2- 172.21.15.78:0/2432903660 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f89f015d080 0x7f89f006ba10 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f89ec0097f0 tx=0x7f89ec01c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6dd9d6103983c98c server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:14.150 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:14.143+0000 7f89f4fa3640 1 -- 172.21.15.78:0/2432903660 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89ec0aa5f0 con 0x7f89f015d080 2023-12-12T10:12:14.150 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:14.143+0000 7f89f4fa3640 1 -- 172.21.15.78:0/2432903660 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89ec0aa750 con 0x7f89f015d080 2023-12-12T10:12:14.150 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:14.143+0000 7f89f4fa3640 1 -- 172.21.15.78:0/2432903660 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89ec0aaae0 con 0x7f89f015d080 2023-12-12T10:12:14.150 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:14.143+0000 7f89f8209640 1 -- 172.21.15.78:0/2432903660 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f89f015d080 msgr2=0x7f89f006ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:14.151 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:14.143+0000 7f89f8209640 1 --2- 172.21.15.78:0/2432903660 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f89f015d080 0x7f89f006ba10 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f89ec0097f0 tx=0x7f89ec01c490 comp rx=0 tx=0).stop 2023-12-12T10:12:14.151 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:14.147+0000 7f89f8209640 1 -- 172.21.15.78:0/2432903660 shutdown_connections 2023-12-12T10:12:14.151 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:14.147+0000 7f89f8209640 1 --2- 172.21.15.78:0/2432903660 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f89f015d080 0x7f89f006ba10 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:14.151 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:14.147+0000 7f89f8209640 1 -- 172.21.15.78:0/2432903660 >> 172.21.15.78:0/2432903660 conn(0x7f89f00b1650 msgr2=0x7f89f00b1a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:14.151 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:14.147+0000 7f89f8209640 1 -- 172.21.15.78:0/2432903660 shutdown_connections 2023-12-12T10:12:14.151 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:14.147+0000 7f89f8209640 1 -- 172.21.15.78:0/2432903660 wait complete. 2023-12-12T10:12:14.152 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:14.147+0000 7f89f8209640 1 Processor -- start 2023-12-12T10:12:14.152 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:14.147+0000 7f89f8209640 1 -- start start 2023-12-12T10:12:14.154 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:14.147+0000 7f89f8209640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f89f00cca80 0x7f89f014b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:14.154 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:14.147+0000 7f89f8209640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f89f015d080 0x7f89f015b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:14.154 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:14.147+0000 7f89f8209640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f89f0160da0 0x7f89f0150dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:14.154 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:14.147+0000 7f89f8209640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89f014b960 con 0x7f89f0160da0 2023-12-12T10:12:14.154 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:14.147+0000 7f89f8209640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89f0159aa0 con 0x7f89f00cca80 2023-12-12T10:12:14.154 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:14.147+0000 7f89f8209640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89f0159d80 con 0x7f89f015d080 2023-12-12T10:12:14.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:14.147+0000 7f89f67a6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f89f0160da0 0x7f89f0150dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:14.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:14.147+0000 7f89f5fa5640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f89f00cca80 0x7f89f014b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:14.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:14.147+0000 7f89f57a4640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f89f015d080 0x7f89f015b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:14.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:14.147+0000 7f89f67a6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f89f0160da0 0x7f89f0150dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43218/0 (socket says 172.21.15.78:43218) 2023-12-12T10:12:14.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:14.147+0000 7f89f67a6640 1 -- 172.21.15.78:0/1228611975 learned_addr learned my addr 172.21.15.78:0/1228611975 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:14.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:14.147+0000 7f89f67a6640 1 -- 172.21.15.78:0/1228611975 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f89f015d080 msgr2=0x7f89f015b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:14.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:14.147+0000 7f89f67a6640 1 --2- 172.21.15.78:0/1228611975 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f89f015d080 0x7f89f015b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:14.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:14.147+0000 7f89f67a6640 1 -- 172.21.15.78:0/1228611975 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f89f00cca80 msgr2=0x7f89f014b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:14.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:14.147+0000 7f89f67a6640 1 --2- 172.21.15.78:0/1228611975 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f89f00cca80 0x7f89f014b420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:14.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:14.147+0000 7f89f67a6640 1 -- 172.21.15.78:0/1228611975 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89ec009420 con 0x7f89f0160da0 2023-12-12T10:12:14.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:14.147+0000 7f89f67a6640 1 --2- 172.21.15.78:0/1228611975 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f89f0160da0 0x7f89f0150dc0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f89e800c790 tx=0x7f89e800cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:14.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:14.147+0000 7f89e67fc640 1 -- 172.21.15.78:0/1228611975 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89e800cea0 con 0x7f89f0160da0 2023-12-12T10:12:14.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:14.151+0000 7f89e67fc640 1 -- 172.21.15.78:0/1228611975 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89e8003b80 con 0x7f89f0160da0 2023-12-12T10:12:14.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:14.151+0000 7f89e67fc640 1 -- 172.21.15.78:0/1228611975 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89e800a850 con 0x7f89f0160da0 2023-12-12T10:12:14.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:14.151+0000 7f89f8209640 1 -- 172.21.15.78:0/1228611975 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89f015a060 con 0x7f89f0160da0 2023-12-12T10:12:14.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:14.151+0000 7f89f8209640 1 -- 172.21.15.78:0/1228611975 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89f015a340 con 0x7f89f0160da0 2023-12-12T10:12:14.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:14.151+0000 7f89f8209640 1 -- 172.21.15.78:0/1228611975 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89f0067530 con 0x7f89f0160da0 2023-12-12T10:12:14.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:14.151+0000 7f89e67fc640 1 -- 172.21.15.78:0/1228611975 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f89e800a9b0 con 0x7f89f0160da0 2023-12-12T10:12:14.158 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:14.151+0000 7f89e67fc640 1 --2- 172.21.15.78:0/1228611975 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f89d4066470 0x7f89d4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:14.158 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:14.151+0000 7f89e67fc640 1 -- 172.21.15.78:0/1228611975 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6428+0+0 (secure 0 0 0) 0x7f89e8083ed0 con 0x7f89f0160da0 2023-12-12T10:12:14.158 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:14.151+0000 7f89f5fa5640 1 --2- 172.21.15.78:0/1228611975 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f89d4066470 0x7f89d4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:14.158 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:14.155+0000 7f89f5fa5640 1 --2- 172.21.15.78:0/1228611975 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f89d4066470 0x7f89d4068930 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f89ec0ae000 tx=0x7f89ec0a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:14.162 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:14.159+0000 7f89e67fc640 1 -- 172.21.15.78:0/1228611975 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f89e8051120 con 0x7f89f0160da0 2023-12-12T10:12:14.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:14.351+0000 7f89f8209640 1 -- 172.21.15.78:0/1228611975 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7f89f015e900 con 0x7f89f0160da0 2023-12-12T10:12:14.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:14.935+0000 7f89e67fc640 1 -- 172.21.15.78:0/1228611975 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v7) v1 ==== 137+0+0 (secure 0 0 0) 0x7f89e8054740 con 0x7f89f0160da0 2023-12-12T10:12:14.941 INFO:teuthology.orchestra.run.smithi078.stderr:added data pool 4 to fsmap 2023-12-12T10:12:14.944 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:14.939+0000 7f89f8209640 1 -- 172.21.15.78:0/1228611975 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f89d4066470 msgr2=0x7f89d4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:14.944 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:14.939+0000 7f89f8209640 1 --2- 172.21.15.78:0/1228611975 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f89d4066470 0x7f89d4068930 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f89ec0ae000 tx=0x7f89ec0a7000 comp rx=0 tx=0).stop 2023-12-12T10:12:14.944 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:14.939+0000 7f89f8209640 1 -- 172.21.15.78:0/1228611975 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f89f0160da0 msgr2=0x7f89f0150dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:14.944 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:14.939+0000 7f89f8209640 1 --2- 172.21.15.78:0/1228611975 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f89f0160da0 0x7f89f0150dc0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f89e800c790 tx=0x7f89e800cc50 comp rx=0 tx=0).stop 2023-12-12T10:12:14.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:14.939+0000 7f89f8209640 1 -- 172.21.15.78:0/1228611975 shutdown_connections 2023-12-12T10:12:14.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:14.939+0000 7f89f8209640 1 --2- 172.21.15.78:0/1228611975 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f89d4066470 0x7f89d4068930 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:14.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:14.939+0000 7f89f8209640 1 --2- 172.21.15.78:0/1228611975 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f89f0160da0 0x7f89f0150dc0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:14.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:14.939+0000 7f89f8209640 1 --2- 172.21.15.78:0/1228611975 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f89f015d080 0x7f89f015b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:14.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:14.939+0000 7f89f8209640 1 --2- 172.21.15.78:0/1228611975 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f89f00cca80 0x7f89f014b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:14.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:14.939+0000 7f89f8209640 1 -- 172.21.15.78:0/1228611975 >> 172.21.15.78:0/1228611975 conn(0x7f89f00b1650 msgr2=0x7f89f00b0ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:14.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:14.939+0000 7f89f8209640 1 -- 172.21.15.78:0/1228611975 shutdown_connections 2023-12-12T10:12:14.946 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:14.939+0000 7f89f8209640 1 -- 172.21.15.78:0/1228611975 wait complete. 2023-12-12T10:12:14.967 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-12T10:12:15.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.103+0000 7f5f82b2a640 1 Processor -- start 2023-12-12T10:12:15.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.103+0000 7f5f82b2a640 1 -- start start 2023-12-12T10:12:15.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.103+0000 7f5f82b2a640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f5f7c15d3c0 0x7f5f7c0d3b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:15.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.103+0000 7f5f82b2a640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5f7c0ce670 0x7f5f7c0d15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:15.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.103+0000 7f5f82b2a640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f7c0b3250 con 0x7f5f7c0d1ae0 2023-12-12T10:12:15.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.103+0000 7f5f82b2a640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f7c0d1f70 con 0x7f5f7c15d3c0 2023-12-12T10:12:15.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.103+0000 7f5f82b2a640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f7c0cee50 con 0x7f5f7c0ce670 2023-12-12T10:12:15.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.103+0000 7f5f808c6640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f5f7c15d3c0 0x7f5f7c0d3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:15.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.103+0000 7f5f808c6640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f5f7c15d3c0 0x7f5f7c0d3b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43226/0 (socket says 172.21.15.78:43226) 2023-12-12T10:12:15.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.103+0000 7f5f808c6640 1 -- 172.21.15.78:0/2480050396 learned_addr learned my addr 172.21.15.78:0/2480050396 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:15.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.103+0000 7f5f73fff640 1 --2- 172.21.15.78:0/2480050396 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5f7c0ce670 0x7f5f7c0d15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:15.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.103+0000 7f5f808c6640 1 -- 172.21.15.78:0/2480050396 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5f7c0ce670 msgr2=0x7f5f7c0d15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:15.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.103+0000 7f5f808c6640 1 --2- 172.21.15.78:0/2480050396 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5f7c0ce670 0x7f5f7c0d15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:15.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.103+0000 7f5f808c6640 1 -- 172.21.15.78:0/2480050396 >> v1:172.21.15.78:6789/0 conn(0x7f5f7c0d1ae0 legacy=0x7f5f7c0cf680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:15.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.103+0000 7f5f808c6640 1 -- 172.21.15.78:0/2480050396 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f7c0b2920 con 0x7f5f7c15d3c0 2023-12-12T10:12:15.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.103+0000 7f5f737fe640 1 -- 172.21.15.78:0/2480050396 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4061806885 0 0) 0x7f5f7c0b3250 con 0x7f5f7c0d1ae0 2023-12-12T10:12:15.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.107+0000 7f5f808c6640 1 --2- 172.21.15.78:0/2480050396 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f7c15d3c0 0x7f5f7c0d3b10 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5f78009870 tx=0x7f5f7801ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f78f1120c522a69c server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:15.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.107+0000 7f5f737fe640 1 -- 172.21.15.78:0/2480050396 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f780a8a30 con 0x7f5f7c15d3c0 2023-12-12T10:12:15.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.107+0000 7f5f737fe640 1 -- 172.21.15.78:0/2480050396 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f780a8b90 con 0x7f5f7c15d3c0 2023-12-12T10:12:15.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.107+0000 7f5f737fe640 1 -- 172.21.15.78:0/2480050396 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f780b0440 con 0x7f5f7c15d3c0 2023-12-12T10:12:15.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.107+0000 7f5f82b2a640 1 -- 172.21.15.78:0/2480050396 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f7c15d3c0 msgr2=0x7f5f7c0d3b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:15.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.107+0000 7f5f82b2a640 1 --2- 172.21.15.78:0/2480050396 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f7c15d3c0 0x7f5f7c0d3b10 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5f78009870 tx=0x7f5f7801ed30 comp rx=0 tx=0).stop 2023-12-12T10:12:15.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.107+0000 7f5f82b2a640 1 -- 172.21.15.78:0/2480050396 shutdown_connections 2023-12-12T10:12:15.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.107+0000 7f5f82b2a640 1 --2- 172.21.15.78:0/2480050396 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5f7c0ce670 0x7f5f7c0d15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:15.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.107+0000 7f5f82b2a640 1 --2- 172.21.15.78:0/2480050396 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f7c15d3c0 0x7f5f7c0d3b10 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:15.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.107+0000 7f5f82b2a640 1 -- 172.21.15.78:0/2480050396 >> 172.21.15.78:0/2480050396 conn(0x7f5f7c09c2a0 msgr2=0x7f5f7c0d2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:15.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.107+0000 7f5f82b2a640 1 -- 172.21.15.78:0/2480050396 shutdown_connections 2023-12-12T10:12:15.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.107+0000 7f5f82b2a640 1 -- 172.21.15.78:0/2480050396 wait complete. 2023-12-12T10:12:15.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.111+0000 7f5f82b2a640 1 Processor -- start 2023-12-12T10:12:15.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.111+0000 7f5f82b2a640 1 -- start start 2023-12-12T10:12:15.116 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.111+0000 7f5f82b2a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f7c0ce670 0x7f5f7c1604f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:15.116 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.111+0000 7f5f82b2a640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5f7c0d1ae0 0x7f5f7c09f210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:15.116 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.111+0000 7f5f82b2a640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5f7c15d3c0 0x7f5f7c0cc4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:15.116 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.111+0000 7f5f82b2a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f7c09ed10 con 0x7f5f7c0ce670 2023-12-12T10:12:15.116 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.111+0000 7f5f82b2a640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f7c09f750 con 0x7f5f7c0d1ae0 2023-12-12T10:12:15.116 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.111+0000 7f5f82b2a640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f7c0c9860 con 0x7f5f7c15d3c0 2023-12-12T10:12:15.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.111+0000 7f5f808c6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f7c0ce670 0x7f5f7c1604f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:15.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.111+0000 7f5f808c6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f7c0ce670 0x7f5f7c1604f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43236/0 (socket says 172.21.15.78:43236) 2023-12-12T10:12:15.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.111+0000 7f5f808c6640 1 -- 172.21.15.78:0/2986088107 learned_addr learned my addr 172.21.15.78:0/2986088107 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:15.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.111+0000 7f5f73fff640 1 --2- 172.21.15.78:0/2986088107 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5f7c0d1ae0 0x7f5f7c09f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:15.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.111+0000 7f5f810c7640 1 --2- 172.21.15.78:0/2986088107 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5f7c15d3c0 0x7f5f7c0cc4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:15.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.111+0000 7f5f808c6640 1 -- 172.21.15.78:0/2986088107 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5f7c15d3c0 msgr2=0x7f5f7c0cc4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:15.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.111+0000 7f5f808c6640 1 --2- 172.21.15.78:0/2986088107 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5f7c15d3c0 0x7f5f7c0cc4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:15.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.111+0000 7f5f808c6640 1 -- 172.21.15.78:0/2986088107 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5f7c0d1ae0 msgr2=0x7f5f7c09f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:15.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.111+0000 7f5f808c6640 1 --2- 172.21.15.78:0/2986088107 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5f7c0d1ae0 0x7f5f7c09f210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:15.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.111+0000 7f5f808c6640 1 -- 172.21.15.78:0/2986088107 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f780094d0 con 0x7f5f7c0ce670 2023-12-12T10:12:15.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.111+0000 7f5f810c7640 1 --2- 172.21.15.78:0/2986088107 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5f7c15d3c0 0x7f5f7c0cc4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T10:12:15.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.111+0000 7f5f808c6640 1 --2- 172.21.15.78:0/2986088107 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f7c0ce670 0x7f5f7c1604f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5f780b3040 tx=0x7f5f7801bad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:15.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.111+0000 7f5f717fa640 1 -- 172.21.15.78:0/2986088107 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f780be070 con 0x7f5f7c0ce670 2023-12-12T10:12:15.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.111+0000 7f5f717fa640 1 -- 172.21.15.78:0/2986088107 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f780ba400 con 0x7f5f7c0ce670 2023-12-12T10:12:15.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.111+0000 7f5f717fa640 1 -- 172.21.15.78:0/2986088107 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f780ba7d0 con 0x7f5f7c0ce670 2023-12-12T10:12:15.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.111+0000 7f5f82b2a640 1 -- 172.21.15.78:0/2986088107 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f7c09f9e0 con 0x7f5f7c0ce670 2023-12-12T10:12:15.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.111+0000 7f5f82b2a640 1 -- 172.21.15.78:0/2986088107 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f7c0a0220 con 0x7f5f7c0ce670 2023-12-12T10:12:15.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.115+0000 7f5f82b2a640 1 -- 172.21.15.78:0/2986088107 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f7c067530 con 0x7f5f7c0ce670 2023-12-12T10:12:15.121 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.115+0000 7f5f717fa640 1 -- 172.21.15.78:0/2986088107 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5f780c3410 con 0x7f5f7c0ce670 2023-12-12T10:12:15.121 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.115+0000 7f5f717fa640 1 --2- 172.21.15.78:0/2986088107 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f5f68066470 0x7f5f68068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:15.121 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.115+0000 7f5f717fa640 1 -- 172.21.15.78:0/2986088107 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5f78121c30 con 0x7f5f7c0ce670 2023-12-12T10:12:15.121 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.115+0000 7f5f73fff640 1 --2- 172.21.15.78:0/2986088107 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f5f68066470 0x7f5f68068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:15.121 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.115+0000 7f5f73fff640 1 --2- 172.21.15.78:0/2986088107 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f5f68066470 0x7f5f68068930 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5f7c0ccf90 tx=0x7f5f6c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:15.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.119+0000 7f5f717fa640 1 -- 172.21.15.78:0/2986088107 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5f780eee50 con 0x7f5f7c0ce670 2023-12-12T10:12:15.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.303+0000 7f5f82b2a640 1 -- 172.21.15.78:0/2986088107 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5f7c0d1380 con 0x7f5f7c0ce670 2023-12-12T10:12:15.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.303+0000 7f5f717fa640 1 -- 172.21.15.78:0/2986088107 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4912 (secure 0 0 0) 0x7f5f780f2470 con 0x7f5f7c0ce670 2023-12-12T10:12:15.310 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:12:15.310 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/3747609982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":3747609982},{"type":"v1","addr":"172.21.15.187:6834","nonce":3747609982}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4282,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/3245919280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":3245919280},{"type":"v1","addr":"172.21.15.187:6835","nonce":3245919280}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4293,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/3902814576","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":3902814576},{"type":"v1","addr":"172.21.15.78:6835","nonce":3902814576}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-12T10:12:09.200933+0000","modified":"2023-12-12T10:12:14.355309+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4296},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4296":{"gid":4296,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.78:6837/739552946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":739552946},{"type":"v1","addr":"172.21.15.78:6837","nonce":739552946}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-12-12T10:12:15.310 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 7 2023-12-12T10:12:15.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.307+0000 7f5f82b2a640 1 -- 172.21.15.78:0/2986088107 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f5f68066470 msgr2=0x7f5f68068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:15.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.307+0000 7f5f82b2a640 1 --2- 172.21.15.78:0/2986088107 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f5f68066470 0x7f5f68068930 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5f7c0ccf90 tx=0x7f5f6c008040 comp rx=0 tx=0).stop 2023-12-12T10:12:15.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.307+0000 7f5f82b2a640 1 -- 172.21.15.78:0/2986088107 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f7c0ce670 msgr2=0x7f5f7c1604f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:15.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.307+0000 7f5f82b2a640 1 --2- 172.21.15.78:0/2986088107 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f7c0ce670 0x7f5f7c1604f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5f780b3040 tx=0x7f5f7801bad0 comp rx=0 tx=0).stop 2023-12-12T10:12:15.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.307+0000 7f5f82b2a640 1 -- 172.21.15.78:0/2986088107 shutdown_connections 2023-12-12T10:12:15.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.307+0000 7f5f82b2a640 1 --2- 172.21.15.78:0/2986088107 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f5f68066470 0x7f5f68068930 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:15.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.307+0000 7f5f82b2a640 1 --2- 172.21.15.78:0/2986088107 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5f7c15d3c0 0x7f5f7c0cc4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:15.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.307+0000 7f5f82b2a640 1 --2- 172.21.15.78:0/2986088107 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5f7c0d1ae0 0x7f5f7c09f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:15.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.307+0000 7f5f82b2a640 1 --2- 172.21.15.78:0/2986088107 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5f7c0ce670 0x7f5f7c1604f0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:15.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.307+0000 7f5f82b2a640 1 -- 172.21.15.78:0/2986088107 >> 172.21.15.78:0/2986088107 conn(0x7f5f7c09c2a0 msgr2=0x7f5f7c15c6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:15.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.307+0000 7f5f82b2a640 1 -- 172.21.15.78:0/2986088107 shutdown_connections 2023-12-12T10:12:15.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.307+0000 7f5f82b2a640 1 -- 172.21.15.78:0/2986088107 wait complete. 2023-12-12T10:12:15.330 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T10:12:15.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.463+0000 7fc00cb57640 1 Processor -- start 2023-12-12T10:12:15.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.463+0000 7fc00cb57640 1 -- start start 2023-12-12T10:12:15.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.463+0000 7fc00cb57640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fc00815d3c0 0x7fc0080d3b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:15.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.463+0000 7fc00cb57640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0080b3250 con 0x7fc0080d1cb0 2023-12-12T10:12:15.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.463+0000 7fc00cb57640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0080cee50 con 0x7fc0080ce670 2023-12-12T10:12:15.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.463+0000 7fc00cb57640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0080b2920 con 0x7fc00815d3c0 2023-12-12T10:12:15.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.463+0000 7fc006d9d640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fc0080d1cb0 0x7fc0080b36e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:56274/0 (socket says 172.21.15.78:56274) 2023-12-12T10:12:15.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.463+0000 7fc006d9d640 1 -- 172.21.15.78:0/277158966 learned_addr learned my addr 172.21.15.78:0/277158966 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-12-12T10:12:15.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.463+0000 7fc00659c640 1 --2- 172.21.15.78:0/277158966 >> v2:172.21.15.187:3300/0 conn(0x7fc00815d3c0 0x7fc0080d3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:15.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.463+0000 7fc00559a640 1 -- 172.21.15.78:0/277158966 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3236183830 0 0) 0x7fc0080b3250 con 0x7fc0080d1cb0 2023-12-12T10:12:15.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.463+0000 7fc00559a640 1 -- 172.21.15.78:0/277158966 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbff0003530 con 0x7fc0080d1cb0 2023-12-12T10:12:15.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.463+0000 7fc00559a640 1 -- 172.21.15.78:0/277158966 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3239670926 0 0) 0x7fbff0003530 con 0x7fc0080d1cb0 2023-12-12T10:12:15.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.463+0000 7fc00559a640 1 -- 172.21.15.78:0/277158966 >> v2:172.21.15.187:3300/0 conn(0x7fc00815d3c0 msgr2=0x7fc0080d3b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:15.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.463+0000 7fc00559a640 1 --2- 172.21.15.78:0/277158966 >> v2:172.21.15.187:3300/0 conn(0x7fc00815d3c0 0x7fc0080d3b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:15.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.463+0000 7fc00559a640 1 -- 172.21.15.78:0/277158966 >> v1:172.21.15.187:6789/0 conn(0x7fc0080ce670 legacy=0x7fc0080d15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:15.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.463+0000 7fc00559a640 1 -- 172.21.15.78:0/277158966 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0080b2c00 con 0x7fc0080d1cb0 2023-12-12T10:12:15.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.463+0000 7fc00559a640 1 -- 172.21.15.78:0/277158966 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 465499599 0 0) 0x7fc000001a00 con 0x7fc0080d1cb0 2023-12-12T10:12:15.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.463+0000 7fc00559a640 1 -- 172.21.15.78:0/277158966 >> v1:172.21.15.78:6789/0 conn(0x7fc0080d1cb0 legacy=0x7fc0080b36e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:15.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.463+0000 7fc00559a640 1 --2- 172.21.15.78:0/277158966 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbff0003980 0x7fbff0003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:15.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.463+0000 7fc00559a640 1 --2- 172.21.15.78:0/277158966 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbff00047d0 0x7fbff0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:15.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.463+0000 7fc00559a640 1 --2- 172.21.15.78:0/277158966 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbff0005190 0x7fbff000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:15.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.463+0000 7fc00559a640 1 -- 172.21.15.78:0/277158966 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0080b2920 con 0x7fbff00047d0 2023-12-12T10:12:15.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.463+0000 7fc00559a640 1 -- 172.21.15.78:0/277158966 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbff000c040 con 0x7fbff0005190 2023-12-12T10:12:15.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.463+0000 7fc00559a640 1 -- 172.21.15.78:0/277158966 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbff000c200 con 0x7fbff0003980 2023-12-12T10:12:15.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.467+0000 7fc005d9b640 1 --2- 172.21.15.78:0/277158966 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbff00047d0 0x7fbff0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:15.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.467+0000 7fc00659c640 1 --2- 172.21.15.78:0/277158966 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbff0003980 0x7fbff0003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:15.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.467+0000 7fc006d9d640 1 --2- 172.21.15.78:0/277158966 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbff0005190 0x7fbff000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:15.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.467+0000 7fc005d9b640 1 -- 172.21.15.78:0/277158966 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbff0003980 msgr2=0x7fbff0003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:15.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.467+0000 7fc005d9b640 1 --2- 172.21.15.78:0/277158966 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbff0003980 0x7fbff0003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:15.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.467+0000 7fc005d9b640 1 -- 172.21.15.78:0/277158966 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbff0005190 msgr2=0x7fbff000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:15.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.467+0000 7fc005d9b640 1 --2- 172.21.15.78:0/277158966 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbff0005190 0x7fbff000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:15.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.467+0000 7fc006d9d640 1 -- 172.21.15.78:0/277158966 reap_dead start 2023-12-12T10:12:15.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.467+0000 7fc005d9b640 1 -- 172.21.15.78:0/277158966 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbff0003530 con 0x7fbff00047d0 2023-12-12T10:12:15.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.467+0000 7fc005d9b640 1 --2- 172.21.15.78:0/277158966 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbff00047d0 0x7fbff0004c50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fbffc001780 tx=0x7fbffc01c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9af91f87c7281fd2 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:15.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.467+0000 7fc00559a640 1 -- 172.21.15.78:0/277158966 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbffc0052d0 con 0x7fbff00047d0 2023-12-12T10:12:15.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.467+0000 7fc00559a640 1 -- 172.21.15.78:0/277158966 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbffc0a7050 con 0x7fbff00047d0 2023-12-12T10:12:15.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.467+0000 7fc00559a640 1 -- 172.21.15.78:0/277158966 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbffc003600 con 0x7fbff00047d0 2023-12-12T10:12:15.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.471+0000 7fc00cb57640 1 -- 172.21.15.78:0/277158966 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbff00047d0 msgr2=0x7fbff0004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:15.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.471+0000 7fc00cb57640 1 --2- 172.21.15.78:0/277158966 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbff00047d0 0x7fbff0004c50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fbffc001780 tx=0x7fbffc01c3e0 comp rx=0 tx=0).stop 2023-12-12T10:12:15.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.471+0000 7fc00cb57640 1 -- 172.21.15.78:0/277158966 shutdown_connections 2023-12-12T10:12:15.476 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.471+0000 7fc00cb57640 1 --2- 172.21.15.78:0/277158966 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbff00047d0 0x7fbff0004c50 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:15.476 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.471+0000 7fc00cb57640 1 -- 172.21.15.78:0/277158966 >> 172.21.15.78:0/277158966 conn(0x7fc00809c2a0 msgr2=0x7fc0080d2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:15.476 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.471+0000 7fc00cb57640 1 -- 172.21.15.78:0/277158966 shutdown_connections 2023-12-12T10:12:15.476 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.471+0000 7fc00cb57640 1 -- 172.21.15.78:0/277158966 wait complete. 2023-12-12T10:12:15.476 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.471+0000 7fc00cb57640 1 Processor -- start 2023-12-12T10:12:15.476 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.471+0000 7fc00cb57640 1 -- start start 2023-12-12T10:12:15.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.471+0000 7fc00cb57640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbff00047d0 0x7fc008160150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:15.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.471+0000 7fc00cb57640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc00815b100 0x7fc00815b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:15.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.471+0000 7fc00cb57640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc0081f2ae0 0x7fc0081f2f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:15.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.471+0000 7fc00cb57640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc00815bac0 con 0x7fbff00047d0 2023-12-12T10:12:15.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.471+0000 7fc00cb57640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0080c76d0 con 0x7fc0081f2ae0 2023-12-12T10:12:15.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.471+0000 7fc00cb57640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0081f34d0 con 0x7fc00815b100 2023-12-12T10:12:15.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.471+0000 7fc00659c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbff00047d0 0x7fc008160150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:15.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.471+0000 7fc00659c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbff00047d0 0x7fc008160150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43252/0 (socket says 172.21.15.78:43252) 2023-12-12T10:12:15.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.471+0000 7fc00659c640 1 -- 172.21.15.78:0/628056547 learned_addr learned my addr 172.21.15.78:0/628056547 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:15.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.471+0000 7fc005d9b640 1 --2- 172.21.15.78:0/628056547 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc00815b100 0x7fc00815b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:15.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.471+0000 7fc006d9d640 1 --2- 172.21.15.78:0/628056547 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc0081f2ae0 0x7fc0081f2f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:15.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.475+0000 7fc00659c640 1 -- 172.21.15.78:0/628056547 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc00815b100 msgr2=0x7fc00815b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:15.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.475+0000 7fc00659c640 1 --2- 172.21.15.78:0/628056547 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc00815b100 0x7fc00815b580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:15.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.475+0000 7fc00659c640 1 -- 172.21.15.78:0/628056547 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc0081f2ae0 msgr2=0x7fc0081f2f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:15.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.475+0000 7fc00659c640 1 --2- 172.21.15.78:0/628056547 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc0081f2ae0 0x7fc0081f2f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:15.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.475+0000 7fc00659c640 1 -- 172.21.15.78:0/628056547 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0081f3730 con 0x7fbff00047d0 2023-12-12T10:12:15.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.475+0000 7fc005d9b640 1 --2- 172.21.15.78:0/628056547 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc00815b100 0x7fc00815b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T10:12:15.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.475+0000 7fc00659c640 1 --2- 172.21.15.78:0/628056547 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbff00047d0 0x7fc008160150 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fbff8011930 tx=0x7fbff8011df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:15.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.475+0000 7fbff6ffd640 1 -- 172.21.15.78:0/628056547 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbff80095b0 con 0x7fbff00047d0 2023-12-12T10:12:15.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.475+0000 7fbff6ffd640 1 -- 172.21.15.78:0/628056547 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbff8004240 con 0x7fbff00047d0 2023-12-12T10:12:15.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.475+0000 7fc00cb57640 1 -- 172.21.15.78:0/628056547 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0081f3a10 con 0x7fbff00047d0 2023-12-12T10:12:15.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.475+0000 7fbff6ffd640 1 -- 172.21.15.78:0/628056547 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbff800f8e0 con 0x7fbff00047d0 2023-12-12T10:12:15.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.475+0000 7fc00cb57640 1 -- 172.21.15.78:0/628056547 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0080cb110 con 0x7fbff00047d0 2023-12-12T10:12:15.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.475+0000 7fc00cb57640 1 -- 172.21.15.78:0/628056547 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0080d3a90 con 0x7fbff00047d0 2023-12-12T10:12:15.481 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.475+0000 7fbff6ffd640 1 -- 172.21.15.78:0/628056547 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fbff800fa40 con 0x7fbff00047d0 2023-12-12T10:12:15.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.475+0000 7fbff6ffd640 1 --2- 172.21.15.78:0/628056547 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fbfe80664a0 0x7fbfe8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:15.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.479+0000 7fbff6ffd640 1 -- 172.21.15.78:0/628056547 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fbff8084800 con 0x7fbff00047d0 2023-12-12T10:12:15.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.479+0000 7fc005d9b640 1 --2- 172.21.15.78:0/628056547 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fbfe80664a0 0x7fbfe8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:15.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.479+0000 7fc005d9b640 1 --2- 172.21.15.78:0/628056547 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fbfe80664a0 0x7fbfe8068960 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fbffc001750 tx=0x7fbffc0011a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:15.486 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.479+0000 7fbff6ffd640 1 -- 172.21.15.78:0/628056547 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fbff80519a0 con 0x7fbff00047d0 2023-12-12T10:12:15.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.635+0000 7fc00cb57640 1 -- 172.21.15.78:0/628056547 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc008067530 con 0x7fbff00047d0 2023-12-12T10:12:15.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.635+0000 7fbff6ffd640 1 -- 172.21.15.78:0/628056547 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18310 (secure 0 0 0) 0x7fbff800fcf0 con 0x7fbff00047d0 2023-12-12T10:12:15.642 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:12:15.642 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":24,"fsid":"fc81937c-bd26-483c-952b-d1324fcb0c9e","created":"2023-12-12T10:11:44.020214+0000","modified":"2023-12-12T10:12:14.355146+0000","last_up_change":"2023-12-12T10:11:56.278318+0000","last_in_change":"2023-12-12T10:11:46.553610+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T10:11:57.053584+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-12T10:12:07.454450+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-12T10:12:08.182909+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-12T10:12:11.977952+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"22dfdedf-5f6c-4b20-9f6c-30517a1db70a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6809","nonce":3345683600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6811","nonce":3345683600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6815","nonce":3345683600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6813","nonce":3345683600}]},"public_addr":"172.21.15.78:6809/3345683600","cluster_addr":"172.21.15.78:6811/3345683600","heartbeat_back_addr":"172.21.15.78:6815/3345683600","heartbeat_front_addr":"172.21.15.78:6813/3345683600","state":["exists","up"]},{"osd":1,"uuid":"be34a7f3-a69a-462e-9ddf-5e537448dba2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6801","nonce":962652768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6803","nonce":962652768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6807","nonce":962652768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6805","nonce":962652768}]},"public_addr":"172.21.15.78:6801/962652768","cluster_addr":"172.21.15.78:6803/962652768","heartbeat_back_addr":"172.21.15.78:6807/962652768","heartbeat_front_addr":"172.21.15.78:6805/962652768","state":["exists","up"]},{"osd":2,"uuid":"55b381de-5f56-4b14-80f7-e6e41e084a13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6818","nonce":2910206054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6822","nonce":2910206054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6829","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6831","nonce":2910206054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6826","nonce":2910206054}]},"public_addr":"172.21.15.78:6818/2910206054","cluster_addr":"172.21.15.78:6822/2910206054","heartbeat_back_addr":"172.21.15.78:6831/2910206054","heartbeat_front_addr":"172.21.15.78:6826/2910206054","state":["exists","up"]},{"osd":3,"uuid":"d7682de1-25cb-4cec-869f-8851c28b0e6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6819","nonce":3750796703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6821","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6823","nonce":3750796703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6830","nonce":3750796703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6825","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6827","nonce":3750796703}]},"public_addr":"172.21.15.78:6819/3750796703","cluster_addr":"172.21.15.78:6823/3750796703","heartbeat_back_addr":"172.21.15.78:6830/3750796703","heartbeat_front_addr":"172.21.15.78:6827/3750796703","state":["exists","up"]},{"osd":4,"uuid":"8279815a-d6c7-4199-871e-d28971b9dc07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6809","nonce":2944277204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6811","nonce":2944277204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6815","nonce":2944277204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6813","nonce":2944277204}]},"public_addr":"172.21.15.187:6809/2944277204","cluster_addr":"172.21.15.187:6811/2944277204","heartbeat_back_addr":"172.21.15.187:6815/2944277204","heartbeat_front_addr":"172.21.15.187:6813/2944277204","state":["exists","up"]},{"osd":5,"uuid":"0a714c65-f8ce-4340-968f-11a799677ef3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6801","nonce":185858620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6803","nonce":185858620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6807","nonce":185858620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6805","nonce":185858620}]},"public_addr":"172.21.15.187:6801/185858620","cluster_addr":"172.21.15.187:6803/185858620","heartbeat_back_addr":"172.21.15.187:6807/185858620","heartbeat_front_addr":"172.21.15.187:6805/185858620","state":["exists","up"]},{"osd":6,"uuid":"d0bba9ab-f7ee-449e-8999-1c0cf7e6d53c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6817","nonce":4213392126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6819","nonce":4213392126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6824","nonce":4213392126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6821","nonce":4213392126}]},"public_addr":"172.21.15.187:6817/4213392126","cluster_addr":"172.21.15.187:6819/4213392126","heartbeat_back_addr":"172.21.15.187:6824/4213392126","heartbeat_front_addr":"172.21.15.187:6821/4213392126","state":["exists","up"]},{"osd":7,"uuid":"efe5e0d9-2f87-4889-a27a-e2a95a632302","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6823","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6825","nonce":85774004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6827","nonce":85774004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6831","nonce":85774004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6829","nonce":85774004}]},"public_addr":"172.21.15.187:6825/85774004","cluster_addr":"172.21.15.187:6827/85774004","heartbeat_back_addr":"172.21.15.187:6831/85774004","heartbeat_front_addr":"172.21.15.187:6829/85774004","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.214447+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.448899+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.293107+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.564184+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.175026+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.097717+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.261141+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.287681+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T10:12:15.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.639+0000 7fc00cb57640 1 -- 172.21.15.78:0/628056547 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fbfe80664a0 msgr2=0x7fbfe8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:15.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.639+0000 7fc00cb57640 1 --2- 172.21.15.78:0/628056547 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fbfe80664a0 0x7fbfe8068960 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fbffc001750 tx=0x7fbffc0011a0 comp rx=0 tx=0).stop 2023-12-12T10:12:15.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.639+0000 7fc00cb57640 1 -- 172.21.15.78:0/628056547 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbff00047d0 msgr2=0x7fc008160150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:15.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.639+0000 7fc00cb57640 1 --2- 172.21.15.78:0/628056547 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbff00047d0 0x7fc008160150 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fbff8011930 tx=0x7fbff8011df0 comp rx=0 tx=0).stop 2023-12-12T10:12:15.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.639+0000 7fc00cb57640 1 -- 172.21.15.78:0/628056547 shutdown_connections 2023-12-12T10:12:15.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.639+0000 7fc00cb57640 1 --2- 172.21.15.78:0/628056547 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fbfe80664a0 0x7fbfe8068960 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:15.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.639+0000 7fc00cb57640 1 --2- 172.21.15.78:0/628056547 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc0081f2ae0 0x7fc0081f2f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:15.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.639+0000 7fc00cb57640 1 --2- 172.21.15.78:0/628056547 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc00815b100 0x7fc00815b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:15.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.639+0000 7fc00cb57640 1 --2- 172.21.15.78:0/628056547 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbff00047d0 0x7fc008160150 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:15.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.639+0000 7fc00cb57640 1 -- 172.21.15.78:0/628056547 >> 172.21.15.78:0/628056547 conn(0x7fc00809c2a0 msgr2=0x7fc008157fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:15.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.639+0000 7fc00cb57640 1 -- 172.21.15.78:0/628056547 shutdown_connections 2023-12-12T10:12:15.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.639+0000 7fc00cb57640 1 -- 172.21.15.78:0/628056547 wait complete. 2023-12-12T10:12:15.662 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T10:12:15.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.791+0000 7f943b165640 1 Processor -- start 2023-12-12T10:12:15.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.791+0000 7f943b165640 1 -- start start 2023-12-12T10:12:15.800 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.795+0000 7f943b165640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9434146930 0x7f9434161530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:15.800 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.795+0000 7f943b165640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f94340b43f0 0x7f943415d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:15.800 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.795+0000 7f943b165640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f943406a540 0x7f943406a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:15.800 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.795+0000 7f943b165640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f943406af10 con 0x7f943406a540 2023-12-12T10:12:15.800 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.795+0000 7f943b165640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94341610a0 con 0x7f94340b43f0 2023-12-12T10:12:15.800 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.795+0000 7f943b165640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f943415e560 con 0x7f9434146930 2023-12-12T10:12:15.800 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.795+0000 7f9439702640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f943406a540 0x7f943406a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:15.800 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.795+0000 7f9439702640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f943406a540 0x7f943406a9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43260/0 (socket says 172.21.15.78:43260) 2023-12-12T10:12:15.800 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.795+0000 7f9439702640 1 -- 172.21.15.78:0/1466541368 learned_addr learned my addr 172.21.15.78:0/1466541368 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:15.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.795+0000 7f942bfff640 1 --2- 172.21.15.78:0/1466541368 >> v2:172.21.15.187:3300/0 conn(0x7f94340b43f0 0x7f943415d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:15.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.795+0000 7f9438f01640 1 --2- 172.21.15.78:0/1466541368 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9434146930 0x7f9434161530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:15.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.795+0000 7f9439702640 1 -- 172.21.15.78:0/1466541368 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9434146930 msgr2=0x7f9434161530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:15.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.795+0000 7f9439702640 1 --2- 172.21.15.78:0/1466541368 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9434146930 0x7f9434161530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:15.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.795+0000 7f9439702640 1 -- 172.21.15.78:0/1466541368 >> v2:172.21.15.187:3300/0 conn(0x7f94340b43f0 msgr2=0x7f943415d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:15.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.795+0000 7f9439702640 1 --2- 172.21.15.78:0/1466541368 >> v2:172.21.15.187:3300/0 conn(0x7f94340b43f0 0x7f943415d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:15.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.795+0000 7f9439702640 1 -- 172.21.15.78:0/1466541368 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f943415dfa0 con 0x7f943406a540 2023-12-12T10:12:15.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.795+0000 7f9438f01640 1 --2- 172.21.15.78:0/1466541368 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9434146930 0x7f9434161530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T10:12:15.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.795+0000 7f942bfff640 1 --2- 172.21.15.78:0/1466541368 >> v2:172.21.15.187:3300/0 conn(0x7f94340b43f0 0x7f943415d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T10:12:15.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.799+0000 7f9439702640 1 --2- 172.21.15.78:0/1466541368 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f943406a540 0x7f943406a9d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9434067b80 tx=0x7f942c01c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1aa727253d91427 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:15.803 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.799+0000 7f942b7fe640 1 -- 172.21.15.78:0/1466541368 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f942c0a5820 con 0x7f943406a540 2023-12-12T10:12:15.803 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.799+0000 7f942b7fe640 1 -- 172.21.15.78:0/1466541368 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f942c0a5980 con 0x7f943406a540 2023-12-12T10:12:15.803 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.799+0000 7f942b7fe640 1 -- 172.21.15.78:0/1466541368 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f942c0a5d10 con 0x7f943406a540 2023-12-12T10:12:15.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.799+0000 7f943b165640 1 -- 172.21.15.78:0/1466541368 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f943406a540 msgr2=0x7f943406a9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:15.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.799+0000 7f943b165640 1 --2- 172.21.15.78:0/1466541368 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f943406a540 0x7f943406a9d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9434067b80 tx=0x7f942c01c9a0 comp rx=0 tx=0).stop 2023-12-12T10:12:15.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.799+0000 7f943b165640 1 -- 172.21.15.78:0/1466541368 shutdown_connections 2023-12-12T10:12:15.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.799+0000 7f943b165640 1 --2- 172.21.15.78:0/1466541368 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f943406a540 0x7f943406a9d0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:15.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.799+0000 7f943b165640 1 --2- 172.21.15.78:0/1466541368 >> v2:172.21.15.187:3300/0 conn(0x7f94340b43f0 0x7f943415d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:15.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.799+0000 7f943b165640 1 --2- 172.21.15.78:0/1466541368 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9434146930 0x7f9434161530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:15.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.799+0000 7f943b165640 1 -- 172.21.15.78:0/1466541368 >> 172.21.15.78:0/1466541368 conn(0x7f94340b1c10 msgr2=0x7f94340b2020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:15.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.799+0000 7f943b165640 1 -- 172.21.15.78:0/1466541368 shutdown_connections 2023-12-12T10:12:15.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.799+0000 7f943b165640 1 -- 172.21.15.78:0/1466541368 wait complete. 2023-12-12T10:12:15.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.799+0000 7f943b165640 1 Processor -- start 2023-12-12T10:12:15.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.799+0000 7f943b165640 1 -- start start 2023-12-12T10:12:15.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.803+0000 7f943b165640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f943406a540 0x7f943415c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:15.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.803+0000 7f943b165640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f94340b43f0 0x7f94340b0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:15.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.803+0000 7f943b165640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9434146930 0x7f943413c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:15.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.803+0000 7f943b165640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f943413cfc0 con 0x7f943406a540 2023-12-12T10:12:15.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.803+0000 7f943b165640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f943413d260 con 0x7f9434146930 2023-12-12T10:12:15.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.803+0000 7f943b165640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f943413d540 con 0x7f94340b43f0 2023-12-12T10:12:15.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.803+0000 7f9438f01640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f943406a540 0x7f943415c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:15.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.803+0000 7f9438f01640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f943406a540 0x7f943415c380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43262/0 (socket says 172.21.15.78:43262) 2023-12-12T10:12:15.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.803+0000 7f9438f01640 1 -- 172.21.15.78:0/3319805626 learned_addr learned my addr 172.21.15.78:0/3319805626 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:15.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.803+0000 7f942bfff640 1 --2- 172.21.15.78:0/3319805626 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f94340b43f0 0x7f94340b0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:15.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.803+0000 7f9439702640 1 --2- 172.21.15.78:0/3319805626 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9434146930 0x7f943413c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:15.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.803+0000 7f9438f01640 1 -- 172.21.15.78:0/3319805626 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f94340b43f0 msgr2=0x7f94340b0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:15.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.803+0000 7f9438f01640 1 --2- 172.21.15.78:0/3319805626 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f94340b43f0 0x7f94340b0ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:15.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.803+0000 7f9438f01640 1 -- 172.21.15.78:0/3319805626 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9434146930 msgr2=0x7f943413c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:15.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.803+0000 7f9438f01640 1 --2- 172.21.15.78:0/3319805626 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9434146930 0x7f943413c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:15.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.803+0000 7f9438f01640 1 -- 172.21.15.78:0/3319805626 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f942c009b30 con 0x7f943406a540 2023-12-12T10:12:15.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.803+0000 7f942bfff640 1 --2- 172.21.15.78:0/3319805626 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f94340b43f0 0x7f94340b0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T10:12:15.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.803+0000 7f9439702640 1 --2- 172.21.15.78:0/3319805626 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9434146930 0x7f943413c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T10:12:15.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.803+0000 7f9438f01640 1 --2- 172.21.15.78:0/3319805626 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f943406a540 0x7f943415c380 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f943000d800 tx=0x7f943000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:15.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.803+0000 7f94297fa640 1 -- 172.21.15.78:0/3319805626 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94300096c0 con 0x7f943406a540 2023-12-12T10:12:15.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.803+0000 7f94297fa640 1 -- 172.21.15.78:0/3319805626 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9430009820 con 0x7f943406a540 2023-12-12T10:12:15.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.803+0000 7f94297fa640 1 -- 172.21.15.78:0/3319805626 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9430009bd0 con 0x7f943406a540 2023-12-12T10:12:15.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.803+0000 7f943b165640 1 -- 172.21.15.78:0/3319805626 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f943413d820 con 0x7f943406a540 2023-12-12T10:12:15.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.803+0000 7f943b165640 1 -- 172.21.15.78:0/3319805626 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f943413dde0 con 0x7f943406a540 2023-12-12T10:12:15.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.803+0000 7f943b165640 1 -- 172.21.15.78:0/3319805626 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94340671f0 con 0x7f943406a540 2023-12-12T10:12:15.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.803+0000 7f94297fa640 1 -- 172.21.15.78:0/3319805626 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9430009d30 con 0x7f943406a540 2023-12-12T10:12:15.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.807+0000 7f94297fa640 1 --2- 172.21.15.78:0/3319805626 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f9420066470 0x7f9420068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:15.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.807+0000 7f94297fa640 1 -- 172.21.15.78:0/3319805626 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9430084880 con 0x7f943406a540 2023-12-12T10:12:15.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.807+0000 7f942bfff640 1 --2- 172.21.15.78:0/3319805626 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f9420066470 0x7f9420068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:15.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.807+0000 7f942bfff640 1 --2- 172.21.15.78:0/3319805626 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f9420066470 0x7f9420068930 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f943406f2a0 tx=0x7f9424008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:15.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.811+0000 7f94297fa640 1 -- 172.21.15.78:0/3319805626 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9430051a00 con 0x7f943406a540 2023-12-12T10:12:15.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.959+0000 7f943b165640 1 -- 172.21.15.78:0/3319805626 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f94340725a0 con 0x7f943406a540 2023-12-12T10:12:15.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.963+0000 7f94297fa640 1 -- 172.21.15.78:0/3319805626 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18310 (secure 0 0 0) 0x7f9430055020 con 0x7f943406a540 2023-12-12T10:12:15.967 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:12:15.967 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":24,"fsid":"fc81937c-bd26-483c-952b-d1324fcb0c9e","created":"2023-12-12T10:11:44.020214+0000","modified":"2023-12-12T10:12:14.355146+0000","last_up_change":"2023-12-12T10:11:56.278318+0000","last_in_change":"2023-12-12T10:11:46.553610+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T10:11:57.053584+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-12T10:12:07.454450+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-12T10:12:08.182909+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-12T10:12:11.977952+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"22dfdedf-5f6c-4b20-9f6c-30517a1db70a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6809","nonce":3345683600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6811","nonce":3345683600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6815","nonce":3345683600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6813","nonce":3345683600}]},"public_addr":"172.21.15.78:6809/3345683600","cluster_addr":"172.21.15.78:6811/3345683600","heartbeat_back_addr":"172.21.15.78:6815/3345683600","heartbeat_front_addr":"172.21.15.78:6813/3345683600","state":["exists","up"]},{"osd":1,"uuid":"be34a7f3-a69a-462e-9ddf-5e537448dba2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6801","nonce":962652768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6803","nonce":962652768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6807","nonce":962652768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6805","nonce":962652768}]},"public_addr":"172.21.15.78:6801/962652768","cluster_addr":"172.21.15.78:6803/962652768","heartbeat_back_addr":"172.21.15.78:6807/962652768","heartbeat_front_addr":"172.21.15.78:6805/962652768","state":["exists","up"]},{"osd":2,"uuid":"55b381de-5f56-4b14-80f7-e6e41e084a13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6818","nonce":2910206054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6822","nonce":2910206054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6829","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6831","nonce":2910206054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6826","nonce":2910206054}]},"public_addr":"172.21.15.78:6818/2910206054","cluster_addr":"172.21.15.78:6822/2910206054","heartbeat_back_addr":"172.21.15.78:6831/2910206054","heartbeat_front_addr":"172.21.15.78:6826/2910206054","state":["exists","up"]},{"osd":3,"uuid":"d7682de1-25cb-4cec-869f-8851c28b0e6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6819","nonce":3750796703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6821","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6823","nonce":3750796703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6830","nonce":3750796703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6825","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6827","nonce":3750796703}]},"public_addr":"172.21.15.78:6819/3750796703","cluster_addr":"172.21.15.78:6823/3750796703","heartbeat_back_addr":"172.21.15.78:6830/3750796703","heartbeat_front_addr":"172.21.15.78:6827/3750796703","state":["exists","up"]},{"osd":4,"uuid":"8279815a-d6c7-4199-871e-d28971b9dc07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6809","nonce":2944277204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6811","nonce":2944277204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6815","nonce":2944277204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6813","nonce":2944277204}]},"public_addr":"172.21.15.187:6809/2944277204","cluster_addr":"172.21.15.187:6811/2944277204","heartbeat_back_addr":"172.21.15.187:6815/2944277204","heartbeat_front_addr":"172.21.15.187:6813/2944277204","state":["exists","up"]},{"osd":5,"uuid":"0a714c65-f8ce-4340-968f-11a799677ef3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6801","nonce":185858620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6803","nonce":185858620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6807","nonce":185858620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6805","nonce":185858620}]},"public_addr":"172.21.15.187:6801/185858620","cluster_addr":"172.21.15.187:6803/185858620","heartbeat_back_addr":"172.21.15.187:6807/185858620","heartbeat_front_addr":"172.21.15.187:6805/185858620","state":["exists","up"]},{"osd":6,"uuid":"d0bba9ab-f7ee-449e-8999-1c0cf7e6d53c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6817","nonce":4213392126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6819","nonce":4213392126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6824","nonce":4213392126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6821","nonce":4213392126}]},"public_addr":"172.21.15.187:6817/4213392126","cluster_addr":"172.21.15.187:6819/4213392126","heartbeat_back_addr":"172.21.15.187:6824/4213392126","heartbeat_front_addr":"172.21.15.187:6821/4213392126","state":["exists","up"]},{"osd":7,"uuid":"efe5e0d9-2f87-4889-a27a-e2a95a632302","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6823","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6825","nonce":85774004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6827","nonce":85774004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6831","nonce":85774004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6829","nonce":85774004}]},"public_addr":"172.21.15.187:6825/85774004","cluster_addr":"172.21.15.187:6827/85774004","heartbeat_back_addr":"172.21.15.187:6831/85774004","heartbeat_front_addr":"172.21.15.187:6829/85774004","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.214447+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.448899+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.293107+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.564184+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.175026+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.097717+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.261141+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.287681+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T10:12:15.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.963+0000 7f943b165640 1 -- 172.21.15.78:0/3319805626 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f9420066470 msgr2=0x7f9420068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:15.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.963+0000 7f943b165640 1 --2- 172.21.15.78:0/3319805626 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f9420066470 0x7f9420068930 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f943406f2a0 tx=0x7f9424008040 comp rx=0 tx=0).stop 2023-12-12T10:12:15.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.963+0000 7f943b165640 1 -- 172.21.15.78:0/3319805626 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f943406a540 msgr2=0x7f943415c380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:15.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.963+0000 7f943b165640 1 --2- 172.21.15.78:0/3319805626 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f943406a540 0x7f943415c380 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f943000d800 tx=0x7f943000dcc0 comp rx=0 tx=0).stop 2023-12-12T10:12:15.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.963+0000 7f943b165640 1 -- 172.21.15.78:0/3319805626 shutdown_connections 2023-12-12T10:12:15.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.963+0000 7f943b165640 1 --2- 172.21.15.78:0/3319805626 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f9420066470 0x7f9420068930 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:15.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.963+0000 7f943b165640 1 --2- 172.21.15.78:0/3319805626 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9434146930 0x7f943413c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:15.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.963+0000 7f943b165640 1 --2- 172.21.15.78:0/3319805626 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f94340b43f0 0x7f94340b0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:15.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.963+0000 7f943b165640 1 --2- 172.21.15.78:0/3319805626 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f943406a540 0x7f943415c380 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:15.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.963+0000 7f943b165640 1 -- 172.21.15.78:0/3319805626 >> 172.21.15.78:0/3319805626 conn(0x7f94340b1c10 msgr2=0x7f9434143220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:15.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.963+0000 7f943b165640 1 -- 172.21.15.78:0/3319805626 shutdown_connections 2023-12-12T10:12:15.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:15.963+0000 7f943b165640 1 -- 172.21.15.78:0/3319805626 wait complete. 2023-12-12T10:12:16.003 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-12T10:12:16.140 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.135+0000 7f9a8c357640 1 Processor -- start 2023-12-12T10:12:16.140 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.135+0000 7f9a8c357640 1 -- start start 2023-12-12T10:12:16.141 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.135+0000 7f9a8c357640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f9a840ade10 0x7f9a840ce5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:16.141 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.135+0000 7f9a8c357640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a840ae1f0 con 0x7f9a840b47d0 2023-12-12T10:12:16.141 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.135+0000 7f9a8c357640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a8415c410 con 0x7f9a840cb7e0 2023-12-12T10:12:16.141 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.135+0000 7f9a8c357640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a840ceb00 con 0x7f9a840ade10 2023-12-12T10:12:16.143 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.135+0000 7f9a8a8f4640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f9a840b47d0 0x7f9a841580a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:56276/0 (socket says 172.21.15.78:56276) 2023-12-12T10:12:16.144 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.135+0000 7f9a8a8f4640 1 -- 172.21.15.78:0/2168761671 learned_addr learned my addr 172.21.15.78:0/2168761671 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-12-12T10:12:16.144 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.135+0000 7f9a8a0f3640 1 --2- 172.21.15.78:0/2168761671 >> v2:172.21.15.187:3300/0 conn(0x7f9a840ade10 0x7f9a840ce5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:16.144 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.135+0000 7f9a890f1640 1 -- 172.21.15.78:0/2168761671 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1831941146 0 0) 0x7f9a840ae1f0 con 0x7f9a840b47d0 2023-12-12T10:12:16.144 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.135+0000 7f9a890f1640 1 -- 172.21.15.78:0/2168761671 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a70003530 con 0x7f9a840b47d0 2023-12-12T10:12:16.144 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.139+0000 7f9a890f1640 1 -- 172.21.15.78:0/2168761671 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1980408642 0 0) 0x7f9a70003530 con 0x7f9a840b47d0 2023-12-12T10:12:16.144 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.139+0000 7f9a890f1640 1 -- 172.21.15.78:0/2168761671 >> v2:172.21.15.187:3300/0 conn(0x7f9a840ade10 msgr2=0x7f9a840ce5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:16.144 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.139+0000 7f9a890f1640 1 --2- 172.21.15.78:0/2168761671 >> v2:172.21.15.187:3300/0 conn(0x7f9a840ade10 0x7f9a840ce5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:16.144 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.139+0000 7f9a890f1640 1 -- 172.21.15.78:0/2168761671 >> v1:172.21.15.187:6789/0 conn(0x7f9a840cb7e0 legacy=0x7f9a840b40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:16.144 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.139+0000 7f9a890f1640 1 -- 172.21.15.78:0/2168761671 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a8415b800 con 0x7f9a840b47d0 2023-12-12T10:12:16.144 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.139+0000 7f9a890f1640 1 -- 172.21.15.78:0/2168761671 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 465499599 0 0) 0x7f9a7c001a00 con 0x7f9a840b47d0 2023-12-12T10:12:16.144 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.139+0000 7f9a890f1640 1 -- 172.21.15.78:0/2168761671 >> v1:172.21.15.78:6789/0 conn(0x7f9a840b47d0 legacy=0x7f9a841580a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:16.144 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.139+0000 7f9a890f1640 1 --2- 172.21.15.78:0/2168761671 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9a700039d0 0x7f9a70003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:16.144 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.139+0000 7f9a890f1640 1 --2- 172.21.15.78:0/2168761671 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9a700047d0 0x7f9a70004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:16.145 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.139+0000 7f9a890f1640 1 --2- 172.21.15.78:0/2168761671 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9a70005190 0x7f9a7000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:16.145 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.139+0000 7f9a890f1640 1 -- 172.21.15.78:0/2168761671 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a840ceb00 con 0x7f9a700039d0 2023-12-12T10:12:16.145 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.139+0000 7f9a890f1640 1 -- 172.21.15.78:0/2168761671 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a7000c090 con 0x7f9a700047d0 2023-12-12T10:12:16.145 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.139+0000 7f9a890f1640 1 -- 172.21.15.78:0/2168761671 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a7000c250 con 0x7f9a70005190 2023-12-12T10:12:16.145 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.139+0000 7f9a8a0f3640 1 --2- 172.21.15.78:0/2168761671 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9a700039d0 0x7f9a70003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:16.145 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.139+0000 7f9a898f2640 1 --2- 172.21.15.78:0/2168761671 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9a700047d0 0x7f9a70004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:16.145 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.139+0000 7f9a8a0f3640 1 -- 172.21.15.78:0/2168761671 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9a70005190 msgr2=0x7f9a7000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:16.145 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.139+0000 7f9a8a8f4640 1 --2- 172.21.15.78:0/2168761671 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9a70005190 0x7f9a7000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:16.145 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.139+0000 7f9a8a0f3640 1 --2- 172.21.15.78:0/2168761671 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9a70005190 0x7f9a7000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:16.145 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.139+0000 7f9a8a0f3640 1 -- 172.21.15.78:0/2168761671 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9a700047d0 msgr2=0x7f9a70004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:16.145 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.139+0000 7f9a8a0f3640 1 --2- 172.21.15.78:0/2168761671 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9a700047d0 0x7f9a70004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:16.145 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.139+0000 7f9a8a0f3640 1 -- 172.21.15.78:0/2168761671 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a70003530 con 0x7f9a700039d0 2023-12-12T10:12:16.145 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.139+0000 7f9a898f2640 1 --2- 172.21.15.78:0/2168761671 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9a700047d0 0x7f9a70004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T10:12:16.145 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.139+0000 7f9a8a8f4640 1 --2- 172.21.15.78:0/2168761671 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9a70005190 0x7f9a7000b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T10:12:16.145 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.139+0000 7f9a8a8f4640 1 -- 172.21.15.78:0/2168761671 reap_dead start 2023-12-12T10:12:16.146 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.139+0000 7f9a8a0f3640 1 --2- 172.21.15.78:0/2168761671 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9a700039d0 0x7f9a70003df0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f9a80009ae0 tx=0x7f9a8001ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f75c213625a44d1f server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:16.146 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.139+0000 7f9a890f1640 1 -- 172.21.15.78:0/2168761671 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a800a6430 con 0x7f9a700039d0 2023-12-12T10:12:16.146 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.139+0000 7f9a890f1640 1 -- 172.21.15.78:0/2168761671 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a800a6590 con 0x7f9a700039d0 2023-12-12T10:12:16.146 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.139+0000 7f9a890f1640 1 -- 172.21.15.78:0/2168761671 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a800a6940 con 0x7f9a700039d0 2023-12-12T10:12:16.147 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.143+0000 7f9a8c357640 1 -- 172.21.15.78:0/2168761671 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9a700039d0 msgr2=0x7f9a70003df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:16.147 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.143+0000 7f9a8c357640 1 --2- 172.21.15.78:0/2168761671 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9a700039d0 0x7f9a70003df0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f9a80009ae0 tx=0x7f9a8001ca50 comp rx=0 tx=0).stop 2023-12-12T10:12:16.147 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.143+0000 7f9a8c357640 1 -- 172.21.15.78:0/2168761671 shutdown_connections 2023-12-12T10:12:16.147 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.143+0000 7f9a8c357640 1 --2- 172.21.15.78:0/2168761671 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9a700039d0 0x7f9a70003df0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:16.147 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.143+0000 7f9a8c357640 1 -- 172.21.15.78:0/2168761671 >> 172.21.15.78:0/2168761671 conn(0x7f9a8406c5d0 msgr2=0x7f9a8406c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:16.148 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.143+0000 7f9a8c357640 1 -- 172.21.15.78:0/2168761671 shutdown_connections 2023-12-12T10:12:16.148 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.143+0000 7f9a8c357640 1 -- 172.21.15.78:0/2168761671 wait complete. 2023-12-12T10:12:16.149 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.143+0000 7f9a8c357640 1 Processor -- start 2023-12-12T10:12:16.149 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.143+0000 7f9a8c357640 1 -- start start 2023-12-12T10:12:16.151 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.143+0000 7f9a8c357640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9a700039d0 0x7f9a840a8470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:16.151 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.143+0000 7f9a8c357640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9a840a8e80 0x7f9a841456d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:16.152 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.143+0000 7f9a8c357640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9a8415ff90 0x7f9a84071280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:16.152 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.143+0000 7f9a8c357640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a840a92e0 con 0x7f9a840a8e80 2023-12-12T10:12:16.152 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.143+0000 7f9a8c357640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a84145c10 con 0x7f9a700039d0 2023-12-12T10:12:16.152 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.143+0000 7f9a8c357640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a8415fb00 con 0x7f9a8415ff90 2023-12-12T10:12:16.152 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.143+0000 7f9a898f2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9a840a8e80 0x7f9a841456d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:16.152 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.143+0000 7f9a898f2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9a840a8e80 0x7f9a841456d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43270/0 (socket says 172.21.15.78:43270) 2023-12-12T10:12:16.152 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.143+0000 7f9a898f2640 1 -- 172.21.15.78:0/3584113726 learned_addr learned my addr 172.21.15.78:0/3584113726 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:16.152 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.143+0000 7f9a8a0f3640 1 --2- 172.21.15.78:0/3584113726 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9a700039d0 0x7f9a840a8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:16.152 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.143+0000 7f9a8a8f4640 1 --2- 172.21.15.78:0/3584113726 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9a8415ff90 0x7f9a84071280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:16.152 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.147+0000 7f9a898f2640 1 -- 172.21.15.78:0/3584113726 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9a8415ff90 msgr2=0x7f9a84071280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:16.152 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.147+0000 7f9a898f2640 1 --2- 172.21.15.78:0/3584113726 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9a8415ff90 0x7f9a84071280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:16.152 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.147+0000 7f9a898f2640 1 -- 172.21.15.78:0/3584113726 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9a700039d0 msgr2=0x7f9a840a8470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:16.152 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.147+0000 7f9a898f2640 1 --2- 172.21.15.78:0/3584113726 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9a700039d0 0x7f9a840a8470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:16.152 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.147+0000 7f9a898f2640 1 -- 172.21.15.78:0/3584113726 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a841562d0 con 0x7f9a840a8e80 2023-12-12T10:12:16.153 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.147+0000 7f9a8a0f3640 1 --2- 172.21.15.78:0/3584113726 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9a700039d0 0x7f9a840a8470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T10:12:16.153 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.147+0000 7f9a898f2640 1 --2- 172.21.15.78:0/3584113726 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9a840a8e80 0x7f9a841456d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9a74000c10 tx=0x7f9a7400e9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:16.153 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.147+0000 7f9a7affd640 1 -- 172.21.15.78:0/3584113726 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a740052e0 con 0x7f9a840a8e80 2023-12-12T10:12:16.153 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.147+0000 7f9a7affd640 1 -- 172.21.15.78:0/3584113726 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a74005440 con 0x7f9a840a8e80 2023-12-12T10:12:16.153 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.147+0000 7f9a8c357640 1 -- 172.21.15.78:0/3584113726 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a8415f210 con 0x7f9a840a8e80 2023-12-12T10:12:16.153 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.147+0000 7f9a7affd640 1 -- 172.21.15.78:0/3584113726 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a74003820 con 0x7f9a840a8e80 2023-12-12T10:12:16.153 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.147+0000 7f9a8c357640 1 -- 172.21.15.78:0/3584113726 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a8415f790 con 0x7f9a840a8e80 2023-12-12T10:12:16.154 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.147+0000 7f9a8c357640 1 -- 172.21.15.78:0/3584113726 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a840671f0 con 0x7f9a840a8e80 2023-12-12T10:12:16.154 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.147+0000 7f9a7affd640 1 -- 172.21.15.78:0/3584113726 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9a74003980 con 0x7f9a840a8e80 2023-12-12T10:12:16.154 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.147+0000 7f9a7affd640 1 --2- 172.21.15.78:0/3584113726 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f9a68066470 0x7f9a68068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:16.154 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.147+0000 7f9a7affd640 1 -- 172.21.15.78:0/3584113726 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9a74083f90 con 0x7f9a840a8e80 2023-12-12T10:12:16.154 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.147+0000 7f9a8a0f3640 1 --2- 172.21.15.78:0/3584113726 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f9a68066470 0x7f9a68068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:16.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.151+0000 7f9a8a0f3640 1 --2- 172.21.15.78:0/3584113726 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f9a68066470 0x7f9a68068930 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9a800ad000 tx=0x7f9a800046d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:16.158 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.151+0000 7f9a7affd640 1 -- 172.21.15.78:0/3584113726 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9a74051110 con 0x7f9a840a8e80 2023-12-12T10:12:16.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.331+0000 7f9a8c357640 1 -- 172.21.15.78:0/3584113726 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9a84067530 con 0x7f9a840a8e80 2023-12-12T10:12:16.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.331+0000 7f9a7affd640 1 -- 172.21.15.78:0/3584113726 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4912 (secure 0 0 0) 0x7f9a74054730 con 0x7f9a840a8e80 2023-12-12T10:12:16.339 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:12:16.339 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/3747609982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":3747609982},{"type":"v1","addr":"172.21.15.187:6834","nonce":3747609982}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4282,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/3245919280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":3245919280},{"type":"v1","addr":"172.21.15.187:6835","nonce":3245919280}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4293,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/3902814576","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":3902814576},{"type":"v1","addr":"172.21.15.78:6835","nonce":3902814576}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-12T10:12:09.200933+0000","modified":"2023-12-12T10:12:14.355309+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4296},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4296":{"gid":4296,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.78:6837/739552946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":739552946},{"type":"v1","addr":"172.21.15.78:6837","nonce":739552946}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-12-12T10:12:16.339 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 7 2023-12-12T10:12:16.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.335+0000 7f9a8c357640 1 -- 172.21.15.78:0/3584113726 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f9a68066470 msgr2=0x7f9a68068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:16.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.335+0000 7f9a8c357640 1 --2- 172.21.15.78:0/3584113726 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f9a68066470 0x7f9a68068930 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9a800ad000 tx=0x7f9a800046d0 comp rx=0 tx=0).stop 2023-12-12T10:12:16.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.335+0000 7f9a8c357640 1 -- 172.21.15.78:0/3584113726 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9a840a8e80 msgr2=0x7f9a841456d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:16.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.335+0000 7f9a8c357640 1 --2- 172.21.15.78:0/3584113726 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9a840a8e80 0x7f9a841456d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9a74000c10 tx=0x7f9a7400e9e0 comp rx=0 tx=0).stop 2023-12-12T10:12:16.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.335+0000 7f9a8c357640 1 -- 172.21.15.78:0/3584113726 shutdown_connections 2023-12-12T10:12:16.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.335+0000 7f9a8c357640 1 --2- 172.21.15.78:0/3584113726 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f9a68066470 0x7f9a68068930 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:16.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.335+0000 7f9a8c357640 1 --2- 172.21.15.78:0/3584113726 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9a8415ff90 0x7f9a84071280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:16.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.335+0000 7f9a8c357640 1 --2- 172.21.15.78:0/3584113726 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9a840a8e80 0x7f9a841456d0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:16.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.335+0000 7f9a8c357640 1 --2- 172.21.15.78:0/3584113726 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9a700039d0 0x7f9a840a8470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:16.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.335+0000 7f9a8c357640 1 -- 172.21.15.78:0/3584113726 >> 172.21.15.78:0/3584113726 conn(0x7f9a8406c5d0 msgr2=0x7f9a840aedd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:16.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.335+0000 7f9a8c357640 1 -- 172.21.15.78:0/3584113726 shutdown_connections 2023-12-12T10:12:16.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.335+0000 7f9a8c357640 1 -- 172.21.15.78:0/3584113726 wait complete. 2023-12-12T10:12:16.359 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T10:12:16.497 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.491+0000 7fae119aa640 1 Processor -- start 2023-12-12T10:12:16.497 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.491+0000 7fae119aa640 1 -- start start 2023-12-12T10:12:16.498 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.491+0000 7fae119aa640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fae0c15d3c0 0x7fae0c0d3b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:16.498 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.491+0000 7fae119aa640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fae0c0d1cb0 0x7fae0c0b36e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:16.498 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.491+0000 7fae119aa640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae0c0b3250 con 0x7fae0c0ce670 2023-12-12T10:12:16.499 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.491+0000 7fae119aa640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae0c0cee50 con 0x7fae0c15d3c0 2023-12-12T10:12:16.499 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.491+0000 7fae119aa640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae0c0b2920 con 0x7fae0c0d1cb0 2023-12-12T10:12:16.499 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.491+0000 7fae0affd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fae0c15d3c0 0x7fae0c0d3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:16.499 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.495+0000 7fae0affd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fae0c15d3c0 0x7fae0c0d3b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43272/0 (socket says 172.21.15.78:43272) 2023-12-12T10:12:16.499 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.495+0000 7fae0affd640 1 -- 172.21.15.78:0/3989405303 learned_addr learned my addr 172.21.15.78:0/3989405303 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:16.499 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.495+0000 7fae0b7fe640 1 --2- 172.21.15.78:0/3989405303 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fae0c0d1cb0 0x7fae0c0b36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:16.499 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.495+0000 7fae0affd640 1 -- 172.21.15.78:0/3989405303 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fae0c0d1cb0 msgr2=0x7fae0c0b36e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:16.499 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.495+0000 7fae0affd640 1 --2- 172.21.15.78:0/3989405303 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fae0c0d1cb0 0x7fae0c0b36e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:16.499 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.495+0000 7fae0affd640 1 -- 172.21.15.78:0/3989405303 >> v1:172.21.15.187:6789/0 conn(0x7fae0c0ce670 legacy=0x7fae0c0d15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:16.499 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.495+0000 7fae0affd640 1 -- 172.21.15.78:0/3989405303 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae0c0b2c00 con 0x7fae0c15d3c0 2023-12-12T10:12:16.499 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.495+0000 7fae0b7fe640 1 --2- 172.21.15.78:0/3989405303 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fae0c0d1cb0 0x7fae0c0b36e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T10:12:16.501 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.495+0000 7fae0affd640 1 --2- 172.21.15.78:0/3989405303 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae0c15d3c0 0x7fae0c0d3b10 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fadfc009870 tx=0x7fadfc01ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abc4569b1f15172f server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:16.502 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.495+0000 7fae0a7fc640 1 -- 172.21.15.78:0/3989405303 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadfc0a8a30 con 0x7fae0c15d3c0 2023-12-12T10:12:16.502 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.495+0000 7fae0a7fc640 1 -- 172.21.15.78:0/3989405303 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadfc0a8b90 con 0x7fae0c15d3c0 2023-12-12T10:12:16.502 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.495+0000 7fae0a7fc640 1 -- 172.21.15.78:0/3989405303 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadfc0b0440 con 0x7fae0c15d3c0 2023-12-12T10:12:16.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.499+0000 7fae119aa640 1 -- 172.21.15.78:0/3989405303 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae0c15d3c0 msgr2=0x7fae0c0d3b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:16.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.499+0000 7fae119aa640 1 --2- 172.21.15.78:0/3989405303 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae0c15d3c0 0x7fae0c0d3b10 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fadfc009870 tx=0x7fadfc01ed30 comp rx=0 tx=0).stop 2023-12-12T10:12:16.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.499+0000 7fae119aa640 1 -- 172.21.15.78:0/3989405303 shutdown_connections 2023-12-12T10:12:16.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.499+0000 7fae119aa640 1 --2- 172.21.15.78:0/3989405303 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fae0c0d1cb0 0x7fae0c0b36e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:16.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.499+0000 7fae119aa640 1 --2- 172.21.15.78:0/3989405303 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae0c15d3c0 0x7fae0c0d3b10 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:16.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.499+0000 7fae119aa640 1 -- 172.21.15.78:0/3989405303 >> 172.21.15.78:0/3989405303 conn(0x7fae0c09c2a0 msgr2=0x7fae0c0d2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:16.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.499+0000 7fae119aa640 1 -- 172.21.15.78:0/3989405303 shutdown_connections 2023-12-12T10:12:16.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.499+0000 7fae119aa640 1 -- 172.21.15.78:0/3989405303 wait complete. 2023-12-12T10:12:16.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.499+0000 7fae119aa640 1 Processor -- start 2023-12-12T10:12:16.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.499+0000 7fae119aa640 1 -- start start 2023-12-12T10:12:16.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.499+0000 7fae119aa640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae0c0ce670 0x7fae0c0c7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:16.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.499+0000 7fae119aa640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fae0c0d1cb0 0x7fae0c0b1540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:16.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.499+0000 7fae119aa640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fae0c15d3c0 0x7fae0c0b5b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:16.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.499+0000 7fae119aa640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae0c0b8910 con 0x7fae0c0ce670 2023-12-12T10:12:16.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.499+0000 7fae119aa640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae0c1f6220 con 0x7fae0c0d1cb0 2023-12-12T10:12:16.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.499+0000 7fae119aa640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae0c0c8fb0 con 0x7fae0c15d3c0 2023-12-12T10:12:16.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.499+0000 7fae0affd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae0c0ce670 0x7fae0c0c7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:16.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.499+0000 7fae0affd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae0c0ce670 0x7fae0c0c7110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43274/0 (socket says 172.21.15.78:43274) 2023-12-12T10:12:16.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.499+0000 7fae0affd640 1 -- 172.21.15.78:0/1802029439 learned_addr learned my addr 172.21.15.78:0/1802029439 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:16.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.499+0000 7fae03fff640 1 --2- 172.21.15.78:0/1802029439 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fae0c0d1cb0 0x7fae0c0b1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:16.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.499+0000 7fae0b7fe640 1 --2- 172.21.15.78:0/1802029439 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fae0c15d3c0 0x7fae0c0b5b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:16.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.499+0000 7fae0affd640 1 -- 172.21.15.78:0/1802029439 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fae0c15d3c0 msgr2=0x7fae0c0b5b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:16.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.499+0000 7fae0affd640 1 --2- 172.21.15.78:0/1802029439 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fae0c15d3c0 0x7fae0c0b5b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:16.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.499+0000 7fae0affd640 1 -- 172.21.15.78:0/1802029439 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fae0c0d1cb0 msgr2=0x7fae0c0b1540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:16.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.499+0000 7fae0affd640 1 --2- 172.21.15.78:0/1802029439 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fae0c0d1cb0 0x7fae0c0b1540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:16.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.499+0000 7fae0affd640 1 -- 172.21.15.78:0/1802029439 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadfc0094d0 con 0x7fae0c0ce670 2023-12-12T10:12:16.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.499+0000 7fae0affd640 1 --2- 172.21.15.78:0/1802029439 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae0c0ce670 0x7fae0c0c7110 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fadfc0b3040 tx=0x7fadfc01bad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:16.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.503+0000 7fae08ff9640 1 -- 172.21.15.78:0/1802029439 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadfc0be070 con 0x7fae0c0ce670 2023-12-12T10:12:16.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.503+0000 7fae08ff9640 1 -- 172.21.15.78:0/1802029439 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadfc0ba400 con 0x7fae0c0ce670 2023-12-12T10:12:16.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.503+0000 7fae119aa640 1 -- 172.21.15.78:0/1802029439 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae0c0c9290 con 0x7fae0c0ce670 2023-12-12T10:12:16.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.503+0000 7fae08ff9640 1 -- 172.21.15.78:0/1802029439 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadfc0ba7d0 con 0x7fae0c0ce670 2023-12-12T10:12:16.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.503+0000 7fae119aa640 1 -- 172.21.15.78:0/1802029439 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae0c0c9850 con 0x7fae0c0ce670 2023-12-12T10:12:16.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.503+0000 7fae119aa640 1 -- 172.21.15.78:0/1802029439 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae0c067530 con 0x7fae0c0ce670 2023-12-12T10:12:16.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.503+0000 7fae08ff9640 1 -- 172.21.15.78:0/1802029439 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fadfc0c3410 con 0x7fae0c0ce670 2023-12-12T10:12:16.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.503+0000 7fae08ff9640 1 --2- 172.21.15.78:0/1802029439 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fadec066470 0x7fadec068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:16.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.503+0000 7fae08ff9640 1 -- 172.21.15.78:0/1802029439 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fadfc121c80 con 0x7fae0c0ce670 2023-12-12T10:12:16.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.503+0000 7fae03fff640 1 --2- 172.21.15.78:0/1802029439 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fadec066470 0x7fadec068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:16.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.507+0000 7fae03fff640 1 --2- 172.21.15.78:0/1802029439 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fadec066470 0x7fadec068930 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fae0c09c790 tx=0x7fadf4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:16.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.507+0000 7fae08ff9640 1 -- 172.21.15.78:0/1802029439 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fadfc0eeea0 con 0x7fae0c0ce670 2023-12-12T10:12:16.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.659+0000 7fae119aa640 1 -- 172.21.15.78:0/1802029439 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fae0c0d2600 con 0x7fae0c0ce670 2023-12-12T10:12:16.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.663+0000 7fae08ff9640 1 -- 172.21.15.78:0/1802029439 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18310 (secure 0 0 0) 0x7fadfc0f24c0 con 0x7fae0c0ce670 2023-12-12T10:12:16.667 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:12:16.667 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":24,"fsid":"fc81937c-bd26-483c-952b-d1324fcb0c9e","created":"2023-12-12T10:11:44.020214+0000","modified":"2023-12-12T10:12:14.355146+0000","last_up_change":"2023-12-12T10:11:56.278318+0000","last_in_change":"2023-12-12T10:11:46.553610+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T10:11:57.053584+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-12T10:12:07.454450+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-12T10:12:08.182909+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-12T10:12:11.977952+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"22dfdedf-5f6c-4b20-9f6c-30517a1db70a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6809","nonce":3345683600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6811","nonce":3345683600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6815","nonce":3345683600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6813","nonce":3345683600}]},"public_addr":"172.21.15.78:6809/3345683600","cluster_addr":"172.21.15.78:6811/3345683600","heartbeat_back_addr":"172.21.15.78:6815/3345683600","heartbeat_front_addr":"172.21.15.78:6813/3345683600","state":["exists","up"]},{"osd":1,"uuid":"be34a7f3-a69a-462e-9ddf-5e537448dba2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6801","nonce":962652768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6803","nonce":962652768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6807","nonce":962652768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6805","nonce":962652768}]},"public_addr":"172.21.15.78:6801/962652768","cluster_addr":"172.21.15.78:6803/962652768","heartbeat_back_addr":"172.21.15.78:6807/962652768","heartbeat_front_addr":"172.21.15.78:6805/962652768","state":["exists","up"]},{"osd":2,"uuid":"55b381de-5f56-4b14-80f7-e6e41e084a13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6818","nonce":2910206054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6822","nonce":2910206054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6829","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6831","nonce":2910206054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6826","nonce":2910206054}]},"public_addr":"172.21.15.78:6818/2910206054","cluster_addr":"172.21.15.78:6822/2910206054","heartbeat_back_addr":"172.21.15.78:6831/2910206054","heartbeat_front_addr":"172.21.15.78:6826/2910206054","state":["exists","up"]},{"osd":3,"uuid":"d7682de1-25cb-4cec-869f-8851c28b0e6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6819","nonce":3750796703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6821","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6823","nonce":3750796703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6830","nonce":3750796703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6825","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6827","nonce":3750796703}]},"public_addr":"172.21.15.78:6819/3750796703","cluster_addr":"172.21.15.78:6823/3750796703","heartbeat_back_addr":"172.21.15.78:6830/3750796703","heartbeat_front_addr":"172.21.15.78:6827/3750796703","state":["exists","up"]},{"osd":4,"uuid":"8279815a-d6c7-4199-871e-d28971b9dc07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6809","nonce":2944277204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6811","nonce":2944277204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6815","nonce":2944277204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6813","nonce":2944277204}]},"public_addr":"172.21.15.187:6809/2944277204","cluster_addr":"172.21.15.187:6811/2944277204","heartbeat_back_addr":"172.21.15.187:6815/2944277204","heartbeat_front_addr":"172.21.15.187:6813/2944277204","state":["exists","up"]},{"osd":5,"uuid":"0a714c65-f8ce-4340-968f-11a799677ef3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6801","nonce":185858620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6803","nonce":185858620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6807","nonce":185858620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6805","nonce":185858620}]},"public_addr":"172.21.15.187:6801/185858620","cluster_addr":"172.21.15.187:6803/185858620","heartbeat_back_addr":"172.21.15.187:6807/185858620","heartbeat_front_addr":"172.21.15.187:6805/185858620","state":["exists","up"]},{"osd":6,"uuid":"d0bba9ab-f7ee-449e-8999-1c0cf7e6d53c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6817","nonce":4213392126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6819","nonce":4213392126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6824","nonce":4213392126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6821","nonce":4213392126}]},"public_addr":"172.21.15.187:6817/4213392126","cluster_addr":"172.21.15.187:6819/4213392126","heartbeat_back_addr":"172.21.15.187:6824/4213392126","heartbeat_front_addr":"172.21.15.187:6821/4213392126","state":["exists","up"]},{"osd":7,"uuid":"efe5e0d9-2f87-4889-a27a-e2a95a632302","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6823","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6825","nonce":85774004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6827","nonce":85774004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6831","nonce":85774004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6829","nonce":85774004}]},"public_addr":"172.21.15.187:6825/85774004","cluster_addr":"172.21.15.187:6827/85774004","heartbeat_back_addr":"172.21.15.187:6831/85774004","heartbeat_front_addr":"172.21.15.187:6829/85774004","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.214447+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.448899+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.293107+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.564184+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.175026+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.097717+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.261141+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.287681+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T10:12:16.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.663+0000 7fae119aa640 1 -- 172.21.15.78:0/1802029439 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fadec066470 msgr2=0x7fadec068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:16.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.663+0000 7fae119aa640 1 --2- 172.21.15.78:0/1802029439 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fadec066470 0x7fadec068930 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fae0c09c790 tx=0x7fadf4009040 comp rx=0 tx=0).stop 2023-12-12T10:12:16.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.663+0000 7fae119aa640 1 -- 172.21.15.78:0/1802029439 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae0c0ce670 msgr2=0x7fae0c0c7110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:16.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.663+0000 7fae119aa640 1 --2- 172.21.15.78:0/1802029439 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae0c0ce670 0x7fae0c0c7110 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fadfc0b3040 tx=0x7fadfc01bad0 comp rx=0 tx=0).stop 2023-12-12T10:12:16.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.663+0000 7fae119aa640 1 -- 172.21.15.78:0/1802029439 shutdown_connections 2023-12-12T10:12:16.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.663+0000 7fae119aa640 1 --2- 172.21.15.78:0/1802029439 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fadec066470 0x7fadec068930 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:16.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.663+0000 7fae119aa640 1 --2- 172.21.15.78:0/1802029439 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fae0c15d3c0 0x7fae0c0b5b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:16.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.663+0000 7fae119aa640 1 --2- 172.21.15.78:0/1802029439 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fae0c0d1cb0 0x7fae0c0b1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:16.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.663+0000 7fae119aa640 1 --2- 172.21.15.78:0/1802029439 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae0c0ce670 0x7fae0c0c7110 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:16.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.663+0000 7fae119aa640 1 -- 172.21.15.78:0/1802029439 >> 172.21.15.78:0/1802029439 conn(0x7fae0c09c2a0 msgr2=0x7fae0c06afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:16.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.663+0000 7fae119aa640 1 -- 172.21.15.78:0/1802029439 shutdown_connections 2023-12-12T10:12:16.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:16.663+0000 7fae119aa640 1 -- 172.21.15.78:0/1802029439 wait complete. 2023-12-12T10:12:17.090 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-12T10:12:09.200933+0000', 'modified': '2023-12-12T10:12:14.355309+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4296}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4296': {'gid': 4296, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.78:6837/739552946', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.78:6836', 'nonce': 739552946}, {'type': 'v1', 'addr': '172.21.15.78:6837', 'nonce': 739552946}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2023-12-12T10:12:17.090 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-12T10:12:17.090 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-12-12T10:12:17.229 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.223+0000 7febf1d9d640 1 Processor -- start 2023-12-12T10:12:17.229 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.223+0000 7febf1d9d640 1 -- start start 2023-12-12T10:12:17.230 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.223+0000 7febf1d9d640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7febec071610 0x7febec164ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:17.230 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.223+0000 7febf1d9d640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febec070a70 con 0x7febec143770 2023-12-12T10:12:17.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.223+0000 7febf1d9d640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febec0ce3c0 con 0x7febec0cdf60 2023-12-12T10:12:17.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.223+0000 7febf1d9d640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febec15e920 con 0x7febec071610 2023-12-12T10:12:17.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.227+0000 7febeb7fe640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7febec143770 0x7febec0b1e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:56280/0 (socket says 172.21.15.78:56280) 2023-12-12T10:12:17.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.227+0000 7febeb7fe640 1 -- 172.21.15.78:0/2305859582 learned_addr learned my addr 172.21.15.78:0/2305859582 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-12-12T10:12:17.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.227+0000 7febebfff640 1 --2- 172.21.15.78:0/2305859582 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7febec071610 0x7febec164ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:17.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.227+0000 7febeaffd640 1 -- 172.21.15.78:0/2305859582 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 964054168 0 0) 0x7febec070a70 con 0x7febec143770 2023-12-12T10:12:17.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.227+0000 7febeaffd640 1 -- 172.21.15.78:0/2305859582 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7febd8003530 con 0x7febec143770 2023-12-12T10:12:17.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.227+0000 7febeaffd640 1 -- 172.21.15.78:0/2305859582 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 958238566 0 0) 0x7febd8003530 con 0x7febec143770 2023-12-12T10:12:17.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.227+0000 7febeaffd640 1 -- 172.21.15.78:0/2305859582 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7febec071610 msgr2=0x7febec164ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:17.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.227+0000 7febeaffd640 1 --2- 172.21.15.78:0/2305859582 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7febec071610 0x7febec164ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:17.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.227+0000 7febeaffd640 1 -- 172.21.15.78:0/2305859582 >> v1:172.21.15.187:6789/0 conn(0x7febec0cdf60 legacy=0x7febec070f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:17.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.227+0000 7febeaffd640 1 -- 172.21.15.78:0/2305859582 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febec070440 con 0x7febec143770 2023-12-12T10:12:17.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.227+0000 7febeaffd640 1 -- 172.21.15.78:0/2305859582 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 465499599 0 0) 0x7febdc001680 con 0x7febec143770 2023-12-12T10:12:17.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.227+0000 7febeaffd640 1 -- 172.21.15.78:0/2305859582 >> v1:172.21.15.78:6789/0 conn(0x7febec143770 legacy=0x7febec0b1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:17.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.227+0000 7febeaffd640 1 --2- 172.21.15.78:0/2305859582 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7febd80039b0 0x7febd8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:17.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.227+0000 7febeaffd640 1 --2- 172.21.15.78:0/2305859582 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7febec071610 0x7febd80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:17.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.227+0000 7febeaffd640 1 --2- 172.21.15.78:0/2305859582 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7febd8004d10 0x7febd8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:17.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.227+0000 7febeaffd640 1 -- 172.21.15.78:0/2305859582 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febec15e920 con 0x7febd80039b0 2023-12-12T10:12:17.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.227+0000 7febeaffd640 1 -- 172.21.15.78:0/2305859582 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febd800bac0 con 0x7febd8004d10 2023-12-12T10:12:17.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.227+0000 7febeaffd640 1 -- 172.21.15.78:0/2305859582 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febd800bc80 con 0x7febec071610 2023-12-12T10:12:17.234 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.227+0000 7febeb7fe640 1 --2- 172.21.15.78:0/2305859582 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7febd80039b0 0x7febd8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:17.234 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.227+0000 7febe3fff640 1 --2- 172.21.15.78:0/2305859582 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7febec071610 0x7febd80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:17.234 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.227+0000 7febebfff640 1 --2- 172.21.15.78:0/2305859582 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7febd8004d10 0x7febd8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:17.234 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.227+0000 7febeb7fe640 1 -- 172.21.15.78:0/2305859582 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7febec071610 msgr2=0x7febd80047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:17.234 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.227+0000 7febeb7fe640 1 --2- 172.21.15.78:0/2305859582 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7febec071610 0x7febd80047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:17.234 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.227+0000 7febeb7fe640 1 -- 172.21.15.78:0/2305859582 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7febd8004d10 msgr2=0x7febd8005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:17.234 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.227+0000 7febeb7fe640 1 --2- 172.21.15.78:0/2305859582 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7febd8004d10 0x7febd8005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:17.234 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.227+0000 7febeb7fe640 1 -- 172.21.15.78:0/2305859582 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febd8003530 con 0x7febd80039b0 2023-12-12T10:12:17.234 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.231+0000 7febeb7fe640 1 --2- 172.21.15.78:0/2305859582 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7febd80039b0 0x7febd8003dd0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7febdc00c240 tx=0x7febdc01cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=459465660cc9cf74 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:17.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.231+0000 7febeaffd640 1 -- 172.21.15.78:0/2305859582 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febdc005ae0 con 0x7febd80039b0 2023-12-12T10:12:17.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.231+0000 7febeaffd640 1 -- 172.21.15.78:0/2305859582 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febdc005c40 con 0x7febd80039b0 2023-12-12T10:12:17.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.231+0000 7febeaffd640 1 -- 172.21.15.78:0/2305859582 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febdc0a5860 con 0x7febd80039b0 2023-12-12T10:12:17.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.231+0000 7febf1d9d640 1 -- 172.21.15.78:0/2305859582 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7febd80039b0 msgr2=0x7febd8003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:17.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.231+0000 7febf1d9d640 1 --2- 172.21.15.78:0/2305859582 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7febd80039b0 0x7febd8003dd0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7febdc00c240 tx=0x7febdc01cb80 comp rx=0 tx=0).stop 2023-12-12T10:12:17.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.231+0000 7febebfff640 1 -- 172.21.15.78:0/2305859582 reap_dead start 2023-12-12T10:12:17.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.231+0000 7febf1d9d640 1 -- 172.21.15.78:0/2305859582 shutdown_connections 2023-12-12T10:12:17.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.231+0000 7febf1d9d640 1 -- 172.21.15.78:0/2305859582 >> 172.21.15.78:0/2305859582 conn(0x7febec06a710 msgr2=0x7febec06ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:17.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.231+0000 7febf1d9d640 1 -- 172.21.15.78:0/2305859582 shutdown_connections 2023-12-12T10:12:17.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.231+0000 7febf1d9d640 1 -- 172.21.15.78:0/2305859582 wait complete. 2023-12-12T10:12:17.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.231+0000 7febf1d9d640 1 Processor -- start 2023-12-12T10:12:17.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.231+0000 7febf1d9d640 1 -- start start 2023-12-12T10:12:17.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.235+0000 7febf1d9d640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7febd80039b0 0x7febec1591e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:17.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.235+0000 7febf1d9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7febec0aed90 0x7febec0af210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:17.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.235+0000 7febf1d9d640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7febec1ead70 0x7febec1eb1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:17.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.235+0000 7febf1d9d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febec1eb730 con 0x7febec0aed90 2023-12-12T10:12:17.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.235+0000 7febf1d9d640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febec159720 con 0x7febd80039b0 2023-12-12T10:12:17.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.235+0000 7febf1d9d640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febec0b0460 con 0x7febec1ead70 2023-12-12T10:12:17.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.235+0000 7febe3fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7febec0aed90 0x7febec0af210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:17.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.235+0000 7febe3fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7febec0aed90 0x7febec0af210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43280/0 (socket says 172.21.15.78:43280) 2023-12-12T10:12:17.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.235+0000 7febe3fff640 1 -- 172.21.15.78:0/3994282457 learned_addr learned my addr 172.21.15.78:0/3994282457 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:17.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.235+0000 7febebfff640 1 --2- 172.21.15.78:0/3994282457 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7febec1ead70 0x7febec1eb1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:17.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.235+0000 7febeb7fe640 1 --2- 172.21.15.78:0/3994282457 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7febd80039b0 0x7febec1591e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:17.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.235+0000 7febe3fff640 1 -- 172.21.15.78:0/3994282457 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7febec1ead70 msgr2=0x7febec1eb1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:17.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.235+0000 7febe3fff640 1 --2- 172.21.15.78:0/3994282457 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7febec1ead70 0x7febec1eb1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:17.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.235+0000 7febe3fff640 1 -- 172.21.15.78:0/3994282457 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7febd80039b0 msgr2=0x7febec1591e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:17.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.235+0000 7febe3fff640 1 --2- 172.21.15.78:0/3994282457 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7febd80039b0 0x7febec1591e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:17.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.235+0000 7febe3fff640 1 -- 172.21.15.78:0/3994282457 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febec0af850 con 0x7febec0aed90 2023-12-12T10:12:17.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.235+0000 7febe3fff640 1 --2- 172.21.15.78:0/3994282457 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7febec0aed90 0x7febec0af210 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7febd400f850 tx=0x7febd400fd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:17.241 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.235+0000 7febe8ff9640 1 -- 172.21.15.78:0/3994282457 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febd400fe40 con 0x7febec0aed90 2023-12-12T10:12:17.241 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.235+0000 7febe8ff9640 1 -- 172.21.15.78:0/3994282457 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febd40052e0 con 0x7febec0aed90 2023-12-12T10:12:17.241 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.235+0000 7febf1d9d640 1 -- 172.21.15.78:0/3994282457 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febec0afb30 con 0x7febec0aed90 2023-12-12T10:12:17.241 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.235+0000 7febe8ff9640 1 -- 172.21.15.78:0/3994282457 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febd400d6d0 con 0x7febec0aed90 2023-12-12T10:12:17.241 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.235+0000 7febf1d9d640 1 -- 172.21.15.78:0/3994282457 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febec0b00f0 con 0x7febec0aed90 2023-12-12T10:12:17.242 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.235+0000 7febe8ff9640 1 -- 172.21.15.78:0/3994282457 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7febd400d830 con 0x7febec0aed90 2023-12-12T10:12:17.243 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.239+0000 7febe8ff9640 1 --2- 172.21.15.78:0/3994282457 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7febcc066490 0x7febcc068950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:17.243 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.239+0000 7febe8ff9640 1 -- 172.21.15.78:0/3994282457 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7febd4083fb0 con 0x7febec0aed90 2023-12-12T10:12:17.243 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.239+0000 7febf5100000 1 Processor -- start 2023-12-12T10:12:17.243 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.239+0000 7febeb7fe640 1 --2- 172.21.15.78:0/3994282457 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7febcc066490 0x7febcc068950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:17.243 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.239+0000 7febf5100000 1 -- start start 2023-12-12T10:12:17.244 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.239+0000 7febeb7fe640 1 --2- 172.21.15.78:0/3994282457 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7febcc066490 0x7febcc068950 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7febdc0ab000 tx=0x7febdc0a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:17.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.239+0000 7febf5100000 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560bbd97d6b0 0x560bbd97da90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:17.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.239+0000 7febf5100000 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560bbd97dfd0 0x560bbd930b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:17.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.239+0000 7febf5100000 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x560bbd931050 0x560bbd931430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:17.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.239+0000 7febf5100000 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x560bbd79d250 con 0x560bbd97dfd0 2023-12-12T10:12:17.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.239+0000 7febf5100000 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x560bbd78ad60 con 0x560bbd97d6b0 2023-12-12T10:12:17.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.239+0000 7febf5100000 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x560bbd788290 con 0x560bbd931050 2023-12-12T10:12:17.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.239+0000 7febe3fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560bbd97dfd0 0x560bbd930b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:17.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.239+0000 7febe3fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560bbd97dfd0 0x560bbd930b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43286/0 (socket says 172.21.15.78:43286) 2023-12-12T10:12:17.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.239+0000 7febe3fff640 1 -- 172.21.15.78:0/2389344929 learned_addr learned my addr 172.21.15.78:0/2389344929 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:17.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.239+0000 7febeb7fe640 1 --2- 172.21.15.78:0/2389344929 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560bbd97d6b0 0x560bbd97da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:17.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.239+0000 7febebfff640 1 --2- 172.21.15.78:0/2389344929 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x560bbd931050 0x560bbd931430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:17.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.239+0000 7febe3fff640 1 -- 172.21.15.78:0/2389344929 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x560bbd931050 msgr2=0x560bbd931430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:17.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.239+0000 7febe3fff640 1 --2- 172.21.15.78:0/2389344929 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x560bbd931050 0x560bbd931430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:17.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.239+0000 7febe3fff640 1 -- 172.21.15.78:0/2389344929 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560bbd97d6b0 msgr2=0x560bbd97da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:17.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.239+0000 7febe3fff640 1 --2- 172.21.15.78:0/2389344929 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560bbd97d6b0 0x560bbd97da90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:17.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.239+0000 7febe3fff640 1 -- 172.21.15.78:0/2389344929 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560bbd47b890 con 0x560bbd97dfd0 2023-12-12T10:12:17.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.239+0000 7febeb7fe640 1 --2- 172.21.15.78:0/2389344929 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560bbd97d6b0 0x560bbd97da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T10:12:17.247 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.239+0000 7febebfff640 1 --2- 172.21.15.78:0/2389344929 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x560bbd931050 0x560bbd931430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T10:12:17.247 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.239+0000 7febe3fff640 1 --2- 172.21.15.78:0/2389344929 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560bbd97dfd0 0x560bbd930b10 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7febd4051310 tx=0x7febd4054840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2983c339ecfdcaa6 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:17.247 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.239+0000 7febe17fa640 1 -- 172.21.15.78:0/2389344929 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febd405d060 con 0x560bbd97dfd0 2023-12-12T10:12:17.247 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.239+0000 7febe17fa640 1 -- 172.21.15.78:0/2389344929 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febd40531b0 con 0x560bbd97dfd0 2023-12-12T10:12:17.247 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.239+0000 7febe17fa640 1 -- 172.21.15.78:0/2389344929 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febd405cbd0 con 0x560bbd97dfd0 2023-12-12T10:12:17.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.239+0000 7febf5100000 1 -- 172.21.15.78:0/2389344929 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560bbd97dfd0 msgr2=0x560bbd930b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:17.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.239+0000 7febf5100000 1 --2- 172.21.15.78:0/2389344929 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560bbd97dfd0 0x560bbd930b10 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7febd4051310 tx=0x7febd4054840 comp rx=0 tx=0).stop 2023-12-12T10:12:17.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.243+0000 7febf5100000 1 -- 172.21.15.78:0/2389344929 shutdown_connections 2023-12-12T10:12:17.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.243+0000 7febf5100000 1 --2- 172.21.15.78:0/2389344929 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x560bbd931050 0x560bbd931430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:17.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.243+0000 7febf5100000 1 --2- 172.21.15.78:0/2389344929 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560bbd97dfd0 0x560bbd930b10 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:17.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.243+0000 7febf5100000 1 --2- 172.21.15.78:0/2389344929 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560bbd97d6b0 0x560bbd97da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:17.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.243+0000 7febf5100000 1 -- 172.21.15.78:0/2389344929 >> 172.21.15.78:0/2389344929 conn(0x560bbd95e240 msgr2=0x560bbd960630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:17.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.243+0000 7febf5100000 1 -- 172.21.15.78:0/2389344929 shutdown_connections 2023-12-12T10:12:17.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.243+0000 7febf5100000 1 -- 172.21.15.78:0/2389344929 wait complete. 2023-12-12T10:12:17.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.243+0000 7febf5100000 1 -- start start 2023-12-12T10:12:17.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.243+0000 7febf5100000 1 Processor -- start 2023-12-12T10:12:17.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.243+0000 7febf5100000 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560bbd931050 0x560bbd9370e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:17.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.243+0000 7febf5100000 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x560bbd97d6b0 0x560bbd937620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:17.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.243+0000 7febf5100000 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560bbd97dfd0 0x560bbd937b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:17.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.243+0000 7febf5100000 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x560bbd783b80 con 0x560bbd97dfd0 2023-12-12T10:12:17.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.243+0000 7febf5100000 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x560bbd73bbf0 con 0x560bbd931050 2023-12-12T10:12:17.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.243+0000 7febf5100000 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x560bbd741a90 con 0x560bbd97d6b0 2023-12-12T10:12:17.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.243+0000 7febf5100000 10 client.0 _ll_register_callbacks cb 0x560bbd91e970 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-12T10:12:17.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.243+0000 7febebfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560bbd97dfd0 0x560bbd937b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:17.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.243+0000 7febebfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560bbd97dfd0 0x560bbd937b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43292/0 (socket says 172.21.15.78:43292) 2023-12-12T10:12:17.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.243+0000 7febebfff640 1 -- 172.21.15.78:0/1289467825 learned_addr learned my addr 172.21.15.78:0/1289467825 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:17.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.243+0000 7febeb7fe640 1 --2- 172.21.15.78:0/1289467825 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560bbd931050 0x560bbd9370e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:17.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.243+0000 7febe3fff640 1 --2- 172.21.15.78:0/1289467825 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x560bbd97d6b0 0x560bbd937620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:17.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.243+0000 7febebfff640 1 -- 172.21.15.78:0/1289467825 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x560bbd97d6b0 msgr2=0x560bbd937620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:17.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.243+0000 7febebfff640 1 --2- 172.21.15.78:0/1289467825 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x560bbd97d6b0 0x560bbd937620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:17.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.243+0000 7febebfff640 1 -- 172.21.15.78:0/1289467825 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560bbd931050 msgr2=0x560bbd9370e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:17.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.243+0000 7febebfff640 1 --2- 172.21.15.78:0/1289467825 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560bbd931050 0x560bbd9370e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:17.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.243+0000 7febebfff640 1 -- 172.21.15.78:0/1289467825 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febec0b00f0 con 0x560bbd97dfd0 2023-12-12T10:12:17.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.243+0000 7febebfff640 1 --2- 172.21.15.78:0/1289467825 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560bbd97dfd0 0x560bbd937b60 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7febec06e2b0 tx=0x7febe4016e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=244a2048ebf316fa server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:17.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.243+0000 7febca7fc640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2023-12-12T10:12:17.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.243+0000 7febca7fc640 1 -- 172.21.15.78:0/1289467825 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe400e040 con 0x560bbd97dfd0 2023-12-12T10:12:17.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.243+0000 7febf5100000 1 -- 172.21.15.78:0/1289467825 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560bbd741420 con 0x560bbd97dfd0 2023-12-12T10:12:17.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.243+0000 7febca7fc640 1 -- 172.21.15.78:0/1289467825 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7febe4003db0 con 0x560bbd97dfd0 2023-12-12T10:12:17.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.243+0000 7febca7fc640 1 -- 172.21.15.78:0/1289467825 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7febe40147d0 con 0x560bbd97dfd0 2023-12-12T10:12:17.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.243+0000 7febf5100000 10 client.4404 fetch_fsmap learned FSMap version 7 2023-12-12T10:12:17.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.243+0000 7febf5100000 1 -- 172.21.15.78:0/1289467825 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x560bbd744190 con 0x560bbd97dfd0 2023-12-12T10:12:17.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.243+0000 7febca7fc640 1 -- 172.21.15.78:0/1289467825 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x560bbd741420 con 0x560bbd97dfd0 2023-12-12T10:12:17.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.243+0000 7febca7fc640 1 -- 172.21.15.78:0/1289467825 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 7) v1 ==== 3302+0+0 (secure 0 0 0) 0x7febe4014930 con 0x560bbd97dfd0 2023-12-12T10:12:17.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.243+0000 7febf5100000 10 client.4404 fetch_fsmap finished waiting for FSMap version 7 2023-12-12T10:12:17.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.243+0000 7febf5100000 10 client.4404 resolve_mds: resolved name 'c' to daemon mds.c 2023-12-12T10:12:17.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.243+0000 7febf5100000 20 client.4404 populate_metadata read hostname 'smithi078' 2023-12-12T10:12:17.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.243+0000 7febf5100000 1 --2- 172.21.15.78:0/1289467825 >> [v2:172.21.15.78:6836/739552946,v1:172.21.15.78:6837/739552946] conn(0x560bbd938570 0x560bbd98f970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:17.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.243+0000 7febf5100000 4 client.4404 mds_command: new command op to 4296 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-12T10:12:17.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.243+0000 7febf5100000 1 -- 172.21.15.78:0/1289467825 --> [v2:172.21.15.78:6836/739552946,v1:172.21.15.78:6837/739552946] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560bbd7824d0 con 0x560bbd938570 2023-12-12T10:12:17.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.247+0000 7febeb7fe640 1 --2- 172.21.15.78:0/1289467825 >> [v2:172.21.15.78:6836/739552946,v1:172.21.15.78:6837/739552946] conn(0x560bbd938570 0x560bbd98f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:17.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.247+0000 7febca7fc640 10 client.4404 ms_handle_connect on v2:172.21.15.78:6836/739552946 2023-12-12T10:12:17.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.247+0000 7febeb7fe640 1 --2- 172.21.15.78:0/1289467825 >> [v2:172.21.15.78:6836/739552946,v1:172.21.15.78:6837/739552946] conn(0x560bbd938570 0x560bbd98f970 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=557087c0c8005f07 server_cookie=c2019ad6e6b5dcfe in_seq=0 out_seq=0 2023-12-12T10:12:17.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.247+0000 7febca7fc640 1 -- 172.21.15.78:0/1289467825 <== mds.0 v2:172.21.15.78:6836/739552946 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x560bbd7824d0 con 0x560bbd938570 2023-12-12T10:12:17.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.247+0000 7febca7fc640 10 client.4404 handle_command_reply: tid=0 2023-12-12T10:12:17.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.247+0000 7febf5100000 1 client.4404 shutdown 2023-12-12T10:12:17.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.247+0000 7febf5100000 1 -- 172.21.15.78:0/1289467825 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560bbd97dfd0 msgr2=0x560bbd937b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:17.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.247+0000 7febf5100000 1 --2- 172.21.15.78:0/1289467825 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560bbd97dfd0 0x560bbd937b60 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7febec06e2b0 tx=0x7febe4016e50 comp rx=0 tx=0).stop 2023-12-12T10:12:17.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.247+0000 7febf5100000 1 -- 172.21.15.78:0/1289467825 shutdown_connections 2023-12-12T10:12:17.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.247+0000 7febf5100000 1 --2- 172.21.15.78:0/1289467825 >> [v2:172.21.15.78:6836/739552946,v1:172.21.15.78:6837/739552946] conn(0x560bbd938570 0x560bbd98f970 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:17.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.247+0000 7febf5100000 1 --2- 172.21.15.78:0/1289467825 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560bbd97dfd0 0x560bbd937b60 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:17.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.247+0000 7febf5100000 1 --2- 172.21.15.78:0/1289467825 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x560bbd97d6b0 0x560bbd937620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:17.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.247+0000 7febca7fc640 0 client.4404 ms_handle_reset on v2:172.21.15.78:6836/739552946 2023-12-12T10:12:17.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.247+0000 7febf5100000 1 --2- 172.21.15.78:0/1289467825 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560bbd931050 0x560bbd9370e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:17.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.247+0000 7febf5100000 1 -- 172.21.15.78:0/1289467825 >> 172.21.15.78:0/1289467825 conn(0x560bbd95e240 msgr2=0x560bbd930200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:17.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.247+0000 7febf5100000 1 -- 172.21.15.78:0/1289467825 shutdown_connections 2023-12-12T10:12:17.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.247+0000 7febf5100000 1 -- 172.21.15.78:0/1289467825 wait complete. 2023-12-12T10:12:17.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.247+0000 7febf5100000 20 client.4404 trim_cache size 0 max 16384 2023-12-12T10:12:17.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.263+0000 7febf5100000 1 Processor -- start 2023-12-12T10:12:17.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.263+0000 7febf5100000 1 -- start start 2023-12-12T10:12:17.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.263+0000 7febf5100000 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x560bbd931050 0x560bbd95cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:17.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.263+0000 7febf5100000 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560bbd97d6b0 0x560bbd95d260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:17.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.263+0000 7febf5100000 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560bbd97dfd0 0x560bbd98f970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:17.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.263+0000 7febf5100000 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x560bbd43c940 con 0x560bbd97dfd0 2023-12-12T10:12:17.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.263+0000 7febf5100000 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x560bbd92af80 con 0x560bbd97d6b0 2023-12-12T10:12:17.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.263+0000 7febf5100000 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x560bbd7866e0 con 0x560bbd931050 2023-12-12T10:12:17.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.263+0000 7febebfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560bbd97dfd0 0x560bbd98f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:17.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.263+0000 7febebfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560bbd97dfd0 0x560bbd98f970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43298/0 (socket says 172.21.15.78:43298) 2023-12-12T10:12:17.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.263+0000 7febebfff640 1 -- 172.21.15.78:0/219983404 learned_addr learned my addr 172.21.15.78:0/219983404 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:17.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.263+0000 7febeb7fe640 1 --2- 172.21.15.78:0/219983404 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x560bbd931050 0x560bbd95cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:17.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.263+0000 7febe3fff640 1 --2- 172.21.15.78:0/219983404 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560bbd97d6b0 0x560bbd95d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:17.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.263+0000 7febebfff640 1 -- 172.21.15.78:0/219983404 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x560bbd931050 msgr2=0x560bbd95cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:17.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.263+0000 7febebfff640 1 --2- 172.21.15.78:0/219983404 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x560bbd931050 0x560bbd95cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:17.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.263+0000 7febebfff640 1 -- 172.21.15.78:0/219983404 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560bbd97d6b0 msgr2=0x560bbd95d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:17.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.263+0000 7febebfff640 1 --2- 172.21.15.78:0/219983404 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560bbd97d6b0 0x560bbd95d260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:17.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.263+0000 7febebfff640 1 -- 172.21.15.78:0/219983404 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560bbd72a490 con 0x560bbd97dfd0 2023-12-12T10:12:17.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.263+0000 7febebfff640 1 --2- 172.21.15.78:0/219983404 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560bbd97dfd0 0x560bbd98f970 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7febe4009410 tx=0x7febe4019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd12f8f5fce53bf4 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:17.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.263+0000 7febe1ffb640 1 -- 172.21.15.78:0/219983404 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe400e070 con 0x560bbd97dfd0 2023-12-12T10:12:17.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.263+0000 7febe1ffb640 1 -- 172.21.15.78:0/219983404 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febe400f040 con 0x560bbd97dfd0 2023-12-12T10:12:17.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.263+0000 7febe1ffb640 1 -- 172.21.15.78:0/219983404 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febe4016a00 con 0x560bbd97dfd0 2023-12-12T10:12:17.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.263+0000 7febf5100000 1 -- 172.21.15.78:0/219983404 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560bbd97dfd0 msgr2=0x560bbd98f970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:17.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.263+0000 7febf5100000 1 --2- 172.21.15.78:0/219983404 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560bbd97dfd0 0x560bbd98f970 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7febe4009410 tx=0x7febe4019000 comp rx=0 tx=0).stop 2023-12-12T10:12:17.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.267+0000 7febf5100000 1 -- 172.21.15.78:0/219983404 shutdown_connections 2023-12-12T10:12:17.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.267+0000 7febf5100000 1 --2- 172.21.15.78:0/219983404 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560bbd97dfd0 0x560bbd98f970 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:17.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.267+0000 7febf5100000 1 --2- 172.21.15.78:0/219983404 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560bbd97d6b0 0x560bbd95d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:17.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.267+0000 7febf5100000 1 --2- 172.21.15.78:0/219983404 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x560bbd931050 0x560bbd95cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:17.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.267+0000 7febf5100000 1 -- 172.21.15.78:0/219983404 >> 172.21.15.78:0/219983404 conn(0x560bbd95e240 msgr2=0x560bbd92f270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:17.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.267+0000 7febf5100000 1 -- 172.21.15.78:0/219983404 shutdown_connections 2023-12-12T10:12:17.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.267+0000 7febf5100000 1 -- 172.21.15.78:0/219983404 wait complete. 2023-12-12T10:12:17.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.267+0000 7febf5100000 1 -- start start 2023-12-12T10:12:17.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.267+0000 7febf5100000 1 Processor -- start 2023-12-12T10:12:17.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.267+0000 7febf5100000 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x560bbd931050 0x560bbd9de190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:17.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.267+0000 7febf5100000 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560bbd97d6b0 0x560bbd9de6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:17.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.267+0000 7febf5100000 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560bbd97dfd0 0x560bbd9993f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:17.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.267+0000 7febf5100000 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x560bbd784430 con 0x560bbd97d6b0 2023-12-12T10:12:17.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.267+0000 7febf5100000 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x560bbd8065d0 con 0x560bbd97dfd0 2023-12-12T10:12:17.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.267+0000 7febf5100000 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x560bbd77acc0 con 0x560bbd931050 2023-12-12T10:12:17.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.267+0000 7febf5100000 10 client.0 _ll_register_callbacks cb 0x560bbd79d1a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-12T10:12:17.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.267+0000 7febe3fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560bbd97d6b0 0x560bbd9de6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:17.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.267+0000 7febe3fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560bbd97d6b0 0x560bbd9de6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43310/0 (socket says 172.21.15.78:43310) 2023-12-12T10:12:17.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.267+0000 7febe3fff640 1 -- 172.21.15.78:0/2365184466 learned_addr learned my addr 172.21.15.78:0/2365184466 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:17.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.267+0000 7febebfff640 1 --2- 172.21.15.78:0/2365184466 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560bbd97dfd0 0x560bbd9993f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:17.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.267+0000 7febeb7fe640 1 --2- 172.21.15.78:0/2365184466 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x560bbd931050 0x560bbd9de190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:17.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.267+0000 7febe3fff640 1 -- 172.21.15.78:0/2365184466 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x560bbd931050 msgr2=0x560bbd9de190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:17.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.267+0000 7febe3fff640 1 --2- 172.21.15.78:0/2365184466 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x560bbd931050 0x560bbd9de190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:17.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.267+0000 7febe3fff640 1 -- 172.21.15.78:0/2365184466 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560bbd97dfd0 msgr2=0x560bbd9993f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:17.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.267+0000 7febe3fff640 1 --2- 172.21.15.78:0/2365184466 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560bbd97dfd0 0x560bbd9993f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:17.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.267+0000 7febe3fff640 1 -- 172.21.15.78:0/2365184466 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560bbd744190 con 0x560bbd97d6b0 2023-12-12T10:12:17.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.267+0000 7febe3fff640 1 --2- 172.21.15.78:0/2365184466 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560bbd97d6b0 0x560bbd9de6d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7febd4054d50 tx=0x7febd400a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d8854112c6f5ca2 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:17.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.267+0000 7febca7fc640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2023-12-12T10:12:17.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.267+0000 7febca7fc640 1 -- 172.21.15.78:0/2365184466 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febd4071070 con 0x560bbd97d6b0 2023-12-12T10:12:17.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.267+0000 7febca7fc640 1 -- 172.21.15.78:0/2365184466 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7febd405d060 con 0x560bbd97d6b0 2023-12-12T10:12:17.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.267+0000 7febf5100000 1 -- 172.21.15.78:0/2365184466 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560bbd71ef90 con 0x560bbd97d6b0 2023-12-12T10:12:17.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.267+0000 7febca7fc640 1 -- 172.21.15.78:0/2365184466 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7febd4051150 con 0x560bbd97d6b0 2023-12-12T10:12:17.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.267+0000 7febf5100000 10 client.4410 fetch_fsmap learned FSMap version 7 2023-12-12T10:12:17.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.267+0000 7febf5100000 1 -- 172.21.15.78:0/2365184466 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x560bbd47bcc0 con 0x560bbd97d6b0 2023-12-12T10:12:17.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.267+0000 7febca7fc640 1 -- 172.21.15.78:0/2365184466 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x560bbd71ef90 con 0x560bbd97d6b0 2023-12-12T10:12:17.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.267+0000 7febca7fc640 1 -- 172.21.15.78:0/2365184466 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 7) v1 ==== 3302+0+0 (secure 0 0 0) 0x7febd405e070 con 0x560bbd97d6b0 2023-12-12T10:12:17.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.267+0000 7febf5100000 10 client.4410 fetch_fsmap finished waiting for FSMap version 7 2023-12-12T10:12:17.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.267+0000 7febf5100000 10 client.4410 resolve_mds: resolved name 'c' to daemon mds.c 2023-12-12T10:12:17.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.267+0000 7febf5100000 20 client.4410 populate_metadata read hostname 'smithi078' 2023-12-12T10:12:17.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.267+0000 7febf5100000 1 --2- 172.21.15.78:0/2365184466 >> [v2:172.21.15.78:6836/739552946,v1:172.21.15.78:6837/739552946] conn(0x560bbd99ab40 0x560bbd9e7000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:17.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.267+0000 7febf5100000 4 client.4410 mds_command: new command op to 4296 tid=0 multi_id=0 [{"prefix": "status"}] 2023-12-12T10:12:17.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.267+0000 7febf5100000 1 -- 172.21.15.78:0/2365184466 --> [v2:172.21.15.78:6836/739552946,v1:172.21.15.78:6837/739552946] -- command(tid 0: {"prefix": "status"}) v1 -- 0x560bbd7b1ac0 con 0x560bbd99ab40 2023-12-12T10:12:17.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.267+0000 7febeb7fe640 1 --2- 172.21.15.78:0/2365184466 >> [v2:172.21.15.78:6836/739552946,v1:172.21.15.78:6837/739552946] conn(0x560bbd99ab40 0x560bbd9e7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:17.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.271+0000 7febca7fc640 10 client.4410 ms_handle_connect on v2:172.21.15.78:6836/739552946 2023-12-12T10:12:17.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.271+0000 7febeb7fe640 1 --2- 172.21.15.78:0/2365184466 >> [v2:172.21.15.78:6836/739552946,v1:172.21.15.78:6837/739552946] conn(0x560bbd99ab40 0x560bbd9e7000 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df8343674772e82d server_cookie=1ce7d67afdc54fdb in_seq=0 out_seq=0 2023-12-12T10:12:17.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.271+0000 7febca7fc640 1 -- 172.21.15.78:0/2365184466 <== mds.0 v2:172.21.15.78:6836/739552946 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x560bbd7b1ac0 con 0x560bbd99ab40 2023-12-12T10:12:17.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.271+0000 7febca7fc640 10 client.4410 handle_command_reply: tid=0 2023-12-12T10:12:17.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.271+0000 7febf5100000 1 client.4410 shutdown 2023-12-12T10:12:17.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.271+0000 7febf5100000 1 -- 172.21.15.78:0/2365184466 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560bbd97d6b0 msgr2=0x560bbd9de6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:17.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.271+0000 7febf5100000 1 --2- 172.21.15.78:0/2365184466 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560bbd97d6b0 0x560bbd9de6d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7febd4054d50 tx=0x7febd400a000 comp rx=0 tx=0).stop 2023-12-12T10:12:17.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.271+0000 7febf5100000 1 -- 172.21.15.78:0/2365184466 shutdown_connections 2023-12-12T10:12:17.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.271+0000 7febf5100000 1 --2- 172.21.15.78:0/2365184466 >> [v2:172.21.15.78:6836/739552946,v1:172.21.15.78:6837/739552946] conn(0x560bbd99ab40 0x560bbd9e7000 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:17.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.271+0000 7febf5100000 1 --2- 172.21.15.78:0/2365184466 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560bbd97dfd0 0x560bbd9993f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:17.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.271+0000 7febf5100000 1 --2- 172.21.15.78:0/2365184466 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x560bbd97d6b0 0x560bbd9de6d0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:17.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.271+0000 7febf5100000 1 --2- 172.21.15.78:0/2365184466 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x560bbd931050 0x560bbd9de190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:17.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.271+0000 7febf5100000 1 -- 172.21.15.78:0/2365184466 >> 172.21.15.78:0/2365184466 conn(0x560bbd95e240 msgr2=0x560bbd92fb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:17.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.271+0000 7febca7fc640 0 client.4410 ms_handle_reset on v2:172.21.15.78:6836/739552946 2023-12-12T10:12:17.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.271+0000 7febf5100000 1 -- 172.21.15.78:0/2365184466 shutdown_connections 2023-12-12T10:12:17.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.271+0000 7febf5100000 1 -- 172.21.15.78:0/2365184466 wait complete. 2023-12-12T10:12:17.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.271+0000 7febf5100000 20 client.4410 trim_cache size 0 max 16384 2023-12-12T10:12:17.281 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2023-12-12T10:12:17.281 INFO:teuthology.orchestra.run.smithi078.stdout: "cluster_fsid": "fc81937c-bd26-483c-952b-d1324fcb0c9e", 2023-12-12T10:12:17.281 INFO:teuthology.orchestra.run.smithi078.stdout: "whoami": 0, 2023-12-12T10:12:17.282 INFO:teuthology.orchestra.run.smithi078.stdout: "id": 4296, 2023-12-12T10:12:17.282 INFO:teuthology.orchestra.run.smithi078.stdout: "want_state": "up:active", 2023-12-12T10:12:17.282 INFO:teuthology.orchestra.run.smithi078.stdout: "state": "up:active", 2023-12-12T10:12:17.282 INFO:teuthology.orchestra.run.smithi078.stdout: "fs_name": "cephfs", 2023-12-12T10:12:17.282 INFO:teuthology.orchestra.run.smithi078.stdout: "rank_uptime": 7.3629843849999999, 2023-12-12T10:12:17.282 INFO:teuthology.orchestra.run.smithi078.stdout: "mdsmap_epoch": 7, 2023-12-12T10:12:17.282 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_epoch": 24, 2023-12-12T10:12:17.282 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_epoch_barrier": 23, 2023-12-12T10:12:17.282 INFO:teuthology.orchestra.run.smithi078.stdout: "uptime": 14.095744362 2023-12-12T10:12:17.282 INFO:teuthology.orchestra.run.smithi078.stdout:} 2023-12-12T10:12:17.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.271+0000 7febf1d9d640 1 -- 172.21.15.78:0/3994282457 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7febcc066490 msgr2=0x7febcc068950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:17.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.271+0000 7febf1d9d640 1 --2- 172.21.15.78:0/3994282457 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7febcc066490 0x7febcc068950 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7febdc0ab000 tx=0x7febdc0a7070 comp rx=0 tx=0).stop 2023-12-12T10:12:17.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.271+0000 7febf1d9d640 1 -- 172.21.15.78:0/3994282457 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7febec0aed90 msgr2=0x7febec0af210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:17.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.271+0000 7febf1d9d640 1 --2- 172.21.15.78:0/3994282457 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7febec0aed90 0x7febec0af210 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7febd400f850 tx=0x7febd400fd10 comp rx=0 tx=0).stop 2023-12-12T10:12:17.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.271+0000 7febf1d9d640 1 -- 172.21.15.78:0/3994282457 shutdown_connections 2023-12-12T10:12:17.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.271+0000 7febf1d9d640 1 --2- 172.21.15.78:0/3994282457 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7febcc066490 0x7febcc068950 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:17.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.271+0000 7febf1d9d640 1 --2- 172.21.15.78:0/3994282457 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7febec1ead70 0x7febec1eb1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:17.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.271+0000 7febf1d9d640 1 --2- 172.21.15.78:0/3994282457 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7febec0aed90 0x7febec0af210 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:17.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.271+0000 7febf1d9d640 1 --2- 172.21.15.78:0/3994282457 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7febd80039b0 0x7febec1591e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:17.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.271+0000 7febf1d9d640 1 -- 172.21.15.78:0/3994282457 >> 172.21.15.78:0/3994282457 conn(0x7febec06a710 msgr2=0x7febec0b2750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:17.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.271+0000 7febf1d9d640 1 -- 172.21.15.78:0/3994282457 shutdown_connections 2023-12-12T10:12:17.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.271+0000 7febf1d9d640 1 -- 172.21.15.78:0/3994282457 wait complete. 2023-12-12T10:12:17.295 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-12T10:12:17.295 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-12-12T10:12:17.295 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-12T10:12:17.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.427+0000 7f0ccce79640 1 Processor -- start 2023-12-12T10:12:17.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.427+0000 7f0ccce79640 1 -- start start 2023-12-12T10:12:17.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.427+0000 7f0ccce79640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f0cc81613e0 0x7f0cc8168060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:17.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.427+0000 7f0ccce79640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cc80b4f10 con 0x7f0cc8161900 2023-12-12T10:12:17.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.427+0000 7f0ccce79640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cc80b4a80 con 0x7f0cc81401a0 2023-12-12T10:12:17.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.427+0000 7f0ccce79640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cc80b2780 con 0x7f0cc81613e0 2023-12-12T10:12:17.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.427+0000 7f0cbffff640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f0cc8161900 0x7f0cc8160cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:56294/0 (socket says 172.21.15.78:56294) 2023-12-12T10:12:17.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.427+0000 7f0cbffff640 1 -- 172.21.15.78:0/3500354435 learned_addr learned my addr 172.21.15.78:0/3500354435 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-12-12T10:12:17.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.427+0000 7f0cc6d9d640 1 --2- 172.21.15.78:0/3500354435 >> v2:172.21.15.187:3300/0 conn(0x7f0cc81613e0 0x7f0cc8168060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:17.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.431+0000 7f0cc5d9b640 1 -- 172.21.15.78:0/3500354435 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 964915830 0 0) 0x7f0cc80b4f10 con 0x7f0cc8161900 2023-12-12T10:12:17.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.431+0000 7f0cc5d9b640 1 -- 172.21.15.78:0/3500354435 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0cb4003530 con 0x7f0cc8161900 2023-12-12T10:12:17.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.431+0000 7f0cc5d9b640 1 -- 172.21.15.78:0/3500354435 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1949453399 0 0) 0x7f0cc80b4a80 con 0x7f0cc81401a0 2023-12-12T10:12:17.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.431+0000 7f0cc5d9b640 1 -- 172.21.15.78:0/3500354435 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0cc80b4f10 con 0x7f0cc81401a0 2023-12-12T10:12:17.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.431+0000 7f0cc6d9d640 1 -- 172.21.15.78:0/3500354435 >> v1:172.21.15.187:6789/0 conn(0x7f0cc81401a0 legacy=0x7f0cc80b2070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:17.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.431+0000 7f0cc6d9d640 1 -- 172.21.15.78:0/3500354435 >> v1:172.21.15.78:6789/0 conn(0x7f0cc8161900 legacy=0x7f0cc8160cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:17.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.431+0000 7f0cc5d9b640 1 -- 172.21.15.78:0/3500354435 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 490655778 0 0) 0x7f0cb4003530 con 0x7f0cc8161900 2023-12-12T10:12:17.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.431+0000 7f0cc6d9d640 1 -- 172.21.15.78:0/3500354435 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cc80b3bd0 con 0x7f0cc81613e0 2023-12-12T10:12:17.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.431+0000 7f0cc6d9d640 1 --2- 172.21.15.78:0/3500354435 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0cc81613e0 0x7f0cc8168060 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0cc0009d90 tx=0x7f0cc001c840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1edee15df9c0a07d server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:17.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.431+0000 7f0cc5d9b640 1 -- 172.21.15.78:0/3500354435 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cb0001680 con 0x7f0cc81613e0 2023-12-12T10:12:17.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.431+0000 7f0cc5d9b640 1 -- 172.21.15.78:0/3500354435 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cc00a5680 con 0x7f0cc81613e0 2023-12-12T10:12:17.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.431+0000 7f0cc5d9b640 1 -- 172.21.15.78:0/3500354435 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cc00a5a10 con 0x7f0cc81613e0 2023-12-12T10:12:17.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.435+0000 7f0ccce79640 1 -- 172.21.15.78:0/3500354435 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0cc81613e0 msgr2=0x7f0cc8168060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:17.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.435+0000 7f0ccce79640 1 --2- 172.21.15.78:0/3500354435 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0cc81613e0 0x7f0cc8168060 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0cc0009d90 tx=0x7f0cc001c840 comp rx=0 tx=0).stop 2023-12-12T10:12:17.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.435+0000 7f0ccce79640 1 -- 172.21.15.78:0/3500354435 shutdown_connections 2023-12-12T10:12:17.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.435+0000 7f0ccce79640 1 --2- 172.21.15.78:0/3500354435 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0cc81613e0 0x7f0cc8168060 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:17.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.435+0000 7f0ccce79640 1 -- 172.21.15.78:0/3500354435 >> 172.21.15.78:0/3500354435 conn(0x7f0cc806c5d0 msgr2=0x7f0cc806c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:17.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.435+0000 7f0ccce79640 1 -- 172.21.15.78:0/3500354435 shutdown_connections 2023-12-12T10:12:17.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.435+0000 7f0ccce79640 1 -- 172.21.15.78:0/3500354435 wait complete. 2023-12-12T10:12:17.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.435+0000 7f0ccce79640 1 Processor -- start 2023-12-12T10:12:17.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.435+0000 7f0ccce79640 1 -- start start 2023-12-12T10:12:17.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.435+0000 7f0ccce79640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0cc81401a0 0x7f0cc80cc420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:17.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.435+0000 7f0ccce79640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0cc81613e0 0x7f0cc8142b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:17.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.435+0000 7f0ccce79640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0cc8161900 0x7f0cc8143050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:17.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.435+0000 7f0ccce79640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc8143590 con 0x7f0cc81401a0 2023-12-12T10:12:17.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.435+0000 7f0ccce79640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc81415a0 con 0x7f0cc8161900 2023-12-12T10:12:17.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.435+0000 7f0ccce79640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cc80cc960 con 0x7f0cc81613e0 2023-12-12T10:12:17.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.435+0000 7f0cc659c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0cc81401a0 0x7f0cc80cc420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:17.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.435+0000 7f0cc659c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0cc81401a0 0x7f0cc80cc420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:43318/0 (socket says 172.21.15.78:43318) 2023-12-12T10:12:17.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.435+0000 7f0cc659c640 1 -- 172.21.15.78:0/2981077800 learned_addr learned my addr 172.21.15.78:0/2981077800 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:17.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.435+0000 7f0cbffff640 1 --2- 172.21.15.78:0/2981077800 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0cc81613e0 0x7f0cc8142b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:17.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.435+0000 7f0cc6d9d640 1 --2- 172.21.15.78:0/2981077800 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0cc8161900 0x7f0cc8143050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:17.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.435+0000 7f0cc659c640 1 -- 172.21.15.78:0/2981077800 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0cc81613e0 msgr2=0x7f0cc8142b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:17.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.435+0000 7f0cc659c640 1 --2- 172.21.15.78:0/2981077800 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0cc81613e0 0x7f0cc8142b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:17.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.435+0000 7f0cc659c640 1 -- 172.21.15.78:0/2981077800 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0cc8161900 msgr2=0x7f0cc8143050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:17.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.435+0000 7f0cc659c640 1 --2- 172.21.15.78:0/2981077800 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0cc8161900 0x7f0cc8143050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:17.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.435+0000 7f0cc659c640 1 -- 172.21.15.78:0/2981077800 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cc0009a70 con 0x7f0cc81401a0 2023-12-12T10:12:17.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.439+0000 7f0cc659c640 1 --2- 172.21.15.78:0/2981077800 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0cc81401a0 0x7f0cc80cc420 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0cb800c490 tx=0x7f0cb800c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:17.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.439+0000 7f0cbeffd640 1 -- 172.21.15.78:0/2981077800 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cb80052d0 con 0x7f0cc81401a0 2023-12-12T10:12:17.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.439+0000 7f0cbeffd640 1 -- 172.21.15.78:0/2981077800 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cb8005430 con 0x7f0cc81401a0 2023-12-12T10:12:17.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.439+0000 7f0cbeffd640 1 -- 172.21.15.78:0/2981077800 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cb8012870 con 0x7f0cc81401a0 2023-12-12T10:12:17.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.439+0000 7f0ccce79640 1 -- 172.21.15.78:0/2981077800 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cc8140d00 con 0x7f0cc81401a0 2023-12-12T10:12:17.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.439+0000 7f0ccce79640 1 -- 172.21.15.78:0/2981077800 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cc81412c0 con 0x7f0cc81401a0 2023-12-12T10:12:17.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.439+0000 7f0ccce79640 1 -- 172.21.15.78:0/2981077800 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cc813c420 con 0x7f0cc81401a0 2023-12-12T10:12:17.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.439+0000 7f0cbeffd640 1 -- 172.21.15.78:0/2981077800 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f0cb80129d0 con 0x7f0cc81401a0 2023-12-12T10:12:17.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.439+0000 7f0cbeffd640 1 --2- 172.21.15.78:0/2981077800 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f0ca8066470 0x7f0ca8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:17.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.439+0000 7f0cbeffd640 1 -- 172.21.15.78:0/2981077800 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0cb8083df0 con 0x7f0cc81401a0 2023-12-12T10:12:17.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.439+0000 7f0cbffff640 1 --2- 172.21.15.78:0/2981077800 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f0ca8066470 0x7f0ca8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:17.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.443+0000 7f0cbffff640 1 --2- 172.21.15.78:0/2981077800 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f0ca8066470 0x7f0ca8068930 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0cc80b32c0 tx=0x7f0cb0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:17.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.443+0000 7f0cbeffd640 1 -- 172.21.15.78:0/2981077800 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0cb8050ee0 con 0x7f0cc81401a0 2023-12-12T10:12:17.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.631+0000 7f0ccce79640 1 -- 172.21.15.78:0/2981077800 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f0cc80671f0 con 0x7f0cc81401a0 2023-12-12T10:12:17.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.631+0000 7f0cbeffd640 1 -- 172.21.15.78:0/2981077800 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+88 (secure 0 0 0) 0x7f0cb8054500 con 0x7f0cc81401a0 2023-12-12T10:12:17.636 INFO:teuthology.orchestra.run.smithi078.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-12-12T10:12:17.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.631+0000 7f0ccce79640 1 -- 172.21.15.78:0/2981077800 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f0ca8066470 msgr2=0x7f0ca8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:17.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.631+0000 7f0ccce79640 1 --2- 172.21.15.78:0/2981077800 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f0ca8066470 0x7f0ca8068930 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0cc80b32c0 tx=0x7f0cb0009040 comp rx=0 tx=0).stop 2023-12-12T10:12:17.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.631+0000 7f0ccce79640 1 -- 172.21.15.78:0/2981077800 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0cc81401a0 msgr2=0x7f0cc80cc420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:17.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.631+0000 7f0ccce79640 1 --2- 172.21.15.78:0/2981077800 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0cc81401a0 0x7f0cc80cc420 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0cb800c490 tx=0x7f0cb800c950 comp rx=0 tx=0).stop 2023-12-12T10:12:17.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.631+0000 7f0ccce79640 1 -- 172.21.15.78:0/2981077800 shutdown_connections 2023-12-12T10:12:17.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.631+0000 7f0ccce79640 1 --2- 172.21.15.78:0/2981077800 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f0ca8066470 0x7f0ca8068930 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:17.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.631+0000 7f0ccce79640 1 --2- 172.21.15.78:0/2981077800 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0cc8161900 0x7f0cc8143050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:17.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.631+0000 7f0ccce79640 1 --2- 172.21.15.78:0/2981077800 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0cc81613e0 0x7f0cc8142b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:17.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.631+0000 7f0ccce79640 1 --2- 172.21.15.78:0/2981077800 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0cc81401a0 0x7f0cc80cc420 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:17.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.631+0000 7f0ccce79640 1 -- 172.21.15.78:0/2981077800 >> 172.21.15.78:0/2981077800 conn(0x7f0cc806c5d0 msgr2=0x7f0cc80af1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:17.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.631+0000 7f0ccce79640 1 -- 172.21.15.78:0/2981077800 shutdown_connections 2023-12-12T10:12:17.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:17.631+0000 7f0ccce79640 1 -- 172.21.15.78:0/2981077800 wait complete. 2023-12-12T10:12:17.656 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-12T10:12:17.656 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-12T10:12:17.656 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi078.front.sepia.ceph.com 2023-12-12T10:12:17.656 INFO:tasks.cephfs.mount:self.client.name = client.admin 2023-12-12T10:12:17.656 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-12-12T10:12:17.656 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-12T10:12:17.656 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-12T10:12:17.656 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-12T10:12:17.656 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2023-12-12T10:12:17.657 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T10:12:17.657 DEBUG:teuthology.orchestra.run.smithi078:> ip addr 2023-12-12T10:12:17.666 INFO:teuthology.orchestra.run.smithi078.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-12T10:12:17.666 INFO:teuthology.orchestra.run.smithi078.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-12T10:12:17.666 INFO:teuthology.orchestra.run.smithi078.stdout: inet 127.0.0.1/8 scope host lo 2023-12-12T10:12:17.666 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-12-12T10:12:17.666 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 ::1/128 scope host 2023-12-12T10:12:17.666 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-12-12T10:12:17.666 INFO:teuthology.orchestra.run.smithi078.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-12T10:12:17.666 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:d8:a1:22 brd ff:ff:ff:ff:ff:ff 2023-12-12T10:12:17.666 INFO:teuthology.orchestra.run.smithi078.stdout: altname enp7s0f0 2023-12-12T10:12:17.666 INFO:teuthology.orchestra.run.smithi078.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-12T10:12:17.667 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:d8:a1:23 brd ff:ff:ff:ff:ff:ff 2023-12-12T10:12:17.667 INFO:teuthology.orchestra.run.smithi078.stdout: altname enp7s0f1 2023-12-12T10:12:17.667 INFO:teuthology.orchestra.run.smithi078.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-12T10:12:17.667 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:8f:d4:dc brd ff:ff:ff:ff:ff:ff 2023-12-12T10:12:17.667 INFO:teuthology.orchestra.run.smithi078.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-12T10:12:17.667 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:8f:d4:dd brd ff:ff:ff:ff:ff:ff 2023-12-12T10:12:17.667 INFO:teuthology.orchestra.run.smithi078.stdout: inet 172.21.15.78/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-12-12T10:12:17.667 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft 42393sec preferred_lft 42393sec 2023-12-12T10:12:17.667 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 fe80::ec4:7aff:fe8f:d4dd/64 scope link 2023-12-12T10:12:17.667 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-12-12T10:12:17.667 INFO:teuthology.orchestra.run.smithi078.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-12T10:12:17.667 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 02:42:b6:5e:55:45 brd ff:ff:ff:ff:ff:ff 2023-12-12T10:12:17.668 INFO:teuthology.orchestra.run.smithi078.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-12T10:12:17.668 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-12-12T10:12:17.670 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-12-12T10:12:17.670 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T10:12:17.670 DEBUG:teuthology.orchestra.run.smithi078:> (cd / && exec bash -c ' 2023-12-12T10:12:17.671 DEBUG:teuthology.orchestra.run.smithi078:> set -e 2023-12-12T10:12:17.671 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link add name ceph-brx type bridge 2023-12-12T10:12:17.671 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip addr flush dev ceph-brx 2023-12-12T10:12:17.671 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link set ceph-brx up 2023-12-12T10:12:17.671 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-12-12T10:12:17.671 DEBUG:teuthology.orchestra.run.smithi078:> ') 2023-12-12T10:12:17.779 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T10:12:17.779 DEBUG:teuthology.orchestra.run.smithi078:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-12T10:12:17.798 INFO:teuthology.orchestra.run.smithi078.stdout:1 2023-12-12T10:12:17.800 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T10:12:17.800 DEBUG:teuthology.orchestra.run.smithi078:> route 2023-12-12T10:12:17.876 INFO:teuthology.orchestra.run.smithi078.stdout:Kernel IP routing table 2023-12-12T10:12:17.876 INFO:teuthology.orchestra.run.smithi078.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-12T10:12:17.876 INFO:teuthology.orchestra.run.smithi078.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-12-12T10:12:17.876 INFO:teuthology.orchestra.run.smithi078.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-12T10:12:17.876 INFO:teuthology.orchestra.run.smithi078.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-12T10:12:17.876 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-12T10:12:17.876 INFO:teuthology.orchestra.run.smithi078.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-12T10:12:17.877 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-12T10:12:17.877 INFO:teuthology.orchestra.run.smithi078.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-12T10:12:17.877 INFO:teuthology.orchestra.run.smithi078.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-12T10:12:17.877 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T10:12:17.877 DEBUG:teuthology.orchestra.run.smithi078:> (cd / && exec bash -c ' 2023-12-12T10:12:17.877 DEBUG:teuthology.orchestra.run.smithi078:> set -e 2023-12-12T10:12:17.877 DEBUG:teuthology.orchestra.run.smithi078:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-12T10:12:17.877 DEBUG:teuthology.orchestra.run.smithi078:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-12T10:12:17.877 DEBUG:teuthology.orchestra.run.smithi078:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-12T10:12:17.878 DEBUG:teuthology.orchestra.run.smithi078:> ') 2023-12-12T10:12:17.971 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T10:12:17.971 DEBUG:teuthology.orchestra.run.smithi078:> ip netns list 2023-12-12T10:12:17.981 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T10:12:17.981 DEBUG:teuthology.orchestra.run.smithi078:> ip netns list-id 2023-12-12T10:12:18.031 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T10:12:18.031 DEBUG:teuthology.orchestra.run.smithi078:> (cd / && exec bash -c ' 2023-12-12T10:12:18.031 DEBUG:teuthology.orchestra.run.smithi078:> set -e 2023-12-12T10:12:18.031 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-12-12T10:12:18.031 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2023-12-12T10:12:18.031 DEBUG:teuthology.orchestra.run.smithi078:> ') 2023-12-12T10:12:18.115 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2023-12-12T10:12:18.115 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T10:12:18.115 DEBUG:teuthology.orchestra.run.smithi078:> (cd / && exec bash -c ' 2023-12-12T10:12:18.115 DEBUG:teuthology.orchestra.run.smithi078:> set -e 2023-12-12T10:12:18.115 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2023-12-12T10:12:18.116 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-12-12T10:12:18.116 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2023-12-12T10:12:18.116 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2023-12-12T10:12:18.116 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2023-12-12T10:12:18.116 DEBUG:teuthology.orchestra.run.smithi078:> ') 2023-12-12T10:12:18.285 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T10:12:18.285 DEBUG:teuthology.orchestra.run.smithi078:> (cd / && exec bash -c ' 2023-12-12T10:12:18.285 DEBUG:teuthology.orchestra.run.smithi078:> set -e 2023-12-12T10:12:18.285 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link set brx.0 up 2023-12-12T10:12:18.286 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link set dev brx.0 master ceph-brx 2023-12-12T10:12:18.286 DEBUG:teuthology.orchestra.run.smithi078:> ') 2023-12-12T10:12:18.326 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2023-12-12T10:12:18.326 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-12T10:12:18.326 DEBUG:teuthology.orchestra.run.smithi078:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2023-12-12T10:12:18.378 INFO:teuthology.orchestra.run.smithi078.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2023-12-12T10:12:18.378 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-12T10:12:18.379 DEBUG:teuthology.orchestra.run.smithi078:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2023-12-12T10:12:18.429 DEBUG:teuthology.orchestra.run.smithi078:> sudo modprobe fuse 2023-12-12T10:12:18.490 DEBUG:teuthology.orchestra.run.smithi078:> cat /proc/self/mounts | awk '{print $2}' 2023-12-12T10:12:18.548 INFO:teuthology.orchestra.run.smithi078.stdout:/sys 2023-12-12T10:12:18.548 INFO:teuthology.orchestra.run.smithi078.stdout:/proc 2023-12-12T10:12:18.548 INFO:teuthology.orchestra.run.smithi078.stdout:/dev 2023-12-12T10:12:18.548 INFO:teuthology.orchestra.run.smithi078.stdout:/dev/pts 2023-12-12T10:12:18.548 INFO:teuthology.orchestra.run.smithi078.stdout:/run 2023-12-12T10:12:18.548 INFO:teuthology.orchestra.run.smithi078.stdout:/ 2023-12-12T10:12:18.548 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/kernel/security 2023-12-12T10:12:18.548 INFO:teuthology.orchestra.run.smithi078.stdout:/dev/shm 2023-12-12T10:12:18.548 INFO:teuthology.orchestra.run.smithi078.stdout:/run/lock 2023-12-12T10:12:18.548 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/fs/cgroup 2023-12-12T10:12:18.549 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/fs/pstore 2023-12-12T10:12:18.549 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/fs/bpf 2023-12-12T10:12:18.549 INFO:teuthology.orchestra.run.smithi078.stdout:/proc/sys/fs/binfmt_misc 2023-12-12T10:12:18.549 INFO:teuthology.orchestra.run.smithi078.stdout:/dev/hugepages 2023-12-12T10:12:18.549 INFO:teuthology.orchestra.run.smithi078.stdout:/dev/mqueue 2023-12-12T10:12:18.549 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/kernel/debug 2023-12-12T10:12:18.549 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/kernel/tracing 2023-12-12T10:12:18.549 INFO:teuthology.orchestra.run.smithi078.stdout:/proc/fs/nfsd 2023-12-12T10:12:18.549 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/fs/fuse/connections 2023-12-12T10:12:18.549 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/kernel/config 2023-12-12T10:12:18.549 INFO:teuthology.orchestra.run.smithi078.stdout:/run/credentials/systemd-sysusers.service 2023-12-12T10:12:18.549 INFO:teuthology.orchestra.run.smithi078.stdout:/run/rpc_pipefs 2023-12-12T10:12:18.549 INFO:teuthology.orchestra.run.smithi078.stdout:/run/user/1000 2023-12-12T10:12:18.549 INFO:teuthology.orchestra.run.smithi078.stdout:/var/lib/ceph 2023-12-12T10:12:18.550 INFO:teuthology.orchestra.run.smithi078.stdout:/var/lib/ceph/osd/ceph-0 2023-12-12T10:12:18.550 INFO:teuthology.orchestra.run.smithi078.stdout:/var/lib/ceph/osd/ceph-1 2023-12-12T10:12:18.550 INFO:teuthology.orchestra.run.smithi078.stdout:/var/lib/ceph/osd/ceph-2 2023-12-12T10:12:18.550 INFO:teuthology.orchestra.run.smithi078.stdout:/var/lib/ceph/osd/ceph-3 2023-12-12T10:12:18.550 INFO:teuthology.orchestra.run.smithi078.stdout:/run/netns 2023-12-12T10:12:18.550 INFO:teuthology.orchestra.run.smithi078.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-12-12T10:12:18.550 INFO:teuthology.orchestra.run.smithi078.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-12-12T10:12:18.551 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T10:12:18.551 DEBUG:teuthology.orchestra.run.smithi078:> ls /sys/fs/fuse/connections 2023-12-12T10:12:18.602 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-12-12T10:12:18.602 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2023-12-12T10:12:18.649 DEBUG:teuthology.orchestra.run.smithi078:> sudo modprobe fuse 2023-12-12T10:12:18.670 DEBUG:teuthology.orchestra.run.smithi078:> cat /proc/self/mounts | awk '{print $2}' 2023-12-12T10:12:18.728 INFO:teuthology.orchestra.run.smithi078.stdout:/sys 2023-12-12T10:12:18.728 INFO:teuthology.orchestra.run.smithi078.stdout:/proc 2023-12-12T10:12:18.728 INFO:teuthology.orchestra.run.smithi078.stdout:/dev 2023-12-12T10:12:18.728 INFO:teuthology.orchestra.run.smithi078.stdout:/dev/pts 2023-12-12T10:12:18.728 INFO:teuthology.orchestra.run.smithi078.stdout:/run 2023-12-12T10:12:18.728 INFO:teuthology.orchestra.run.smithi078.stdout:/ 2023-12-12T10:12:18.728 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/kernel/security 2023-12-12T10:12:18.728 INFO:teuthology.orchestra.run.smithi078.stdout:/dev/shm 2023-12-12T10:12:18.729 INFO:teuthology.orchestra.run.smithi078.stdout:/run/lock 2023-12-12T10:12:18.729 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/fs/cgroup 2023-12-12T10:12:18.729 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/fs/pstore 2023-12-12T10:12:18.729 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/fs/bpf 2023-12-12T10:12:18.729 INFO:teuthology.orchestra.run.smithi078.stdout:/proc/sys/fs/binfmt_misc 2023-12-12T10:12:18.729 INFO:teuthology.orchestra.run.smithi078.stdout:/dev/hugepages 2023-12-12T10:12:18.729 INFO:teuthology.orchestra.run.smithi078.stdout:/dev/mqueue 2023-12-12T10:12:18.729 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/kernel/debug 2023-12-12T10:12:18.729 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/kernel/tracing 2023-12-12T10:12:18.729 INFO:teuthology.orchestra.run.smithi078.stdout:/proc/fs/nfsd 2023-12-12T10:12:18.729 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/fs/fuse/connections 2023-12-12T10:12:18.729 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/kernel/config 2023-12-12T10:12:18.729 INFO:teuthology.orchestra.run.smithi078.stdout:/run/credentials/systemd-sysusers.service 2023-12-12T10:12:18.729 INFO:teuthology.orchestra.run.smithi078.stdout:/run/rpc_pipefs 2023-12-12T10:12:18.729 INFO:teuthology.orchestra.run.smithi078.stdout:/run/user/1000 2023-12-12T10:12:18.730 INFO:teuthology.orchestra.run.smithi078.stdout:/var/lib/ceph 2023-12-12T10:12:18.730 INFO:teuthology.orchestra.run.smithi078.stdout:/var/lib/ceph/osd/ceph-0 2023-12-12T10:12:18.730 INFO:teuthology.orchestra.run.smithi078.stdout:/var/lib/ceph/osd/ceph-1 2023-12-12T10:12:18.730 INFO:teuthology.orchestra.run.smithi078.stdout:/var/lib/ceph/osd/ceph-2 2023-12-12T10:12:18.730 INFO:teuthology.orchestra.run.smithi078.stdout:/var/lib/ceph/osd/ceph-3 2023-12-12T10:12:18.730 INFO:teuthology.orchestra.run.smithi078.stdout:/run/netns 2023-12-12T10:12:18.730 INFO:teuthology.orchestra.run.smithi078.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-12-12T10:12:18.730 INFO:teuthology.orchestra.run.smithi078.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-12-12T10:12:18.731 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T10:12:18.731 DEBUG:teuthology.orchestra.run.smithi078:> ls /sys/fs/fuse/connections 2023-12-12T10:12:18.757 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi078.stderr:2023-12-12T10:12:18.751+0000 7f5f91a77580 -1 init, newargv = 0x5587c2728140 newargc=15 2023-12-12T10:12:18.758 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi078.stderr:ceph-fuse[44812]: starting ceph client 2023-12-12T10:12:18.767 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi078.stderr:ceph-fuse[44812]: starting fuse 2023-12-12T10:12:19.869 DEBUG:teuthology.orchestra.run.smithi078:> sudo modprobe fuse 2023-12-12T10:12:19.893 DEBUG:teuthology.orchestra.run.smithi078:> cat /proc/self/mounts | awk '{print $2}' 2023-12-12T10:12:19.949 INFO:teuthology.orchestra.run.smithi078.stdout:/sys 2023-12-12T10:12:19.950 INFO:teuthology.orchestra.run.smithi078.stdout:/proc 2023-12-12T10:12:19.950 INFO:teuthology.orchestra.run.smithi078.stdout:/dev 2023-12-12T10:12:19.950 INFO:teuthology.orchestra.run.smithi078.stdout:/dev/pts 2023-12-12T10:12:19.950 INFO:teuthology.orchestra.run.smithi078.stdout:/run 2023-12-12T10:12:19.950 INFO:teuthology.orchestra.run.smithi078.stdout:/ 2023-12-12T10:12:19.950 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/kernel/security 2023-12-12T10:12:19.950 INFO:teuthology.orchestra.run.smithi078.stdout:/dev/shm 2023-12-12T10:12:19.950 INFO:teuthology.orchestra.run.smithi078.stdout:/run/lock 2023-12-12T10:12:19.950 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/fs/cgroup 2023-12-12T10:12:19.950 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/fs/pstore 2023-12-12T10:12:19.950 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/fs/bpf 2023-12-12T10:12:19.950 INFO:teuthology.orchestra.run.smithi078.stdout:/proc/sys/fs/binfmt_misc 2023-12-12T10:12:19.950 INFO:teuthology.orchestra.run.smithi078.stdout:/dev/hugepages 2023-12-12T10:12:19.951 INFO:teuthology.orchestra.run.smithi078.stdout:/dev/mqueue 2023-12-12T10:12:19.951 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/kernel/debug 2023-12-12T10:12:19.951 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/kernel/tracing 2023-12-12T10:12:19.951 INFO:teuthology.orchestra.run.smithi078.stdout:/proc/fs/nfsd 2023-12-12T10:12:19.951 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/fs/fuse/connections 2023-12-12T10:12:19.951 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/kernel/config 2023-12-12T10:12:19.951 INFO:teuthology.orchestra.run.smithi078.stdout:/run/credentials/systemd-sysusers.service 2023-12-12T10:12:19.951 INFO:teuthology.orchestra.run.smithi078.stdout:/run/rpc_pipefs 2023-12-12T10:12:19.951 INFO:teuthology.orchestra.run.smithi078.stdout:/run/user/1000 2023-12-12T10:12:19.951 INFO:teuthology.orchestra.run.smithi078.stdout:/var/lib/ceph 2023-12-12T10:12:19.951 INFO:teuthology.orchestra.run.smithi078.stdout:/var/lib/ceph/osd/ceph-0 2023-12-12T10:12:19.951 INFO:teuthology.orchestra.run.smithi078.stdout:/var/lib/ceph/osd/ceph-1 2023-12-12T10:12:19.951 INFO:teuthology.orchestra.run.smithi078.stdout:/var/lib/ceph/osd/ceph-2 2023-12-12T10:12:19.951 INFO:teuthology.orchestra.run.smithi078.stdout:/var/lib/ceph/osd/ceph-3 2023-12-12T10:12:19.951 INFO:teuthology.orchestra.run.smithi078.stdout:/run/netns 2023-12-12T10:12:19.952 INFO:teuthology.orchestra.run.smithi078.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-12-12T10:12:19.952 INFO:teuthology.orchestra.run.smithi078.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-12-12T10:12:19.952 INFO:teuthology.orchestra.run.smithi078.stdout:/home/ubuntu/cephtest/mnt.admin 2023-12-12T10:12:19.953 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T10:12:19.953 DEBUG:teuthology.orchestra.run.smithi078:> ls /sys/fs/fuse/connections 2023-12-12T10:12:20.004 INFO:teuthology.orchestra.run.smithi078.stdout:43 2023-12-12T10:12:20.004 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2023-12-12T10:12:20.004 DEBUG:teuthology.orchestra.run.smithi078:> sudo stdin-killer -- python3 -c ' 2023-12-12T10:12:20.004 DEBUG:teuthology.orchestra.run.smithi078:> import glob 2023-12-12T10:12:20.004 DEBUG:teuthology.orchestra.run.smithi078:> import re 2023-12-12T10:12:20.005 DEBUG:teuthology.orchestra.run.smithi078:> import os 2023-12-12T10:12:20.005 DEBUG:teuthology.orchestra.run.smithi078:> import subprocess 2023-12-12T10:12:20.005 DEBUG:teuthology.orchestra.run.smithi078:> 2023-12-12T10:12:20.005 DEBUG:teuthology.orchestra.run.smithi078:> def _find_admin_socket(client_name): 2023-12-12T10:12:20.005 DEBUG:teuthology.orchestra.run.smithi078:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2023-12-12T10:12:20.005 DEBUG:teuthology.orchestra.run.smithi078:> files = glob.glob(asok_path) 2023-12-12T10:12:20.005 DEBUG:teuthology.orchestra.run.smithi078:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2023-12-12T10:12:20.005 DEBUG:teuthology.orchestra.run.smithi078:> 2023-12-12T10:12:20.005 DEBUG:teuthology.orchestra.run.smithi078:> # Given a non-glob path, it better be there 2023-12-12T10:12:20.005 DEBUG:teuthology.orchestra.run.smithi078:> if "*" not in asok_path: 2023-12-12T10:12:20.005 DEBUG:teuthology.orchestra.run.smithi078:> assert(len(files) == 1) 2023-12-12T10:12:20.005 DEBUG:teuthology.orchestra.run.smithi078:> return files[0] 2023-12-12T10:12:20.005 DEBUG:teuthology.orchestra.run.smithi078:> 2023-12-12T10:12:20.005 DEBUG:teuthology.orchestra.run.smithi078:> for f in files: 2023-12-12T10:12:20.005 DEBUG:teuthology.orchestra.run.smithi078:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-12T10:12:20.006 DEBUG:teuthology.orchestra.run.smithi078:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-12T10:12:20.006 DEBUG:teuthology.orchestra.run.smithi078:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-12T10:12:20.006 DEBUG:teuthology.orchestra.run.smithi078:> contents = proc_f.read() 2023-12-12T10:12:20.006 DEBUG:teuthology.orchestra.run.smithi078:> if mountpoint in contents: 2023-12-12T10:12:20.006 DEBUG:teuthology.orchestra.run.smithi078:> return f 2023-12-12T10:12:20.006 DEBUG:teuthology.orchestra.run.smithi078:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-12T10:12:20.006 DEBUG:teuthology.orchestra.run.smithi078:> 2023-12-12T10:12:20.006 DEBUG:teuthology.orchestra.run.smithi078:> print(_find_admin_socket("client.admin")) 2023-12-12T10:12:20.006 DEBUG:teuthology.orchestra.run.smithi078:> ' 2023-12-12T10:12:20.135 INFO:teuthology.orchestra.run.smithi078.stdout:/var/run/ceph/ceph-client.admin.44812.asok 2023-12-12T10:12:20.138 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-12-12T10:12:20.147 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.44812.asok 2023-12-12T10:12:20.147 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T10:12:20.147 DEBUG:teuthology.orchestra.run.smithi078:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.44812.asok status 2023-12-12T10:12:20.323 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2023-12-12T10:12:20.323 INFO:teuthology.orchestra.run.smithi078.stdout: "metadata": { 2023-12-12T10:12:20.323 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph_sha1": "f1fbf3c583d03e19f5e58eb618e78d8e10d075f9", 2023-12-12T10:12:20.323 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph_version": "ceph version 19.0.0-96-gf1fbf3c5 (f1fbf3c583d03e19f5e58eb618e78d8e10d075f9) reef (dev)", 2023-12-12T10:12:20.323 INFO:teuthology.orchestra.run.smithi078.stdout: "entity_id": "admin", 2023-12-12T10:12:20.323 INFO:teuthology.orchestra.run.smithi078.stdout: "hostname": "smithi078", 2023-12-12T10:12:20.323 INFO:teuthology.orchestra.run.smithi078.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2023-12-12T10:12:20.323 INFO:teuthology.orchestra.run.smithi078.stdout: "pid": "44812", 2023-12-12T10:12:20.323 INFO:teuthology.orchestra.run.smithi078.stdout: "root": "/" 2023-12-12T10:12:20.323 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-12-12T10:12:20.323 INFO:teuthology.orchestra.run.smithi078.stdout: "dentry_count": 0, 2023-12-12T10:12:20.324 INFO:teuthology.orchestra.run.smithi078.stdout: "dentry_pinned_count": 0, 2023-12-12T10:12:20.324 INFO:teuthology.orchestra.run.smithi078.stdout: "id": 4422, 2023-12-12T10:12:20.324 INFO:teuthology.orchestra.run.smithi078.stdout: "inst": { 2023-12-12T10:12:20.324 INFO:teuthology.orchestra.run.smithi078.stdout: "name": { 2023-12-12T10:12:20.324 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "client", 2023-12-12T10:12:20.324 INFO:teuthology.orchestra.run.smithi078.stdout: "num": 4422 2023-12-12T10:12:20.324 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-12-12T10:12:20.324 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": { 2023-12-12T10:12:20.324 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v1", 2023-12-12T10:12:20.324 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "172.21.15.78:0", 2023-12-12T10:12:20.324 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 1099690998 2023-12-12T10:12:20.324 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-12-12T10:12:20.324 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-12-12T10:12:20.325 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": { 2023-12-12T10:12:20.325 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v1", 2023-12-12T10:12:20.325 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "172.21.15.78:0", 2023-12-12T10:12:20.325 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 1099690998 2023-12-12T10:12:20.325 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-12-12T10:12:20.325 INFO:teuthology.orchestra.run.smithi078.stdout: "inst_str": "client.4422 172.21.15.78:0/1099690998", 2023-12-12T10:12:20.325 INFO:teuthology.orchestra.run.smithi078.stdout: "addr_str": "172.21.15.78:0/1099690998", 2023-12-12T10:12:20.325 INFO:teuthology.orchestra.run.smithi078.stdout: "inode_count": 1, 2023-12-12T10:12:20.325 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_epoch": 7, 2023-12-12T10:12:20.325 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_epoch": 24, 2023-12-12T10:12:20.325 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_epoch_barrier": 0, 2023-12-12T10:12:20.325 INFO:teuthology.orchestra.run.smithi078.stdout: "blocklisted": false, 2023-12-12T10:12:20.325 INFO:teuthology.orchestra.run.smithi078.stdout: "fs_name": "cephfs" 2023-12-12T10:12:20.325 INFO:teuthology.orchestra.run.smithi078.stdout:} 2023-12-12T10:12:20.337 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T10:12:20.338 DEBUG:teuthology.orchestra.run.smithi078:> stat --file-system '--printf=%T 2023-12-12T10:12:20.338 DEBUG:teuthology.orchestra.run.smithi078:> ' -- /home/ubuntu/cephtest/mnt.admin 2023-12-12T10:12:20.347 INFO:teuthology.orchestra.run.smithi078.stdout:fuseblk 2023-12-12T10:12:20.347 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2023-12-12T10:12:20.347 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T10:12:20.348 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2023-12-12T10:12:20.410 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T10:12:20.411 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2023-12-12T10:12:20.487 INFO:teuthology.orchestra.run.smithi078.stdout:# file: . 2023-12-12T10:12:20.487 INFO:teuthology.orchestra.run.smithi078.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2023-12-12T10:12:20.487 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:12:20.488 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-12-12T10:12:20.489 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-12T10:12:20.539 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T10:12:20.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:20.711+0000 7f8bbc868640 1 Processor -- start 2023-12-12T10:12:20.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:20.711+0000 7f8bbc868640 1 -- start start 2023-12-12T10:12:20.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:20.715+0000 7f8bbc868640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f8bb81401a0 0x7f8bb80b2070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:20.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:20.715+0000 7f8bbc868640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8bb81613e0 0x7f8bb80ac880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:20.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:20.715+0000 7f8bbc868640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bb80b4f10 con 0x7f8bb8161900 2023-12-12T10:12:20.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:20.715+0000 7f8bbc868640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bb80b4a80 con 0x7f8bb81613e0 2023-12-12T10:12:20.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:20.715+0000 7f8bbc868640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bb80b3bd0 con 0x7f8bb81401a0 2023-12-12T10:12:20.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:20.715+0000 7f8bb5d9b640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f8bb8161900 0x7f8bb8160cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:44232/0 (socket says 172.21.15.78:44232) 2023-12-12T10:12:20.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:20.715+0000 7f8bb5d9b640 1 -- 172.21.15.78:0/3882803343 learned_addr learned my addr 172.21.15.78:0/3882803343 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-12-12T10:12:20.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:20.715+0000 7f8bb6d9d640 1 --2- 172.21.15.78:0/3882803343 >> v2:172.21.15.78:3300/0 conn(0x7f8bb81613e0 0x7f8bb80ac880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:20.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:20.715+0000 7f8bb659c640 1 --2- 172.21.15.78:0/3882803343 >> v2:172.21.15.187:3300/0 conn(0x7f8bb81401a0 0x7f8bb80b2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:20.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:20.715+0000 7f8bb559a640 1 -- 172.21.15.78:0/3882803343 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 188492758 0 0) 0x7f8bb80b4f10 con 0x7f8bb8161900 2023-12-12T10:12:20.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:20.715+0000 7f8bb559a640 1 -- 172.21.15.78:0/3882803343 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ba0003530 con 0x7f8bb8161900 2023-12-12T10:12:20.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:20.715+0000 7f8bb6d9d640 1 -- 172.21.15.78:0/3882803343 >> v2:172.21.15.187:3300/0 conn(0x7f8bb81401a0 msgr2=0x7f8bb80b2070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:20.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:20.715+0000 7f8bb6d9d640 1 --2- 172.21.15.78:0/3882803343 >> v2:172.21.15.187:3300/0 conn(0x7f8bb81401a0 0x7f8bb80b2070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:20.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:20.715+0000 7f8bb6d9d640 1 -- 172.21.15.78:0/3882803343 >> v1:172.21.15.78:6789/0 conn(0x7f8bb8161900 legacy=0x7f8bb8160cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:20.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:20.715+0000 7f8bb6d9d640 1 -- 172.21.15.78:0/3882803343 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bb80b3e70 con 0x7f8bb81613e0 2023-12-12T10:12:20.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:20.719+0000 7f8bb6d9d640 1 --2- 172.21.15.78:0/3882803343 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8bb81613e0 0x7f8bb80ac880 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8bb8074150 tx=0x7f8bb001c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d25bb7f73daa3c4f server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:20.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:20.719+0000 7f8bb559a640 1 -- 172.21.15.78:0/3882803343 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bb00a59a0 con 0x7f8bb81613e0 2023-12-12T10:12:20.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:20.719+0000 7f8bb559a640 1 -- 172.21.15.78:0/3882803343 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bb00a5b00 con 0x7f8bb81613e0 2023-12-12T10:12:20.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:20.719+0000 7f8bb559a640 1 -- 172.21.15.78:0/3882803343 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bb00a5e90 con 0x7f8bb81613e0 2023-12-12T10:12:20.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:20.719+0000 7f8bbc868640 1 -- 172.21.15.78:0/3882803343 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8bb81613e0 msgr2=0x7f8bb80ac880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:20.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:20.719+0000 7f8bbc868640 1 --2- 172.21.15.78:0/3882803343 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8bb81613e0 0x7f8bb80ac880 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8bb8074150 tx=0x7f8bb001c8e0 comp rx=0 tx=0).stop 2023-12-12T10:12:20.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:20.719+0000 7f8bbc868640 1 -- 172.21.15.78:0/3882803343 shutdown_connections 2023-12-12T10:12:20.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:20.719+0000 7f8bbc868640 1 --2- 172.21.15.78:0/3882803343 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8bb81613e0 0x7f8bb80ac880 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:20.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:20.719+0000 7f8bbc868640 1 --2- 172.21.15.78:0/3882803343 >> v2:172.21.15.187:3300/0 conn(0x7f8bb81401a0 0x7f8bb80b2070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:20.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:20.719+0000 7f8bbc868640 1 -- 172.21.15.78:0/3882803343 >> 172.21.15.78:0/3882803343 conn(0x7f8bb806c5d0 msgr2=0x7f8bb806c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:20.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:20.719+0000 7f8bbc868640 1 -- 172.21.15.78:0/3882803343 shutdown_connections 2023-12-12T10:12:20.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:20.719+0000 7f8bbc868640 1 -- 172.21.15.78:0/3882803343 wait complete. 2023-12-12T10:12:20.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:20.719+0000 7f8bbc868640 1 Processor -- start 2023-12-12T10:12:20.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:20.719+0000 7f8bbc868640 1 -- start start 2023-12-12T10:12:20.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:20.723+0000 7f8bbc868640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8bb81401a0 0x7f8bb8138700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:20.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:20.723+0000 7f8bbc868640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8bb81613e0 0x7f8bb8144470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:20.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:20.723+0000 7f8bbc868640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8bb8161900 0x7f8bb81449b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:20.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:20.723+0000 7f8bbc868640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb8138c40 con 0x7f8bb8161900 2023-12-12T10:12:20.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:20.723+0000 7f8bbc868640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb8145030 con 0x7f8bb81613e0 2023-12-12T10:12:20.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:20.723+0000 7f8bbc868640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb8145310 con 0x7f8bb81401a0 2023-12-12T10:12:20.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:20.723+0000 7f8bb6d9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8bb8161900 0x7f8bb81449b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:20.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:20.723+0000 7f8bb6d9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8bb8161900 0x7f8bb81449b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47402/0 (socket says 172.21.15.78:47402) 2023-12-12T10:12:20.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:20.723+0000 7f8bb6d9d640 1 -- 172.21.15.78:0/4118405403 learned_addr learned my addr 172.21.15.78:0/4118405403 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:20.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:20.723+0000 7f8bb5d9b640 1 --2- 172.21.15.78:0/4118405403 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8bb81613e0 0x7f8bb8144470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:20.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:20.723+0000 7f8bb659c640 1 --2- 172.21.15.78:0/4118405403 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8bb81401a0 0x7f8bb8138700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:20.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:20.723+0000 7f8bb6d9d640 1 -- 172.21.15.78:0/4118405403 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8bb81401a0 msgr2=0x7f8bb8138700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:20.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:20.723+0000 7f8bb6d9d640 1 --2- 172.21.15.78:0/4118405403 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8bb81401a0 0x7f8bb8138700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:20.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:20.723+0000 7f8bb6d9d640 1 -- 172.21.15.78:0/4118405403 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8bb81613e0 msgr2=0x7f8bb8144470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:20.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:20.723+0000 7f8bb6d9d640 1 --2- 172.21.15.78:0/4118405403 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8bb81613e0 0x7f8bb8144470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:20.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:20.723+0000 7f8bb6d9d640 1 -- 172.21.15.78:0/4118405403 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bb0009a70 con 0x7f8bb8161900 2023-12-12T10:12:20.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:20.723+0000 7f8bb659c640 1 --2- 172.21.15.78:0/4118405403 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8bb81401a0 0x7f8bb8138700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T10:12:20.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:20.723+0000 7f8bb5d9b640 1 --2- 172.21.15.78:0/4118405403 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8bb81613e0 0x7f8bb8144470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T10:12:20.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:20.723+0000 7f8bb6d9d640 1 --2- 172.21.15.78:0/4118405403 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8bb8161900 0x7f8bb81449b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f8bb00194f0 tx=0x7f8bb0019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:20.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:20.723+0000 7f8ba6ffd640 1 -- 172.21.15.78:0/4118405403 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bb00adcc0 con 0x7f8bb8161900 2023-12-12T10:12:20.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:20.723+0000 7f8ba6ffd640 1 -- 172.21.15.78:0/4118405403 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bb00ade20 con 0x7f8bb8161900 2023-12-12T10:12:20.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:20.723+0000 7f8bbc868640 1 -- 172.21.15.78:0/4118405403 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bb81455f0 con 0x7f8bb8161900 2023-12-12T10:12:20.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:20.723+0000 7f8ba6ffd640 1 -- 172.21.15.78:0/4118405403 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bb00b9690 con 0x7f8bb8161900 2023-12-12T10:12:20.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:20.723+0000 7f8bbc868640 1 -- 172.21.15.78:0/4118405403 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bb8145bb0 con 0x7f8bb8161900 2023-12-12T10:12:20.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:20.723+0000 7f8bbc868640 1 -- 172.21.15.78:0/4118405403 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bb80671f0 con 0x7f8bb8161900 2023-12-12T10:12:20.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:20.723+0000 7f8ba6ffd640 1 -- 172.21.15.78:0/4118405403 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f8bb00b97f0 con 0x7f8bb8161900 2023-12-12T10:12:20.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:20.727+0000 7f8ba6ffd640 1 --2- 172.21.15.78:0/4118405403 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f8b98066470 0x7f8b98068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:20.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:20.727+0000 7f8ba6ffd640 1 -- 172.21.15.78:0/4118405403 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8bb011f960 con 0x7f8bb8161900 2023-12-12T10:12:20.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:20.727+0000 7f8bb659c640 1 --2- 172.21.15.78:0/4118405403 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f8b98066470 0x7f8b98068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:20.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:20.727+0000 7f8bb659c640 1 --2- 172.21.15.78:0/4118405403 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f8b98066470 0x7f8b98068930 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8ba8009bb0 tx=0x7f8ba8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:20.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:20.731+0000 7f8ba6ffd640 1 -- 172.21.15.78:0/4118405403 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8bb00eca50 con 0x7f8bb8161900 2023-12-12T10:12:20.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:20.883+0000 7f8bbc868640 1 -- 172.21.15.78:0/4118405403 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8bb8145da0 con 0x7f8bb8161900 2023-12-12T10:12:20.888 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:20.883+0000 7f8ba6ffd640 1 -- 172.21.15.78:0/4118405403 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18310 (secure 0 0 0) 0x7f8bb0009450 con 0x7f8bb8161900 2023-12-12T10:12:20.888 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:12:20.888 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":24,"fsid":"fc81937c-bd26-483c-952b-d1324fcb0c9e","created":"2023-12-12T10:11:44.020214+0000","modified":"2023-12-12T10:12:14.355146+0000","last_up_change":"2023-12-12T10:11:56.278318+0000","last_in_change":"2023-12-12T10:11:46.553610+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T10:11:57.053584+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-12T10:12:07.454450+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-12T10:12:08.182909+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-12T10:12:11.977952+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"22dfdedf-5f6c-4b20-9f6c-30517a1db70a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6809","nonce":3345683600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6811","nonce":3345683600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6815","nonce":3345683600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6813","nonce":3345683600}]},"public_addr":"172.21.15.78:6809/3345683600","cluster_addr":"172.21.15.78:6811/3345683600","heartbeat_back_addr":"172.21.15.78:6815/3345683600","heartbeat_front_addr":"172.21.15.78:6813/3345683600","state":["exists","up"]},{"osd":1,"uuid":"be34a7f3-a69a-462e-9ddf-5e537448dba2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6801","nonce":962652768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6803","nonce":962652768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6807","nonce":962652768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6805","nonce":962652768}]},"public_addr":"172.21.15.78:6801/962652768","cluster_addr":"172.21.15.78:6803/962652768","heartbeat_back_addr":"172.21.15.78:6807/962652768","heartbeat_front_addr":"172.21.15.78:6805/962652768","state":["exists","up"]},{"osd":2,"uuid":"55b381de-5f56-4b14-80f7-e6e41e084a13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6818","nonce":2910206054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6822","nonce":2910206054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6829","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6831","nonce":2910206054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6826","nonce":2910206054}]},"public_addr":"172.21.15.78:6818/2910206054","cluster_addr":"172.21.15.78:6822/2910206054","heartbeat_back_addr":"172.21.15.78:6831/2910206054","heartbeat_front_addr":"172.21.15.78:6826/2910206054","state":["exists","up"]},{"osd":3,"uuid":"d7682de1-25cb-4cec-869f-8851c28b0e6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6819","nonce":3750796703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6821","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6823","nonce":3750796703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6830","nonce":3750796703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6825","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6827","nonce":3750796703}]},"public_addr":"172.21.15.78:6819/3750796703","cluster_addr":"172.21.15.78:6823/3750796703","heartbeat_back_addr":"172.21.15.78:6830/3750796703","heartbeat_front_addr":"172.21.15.78:6827/3750796703","state":["exists","up"]},{"osd":4,"uuid":"8279815a-d6c7-4199-871e-d28971b9dc07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6809","nonce":2944277204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6811","nonce":2944277204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6815","nonce":2944277204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6813","nonce":2944277204}]},"public_addr":"172.21.15.187:6809/2944277204","cluster_addr":"172.21.15.187:6811/2944277204","heartbeat_back_addr":"172.21.15.187:6815/2944277204","heartbeat_front_addr":"172.21.15.187:6813/2944277204","state":["exists","up"]},{"osd":5,"uuid":"0a714c65-f8ce-4340-968f-11a799677ef3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6801","nonce":185858620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6803","nonce":185858620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6807","nonce":185858620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6805","nonce":185858620}]},"public_addr":"172.21.15.187:6801/185858620","cluster_addr":"172.21.15.187:6803/185858620","heartbeat_back_addr":"172.21.15.187:6807/185858620","heartbeat_front_addr":"172.21.15.187:6805/185858620","state":["exists","up"]},{"osd":6,"uuid":"d0bba9ab-f7ee-449e-8999-1c0cf7e6d53c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6817","nonce":4213392126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6819","nonce":4213392126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6824","nonce":4213392126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6821","nonce":4213392126}]},"public_addr":"172.21.15.187:6817/4213392126","cluster_addr":"172.21.15.187:6819/4213392126","heartbeat_back_addr":"172.21.15.187:6824/4213392126","heartbeat_front_addr":"172.21.15.187:6821/4213392126","state":["exists","up"]},{"osd":7,"uuid":"efe5e0d9-2f87-4889-a27a-e2a95a632302","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6823","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6825","nonce":85774004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6827","nonce":85774004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6831","nonce":85774004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6829","nonce":85774004}]},"public_addr":"172.21.15.187:6825/85774004","cluster_addr":"172.21.15.187:6827/85774004","heartbeat_back_addr":"172.21.15.187:6831/85774004","heartbeat_front_addr":"172.21.15.187:6829/85774004","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.214447+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.448899+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.293107+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.564184+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.175026+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.097717+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.261141+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.287681+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T10:12:20.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:20.883+0000 7f8bbc868640 1 -- 172.21.15.78:0/4118405403 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f8b98066470 msgr2=0x7f8b98068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:20.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:20.883+0000 7f8bbc868640 1 --2- 172.21.15.78:0/4118405403 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f8b98066470 0x7f8b98068930 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8ba8009bb0 tx=0x7f8ba8008040 comp rx=0 tx=0).stop 2023-12-12T10:12:20.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:20.883+0000 7f8bbc868640 1 -- 172.21.15.78:0/4118405403 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8bb8161900 msgr2=0x7f8bb81449b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:20.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:20.883+0000 7f8bbc868640 1 --2- 172.21.15.78:0/4118405403 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8bb8161900 0x7f8bb81449b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f8bb00194f0 tx=0x7f8bb0019680 comp rx=0 tx=0).stop 2023-12-12T10:12:20.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:20.883+0000 7f8bbc868640 1 -- 172.21.15.78:0/4118405403 shutdown_connections 2023-12-12T10:12:20.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:20.883+0000 7f8bbc868640 1 --2- 172.21.15.78:0/4118405403 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f8b98066470 0x7f8b98068930 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:20.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:20.883+0000 7f8bbc868640 1 --2- 172.21.15.78:0/4118405403 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8bb8161900 0x7f8bb81449b0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:20.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:20.883+0000 7f8bbc868640 1 --2- 172.21.15.78:0/4118405403 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8bb81613e0 0x7f8bb8144470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:20.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:20.883+0000 7f8bbc868640 1 --2- 172.21.15.78:0/4118405403 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8bb81401a0 0x7f8bb8138700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:20.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:20.883+0000 7f8bbc868640 1 -- 172.21.15.78:0/4118405403 >> 172.21.15.78:0/4118405403 conn(0x7f8bb806c5d0 msgr2=0x7f8bb813f7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:20.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:20.883+0000 7f8bbc868640 1 -- 172.21.15.78:0/4118405403 shutdown_connections 2023-12-12T10:12:20.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:20.883+0000 7f8bbc868640 1 -- 172.21.15.78:0/4118405403 wait complete. 2023-12-12T10:12:20.909 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-12T10:11:57.053584+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-12T10:12:07.454450+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-12T10:12:08.182909+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-12T10:12:11.977952+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-12T10:12:20.909 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-12T10:12:21.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.043+0000 7ff0188bb640 1 Processor -- start 2023-12-12T10:12:21.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.043+0000 7ff0188bb640 1 -- start start 2023-12-12T10:12:21.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.047+0000 7ff0188bb640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff014143770 0x7ff0140cdf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:21.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.047+0000 7ff0188bb640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff0140b1e20 0x7ff014070f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:21.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.047+0000 7ff0188bb640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff014070a70 con 0x7ff0140b2280 2023-12-12T10:12:21.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.047+0000 7ff0188bb640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff01415e920 con 0x7ff014143770 2023-12-12T10:12:21.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.047+0000 7ff0188bb640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff014070440 con 0x7ff0140b1e20 2023-12-12T10:12:21.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.047+0000 7ff01259c640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff014143770 0x7ff0140cdf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:21.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.047+0000 7ff012d9d640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7ff0140b2280 0x7ff01415a2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:44246/0 (socket says 172.21.15.78:44246) 2023-12-12T10:12:21.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.047+0000 7ff012d9d640 1 -- 172.21.15.78:0/2308114729 learned_addr learned my addr 172.21.15.78:0/2308114729 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-12-12T10:12:21.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.047+0000 7ff009d9b640 1 --2- 172.21.15.78:0/2308114729 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff0140b1e20 0x7ff014070f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:21.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.047+0000 7ff01259c640 1 -- 172.21.15.78:0/2308114729 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff0140b1e20 msgr2=0x7ff014070f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:21.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.047+0000 7ff01259c640 1 --2- 172.21.15.78:0/2308114729 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff0140b1e20 0x7ff014070f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:21.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.047+0000 7ff01259c640 1 -- 172.21.15.78:0/2308114729 >> v1:172.21.15.78:6789/0 conn(0x7ff0140b2280 legacy=0x7ff01415a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:21.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.047+0000 7ff01259c640 1 -- 172.21.15.78:0/2308114729 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff014143b50 con 0x7ff014143770 2023-12-12T10:12:21.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.047+0000 7ff009d9b640 1 --2- 172.21.15.78:0/2308114729 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff0140b1e20 0x7ff014070f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T10:12:21.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.051+0000 7ff01259c640 1 --2- 172.21.15.78:0/2308114729 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff014143770 0x7ff0140cdf60 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff00400ba60 tx=0x7ff00401eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d2beecdc9e88c40 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:21.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.051+0000 7ff011d9b640 1 -- 172.21.15.78:0/2308114729 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0040a7c40 con 0x7ff014143770 2023-12-12T10:12:21.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.051+0000 7ff011d9b640 1 -- 172.21.15.78:0/2308114729 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0040a7da0 con 0x7ff014143770 2023-12-12T10:12:21.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.051+0000 7ff011d9b640 1 -- 172.21.15.78:0/2308114729 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0040af660 con 0x7ff014143770 2023-12-12T10:12:21.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.051+0000 7ff0188bb640 1 -- 172.21.15.78:0/2308114729 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff014143770 msgr2=0x7ff0140cdf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:21.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.051+0000 7ff0188bb640 1 --2- 172.21.15.78:0/2308114729 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff014143770 0x7ff0140cdf60 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff00400ba60 tx=0x7ff00401eb50 comp rx=0 tx=0).stop 2023-12-12T10:12:21.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.051+0000 7ff0188bb640 1 -- 172.21.15.78:0/2308114729 shutdown_connections 2023-12-12T10:12:21.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.051+0000 7ff0188bb640 1 --2- 172.21.15.78:0/2308114729 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff0140b1e20 0x7ff014070f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:21.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.051+0000 7ff0188bb640 1 --2- 172.21.15.78:0/2308114729 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff014143770 0x7ff0140cdf60 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:21.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.051+0000 7ff0188bb640 1 -- 172.21.15.78:0/2308114729 >> 172.21.15.78:0/2308114729 conn(0x7ff01406a710 msgr2=0x7ff01406ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:21.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.051+0000 7ff0188bb640 1 -- 172.21.15.78:0/2308114729 shutdown_connections 2023-12-12T10:12:21.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.051+0000 7ff0188bb640 1 -- 172.21.15.78:0/2308114729 wait complete. 2023-12-12T10:12:21.057 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.051+0000 7ff0188bb640 1 Processor -- start 2023-12-12T10:12:21.057 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.051+0000 7ff0188bb640 1 -- start start 2023-12-12T10:12:21.059 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.055+0000 7ff0188bb640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff0140b1e20 0x7ff0141591e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:21.059 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.055+0000 7ff0188bb640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff0140b2280 0x7ff01413d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:21.059 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.055+0000 7ff0188bb640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff014143770 0x7ff01413d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:21.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.055+0000 7ff0188bb640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff01413f6f0 con 0x7ff0140b1e20 2023-12-12T10:12:21.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.055+0000 7ff0188bb640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff01413b980 con 0x7ff0140b2280 2023-12-12T10:12:21.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.055+0000 7ff0188bb640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff01413bc60 con 0x7ff014143770 2023-12-12T10:12:21.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.055+0000 7ff01259c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff0140b1e20 0x7ff0141591e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:21.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.055+0000 7ff01259c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff0140b1e20 0x7ff0141591e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47424/0 (socket says 172.21.15.78:47424) 2023-12-12T10:12:21.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.055+0000 7ff01259c640 1 -- 172.21.15.78:0/2437537757 learned_addr learned my addr 172.21.15.78:0/2437537757 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:21.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.055+0000 7ff01259c640 1 -- 172.21.15.78:0/2437537757 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff014143770 msgr2=0x7ff01413d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:21.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.055+0000 7ff01259c640 1 --2- 172.21.15.78:0/2437537757 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff014143770 0x7ff01413d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:21.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.055+0000 7ff01259c640 1 -- 172.21.15.78:0/2437537757 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff0140b2280 msgr2=0x7ff01413d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:21.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.055+0000 7ff01259c640 1 --2- 172.21.15.78:0/2437537757 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff0140b2280 0x7ff01413d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:21.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.055+0000 7ff01259c640 1 -- 172.21.15.78:0/2437537757 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff00400b6c0 con 0x7ff0140b1e20 2023-12-12T10:12:21.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.055+0000 7ff01259c640 1 --2- 172.21.15.78:0/2437537757 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff0140b1e20 0x7ff0141591e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff0040b2040 tx=0x7ff00401b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:21.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.055+0000 7ff00b7fe640 1 -- 172.21.15.78:0/2437537757 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0040ba670 con 0x7ff0140b1e20 2023-12-12T10:12:21.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.055+0000 7ff00b7fe640 1 -- 172.21.15.78:0/2437537757 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0040afe90 con 0x7ff0140b1e20 2023-12-12T10:12:21.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.055+0000 7ff0188bb640 1 -- 172.21.15.78:0/2437537757 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff01413f940 con 0x7ff0140b1e20 2023-12-12T10:12:21.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.055+0000 7ff00b7fe640 1 -- 172.21.15.78:0/2437537757 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0040baa30 con 0x7ff0140b1e20 2023-12-12T10:12:21.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.055+0000 7ff0188bb640 1 -- 172.21.15.78:0/2437537757 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff014159720 con 0x7ff0140b1e20 2023-12-12T10:12:21.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.055+0000 7ff0188bb640 1 -- 172.21.15.78:0/2437537757 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff01413be20 con 0x7ff0140b1e20 2023-12-12T10:12:21.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.055+0000 7ff00b7fe640 1 -- 172.21.15.78:0/2437537757 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff0040b6070 con 0x7ff0140b1e20 2023-12-12T10:12:21.063 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.059+0000 7ff00b7fe640 1 --2- 172.21.15.78:0/2437537757 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7feff4066470 0x7feff4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:21.063 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.059+0000 7ff00b7fe640 1 -- 172.21.15.78:0/2437537757 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff00411f840 con 0x7ff0140b1e20 2023-12-12T10:12:21.063 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.059+0000 7ff009d9b640 1 --2- 172.21.15.78:0/2437537757 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7feff4066470 0x7feff4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:21.063 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.059+0000 7ff009d9b640 1 --2- 172.21.15.78:0/2437537757 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7feff4066470 0x7feff4068930 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff0140cc260 tx=0x7feffc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:21.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.063+0000 7ff00b7fe640 1 -- 172.21.15.78:0/2437537757 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff0040ec930 con 0x7ff0140b1e20 2023-12-12T10:12:21.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.211+0000 7ff0188bb640 1 -- 172.21.15.78:0/2437537757 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff0140671f0 con 0x7ff0140b1e20 2023-12-12T10:12:21.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.211+0000 7ff00b7fe640 1 -- 172.21.15.78:0/2437537757 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff0040b40a0 con 0x7ff0140b1e20 2023-12-12T10:12:21.217 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2023-12-12T10:12:21.219 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.211+0000 7ff0188bb640 1 -- 172.21.15.78:0/2437537757 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7feff4066470 msgr2=0x7feff4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:21.219 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.215+0000 7ff0188bb640 1 --2- 172.21.15.78:0/2437537757 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7feff4066470 0x7feff4068930 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff0140cc260 tx=0x7feffc008040 comp rx=0 tx=0).stop 2023-12-12T10:12:21.219 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.215+0000 7ff0188bb640 1 -- 172.21.15.78:0/2437537757 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff0140b1e20 msgr2=0x7ff0141591e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:21.219 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.215+0000 7ff0188bb640 1 --2- 172.21.15.78:0/2437537757 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff0140b1e20 0x7ff0141591e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff0040b2040 tx=0x7ff00401b8f0 comp rx=0 tx=0).stop 2023-12-12T10:12:21.220 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.215+0000 7ff0188bb640 1 -- 172.21.15.78:0/2437537757 shutdown_connections 2023-12-12T10:12:21.220 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.215+0000 7ff0188bb640 1 --2- 172.21.15.78:0/2437537757 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7feff4066470 0x7feff4068930 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:21.220 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.215+0000 7ff0188bb640 1 --2- 172.21.15.78:0/2437537757 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff014143770 0x7ff01413d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:21.220 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.215+0000 7ff0188bb640 1 --2- 172.21.15.78:0/2437537757 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff0140b2280 0x7ff01413d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:21.220 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.215+0000 7ff0188bb640 1 --2- 172.21.15.78:0/2437537757 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff0140b1e20 0x7ff0141591e0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:21.220 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.215+0000 7ff0188bb640 1 -- 172.21.15.78:0/2437537757 >> 172.21.15.78:0/2437537757 conn(0x7ff01406a710 msgr2=0x7ff0140ad540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:21.220 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.215+0000 7ff0188bb640 1 -- 172.21.15.78:0/2437537757 shutdown_connections 2023-12-12T10:12:21.220 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.215+0000 7ff0188bb640 1 -- 172.21.15.78:0/2437537757 wait complete. 2023-12-12T10:12:21.238 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-12T10:12:21.377 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.371+0000 7f80811df640 1 Processor -- start 2023-12-12T10:12:21.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.371+0000 7f80811df640 1 -- start start 2023-12-12T10:12:21.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.375+0000 7f80811df640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f807c143770 0x7f807c0cdf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:21.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.375+0000 7f80811df640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f807c070a70 con 0x7f807c071610 2023-12-12T10:12:21.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.375+0000 7f80811df640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f807c070440 con 0x7f807c0b1e20 2023-12-12T10:12:21.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.375+0000 7f80811df640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f807c143b50 con 0x7f807c143770 2023-12-12T10:12:21.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.375+0000 7f807b59e640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f807c071610 0x7f807c15d910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:44258/0 (socket says 172.21.15.78:44258) 2023-12-12T10:12:21.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.375+0000 7f807b59e640 1 -- 172.21.15.78:0/2367949405 learned_addr learned my addr 172.21.15.78:0/2367949405 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-12-12T10:12:21.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.375+0000 7f807ad9d640 1 --2- 172.21.15.78:0/2367949405 >> v2:172.21.15.187:3300/0 conn(0x7f807c143770 0x7f807c0cdf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:21.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.375+0000 7f807a59c640 1 -- 172.21.15.78:0/2367949405 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3867580157 0 0) 0x7f807c070a70 con 0x7f807c071610 2023-12-12T10:12:21.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.375+0000 7f807a59c640 1 -- 172.21.15.78:0/2367949405 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8068003530 con 0x7f807c071610 2023-12-12T10:12:21.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.375+0000 7f807ad9d640 1 -- 172.21.15.78:0/2367949405 >> v1:172.21.15.187:6789/0 conn(0x7f807c0b1e20 legacy=0x7f807c070f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:21.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.375+0000 7f807ad9d640 1 -- 172.21.15.78:0/2367949405 >> v1:172.21.15.78:6789/0 conn(0x7f807c071610 legacy=0x7f807c15d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:21.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.375+0000 7f807ad9d640 1 -- 172.21.15.78:0/2367949405 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f807c0ce620 con 0x7f807c143770 2023-12-12T10:12:21.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.379+0000 7f807ad9d640 1 --2- 172.21.15.78:0/2367949405 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f807c143770 0x7f807c0cdf60 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f80640097c0 tx=0x7f806401c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1306bceef2a13f41 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:21.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.379+0000 7f807a59c640 1 -- 172.21.15.78:0/2367949405 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80640ab600 con 0x7f807c143770 2023-12-12T10:12:21.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.379+0000 7f807a59c640 1 -- 172.21.15.78:0/2367949405 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80640a7050 con 0x7f807c143770 2023-12-12T10:12:21.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.379+0000 7f807a59c640 1 -- 172.21.15.78:0/2367949405 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80640ab980 con 0x7f807c143770 2023-12-12T10:12:21.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.379+0000 7f80811df640 1 -- 172.21.15.78:0/2367949405 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f807c143770 msgr2=0x7f807c0cdf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:21.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.379+0000 7f80811df640 1 --2- 172.21.15.78:0/2367949405 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f807c143770 0x7f807c0cdf60 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f80640097c0 tx=0x7f806401c3f0 comp rx=0 tx=0).stop 2023-12-12T10:12:21.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.379+0000 7f80811df640 1 -- 172.21.15.78:0/2367949405 shutdown_connections 2023-12-12T10:12:21.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.379+0000 7f80811df640 1 --2- 172.21.15.78:0/2367949405 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f807c143770 0x7f807c0cdf60 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:21.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.379+0000 7f80811df640 1 -- 172.21.15.78:0/2367949405 >> 172.21.15.78:0/2367949405 conn(0x7f807c06a710 msgr2=0x7f807c06ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:21.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.379+0000 7f80811df640 1 -- 172.21.15.78:0/2367949405 shutdown_connections 2023-12-12T10:12:21.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.379+0000 7f80811df640 1 -- 172.21.15.78:0/2367949405 wait complete. 2023-12-12T10:12:21.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.379+0000 7f80811df640 1 Processor -- start 2023-12-12T10:12:21.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.379+0000 7f80811df640 1 -- start start 2023-12-12T10:12:21.387 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.383+0000 7f80811df640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f807c071610 0x7f807c0adba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:21.387 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.383+0000 7f80811df640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f807c0b1e20 0x7f807c158dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:21.387 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.383+0000 7f80811df640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f807c143770 0x7f807c0aa250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:21.387 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.383+0000 7f80811df640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f807c0ae0e0 con 0x7f807c071610 2023-12-12T10:12:21.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.383+0000 7f80811df640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f807c0ab2f0 con 0x7f807c0b1e20 2023-12-12T10:12:21.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.383+0000 7f80811df640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f807c0aad30 con 0x7f807c143770 2023-12-12T10:12:21.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.383+0000 7f807ad9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f807c071610 0x7f807c0adba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:21.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.383+0000 7f807ad9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f807c071610 0x7f807c0adba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47430/0 (socket says 172.21.15.78:47430) 2023-12-12T10:12:21.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.383+0000 7f807ad9d640 1 -- 172.21.15.78:0/180691293 learned_addr learned my addr 172.21.15.78:0/180691293 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:21.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.383+0000 7f807259c640 1 --2- 172.21.15.78:0/180691293 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f807c0b1e20 0x7f807c158dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:21.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.383+0000 7f807b59e640 1 --2- 172.21.15.78:0/180691293 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f807c143770 0x7f807c0aa250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:21.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.383+0000 7f807ad9d640 1 -- 172.21.15.78:0/180691293 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f807c143770 msgr2=0x7f807c0aa250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:21.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.383+0000 7f807ad9d640 1 --2- 172.21.15.78:0/180691293 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f807c143770 0x7f807c0aa250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:21.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.383+0000 7f807ad9d640 1 -- 172.21.15.78:0/180691293 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f807c0b1e20 msgr2=0x7f807c158dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:21.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.383+0000 7f807ad9d640 1 --2- 172.21.15.78:0/180691293 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f807c0b1e20 0x7f807c158dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:21.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.383+0000 7f807ad9d640 1 -- 172.21.15.78:0/180691293 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8064009420 con 0x7f807c071610 2023-12-12T10:12:21.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.383+0000 7f807ad9d640 1 --2- 172.21.15.78:0/180691293 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f807c071610 0x7f807c0adba0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f80640ae040 tx=0x7f806401ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:21.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.383+0000 7f8073fff640 1 -- 172.21.15.78:0/180691293 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80640b7650 con 0x7f807c071610 2023-12-12T10:12:21.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.383+0000 7f8073fff640 1 -- 172.21.15.78:0/180691293 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80640b77d0 con 0x7f807c071610 2023-12-12T10:12:21.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.383+0000 7f8073fff640 1 -- 172.21.15.78:0/180691293 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80640b7b80 con 0x7f807c071610 2023-12-12T10:12:21.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.383+0000 7f80811df640 1 -- 172.21.15.78:0/180691293 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f807c0ab010 con 0x7f807c071610 2023-12-12T10:12:21.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.383+0000 7f80811df640 1 -- 172.21.15.78:0/180691293 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f807c0ad680 con 0x7f807c071610 2023-12-12T10:12:21.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.383+0000 7f80811df640 1 -- 172.21.15.78:0/180691293 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f807c0671f0 con 0x7f807c071610 2023-12-12T10:12:21.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.383+0000 7f8073fff640 1 -- 172.21.15.78:0/180691293 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f80640b5400 con 0x7f807c071610 2023-12-12T10:12:21.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.387+0000 7f8073fff640 1 --2- 172.21.15.78:0/180691293 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f805c066470 0x7f805c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:21.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.387+0000 7f8073fff640 1 -- 172.21.15.78:0/180691293 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f806411ec70 con 0x7f807c071610 2023-12-12T10:12:21.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.387+0000 7f807259c640 1 --2- 172.21.15.78:0/180691293 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f805c066470 0x7f805c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:21.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.387+0000 7f807259c640 1 --2- 172.21.15.78:0/180691293 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f805c066470 0x7f805c068930 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f807c158a90 tx=0x7f806c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:21.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.391+0000 7f8073fff640 1 -- 172.21.15.78:0/180691293 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f80640ebd60 con 0x7f807c071610 2023-12-12T10:12:21.543 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.539+0000 7f80811df640 1 -- 172.21.15.78:0/180691293 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f807c0ad200 con 0x7f807c071610 2023-12-12T10:12:21.543 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.539+0000 7f8073fff640 1 -- 172.21.15.78:0/180691293 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f807c0ad200 con 0x7f807c071610 2023-12-12T10:12:21.544 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2023-12-12T10:12:21.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.539+0000 7f80811df640 1 -- 172.21.15.78:0/180691293 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f805c066470 msgr2=0x7f805c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:21.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.539+0000 7f80811df640 1 --2- 172.21.15.78:0/180691293 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f805c066470 0x7f805c068930 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f807c158a90 tx=0x7f806c009040 comp rx=0 tx=0).stop 2023-12-12T10:12:21.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.539+0000 7f80811df640 1 -- 172.21.15.78:0/180691293 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f807c071610 msgr2=0x7f807c0adba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:21.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.539+0000 7f80811df640 1 --2- 172.21.15.78:0/180691293 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f807c071610 0x7f807c0adba0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f80640ae040 tx=0x7f806401ac30 comp rx=0 tx=0).stop 2023-12-12T10:12:21.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.539+0000 7f80811df640 1 -- 172.21.15.78:0/180691293 shutdown_connections 2023-12-12T10:12:21.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.539+0000 7f80811df640 1 --2- 172.21.15.78:0/180691293 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f805c066470 0x7f805c068930 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:21.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.539+0000 7f80811df640 1 --2- 172.21.15.78:0/180691293 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f807c143770 0x7f807c0aa250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:21.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.539+0000 7f80811df640 1 --2- 172.21.15.78:0/180691293 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f807c0b1e20 0x7f807c158dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:21.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.539+0000 7f80811df640 1 --2- 172.21.15.78:0/180691293 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f807c071610 0x7f807c0adba0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:21.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.539+0000 7f80811df640 1 -- 172.21.15.78:0/180691293 >> 172.21.15.78:0/180691293 conn(0x7f807c06a710 msgr2=0x7f807c15c630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:21.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.539+0000 7f80811df640 1 -- 172.21.15.78:0/180691293 shutdown_connections 2023-12-12T10:12:21.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.539+0000 7f80811df640 1 -- 172.21.15.78:0/180691293 wait complete. 2023-12-12T10:12:21.564 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-12T10:12:21.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.699+0000 7f745e772640 1 Processor -- start 2023-12-12T10:12:21.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.699+0000 7f745e772640 1 -- start start 2023-12-12T10:12:21.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.699+0000 7f745e772640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f745815d080 0x7f745806ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:21.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.699+0000 7f745e772640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f74580cca80 0x7f74581611e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:21.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.699+0000 7f745e772640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f745806bf50 con 0x7f7458160da0 2023-12-12T10:12:21.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.699+0000 7f745e772640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f745806b580 con 0x7f74580cca80 2023-12-12T10:12:21.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.699+0000 7f745e772640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f745806af50 con 0x7f745815d080 2023-12-12T10:12:21.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.699+0000 7f7457fff640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f745815d080 0x7f745806ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:21.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.699+0000 7f745cd0f640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f74580cca80 0x7f74581611e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:21.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.699+0000 7f7457fff640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f745815d080 0x7f745806ba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.78:40320/0 (socket says 172.21.15.78:40320) 2023-12-12T10:12:21.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.699+0000 7f7457fff640 1 -- 172.21.15.78:0/2387841177 learned_addr learned my addr 172.21.15.78:0/2387841177 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:21.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.703+0000 7f7457fff640 1 -- 172.21.15.78:0/2387841177 >> v2:172.21.15.187:3300/0 conn(0x7f74580cca80 msgr2=0x7f74581611e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:21.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.703+0000 7f7457fff640 1 --2- 172.21.15.78:0/2387841177 >> v2:172.21.15.187:3300/0 conn(0x7f74580cca80 0x7f74581611e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:21.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.703+0000 7f7457fff640 1 -- 172.21.15.78:0/2387841177 >> v1:172.21.15.187:6789/0 conn(0x7f7458160da0 legacy=0x7f74580cc370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:21.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.703+0000 7f7457fff640 1 -- 172.21.15.78:0/2387841177 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f745806a900 con 0x7f745815d080 2023-12-12T10:12:21.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.703+0000 7f7457fff640 1 --2- 172.21.15.78:0/2387841177 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f745815d080 0x7f745806ba10 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f7448009870 tx=0x7f744801c540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2c983b62ca654303 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:21.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.703+0000 7f7456ffd640 1 -- 172.21.15.78:0/2387841177 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74480a7070 con 0x7f745815d080 2023-12-12T10:12:21.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.703+0000 7f7456ffd640 1 -- 172.21.15.78:0/2387841177 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74480ab430 con 0x7f745815d080 2023-12-12T10:12:21.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.703+0000 7f7456ffd640 1 -- 172.21.15.78:0/2387841177 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74480ab7c0 con 0x7f745815d080 2023-12-12T10:12:21.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.703+0000 7f745e772640 1 -- 172.21.15.78:0/2387841177 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f745815d080 msgr2=0x7f745806ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:21.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.703+0000 7f745e772640 1 --2- 172.21.15.78:0/2387841177 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f745815d080 0x7f745806ba10 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f7448009870 tx=0x7f744801c540 comp rx=0 tx=0).stop 2023-12-12T10:12:21.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.703+0000 7f745e772640 1 -- 172.21.15.78:0/2387841177 shutdown_connections 2023-12-12T10:12:21.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.703+0000 7f745e772640 1 --2- 172.21.15.78:0/2387841177 >> v2:172.21.15.187:3300/0 conn(0x7f74580cca80 0x7f74581611e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:21.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.703+0000 7f745e772640 1 --2- 172.21.15.78:0/2387841177 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f745815d080 0x7f745806ba10 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:21.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.707+0000 7f745e772640 1 -- 172.21.15.78:0/2387841177 >> 172.21.15.78:0/2387841177 conn(0x7f74580b1650 msgr2=0x7f74580b1a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:21.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.707+0000 7f745e772640 1 -- 172.21.15.78:0/2387841177 shutdown_connections 2023-12-12T10:12:21.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.707+0000 7f745e772640 1 -- 172.21.15.78:0/2387841177 wait complete. 2023-12-12T10:12:21.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.707+0000 7f745e772640 1 Processor -- start 2023-12-12T10:12:21.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.707+0000 7f745e772640 1 -- start start 2023-12-12T10:12:21.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.707+0000 7f745e772640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f74580cca80 0x7f745815e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:21.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.707+0000 7f745e772640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f745815d080 0x7f7458155f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:21.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.707+0000 7f745e772640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7458160da0 0x7f74581540e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:21.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.707+0000 7f745e772640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f745815e790 con 0x7f745815d080 2023-12-12T10:12:21.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.707+0000 7f745e772640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f745815ea70 con 0x7f74580cca80 2023-12-12T10:12:21.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.707+0000 7f745e772640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f745815ed50 con 0x7f7458160da0 2023-12-12T10:12:21.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.707+0000 7f74577fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f745815d080 0x7f7458155f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:21.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.707+0000 7f7457fff640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f74580cca80 0x7f745815e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:21.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.707+0000 7f74577fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f745815d080 0x7f7458155f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47444/0 (socket says 172.21.15.78:47444) 2023-12-12T10:12:21.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.707+0000 7f74577fe640 1 -- 172.21.15.78:0/1354710854 learned_addr learned my addr 172.21.15.78:0/1354710854 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:21.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.707+0000 7f745cd0f640 1 --2- 172.21.15.78:0/1354710854 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7458160da0 0x7f74581540e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:21.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.707+0000 7f74577fe640 1 -- 172.21.15.78:0/1354710854 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7458160da0 msgr2=0x7f74581540e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:21.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.707+0000 7f74577fe640 1 --2- 172.21.15.78:0/1354710854 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7458160da0 0x7f74581540e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:21.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.707+0000 7f74577fe640 1 -- 172.21.15.78:0/1354710854 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f74580cca80 msgr2=0x7f745815e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:21.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.707+0000 7f74577fe640 1 --2- 172.21.15.78:0/1354710854 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f74580cca80 0x7f745815e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:21.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.707+0000 7f74577fe640 1 -- 172.21.15.78:0/1354710854 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74480094d0 con 0x7f745815d080 2023-12-12T10:12:21.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.707+0000 7f74577fe640 1 --2- 172.21.15.78:0/1354710854 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f745815d080 0x7f7458155f40 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f744c00c3c0 tx=0x7f744c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:21.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.711+0000 7f7454ff9640 1 -- 172.21.15.78:0/1354710854 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f744c0052d0 con 0x7f745815d080 2023-12-12T10:12:21.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.711+0000 7f7454ff9640 1 -- 172.21.15.78:0/1354710854 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f744c005430 con 0x7f745815d080 2023-12-12T10:12:21.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.711+0000 7f7454ff9640 1 -- 172.21.15.78:0/1354710854 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f744c003840 con 0x7f745815d080 2023-12-12T10:12:21.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.711+0000 7f745e772640 1 -- 172.21.15.78:0/1354710854 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f745815f030 con 0x7f745815d080 2023-12-12T10:12:21.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.711+0000 7f745e772640 1 -- 172.21.15.78:0/1354710854 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7458154620 con 0x7f745815d080 2023-12-12T10:12:21.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.711+0000 7f745e772640 1 -- 172.21.15.78:0/1354710854 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f745815f550 con 0x7f745815d080 2023-12-12T10:12:21.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.711+0000 7f7454ff9640 1 -- 172.21.15.78:0/1354710854 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f744c0039a0 con 0x7f745815d080 2023-12-12T10:12:21.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.711+0000 7f7454ff9640 1 --2- 172.21.15.78:0/1354710854 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f7444066470 0x7f7444068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:21.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.711+0000 7f7454ff9640 1 -- 172.21.15.78:0/1354710854 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f744c083510 con 0x7f745815d080 2023-12-12T10:12:21.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.711+0000 7f7457fff640 1 --2- 172.21.15.78:0/1354710854 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f7444066470 0x7f7444068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:21.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.711+0000 7f7457fff640 1 --2- 172.21.15.78:0/1354710854 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f7444066470 0x7f7444068930 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f74480af000 tx=0x7f7448008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:21.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.715+0000 7f7454ff9640 1 -- 172.21.15.78:0/1354710854 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f745815f550 con 0x7f745815d080 2023-12-12T10:12:21.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.863+0000 7f745e772640 1 -- 172.21.15.78:0/1354710854 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f745806bf50 con 0x7f745815d080 2023-12-12T10:12:21.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.863+0000 7f7454ff9640 1 -- 172.21.15.78:0/1354710854 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f745806bf50 con 0x7f745815d080 2023-12-12T10:12:21.870 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2023-12-12T10:12:21.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.867+0000 7f745e772640 1 -- 172.21.15.78:0/1354710854 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f7444066470 msgr2=0x7f7444068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:21.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.867+0000 7f745e772640 1 --2- 172.21.15.78:0/1354710854 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f7444066470 0x7f7444068930 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f74480af000 tx=0x7f7448008040 comp rx=0 tx=0).stop 2023-12-12T10:12:21.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.867+0000 7f745e772640 1 -- 172.21.15.78:0/1354710854 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f745815d080 msgr2=0x7f7458155f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:21.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.867+0000 7f745e772640 1 --2- 172.21.15.78:0/1354710854 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f745815d080 0x7f7458155f40 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f744c00c3c0 tx=0x7f744c00c880 comp rx=0 tx=0).stop 2023-12-12T10:12:21.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.867+0000 7f745e772640 1 -- 172.21.15.78:0/1354710854 shutdown_connections 2023-12-12T10:12:21.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.867+0000 7f745e772640 1 --2- 172.21.15.78:0/1354710854 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f7444066470 0x7f7444068930 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:21.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.867+0000 7f745e772640 1 --2- 172.21.15.78:0/1354710854 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7458160da0 0x7f74581540e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:21.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.867+0000 7f745e772640 1 --2- 172.21.15.78:0/1354710854 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f745815d080 0x7f7458155f40 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:21.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.867+0000 7f745e772640 1 --2- 172.21.15.78:0/1354710854 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f74580cca80 0x7f745815e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:21.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.867+0000 7f745e772640 1 -- 172.21.15.78:0/1354710854 >> 172.21.15.78:0/1354710854 conn(0x7f74580b1650 msgr2=0x7f74580cd390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:21.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.867+0000 7f745e772640 1 -- 172.21.15.78:0/1354710854 shutdown_connections 2023-12-12T10:12:21.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:21.867+0000 7f745e772640 1 -- 172.21.15.78:0/1354710854 wait complete. 2023-12-12T10:12:21.891 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-12T10:12:22.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.035+0000 7fc718838640 1 Processor -- start 2023-12-12T10:12:22.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.035+0000 7fc718838640 1 -- start start 2023-12-12T10:12:22.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.035+0000 7fc718838640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fc71415cf40 0x7fc7140ce3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:22.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.035+0000 7fc718838640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc7140ce930 0x7fc7140d13b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:22.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.035+0000 7fc718838640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc7140d0410 0x7fc7140d18f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:22.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.035+0000 7fc718838640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7140cfff0 con 0x7fc7140ce930 2023-12-12T10:12:22.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.035+0000 7fc718838640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7140cf400 con 0x7fc71415cf40 2023-12-12T10:12:22.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.035+0000 7fc718838640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7140cf650 con 0x7fc7140d0410 2023-12-12T10:12:22.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.035+0000 7fc712ffd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc7140ce930 0x7fc7140d13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:22.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.035+0000 7fc712ffd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc7140ce930 0x7fc7140d13b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47452/0 (socket says 172.21.15.78:47452) 2023-12-12T10:12:22.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.035+0000 7fc712ffd640 1 -- 172.21.15.78:0/234533903 learned_addr learned my addr 172.21.15.78:0/234533903 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:22.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.035+0000 7fc7137fe640 1 --2- 172.21.15.78:0/234533903 >> v2:172.21.15.187:3300/0 conn(0x7fc71415cf40 0x7fc7140ce3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:22.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.035+0000 7fc713fff640 1 --2- 172.21.15.78:0/234533903 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc7140d0410 0x7fc7140d18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:22.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.035+0000 7fc712ffd640 1 -- 172.21.15.78:0/234533903 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc7140d0410 msgr2=0x7fc7140d18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:22.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.035+0000 7fc712ffd640 1 --2- 172.21.15.78:0/234533903 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc7140d0410 0x7fc7140d18f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:22.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.035+0000 7fc712ffd640 1 -- 172.21.15.78:0/234533903 >> v2:172.21.15.187:3300/0 conn(0x7fc71415cf40 msgr2=0x7fc7140ce3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:22.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.035+0000 7fc712ffd640 1 --2- 172.21.15.78:0/234533903 >> v2:172.21.15.187:3300/0 conn(0x7fc71415cf40 0x7fc7140ce3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:22.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.035+0000 7fc712ffd640 1 -- 172.21.15.78:0/234533903 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7140cf930 con 0x7fc7140ce930 2023-12-12T10:12:22.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.035+0000 7fc713fff640 1 --2- 172.21.15.78:0/234533903 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc7140d0410 0x7fc7140d18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T10:12:22.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.035+0000 7fc7137fe640 1 --2- 172.21.15.78:0/234533903 >> v2:172.21.15.187:3300/0 conn(0x7fc71415cf40 0x7fc7140ce3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T10:12:22.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.039+0000 7fc712ffd640 1 --2- 172.21.15.78:0/234533903 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc7140ce930 0x7fc7140d13b0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc708009870 tx=0x7fc70801c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7d0045d945fe543 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:22.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.039+0000 7fc7127fc640 1 -- 172.21.15.78:0/234533903 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7080ab620 con 0x7fc7140ce930 2023-12-12T10:12:22.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.039+0000 7fc7127fc640 1 -- 172.21.15.78:0/234533903 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7080ab780 con 0x7fc7140ce930 2023-12-12T10:12:22.043 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.039+0000 7fc7127fc640 1 -- 172.21.15.78:0/234533903 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7080abb10 con 0x7fc7140ce930 2023-12-12T10:12:22.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.039+0000 7fc718838640 1 -- 172.21.15.78:0/234533903 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc7140ce930 msgr2=0x7fc7140d13b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:22.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.039+0000 7fc718838640 1 --2- 172.21.15.78:0/234533903 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc7140ce930 0x7fc7140d13b0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc708009870 tx=0x7fc70801c440 comp rx=0 tx=0).stop 2023-12-12T10:12:22.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.039+0000 7fc718838640 1 -- 172.21.15.78:0/234533903 shutdown_connections 2023-12-12T10:12:22.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.039+0000 7fc718838640 1 --2- 172.21.15.78:0/234533903 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc7140d0410 0x7fc7140d18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:22.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.039+0000 7fc718838640 1 --2- 172.21.15.78:0/234533903 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc7140ce930 0x7fc7140d13b0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:22.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.039+0000 7fc718838640 1 --2- 172.21.15.78:0/234533903 >> v2:172.21.15.187:3300/0 conn(0x7fc71415cf40 0x7fc7140ce3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:22.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.039+0000 7fc718838640 1 -- 172.21.15.78:0/234533903 >> 172.21.15.78:0/234533903 conn(0x7fc7140d2dd0 msgr2=0x7fc7140d31e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:22.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.039+0000 7fc718838640 1 -- 172.21.15.78:0/234533903 shutdown_connections 2023-12-12T10:12:22.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.039+0000 7fc718838640 1 -- 172.21.15.78:0/234533903 wait complete. 2023-12-12T10:12:22.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.039+0000 7fc718838640 1 Processor -- start 2023-12-12T10:12:22.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.039+0000 7fc718838640 1 -- start start 2023-12-12T10:12:22.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.043+0000 7fc718838640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc7140ce930 0x7fc7140b4c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:22.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.043+0000 7fc718838640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc7140d0410 0x7fc7140cc860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:22.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.043+0000 7fc718838640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc71415cf40 0x7fc7140b2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:22.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.043+0000 7fc718838640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7140b3110 con 0x7fc71415cf40 2023-12-12T10:12:22.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.043+0000 7fc718838640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7140b3bf0 con 0x7fc7140d0410 2023-12-12T10:12:22.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.043+0000 7fc718838640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7140b3ed0 con 0x7fc7140ce930 2023-12-12T10:12:22.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.043+0000 7fc713fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc71415cf40 0x7fc7140b2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:22.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.043+0000 7fc713fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc71415cf40 0x7fc7140b2bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47458/0 (socket says 172.21.15.78:47458) 2023-12-12T10:12:22.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.043+0000 7fc713fff640 1 -- 172.21.15.78:0/1687704252 learned_addr learned my addr 172.21.15.78:0/1687704252 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:22.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.043+0000 7fc7137fe640 1 --2- 172.21.15.78:0/1687704252 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc7140ce930 0x7fc7140b4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:22.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.043+0000 7fc712ffd640 1 --2- 172.21.15.78:0/1687704252 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc7140d0410 0x7fc7140cc860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:22.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.043+0000 7fc713fff640 1 -- 172.21.15.78:0/1687704252 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc7140ce930 msgr2=0x7fc7140b4c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:22.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.043+0000 7fc713fff640 1 --2- 172.21.15.78:0/1687704252 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc7140ce930 0x7fc7140b4c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:22.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.043+0000 7fc713fff640 1 -- 172.21.15.78:0/1687704252 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc7140d0410 msgr2=0x7fc7140cc860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:22.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.043+0000 7fc713fff640 1 --2- 172.21.15.78:0/1687704252 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc7140d0410 0x7fc7140cc860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:22.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.043+0000 7fc713fff640 1 -- 172.21.15.78:0/1687704252 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7080094d0 con 0x7fc71415cf40 2023-12-12T10:12:22.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.043+0000 7fc713fff640 1 --2- 172.21.15.78:0/1687704252 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc71415cf40 0x7fc7140b2bd0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc70c00cd10 tx=0x7fc70c00a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:22.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.043+0000 7fc6fbfff640 1 -- 172.21.15.78:0/1687704252 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc70c00f680 con 0x7fc71415cf40 2023-12-12T10:12:22.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.043+0000 7fc6fbfff640 1 -- 172.21.15.78:0/1687704252 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc70c00f800 con 0x7fc71415cf40 2023-12-12T10:12:22.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.043+0000 7fc718838640 1 -- 172.21.15.78:0/1687704252 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7140b41b0 con 0x7fc71415cf40 2023-12-12T10:12:22.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.043+0000 7fc6fbfff640 1 -- 172.21.15.78:0/1687704252 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc70c00fbb0 con 0x7fc71415cf40 2023-12-12T10:12:22.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.043+0000 7fc718838640 1 -- 172.21.15.78:0/1687704252 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7140b4770 con 0x7fc71415cf40 2023-12-12T10:12:22.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.043+0000 7fc718838640 1 -- 172.21.15.78:0/1687704252 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7140745a0 con 0x7fc71415cf40 2023-12-12T10:12:22.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.043+0000 7fc6fbfff640 1 -- 172.21.15.78:0/1687704252 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc70c00b040 con 0x7fc71415cf40 2023-12-12T10:12:22.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.047+0000 7fc6fbfff640 1 --2- 172.21.15.78:0/1687704252 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fc700066470 0x7fc700068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:22.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.047+0000 7fc6fbfff640 1 -- 172.21.15.78:0/1687704252 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc70c084a80 con 0x7fc71415cf40 2023-12-12T10:12:22.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.047+0000 7fc7137fe640 1 --2- 172.21.15.78:0/1687704252 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fc700066470 0x7fc700068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:22.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.047+0000 7fc7137fe640 1 --2- 172.21.15.78:0/1687704252 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fc700066470 0x7fc700068930 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc704006fd0 tx=0x7fc704008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:22.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.051+0000 7fc6fbfff640 1 -- 172.21.15.78:0/1687704252 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc70c051c20 con 0x7fc71415cf40 2023-12-12T10:12:22.208 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.203+0000 7fc718838640 1 -- 172.21.15.78:0/1687704252 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fc7140b4960 con 0x7fc71415cf40 2023-12-12T10:12:22.208 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.203+0000 7fc6fbfff640 1 -- 172.21.15.78:0/1687704252 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7fc70c01d020 con 0x7fc71415cf40 2023-12-12T10:12:22.209 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2023-12-12T10:12:22.210 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.207+0000 7fc718838640 1 -- 172.21.15.78:0/1687704252 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fc700066470 msgr2=0x7fc700068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:22.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.207+0000 7fc718838640 1 --2- 172.21.15.78:0/1687704252 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fc700066470 0x7fc700068930 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc704006fd0 tx=0x7fc704008040 comp rx=0 tx=0).stop 2023-12-12T10:12:22.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.207+0000 7fc718838640 1 -- 172.21.15.78:0/1687704252 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc71415cf40 msgr2=0x7fc7140b2bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:22.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.207+0000 7fc718838640 1 --2- 172.21.15.78:0/1687704252 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc71415cf40 0x7fc7140b2bd0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc70c00cd10 tx=0x7fc70c00a650 comp rx=0 tx=0).stop 2023-12-12T10:12:22.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.207+0000 7fc718838640 1 -- 172.21.15.78:0/1687704252 shutdown_connections 2023-12-12T10:12:22.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.207+0000 7fc718838640 1 --2- 172.21.15.78:0/1687704252 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fc700066470 0x7fc700068930 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:22.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.207+0000 7fc718838640 1 --2- 172.21.15.78:0/1687704252 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc71415cf40 0x7fc7140b2bd0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:22.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.207+0000 7fc718838640 1 --2- 172.21.15.78:0/1687704252 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc7140d0410 0x7fc7140cc860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:22.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.207+0000 7fc718838640 1 --2- 172.21.15.78:0/1687704252 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc7140ce930 0x7fc7140b4c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:22.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.207+0000 7fc718838640 1 -- 172.21.15.78:0/1687704252 >> 172.21.15.78:0/1687704252 conn(0x7fc7140d2dd0 msgr2=0x7fc7140b1280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:22.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.207+0000 7fc718838640 1 -- 172.21.15.78:0/1687704252 shutdown_connections 2023-12-12T10:12:22.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.207+0000 7fc718838640 1 -- 172.21.15.78:0/1687704252 wait complete. 2023-12-12T10:12:22.231 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-12T10:12:22.368 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.363+0000 7fa6306bb640 1 Processor -- start 2023-12-12T10:12:22.368 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.363+0000 7fa6306bb640 1 -- start start 2023-12-12T10:12:22.370 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.363+0000 7fa6306bb640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa62815d620 0x7fa6280b4260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:22.370 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.363+0000 7fa6306bb640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa62815e070 con 0x7fa62815dab0 2023-12-12T10:12:22.370 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.363+0000 7fa6306bb640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa62815e350 con 0x7fa62815aaf0 2023-12-12T10:12:22.370 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.363+0000 7fa6306bb640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa628160db0 con 0x7fa62815d620 2023-12-12T10:12:22.370 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.363+0000 7fa62ec58640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fa62815dab0 0x7fa6280b2ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:44262/0 (socket says 172.21.15.78:44262) 2023-12-12T10:12:22.370 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.363+0000 7fa62ec58640 1 -- 172.21.15.78:0/1172266505 learned_addr learned my addr 172.21.15.78:0/1172266505 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-12-12T10:12:22.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.367+0000 7fa62dc56640 1 --2- 172.21.15.78:0/1172266505 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa62815d620 0x7fa6280b4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:22.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.367+0000 7fa62d455640 1 -- 172.21.15.78:0/1172266505 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4036092266 0 0) 0x7fa62815e070 con 0x7fa62815dab0 2023-12-12T10:12:22.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.367+0000 7fa62d455640 1 -- 172.21.15.78:0/1172266505 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa614003530 con 0x7fa62815dab0 2023-12-12T10:12:22.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.367+0000 7fa62d455640 1 -- 172.21.15.78:0/1172266505 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 87636773 0 0) 0x7fa614003530 con 0x7fa62815dab0 2023-12-12T10:12:22.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.367+0000 7fa62d455640 1 -- 172.21.15.78:0/1172266505 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa62815d620 msgr2=0x7fa6280b4260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:22.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.367+0000 7fa62d455640 1 --2- 172.21.15.78:0/1172266505 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa62815d620 0x7fa6280b4260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:22.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.367+0000 7fa62d455640 1 -- 172.21.15.78:0/1172266505 >> v1:172.21.15.187:6789/0 conn(0x7fa62815aaf0 legacy=0x7fa6281615b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:22.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.367+0000 7fa62d455640 1 -- 172.21.15.78:0/1172266505 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa628161090 con 0x7fa62815dab0 2023-12-12T10:12:22.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.367+0000 7fa62d455640 1 -- 172.21.15.78:0/1172266505 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 465499599 0 0) 0x7fa620001a00 con 0x7fa62815dab0 2023-12-12T10:12:22.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.367+0000 7fa62dc56640 1 --2- 172.21.15.78:0/1172266505 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa62815d620 0x7fa6280b4260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-12T10:12:22.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.367+0000 7fa62d455640 1 -- 172.21.15.78:0/1172266505 >> v1:172.21.15.78:6789/0 conn(0x7fa62815dab0 legacy=0x7fa6280b2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:22.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.367+0000 7fa62d455640 1 --2- 172.21.15.78:0/1172266505 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa62815d620 0x7fa6140039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:22.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.367+0000 7fa62d455640 1 --2- 172.21.15.78:0/1172266505 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa614003ef0 0x7fa6140047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:22.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.367+0000 7fa62d455640 1 --2- 172.21.15.78:0/1172266505 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa614004d10 0x7fa614005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:22.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.367+0000 7fa62d455640 1 -- 172.21.15.78:0/1172266505 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa628160db0 con 0x7fa614003ef0 2023-12-12T10:12:22.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.367+0000 7fa62d455640 1 -- 172.21.15.78:0/1172266505 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa61400b9f0 con 0x7fa614004d10 2023-12-12T10:12:22.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.367+0000 7fa62d455640 1 -- 172.21.15.78:0/1172266505 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa61400bbb0 con 0x7fa62815d620 2023-12-12T10:12:22.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.367+0000 7fa62dc56640 1 --2- 172.21.15.78:0/1172266505 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa614003ef0 0x7fa6140047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:22.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.367+0000 7fa62e457640 1 --2- 172.21.15.78:0/1172266505 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa62815d620 0x7fa6140039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:22.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.367+0000 7fa62ec58640 1 --2- 172.21.15.78:0/1172266505 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa614004d10 0x7fa614005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:22.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.367+0000 7fa62dc56640 1 -- 172.21.15.78:0/1172266505 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa62815d620 msgr2=0x7fa6140039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:22.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.367+0000 7fa62dc56640 1 --2- 172.21.15.78:0/1172266505 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa62815d620 0x7fa6140039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:22.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.367+0000 7fa62dc56640 1 -- 172.21.15.78:0/1172266505 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa614004d10 msgr2=0x7fa614005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:22.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.367+0000 7fa62dc56640 1 --2- 172.21.15.78:0/1172266505 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa614004d10 0x7fa614005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:22.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.367+0000 7fa62dc56640 1 -- 172.21.15.78:0/1172266505 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa618009420 con 0x7fa614003ef0 2023-12-12T10:12:22.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.371+0000 7fa62dc56640 1 --2- 172.21.15.78:0/1172266505 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa614003ef0 0x7fa6140047d0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa618009c70 tx=0x7fa61801cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6abfc8367ee578ff server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:22.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.371+0000 7fa62d455640 1 -- 172.21.15.78:0/1172266505 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa618004030 con 0x7fa614003ef0 2023-12-12T10:12:22.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.371+0000 7fa62d455640 1 -- 172.21.15.78:0/1172266505 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa618004190 con 0x7fa614003ef0 2023-12-12T10:12:22.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.371+0000 7fa62d455640 1 -- 172.21.15.78:0/1172266505 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6180a5730 con 0x7fa614003ef0 2023-12-12T10:12:22.376 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.371+0000 7fa6306bb640 1 -- 172.21.15.78:0/1172266505 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa614003ef0 msgr2=0x7fa6140047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:22.376 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.371+0000 7fa6306bb640 1 --2- 172.21.15.78:0/1172266505 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa614003ef0 0x7fa6140047d0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa618009c70 tx=0x7fa61801cb30 comp rx=0 tx=0).stop 2023-12-12T10:12:22.376 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.371+0000 7fa62ec58640 1 -- 172.21.15.78:0/1172266505 reap_dead start 2023-12-12T10:12:22.376 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.371+0000 7fa6306bb640 1 -- 172.21.15.78:0/1172266505 shutdown_connections 2023-12-12T10:12:22.376 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.371+0000 7fa6306bb640 1 -- 172.21.15.78:0/1172266505 >> 172.21.15.78:0/1172266505 conn(0x7fa6280b1ba0 msgr2=0x7fa6280b1fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:22.376 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.371+0000 7fa6306bb640 1 -- 172.21.15.78:0/1172266505 shutdown_connections 2023-12-12T10:12:22.376 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.371+0000 7fa6306bb640 1 -- 172.21.15.78:0/1172266505 wait complete. 2023-12-12T10:12:22.377 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.371+0000 7fa6306bb640 1 Processor -- start 2023-12-12T10:12:22.377 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.371+0000 7fa6306bb640 1 -- start start 2023-12-12T10:12:22.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.371+0000 7fa6306bb640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa614003ef0 0x7fa6280c78e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:22.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.371+0000 7fa6306bb640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa6281f3100 0x7fa6280c7e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:22.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.375+0000 7fa6306bb640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa6280c52e0 0x7fa6280c5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:22.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.375+0000 7fa6306bb640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6280c8360 con 0x7fa6281f3100 2023-12-12T10:12:22.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.375+0000 7fa6306bb640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6280c8860 con 0x7fa6280c52e0 2023-12-12T10:12:22.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.375+0000 7fa6306bb640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6280c8580 con 0x7fa614003ef0 2023-12-12T10:12:22.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.375+0000 7fa62dc56640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa6281f3100 0x7fa6280c7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:22.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.375+0000 7fa62dc56640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa6281f3100 0x7fa6280c7e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47484/0 (socket says 172.21.15.78:47484) 2023-12-12T10:12:22.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.375+0000 7fa62dc56640 1 -- 172.21.15.78:0/3501463548 learned_addr learned my addr 172.21.15.78:0/3501463548 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:22.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.375+0000 7fa62ec58640 1 --2- 172.21.15.78:0/3501463548 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa6280c52e0 0x7fa6280c5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:22.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.375+0000 7fa62e457640 1 --2- 172.21.15.78:0/3501463548 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa614003ef0 0x7fa6280c78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:22.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.375+0000 7fa62dc56640 1 -- 172.21.15.78:0/3501463548 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa614003ef0 msgr2=0x7fa6280c78e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:22.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.375+0000 7fa62dc56640 1 --2- 172.21.15.78:0/3501463548 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa614003ef0 0x7fa6280c78e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:22.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.375+0000 7fa62dc56640 1 -- 172.21.15.78:0/3501463548 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa6280c52e0 msgr2=0x7fa6280c5790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:22.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.375+0000 7fa62dc56640 1 --2- 172.21.15.78:0/3501463548 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa6280c52e0 0x7fa6280c5790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:22.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.375+0000 7fa62dc56640 1 -- 172.21.15.78:0/3501463548 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa62815e730 con 0x7fa6281f3100 2023-12-12T10:12:22.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.375+0000 7fa62dc56640 1 --2- 172.21.15.78:0/3501463548 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa6281f3100 0x7fa6280c7e20 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa6180af040 tx=0x7fa614005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:22.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.375+0000 7fa61effd640 1 -- 172.21.15.78:0/3501463548 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6180a5930 con 0x7fa6281f3100 2023-12-12T10:12:22.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.375+0000 7fa61effd640 1 -- 172.21.15.78:0/3501463548 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6180a5a90 con 0x7fa6281f3100 2023-12-12T10:12:22.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.375+0000 7fa6306bb640 1 -- 172.21.15.78:0/3501463548 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa62815ea10 con 0x7fa6281f3100 2023-12-12T10:12:22.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.375+0000 7fa61effd640 1 -- 172.21.15.78:0/3501463548 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6180a5e40 con 0x7fa6281f3100 2023-12-12T10:12:22.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.375+0000 7fa6306bb640 1 -- 172.21.15.78:0/3501463548 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6281448a0 con 0x7fa6281f3100 2023-12-12T10:12:22.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.375+0000 7fa6306bb640 1 -- 172.21.15.78:0/3501463548 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6280671f0 con 0x7fa6281f3100 2023-12-12T10:12:22.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.375+0000 7fa61effd640 1 -- 172.21.15.78:0/3501463548 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa618003620 con 0x7fa6281f3100 2023-12-12T10:12:22.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.379+0000 7fa61effd640 1 --2- 172.21.15.78:0/3501463548 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fa60c066470 0x7fa60c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:22.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.379+0000 7fa61effd640 1 -- 172.21.15.78:0/3501463548 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa61811dfd0 con 0x7fa6281f3100 2023-12-12T10:12:22.382 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.379+0000 7fa62e457640 1 --2- 172.21.15.78:0/3501463548 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fa60c066470 0x7fa60c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:22.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.379+0000 7fa62e457640 1 --2- 172.21.15.78:0/3501463548 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fa60c066470 0x7fa60c068930 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa6240124b0 tx=0x7fa62400a9b0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:22.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.383+0000 7fa61effd640 1 -- 172.21.15.78:0/3501463548 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa6180eb2a0 con 0x7fa6281f3100 2023-12-12T10:12:22.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.543+0000 7fa6306bb640 1 -- 172.21.15.78:0/3501463548 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fa62815e590 con 0x7fa6281f3100 2023-12-12T10:12:22.548 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.543+0000 7fa61effd640 1 -- 172.21.15.78:0/3501463548 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7fa62815e590 con 0x7fa6281f3100 2023-12-12T10:12:22.548 INFO:teuthology.orchestra.run.smithi078.stderr:listed 0 entries 2023-12-12T10:12:22.549 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.543+0000 7fa6306bb640 1 -- 172.21.15.78:0/3501463548 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fa60c066470 msgr2=0x7fa60c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:22.549 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.543+0000 7fa6306bb640 1 --2- 172.21.15.78:0/3501463548 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fa60c066470 0x7fa60c068930 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa6240124b0 tx=0x7fa62400a9b0 comp rx=0 tx=0).stop 2023-12-12T10:12:22.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.543+0000 7fa6306bb640 1 -- 172.21.15.78:0/3501463548 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa6281f3100 msgr2=0x7fa6280c7e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:22.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.543+0000 7fa6306bb640 1 --2- 172.21.15.78:0/3501463548 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa6281f3100 0x7fa6280c7e20 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa6180af040 tx=0x7fa614005800 comp rx=0 tx=0).stop 2023-12-12T10:12:22.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.543+0000 7fa6306bb640 1 -- 172.21.15.78:0/3501463548 shutdown_connections 2023-12-12T10:12:22.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.543+0000 7fa6306bb640 1 --2- 172.21.15.78:0/3501463548 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fa60c066470 0x7fa60c068930 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:22.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.543+0000 7fa6306bb640 1 --2- 172.21.15.78:0/3501463548 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa6280c52e0 0x7fa6280c5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:22.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.543+0000 7fa6306bb640 1 --2- 172.21.15.78:0/3501463548 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa6281f3100 0x7fa6280c7e20 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:22.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.543+0000 7fa6306bb640 1 --2- 172.21.15.78:0/3501463548 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa614003ef0 0x7fa6280c78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:22.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.543+0000 7fa6306bb640 1 -- 172.21.15.78:0/3501463548 >> 172.21.15.78:0/3501463548 conn(0x7fa6280b1ba0 msgr2=0x7fa6280cf140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:22.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.543+0000 7fa6306bb640 1 -- 172.21.15.78:0/3501463548 shutdown_connections 2023-12-12T10:12:22.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.543+0000 7fa6306bb640 1 -- 172.21.15.78:0/3501463548 wait complete. 2023-12-12T10:12:22.568 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-12-12T10:12:22.569 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-12T10:12:22.578 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T10:12:22.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.751+0000 7f0561701640 1 Processor -- start 2023-12-12T10:12:22.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.751+0000 7f0561701640 1 -- start start 2023-12-12T10:12:22.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.751+0000 7f0561701640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f055c15d1d0 0x7f055c15d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:22.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.751+0000 7f0561701640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f055c0cfe10 0x7f055c0d3960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:22.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.751+0000 7f0561701640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f055c0afbf0 0x7f055c0d1300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:22.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.751+0000 7f0561701640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f055c0ce260 con 0x7f055c15d1d0 2023-12-12T10:12:22.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.751+0000 7f0561701640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f055c0d02a0 con 0x7f055c0afbf0 2023-12-12T10:12:22.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.751+0000 7f0561701640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f055c0cdc10 con 0x7f055c0cfe10 2023-12-12T10:12:22.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.751+0000 7f055affd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f055c15d1d0 0x7f055c15d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:22.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.751+0000 7f055affd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f055c15d1d0 0x7f055c15d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47498/0 (socket says 172.21.15.78:47498) 2023-12-12T10:12:22.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.751+0000 7f055affd640 1 -- 172.21.15.78:0/632477747 learned_addr learned my addr 172.21.15.78:0/632477747 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:22.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.751+0000 7f055b7fe640 1 --2- 172.21.15.78:0/632477747 >> v2:172.21.15.187:3300/0 conn(0x7f055c0afbf0 0x7f055c0d1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:22.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.751+0000 7f055a7fc640 1 --2- 172.21.15.78:0/632477747 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f055c0cfe10 0x7f055c0d3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:22.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.751+0000 7f055affd640 1 -- 172.21.15.78:0/632477747 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f055c0cfe10 msgr2=0x7f055c0d3960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:22.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.751+0000 7f055affd640 1 --2- 172.21.15.78:0/632477747 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f055c0cfe10 0x7f055c0d3960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:22.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.751+0000 7f055affd640 1 -- 172.21.15.78:0/632477747 >> v2:172.21.15.187:3300/0 conn(0x7f055c0afbf0 msgr2=0x7f055c0d1300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:22.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.751+0000 7f055affd640 1 --2- 172.21.15.78:0/632477747 >> v2:172.21.15.187:3300/0 conn(0x7f055c0afbf0 0x7f055c0d1300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:22.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.751+0000 7f055affd640 1 -- 172.21.15.78:0/632477747 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f055c0cdef0 con 0x7f055c15d1d0 2023-12-12T10:12:22.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.751+0000 7f055b7fe640 1 --2- 172.21.15.78:0/632477747 >> v2:172.21.15.187:3300/0 conn(0x7f055c0afbf0 0x7f055c0d1300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T10:12:22.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.755+0000 7f055affd640 1 --2- 172.21.15.78:0/632477747 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f055c15d1d0 0x7f055c15d5b0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f055c08d630 tx=0x7f054c01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a96cd0cc284f79f2 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:22.760 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.755+0000 7f0559ffb640 1 -- 172.21.15.78:0/632477747 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f054c0ab600 con 0x7f055c15d1d0 2023-12-12T10:12:22.760 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.755+0000 7f0559ffb640 1 -- 172.21.15.78:0/632477747 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f054c0a7050 con 0x7f055c15d1d0 2023-12-12T10:12:22.761 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.755+0000 7f0559ffb640 1 -- 172.21.15.78:0/632477747 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f054c0ab980 con 0x7f055c15d1d0 2023-12-12T10:12:22.761 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.755+0000 7f0561701640 1 -- 172.21.15.78:0/632477747 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f055c15d1d0 msgr2=0x7f055c15d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:22.761 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.755+0000 7f0561701640 1 --2- 172.21.15.78:0/632477747 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f055c15d1d0 0x7f055c15d5b0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f055c08d630 tx=0x7f054c01c470 comp rx=0 tx=0).stop 2023-12-12T10:12:22.761 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.755+0000 7f0561701640 1 -- 172.21.15.78:0/632477747 shutdown_connections 2023-12-12T10:12:22.761 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.755+0000 7f0561701640 1 --2- 172.21.15.78:0/632477747 >> v2:172.21.15.187:3300/0 conn(0x7f055c0afbf0 0x7f055c0d1300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:22.761 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.755+0000 7f0561701640 1 --2- 172.21.15.78:0/632477747 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f055c0cfe10 0x7f055c0d3960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:22.761 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.755+0000 7f0561701640 1 --2- 172.21.15.78:0/632477747 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f055c15d1d0 0x7f055c15d5b0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:22.761 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.755+0000 7f0561701640 1 -- 172.21.15.78:0/632477747 >> 172.21.15.78:0/632477747 conn(0x7f055c0d2e40 msgr2=0x7f055c0d3250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:22.761 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.755+0000 7f0561701640 1 -- 172.21.15.78:0/632477747 shutdown_connections 2023-12-12T10:12:22.761 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.755+0000 7f0561701640 1 -- 172.21.15.78:0/632477747 wait complete. 2023-12-12T10:12:22.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.759+0000 7f0561701640 1 Processor -- start 2023-12-12T10:12:22.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.759+0000 7f0561701640 1 -- start start 2023-12-12T10:12:22.767 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.759+0000 7f0561701640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f055c0afbf0 0x7f055c0ccc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:22.767 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.759+0000 7f0561701640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f055c15d1d0 0x7f055c0b7c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:22.767 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.759+0000 7f0561701640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f055c1564f0 0x7f055c15e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:22.767 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.759+0000 7f0561701640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f055c154fb0 con 0x7f055c1564f0 2023-12-12T10:12:22.767 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.759+0000 7f0561701640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f055c155200 con 0x7f055c15d1d0 2023-12-12T10:12:22.767 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.759+0000 7f0561701640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f055c1554e0 con 0x7f055c0afbf0 2023-12-12T10:12:22.767 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.759+0000 7f055b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f055c1564f0 0x7f055c15e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:22.767 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.759+0000 7f055b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f055c1564f0 0x7f055c15e9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47506/0 (socket says 172.21.15.78:47506) 2023-12-12T10:12:22.767 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.759+0000 7f055b7fe640 1 -- 172.21.15.78:0/530579847 learned_addr learned my addr 172.21.15.78:0/530579847 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:22.767 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.759+0000 7f055a7fc640 1 --2- 172.21.15.78:0/530579847 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f055c15d1d0 0x7f055c0b7c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:22.767 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.759+0000 7f055affd640 1 --2- 172.21.15.78:0/530579847 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f055c0afbf0 0x7f055c0ccc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:22.767 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.759+0000 7f055b7fe640 1 -- 172.21.15.78:0/530579847 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f055c0afbf0 msgr2=0x7f055c0ccc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:22.768 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.759+0000 7f055b7fe640 1 --2- 172.21.15.78:0/530579847 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f055c0afbf0 0x7f055c0ccc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:22.768 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.759+0000 7f055b7fe640 1 -- 172.21.15.78:0/530579847 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f055c15d1d0 msgr2=0x7f055c0b7c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:22.768 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.759+0000 7f055b7fe640 1 --2- 172.21.15.78:0/530579847 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f055c15d1d0 0x7f055c0b7c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:22.768 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.759+0000 7f055b7fe640 1 -- 172.21.15.78:0/530579847 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f054c0094d0 con 0x7f055c1564f0 2023-12-12T10:12:22.768 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.759+0000 7f055b7fe640 1 --2- 172.21.15.78:0/530579847 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f055c1564f0 0x7f055c15e9e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f0554007e10 tx=0x7f055400d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:22.768 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.759+0000 7f05437fe640 1 -- 172.21.15.78:0/530579847 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0554003ba0 con 0x7f055c1564f0 2023-12-12T10:12:22.768 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.759+0000 7f05437fe640 1 -- 172.21.15.78:0/530579847 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f055400f040 con 0x7f055c1564f0 2023-12-12T10:12:22.768 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.759+0000 7f05437fe640 1 -- 172.21.15.78:0/530579847 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f055400de80 con 0x7f055c1564f0 2023-12-12T10:12:22.768 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.759+0000 7f0561701640 1 -- 172.21.15.78:0/530579847 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f055c1557c0 con 0x7f055c1564f0 2023-12-12T10:12:22.768 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.759+0000 7f0561701640 1 -- 172.21.15.78:0/530579847 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f055c0cb690 con 0x7f055c1564f0 2023-12-12T10:12:22.768 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.759+0000 7f0561701640 1 -- 172.21.15.78:0/530579847 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f055c068610 con 0x7f055c1564f0 2023-12-12T10:12:22.769 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.763+0000 7f05437fe640 1 -- 172.21.15.78:0/530579847 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f0554004030 con 0x7f055c1564f0 2023-12-12T10:12:22.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.763+0000 7f05437fe640 1 --2- 172.21.15.78:0/530579847 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f0548066470 0x7f0548068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:22.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.763+0000 7f05437fe640 1 -- 172.21.15.78:0/530579847 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0554084420 con 0x7f055c1564f0 2023-12-12T10:12:22.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.763+0000 7f055affd640 1 --2- 172.21.15.78:0/530579847 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f0548066470 0x7f0548068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:22.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.763+0000 7f055affd640 1 --2- 172.21.15.78:0/530579847 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f0548066470 0x7f0548068930 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f054c0ad000 tx=0x7f054c0a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:22.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.767+0000 7f05437fe640 1 -- 172.21.15.78:0/530579847 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f05540515c0 con 0x7f055c1564f0 2023-12-12T10:12:22.924 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.919+0000 7f0561701640 1 -- 172.21.15.78:0/530579847 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f055c072990 con 0x7f055c1564f0 2023-12-12T10:12:22.926 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.919+0000 7f05437fe640 1 -- 172.21.15.78:0/530579847 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18310 (secure 0 0 0) 0x7f0554054be0 con 0x7f055c1564f0 2023-12-12T10:12:22.927 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:12:22.927 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":24,"fsid":"fc81937c-bd26-483c-952b-d1324fcb0c9e","created":"2023-12-12T10:11:44.020214+0000","modified":"2023-12-12T10:12:14.355146+0000","last_up_change":"2023-12-12T10:11:56.278318+0000","last_in_change":"2023-12-12T10:11:46.553610+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T10:11:57.053584+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-12T10:12:07.454450+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-12T10:12:08.182909+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-12T10:12:11.977952+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"22dfdedf-5f6c-4b20-9f6c-30517a1db70a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6809","nonce":3345683600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6811","nonce":3345683600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6815","nonce":3345683600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6813","nonce":3345683600}]},"public_addr":"172.21.15.78:6809/3345683600","cluster_addr":"172.21.15.78:6811/3345683600","heartbeat_back_addr":"172.21.15.78:6815/3345683600","heartbeat_front_addr":"172.21.15.78:6813/3345683600","state":["exists","up"]},{"osd":1,"uuid":"be34a7f3-a69a-462e-9ddf-5e537448dba2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6801","nonce":962652768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6803","nonce":962652768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6807","nonce":962652768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6805","nonce":962652768}]},"public_addr":"172.21.15.78:6801/962652768","cluster_addr":"172.21.15.78:6803/962652768","heartbeat_back_addr":"172.21.15.78:6807/962652768","heartbeat_front_addr":"172.21.15.78:6805/962652768","state":["exists","up"]},{"osd":2,"uuid":"55b381de-5f56-4b14-80f7-e6e41e084a13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6818","nonce":2910206054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6822","nonce":2910206054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6829","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6831","nonce":2910206054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6826","nonce":2910206054}]},"public_addr":"172.21.15.78:6818/2910206054","cluster_addr":"172.21.15.78:6822/2910206054","heartbeat_back_addr":"172.21.15.78:6831/2910206054","heartbeat_front_addr":"172.21.15.78:6826/2910206054","state":["exists","up"]},{"osd":3,"uuid":"d7682de1-25cb-4cec-869f-8851c28b0e6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6819","nonce":3750796703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6821","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6823","nonce":3750796703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6830","nonce":3750796703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6825","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6827","nonce":3750796703}]},"public_addr":"172.21.15.78:6819/3750796703","cluster_addr":"172.21.15.78:6823/3750796703","heartbeat_back_addr":"172.21.15.78:6830/3750796703","heartbeat_front_addr":"172.21.15.78:6827/3750796703","state":["exists","up"]},{"osd":4,"uuid":"8279815a-d6c7-4199-871e-d28971b9dc07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6809","nonce":2944277204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6811","nonce":2944277204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6815","nonce":2944277204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6813","nonce":2944277204}]},"public_addr":"172.21.15.187:6809/2944277204","cluster_addr":"172.21.15.187:6811/2944277204","heartbeat_back_addr":"172.21.15.187:6815/2944277204","heartbeat_front_addr":"172.21.15.187:6813/2944277204","state":["exists","up"]},{"osd":5,"uuid":"0a714c65-f8ce-4340-968f-11a799677ef3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6801","nonce":185858620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6803","nonce":185858620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6807","nonce":185858620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6805","nonce":185858620}]},"public_addr":"172.21.15.187:6801/185858620","cluster_addr":"172.21.15.187:6803/185858620","heartbeat_back_addr":"172.21.15.187:6807/185858620","heartbeat_front_addr":"172.21.15.187:6805/185858620","state":["exists","up"]},{"osd":6,"uuid":"d0bba9ab-f7ee-449e-8999-1c0cf7e6d53c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6817","nonce":4213392126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6819","nonce":4213392126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6824","nonce":4213392126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6821","nonce":4213392126}]},"public_addr":"172.21.15.187:6817/4213392126","cluster_addr":"172.21.15.187:6819/4213392126","heartbeat_back_addr":"172.21.15.187:6824/4213392126","heartbeat_front_addr":"172.21.15.187:6821/4213392126","state":["exists","up"]},{"osd":7,"uuid":"efe5e0d9-2f87-4889-a27a-e2a95a632302","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6823","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6825","nonce":85774004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6827","nonce":85774004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6831","nonce":85774004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6829","nonce":85774004}]},"public_addr":"172.21.15.187:6825/85774004","cluster_addr":"172.21.15.187:6827/85774004","heartbeat_back_addr":"172.21.15.187:6831/85774004","heartbeat_front_addr":"172.21.15.187:6829/85774004","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.214447+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.448899+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.293107+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.564184+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.175026+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.097717+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.261141+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.287681+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T10:12:22.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.923+0000 7f0561701640 1 -- 172.21.15.78:0/530579847 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f0548066470 msgr2=0x7f0548068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:22.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.923+0000 7f0561701640 1 --2- 172.21.15.78:0/530579847 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f0548066470 0x7f0548068930 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f054c0ad000 tx=0x7f054c0a6000 comp rx=0 tx=0).stop 2023-12-12T10:12:22.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.923+0000 7f0561701640 1 -- 172.21.15.78:0/530579847 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f055c1564f0 msgr2=0x7f055c15e9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:22.929 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.923+0000 7f0561701640 1 --2- 172.21.15.78:0/530579847 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f055c1564f0 0x7f055c15e9e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f0554007e10 tx=0x7f055400d4a0 comp rx=0 tx=0).stop 2023-12-12T10:12:22.929 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.923+0000 7f0561701640 1 -- 172.21.15.78:0/530579847 shutdown_connections 2023-12-12T10:12:22.929 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.923+0000 7f0561701640 1 --2- 172.21.15.78:0/530579847 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f0548066470 0x7f0548068930 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:22.929 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.923+0000 7f0561701640 1 --2- 172.21.15.78:0/530579847 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f055c1564f0 0x7f055c15e9e0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:22.929 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.923+0000 7f0561701640 1 --2- 172.21.15.78:0/530579847 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f055c15d1d0 0x7f055c0b7c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:22.929 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.923+0000 7f0561701640 1 --2- 172.21.15.78:0/530579847 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f055c0afbf0 0x7f055c0ccc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:22.929 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.923+0000 7f0561701640 1 -- 172.21.15.78:0/530579847 >> 172.21.15.78:0/530579847 conn(0x7f055c0d2e40 msgr2=0x7f055c0b3de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:22.929 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.923+0000 7f0561701640 1 -- 172.21.15.78:0/530579847 shutdown_connections 2023-12-12T10:12:22.929 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:22.923+0000 7f0561701640 1 -- 172.21.15.78:0/530579847 wait complete. 2023-12-12T10:12:22.948 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-12T10:11:57.053584+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-12T10:12:07.454450+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-12T10:12:08.182909+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-12T10:12:11.977952+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-12T10:12:22.948 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-12T10:12:23.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.083+0000 7f908ba05640 1 Processor -- start 2023-12-12T10:12:23.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.083+0000 7f908ba05640 1 -- start start 2023-12-12T10:12:23.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.087+0000 7f908ba05640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f90840b6e10 0x7f90840cffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:23.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.087+0000 7f908ba05640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f90840b8c60 0x7f90840cdbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:23.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.087+0000 7f908ba05640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90840d1c80 con 0x7f90840cfbe0 2023-12-12T10:12:23.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.087+0000 7f908ba05640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90840d2110 con 0x7f90840b6e10 2023-12-12T10:12:23.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.087+0000 7f908ba05640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90840d0930 con 0x7f90840b8c60 2023-12-12T10:12:23.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.087+0000 7f90897a1640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f90840cfbe0 0x7f90840b8550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:44270/0 (socket says 172.21.15.78:44270) 2023-12-12T10:12:23.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.087+0000 7f90897a1640 1 -- 172.21.15.78:0/1961705632 learned_addr learned my addr 172.21.15.78:0/1961705632 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-12-12T10:12:23.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.087+0000 7f9088fa0640 1 --2- 172.21.15.78:0/1961705632 >> v2:172.21.15.78:3300/0 conn(0x7f90840b6e10 0x7f90840cffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:23.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.087+0000 7f9089fa2640 1 --2- 172.21.15.78:0/1961705632 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f90840b8c60 0x7f90840cdbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:23.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.087+0000 7f907bfff640 1 -- 172.21.15.78:0/1961705632 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2859795981 0 0) 0x7f90840d1c80 con 0x7f90840cfbe0 2023-12-12T10:12:23.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.087+0000 7f907bfff640 1 -- 172.21.15.78:0/1961705632 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9070003530 con 0x7f90840cfbe0 2023-12-12T10:12:23.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.087+0000 7f9088fa0640 1 -- 172.21.15.78:0/1961705632 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f90840b8c60 msgr2=0x7f90840cdbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:23.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.087+0000 7f9088fa0640 1 --2- 172.21.15.78:0/1961705632 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f90840b8c60 0x7f90840cdbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:23.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.087+0000 7f9088fa0640 1 -- 172.21.15.78:0/1961705632 >> v1:172.21.15.78:6789/0 conn(0x7f90840cfbe0 legacy=0x7f90840b8550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:23.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.087+0000 7f9088fa0640 1 -- 172.21.15.78:0/1961705632 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90840d0650 con 0x7f90840b6e10 2023-12-12T10:12:23.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.091+0000 7f9088fa0640 1 --2- 172.21.15.78:0/1961705632 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f90840b6e10 0x7f90840cffc0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f90740097c0 tx=0x7f907401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68c125509deeae77 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:23.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.091+0000 7f907bfff640 1 -- 172.21.15.78:0/1961705632 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90740ab600 con 0x7f90840b6e10 2023-12-12T10:12:23.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.091+0000 7f907bfff640 1 -- 172.21.15.78:0/1961705632 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90740a7050 con 0x7f90840b6e10 2023-12-12T10:12:23.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.091+0000 7f907bfff640 1 -- 172.21.15.78:0/1961705632 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90740ab980 con 0x7f90840b6e10 2023-12-12T10:12:23.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.091+0000 7f908ba05640 1 -- 172.21.15.78:0/1961705632 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f90840b6e10 msgr2=0x7f90840cffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:23.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.091+0000 7f908ba05640 1 --2- 172.21.15.78:0/1961705632 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f90840b6e10 0x7f90840cffc0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f90740097c0 tx=0x7f907401c450 comp rx=0 tx=0).stop 2023-12-12T10:12:23.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.091+0000 7f908ba05640 1 -- 172.21.15.78:0/1961705632 shutdown_connections 2023-12-12T10:12:23.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.091+0000 7f908ba05640 1 --2- 172.21.15.78:0/1961705632 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f90840b8c60 0x7f90840cdbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:23.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.091+0000 7f908ba05640 1 --2- 172.21.15.78:0/1961705632 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f90840b6e10 0x7f90840cffc0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:23.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.091+0000 7f908ba05640 1 -- 172.21.15.78:0/1961705632 >> 172.21.15.78:0/1961705632 conn(0x7f90840d2fb0 msgr2=0x7f90840d33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:23.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.091+0000 7f908ba05640 1 -- 172.21.15.78:0/1961705632 shutdown_connections 2023-12-12T10:12:23.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.091+0000 7f908ba05640 1 -- 172.21.15.78:0/1961705632 wait complete. 2023-12-12T10:12:23.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.091+0000 7f908ba05640 1 Processor -- start 2023-12-12T10:12:23.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.091+0000 7f908ba05640 1 -- start start 2023-12-12T10:12:23.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.095+0000 7f908ba05640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f90840b6e10 0x7f9084155bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:23.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.095+0000 7f908ba05640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f90840b8c60 0x7f90840cb280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:23.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.095+0000 7f908ba05640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f90840cfbe0 0x7f908415fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:23.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.095+0000 7f908ba05640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f908415ee70 con 0x7f90840cfbe0 2023-12-12T10:12:23.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.095+0000 7f908ba05640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9084156110 con 0x7f90840b6e10 2023-12-12T10:12:23.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.095+0000 7f908ba05640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90840cb7c0 con 0x7f90840b8c60 2023-12-12T10:12:23.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.095+0000 7f9089fa2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f90840cfbe0 0x7f908415fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:23.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.095+0000 7f9089fa2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f90840cfbe0 0x7f908415fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47514/0 (socket says 172.21.15.78:47514) 2023-12-12T10:12:23.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.095+0000 7f9089fa2640 1 -- 172.21.15.78:0/1734120414 learned_addr learned my addr 172.21.15.78:0/1734120414 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:23.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.095+0000 7f9089fa2640 1 -- 172.21.15.78:0/1734120414 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f90840b8c60 msgr2=0x7f90840cb280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:23.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.095+0000 7f9089fa2640 1 --2- 172.21.15.78:0/1734120414 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f90840b8c60 0x7f90840cb280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:23.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.095+0000 7f9089fa2640 1 -- 172.21.15.78:0/1734120414 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f90840b6e10 msgr2=0x7f9084155bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:23.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.095+0000 7f9089fa2640 1 --2- 172.21.15.78:0/1734120414 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f90840b6e10 0x7f9084155bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:23.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.095+0000 7f9089fa2640 1 -- 172.21.15.78:0/1734120414 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9074009420 con 0x7f90840cfbe0 2023-12-12T10:12:23.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.095+0000 7f9089fa2640 1 --2- 172.21.15.78:0/1734120414 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f90840cfbe0 0x7f908415fd50 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f907c00efc0 tx=0x7f907c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:23.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.095+0000 7f9079ffb640 1 -- 172.21.15.78:0/1734120414 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f907c014480 con 0x7f90840cfbe0 2023-12-12T10:12:23.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.095+0000 7f9079ffb640 1 -- 172.21.15.78:0/1734120414 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f907c00f040 con 0x7f90840cfbe0 2023-12-12T10:12:23.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.095+0000 7f9079ffb640 1 -- 172.21.15.78:0/1734120414 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f907c014820 con 0x7f90840cfbe0 2023-12-12T10:12:23.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.095+0000 7f908ba05640 1 -- 172.21.15.78:0/1734120414 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9084156580 con 0x7f90840cfbe0 2023-12-12T10:12:23.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.095+0000 7f908ba05640 1 -- 172.21.15.78:0/1734120414 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f908415f270 con 0x7f90840cfbe0 2023-12-12T10:12:23.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.095+0000 7f908ba05640 1 -- 172.21.15.78:0/1734120414 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9084074610 con 0x7f90840cfbe0 2023-12-12T10:12:23.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.095+0000 7f9079ffb640 1 -- 172.21.15.78:0/1734120414 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f907c014980 con 0x7f90840cfbe0 2023-12-12T10:12:23.103 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.099+0000 7f9079ffb640 1 --2- 172.21.15.78:0/1734120414 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f90680664a0 0x7f9068068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:23.103 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.099+0000 7f9079ffb640 1 -- 172.21.15.78:0/1734120414 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f907c084c20 con 0x7f90840cfbe0 2023-12-12T10:12:23.103 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.099+0000 7f90897a1640 1 --2- 172.21.15.78:0/1734120414 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f90680664a0 0x7f9068068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:23.103 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.099+0000 7f90897a1640 1 --2- 172.21.15.78:0/1734120414 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f90680664a0 0x7f9068068960 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9080007fd0 tx=0x7f9080007940 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:23.106 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.103+0000 7f9079ffb640 1 -- 172.21.15.78:0/1734120414 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f907c051e40 con 0x7f90840cfbe0 2023-12-12T10:12:23.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.251+0000 7f908ba05640 1 -- 172.21.15.78:0/1734120414 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f908415efb0 con 0x7f90840cfbe0 2023-12-12T10:12:23.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.251+0000 7f9079ffb640 1 -- 172.21.15.78:0/1734120414 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f907c018020 con 0x7f90840cfbe0 2023-12-12T10:12:23.258 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2023-12-12T10:12:23.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.255+0000 7f908ba05640 1 -- 172.21.15.78:0/1734120414 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f90680664a0 msgr2=0x7f9068068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:23.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.255+0000 7f908ba05640 1 --2- 172.21.15.78:0/1734120414 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f90680664a0 0x7f9068068960 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9080007fd0 tx=0x7f9080007940 comp rx=0 tx=0).stop 2023-12-12T10:12:23.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.255+0000 7f908ba05640 1 -- 172.21.15.78:0/1734120414 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f90840cfbe0 msgr2=0x7f908415fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:23.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.255+0000 7f908ba05640 1 --2- 172.21.15.78:0/1734120414 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f90840cfbe0 0x7f908415fd50 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f907c00efc0 tx=0x7f907c00c490 comp rx=0 tx=0).stop 2023-12-12T10:12:23.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.255+0000 7f908ba05640 1 -- 172.21.15.78:0/1734120414 shutdown_connections 2023-12-12T10:12:23.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.255+0000 7f908ba05640 1 --2- 172.21.15.78:0/1734120414 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f90680664a0 0x7f9068068960 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:23.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.255+0000 7f908ba05640 1 --2- 172.21.15.78:0/1734120414 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f90840cfbe0 0x7f908415fd50 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:23.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.255+0000 7f908ba05640 1 --2- 172.21.15.78:0/1734120414 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f90840b8c60 0x7f90840cb280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:23.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.255+0000 7f908ba05640 1 --2- 172.21.15.78:0/1734120414 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f90840b6e10 0x7f9084155bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:23.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.255+0000 7f908ba05640 1 -- 172.21.15.78:0/1734120414 >> 172.21.15.78:0/1734120414 conn(0x7f90840d2fb0 msgr2=0x7f908406c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:23.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.255+0000 7f908ba05640 1 -- 172.21.15.78:0/1734120414 shutdown_connections 2023-12-12T10:12:23.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.255+0000 7f908ba05640 1 -- 172.21.15.78:0/1734120414 wait complete. 2023-12-12T10:12:23.279 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-12T10:12:23.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.415+0000 7f7b66a68640 1 Processor -- start 2023-12-12T10:12:23.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.415+0000 7f7b66a68640 1 -- start start 2023-12-12T10:12:23.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.415+0000 7f7b66a68640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7b60143770 0x7f7b600cdf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:23.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.415+0000 7f7b66a68640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f7b60071610 0x7f7b6015d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:23.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.415+0000 7f7b66a68640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b60070a70 con 0x7f7b600b1e20 2023-12-12T10:12:23.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.415+0000 7f7b66a68640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b60070440 con 0x7f7b60071610 2023-12-12T10:12:23.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.415+0000 7f7b66a68640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b60143b50 con 0x7f7b60143770 2023-12-12T10:12:23.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.415+0000 7f7b65005640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f7b60071610 0x7f7b6015d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:23.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.415+0000 7f7b65005640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f7b60071610 0x7f7b6015d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47520/0 (socket says 172.21.15.78:47520) 2023-12-12T10:12:23.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.415+0000 7f7b65005640 1 -- 172.21.15.78:0/3896605940 learned_addr learned my addr 172.21.15.78:0/3896605940 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:23.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.415+0000 7f7b64804640 1 --2- 172.21.15.78:0/3896605940 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7b60143770 0x7f7b600cdf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:23.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.415+0000 7f7b65005640 1 -- 172.21.15.78:0/3896605940 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7b60143770 msgr2=0x7f7b600cdf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:23.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.415+0000 7f7b65005640 1 --2- 172.21.15.78:0/3896605940 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7b60143770 0x7f7b600cdf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:23.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.415+0000 7f7b65005640 1 -- 172.21.15.78:0/3896605940 >> v1:172.21.15.187:6789/0 conn(0x7f7b600b1e20 legacy=0x7f7b60070f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:23.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.415+0000 7f7b65005640 1 -- 172.21.15.78:0/3896605940 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b600ce620 con 0x7f7b60071610 2023-12-12T10:12:23.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.415+0000 7f7b64804640 1 --2- 172.21.15.78:0/3896605940 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7b60143770 0x7f7b600cdf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T10:12:23.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.419+0000 7f7b65005640 1 --2- 172.21.15.78:0/3896605940 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7b60071610 0x7f7b6015d910 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f7b58009e50 tx=0x7f7b5801c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3b5156adc515ba server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:23.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.419+0000 7f7b5f7fe640 1 -- 172.21.15.78:0/3896605940 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b580a5750 con 0x7f7b60071610 2023-12-12T10:12:23.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.419+0000 7f7b5f7fe640 1 -- 172.21.15.78:0/3896605940 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b580a58b0 con 0x7f7b60071610 2023-12-12T10:12:23.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.419+0000 7f7b5f7fe640 1 -- 172.21.15.78:0/3896605940 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b580a5c40 con 0x7f7b60071610 2023-12-12T10:12:23.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.419+0000 7f7b66a68640 1 -- 172.21.15.78:0/3896605940 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7b60071610 msgr2=0x7f7b6015d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:23.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.419+0000 7f7b66a68640 1 --2- 172.21.15.78:0/3896605940 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7b60071610 0x7f7b6015d910 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f7b58009e50 tx=0x7f7b5801c980 comp rx=0 tx=0).stop 2023-12-12T10:12:23.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.419+0000 7f7b66a68640 1 -- 172.21.15.78:0/3896605940 shutdown_connections 2023-12-12T10:12:23.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.419+0000 7f7b66a68640 1 --2- 172.21.15.78:0/3896605940 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7b60071610 0x7f7b6015d910 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:23.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.419+0000 7f7b66a68640 1 --2- 172.21.15.78:0/3896605940 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7b60143770 0x7f7b600cdf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:23.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.419+0000 7f7b66a68640 1 -- 172.21.15.78:0/3896605940 >> 172.21.15.78:0/3896605940 conn(0x7f7b6006a710 msgr2=0x7f7b6006ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:23.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.419+0000 7f7b66a68640 1 -- 172.21.15.78:0/3896605940 shutdown_connections 2023-12-12T10:12:23.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.419+0000 7f7b66a68640 1 -- 172.21.15.78:0/3896605940 wait complete. 2023-12-12T10:12:23.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.423+0000 7f7b66a68640 1 Processor -- start 2023-12-12T10:12:23.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.423+0000 7f7b66a68640 1 -- start start 2023-12-12T10:12:23.428 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.423+0000 7f7b66a68640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7b60071610 0x7f7b601f5d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:23.428 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.423+0000 7f7b66a68640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7b600b1e20 0x7f7b6013b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:23.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.423+0000 7f7b66a68640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7b60143770 0x7f7b601f1ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:23.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.423+0000 7f7b66a68640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b601f52e0 con 0x7f7b60071610 2023-12-12T10:12:23.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.423+0000 7f7b66a68640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b601f58a0 con 0x7f7b60143770 2023-12-12T10:12:23.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.423+0000 7f7b66a68640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b601f6270 con 0x7f7b600b1e20 2023-12-12T10:12:23.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.423+0000 7f7b64804640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7b60071610 0x7f7b601f5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:23.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.423+0000 7f7b64804640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7b60071610 0x7f7b601f5d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47524/0 (socket says 172.21.15.78:47524) 2023-12-12T10:12:23.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.423+0000 7f7b64804640 1 -- 172.21.15.78:0/2750320351 learned_addr learned my addr 172.21.15.78:0/2750320351 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:23.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.423+0000 7f7b65005640 1 --2- 172.21.15.78:0/2750320351 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7b60143770 0x7f7b601f1ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:23.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.423+0000 7f7b5ffff640 1 --2- 172.21.15.78:0/2750320351 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7b600b1e20 0x7f7b6013b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:23.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.423+0000 7f7b64804640 1 -- 172.21.15.78:0/2750320351 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7b600b1e20 msgr2=0x7f7b6013b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:23.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.423+0000 7f7b64804640 1 --2- 172.21.15.78:0/2750320351 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7b600b1e20 0x7f7b6013b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:23.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.423+0000 7f7b64804640 1 -- 172.21.15.78:0/2750320351 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7b60143770 msgr2=0x7f7b601f1ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:23.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.423+0000 7f7b64804640 1 --2- 172.21.15.78:0/2750320351 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7b60143770 0x7f7b601f1ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:23.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.423+0000 7f7b64804640 1 -- 172.21.15.78:0/2750320351 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b58009b30 con 0x7f7b60071610 2023-12-12T10:12:23.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.423+0000 7f7b64804640 1 --2- 172.21.15.78:0/2750320351 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7b60071610 0x7f7b601f5d30 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f7b5400d830 tx=0x7f7b5400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:23.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.423+0000 7f7b5d7fa640 1 -- 172.21.15.78:0/2750320351 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b5400b6c0 con 0x7f7b60071610 2023-12-12T10:12:23.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.423+0000 7f7b5d7fa640 1 -- 172.21.15.78:0/2750320351 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b5400b820 con 0x7f7b60071610 2023-12-12T10:12:23.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.423+0000 7f7b66a68640 1 -- 172.21.15.78:0/2750320351 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b6013b650 con 0x7f7b60071610 2023-12-12T10:12:23.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.423+0000 7f7b5d7fa640 1 -- 172.21.15.78:0/2750320351 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b5400bbd0 con 0x7f7b60071610 2023-12-12T10:12:23.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.423+0000 7f7b66a68640 1 -- 172.21.15.78:0/2750320351 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b601f2b40 con 0x7f7b60071610 2023-12-12T10:12:23.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.423+0000 7f7b66a68640 1 -- 172.21.15.78:0/2750320351 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b600671f0 con 0x7f7b60071610 2023-12-12T10:12:23.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.427+0000 7f7b5d7fa640 1 -- 172.21.15.78:0/2750320351 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7b5401e460 con 0x7f7b60071610 2023-12-12T10:12:23.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.427+0000 7f7b5d7fa640 1 --2- 172.21.15.78:0/2750320351 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f7b44066470 0x7f7b44068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:23.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.427+0000 7f7b5d7fa640 1 -- 172.21.15.78:0/2750320351 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7b540848a0 con 0x7f7b60071610 2023-12-12T10:12:23.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.427+0000 7f7b5ffff640 1 --2- 172.21.15.78:0/2750320351 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f7b44066470 0x7f7b44068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:23.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.427+0000 7f7b5ffff640 1 --2- 172.21.15.78:0/2750320351 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f7b44066470 0x7f7b44068930 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7b600ae4a0 tx=0x7f7b4c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:23.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.431+0000 7f7b5d7fa640 1 -- 172.21.15.78:0/2750320351 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7b54051990 con 0x7f7b60071610 2023-12-12T10:12:23.585 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.579+0000 7f7b66a68640 1 -- 172.21.15.78:0/2750320351 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7b60067530 con 0x7f7b60071610 2023-12-12T10:12:23.585 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.579+0000 7f7b5d7fa640 1 -- 172.21.15.78:0/2750320351 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7b54082e60 con 0x7f7b60071610 2023-12-12T10:12:23.585 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2023-12-12T10:12:23.587 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.583+0000 7f7b66a68640 1 -- 172.21.15.78:0/2750320351 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f7b44066470 msgr2=0x7f7b44068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:23.587 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.583+0000 7f7b66a68640 1 --2- 172.21.15.78:0/2750320351 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f7b44066470 0x7f7b44068930 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7b600ae4a0 tx=0x7f7b4c009040 comp rx=0 tx=0).stop 2023-12-12T10:12:23.587 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.583+0000 7f7b66a68640 1 -- 172.21.15.78:0/2750320351 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7b60071610 msgr2=0x7f7b601f5d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:23.587 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.583+0000 7f7b66a68640 1 --2- 172.21.15.78:0/2750320351 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7b60071610 0x7f7b601f5d30 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f7b5400d830 tx=0x7f7b5400dcf0 comp rx=0 tx=0).stop 2023-12-12T10:12:23.587 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.583+0000 7f7b66a68640 1 -- 172.21.15.78:0/2750320351 shutdown_connections 2023-12-12T10:12:23.587 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.583+0000 7f7b66a68640 1 --2- 172.21.15.78:0/2750320351 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f7b44066470 0x7f7b44068930 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:23.587 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.583+0000 7f7b66a68640 1 --2- 172.21.15.78:0/2750320351 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7b60143770 0x7f7b601f1ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:23.588 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.583+0000 7f7b66a68640 1 --2- 172.21.15.78:0/2750320351 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7b600b1e20 0x7f7b6013b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:23.588 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.583+0000 7f7b66a68640 1 --2- 172.21.15.78:0/2750320351 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7b60071610 0x7f7b601f5d30 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:23.588 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.583+0000 7f7b66a68640 1 -- 172.21.15.78:0/2750320351 >> 172.21.15.78:0/2750320351 conn(0x7f7b6006a710 msgr2=0x7f7b6015b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:23.588 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.583+0000 7f7b66a68640 1 -- 172.21.15.78:0/2750320351 shutdown_connections 2023-12-12T10:12:23.588 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.583+0000 7f7b66a68640 1 -- 172.21.15.78:0/2750320351 wait complete. 2023-12-12T10:12:23.606 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-12T10:12:23.745 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.739+0000 7f3a237c1640 1 Processor -- start 2023-12-12T10:12:23.745 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.739+0000 7f3a237c1640 1 -- start start 2023-12-12T10:12:23.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.739+0000 7f3a237c1640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f3a1c15aec0 0x7f3a1c15e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:23.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.739+0000 7f3a237c1640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3a1c06afb0 0x7f3a1c0cc410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:23.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.739+0000 7f3a237c1640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f3a1c06b460 0x7f3a1c0cc950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:23.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.739+0000 7f3a237c1640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a1c15d8a0 con 0x7f3a1c06b460 2023-12-12T10:12:23.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.739+0000 7f3a237c1640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a1c15daf0 con 0x7f3a1c15aec0 2023-12-12T10:12:23.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.739+0000 7f3a237c1640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a1c06b990 con 0x7f3a1c06afb0 2023-12-12T10:12:23.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.743+0000 7f3a21d5e640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f3a1c06b460 0x7f3a1c0cc950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:23.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.743+0000 7f3a21d5e640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f3a1c06b460 0x7f3a1c0cc950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47538/0 (socket says 172.21.15.78:47538) 2023-12-12T10:12:23.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.743+0000 7f3a21d5e640 1 -- 172.21.15.78:0/2200171573 learned_addr learned my addr 172.21.15.78:0/2200171573 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:23.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.743+0000 7f3a2155d640 1 --2- 172.21.15.78:0/2200171573 >> v2:172.21.15.187:3300/0 conn(0x7f3a1c15aec0 0x7f3a1c15e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:23.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.743+0000 7f3a20d5c640 1 --2- 172.21.15.78:0/2200171573 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3a1c06afb0 0x7f3a1c0cc410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:23.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.743+0000 7f3a21d5e640 1 -- 172.21.15.78:0/2200171573 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3a1c06afb0 msgr2=0x7f3a1c0cc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:23.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.743+0000 7f3a21d5e640 1 --2- 172.21.15.78:0/2200171573 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3a1c06afb0 0x7f3a1c0cc410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:23.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.743+0000 7f3a21d5e640 1 -- 172.21.15.78:0/2200171573 >> v2:172.21.15.187:3300/0 conn(0x7f3a1c15aec0 msgr2=0x7f3a1c15e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:23.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.743+0000 7f3a21d5e640 1 --2- 172.21.15.78:0/2200171573 >> v2:172.21.15.187:3300/0 conn(0x7f3a1c15aec0 0x7f3a1c15e2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:23.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.743+0000 7f3a21d5e640 1 -- 172.21.15.78:0/2200171573 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a1c06bc70 con 0x7f3a1c06b460 2023-12-12T10:12:23.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.743+0000 7f3a21d5e640 1 --2- 172.21.15.78:0/2200171573 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3a1c06b460 0x7f3a1c0cc950 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c0cd0f0 tx=0x7f3a1401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70d635de3b7de828 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:23.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.743+0000 7f3a13fff640 1 -- 172.21.15.78:0/2200171573 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a140ab650 con 0x7f3a1c06b460 2023-12-12T10:12:23.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.743+0000 7f3a13fff640 1 -- 172.21.15.78:0/2200171573 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a140ab7b0 con 0x7f3a1c06b460 2023-12-12T10:12:23.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.743+0000 7f3a13fff640 1 -- 172.21.15.78:0/2200171573 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a140abb40 con 0x7f3a1c06b460 2023-12-12T10:12:23.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.747+0000 7f3a237c1640 1 -- 172.21.15.78:0/2200171573 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3a1c06b460 msgr2=0x7f3a1c0cc950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:23.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.747+0000 7f3a237c1640 1 --2- 172.21.15.78:0/2200171573 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3a1c06b460 0x7f3a1c0cc950 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c0cd0f0 tx=0x7f3a1401c470 comp rx=0 tx=0).stop 2023-12-12T10:12:23.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.747+0000 7f3a237c1640 1 -- 172.21.15.78:0/2200171573 shutdown_connections 2023-12-12T10:12:23.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.747+0000 7f3a237c1640 1 --2- 172.21.15.78:0/2200171573 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3a1c06b460 0x7f3a1c0cc950 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:23.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.747+0000 7f3a237c1640 1 --2- 172.21.15.78:0/2200171573 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3a1c06afb0 0x7f3a1c0cc410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:23.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.747+0000 7f3a237c1640 1 --2- 172.21.15.78:0/2200171573 >> v2:172.21.15.187:3300/0 conn(0x7f3a1c15aec0 0x7f3a1c15e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:23.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.747+0000 7f3a237c1640 1 -- 172.21.15.78:0/2200171573 >> 172.21.15.78:0/2200171573 conn(0x7f3a1c0b1650 msgr2=0x7f3a1c0b1a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:23.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.747+0000 7f3a237c1640 1 -- 172.21.15.78:0/2200171573 shutdown_connections 2023-12-12T10:12:23.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.747+0000 7f3a237c1640 1 -- 172.21.15.78:0/2200171573 wait complete. 2023-12-12T10:12:23.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.747+0000 7f3a237c1640 1 Processor -- start 2023-12-12T10:12:23.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.747+0000 7f3a237c1640 1 -- start start 2023-12-12T10:12:23.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.747+0000 7f3a237c1640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3a1c06afb0 0x7f3a1c1622c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:23.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.747+0000 7f3a237c1640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3a1c06b460 0x7f3a1c1672d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:23.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.747+0000 7f3a237c1640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3a1c15aec0 0x7f3a1c167810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:23.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.747+0000 7f3a237c1640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a1c152ac0 con 0x7f3a1c15aec0 2023-12-12T10:12:23.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.747+0000 7f3a237c1640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a1c0ad250 con 0x7f3a1c06afb0 2023-12-12T10:12:23.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.747+0000 7f3a237c1640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a1c156f00 con 0x7f3a1c06b460 2023-12-12T10:12:23.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.747+0000 7f3a21d5e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3a1c15aec0 0x7f3a1c167810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:23.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.747+0000 7f3a21d5e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3a1c15aec0 0x7f3a1c167810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47550/0 (socket says 172.21.15.78:47550) 2023-12-12T10:12:23.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.747+0000 7f3a21d5e640 1 -- 172.21.15.78:0/3795432834 learned_addr learned my addr 172.21.15.78:0/3795432834 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:23.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.747+0000 7f3a20d5c640 1 --2- 172.21.15.78:0/3795432834 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3a1c06b460 0x7f3a1c1672d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:23.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.747+0000 7f3a2155d640 1 --2- 172.21.15.78:0/3795432834 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3a1c06afb0 0x7f3a1c1622c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:23.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.751+0000 7f3a20d5c640 1 -- 172.21.15.78:0/3795432834 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3a1c06afb0 msgr2=0x7f3a1c1622c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:23.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.751+0000 7f3a20d5c640 1 --2- 172.21.15.78:0/3795432834 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3a1c06afb0 0x7f3a1c1622c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:23.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.751+0000 7f3a20d5c640 1 -- 172.21.15.78:0/3795432834 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3a1c15aec0 msgr2=0x7f3a1c167810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:23.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.751+0000 7f3a20d5c640 1 --2- 172.21.15.78:0/3795432834 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3a1c15aec0 0x7f3a1c167810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:23.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.751+0000 7f3a20d5c640 1 -- 172.21.15.78:0/3795432834 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a140094d0 con 0x7f3a1c06b460 2023-12-12T10:12:23.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.751+0000 7f3a21d5e640 1 --2- 172.21.15.78:0/3795432834 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3a1c15aec0 0x7f3a1c167810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-12T10:12:23.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.751+0000 7f3a20d5c640 1 --2- 172.21.15.78:0/3795432834 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3a1c06b460 0x7f3a1c1672d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c00d5f0 tx=0x7f3a0c00dab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:23.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.751+0000 7f3a11ffb640 1 -- 172.21.15.78:0/3795432834 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a0c014620 con 0x7f3a1c06b460 2023-12-12T10:12:23.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.751+0000 7f3a11ffb640 1 -- 172.21.15.78:0/3795432834 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a0c014780 con 0x7f3a1c06b460 2023-12-12T10:12:23.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.751+0000 7f3a11ffb640 1 -- 172.21.15.78:0/3795432834 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a0c014b10 con 0x7f3a1c06b460 2023-12-12T10:12:23.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.751+0000 7f3a237c1640 1 -- 172.21.15.78:0/3795432834 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a1c1571e0 con 0x7f3a1c06b460 2023-12-12T10:12:23.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.751+0000 7f3a237c1640 1 -- 172.21.15.78:0/3795432834 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a1c0b27e0 con 0x7f3a1c06b460 2023-12-12T10:12:23.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.751+0000 7f3a237c1640 1 -- 172.21.15.78:0/3795432834 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a1c067530 con 0x7f3a1c06b460 2023-12-12T10:12:23.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.751+0000 7f3a11ffb640 1 -- 172.21.15.78:0/3795432834 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3a0c014c70 con 0x7f3a1c06b460 2023-12-12T10:12:23.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.755+0000 7f3a11ffb640 1 --2- 172.21.15.78:0/3795432834 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f3a00066470 0x7f3a00068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:23.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.755+0000 7f3a11ffb640 1 -- 172.21.15.78:0/3795432834 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3a0c084bd0 con 0x7f3a1c06b460 2023-12-12T10:12:23.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.755+0000 7f3a2155d640 1 --2- 172.21.15.78:0/3795432834 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f3a00066470 0x7f3a00068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:23.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.755+0000 7f3a2155d640 1 --2- 172.21.15.78:0/3795432834 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f3a00066470 0x7f3a00068930 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3a18003ab0 tx=0x7f3a18009830 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:23.762 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.759+0000 7f3a11ffb640 1 -- 172.21.15.78:0/3795432834 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3a0c051ef0 con 0x7f3a1c06b460 2023-12-12T10:12:23.912 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.907+0000 7f3a237c1640 1 -- 172.21.15.78:0/3795432834 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3a1c157730 con 0x7f3a1c06b460 2023-12-12T10:12:23.912 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.907+0000 7f3a11ffb640 1 -- 172.21.15.78:0/3795432834 <== mon.2 v2:172.21.15.187:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3a0c055510 con 0x7f3a1c06b460 2023-12-12T10:12:23.913 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2023-12-12T10:12:23.914 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.907+0000 7f3a237c1640 1 -- 172.21.15.78:0/3795432834 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f3a00066470 msgr2=0x7f3a00068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:23.915 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.907+0000 7f3a237c1640 1 --2- 172.21.15.78:0/3795432834 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f3a00066470 0x7f3a00068930 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3a18003ab0 tx=0x7f3a18009830 comp rx=0 tx=0).stop 2023-12-12T10:12:23.915 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.907+0000 7f3a237c1640 1 -- 172.21.15.78:0/3795432834 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3a1c06b460 msgr2=0x7f3a1c1672d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:23.915 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.907+0000 7f3a237c1640 1 --2- 172.21.15.78:0/3795432834 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3a1c06b460 0x7f3a1c1672d0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c00d5f0 tx=0x7f3a0c00dab0 comp rx=0 tx=0).stop 2023-12-12T10:12:23.915 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.911+0000 7f3a237c1640 1 -- 172.21.15.78:0/3795432834 shutdown_connections 2023-12-12T10:12:23.915 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.911+0000 7f3a237c1640 1 --2- 172.21.15.78:0/3795432834 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f3a00066470 0x7f3a00068930 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:23.915 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.911+0000 7f3a237c1640 1 --2- 172.21.15.78:0/3795432834 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3a1c15aec0 0x7f3a1c167810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:23.915 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.911+0000 7f3a237c1640 1 --2- 172.21.15.78:0/3795432834 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3a1c06b460 0x7f3a1c1672d0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:23.915 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.911+0000 7f3a237c1640 1 --2- 172.21.15.78:0/3795432834 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3a1c06afb0 0x7f3a1c1622c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:23.915 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.911+0000 7f3a237c1640 1 -- 172.21.15.78:0/3795432834 >> 172.21.15.78:0/3795432834 conn(0x7f3a1c0b1650 msgr2=0x7f3a1c15f550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:23.915 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.911+0000 7f3a237c1640 1 -- 172.21.15.78:0/3795432834 shutdown_connections 2023-12-12T10:12:23.915 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:23.911+0000 7f3a237c1640 1 -- 172.21.15.78:0/3795432834 wait complete. 2023-12-12T10:12:23.937 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-12T10:12:24.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.071+0000 7f8d86365640 1 Processor -- start 2023-12-12T10:12:24.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.071+0000 7f8d86365640 1 -- start start 2023-12-12T10:12:24.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.075+0000 7f8d86365640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f8d8006d9f0 0x7f8d800b36e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:24.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.075+0000 7f8d86365640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8d8006de70 0x7f8d800b3c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:24.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.075+0000 7f8d86365640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d8015d6d0 con 0x7f8d8015d2f0 2023-12-12T10:12:24.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.075+0000 7f8d86365640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d80070ea0 con 0x7f8d8006de70 2023-12-12T10:12:24.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.075+0000 7f8d86365640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d80070600 con 0x7f8d8006d9f0 2023-12-12T10:12:24.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.075+0000 7f8d84902640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8d8006de70 0x7f8d800b3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:24.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.075+0000 7f8d84902640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8d8006de70 0x7f8d800b3c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47564/0 (socket says 172.21.15.78:47564) 2023-12-12T10:12:24.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.075+0000 7f8d84902640 1 -- 172.21.15.78:0/1776352525 learned_addr learned my addr 172.21.15.78:0/1776352525 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:24.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.075+0000 7f8d7ffff640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f8d8015d2f0 0x7f8d800722c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:44286/0 (socket says 172.21.15.78:44286) 2023-12-12T10:12:24.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.075+0000 7f8d7f7fe640 1 --2- 172.21.15.78:0/1776352525 >> v2:172.21.15.187:3300/0 conn(0x7f8d8006d9f0 0x7f8d800b36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:24.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.075+0000 7f8d84902640 1 -- 172.21.15.78:0/1776352525 >> v2:172.21.15.187:3300/0 conn(0x7f8d8006d9f0 msgr2=0x7f8d800b36e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:24.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.075+0000 7f8d84902640 1 --2- 172.21.15.78:0/1776352525 >> v2:172.21.15.187:3300/0 conn(0x7f8d8006d9f0 0x7f8d800b36e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:24.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.075+0000 7f8d84902640 1 -- 172.21.15.78:0/1776352525 >> v1:172.21.15.78:6789/0 conn(0x7f8d8015d2f0 legacy=0x7f8d800722c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:24.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.075+0000 7f8d84902640 1 -- 172.21.15.78:0/1776352525 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d800708e0 con 0x7f8d8006de70 2023-12-12T10:12:24.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.079+0000 7f8d84902640 1 --2- 172.21.15.78:0/1776352525 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d8006de70 0x7f8d800b3c20 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f8d8009d1a0 tx=0x7f8d7801c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93800897a76a6522 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:24.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.079+0000 7f8d7effd640 1 -- 172.21.15.78:0/1776352525 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d780a57d0 con 0x7f8d8006de70 2023-12-12T10:12:24.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.079+0000 7f8d7effd640 1 -- 172.21.15.78:0/1776352525 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d780a5930 con 0x7f8d8006de70 2023-12-12T10:12:24.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.079+0000 7f8d7effd640 1 -- 172.21.15.78:0/1776352525 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d780a5cc0 con 0x7f8d8006de70 2023-12-12T10:12:24.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.079+0000 7f8d86365640 1 -- 172.21.15.78:0/1776352525 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d8006de70 msgr2=0x7f8d800b3c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:24.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.079+0000 7f8d86365640 1 --2- 172.21.15.78:0/1776352525 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d8006de70 0x7f8d800b3c20 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f8d8009d1a0 tx=0x7f8d7801c910 comp rx=0 tx=0).stop 2023-12-12T10:12:24.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.079+0000 7f8d86365640 1 -- 172.21.15.78:0/1776352525 shutdown_connections 2023-12-12T10:12:24.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.079+0000 7f8d86365640 1 --2- 172.21.15.78:0/1776352525 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d8006de70 0x7f8d800b3c20 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:24.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.079+0000 7f8d86365640 1 --2- 172.21.15.78:0/1776352525 >> v2:172.21.15.187:3300/0 conn(0x7f8d8006d9f0 0x7f8d800b36e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:24.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.079+0000 7f8d86365640 1 -- 172.21.15.78:0/1776352525 >> 172.21.15.78:0/1776352525 conn(0x7f8d800b0bb0 msgr2=0x7f8d800b0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:24.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.079+0000 7f8d86365640 1 -- 172.21.15.78:0/1776352525 shutdown_connections 2023-12-12T10:12:24.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.079+0000 7f8d86365640 1 -- 172.21.15.78:0/1776352525 wait complete. 2023-12-12T10:12:24.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.079+0000 7f8d86365640 1 Processor -- start 2023-12-12T10:12:24.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.079+0000 7f8d86365640 1 -- start start 2023-12-12T10:12:24.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.083+0000 7f8d86365640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d8006d9f0 0x7f8d800afcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:24.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.083+0000 7f8d86365640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8d8006de70 0x7f8d801503e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:24.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.083+0000 7f8d86365640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8d8015d2f0 0x7f8d80155aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:24.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.083+0000 7f8d86365640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d8015d860 con 0x7f8d8006d9f0 2023-12-12T10:12:24.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.083+0000 7f8d86365640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d80155350 con 0x7f8d8006de70 2023-12-12T10:12:24.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.083+0000 7f8d86365640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d8015dd90 con 0x7f8d8015d2f0 2023-12-12T10:12:24.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.083+0000 7f8d7ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d8006d9f0 0x7f8d800afcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:24.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.083+0000 7f8d7ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d8006d9f0 0x7f8d800afcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47578/0 (socket says 172.21.15.78:47578) 2023-12-12T10:12:24.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.083+0000 7f8d7ffff640 1 -- 172.21.15.78:0/3640733316 learned_addr learned my addr 172.21.15.78:0/3640733316 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:24.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.083+0000 7f8d7f7fe640 1 --2- 172.21.15.78:0/3640733316 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8d8006de70 0x7f8d801503e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:24.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.083+0000 7f8d84902640 1 --2- 172.21.15.78:0/3640733316 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8d8015d2f0 0x7f8d80155aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:24.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.083+0000 7f8d7ffff640 1 -- 172.21.15.78:0/3640733316 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8d8015d2f0 msgr2=0x7f8d80155aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:24.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.083+0000 7f8d7ffff640 1 --2- 172.21.15.78:0/3640733316 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8d8015d2f0 0x7f8d80155aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:24.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.083+0000 7f8d7ffff640 1 -- 172.21.15.78:0/3640733316 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8d8006de70 msgr2=0x7f8d801503e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:24.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.083+0000 7f8d7ffff640 1 --2- 172.21.15.78:0/3640733316 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8d8006de70 0x7f8d801503e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:24.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.083+0000 7f8d7ffff640 1 -- 172.21.15.78:0/3640733316 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d78009b30 con 0x7f8d8006d9f0 2023-12-12T10:12:24.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.083+0000 7f8d84902640 1 --2- 172.21.15.78:0/3640733316 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8d8015d2f0 0x7f8d80155aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T10:12:24.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.083+0000 7f8d7ffff640 1 --2- 172.21.15.78:0/3640733316 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d8006d9f0 0x7f8d800afcd0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f8d7000c460 tx=0x7f8d7000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:24.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.083+0000 7f8d7cff9640 1 -- 172.21.15.78:0/3640733316 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d70007480 con 0x7f8d8006d9f0 2023-12-12T10:12:24.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.083+0000 7f8d7cff9640 1 -- 172.21.15.78:0/3640733316 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d700075e0 con 0x7f8d8006d9f0 2023-12-12T10:12:24.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.083+0000 7f8d86365640 1 -- 172.21.15.78:0/3640733316 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d8015dab0 con 0x7f8d8006d9f0 2023-12-12T10:12:24.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.083+0000 7f8d7cff9640 1 -- 172.21.15.78:0/3640733316 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d70004a10 con 0x7f8d8006d9f0 2023-12-12T10:12:24.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.083+0000 7f8d86365640 1 -- 172.21.15.78:0/3640733316 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d800b0210 con 0x7f8d8006d9f0 2023-12-12T10:12:24.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.083+0000 7f8d86365640 1 -- 172.21.15.78:0/3640733316 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d80154e40 con 0x7f8d8006d9f0 2023-12-12T10:12:24.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.083+0000 7f8d7cff9640 1 -- 172.21.15.78:0/3640733316 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f8d70004b70 con 0x7f8d8006d9f0 2023-12-12T10:12:24.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.087+0000 7f8d7cff9640 1 --2- 172.21.15.78:0/3640733316 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f8d6c066470 0x7f8d6c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:24.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.087+0000 7f8d7cff9640 1 -- 172.21.15.78:0/3640733316 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8d700832b0 con 0x7f8d8006d9f0 2023-12-12T10:12:24.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.087+0000 7f8d7f7fe640 1 --2- 172.21.15.78:0/3640733316 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f8d6c066470 0x7f8d6c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:24.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.087+0000 7f8d7f7fe640 1 --2- 172.21.15.78:0/3640733316 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f8d6c066470 0x7f8d6c068930 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8d800725a0 tx=0x7f8d74008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:24.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.091+0000 7f8d7cff9640 1 -- 172.21.15.78:0/3640733316 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8d80154e40 con 0x7f8d8006d9f0 2023-12-12T10:12:24.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.239+0000 7f8d86365640 1 -- 172.21.15.78:0/3640733316 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f8d80154e40 con 0x7f8d8006d9f0 2023-12-12T10:12:24.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.239+0000 7f8d7cff9640 1 -- 172.21.15.78:0/3640733316 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7f8d80154e40 con 0x7f8d8006d9f0 2023-12-12T10:12:24.246 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2023-12-12T10:12:24.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.243+0000 7f8d86365640 1 -- 172.21.15.78:0/3640733316 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f8d6c066470 msgr2=0x7f8d6c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:24.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.243+0000 7f8d86365640 1 --2- 172.21.15.78:0/3640733316 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f8d6c066470 0x7f8d6c068930 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8d800725a0 tx=0x7f8d74008040 comp rx=0 tx=0).stop 2023-12-12T10:12:24.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.243+0000 7f8d86365640 1 -- 172.21.15.78:0/3640733316 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d8006d9f0 msgr2=0x7f8d800afcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:24.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.243+0000 7f8d86365640 1 --2- 172.21.15.78:0/3640733316 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d8006d9f0 0x7f8d800afcd0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f8d7000c460 tx=0x7f8d7000c920 comp rx=0 tx=0).stop 2023-12-12T10:12:24.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.243+0000 7f8d86365640 1 -- 172.21.15.78:0/3640733316 shutdown_connections 2023-12-12T10:12:24.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.243+0000 7f8d86365640 1 --2- 172.21.15.78:0/3640733316 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f8d6c066470 0x7f8d6c068930 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:24.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.243+0000 7f8d86365640 1 --2- 172.21.15.78:0/3640733316 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8d8015d2f0 0x7f8d80155aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:24.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.243+0000 7f8d86365640 1 --2- 172.21.15.78:0/3640733316 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8d8006de70 0x7f8d801503e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:24.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.243+0000 7f8d86365640 1 --2- 172.21.15.78:0/3640733316 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d8006d9f0 0x7f8d800afcd0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:24.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.243+0000 7f8d86365640 1 -- 172.21.15.78:0/3640733316 >> 172.21.15.78:0/3640733316 conn(0x7f8d800b0bb0 msgr2=0x7f8d800ad8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:24.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.243+0000 7f8d86365640 1 -- 172.21.15.78:0/3640733316 shutdown_connections 2023-12-12T10:12:24.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.243+0000 7f8d86365640 1 -- 172.21.15.78:0/3640733316 wait complete. 2023-12-12T10:12:24.267 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-12T10:12:24.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.399+0000 7fd3baa17640 1 Processor -- start 2023-12-12T10:12:24.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.399+0000 7fd3baa17640 1 -- start start 2023-12-12T10:12:24.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.399+0000 7fd3baa17640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd3b4071610 0x7fd3b4164ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:24.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.399+0000 7fd3baa17640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3b4070a70 con 0x7fd3b4143770 2023-12-12T10:12:24.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.399+0000 7fd3baa17640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3b40ce3c0 con 0x7fd3b40cdf60 2023-12-12T10:12:24.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.399+0000 7fd3baa17640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3b415e920 con 0x7fd3b4071610 2023-12-12T10:12:24.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.399+0000 7fd3b3fff640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fd3b4143770 0x7fd3b40b1e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:44296/0 (socket says 172.21.15.78:44296) 2023-12-12T10:12:24.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.399+0000 7fd3b3fff640 1 -- 172.21.15.78:0/1103297197 learned_addr learned my addr 172.21.15.78:0/1103297197 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-12-12T10:12:24.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.399+0000 7fd3b8fb4640 1 --2- 172.21.15.78:0/1103297197 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd3b4071610 0x7fd3b4164ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:24.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.399+0000 7fd3b2ffd640 1 -- 172.21.15.78:0/1103297197 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3184172682 0 0) 0x7fd3b4070a70 con 0x7fd3b4143770 2023-12-12T10:12:24.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.399+0000 7fd3b2ffd640 1 -- 172.21.15.78:0/1103297197 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd39c005740 con 0x7fd3b4143770 2023-12-12T10:12:24.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.399+0000 7fd3b2ffd640 1 -- 172.21.15.78:0/1103297197 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1083525799 0 0) 0x7fd3b40ce3c0 con 0x7fd3b40cdf60 2023-12-12T10:12:24.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.399+0000 7fd3b2ffd640 1 -- 172.21.15.78:0/1103297197 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3b4070a70 con 0x7fd3b40cdf60 2023-12-12T10:12:24.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.403+0000 7fd3b8fb4640 1 -- 172.21.15.78:0/1103297197 >> v1:172.21.15.187:6789/0 conn(0x7fd3b40cdf60 legacy=0x7fd3b4070f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:24.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.403+0000 7fd3b8fb4640 1 -- 172.21.15.78:0/1103297197 >> v1:172.21.15.78:6789/0 conn(0x7fd3b4143770 legacy=0x7fd3b40b1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:24.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.403+0000 7fd3b8fb4640 1 -- 172.21.15.78:0/1103297197 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3b4070440 con 0x7fd3b4071610 2023-12-12T10:12:24.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.403+0000 7fd3b8fb4640 1 --2- 172.21.15.78:0/1103297197 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd3b4071610 0x7fd3b4164ca0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac009dc0 tx=0x7fd3ac01c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d77762525fd610da server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:24.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.403+0000 7fd3b2ffd640 1 -- 172.21.15.78:0/1103297197 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3ac0a5a50 con 0x7fd3b4071610 2023-12-12T10:12:24.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.403+0000 7fd3b2ffd640 1 -- 172.21.15.78:0/1103297197 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3ac0a5bb0 con 0x7fd3b4071610 2023-12-12T10:12:24.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.403+0000 7fd3b2ffd640 1 -- 172.21.15.78:0/1103297197 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3ac0ad440 con 0x7fd3b4071610 2023-12-12T10:12:24.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.403+0000 7fd3baa17640 1 -- 172.21.15.78:0/1103297197 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd3b4071610 msgr2=0x7fd3b4164ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:24.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.403+0000 7fd3baa17640 1 --2- 172.21.15.78:0/1103297197 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd3b4071610 0x7fd3b4164ca0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac009dc0 tx=0x7fd3ac01c970 comp rx=0 tx=0).stop 2023-12-12T10:12:24.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.403+0000 7fd3baa17640 1 -- 172.21.15.78:0/1103297197 shutdown_connections 2023-12-12T10:12:24.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.403+0000 7fd3baa17640 1 --2- 172.21.15.78:0/1103297197 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd3b4071610 0x7fd3b4164ca0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:24.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.403+0000 7fd3baa17640 1 -- 172.21.15.78:0/1103297197 >> 172.21.15.78:0/1103297197 conn(0x7fd3b406a710 msgr2=0x7fd3b406ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:24.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.407+0000 7fd3baa17640 1 -- 172.21.15.78:0/1103297197 shutdown_connections 2023-12-12T10:12:24.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.407+0000 7fd3baa17640 1 -- 172.21.15.78:0/1103297197 wait complete. 2023-12-12T10:12:24.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.407+0000 7fd3baa17640 1 Processor -- start 2023-12-12T10:12:24.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.407+0000 7fd3baa17640 1 -- start start 2023-12-12T10:12:24.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.407+0000 7fd3baa17640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3b4071610 0x7fd3b413a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:24.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.407+0000 7fd3baa17640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd3b40cdf60 0x7fd3b41395f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:24.415 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.407+0000 7fd3baa17640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd3b4143770 0x7fd3b4140600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:24.415 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.407+0000 7fd3baa17640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3b4139b30 con 0x7fd3b4071610 2023-12-12T10:12:24.415 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.407+0000 7fd3baa17640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3b415b460 con 0x7fd3b4143770 2023-12-12T10:12:24.415 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.407+0000 7fd3baa17640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3b4140b40 con 0x7fd3b40cdf60 2023-12-12T10:12:24.415 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.407+0000 7fd3b3fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3b4071610 0x7fd3b413a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:24.415 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.407+0000 7fd3b3fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3b4071610 0x7fd3b413a840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47584/0 (socket says 172.21.15.78:47584) 2023-12-12T10:12:24.415 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.407+0000 7fd3b3fff640 1 -- 172.21.15.78:0/3756477356 learned_addr learned my addr 172.21.15.78:0/3756477356 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:24.415 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.407+0000 7fd3b37fe640 1 --2- 172.21.15.78:0/3756477356 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd3b40cdf60 0x7fd3b41395f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:24.415 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.407+0000 7fd3b8fb4640 1 --2- 172.21.15.78:0/3756477356 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd3b4143770 0x7fd3b4140600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:24.415 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.407+0000 7fd3b3fff640 1 -- 172.21.15.78:0/3756477356 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd3b40cdf60 msgr2=0x7fd3b41395f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:24.415 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.407+0000 7fd3b3fff640 1 --2- 172.21.15.78:0/3756477356 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd3b40cdf60 0x7fd3b41395f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:24.415 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.407+0000 7fd3b3fff640 1 -- 172.21.15.78:0/3756477356 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd3b4143770 msgr2=0x7fd3b4140600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:24.415 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.407+0000 7fd3b3fff640 1 --2- 172.21.15.78:0/3756477356 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd3b4143770 0x7fd3b4140600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:24.415 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.407+0000 7fd3b3fff640 1 -- 172.21.15.78:0/3756477356 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3ac009a70 con 0x7fd3b4071610 2023-12-12T10:12:24.416 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.407+0000 7fd3b3fff640 1 --2- 172.21.15.78:0/3756477356 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3b4071610 0x7fd3b413a840 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fd3a400c420 tx=0x7fd3a400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:24.416 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.411+0000 7fd3b0ff9640 1 -- 172.21.15.78:0/3756477356 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3a4005cf0 con 0x7fd3b4071610 2023-12-12T10:12:24.416 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.411+0000 7fd3b0ff9640 1 -- 172.21.15.78:0/3756477356 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3a4005e50 con 0x7fd3b4071610 2023-12-12T10:12:24.416 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.411+0000 7fd3b0ff9640 1 -- 172.21.15.78:0/3756477356 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3a40072f0 con 0x7fd3b4071610 2023-12-12T10:12:24.416 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.411+0000 7fd3baa17640 1 -- 172.21.15.78:0/3756477356 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3b413aeb0 con 0x7fd3b4071610 2023-12-12T10:12:24.416 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.411+0000 7fd3baa17640 1 -- 172.21.15.78:0/3756477356 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3b415b990 con 0x7fd3b4071610 2023-12-12T10:12:24.416 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.411+0000 7fd3baa17640 1 -- 172.21.15.78:0/3756477356 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3b40671f0 con 0x7fd3b4071610 2023-12-12T10:12:24.416 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.411+0000 7fd3b0ff9640 1 -- 172.21.15.78:0/3756477356 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd3a4007450 con 0x7fd3b4071610 2023-12-12T10:12:24.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.411+0000 7fd3b0ff9640 1 --2- 172.21.15.78:0/3756477356 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fd3a0066470 0x7fd3a0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:24.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.411+0000 7fd3b0ff9640 1 -- 172.21.15.78:0/3756477356 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd3a4083730 con 0x7fd3b4071610 2023-12-12T10:12:24.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.411+0000 7fd3b37fe640 1 --2- 172.21.15.78:0/3756477356 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fd3a0066470 0x7fd3a0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:24.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.415+0000 7fd3b37fe640 1 --2- 172.21.15.78:0/3756477356 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fd3a0066470 0x7fd3a0068930 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd3b4142d40 tx=0x7fd3a8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:24.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.415+0000 7fd3b0ff9640 1 -- 172.21.15.78:0/3756477356 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd3a4054370 con 0x7fd3b4071610 2023-12-12T10:12:24.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.575+0000 7fd3baa17640 1 -- 172.21.15.78:0/3756477356 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fd3b4067530 con 0x7fd3b4071610 2023-12-12T10:12:24.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.575+0000 7fd3b0ff9640 1 -- 172.21.15.78:0/3756477356 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) v1 ==== 80+0+0 (secure 0 0 0) 0x7fd3a4053f00 con 0x7fd3b4071610 2023-12-12T10:12:24.582 INFO:teuthology.orchestra.run.smithi078.stderr:listed 0 entries 2023-12-12T10:12:24.584 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.579+0000 7fd3baa17640 1 -- 172.21.15.78:0/3756477356 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fd3a0066470 msgr2=0x7fd3a0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:24.584 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.579+0000 7fd3baa17640 1 --2- 172.21.15.78:0/3756477356 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fd3a0066470 0x7fd3a0068930 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd3b4142d40 tx=0x7fd3a8009040 comp rx=0 tx=0).stop 2023-12-12T10:12:24.584 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.579+0000 7fd3baa17640 1 -- 172.21.15.78:0/3756477356 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3b4071610 msgr2=0x7fd3b413a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:24.584 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.579+0000 7fd3baa17640 1 --2- 172.21.15.78:0/3756477356 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3b4071610 0x7fd3b413a840 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fd3a400c420 tx=0x7fd3a400c8e0 comp rx=0 tx=0).stop 2023-12-12T10:12:24.584 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.579+0000 7fd3baa17640 1 -- 172.21.15.78:0/3756477356 shutdown_connections 2023-12-12T10:12:24.584 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.579+0000 7fd3baa17640 1 --2- 172.21.15.78:0/3756477356 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fd3a0066470 0x7fd3a0068930 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:24.584 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.579+0000 7fd3baa17640 1 --2- 172.21.15.78:0/3756477356 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd3b4143770 0x7fd3b4140600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:24.584 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.579+0000 7fd3baa17640 1 --2- 172.21.15.78:0/3756477356 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd3b40cdf60 0x7fd3b41395f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:24.584 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.579+0000 7fd3baa17640 1 --2- 172.21.15.78:0/3756477356 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3b4071610 0x7fd3b413a840 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:24.584 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.579+0000 7fd3baa17640 1 -- 172.21.15.78:0/3756477356 >> 172.21.15.78:0/3756477356 conn(0x7fd3b406a710 msgr2=0x7fd3b40b33d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:24.584 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.579+0000 7fd3baa17640 1 -- 172.21.15.78:0/3756477356 shutdown_connections 2023-12-12T10:12:24.585 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.579+0000 7fd3baa17640 1 -- 172.21.15.78:0/3756477356 wait complete. 2023-12-12T10:12:24.602 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi078.front.sepia.ceph.com... 2023-12-12T10:12:24.603 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T10:12:24.603 DEBUG:teuthology.orchestra.run.smithi078:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2023-12-12T10:12:24.678 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi078.stderr:ceph-fuse[44812]: fuse finished with error 0 and tester_r 0 2023-12-12T10:12:24.681 INFO:teuthology.orchestra.run:waiting for 300 2023-12-12T10:12:24.744 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi078.front.sepia.ceph.com 2023-12-12T10:12:24.744 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T10:12:24.744 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2023-12-12T10:12:24.778 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T10:12:24.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.955+0000 7f380559d640 1 Processor -- start 2023-12-12T10:12:24.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.955+0000 7f380559d640 1 -- start start 2023-12-12T10:12:24.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.955+0000 7f380559d640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f380015d3c0 0x7f38000d3b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:24.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.955+0000 7f380559d640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f38000ce670 0x7f38000d15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:24.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.955+0000 7f380559d640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38000b3250 con 0x7f38000d1ae0 2023-12-12T10:12:24.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.955+0000 7f380559d640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38000d1f70 con 0x7f380015d3c0 2023-12-12T10:12:24.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.955+0000 7f380559d640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38000cee50 con 0x7f38000ce670 2023-12-12T10:12:24.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.955+0000 7f37feffd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f380015d3c0 0x7f38000d3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:24.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.955+0000 7f37feffd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f380015d3c0 0x7f38000d3b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47588/0 (socket says 172.21.15.78:47588) 2023-12-12T10:12:24.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.955+0000 7f37feffd640 1 -- 172.21.15.78:0/2875454951 learned_addr learned my addr 172.21.15.78:0/2875454951 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:24.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.955+0000 7f37ff7fe640 1 --1- 172.21.15.78:0/2875454951 >> v1:172.21.15.78:6789/0 conn(0x7f38000d1ae0 0x7f38000cf680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:44302/0 (socket says 172.21.15.78:44302) 2023-12-12T10:12:24.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.959+0000 7f37f67fc640 1 --2- 172.21.15.78:0/2875454951 >> v2:172.21.15.187:3300/0 conn(0x7f38000ce670 0x7f38000d15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:24.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.959+0000 7f37feffd640 1 -- 172.21.15.78:0/2875454951 >> v2:172.21.15.187:3300/0 conn(0x7f38000ce670 msgr2=0x7f38000d15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:24.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.959+0000 7f37feffd640 1 --2- 172.21.15.78:0/2875454951 >> v2:172.21.15.187:3300/0 conn(0x7f38000ce670 0x7f38000d15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:24.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.959+0000 7f37feffd640 1 -- 172.21.15.78:0/2875454951 >> v1:172.21.15.78:6789/0 conn(0x7f38000d1ae0 legacy=0x7f38000cf680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:24.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.959+0000 7f37feffd640 1 -- 172.21.15.78:0/2875454951 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38000b2920 con 0x7f380015d3c0 2023-12-12T10:12:24.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.959+0000 7f37f67fc640 1 --2- 172.21.15.78:0/2875454951 >> v2:172.21.15.187:3300/0 conn(0x7f38000ce670 0x7f38000d15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T10:12:24.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.959+0000 7f37feffd640 1 --2- 172.21.15.78:0/2875454951 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f380015d3c0 0x7f38000d3b10 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f37e8009870 tx=0x7f37e801ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f0818683cd4f99a server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:24.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.959+0000 7f37fe7fc640 1 -- 172.21.15.78:0/2875454951 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37e80a89f0 con 0x7f380015d3c0 2023-12-12T10:12:24.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.959+0000 7f37fe7fc640 1 -- 172.21.15.78:0/2875454951 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37e80a8b50 con 0x7f380015d3c0 2023-12-12T10:12:24.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.959+0000 7f37fe7fc640 1 -- 172.21.15.78:0/2875454951 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37e80b0440 con 0x7f380015d3c0 2023-12-12T10:12:24.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.963+0000 7f380559d640 1 -- 172.21.15.78:0/2875454951 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f380015d3c0 msgr2=0x7f38000d3b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:24.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.963+0000 7f380559d640 1 --2- 172.21.15.78:0/2875454951 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f380015d3c0 0x7f38000d3b10 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f37e8009870 tx=0x7f37e801ecf0 comp rx=0 tx=0).stop 2023-12-12T10:12:24.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.963+0000 7f380559d640 1 -- 172.21.15.78:0/2875454951 shutdown_connections 2023-12-12T10:12:24.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.963+0000 7f380559d640 1 --2- 172.21.15.78:0/2875454951 >> v2:172.21.15.187:3300/0 conn(0x7f38000ce670 0x7f38000d15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:24.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.963+0000 7f380559d640 1 --2- 172.21.15.78:0/2875454951 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f380015d3c0 0x7f38000d3b10 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:24.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.963+0000 7f380559d640 1 -- 172.21.15.78:0/2875454951 >> 172.21.15.78:0/2875454951 conn(0x7f380009c2a0 msgr2=0x7f38000d2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:24.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.963+0000 7f380559d640 1 -- 172.21.15.78:0/2875454951 shutdown_connections 2023-12-12T10:12:24.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.963+0000 7f380559d640 1 -- 172.21.15.78:0/2875454951 wait complete. 2023-12-12T10:12:24.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.963+0000 7f380559d640 1 Processor -- start 2023-12-12T10:12:24.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.963+0000 7f380559d640 1 -- start start 2023-12-12T10:12:24.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.963+0000 7f380559d640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f38000ce670 0x7f38000cc7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:24.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.963+0000 7f380559d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f38000d1ae0 0x7f380015f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:24.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.963+0000 7f380559d640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f380015d3c0 0x7f3800159640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:24.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.963+0000 7f380559d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38000ca230 con 0x7f38000d1ae0 2023-12-12T10:12:24.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.963+0000 7f380559d640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f380015fa00 con 0x7f380015d3c0 2023-12-12T10:12:24.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.963+0000 7f380559d640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f380015fc30 con 0x7f38000ce670 2023-12-12T10:12:24.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.963+0000 7f37f67fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f38000d1ae0 0x7f380015f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:24.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.963+0000 7f37f67fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f38000d1ae0 0x7f380015f4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47590/0 (socket says 172.21.15.78:47590) 2023-12-12T10:12:24.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.963+0000 7f37f67fc640 1 -- 172.21.15.78:0/850403393 learned_addr learned my addr 172.21.15.78:0/850403393 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:24.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.963+0000 7f37ff7fe640 1 --2- 172.21.15.78:0/850403393 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f380015d3c0 0x7f3800159640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:24.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.963+0000 7f37feffd640 1 --2- 172.21.15.78:0/850403393 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f38000ce670 0x7f38000cc7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:24.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.963+0000 7f37f67fc640 1 -- 172.21.15.78:0/850403393 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f38000ce670 msgr2=0x7f38000cc7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:24.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.963+0000 7f37f67fc640 1 --2- 172.21.15.78:0/850403393 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f38000ce670 0x7f38000cc7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:24.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.963+0000 7f37f67fc640 1 -- 172.21.15.78:0/850403393 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f380015d3c0 msgr2=0x7f3800159640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:24.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.963+0000 7f37f67fc640 1 --2- 172.21.15.78:0/850403393 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f380015d3c0 0x7f3800159640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:24.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.963+0000 7f37f67fc640 1 -- 172.21.15.78:0/850403393 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37e80094d0 con 0x7f38000d1ae0 2023-12-12T10:12:24.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.967+0000 7f37f67fc640 1 --2- 172.21.15.78:0/850403393 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f38000d1ae0 0x7f380015f4c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f37f000d800 tx=0x7f37f000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:24.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.967+0000 7f37f7fff640 1 -- 172.21.15.78:0/850403393 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37f000b6c0 con 0x7f38000d1ae0 2023-12-12T10:12:24.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.967+0000 7f37f7fff640 1 -- 172.21.15.78:0/850403393 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37f000b820 con 0x7f38000d1ae0 2023-12-12T10:12:24.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.967+0000 7f37f7fff640 1 -- 172.21.15.78:0/850403393 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37f000bbd0 con 0x7f38000d1ae0 2023-12-12T10:12:24.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.967+0000 7f380559d640 1 -- 172.21.15.78:0/850403393 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f380015ff10 con 0x7f38000d1ae0 2023-12-12T10:12:24.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.967+0000 7f380559d640 1 -- 172.21.15.78:0/850403393 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38001604d0 con 0x7f38000d1ae0 2023-12-12T10:12:24.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.967+0000 7f380559d640 1 -- 172.21.15.78:0/850403393 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3800067530 con 0x7f38000d1ae0 2023-12-12T10:12:24.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.967+0000 7f37f7fff640 1 -- 172.21.15.78:0/850403393 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f37f000bd30 con 0x7f38000d1ae0 2023-12-12T10:12:24.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.967+0000 7f37f7fff640 1 --2- 172.21.15.78:0/850403393 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f37e0066470 0x7f37e0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:24.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.967+0000 7f37f7fff640 1 -- 172.21.15.78:0/850403393 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f37f0084500 con 0x7f38000d1ae0 2023-12-12T10:12:24.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.967+0000 7f37feffd640 1 --2- 172.21.15.78:0/850403393 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f37e0066470 0x7f37e0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:24.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.971+0000 7f37feffd640 1 --2- 172.21.15.78:0/850403393 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f37e0066470 0x7f37e0068930 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f37e80b2000 tx=0x7f37e8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:24.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:24.971+0000 7f37f7fff640 1 -- 172.21.15.78:0/850403393 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f37f0051740 con 0x7f38000d1ae0 2023-12-12T10:12:25.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.127+0000 7f380559d640 1 -- 172.21.15.78:0/850403393 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f38000d1380 con 0x7f38000d1ae0 2023-12-12T10:12:25.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.127+0000 7f37f7fff640 1 -- 172.21.15.78:0/850403393 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18310 (secure 0 0 0) 0x7f37f0054d60 con 0x7f38000d1ae0 2023-12-12T10:12:25.132 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:12:25.132 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":24,"fsid":"fc81937c-bd26-483c-952b-d1324fcb0c9e","created":"2023-12-12T10:11:44.020214+0000","modified":"2023-12-12T10:12:14.355146+0000","last_up_change":"2023-12-12T10:11:56.278318+0000","last_in_change":"2023-12-12T10:11:46.553610+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T10:11:57.053584+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-12T10:12:07.454450+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-12T10:12:08.182909+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-12T10:12:11.977952+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"22dfdedf-5f6c-4b20-9f6c-30517a1db70a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6809","nonce":3345683600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6811","nonce":3345683600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6815","nonce":3345683600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6813","nonce":3345683600}]},"public_addr":"172.21.15.78:6809/3345683600","cluster_addr":"172.21.15.78:6811/3345683600","heartbeat_back_addr":"172.21.15.78:6815/3345683600","heartbeat_front_addr":"172.21.15.78:6813/3345683600","state":["exists","up"]},{"osd":1,"uuid":"be34a7f3-a69a-462e-9ddf-5e537448dba2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6801","nonce":962652768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6803","nonce":962652768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6807","nonce":962652768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6805","nonce":962652768}]},"public_addr":"172.21.15.78:6801/962652768","cluster_addr":"172.21.15.78:6803/962652768","heartbeat_back_addr":"172.21.15.78:6807/962652768","heartbeat_front_addr":"172.21.15.78:6805/962652768","state":["exists","up"]},{"osd":2,"uuid":"55b381de-5f56-4b14-80f7-e6e41e084a13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6818","nonce":2910206054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6822","nonce":2910206054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6829","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6831","nonce":2910206054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6826","nonce":2910206054}]},"public_addr":"172.21.15.78:6818/2910206054","cluster_addr":"172.21.15.78:6822/2910206054","heartbeat_back_addr":"172.21.15.78:6831/2910206054","heartbeat_front_addr":"172.21.15.78:6826/2910206054","state":["exists","up"]},{"osd":3,"uuid":"d7682de1-25cb-4cec-869f-8851c28b0e6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6819","nonce":3750796703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6821","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6823","nonce":3750796703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6830","nonce":3750796703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6825","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6827","nonce":3750796703}]},"public_addr":"172.21.15.78:6819/3750796703","cluster_addr":"172.21.15.78:6823/3750796703","heartbeat_back_addr":"172.21.15.78:6830/3750796703","heartbeat_front_addr":"172.21.15.78:6827/3750796703","state":["exists","up"]},{"osd":4,"uuid":"8279815a-d6c7-4199-871e-d28971b9dc07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6809","nonce":2944277204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6811","nonce":2944277204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6815","nonce":2944277204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6813","nonce":2944277204}]},"public_addr":"172.21.15.187:6809/2944277204","cluster_addr":"172.21.15.187:6811/2944277204","heartbeat_back_addr":"172.21.15.187:6815/2944277204","heartbeat_front_addr":"172.21.15.187:6813/2944277204","state":["exists","up"]},{"osd":5,"uuid":"0a714c65-f8ce-4340-968f-11a799677ef3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6801","nonce":185858620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6803","nonce":185858620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6807","nonce":185858620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6805","nonce":185858620}]},"public_addr":"172.21.15.187:6801/185858620","cluster_addr":"172.21.15.187:6803/185858620","heartbeat_back_addr":"172.21.15.187:6807/185858620","heartbeat_front_addr":"172.21.15.187:6805/185858620","state":["exists","up"]},{"osd":6,"uuid":"d0bba9ab-f7ee-449e-8999-1c0cf7e6d53c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6817","nonce":4213392126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6819","nonce":4213392126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6824","nonce":4213392126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6821","nonce":4213392126}]},"public_addr":"172.21.15.187:6817/4213392126","cluster_addr":"172.21.15.187:6819/4213392126","heartbeat_back_addr":"172.21.15.187:6824/4213392126","heartbeat_front_addr":"172.21.15.187:6821/4213392126","state":["exists","up"]},{"osd":7,"uuid":"efe5e0d9-2f87-4889-a27a-e2a95a632302","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6823","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6825","nonce":85774004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6827","nonce":85774004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6831","nonce":85774004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6829","nonce":85774004}]},"public_addr":"172.21.15.187:6825/85774004","cluster_addr":"172.21.15.187:6827/85774004","heartbeat_back_addr":"172.21.15.187:6831/85774004","heartbeat_front_addr":"172.21.15.187:6829/85774004","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.214447+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.448899+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.293107+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.564184+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.175026+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.097717+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.261141+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.287681+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T10:12:25.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.127+0000 7f380559d640 1 -- 172.21.15.78:0/850403393 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f37e0066470 msgr2=0x7f37e0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:25.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.127+0000 7f380559d640 1 --2- 172.21.15.78:0/850403393 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f37e0066470 0x7f37e0068930 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f37e80b2000 tx=0x7f37e8009040 comp rx=0 tx=0).stop 2023-12-12T10:12:25.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.127+0000 7f380559d640 1 -- 172.21.15.78:0/850403393 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f38000d1ae0 msgr2=0x7f380015f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:25.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.127+0000 7f380559d640 1 --2- 172.21.15.78:0/850403393 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f38000d1ae0 0x7f380015f4c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f37f000d800 tx=0x7f37f000dcc0 comp rx=0 tx=0).stop 2023-12-12T10:12:25.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.127+0000 7f380559d640 1 -- 172.21.15.78:0/850403393 shutdown_connections 2023-12-12T10:12:25.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.127+0000 7f380559d640 1 --2- 172.21.15.78:0/850403393 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f37e0066470 0x7f37e0068930 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:25.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.127+0000 7f380559d640 1 --2- 172.21.15.78:0/850403393 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f380015d3c0 0x7f3800159640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:25.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.127+0000 7f380559d640 1 --2- 172.21.15.78:0/850403393 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f38000d1ae0 0x7f380015f4c0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:25.135 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.127+0000 7f380559d640 1 --2- 172.21.15.78:0/850403393 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f38000ce670 0x7f38000cc7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:25.135 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.127+0000 7f380559d640 1 -- 172.21.15.78:0/850403393 >> 172.21.15.78:0/850403393 conn(0x7f380009c2a0 msgr2=0x7f38000b4d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:25.135 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.127+0000 7f380559d640 1 -- 172.21.15.78:0/850403393 shutdown_connections 2023-12-12T10:12:25.135 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.127+0000 7f380559d640 1 -- 172.21.15.78:0/850403393 wait complete. 2023-12-12T10:12:25.153 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T10:12:25.290 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.283+0000 7f1bb5e9a640 1 Processor -- start 2023-12-12T10:12:25.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.283+0000 7f1bb5e9a640 1 -- start start 2023-12-12T10:12:25.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.287+0000 7f1bb5e9a640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1bb01401a0 0x7f1bb00b2070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:25.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.287+0000 7f1bb5e9a640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f1bb0161900 0x7f1bb0160cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:25.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.287+0000 7f1bb5e9a640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bb00b4f10 con 0x7f1bb0161210 2023-12-12T10:12:25.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.287+0000 7f1bb5e9a640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bb00b4a80 con 0x7f1bb0161900 2023-12-12T10:12:25.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.287+0000 7f1bb5e9a640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bb0161630 con 0x7f1bb01401a0 2023-12-12T10:12:25.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.287+0000 7f1ba7fff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f1bb0161900 0x7f1bb0160cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:25.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.287+0000 7f1ba7fff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f1bb0161900 0x7f1bb0160cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47596/0 (socket says 172.21.15.78:47596) 2023-12-12T10:12:25.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.287+0000 7f1ba7fff640 1 -- 172.21.15.78:0/563847439 learned_addr learned my addr 172.21.15.78:0/563847439 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:25.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.287+0000 7f1baf7fe640 1 --2- 172.21.15.78:0/563847439 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1bb01401a0 0x7f1bb00b2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:25.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.287+0000 7f1ba7fff640 1 -- 172.21.15.78:0/563847439 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1bb01401a0 msgr2=0x7f1bb00b2070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:25.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.287+0000 7f1ba7fff640 1 --2- 172.21.15.78:0/563847439 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1bb01401a0 0x7f1bb00b2070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:25.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.287+0000 7f1ba7fff640 1 -- 172.21.15.78:0/563847439 >> v1:172.21.15.78:6789/0 conn(0x7f1bb0161210 legacy=0x7f1bb01427c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:25.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.287+0000 7f1ba7fff640 1 -- 172.21.15.78:0/563847439 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bb00b3bd0 con 0x7f1bb0161900 2023-12-12T10:12:25.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.291+0000 7f1ba7fff640 1 --2- 172.21.15.78:0/563847439 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1bb0161900 0x7f1bb0160cd0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1b98009870 tx=0x7f1b9801c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fff49939a720d173 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:25.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.291+0000 7f1baeffd640 1 -- 172.21.15.78:0/563847439 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b980a7070 con 0x7f1bb0161900 2023-12-12T10:12:25.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.291+0000 7f1baeffd640 1 -- 172.21.15.78:0/563847439 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b980ab430 con 0x7f1bb0161900 2023-12-12T10:12:25.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.291+0000 7f1baeffd640 1 -- 172.21.15.78:0/563847439 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b980ab7c0 con 0x7f1bb0161900 2023-12-12T10:12:25.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.291+0000 7f1bb5e9a640 1 -- 172.21.15.78:0/563847439 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1bb0161900 msgr2=0x7f1bb0160cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:25.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.291+0000 7f1bb5e9a640 1 --2- 172.21.15.78:0/563847439 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1bb0161900 0x7f1bb0160cd0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1b98009870 tx=0x7f1b9801c510 comp rx=0 tx=0).stop 2023-12-12T10:12:25.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.291+0000 7f1bb5e9a640 1 -- 172.21.15.78:0/563847439 shutdown_connections 2023-12-12T10:12:25.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.291+0000 7f1bb5e9a640 1 --2- 172.21.15.78:0/563847439 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1bb0161900 0x7f1bb0160cd0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:25.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.291+0000 7f1bb5e9a640 1 --2- 172.21.15.78:0/563847439 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1bb01401a0 0x7f1bb00b2070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:25.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.291+0000 7f1bb5e9a640 1 -- 172.21.15.78:0/563847439 >> 172.21.15.78:0/563847439 conn(0x7f1bb006c5d0 msgr2=0x7f1bb006c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:25.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.291+0000 7f1bb5e9a640 1 -- 172.21.15.78:0/563847439 shutdown_connections 2023-12-12T10:12:25.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.291+0000 7f1bb5e9a640 1 -- 172.21.15.78:0/563847439 wait complete. 2023-12-12T10:12:25.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.291+0000 7f1bb5e9a640 1 Processor -- start 2023-12-12T10:12:25.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.291+0000 7f1bb5e9a640 1 -- start start 2023-12-12T10:12:25.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.295+0000 7f1bb5e9a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1bb01401a0 0x7f1bb0135bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:25.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.295+0000 7f1bb5e9a640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1bb0161210 0x7f1bb013cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:25.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.295+0000 7f1bb5e9a640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1bb0161900 0x7f1bb0135310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:25.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.295+0000 7f1bb5e9a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bb00af8a0 con 0x7f1bb01401a0 2023-12-12T10:12:25.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.295+0000 7f1bb5e9a640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bb013b840 con 0x7f1bb0161210 2023-12-12T10:12:25.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.295+0000 7f1bb5e9a640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bb00af250 con 0x7f1bb0161900 2023-12-12T10:12:25.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.295+0000 7f1baf7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1bb01401a0 0x7f1bb0135bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:25.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.295+0000 7f1baf7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1bb01401a0 0x7f1bb0135bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47600/0 (socket says 172.21.15.78:47600) 2023-12-12T10:12:25.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.295+0000 7f1baf7fe640 1 -- 172.21.15.78:0/2702363625 learned_addr learned my addr 172.21.15.78:0/2702363625 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:25.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.295+0000 7f1ba7fff640 1 --2- 172.21.15.78:0/2702363625 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1bb0161210 0x7f1bb013cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:25.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.295+0000 7f1baffff640 1 --2- 172.21.15.78:0/2702363625 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1bb0161900 0x7f1bb0135310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:25.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.295+0000 7f1baf7fe640 1 -- 172.21.15.78:0/2702363625 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1bb0161900 msgr2=0x7f1bb0135310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:25.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.295+0000 7f1baf7fe640 1 --2- 172.21.15.78:0/2702363625 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1bb0161900 0x7f1bb0135310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:25.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.295+0000 7f1baf7fe640 1 -- 172.21.15.78:0/2702363625 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1bb0161210 msgr2=0x7f1bb013cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:25.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.295+0000 7f1baf7fe640 1 --2- 172.21.15.78:0/2702363625 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1bb0161210 0x7f1bb013cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:25.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.295+0000 7f1baf7fe640 1 -- 172.21.15.78:0/2702363625 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b980094d0 con 0x7f1bb01401a0 2023-12-12T10:12:25.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.295+0000 7f1baf7fe640 1 --2- 172.21.15.78:0/2702363625 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1bb01401a0 0x7f1bb0135bc0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f1ba000d800 tx=0x7f1ba000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:25.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.295+0000 7f1bacff9640 1 -- 172.21.15.78:0/2702363625 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ba000b6c0 con 0x7f1bb01401a0 2023-12-12T10:12:25.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.295+0000 7f1bacff9640 1 -- 172.21.15.78:0/2702363625 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ba000b820 con 0x7f1bb01401a0 2023-12-12T10:12:25.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.295+0000 7f1bb5e9a640 1 -- 172.21.15.78:0/2702363625 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bb00af530 con 0x7f1bb01401a0 2023-12-12T10:12:25.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.295+0000 7f1bacff9640 1 -- 172.21.15.78:0/2702363625 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ba000bb90 con 0x7f1bb01401a0 2023-12-12T10:12:25.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.295+0000 7f1bb5e9a640 1 -- 172.21.15.78:0/2702363625 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bb013d3e0 con 0x7f1bb01401a0 2023-12-12T10:12:25.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.295+0000 7f1bb5e9a640 1 -- 172.21.15.78:0/2702363625 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bb00671f0 con 0x7f1bb01401a0 2023-12-12T10:12:25.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.295+0000 7f1bacff9640 1 -- 172.21.15.78:0/2702363625 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f1ba000bcf0 con 0x7f1bb01401a0 2023-12-12T10:12:25.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.299+0000 7f1bacff9640 1 --2- 172.21.15.78:0/2702363625 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f1b90066470 0x7f1b90068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:25.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.299+0000 7f1bacff9640 1 -- 172.21.15.78:0/2702363625 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1ba00846e0 con 0x7f1bb01401a0 2023-12-12T10:12:25.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.299+0000 7f1ba7fff640 1 --2- 172.21.15.78:0/2702363625 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f1b90066470 0x7f1b90068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:25.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.299+0000 7f1ba7fff640 1 --2- 172.21.15.78:0/2702363625 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f1b90066470 0x7f1b90068930 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1b980af000 tx=0x7f1b98008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:25.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.303+0000 7f1bacff9640 1 -- 172.21.15.78:0/2702363625 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1ba0051870 con 0x7f1bb01401a0 2023-12-12T10:12:25.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.451+0000 7f1bb5e9a640 1 -- 172.21.15.78:0/2702363625 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1bb0067530 con 0x7f1bb01401a0 2023-12-12T10:12:25.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.455+0000 7f1bacff9640 1 -- 172.21.15.78:0/2702363625 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18310 (secure 0 0 0) 0x7f1ba0054e90 con 0x7f1bb01401a0 2023-12-12T10:12:25.460 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:12:25.460 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":24,"fsid":"fc81937c-bd26-483c-952b-d1324fcb0c9e","created":"2023-12-12T10:11:44.020214+0000","modified":"2023-12-12T10:12:14.355146+0000","last_up_change":"2023-12-12T10:11:56.278318+0000","last_in_change":"2023-12-12T10:11:46.553610+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T10:11:57.053584+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-12T10:12:07.454450+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-12T10:12:08.182909+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-12T10:12:11.977952+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"22dfdedf-5f6c-4b20-9f6c-30517a1db70a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6809","nonce":3345683600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6811","nonce":3345683600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6815","nonce":3345683600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6813","nonce":3345683600}]},"public_addr":"172.21.15.78:6809/3345683600","cluster_addr":"172.21.15.78:6811/3345683600","heartbeat_back_addr":"172.21.15.78:6815/3345683600","heartbeat_front_addr":"172.21.15.78:6813/3345683600","state":["exists","up"]},{"osd":1,"uuid":"be34a7f3-a69a-462e-9ddf-5e537448dba2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6801","nonce":962652768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6803","nonce":962652768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6807","nonce":962652768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6805","nonce":962652768}]},"public_addr":"172.21.15.78:6801/962652768","cluster_addr":"172.21.15.78:6803/962652768","heartbeat_back_addr":"172.21.15.78:6807/962652768","heartbeat_front_addr":"172.21.15.78:6805/962652768","state":["exists","up"]},{"osd":2,"uuid":"55b381de-5f56-4b14-80f7-e6e41e084a13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6818","nonce":2910206054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6822","nonce":2910206054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6829","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6831","nonce":2910206054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6826","nonce":2910206054}]},"public_addr":"172.21.15.78:6818/2910206054","cluster_addr":"172.21.15.78:6822/2910206054","heartbeat_back_addr":"172.21.15.78:6831/2910206054","heartbeat_front_addr":"172.21.15.78:6826/2910206054","state":["exists","up"]},{"osd":3,"uuid":"d7682de1-25cb-4cec-869f-8851c28b0e6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6819","nonce":3750796703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6821","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6823","nonce":3750796703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6830","nonce":3750796703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6825","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6827","nonce":3750796703}]},"public_addr":"172.21.15.78:6819/3750796703","cluster_addr":"172.21.15.78:6823/3750796703","heartbeat_back_addr":"172.21.15.78:6830/3750796703","heartbeat_front_addr":"172.21.15.78:6827/3750796703","state":["exists","up"]},{"osd":4,"uuid":"8279815a-d6c7-4199-871e-d28971b9dc07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6809","nonce":2944277204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6811","nonce":2944277204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6815","nonce":2944277204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6813","nonce":2944277204}]},"public_addr":"172.21.15.187:6809/2944277204","cluster_addr":"172.21.15.187:6811/2944277204","heartbeat_back_addr":"172.21.15.187:6815/2944277204","heartbeat_front_addr":"172.21.15.187:6813/2944277204","state":["exists","up"]},{"osd":5,"uuid":"0a714c65-f8ce-4340-968f-11a799677ef3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6801","nonce":185858620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6803","nonce":185858620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6807","nonce":185858620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6805","nonce":185858620}]},"public_addr":"172.21.15.187:6801/185858620","cluster_addr":"172.21.15.187:6803/185858620","heartbeat_back_addr":"172.21.15.187:6807/185858620","heartbeat_front_addr":"172.21.15.187:6805/185858620","state":["exists","up"]},{"osd":6,"uuid":"d0bba9ab-f7ee-449e-8999-1c0cf7e6d53c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6817","nonce":4213392126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6819","nonce":4213392126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6824","nonce":4213392126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6821","nonce":4213392126}]},"public_addr":"172.21.15.187:6817/4213392126","cluster_addr":"172.21.15.187:6819/4213392126","heartbeat_back_addr":"172.21.15.187:6824/4213392126","heartbeat_front_addr":"172.21.15.187:6821/4213392126","state":["exists","up"]},{"osd":7,"uuid":"efe5e0d9-2f87-4889-a27a-e2a95a632302","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6823","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6825","nonce":85774004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6827","nonce":85774004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6831","nonce":85774004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6829","nonce":85774004}]},"public_addr":"172.21.15.187:6825/85774004","cluster_addr":"172.21.15.187:6827/85774004","heartbeat_back_addr":"172.21.15.187:6831/85774004","heartbeat_front_addr":"172.21.15.187:6829/85774004","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.214447+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.448899+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.293107+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.564184+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.175026+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.097717+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.261141+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.287681+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T10:12:25.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.455+0000 7f1bb5e9a640 1 -- 172.21.15.78:0/2702363625 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f1b90066470 msgr2=0x7f1b90068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:25.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.455+0000 7f1bb5e9a640 1 --2- 172.21.15.78:0/2702363625 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f1b90066470 0x7f1b90068930 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1b980af000 tx=0x7f1b98008040 comp rx=0 tx=0).stop 2023-12-12T10:12:25.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.455+0000 7f1bb5e9a640 1 -- 172.21.15.78:0/2702363625 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1bb01401a0 msgr2=0x7f1bb0135bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:25.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.455+0000 7f1bb5e9a640 1 --2- 172.21.15.78:0/2702363625 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1bb01401a0 0x7f1bb0135bc0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f1ba000d800 tx=0x7f1ba000dcc0 comp rx=0 tx=0).stop 2023-12-12T10:12:25.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.455+0000 7f1bb5e9a640 1 -- 172.21.15.78:0/2702363625 shutdown_connections 2023-12-12T10:12:25.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.455+0000 7f1bb5e9a640 1 --2- 172.21.15.78:0/2702363625 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f1b90066470 0x7f1b90068930 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:25.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.455+0000 7f1bb5e9a640 1 --2- 172.21.15.78:0/2702363625 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1bb0161900 0x7f1bb0135310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:25.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.455+0000 7f1bb5e9a640 1 --2- 172.21.15.78:0/2702363625 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1bb0161210 0x7f1bb013cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:25.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.455+0000 7f1bb5e9a640 1 --2- 172.21.15.78:0/2702363625 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1bb01401a0 0x7f1bb0135bc0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:25.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.455+0000 7f1bb5e9a640 1 -- 172.21.15.78:0/2702363625 >> 172.21.15.78:0/2702363625 conn(0x7f1bb006c5d0 msgr2=0x7f1bb015f1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:25.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.455+0000 7f1bb5e9a640 1 -- 172.21.15.78:0/2702363625 shutdown_connections 2023-12-12T10:12:25.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.455+0000 7f1bb5e9a640 1 -- 172.21.15.78:0/2702363625 wait complete. 2023-12-12T10:12:25.482 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-12T10:12:25.621 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.615+0000 7fdbcd99d640 1 Processor -- start 2023-12-12T10:12:25.622 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.615+0000 7fdbcd99d640 1 -- start start 2023-12-12T10:12:25.623 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.619+0000 7fdbcd99d640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdbc8071610 0x7fdbc8164ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:25.623 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.619+0000 7fdbcd99d640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbc8070a70 con 0x7fdbc80cdf60 2023-12-12T10:12:25.623 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.619+0000 7fdbcd99d640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbc80ce3c0 con 0x7fdbc8143770 2023-12-12T10:12:25.623 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.619+0000 7fdbcd99d640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc815e920 con 0x7fdbc8071610 2023-12-12T10:12:25.624 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.619+0000 7fdbbe7fc640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fdbc80cdf60 0x7fdbc8070f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:44318/0 (socket says 172.21.15.78:44318) 2023-12-12T10:12:25.624 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.619+0000 7fdbbe7fc640 1 -- 172.21.15.78:0/1774542351 learned_addr learned my addr 172.21.15.78:0/1774542351 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-12-12T10:12:25.624 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.619+0000 7fdbc77fe640 1 --2- 172.21.15.78:0/1774542351 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdbc8071610 0x7fdbc8164ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:25.624 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.619+0000 7fdbc67fc640 1 -- 172.21.15.78:0/1774542351 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3584976139 0 0) 0x7fdbc8070a70 con 0x7fdbc80cdf60 2023-12-12T10:12:25.624 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.619+0000 7fdbc67fc640 1 -- 172.21.15.78:0/1774542351 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdbb4003530 con 0x7fdbc80cdf60 2023-12-12T10:12:25.624 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.619+0000 7fdbc67fc640 1 -- 172.21.15.78:0/1774542351 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1035137863 0 0) 0x7fdbc80ce3c0 con 0x7fdbc8143770 2023-12-12T10:12:25.624 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.619+0000 7fdbc67fc640 1 -- 172.21.15.78:0/1774542351 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdbc8070a70 con 0x7fdbc8143770 2023-12-12T10:12:25.624 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.619+0000 7fdbc77fe640 1 -- 172.21.15.78:0/1774542351 >> v1:172.21.15.187:6789/0 conn(0x7fdbc8143770 legacy=0x7fdbc80b1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:25.624 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.619+0000 7fdbc67fc640 1 -- 172.21.15.78:0/1774542351 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2713138213 0 0) 0x7fdbb4003530 con 0x7fdbc80cdf60 2023-12-12T10:12:25.624 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.619+0000 7fdbc77fe640 1 -- 172.21.15.78:0/1774542351 >> v1:172.21.15.78:6789/0 conn(0x7fdbc80cdf60 legacy=0x7fdbc8070f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:25.624 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.619+0000 7fdbc77fe640 1 -- 172.21.15.78:0/1774542351 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbc8070440 con 0x7fdbc8071610 2023-12-12T10:12:25.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.623+0000 7fdbc77fe640 1 --2- 172.21.15.78:0/1774542351 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdbc8071610 0x7fdbc8164ca0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fdbc0009dc0 tx=0x7fdbc001c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2c0187178092c3bb server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:25.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.623+0000 7fdbc67fc640 1 -- 172.21.15.78:0/1774542351 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbb8001680 con 0x7fdbc8071610 2023-12-12T10:12:25.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.623+0000 7fdbc67fc640 1 -- 172.21.15.78:0/1774542351 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbc00a5640 con 0x7fdbc8071610 2023-12-12T10:12:25.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.623+0000 7fdbc67fc640 1 -- 172.21.15.78:0/1774542351 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbc00a59b0 con 0x7fdbc8071610 2023-12-12T10:12:25.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.623+0000 7fdbcd99d640 1 -- 172.21.15.78:0/1774542351 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdbc8071610 msgr2=0x7fdbc8164ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:25.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.623+0000 7fdbcd99d640 1 --2- 172.21.15.78:0/1774542351 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdbc8071610 0x7fdbc8164ca0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fdbc0009dc0 tx=0x7fdbc001c800 comp rx=0 tx=0).stop 2023-12-12T10:12:25.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.623+0000 7fdbcd99d640 1 -- 172.21.15.78:0/1774542351 shutdown_connections 2023-12-12T10:12:25.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.623+0000 7fdbcd99d640 1 --2- 172.21.15.78:0/1774542351 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdbc8071610 0x7fdbc8164ca0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:25.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.623+0000 7fdbcd99d640 1 -- 172.21.15.78:0/1774542351 >> 172.21.15.78:0/1774542351 conn(0x7fdbc806a710 msgr2=0x7fdbc806ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:25.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.623+0000 7fdbcd99d640 1 -- 172.21.15.78:0/1774542351 shutdown_connections 2023-12-12T10:12:25.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.623+0000 7fdbcd99d640 1 -- 172.21.15.78:0/1774542351 wait complete. 2023-12-12T10:12:25.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.623+0000 7fdbcd99d640 1 Processor -- start 2023-12-12T10:12:25.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.623+0000 7fdbcd99d640 1 -- start start 2023-12-12T10:12:25.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.627+0000 7fdbcd99d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdbc8071610 0x7fdbc815c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:25.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.627+0000 7fdbcd99d640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdbc80cdf60 0x7fdbc81327d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:25.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.627+0000 7fdbcd99d640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdbc8143770 0x7fdbc813d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:25.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.627+0000 7fdbcd99d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc813c190 con 0x7fdbc8071610 2023-12-12T10:12:25.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.627+0000 7fdbcd99d640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc813c470 con 0x7fdbc80cdf60 2023-12-12T10:12:25.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.627+0000 7fdbcd99d640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc813c750 con 0x7fdbc8143770 2023-12-12T10:12:25.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.627+0000 7fdbc6ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdbc8071610 0x7fdbc815c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:25.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.627+0000 7fdbc6ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdbc8071610 0x7fdbc815c710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47604/0 (socket says 172.21.15.78:47604) 2023-12-12T10:12:25.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.627+0000 7fdbc6ffd640 1 -- 172.21.15.78:0/1308399037 learned_addr learned my addr 172.21.15.78:0/1308399037 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:25.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.627+0000 7fdbc77fe640 1 --2- 172.21.15.78:0/1308399037 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdbc8143770 0x7fdbc813d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:25.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.627+0000 7fdbbe7fc640 1 --2- 172.21.15.78:0/1308399037 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdbc80cdf60 0x7fdbc81327d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:25.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.627+0000 7fdbc6ffd640 1 -- 172.21.15.78:0/1308399037 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdbc8143770 msgr2=0x7fdbc813d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:25.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.627+0000 7fdbc6ffd640 1 --2- 172.21.15.78:0/1308399037 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdbc8143770 0x7fdbc813d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:25.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.627+0000 7fdbc6ffd640 1 -- 172.21.15.78:0/1308399037 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdbc80cdf60 msgr2=0x7fdbc81327d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:25.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.627+0000 7fdbc6ffd640 1 --2- 172.21.15.78:0/1308399037 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdbc80cdf60 0x7fdbc81327d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:25.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.627+0000 7fdbc6ffd640 1 -- 172.21.15.78:0/1308399037 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbc0009a70 con 0x7fdbc8071610 2023-12-12T10:12:25.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.627+0000 7fdbc6ffd640 1 --2- 172.21.15.78:0/1308399037 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdbc8071610 0x7fdbc815c710 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fdbb000c430 tx=0x7fdbb000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:25.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.627+0000 7fdbc4ff9640 1 -- 172.21.15.78:0/1308399037 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbb00052d0 con 0x7fdbc8071610 2023-12-12T10:12:25.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.627+0000 7fdbc4ff9640 1 -- 172.21.15.78:0/1308399037 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbb0005450 con 0x7fdbc8071610 2023-12-12T10:12:25.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.627+0000 7fdbc4ff9640 1 -- 172.21.15.78:0/1308399037 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbb0003840 con 0x7fdbc8071610 2023-12-12T10:12:25.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.627+0000 7fdbcd99d640 1 -- 172.21.15.78:0/1308399037 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbc813ca30 con 0x7fdbc8071610 2023-12-12T10:12:25.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.627+0000 7fdbcd99d640 1 -- 172.21.15.78:0/1308399037 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbc813be40 con 0x7fdbc8071610 2023-12-12T10:12:25.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.627+0000 7fdbcd99d640 1 -- 172.21.15.78:0/1308399037 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbc80671f0 con 0x7fdbc8071610 2023-12-12T10:12:25.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.627+0000 7fdbc4ff9640 1 -- 172.21.15.78:0/1308399037 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fdbb00039a0 con 0x7fdbc8071610 2023-12-12T10:12:25.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.631+0000 7fdbc4ff9640 1 --2- 172.21.15.78:0/1308399037 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fdba8066470 0x7fdba8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:25.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.631+0000 7fdbc4ff9640 1 -- 172.21.15.78:0/1308399037 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fdbb0083770 con 0x7fdbc8071610 2023-12-12T10:12:25.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.631+0000 7fdbbe7fc640 1 --2- 172.21.15.78:0/1308399037 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fdba8066470 0x7fdba8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:25.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.631+0000 7fdbbe7fc640 1 --2- 172.21.15.78:0/1308399037 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fdba8066470 0x7fdba8068930 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fdbc80b33b0 tx=0x7fdbb80016a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:25.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.635+0000 7fdbc4ff9640 1 -- 172.21.15.78:0/1308399037 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fdbb0050910 con 0x7fdbc8071610 2023-12-12T10:12:25.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.815+0000 7fdbcd99d640 1 -- 172.21.15.78:0/1308399037 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fdbc8067530 con 0x7fdbc8071610 2023-12-12T10:12:25.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.931+0000 7fdbc4ff9640 1 -- 172.21.15.78:0/1308399037 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) v1 ==== 118+0+0 (secure 0 0 0) 0x7fdbb0053f30 con 0x7fdbc8071610 2023-12-12T10:12:25.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.935+0000 7fdbcd99d640 1 -- 172.21.15.78:0/1308399037 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fdba8066470 msgr2=0x7fdba8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:25.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.935+0000 7fdbcd99d640 1 --2- 172.21.15.78:0/1308399037 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fdba8066470 0x7fdba8068930 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fdbc80b33b0 tx=0x7fdbb80016a0 comp rx=0 tx=0).stop 2023-12-12T10:12:25.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.935+0000 7fdbcd99d640 1 -- 172.21.15.78:0/1308399037 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdbc8071610 msgr2=0x7fdbc815c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:25.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.935+0000 7fdbcd99d640 1 --2- 172.21.15.78:0/1308399037 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdbc8071610 0x7fdbc815c710 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fdbb000c430 tx=0x7fdbb000c8f0 comp rx=0 tx=0).stop 2023-12-12T10:12:25.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.935+0000 7fdbcd99d640 1 -- 172.21.15.78:0/1308399037 shutdown_connections 2023-12-12T10:12:25.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.935+0000 7fdbcd99d640 1 --2- 172.21.15.78:0/1308399037 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fdba8066470 0x7fdba8068930 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:25.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.935+0000 7fdbcd99d640 1 --2- 172.21.15.78:0/1308399037 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdbc8143770 0x7fdbc813d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:25.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.935+0000 7fdbcd99d640 1 --2- 172.21.15.78:0/1308399037 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdbc80cdf60 0x7fdbc81327d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:25.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.935+0000 7fdbcd99d640 1 --2- 172.21.15.78:0/1308399037 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdbc8071610 0x7fdbc815c710 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:25.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.935+0000 7fdbcd99d640 1 -- 172.21.15.78:0/1308399037 >> 172.21.15.78:0/1308399037 conn(0x7fdbc806a710 msgr2=0x7fdbc813b340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:25.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.935+0000 7fdbcd99d640 1 -- 172.21.15.78:0/1308399037 shutdown_connections 2023-12-12T10:12:25.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:25.935+0000 7fdbcd99d640 1 -- 172.21.15.78:0/1308399037 wait complete. 2023-12-12T10:12:25.959 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2023-12-12T10:12:25.959 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-12T10:12:26.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:26.091+0000 7f766c2ea640 1 Processor -- start 2023-12-12T10:12:26.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:26.091+0000 7f766c2ea640 1 -- start start 2023-12-12T10:12:26.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:26.095+0000 7f766c2ea640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f76640cb4b0 0x7f766415f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:26.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:26.095+0000 7f766c2ea640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76640cea30 con 0x7f766406c850 2023-12-12T10:12:26.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:26.095+0000 7f766c2ea640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f766415bfc0 con 0x7f766415baa0 2023-12-12T10:12:26.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:26.095+0000 7f766c2ea640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f766415c2a0 con 0x7f76640cb4b0 2023-12-12T10:12:26.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:26.095+0000 7f766a086640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f76640cb4b0 0x7f766415f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:26.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:26.095+0000 7f766a086640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f76640cb4b0 0x7f766415f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47606/0 (socket says 172.21.15.78:47606) 2023-12-12T10:12:26.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:26.095+0000 7f766a086640 1 -- 172.21.15.78:0/2189992204 learned_addr learned my addr 172.21.15.78:0/2189992204 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:26.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:26.095+0000 7f766a086640 1 -- 172.21.15.78:0/2189992204 >> v1:172.21.15.187:6789/0 conn(0x7f766415baa0 legacy=0x7f76640714e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:26.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:26.095+0000 7f766a086640 1 -- 172.21.15.78:0/2189992204 >> v1:172.21.15.78:6789/0 conn(0x7f766406c850 legacy=0x7f766415b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:26.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:26.095+0000 7f766a086640 1 -- 172.21.15.78:0/2189992204 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f766415ea20 con 0x7f76640cb4b0 2023-12-12T10:12:26.103 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:26.099+0000 7f766a086640 1 --2- 172.21.15.78:0/2189992204 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f76640cb4b0 0x7f766415f500 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f7660009870 tx=0x7f766001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=421cda0fdfee4164 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:26.103 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:26.099+0000 7f7669084640 1 -- 172.21.15.78:0/2189992204 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76600ab680 con 0x7f76640cb4b0 2023-12-12T10:12:26.103 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:26.099+0000 7f7669084640 1 -- 172.21.15.78:0/2189992204 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76600ab7e0 con 0x7f76640cb4b0 2023-12-12T10:12:26.103 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:26.099+0000 7f7669084640 1 -- 172.21.15.78:0/2189992204 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76600abb70 con 0x7f76640cb4b0 2023-12-12T10:12:26.104 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:26.099+0000 7f766c2ea640 1 -- 172.21.15.78:0/2189992204 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f76640cb4b0 msgr2=0x7f766415f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:26.104 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:26.099+0000 7f766c2ea640 1 --2- 172.21.15.78:0/2189992204 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f76640cb4b0 0x7f766415f500 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f7660009870 tx=0x7f766001c480 comp rx=0 tx=0).stop 2023-12-12T10:12:26.104 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:26.099+0000 7f766c2ea640 1 -- 172.21.15.78:0/2189992204 shutdown_connections 2023-12-12T10:12:26.104 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:26.099+0000 7f766c2ea640 1 --2- 172.21.15.78:0/2189992204 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f76640cb4b0 0x7f766415f500 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:26.104 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:26.099+0000 7f766c2ea640 1 -- 172.21.15.78:0/2189992204 >> 172.21.15.78:0/2189992204 conn(0x7f766406a710 msgr2=0x7f766406ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:26.104 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:26.099+0000 7f766c2ea640 1 -- 172.21.15.78:0/2189992204 shutdown_connections 2023-12-12T10:12:26.105 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:26.099+0000 7f766c2ea640 1 -- 172.21.15.78:0/2189992204 wait complete. 2023-12-12T10:12:26.106 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:26.099+0000 7f766c2ea640 1 Processor -- start 2023-12-12T10:12:26.106 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:26.099+0000 7f766c2ea640 1 -- start start 2023-12-12T10:12:26.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:26.103+0000 7f766c2ea640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f766406c850 0x7f76640af2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:26.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:26.103+0000 7f766c2ea640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f76640cb4b0 0x7f7664146990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:26.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:26.103+0000 7f766c2ea640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f766415baa0 0x7f7664146ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:26.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:26.103+0000 7f766c2ea640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7664152c30 con 0x7f766415baa0 2023-12-12T10:12:26.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:26.103+0000 7f766c2ea640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7664147410 con 0x7f76640cb4b0 2023-12-12T10:12:26.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:26.103+0000 7f766c2ea640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76641531b0 con 0x7f766406c850 2023-12-12T10:12:26.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:26.103+0000 7f766a887640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f766415baa0 0x7f7664146ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:26.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:26.103+0000 7f766a887640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f766415baa0 0x7f7664146ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47614/0 (socket says 172.21.15.78:47614) 2023-12-12T10:12:26.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:26.103+0000 7f766a887640 1 -- 172.21.15.78:0/1232550616 learned_addr learned my addr 172.21.15.78:0/1232550616 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:26.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:26.103+0000 7f766a086640 1 --2- 172.21.15.78:0/1232550616 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f766406c850 0x7f76640af2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:26.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:26.103+0000 7f7669885640 1 --2- 172.21.15.78:0/1232550616 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f76640cb4b0 0x7f7664146990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:26.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:26.103+0000 7f766a887640 1 -- 172.21.15.78:0/1232550616 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f766406c850 msgr2=0x7f76640af2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:26.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:26.103+0000 7f766a887640 1 --2- 172.21.15.78:0/1232550616 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f766406c850 0x7f76640af2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:26.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:26.103+0000 7f766a887640 1 -- 172.21.15.78:0/1232550616 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f76640cb4b0 msgr2=0x7f7664146990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:26.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:26.103+0000 7f766a887640 1 --2- 172.21.15.78:0/1232550616 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f76640cb4b0 0x7f7664146990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:26.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:26.103+0000 7f766a887640 1 -- 172.21.15.78:0/1232550616 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76600094d0 con 0x7f766415baa0 2023-12-12T10:12:26.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:26.103+0000 7f766a086640 1 --2- 172.21.15.78:0/1232550616 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f766406c850 0x7f76640af2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T10:12:26.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:26.103+0000 7f7669885640 1 --2- 172.21.15.78:0/1232550616 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f76640cb4b0 0x7f7664146990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T10:12:26.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:26.103+0000 7f766a887640 1 --2- 172.21.15.78:0/1232550616 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f766415baa0 0x7f7664146ed0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f765c00c730 tx=0x7f765c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:26.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:26.103+0000 7f765affd640 1 -- 172.21.15.78:0/1232550616 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f765c003b80 con 0x7f766415baa0 2023-12-12T10:12:26.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:26.103+0000 7f765affd640 1 -- 172.21.15.78:0/1232550616 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f765c003ce0 con 0x7f766415baa0 2023-12-12T10:12:26.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:26.103+0000 7f765affd640 1 -- 172.21.15.78:0/1232550616 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f765c005310 con 0x7f766415baa0 2023-12-12T10:12:26.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:26.103+0000 7f766c2ea640 1 -- 172.21.15.78:0/1232550616 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f766414af10 con 0x7f766415baa0 2023-12-12T10:12:26.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:26.103+0000 7f766c2ea640 1 -- 172.21.15.78:0/1232550616 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7664152e40 con 0x7f766415baa0 2023-12-12T10:12:26.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:26.103+0000 7f766c2ea640 1 -- 172.21.15.78:0/1232550616 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76640671f0 con 0x7f766415baa0 2023-12-12T10:12:26.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:26.103+0000 7f765affd640 1 -- 172.21.15.78:0/1232550616 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f765c005680 con 0x7f766415baa0 2023-12-12T10:12:26.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:26.107+0000 7f765affd640 1 --2- 172.21.15.78:0/1232550616 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f76480664a0 0x7f7648068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:26.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:26.107+0000 7f765affd640 1 -- 172.21.15.78:0/1232550616 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f765c084130 con 0x7f766415baa0 2023-12-12T10:12:26.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:26.107+0000 7f766a086640 1 --2- 172.21.15.78:0/1232550616 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f76480664a0 0x7f7648068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:26.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:26.107+0000 7f766a086640 1 --2- 172.21.15.78:0/1232550616 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f76480664a0 0x7f7648068960 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f76600af000 tx=0x7f76600a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:26.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:26.111+0000 7f765affd640 1 -- 172.21.15.78:0/1232550616 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f765c051220 con 0x7f766415baa0 2023-12-12T10:12:26.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:26.291+0000 7f766c2ea640 1 -- 172.21.15.78:0/1232550616 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f7664153320 con 0x7f766415baa0 2023-12-12T10:12:26.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:26.935+0000 7f765affd640 1 -- 172.21.15.78:0/1232550616 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) v1 ==== 122+0+0 (secure 0 0 0) 0x7f765c054840 con 0x7f766415baa0 2023-12-12T10:12:26.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:26.935+0000 7f766c2ea640 1 -- 172.21.15.78:0/1232550616 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f76480664a0 msgr2=0x7f7648068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:26.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:26.935+0000 7f766c2ea640 1 --2- 172.21.15.78:0/1232550616 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f76480664a0 0x7f7648068960 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f76600af000 tx=0x7f76600a7000 comp rx=0 tx=0).stop 2023-12-12T10:12:26.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:26.935+0000 7f766c2ea640 1 -- 172.21.15.78:0/1232550616 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f766415baa0 msgr2=0x7f7664146ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:26.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:26.935+0000 7f766c2ea640 1 --2- 172.21.15.78:0/1232550616 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f766415baa0 0x7f7664146ed0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f765c00c730 tx=0x7f765c00cbf0 comp rx=0 tx=0).stop 2023-12-12T10:12:26.943 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:26.935+0000 7f766c2ea640 1 -- 172.21.15.78:0/1232550616 shutdown_connections 2023-12-12T10:12:26.943 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:26.935+0000 7f766c2ea640 1 --2- 172.21.15.78:0/1232550616 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f76480664a0 0x7f7648068960 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:26.943 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:26.935+0000 7f766c2ea640 1 --2- 172.21.15.78:0/1232550616 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f766415baa0 0x7f7664146ed0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:26.943 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:26.935+0000 7f766c2ea640 1 --2- 172.21.15.78:0/1232550616 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f76640cb4b0 0x7f7664146990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:26.943 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:26.935+0000 7f766c2ea640 1 --2- 172.21.15.78:0/1232550616 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f766406c850 0x7f76640af2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:26.943 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:26.935+0000 7f766c2ea640 1 -- 172.21.15.78:0/1232550616 >> 172.21.15.78:0/1232550616 conn(0x7f766406a710 msgr2=0x7f76640b02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:26.943 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:26.935+0000 7f766c2ea640 1 -- 172.21.15.78:0/1232550616 shutdown_connections 2023-12-12T10:12:26.943 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:26.935+0000 7f766c2ea640 1 -- 172.21.15.78:0/1232550616 wait complete. 2023-12-12T10:12:26.964 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-12-12T10:12:26.964 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-12T10:12:27.105 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.099+0000 7fa3e94ad640 1 Processor -- start 2023-12-12T10:12:27.106 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.099+0000 7fa3e94ad640 1 -- start start 2023-12-12T10:12:27.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.103+0000 7fa3e94ad640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa3e4161900 0x7fa3e4160cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:27.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.103+0000 7fa3e94ad640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa3e4161210 0x7fa3e40ac880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:27.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.103+0000 7fa3e94ad640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3e40b4f10 con 0x7fa3e41401a0 2023-12-12T10:12:27.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.103+0000 7fa3e94ad640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3e40b4a80 con 0x7fa3e4161210 2023-12-12T10:12:27.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.103+0000 7fa3e94ad640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e40b2780 con 0x7fa3e4161900 2023-12-12T10:12:27.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.103+0000 7fa3e37fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa3e4161210 0x7fa3e40ac880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:27.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.103+0000 7fa3e37fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa3e4161210 0x7fa3e40ac880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47626/0 (socket says 172.21.15.78:47626) 2023-12-12T10:12:27.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.103+0000 7fa3e37fe640 1 -- 172.21.15.78:0/2895800278 learned_addr learned my addr 172.21.15.78:0/2895800278 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:27.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.103+0000 7fa3dbfff640 1 --2- 172.21.15.78:0/2895800278 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa3e4161900 0x7fa3e4160cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:27.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.103+0000 7fa3e37fe640 1 -- 172.21.15.78:0/2895800278 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa3e4161900 msgr2=0x7fa3e4160cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:27.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.103+0000 7fa3e37fe640 1 --2- 172.21.15.78:0/2895800278 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa3e4161900 0x7fa3e4160cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:27.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.103+0000 7fa3e37fe640 1 -- 172.21.15.78:0/2895800278 >> v1:172.21.15.187:6789/0 conn(0x7fa3e41401a0 legacy=0x7fa3e40b2070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:27.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.103+0000 7fa3e37fe640 1 -- 172.21.15.78:0/2895800278 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3e4161630 con 0x7fa3e4161210 2023-12-12T10:12:27.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.107+0000 7fa3e37fe640 1 --2- 172.21.15.78:0/2895800278 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3e4161210 0x7fa3e40ac880 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fa3dc009e50 tx=0x7fa3dc01ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=249e8a3c36915234 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:27.111 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.107+0000 7fa3e27fc640 1 -- 172.21.15.78:0/2895800278 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3dc0a57d0 con 0x7fa3e4161210 2023-12-12T10:12:27.111 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.107+0000 7fa3e27fc640 1 -- 172.21.15.78:0/2895800278 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3dc0a5930 con 0x7fa3e4161210 2023-12-12T10:12:27.111 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.107+0000 7fa3e27fc640 1 -- 172.21.15.78:0/2895800278 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3dc0a5cc0 con 0x7fa3e4161210 2023-12-12T10:12:27.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.107+0000 7fa3e94ad640 1 -- 172.21.15.78:0/2895800278 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3e4161210 msgr2=0x7fa3e40ac880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:27.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.107+0000 7fa3e94ad640 1 --2- 172.21.15.78:0/2895800278 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3e4161210 0x7fa3e40ac880 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fa3dc009e50 tx=0x7fa3dc01ca10 comp rx=0 tx=0).stop 2023-12-12T10:12:27.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.107+0000 7fa3e94ad640 1 -- 172.21.15.78:0/2895800278 shutdown_connections 2023-12-12T10:12:27.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.107+0000 7fa3e94ad640 1 --2- 172.21.15.78:0/2895800278 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3e4161210 0x7fa3e40ac880 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:27.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.107+0000 7fa3e94ad640 1 --2- 172.21.15.78:0/2895800278 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa3e4161900 0x7fa3e4160cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:27.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.107+0000 7fa3e94ad640 1 -- 172.21.15.78:0/2895800278 >> 172.21.15.78:0/2895800278 conn(0x7fa3e406c5d0 msgr2=0x7fa3e406c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:27.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.107+0000 7fa3e94ad640 1 -- 172.21.15.78:0/2895800278 shutdown_connections 2023-12-12T10:12:27.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.107+0000 7fa3e94ad640 1 -- 172.21.15.78:0/2895800278 wait complete. 2023-12-12T10:12:27.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.107+0000 7fa3e94ad640 1 Processor -- start 2023-12-12T10:12:27.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.107+0000 7fa3e94ad640 1 -- start start 2023-12-12T10:12:27.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.107+0000 7fa3e94ad640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3e41401a0 0x7fa3e40cb8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:27.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.107+0000 7fa3e94ad640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa3e4161210 0x7fa3e4071a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:27.116 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.107+0000 7fa3e94ad640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa3e4161900 0x7fa3e41558a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:27.116 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.107+0000 7fa3e94ad640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e4072530 con 0x7fa3e41401a0 2023-12-12T10:12:27.116 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.107+0000 7fa3e94ad640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e413a2c0 con 0x7fa3e4161210 2023-12-12T10:12:27.116 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.107+0000 7fa3e94ad640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e413a5a0 con 0x7fa3e4161900 2023-12-12T10:12:27.116 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.107+0000 7fa3e2ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3e41401a0 0x7fa3e40cb8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:27.116 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.107+0000 7fa3e2ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3e41401a0 0x7fa3e40cb8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47638/0 (socket says 172.21.15.78:47638) 2023-12-12T10:12:27.116 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.107+0000 7fa3e2ffd640 1 -- 172.21.15.78:0/2154769896 learned_addr learned my addr 172.21.15.78:0/2154769896 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:27.116 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.111+0000 7fa3e37fe640 1 --2- 172.21.15.78:0/2154769896 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa3e4161900 0x7fa3e41558a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:27.116 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.111+0000 7fa3dbfff640 1 --2- 172.21.15.78:0/2154769896 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa3e4161210 0x7fa3e4071a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:27.116 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.111+0000 7fa3e2ffd640 1 -- 172.21.15.78:0/2154769896 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa3e4161900 msgr2=0x7fa3e41558a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:27.116 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.111+0000 7fa3e2ffd640 1 --2- 172.21.15.78:0/2154769896 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa3e4161900 0x7fa3e41558a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:27.116 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.111+0000 7fa3e2ffd640 1 -- 172.21.15.78:0/2154769896 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa3e4161210 msgr2=0x7fa3e4071a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:27.116 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.111+0000 7fa3e2ffd640 1 --2- 172.21.15.78:0/2154769896 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa3e4161210 0x7fa3e4071a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:27.116 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.111+0000 7fa3e2ffd640 1 -- 172.21.15.78:0/2154769896 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3dc009b30 con 0x7fa3e41401a0 2023-12-12T10:12:27.116 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.111+0000 7fa3dbfff640 1 --2- 172.21.15.78:0/2154769896 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa3e4161210 0x7fa3e4071a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T10:12:27.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.111+0000 7fa3e2ffd640 1 --2- 172.21.15.78:0/2154769896 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3e41401a0 0x7fa3e40cb8d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa3d400c500 tx=0x7fa3d400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:27.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.111+0000 7fa3db7fe640 1 -- 172.21.15.78:0/2154769896 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d4005220 con 0x7fa3e41401a0 2023-12-12T10:12:27.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.111+0000 7fa3db7fe640 1 -- 172.21.15.78:0/2154769896 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3d4005380 con 0x7fa3e41401a0 2023-12-12T10:12:27.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.111+0000 7fa3db7fe640 1 -- 172.21.15.78:0/2154769896 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d4007270 con 0x7fa3e41401a0 2023-12-12T10:12:27.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.111+0000 7fa3e94ad640 1 -- 172.21.15.78:0/2154769896 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3e413a880 con 0x7fa3e41401a0 2023-12-12T10:12:27.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.111+0000 7fa3e94ad640 1 -- 172.21.15.78:0/2154769896 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3e41388e0 con 0x7fa3e41401a0 2023-12-12T10:12:27.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.111+0000 7fa3e94ad640 1 -- 172.21.15.78:0/2154769896 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3e40671f0 con 0x7fa3e41401a0 2023-12-12T10:12:27.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.111+0000 7fa3db7fe640 1 -- 172.21.15.78:0/2154769896 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa3d40073d0 con 0x7fa3e41401a0 2023-12-12T10:12:27.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.111+0000 7fa3db7fe640 1 --2- 172.21.15.78:0/2154769896 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fa3c4066470 0x7fa3c4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:27.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.111+0000 7fa3db7fe640 1 -- 172.21.15.78:0/2154769896 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa3d4083530 con 0x7fa3e41401a0 2023-12-12T10:12:27.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.111+0000 7fa3dbfff640 1 --2- 172.21.15.78:0/2154769896 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fa3c4066470 0x7fa3c4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:27.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.115+0000 7fa3dbfff640 1 --2- 172.21.15.78:0/2154769896 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fa3c4066470 0x7fa3c4068930 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa3e415e830 tx=0x7fa3cc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:27.122 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.115+0000 7fa3db7fe640 1 -- 172.21.15.78:0/2154769896 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa3d40506e0 con 0x7fa3e41401a0 2023-12-12T10:12:27.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.298+0000 7fa3e94ad640 1 -- 172.21.15.78:0/2154769896 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa3e413ada0 con 0x7fa3e41401a0 2023-12-12T10:12:27.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.302+0000 7fa3db7fe640 1 -- 172.21.15.78:0/2154769896 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4912 (secure 0 0 0) 0x7fa3d4053d00 con 0x7fa3e41401a0 2023-12-12T10:12:27.307 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:12:27.307 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/3747609982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":3747609982},{"type":"v1","addr":"172.21.15.187:6834","nonce":3747609982}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4282,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/3245919280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":3245919280},{"type":"v1","addr":"172.21.15.187:6835","nonce":3245919280}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4293,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/3902814576","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":3902814576},{"type":"v1","addr":"172.21.15.78:6835","nonce":3902814576}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-12T10:12:09.200933+0000","modified":"2023-12-12T10:12:26.296409+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4296},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4296":{"gid":4296,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.78:6837/739552946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":739552946},{"type":"v1","addr":"172.21.15.78:6837","nonce":739552946}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-12T10:12:27.307 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 9 2023-12-12T10:12:27.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.302+0000 7fa3e94ad640 1 -- 172.21.15.78:0/2154769896 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fa3c4066470 msgr2=0x7fa3c4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:27.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.302+0000 7fa3e94ad640 1 --2- 172.21.15.78:0/2154769896 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fa3c4066470 0x7fa3c4068930 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa3e415e830 tx=0x7fa3cc008040 comp rx=0 tx=0).stop 2023-12-12T10:12:27.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.302+0000 7fa3e94ad640 1 -- 172.21.15.78:0/2154769896 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3e41401a0 msgr2=0x7fa3e40cb8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:27.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.302+0000 7fa3e94ad640 1 --2- 172.21.15.78:0/2154769896 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3e41401a0 0x7fa3e40cb8d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa3d400c500 tx=0x7fa3d400c9c0 comp rx=0 tx=0).stop 2023-12-12T10:12:27.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.302+0000 7fa3e94ad640 1 -- 172.21.15.78:0/2154769896 shutdown_connections 2023-12-12T10:12:27.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.302+0000 7fa3e94ad640 1 --2- 172.21.15.78:0/2154769896 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fa3c4066470 0x7fa3c4068930 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:27.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.302+0000 7fa3e94ad640 1 --2- 172.21.15.78:0/2154769896 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa3e4161900 0x7fa3e41558a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:27.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.302+0000 7fa3e94ad640 1 --2- 172.21.15.78:0/2154769896 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa3e4161210 0x7fa3e4071a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:27.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.302+0000 7fa3e94ad640 1 --2- 172.21.15.78:0/2154769896 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3e41401a0 0x7fa3e40cb8d0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:27.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.302+0000 7fa3e94ad640 1 -- 172.21.15.78:0/2154769896 >> 172.21.15.78:0/2154769896 conn(0x7fa3e406c5d0 msgr2=0x7fa3e413f810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:27.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.302+0000 7fa3e94ad640 1 -- 172.21.15.78:0/2154769896 shutdown_connections 2023-12-12T10:12:27.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.302+0000 7fa3e94ad640 1 -- 172.21.15.78:0/2154769896 wait complete. 2023-12-12T10:12:27.328 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T10:12:27.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.458+0000 7f61d81e7640 1 Processor -- start 2023-12-12T10:12:27.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.458+0000 7f61d81e7640 1 -- start start 2023-12-12T10:12:27.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.458+0000 7f61d81e7640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f61d0159440 0x7f61d00b2750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:27.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.458+0000 7f61d81e7640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61d00cf210 con 0x7f61d00b3540 2023-12-12T10:12:27.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.458+0000 7f61d81e7640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61d006df30 con 0x7f61d00cea50 2023-12-12T10:12:27.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.458+0000 7f61d81e7640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61d006d600 con 0x7f61d0159440 2023-12-12T10:12:27.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.462+0000 7f61d6784640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f61d00b3540 0x7f61d006a6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:44336/0 (socket says 172.21.15.78:44336) 2023-12-12T10:12:27.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.462+0000 7f61d6784640 1 -- 172.21.15.78:0/1127467601 learned_addr learned my addr 172.21.15.78:0/1127467601 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-12-12T10:12:27.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.462+0000 7f61d5f83640 1 --2- 172.21.15.78:0/1127467601 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f61d0159440 0x7f61d00b2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:27.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.462+0000 7f61d4f81640 1 -- 172.21.15.78:0/1127467601 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1411207962 0 0) 0x7f61d00cf210 con 0x7f61d00b3540 2023-12-12T10:12:27.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.462+0000 7f61d4f81640 1 -- 172.21.15.78:0/1127467601 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61bc003530 con 0x7f61d00b3540 2023-12-12T10:12:27.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.462+0000 7f61d4f81640 1 -- 172.21.15.78:0/1127467601 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1458840766 0 0) 0x7f61d006df30 con 0x7f61d00cea50 2023-12-12T10:12:27.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.462+0000 7f61d4f81640 1 -- 172.21.15.78:0/1127467601 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61d00cf210 con 0x7f61d00cea50 2023-12-12T10:12:27.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.462+0000 7f61d5f83640 1 -- 172.21.15.78:0/1127467601 >> v1:172.21.15.187:6789/0 conn(0x7f61d00cea50 legacy=0x7f61d00b2e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:27.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.462+0000 7f61d5f83640 1 -- 172.21.15.78:0/1127467601 >> v1:172.21.15.78:6789/0 conn(0x7f61d00b3540 legacy=0x7f61d006a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:27.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.462+0000 7f61d5f83640 1 -- 172.21.15.78:0/1127467601 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61d006d8e0 con 0x7f61d0159440 2023-12-12T10:12:27.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.462+0000 7f61d5f83640 1 --2- 172.21.15.78:0/1127467601 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f61d0159440 0x7f61d00b2750 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f61cc0097f0 tx=0x7f61cc01c370 comp rx=0 tx=0).ready entity=mon.2 client_cookie=237195bdde75e8ee server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:27.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.466+0000 7f61d4f81640 1 -- 172.21.15.78:0/1127467601 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61cc0ac640 con 0x7f61d0159440 2023-12-12T10:12:27.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.466+0000 7f61d4f81640 1 -- 172.21.15.78:0/1127467601 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61cc0ac7a0 con 0x7f61d0159440 2023-12-12T10:12:27.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.466+0000 7f61d4f81640 1 -- 172.21.15.78:0/1127467601 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61cc0acb10 con 0x7f61d0159440 2023-12-12T10:12:27.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.466+0000 7f61d81e7640 1 -- 172.21.15.78:0/1127467601 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f61d0159440 msgr2=0x7f61d00b2750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:27.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.466+0000 7f61d81e7640 1 --2- 172.21.15.78:0/1127467601 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f61d0159440 0x7f61d00b2750 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f61cc0097f0 tx=0x7f61cc01c370 comp rx=0 tx=0).stop 2023-12-12T10:12:27.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.466+0000 7f61d81e7640 1 -- 172.21.15.78:0/1127467601 shutdown_connections 2023-12-12T10:12:27.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.466+0000 7f61d81e7640 1 --2- 172.21.15.78:0/1127467601 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f61d0159440 0x7f61d00b2750 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:27.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.466+0000 7f61d81e7640 1 -- 172.21.15.78:0/1127467601 >> 172.21.15.78:0/1127467601 conn(0x7f61d00cf480 msgr2=0x7f61d00cf890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:27.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.466+0000 7f61d81e7640 1 -- 172.21.15.78:0/1127467601 shutdown_connections 2023-12-12T10:12:27.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.466+0000 7f61d81e7640 1 -- 172.21.15.78:0/1127467601 wait complete. 2023-12-12T10:12:27.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.466+0000 7f61d81e7640 1 Processor -- start 2023-12-12T10:12:27.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.466+0000 7f61d81e7640 1 -- start start 2023-12-12T10:12:27.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.466+0000 7f61d81e7640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f61d00b3540 0x7f61d0148ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:27.476 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.466+0000 7f61d81e7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f61d00cea50 0x7f61d014edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:27.476 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.466+0000 7f61d81e7640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f61d0159440 0x7f61d015d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:27.476 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.466+0000 7f61d81e7640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61d0147c40 con 0x7f61d00cea50 2023-12-12T10:12:27.476 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.466+0000 7f61d81e7640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61d0147f20 con 0x7f61d00b3540 2023-12-12T10:12:27.476 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.466+0000 7f61d81e7640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61d0148200 con 0x7f61d0159440 2023-12-12T10:12:27.476 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.466+0000 7f61d5782640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f61d00cea50 0x7f61d014edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:27.476 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.466+0000 7f61d5782640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f61d00cea50 0x7f61d014edd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47652/0 (socket says 172.21.15.78:47652) 2023-12-12T10:12:27.476 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.470+0000 7f61d5782640 1 -- 172.21.15.78:0/2973049888 learned_addr learned my addr 172.21.15.78:0/2973049888 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:27.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.470+0000 7f61d5f83640 1 --2- 172.21.15.78:0/2973049888 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f61d00b3540 0x7f61d0148ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:27.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.470+0000 7f61d6784640 1 --2- 172.21.15.78:0/2973049888 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f61d0159440 0x7f61d015d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:27.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.470+0000 7f61d5782640 1 -- 172.21.15.78:0/2973049888 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f61d0159440 msgr2=0x7f61d015d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:27.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.470+0000 7f61d5782640 1 --2- 172.21.15.78:0/2973049888 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f61d0159440 0x7f61d015d1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:27.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.470+0000 7f61d5782640 1 -- 172.21.15.78:0/2973049888 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f61d00b3540 msgr2=0x7f61d0148ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:27.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.470+0000 7f61d5782640 1 --2- 172.21.15.78:0/2973049888 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f61d00b3540 0x7f61d0148ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:27.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.470+0000 7f61d5782640 1 -- 172.21.15.78:0/2973049888 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61cc009420 con 0x7f61d00cea50 2023-12-12T10:12:27.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.470+0000 7f61d6784640 1 --2- 172.21.15.78:0/2973049888 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f61d0159440 0x7f61d015d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T10:12:27.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.470+0000 7f61d5782640 1 --2- 172.21.15.78:0/2973049888 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f61d00cea50 0x7f61d014edd0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f61c000c500 tx=0x7f61c000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:27.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.470+0000 7f61c67fc640 1 -- 172.21.15.78:0/2973049888 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61c00052d0 con 0x7f61d00cea50 2023-12-12T10:12:27.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.470+0000 7f61c67fc640 1 -- 172.21.15.78:0/2973049888 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61c0005450 con 0x7f61d00cea50 2023-12-12T10:12:27.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.470+0000 7f61c67fc640 1 -- 172.21.15.78:0/2973049888 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61c0012870 con 0x7f61d00cea50 2023-12-12T10:12:27.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.470+0000 7f61d81e7640 1 -- 172.21.15.78:0/2973049888 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61d01484e0 con 0x7f61d00cea50 2023-12-12T10:12:27.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.470+0000 7f61d81e7640 1 -- 172.21.15.78:0/2973049888 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61d0149220 con 0x7f61d00cea50 2023-12-12T10:12:27.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.470+0000 7f61d81e7640 1 -- 172.21.15.78:0/2973049888 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61d0067530 con 0x7f61d00cea50 2023-12-12T10:12:27.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.470+0000 7f61c67fc640 1 -- 172.21.15.78:0/2973049888 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f61c00129d0 con 0x7f61d00cea50 2023-12-12T10:12:27.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.470+0000 7f61c67fc640 1 --2- 172.21.15.78:0/2973049888 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f61b4066470 0x7f61b4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:27.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.470+0000 7f61c67fc640 1 -- 172.21.15.78:0/2973049888 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f61c0083dc0 con 0x7f61d00cea50 2023-12-12T10:12:27.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.474+0000 7f61d5f83640 1 --2- 172.21.15.78:0/2973049888 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f61b4066470 0x7f61b4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:27.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.474+0000 7f61d5f83640 1 --2- 172.21.15.78:0/2973049888 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f61b4066470 0x7f61b4068930 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f61cc0ae000 tx=0x7f61cc0a6070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:27.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.474+0000 7f61c67fc640 1 -- 172.21.15.78:0/2973049888 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f61c0050ec0 con 0x7f61d00cea50 2023-12-12T10:12:27.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.626+0000 7f61d81e7640 1 -- 172.21.15.78:0/2973049888 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f61d006d2b0 con 0x7f61d00cea50 2023-12-12T10:12:27.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.626+0000 7f61c67fc640 1 -- 172.21.15.78:0/2973049888 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18310 (secure 0 0 0) 0x7f61c00544e0 con 0x7f61d00cea50 2023-12-12T10:12:27.634 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:12:27.634 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":24,"fsid":"fc81937c-bd26-483c-952b-d1324fcb0c9e","created":"2023-12-12T10:11:44.020214+0000","modified":"2023-12-12T10:12:14.355146+0000","last_up_change":"2023-12-12T10:11:56.278318+0000","last_in_change":"2023-12-12T10:11:46.553610+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T10:11:57.053584+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-12T10:12:07.454450+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-12T10:12:08.182909+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-12T10:12:11.977952+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"22dfdedf-5f6c-4b20-9f6c-30517a1db70a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6809","nonce":3345683600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6811","nonce":3345683600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6815","nonce":3345683600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6813","nonce":3345683600}]},"public_addr":"172.21.15.78:6809/3345683600","cluster_addr":"172.21.15.78:6811/3345683600","heartbeat_back_addr":"172.21.15.78:6815/3345683600","heartbeat_front_addr":"172.21.15.78:6813/3345683600","state":["exists","up"]},{"osd":1,"uuid":"be34a7f3-a69a-462e-9ddf-5e537448dba2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6801","nonce":962652768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6803","nonce":962652768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6807","nonce":962652768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6805","nonce":962652768}]},"public_addr":"172.21.15.78:6801/962652768","cluster_addr":"172.21.15.78:6803/962652768","heartbeat_back_addr":"172.21.15.78:6807/962652768","heartbeat_front_addr":"172.21.15.78:6805/962652768","state":["exists","up"]},{"osd":2,"uuid":"55b381de-5f56-4b14-80f7-e6e41e084a13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6818","nonce":2910206054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6822","nonce":2910206054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6829","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6831","nonce":2910206054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6826","nonce":2910206054}]},"public_addr":"172.21.15.78:6818/2910206054","cluster_addr":"172.21.15.78:6822/2910206054","heartbeat_back_addr":"172.21.15.78:6831/2910206054","heartbeat_front_addr":"172.21.15.78:6826/2910206054","state":["exists","up"]},{"osd":3,"uuid":"d7682de1-25cb-4cec-869f-8851c28b0e6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6819","nonce":3750796703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6821","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6823","nonce":3750796703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6830","nonce":3750796703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6825","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6827","nonce":3750796703}]},"public_addr":"172.21.15.78:6819/3750796703","cluster_addr":"172.21.15.78:6823/3750796703","heartbeat_back_addr":"172.21.15.78:6830/3750796703","heartbeat_front_addr":"172.21.15.78:6827/3750796703","state":["exists","up"]},{"osd":4,"uuid":"8279815a-d6c7-4199-871e-d28971b9dc07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6809","nonce":2944277204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6811","nonce":2944277204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6815","nonce":2944277204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6813","nonce":2944277204}]},"public_addr":"172.21.15.187:6809/2944277204","cluster_addr":"172.21.15.187:6811/2944277204","heartbeat_back_addr":"172.21.15.187:6815/2944277204","heartbeat_front_addr":"172.21.15.187:6813/2944277204","state":["exists","up"]},{"osd":5,"uuid":"0a714c65-f8ce-4340-968f-11a799677ef3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6801","nonce":185858620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6803","nonce":185858620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6807","nonce":185858620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6805","nonce":185858620}]},"public_addr":"172.21.15.187:6801/185858620","cluster_addr":"172.21.15.187:6803/185858620","heartbeat_back_addr":"172.21.15.187:6807/185858620","heartbeat_front_addr":"172.21.15.187:6805/185858620","state":["exists","up"]},{"osd":6,"uuid":"d0bba9ab-f7ee-449e-8999-1c0cf7e6d53c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6817","nonce":4213392126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6819","nonce":4213392126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6824","nonce":4213392126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6821","nonce":4213392126}]},"public_addr":"172.21.15.187:6817/4213392126","cluster_addr":"172.21.15.187:6819/4213392126","heartbeat_back_addr":"172.21.15.187:6824/4213392126","heartbeat_front_addr":"172.21.15.187:6821/4213392126","state":["exists","up"]},{"osd":7,"uuid":"efe5e0d9-2f87-4889-a27a-e2a95a632302","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6823","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6825","nonce":85774004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6827","nonce":85774004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6831","nonce":85774004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6829","nonce":85774004}]},"public_addr":"172.21.15.187:6825/85774004","cluster_addr":"172.21.15.187:6827/85774004","heartbeat_back_addr":"172.21.15.187:6831/85774004","heartbeat_front_addr":"172.21.15.187:6829/85774004","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.214447+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.448899+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.293107+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.564184+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.175026+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.097717+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.261141+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.287681+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T10:12:27.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.630+0000 7f61d81e7640 1 -- 172.21.15.78:0/2973049888 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f61b4066470 msgr2=0x7f61b4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:27.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.630+0000 7f61d81e7640 1 --2- 172.21.15.78:0/2973049888 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f61b4066470 0x7f61b4068930 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f61cc0ae000 tx=0x7f61cc0a6070 comp rx=0 tx=0).stop 2023-12-12T10:12:27.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.630+0000 7f61d81e7640 1 -- 172.21.15.78:0/2973049888 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f61d00cea50 msgr2=0x7f61d014edd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:27.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.630+0000 7f61d81e7640 1 --2- 172.21.15.78:0/2973049888 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f61d00cea50 0x7f61d014edd0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f61c000c500 tx=0x7f61c000c9c0 comp rx=0 tx=0).stop 2023-12-12T10:12:27.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.630+0000 7f61d81e7640 1 -- 172.21.15.78:0/2973049888 shutdown_connections 2023-12-12T10:12:27.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.630+0000 7f61d81e7640 1 --2- 172.21.15.78:0/2973049888 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f61b4066470 0x7f61b4068930 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:27.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.630+0000 7f61d81e7640 1 --2- 172.21.15.78:0/2973049888 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f61d0159440 0x7f61d015d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:27.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.630+0000 7f61d81e7640 1 --2- 172.21.15.78:0/2973049888 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f61d00cea50 0x7f61d014edd0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:27.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.630+0000 7f61d81e7640 1 --2- 172.21.15.78:0/2973049888 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f61d00b3540 0x7f61d0148ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:27.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.630+0000 7f61d81e7640 1 -- 172.21.15.78:0/2973049888 >> 172.21.15.78:0/2973049888 conn(0x7f61d00cf480 msgr2=0x7f61d00b2750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:27.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.630+0000 7f61d81e7640 1 -- 172.21.15.78:0/2973049888 shutdown_connections 2023-12-12T10:12:27.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.630+0000 7f61d81e7640 1 -- 172.21.15.78:0/2973049888 wait complete. 2023-12-12T10:12:27.656 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-12T10:12:27.656 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-12T10:12:27.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.786+0000 7fecbe1df640 1 Processor -- start 2023-12-12T10:12:27.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.786+0000 7fecbe1df640 1 -- start start 2023-12-12T10:12:27.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.790+0000 7fecbe1df640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fecb813ceb0 0x7fecb813d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:27.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.790+0000 7fecbe1df640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fecb813fc60 0x7fecb8072030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:27.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.790+0000 7fecbe1df640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecb80705a0 con 0x7fecb8071bf0 2023-12-12T10:12:27.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.790+0000 7fecbe1df640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecb8140410 con 0x7fecb813fc60 2023-12-12T10:12:27.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.790+0000 7fecbe1df640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecb80cdc90 con 0x7fecb813ceb0 2023-12-12T10:12:27.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.790+0000 7fecb7fff640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fecb813fc60 0x7fecb8072030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:27.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.790+0000 7fecb77fe640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fecb813ceb0 0x7fecb813d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:27.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.790+0000 7fecb6ffd640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7fecb8071bf0 0x7fecb813f550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.78:40588/0 (socket says 172.21.15.78:40588) 2023-12-12T10:12:27.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.790+0000 7fecb77fe640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fecb813ceb0 0x7fecb813d4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.78:40562/0 (socket says 172.21.15.78:40562) 2023-12-12T10:12:27.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.790+0000 7fecb7fff640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fecb813fc60 0x7fecb8072030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.78:36006/0 (socket says 172.21.15.78:36006) 2023-12-12T10:12:27.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.790+0000 7fecb6ffd640 1 -- 172.21.15.78:0/795750427 learned_addr learned my addr 172.21.15.78:0/795750427 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-12-12T10:12:27.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.790+0000 7fecb77fe640 1 -- 172.21.15.78:0/795750427 >> v2:172.21.15.187:3300/0 conn(0x7fecb813fc60 msgr2=0x7fecb8072030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:27.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.790+0000 7fecb77fe640 1 --2- 172.21.15.78:0/795750427 >> v2:172.21.15.187:3300/0 conn(0x7fecb813fc60 0x7fecb8072030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:27.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.790+0000 7fecb77fe640 1 -- 172.21.15.78:0/795750427 >> v1:172.21.15.187:6789/0 conn(0x7fecb8071bf0 legacy=0x7fecb813f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:27.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.790+0000 7fecb77fe640 1 -- 172.21.15.78:0/795750427 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecb8072570 con 0x7fecb813ceb0 2023-12-12T10:12:27.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.790+0000 7fecb67fc640 1 -- 172.21.15.78:0/795750427 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1371084650 0 0) 0x7fecb80705a0 con 0x7fecb8071bf0 2023-12-12T10:12:27.800 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.794+0000 7fecb77fe640 1 --2- 172.21.15.78:0/795750427 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fecb813ceb0 0x7fecb813d4c0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7feca80097c0 tx=0x7feca801c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=60a84c9e0fdcab10 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:27.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.794+0000 7fecb67fc640 1 -- 172.21.15.78:0/795750427 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feca80ab600 con 0x7fecb813ceb0 2023-12-12T10:12:27.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.794+0000 7fecb67fc640 1 -- 172.21.15.78:0/795750427 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feca80a7050 con 0x7fecb813ceb0 2023-12-12T10:12:27.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.794+0000 7fecb67fc640 1 -- 172.21.15.78:0/795750427 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feca80ab980 con 0x7fecb813ceb0 2023-12-12T10:12:27.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.794+0000 7fecbe1df640 1 -- 172.21.15.78:0/795750427 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fecb813ceb0 msgr2=0x7fecb813d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:27.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.794+0000 7fecbe1df640 1 --2- 172.21.15.78:0/795750427 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fecb813ceb0 0x7fecb813d4c0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7feca80097c0 tx=0x7feca801c480 comp rx=0 tx=0).stop 2023-12-12T10:12:27.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.794+0000 7fecbe1df640 1 -- 172.21.15.78:0/795750427 shutdown_connections 2023-12-12T10:12:27.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.794+0000 7fecbe1df640 1 --2- 172.21.15.78:0/795750427 >> v2:172.21.15.187:3300/0 conn(0x7fecb813fc60 0x7fecb8072030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:27.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.794+0000 7fecbe1df640 1 --2- 172.21.15.78:0/795750427 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fecb813ceb0 0x7fecb813d4c0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:27.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.794+0000 7fecbe1df640 1 -- 172.21.15.78:0/795750427 >> 172.21.15.78:0/795750427 conn(0x7fecb806c5d0 msgr2=0x7fecb806c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:27.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.794+0000 7fecbe1df640 1 -- 172.21.15.78:0/795750427 shutdown_connections 2023-12-12T10:12:27.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.794+0000 7fecbe1df640 1 -- 172.21.15.78:0/795750427 wait complete. 2023-12-12T10:12:27.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.794+0000 7fecbe1df640 1 Processor -- start 2023-12-12T10:12:27.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.794+0000 7fecbe1df640 1 -- start start 2023-12-12T10:12:27.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.798+0000 7fecbe1df640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fecb8071bf0 0x7fecb8152ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:27.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.798+0000 7fecbe1df640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fecb813ceb0 0x7fecb8140950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:27.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.798+0000 7fecbe1df640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fecb813fc60 0x7fecb80aebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:27.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.798+0000 7fecbe1df640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecb80b2ca0 con 0x7fecb813ceb0 2023-12-12T10:12:27.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.798+0000 7fecbe1df640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecb8132ab0 con 0x7fecb813fc60 2023-12-12T10:12:27.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.798+0000 7fecbe1df640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecb8141330 con 0x7fecb8071bf0 2023-12-12T10:12:27.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.798+0000 7fecb6ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fecb813ceb0 0x7fecb8140950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:27.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.798+0000 7fecb6ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fecb813ceb0 0x7fecb8140950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47668/0 (socket says 172.21.15.78:47668) 2023-12-12T10:12:27.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.798+0000 7fecb6ffd640 1 -- 172.21.15.78:0/2200236480 learned_addr learned my addr 172.21.15.78:0/2200236480 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:27.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.798+0000 7fecb77fe640 1 --2- 172.21.15.78:0/2200236480 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fecb8071bf0 0x7fecb8152ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:27.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.798+0000 7fecb7fff640 1 --2- 172.21.15.78:0/2200236480 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fecb813fc60 0x7fecb80aebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:27.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.798+0000 7fecb6ffd640 1 -- 172.21.15.78:0/2200236480 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fecb8071bf0 msgr2=0x7fecb8152ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:27.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.798+0000 7fecb6ffd640 1 --2- 172.21.15.78:0/2200236480 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fecb8071bf0 0x7fecb8152ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:27.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.798+0000 7fecb6ffd640 1 -- 172.21.15.78:0/2200236480 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fecb813fc60 msgr2=0x7fecb80aebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:27.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.798+0000 7fecb6ffd640 1 --2- 172.21.15.78:0/2200236480 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fecb813fc60 0x7fecb80aebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:27.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.798+0000 7fecb6ffd640 1 -- 172.21.15.78:0/2200236480 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feca8009420 con 0x7fecb813ceb0 2023-12-12T10:12:27.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.798+0000 7fecb6ffd640 1 --2- 172.21.15.78:0/2200236480 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fecb813ceb0 0x7fecb8140950 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fecac0011f0 tx=0x7fecac00c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:27.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.798+0000 7fec9ffff640 1 -- 172.21.15.78:0/2200236480 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecac0074e0 con 0x7fecb813ceb0 2023-12-12T10:12:27.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.798+0000 7fec9ffff640 1 -- 172.21.15.78:0/2200236480 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecac007640 con 0x7fecb813ceb0 2023-12-12T10:12:27.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.798+0000 7fec9ffff640 1 -- 172.21.15.78:0/2200236480 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecac004a10 con 0x7fecb813ceb0 2023-12-12T10:12:27.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.798+0000 7fecbe1df640 1 -- 172.21.15.78:0/2200236480 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecb80b2300 con 0x7fecb813ceb0 2023-12-12T10:12:27.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.798+0000 7fecbe1df640 1 -- 172.21.15.78:0/2200236480 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecb80b28c0 con 0x7fecb813ceb0 2023-12-12T10:12:27.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.798+0000 7fecbe1df640 1 -- 172.21.15.78:0/2200236480 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecb80671f0 con 0x7fecb813ceb0 2023-12-12T10:12:27.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.798+0000 7fec9ffff640 1 -- 172.21.15.78:0/2200236480 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fecac004b70 con 0x7fecb813ceb0 2023-12-12T10:12:27.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.802+0000 7fec9ffff640 1 --2- 172.21.15.78:0/2200236480 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7feca4066470 0x7feca4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:27.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.802+0000 7fec9ffff640 1 -- 172.21.15.78:0/2200236480 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fecac0832c0 con 0x7fecb813ceb0 2023-12-12T10:12:27.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.802+0000 7fecb77fe640 1 --2- 172.21.15.78:0/2200236480 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7feca4066470 0x7feca4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:27.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.802+0000 7fecb77fe640 1 --2- 172.21.15.78:0/2200236480 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7feca4066470 0x7feca4068930 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7feca80ad000 tx=0x7feca8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:27.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.806+0000 7fec9ffff640 1 -- 172.21.15.78:0/2200236480 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fecac050570 con 0x7fecb813ceb0 2023-12-12T10:12:27.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.954+0000 7fecbe1df640 1 -- 172.21.15.78:0/2200236480 --> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fecb8070ae0 con 0x7feca4066470 2023-12-12T10:12:27.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.962+0000 7fec9ffff640 1 -- 172.21.15.78:0/2200236480 <== mgr.4104 v2:172.21.15.78:6832/1725498448 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345293 (secure 0 0 0) 0x7feca80aa3a0 con 0x7feca4066470 2023-12-12T10:12:27.972 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:12:27.976 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2023-12-12T10:12:27.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.970+0000 7fecbe1df640 1 -- 172.21.15.78:0/2200236480 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7feca4066470 msgr2=0x7feca4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:27.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.970+0000 7fecbe1df640 1 --2- 172.21.15.78:0/2200236480 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7feca4066470 0x7feca4068930 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7feca80ad000 tx=0x7feca8008040 comp rx=0 tx=0).stop 2023-12-12T10:12:27.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.970+0000 7fecbe1df640 1 -- 172.21.15.78:0/2200236480 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fecb813ceb0 msgr2=0x7fecb8140950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:27.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.970+0000 7fecbe1df640 1 --2- 172.21.15.78:0/2200236480 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fecb813ceb0 0x7fecb8140950 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fecac0011f0 tx=0x7fecac00c9b0 comp rx=0 tx=0).stop 2023-12-12T10:12:27.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.970+0000 7fecbe1df640 1 -- 172.21.15.78:0/2200236480 shutdown_connections 2023-12-12T10:12:27.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.970+0000 7fecbe1df640 1 --2- 172.21.15.78:0/2200236480 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7feca4066470 0x7feca4068930 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:27.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.970+0000 7fecbe1df640 1 --2- 172.21.15.78:0/2200236480 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fecb813fc60 0x7fecb80aebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:27.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.970+0000 7fecbe1df640 1 --2- 172.21.15.78:0/2200236480 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fecb813ceb0 0x7fecb8140950 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:27.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.970+0000 7fecbe1df640 1 --2- 172.21.15.78:0/2200236480 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fecb8071bf0 0x7fecb8152ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:27.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.970+0000 7fecbe1df640 1 -- 172.21.15.78:0/2200236480 >> 172.21.15.78:0/2200236480 conn(0x7fecb806c5d0 msgr2=0x7fecb8135790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:27.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.970+0000 7fecbe1df640 1 -- 172.21.15.78:0/2200236480 shutdown_connections 2023-12-12T10:12:27.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:27.970+0000 7fecbe1df640 1 -- 172.21.15.78:0/2200236480 wait complete. 2023-12-12T10:12:27.994 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":32,"stamp":"2023-12-12T10:12:26.993864+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594864,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":206,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158,"ondisk_log_size":158,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219392,"kb_used_data":3204,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755328,"statfs":{"total":773094113280,"available":772869455872,"internally_reserved":0,"allocated":3280896,"data_stored":1987095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2086,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002806"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.957388+0000","last_change":"2023-12-12T10:12:08.837046+0000","last_active":"2023-12-12T10:12:13.957388+0000","last_peered":"2023-12-12T10:12:13.957388+0000","last_clean":"2023-12-12T10:12:13.957388+0000","last_became_active":"2023-12-12T10:12:08.836763+0000","last_became_peered":"2023-12-12T10:12:08.836763+0000","last_unstale":"2023-12-12T10:12:13.957388+0000","last_undegraded":"2023-12-12T10:12:13.957388+0000","last_fullsized":"2023-12-12T10:12:13.957388+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_clean_scrub_stamp":"2023-12-12T10:12:07.792253+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:01:42.240854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.944527+0000","last_change":"2023-12-12T10:12:09.835821+0000","last_active":"2023-12-12T10:12:13.944527+0000","last_peered":"2023-12-12T10:12:13.944527+0000","last_clean":"2023-12-12T10:12:13.944527+0000","last_became_active":"2023-12-12T10:12:09.835565+0000","last_became_peered":"2023-12-12T10:12:09.835565+0000","last_unstale":"2023-12-12T10:12:13.944527+0000","last_undegraded":"2023-12-12T10:12:13.944527+0000","last_fullsized":"2023-12-12T10:12:13.944527+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:59:46.622358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-12T10:12:15.555553+0000","last_change":"2023-12-12T10:12:14.188368+0000","last_active":"2023-12-12T10:12:15.555553+0000","last_peered":"2023-12-12T10:12:15.555553+0000","last_clean":"2023-12-12T10:12:15.555553+0000","last_became_active":"2023-12-12T10:12:14.188013+0000","last_became_peered":"2023-12-12T10:12:14.188013+0000","last_unstale":"2023-12-12T10:12:15.555553+0000","last_undegraded":"2023-12-12T10:12:15.555553+0000","last_fullsized":"2023-12-12T10:12:15.555553+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_clean_scrub_stamp":"2023-12-12T10:12:12.929940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:41:41.466318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.946555+0000","last_change":"2023-12-12T10:12:08.841058+0000","last_active":"2023-12-12T10:12:13.946555+0000","last_peered":"2023-12-12T10:12:13.946555+0000","last_clean":"2023-12-12T10:12:13.946555+0000","last_became_active":"2023-12-12T10:12:08.840749+0000","last_became_peered":"2023-12-12T10:12:08.840749+0000","last_unstale":"2023-12-12T10:12:13.946555+0000","last_undegraded":"2023-12-12T10:12:13.946555+0000","last_fullsized":"2023-12-12T10:12:13.946555+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_clean_scrub_stamp":"2023-12-12T10:12:07.792253+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:01:42.240854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.955095+0000","last_change":"2023-12-12T10:12:09.846736+0000","last_active":"2023-12-12T10:12:13.955095+0000","last_peered":"2023-12-12T10:12:13.955095+0000","last_clean":"2023-12-12T10:12:13.955095+0000","last_became_active":"2023-12-12T10:12:09.846467+0000","last_became_peered":"2023-12-12T10:12:09.846467+0000","last_unstale":"2023-12-12T10:12:13.955095+0000","last_undegraded":"2023-12-12T10:12:13.955095+0000","last_fullsized":"2023-12-12T10:12:13.955095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:29:34.002418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-12T10:12:14.943582+0000","last_change":"2023-12-12T10:12:13.957767+0000","last_active":"2023-12-12T10:12:14.943582+0000","last_peered":"2023-12-12T10:12:14.943582+0000","last_clean":"2023-12-12T10:12:14.943582+0000","last_became_active":"2023-12-12T10:12:13.957289+0000","last_became_peered":"2023-12-12T10:12:13.957289+0000","last_unstale":"2023-12-12T10:12:14.943582+0000","last_undegraded":"2023-12-12T10:12:14.943582+0000","last_fullsized":"2023-12-12T10:12:14.943582+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_clean_scrub_stamp":"2023-12-12T10:12:12.929940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:29:38.133352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:14.179027+0000","last_change":"2023-12-12T10:12:08.846842+0000","last_active":"2023-12-12T10:12:14.179027+0000","last_peered":"2023-12-12T10:12:14.179027+0000","last_clean":"2023-12-12T10:12:14.179027+0000","last_became_active":"2023-12-12T10:12:08.846389+0000","last_became_peered":"2023-12-12T10:12:08.846389+0000","last_unstale":"2023-12-12T10:12:14.179027+0000","last_undegraded":"2023-12-12T10:12:14.179027+0000","last_fullsized":"2023-12-12T10:12:14.179027+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_clean_scrub_stamp":"2023-12-12T10:12:07.792253+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:14:21.574354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.954855+0000","last_change":"2023-12-12T10:12:09.846099+0000","last_active":"2023-12-12T10:12:13.954855+0000","last_peered":"2023-12-12T10:12:13.954855+0000","last_clean":"2023-12-12T10:12:13.954855+0000","last_became_active":"2023-12-12T10:12:09.843647+0000","last_became_peered":"2023-12-12T10:12:09.843647+0000","last_unstale":"2023-12-12T10:12:13.954855+0000","last_undegraded":"2023-12-12T10:12:13.954855+0000","last_fullsized":"2023-12-12T10:12:13.954855+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:06:52.618740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-12T10:12:14.944222+0000","last_change":"2023-12-12T10:12:13.966808+0000","last_active":"2023-12-12T10:12:14.944222+0000","last_peered":"2023-12-12T10:12:14.944222+0000","last_clean":"2023-12-12T10:12:14.944222+0000","last_became_active":"2023-12-12T10:12:13.966405+0000","last_became_peered":"2023-12-12T10:12:13.966405+0000","last_unstale":"2023-12-12T10:12:14.944222+0000","last_undegraded":"2023-12-12T10:12:14.944222+0000","last_fullsized":"2023-12-12T10:12:14.944222+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_clean_scrub_stamp":"2023-12-12T10:12:12.929940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:08:16.230176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:14.178844+0000","last_change":"2023-12-12T10:12:08.844404+0000","last_active":"2023-12-12T10:12:14.178844+0000","last_peered":"2023-12-12T10:12:14.178844+0000","last_clean":"2023-12-12T10:12:14.178844+0000","last_became_active":"2023-12-12T10:12:08.842413+0000","last_became_peered":"2023-12-12T10:12:08.842413+0000","last_unstale":"2023-12-12T10:12:14.178844+0000","last_undegraded":"2023-12-12T10:12:14.178844+0000","last_fullsized":"2023-12-12T10:12:14.178844+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_clean_scrub_stamp":"2023-12-12T10:12:07.792253+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:29:32.995665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.955015+0000","last_change":"2023-12-12T10:12:09.841014+0000","last_active":"2023-12-12T10:12:13.955015+0000","last_peered":"2023-12-12T10:12:13.955015+0000","last_clean":"2023-12-12T10:12:13.955015+0000","last_became_active":"2023-12-12T10:12:09.840537+0000","last_became_peered":"2023-12-12T10:12:09.840537+0000","last_unstale":"2023-12-12T10:12:13.955015+0000","last_undegraded":"2023-12-12T10:12:13.955015+0000","last_fullsized":"2023-12-12T10:12:13.955015+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:17:19.749257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-12T10:12:14.943939+0000","last_change":"2023-12-12T10:12:13.964740+0000","last_active":"2023-12-12T10:12:14.943939+0000","last_peered":"2023-12-12T10:12:14.943939+0000","last_clean":"2023-12-12T10:12:14.943939+0000","last_became_active":"2023-12-12T10:12:13.964322+0000","last_became_peered":"2023-12-12T10:12:13.964322+0000","last_unstale":"2023-12-12T10:12:14.943939+0000","last_undegraded":"2023-12-12T10:12:14.943939+0000","last_fullsized":"2023-12-12T10:12:14.943939+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_clean_scrub_stamp":"2023-12-12T10:12:12.929940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T22:01:09.241666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.942306+0000","last_change":"2023-12-12T10:12:09.830608+0000","last_active":"2023-12-12T10:12:13.942306+0000","last_peered":"2023-12-12T10:12:13.942306+0000","last_clean":"2023-12-12T10:12:13.942306+0000","last_became_active":"2023-12-12T10:12:09.830291+0000","last_became_peered":"2023-12-12T10:12:09.830291+0000","last_unstale":"2023-12-12T10:12:13.942306+0000","last_undegraded":"2023-12-12T10:12:13.942306+0000","last_fullsized":"2023-12-12T10:12:13.942306+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:14:22.581107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:14.178760+0000","last_change":"2023-12-12T10:12:08.842318+0000","last_active":"2023-12-12T10:12:14.178760+0000","last_peered":"2023-12-12T10:12:14.178760+0000","last_clean":"2023-12-12T10:12:14.178760+0000","last_became_active":"2023-12-12T10:12:08.841798+0000","last_became_peered":"2023-12-12T10:12:08.841798+0000","last_unstale":"2023-12-12T10:12:14.178760+0000","last_undegraded":"2023-12-12T10:12:14.178760+0000","last_fullsized":"2023-12-12T10:12:14.178760+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_clean_scrub_stamp":"2023-12-12T10:12:07.792253+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:05:44.538814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-12T10:12:14.945190+0000","last_change":"2023-12-12T10:12:13.966998+0000","last_active":"2023-12-12T10:12:14.945190+0000","last_peered":"2023-12-12T10:12:14.945190+0000","last_clean":"2023-12-12T10:12:14.945190+0000","last_became_active":"2023-12-12T10:12:13.966611+0000","last_became_peered":"2023-12-12T10:12:13.966611+0000","last_unstale":"2023-12-12T10:12:14.945190+0000","last_undegraded":"2023-12-12T10:12:14.945190+0000","last_fullsized":"2023-12-12T10:12:14.945190+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_clean_scrub_stamp":"2023-12-12T10:12:12.929940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:29:09.752788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.942671+0000","last_change":"2023-12-12T10:12:09.833899+0000","last_active":"2023-12-12T10:12:13.942671+0000","last_peered":"2023-12-12T10:12:13.942671+0000","last_clean":"2023-12-12T10:12:13.942671+0000","last_became_active":"2023-12-12T10:12:09.833515+0000","last_became_peered":"2023-12-12T10:12:09.833515+0000","last_unstale":"2023-12-12T10:12:13.942671+0000","last_undegraded":"2023-12-12T10:12:13.942671+0000","last_fullsized":"2023-12-12T10:12:13.942671+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:05:45.545567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.961555+0000","last_change":"2023-12-12T10:12:08.831931+0000","last_active":"2023-12-12T10:12:13.961555+0000","last_peered":"2023-12-12T10:12:13.961555+0000","last_clean":"2023-12-12T10:12:13.961555+0000","last_became_active":"2023-12-12T10:12:08.831620+0000","last_became_peered":"2023-12-12T10:12:08.831620+0000","last_unstale":"2023-12-12T10:12:13.961555+0000","last_undegraded":"2023-12-12T10:12:13.961555+0000","last_fullsized":"2023-12-12T10:12:13.961555+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_clean_scrub_stamp":"2023-12-12T10:12:07.792253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:33:06.940791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-12T10:12:14.944543+0000","last_change":"2023-12-12T10:12:13.963213+0000","last_active":"2023-12-12T10:12:14.944543+0000","last_peered":"2023-12-12T10:12:14.944543+0000","last_clean":"2023-12-12T10:12:14.944543+0000","last_became_active":"2023-12-12T10:12:13.962745+0000","last_became_peered":"2023-12-12T10:12:13.962745+0000","last_unstale":"2023-12-12T10:12:14.944543+0000","last_undegraded":"2023-12-12T10:12:14.944543+0000","last_fullsized":"2023-12-12T10:12:14.944543+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_clean_scrub_stamp":"2023-12-12T10:12:12.929940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:46:01.637131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.943109+0000","last_change":"2023-12-12T10:12:09.836176+0000","last_active":"2023-12-12T10:12:13.943109+0000","last_peered":"2023-12-12T10:12:13.943109+0000","last_clean":"2023-12-12T10:12:13.943109+0000","last_became_active":"2023-12-12T10:12:09.835770+0000","last_became_peered":"2023-12-12T10:12:09.835770+0000","last_unstale":"2023-12-12T10:12:13.943109+0000","last_undegraded":"2023-12-12T10:12:13.943109+0000","last_fullsized":"2023-12-12T10:12:13.943109+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:47:44.969459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.960982+0000","last_change":"2023-12-12T10:12:08.837492+0000","last_active":"2023-12-12T10:12:13.960982+0000","last_peered":"2023-12-12T10:12:13.960982+0000","last_clean":"2023-12-12T10:12:13.960982+0000","last_became_active":"2023-12-12T10:12:08.836946+0000","last_became_peered":"2023-12-12T10:12:08.836946+0000","last_unstale":"2023-12-12T10:12:13.960982+0000","last_undegraded":"2023-12-12T10:12:13.960982+0000","last_fullsized":"2023-12-12T10:12:13.960982+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_clean_scrub_stamp":"2023-12-12T10:12:07.792253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:43:30.327223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-12T10:12:15.184876+0000","last_change":"2023-12-12T10:12:14.185717+0000","last_active":"2023-12-12T10:12:15.184876+0000","last_peered":"2023-12-12T10:12:15.184876+0000","last_clean":"2023-12-12T10:12:15.184876+0000","last_became_active":"2023-12-12T10:12:14.185270+0000","last_became_peered":"2023-12-12T10:12:14.185270+0000","last_unstale":"2023-12-12T10:12:15.184876+0000","last_undegraded":"2023-12-12T10:12:15.184876+0000","last_fullsized":"2023-12-12T10:12:15.184876+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_clean_scrub_stamp":"2023-12-12T10:12:12.929940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:51:46.510253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.944571+0000","last_change":"2023-12-12T10:12:09.833775+0000","last_active":"2023-12-12T10:12:13.944571+0000","last_peered":"2023-12-12T10:12:13.944571+0000","last_clean":"2023-12-12T10:12:13.944571+0000","last_became_active":"2023-12-12T10:12:09.829608+0000","last_became_peered":"2023-12-12T10:12:09.829608+0000","last_unstale":"2023-12-12T10:12:13.944571+0000","last_undegraded":"2023-12-12T10:12:13.944571+0000","last_fullsized":"2023-12-12T10:12:13.944571+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:15:32.896143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:14.178440+0000","last_change":"2023-12-12T10:12:08.845929+0000","last_active":"2023-12-12T10:12:14.178440+0000","last_peered":"2023-12-12T10:12:14.178440+0000","last_clean":"2023-12-12T10:12:14.178440+0000","last_became_active":"2023-12-12T10:12:08.845586+0000","last_became_peered":"2023-12-12T10:12:08.845586+0000","last_unstale":"2023-12-12T10:12:14.178440+0000","last_undegraded":"2023-12-12T10:12:14.178440+0000","last_fullsized":"2023-12-12T10:12:14.178440+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_clean_scrub_stamp":"2023-12-12T10:12:07.792253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:05:33.556015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-12T10:12:14.944863+0000","last_change":"2023-12-12T10:12:13.963219+0000","last_active":"2023-12-12T10:12:14.944863+0000","last_peered":"2023-12-12T10:12:14.944863+0000","last_clean":"2023-12-12T10:12:14.944863+0000","last_became_active":"2023-12-12T10:12:13.962713+0000","last_became_peered":"2023-12-12T10:12:13.962713+0000","last_unstale":"2023-12-12T10:12:14.944863+0000","last_undegraded":"2023-12-12T10:12:14.944863+0000","last_fullsized":"2023-12-12T10:12:14.944863+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_clean_scrub_stamp":"2023-12-12T10:12:12.929940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:06:56.749674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.958203+0000","last_change":"2023-12-12T10:12:09.827158+0000","last_active":"2023-12-12T10:12:13.958203+0000","last_peered":"2023-12-12T10:12:13.958203+0000","last_clean":"2023-12-12T10:12:13.958203+0000","last_became_active":"2023-12-12T10:12:09.826822+0000","last_became_peered":"2023-12-12T10:12:09.826822+0000","last_unstale":"2023-12-12T10:12:13.958203+0000","last_undegraded":"2023-12-12T10:12:13.958203+0000","last_fullsized":"2023-12-12T10:12:13.958203+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:59:46.622358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.945235+0000","last_change":"2023-12-12T10:12:08.838343+0000","last_active":"2023-12-12T10:12:13.945235+0000","last_peered":"2023-12-12T10:12:13.945235+0000","last_clean":"2023-12-12T10:12:13.945235+0000","last_became_active":"2023-12-12T10:12:08.837997+0000","last_became_peered":"2023-12-12T10:12:08.837997+0000","last_unstale":"2023-12-12T10:12:13.945235+0000","last_undegraded":"2023-12-12T10:12:13.945235+0000","last_fullsized":"2023-12-12T10:12:13.945235+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_clean_scrub_stamp":"2023-12-12T10:12:07.792253+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:33:06.940791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-12T10:12:14.943970+0000","last_change":"2023-12-12T10:12:14.185225+0000","last_active":"2023-12-12T10:12:14.943970+0000","last_peered":"2023-12-12T10:12:14.943970+0000","last_clean":"2023-12-12T10:12:14.943970+0000","last_became_active":"2023-12-12T10:12:14.184122+0000","last_became_peered":"2023-12-12T10:12:14.184122+0000","last_unstale":"2023-12-12T10:12:14.943970+0000","last_undegraded":"2023-12-12T10:12:14.943970+0000","last_fullsized":"2023-12-12T10:12:14.943970+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_clean_scrub_stamp":"2023-12-12T10:12:12.929940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:23:00.194289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.947211+0000","last_change":"2023-12-12T10:12:09.835201+0000","last_active":"2023-12-12T10:12:13.947211+0000","last_peered":"2023-12-12T10:12:13.947211+0000","last_clean":"2023-12-12T10:12:13.947211+0000","last_became_active":"2023-12-12T10:12:09.834701+0000","last_became_peered":"2023-12-12T10:12:09.834701+0000","last_unstale":"2023-12-12T10:12:13.947211+0000","last_undegraded":"2023-12-12T10:12:13.947211+0000","last_fullsized":"2023-12-12T10:12:13.947211+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T22:01:05.110732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.962519+0000","last_change":"2023-12-12T10:12:08.842442+0000","last_active":"2023-12-12T10:12:13.962519+0000","last_peered":"2023-12-12T10:12:13.962519+0000","last_clean":"2023-12-12T10:12:13.962519+0000","last_became_active":"2023-12-12T10:12:08.842125+0000","last_became_peered":"2023-12-12T10:12:08.842125+0000","last_unstale":"2023-12-12T10:12:13.962519+0000","last_undegraded":"2023-12-12T10:12:13.962519+0000","last_fullsized":"2023-12-12T10:12:13.962519+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_clean_scrub_stamp":"2023-12-12T10:12:07.792253+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:24:12.200595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-12T10:12:15.555651+0000","last_change":"2023-12-12T10:12:14.185748+0000","last_active":"2023-12-12T10:12:15.555651+0000","last_peered":"2023-12-12T10:12:15.555651+0000","last_clean":"2023-12-12T10:12:15.555651+0000","last_became_active":"2023-12-12T10:12:14.185262+0000","last_became_peered":"2023-12-12T10:12:14.185262+0000","last_unstale":"2023-12-12T10:12:15.555651+0000","last_undegraded":"2023-12-12T10:12:15.555651+0000","last_fullsized":"2023-12-12T10:12:15.555651+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_clean_scrub_stamp":"2023-12-12T10:12:12.929940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:46:26.737660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.961127+0000","last_change":"2023-12-12T10:12:09.837089+0000","last_active":"2023-12-12T10:12:13.961127+0000","last_peered":"2023-12-12T10:12:13.961127+0000","last_clean":"2023-12-12T10:12:13.961127+0000","last_became_active":"2023-12-12T10:12:09.829551+0000","last_became_peered":"2023-12-12T10:12:09.829551+0000","last_unstale":"2023-12-12T10:12:13.961127+0000","last_undegraded":"2023-12-12T10:12:13.961127+0000","last_fullsized":"2023-12-12T10:12:13.961127+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:59:46.622358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:14.179291+0000","last_change":"2023-12-12T10:12:08.845099+0000","last_active":"2023-12-12T10:12:14.179291+0000","last_peered":"2023-12-12T10:12:14.179291+0000","last_clean":"2023-12-12T10:12:14.179291+0000","last_became_active":"2023-12-12T10:12:08.844823+0000","last_became_peered":"2023-12-12T10:12:08.844823+0000","last_unstale":"2023-12-12T10:12:14.179291+0000","last_undegraded":"2023-12-12T10:12:14.179291+0000","last_fullsized":"2023-12-12T10:12:14.179291+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_clean_scrub_stamp":"2023-12-12T10:12:07.792253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:42:16.450226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-12T10:12:15.556125+0000","last_change":"2023-12-12T10:12:14.182644+0000","last_active":"2023-12-12T10:12:15.556125+0000","last_peered":"2023-12-12T10:12:15.556125+0000","last_clean":"2023-12-12T10:12:15.556125+0000","last_became_active":"2023-12-12T10:12:14.182230+0000","last_became_peered":"2023-12-12T10:12:14.182230+0000","last_unstale":"2023-12-12T10:12:15.556125+0000","last_undegraded":"2023-12-12T10:12:15.556125+0000","last_fullsized":"2023-12-12T10:12:15.556125+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_clean_scrub_stamp":"2023-12-12T10:12:12.929940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:29:09.752788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.955037+0000","last_change":"2023-12-12T10:12:09.840836+0000","last_active":"2023-12-12T10:12:13.955037+0000","last_peered":"2023-12-12T10:12:13.955037+0000","last_clean":"2023-12-12T10:12:13.955037+0000","last_became_active":"2023-12-12T10:12:09.840219+0000","last_became_peered":"2023-12-12T10:12:09.840219+0000","last_unstale":"2023-12-12T10:12:13.955037+0000","last_undegraded":"2023-12-12T10:12:13.955037+0000","last_fullsized":"2023-12-12T10:12:13.955037+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:03:50.236121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.961215+0000","last_change":"2023-12-12T10:12:08.829665+0000","last_active":"2023-12-12T10:12:13.961215+0000","last_peered":"2023-12-12T10:12:13.961215+0000","last_clean":"2023-12-12T10:12:13.961215+0000","last_became_active":"2023-12-12T10:12:08.829433+0000","last_became_peered":"2023-12-12T10:12:08.829433+0000","last_unstale":"2023-12-12T10:12:13.961215+0000","last_undegraded":"2023-12-12T10:12:13.961215+0000","last_fullsized":"2023-12-12T10:12:13.961215+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_clean_scrub_stamp":"2023-12-12T10:12:07.792253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:41:37.226888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-12T10:12:15.184185+0000","last_change":"2023-12-12T10:12:13.973841+0000","last_active":"2023-12-12T10:12:15.184185+0000","last_peered":"2023-12-12T10:12:15.184185+0000","last_clean":"2023-12-12T10:12:15.184185+0000","last_became_active":"2023-12-12T10:12:13.973435+0000","last_became_peered":"2023-12-12T10:12:13.973435+0000","last_unstale":"2023-12-12T10:12:15.184185+0000","last_undegraded":"2023-12-12T10:12:15.184185+0000","last_fullsized":"2023-12-12T10:12:15.184185+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_clean_scrub_stamp":"2023-12-12T10:12:12.929940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:11:19.241925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.946358+0000","last_change":"2023-12-12T10:12:09.823582+0000","last_active":"2023-12-12T10:12:13.946358+0000","last_peered":"2023-12-12T10:12:13.946358+0000","last_clean":"2023-12-12T10:12:13.946358+0000","last_became_active":"2023-12-12T10:12:09.823307+0000","last_became_peered":"2023-12-12T10:12:09.823307+0000","last_unstale":"2023-12-12T10:12:13.946358+0000","last_undegraded":"2023-12-12T10:12:13.946358+0000","last_fullsized":"2023-12-12T10:12:13.946358+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:41:38.233640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.955628+0000","last_change":"2023-12-12T10:12:08.828970+0000","last_active":"2023-12-12T10:12:13.955628+0000","last_peered":"2023-12-12T10:12:13.955628+0000","last_clean":"2023-12-12T10:12:13.955628+0000","last_became_active":"2023-12-12T10:12:08.828622+0000","last_became_peered":"2023-12-12T10:12:08.828622+0000","last_unstale":"2023-12-12T10:12:13.955628+0000","last_undegraded":"2023-12-12T10:12:13.955628+0000","last_fullsized":"2023-12-12T10:12:13.955628+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_clean_scrub_stamp":"2023-12-12T10:12:07.792253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:05:44.538814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-12T10:12:15.184498+0000","last_change":"2023-12-12T10:12:13.971217+0000","last_active":"2023-12-12T10:12:15.184498+0000","last_peered":"2023-12-12T10:12:15.184498+0000","last_clean":"2023-12-12T10:12:15.184498+0000","last_became_active":"2023-12-12T10:12:13.970691+0000","last_became_peered":"2023-12-12T10:12:13.970691+0000","last_unstale":"2023-12-12T10:12:15.184498+0000","last_undegraded":"2023-12-12T10:12:15.184498+0000","last_fullsized":"2023-12-12T10:12:15.184498+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_clean_scrub_stamp":"2023-12-12T10:12:12.929940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:03:54.367055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.962282+0000","last_change":"2023-12-12T10:12:09.832708+0000","last_active":"2023-12-12T10:12:13.962282+0000","last_peered":"2023-12-12T10:12:13.962282+0000","last_clean":"2023-12-12T10:12:13.962282+0000","last_became_active":"2023-12-12T10:12:09.832344+0000","last_became_peered":"2023-12-12T10:12:09.832344+0000","last_unstale":"2023-12-12T10:12:13.962282+0000","last_undegraded":"2023-12-12T10:12:13.962282+0000","last_fullsized":"2023-12-12T10:12:13.962282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:14:22.581107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.965330+0000","last_change":"2023-12-12T10:12:08.837019+0000","last_active":"2023-12-12T10:12:13.965330+0000","last_peered":"2023-12-12T10:12:13.965330+0000","last_clean":"2023-12-12T10:12:13.965330+0000","last_became_active":"2023-12-12T10:12:08.832265+0000","last_became_peered":"2023-12-12T10:12:08.832265+0000","last_unstale":"2023-12-12T10:12:13.965330+0000","last_undegraded":"2023-12-12T10:12:13.965330+0000","last_fullsized":"2023-12-12T10:12:13.965330+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_clean_scrub_stamp":"2023-12-12T10:12:07.792253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:18:36.840178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-12T10:12:15.184922+0000","last_change":"2023-12-12T10:12:13.973617+0000","last_active":"2023-12-12T10:12:15.184922+0000","last_peered":"2023-12-12T10:12:15.184922+0000","last_clean":"2023-12-12T10:12:15.184922+0000","last_became_active":"2023-12-12T10:12:13.973205+0000","last_became_peered":"2023-12-12T10:12:13.973205+0000","last_unstale":"2023-12-12T10:12:15.184922+0000","last_undegraded":"2023-12-12T10:12:15.184922+0000","last_fullsized":"2023-12-12T10:12:15.184922+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_clean_scrub_stamp":"2023-12-12T10:12:12.929940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:39:57.689735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.954974+0000","last_change":"2023-12-12T10:12:09.825813+0000","last_active":"2023-12-12T10:12:13.954974+0000","last_peered":"2023-12-12T10:12:13.954974+0000","last_clean":"2023-12-12T10:12:13.954974+0000","last_became_active":"2023-12-12T10:12:09.824750+0000","last_became_peered":"2023-12-12T10:12:09.824750+0000","last_unstale":"2023-12-12T10:12:13.954974+0000","last_undegraded":"2023-12-12T10:12:13.954974+0000","last_fullsized":"2023-12-12T10:12:13.954974+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:22:27.554110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:14.178474+0000","last_change":"2023-12-12T10:12:08.843140+0000","last_active":"2023-12-12T10:12:14.178474+0000","last_peered":"2023-12-12T10:12:14.178474+0000","last_clean":"2023-12-12T10:12:14.178474+0000","last_became_active":"2023-12-12T10:12:08.842860+0000","last_became_peered":"2023-12-12T10:12:08.842860+0000","last_unstale":"2023-12-12T10:12:14.178474+0000","last_undegraded":"2023-12-12T10:12:14.178474+0000","last_fullsized":"2023-12-12T10:12:14.178474+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_clean_scrub_stamp":"2023-12-12T10:12:07.792253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:18:36.840178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-12T10:12:15.557319+0000","last_change":"2023-12-12T10:12:14.186432+0000","last_active":"2023-12-12T10:12:15.557319+0000","last_peered":"2023-12-12T10:12:15.557319+0000","last_clean":"2023-12-12T10:12:15.557319+0000","last_became_active":"2023-12-12T10:12:14.185836+0000","last_became_peered":"2023-12-12T10:12:14.185836+0000","last_unstale":"2023-12-12T10:12:15.557319+0000","last_undegraded":"2023-12-12T10:12:15.557319+0000","last_fullsized":"2023-12-12T10:12:15.557319+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_clean_scrub_stamp":"2023-12-12T10:12:12.929940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:51:46.510253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.942873+0000","last_change":"2023-12-12T10:12:09.837891+0000","last_active":"2023-12-12T10:12:13.942873+0000","last_peered":"2023-12-12T10:12:13.942873+0000","last_clean":"2023-12-12T10:12:13.942873+0000","last_became_active":"2023-12-12T10:12:09.837628+0000","last_became_peered":"2023-12-12T10:12:09.837628+0000","last_unstale":"2023-12-12T10:12:13.942873+0000","last_undegraded":"2023-12-12T10:12:13.942873+0000","last_fullsized":"2023-12-12T10:12:13.942873+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:24:13.207348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.954955+0000","last_change":"2023-12-12T10:12:08.828997+0000","last_active":"2023-12-12T10:12:13.954955+0000","last_peered":"2023-12-12T10:12:13.954955+0000","last_clean":"2023-12-12T10:12:13.954955+0000","last_became_active":"2023-12-12T10:12:08.828551+0000","last_became_peered":"2023-12-12T10:12:08.828551+0000","last_unstale":"2023-12-12T10:12:13.954955+0000","last_undegraded":"2023-12-12T10:12:13.954955+0000","last_fullsized":"2023-12-12T10:12:13.954955+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_clean_scrub_stamp":"2023-12-12T10:12:07.792253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:24:12.200595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":169,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:14.178565+0000","last_change":"2023-12-12T10:11:58.492812+0000","last_active":"2023-12-12T10:12:14.178565+0000","last_peered":"2023-12-12T10:12:14.178565+0000","last_clean":"2023-12-12T10:12:14.178565+0000","last_became_active":"2023-12-12T10:11:58.491470+0000","last_became_peered":"2023-12-12T10:11:58.491470+0000","last_unstale":"2023-12-12T10:12:14.178565+0000","last_undegraded":"2023-12-12T10:12:14.178565+0000","last_fullsized":"2023-12-12T10:12:14.178565+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:11:57.289641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:11:57.289641+0000","last_clean_scrub_stamp":"2023-12-12T10:11:57.289641+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:10:37.809139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-12T10:12:14.943985+0000","last_change":"2023-12-12T10:12:14.184491+0000","last_active":"2023-12-12T10:12:14.943985+0000","last_peered":"2023-12-12T10:12:14.943985+0000","last_clean":"2023-12-12T10:12:14.943985+0000","last_became_active":"2023-12-12T10:12:14.183538+0000","last_became_peered":"2023-12-12T10:12:14.183538+0000","last_unstale":"2023-12-12T10:12:14.943985+0000","last_undegraded":"2023-12-12T10:12:14.943985+0000","last_fullsized":"2023-12-12T10:12:14.943985+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_clean_scrub_stamp":"2023-12-12T10:12:12.929940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:06:56.749674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:14.178883+0000","last_change":"2023-12-12T10:12:09.848681+0000","last_active":"2023-12-12T10:12:14.178883+0000","last_peered":"2023-12-12T10:12:14.178883+0000","last_clean":"2023-12-12T10:12:14.178883+0000","last_became_active":"2023-12-12T10:12:09.848381+0000","last_became_peered":"2023-12-12T10:12:09.848381+0000","last_unstale":"2023-12-12T10:12:14.178883+0000","last_undegraded":"2023-12-12T10:12:14.178883+0000","last_fullsized":"2023-12-12T10:12:14.178883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:45:57.506196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.966788+0000","last_change":"2023-12-12T10:12:08.831000+0000","last_active":"2023-12-12T10:12:13.966788+0000","last_peered":"2023-12-12T10:12:13.966788+0000","last_clean":"2023-12-12T10:12:13.966788+0000","last_became_active":"2023-12-12T10:12:08.830638+0000","last_became_peered":"2023-12-12T10:12:08.830638+0000","last_unstale":"2023-12-12T10:12:13.966788+0000","last_undegraded":"2023-12-12T10:12:13.966788+0000","last_fullsized":"2023-12-12T10:12:13.966788+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_clean_scrub_stamp":"2023-12-12T10:12:07.792253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:15:31.889391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-12T10:12:14.943486+0000","last_change":"2023-12-12T10:12:14.183763+0000","last_active":"2023-12-12T10:12:14.943486+0000","last_peered":"2023-12-12T10:12:14.943486+0000","last_clean":"2023-12-12T10:12:14.943486+0000","last_became_active":"2023-12-12T10:12:14.183320+0000","last_became_peered":"2023-12-12T10:12:14.183320+0000","last_unstale":"2023-12-12T10:12:14.943486+0000","last_undegraded":"2023-12-12T10:12:14.943486+0000","last_fullsized":"2023-12-12T10:12:14.943486+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_clean_scrub_stamp":"2023-12-12T10:12:12.929940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:46:01.637131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.954867+0000","last_change":"2023-12-12T10:12:09.843426+0000","last_active":"2023-12-12T10:12:13.954867+0000","last_peered":"2023-12-12T10:12:13.954867+0000","last_clean":"2023-12-12T10:12:13.954867+0000","last_became_active":"2023-12-12T10:12:09.841783+0000","last_became_peered":"2023-12-12T10:12:09.841783+0000","last_unstale":"2023-12-12T10:12:13.954867+0000","last_undegraded":"2023-12-12T10:12:13.954867+0000","last_fullsized":"2023-12-12T10:12:13.954867+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:29:05.621853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.963537+0000","last_change":"2023-12-12T10:12:08.835533+0000","last_active":"2023-12-12T10:12:13.963537+0000","last_peered":"2023-12-12T10:12:13.963537+0000","last_clean":"2023-12-12T10:12:13.963537+0000","last_became_active":"2023-12-12T10:12:08.835230+0000","last_became_peered":"2023-12-12T10:12:08.835230+0000","last_unstale":"2023-12-12T10:12:13.963537+0000","last_undegraded":"2023-12-12T10:12:13.963537+0000","last_fullsized":"2023-12-12T10:12:13.963537+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_clean_scrub_stamp":"2023-12-12T10:12:07.792253+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:50:55.983027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-12T10:12:15.556326+0000","last_change":"2023-12-12T10:12:13.968062+0000","last_active":"2023-12-12T10:12:15.556326+0000","last_peered":"2023-12-12T10:12:15.556326+0000","last_clean":"2023-12-12T10:12:15.556326+0000","last_became_active":"2023-12-12T10:12:13.967558+0000","last_became_peered":"2023-12-12T10:12:13.967558+0000","last_unstale":"2023-12-12T10:12:15.556326+0000","last_undegraded":"2023-12-12T10:12:15.556326+0000","last_fullsized":"2023-12-12T10:12:15.556326+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_clean_scrub_stamp":"2023-12-12T10:12:12.929940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:11:19.241925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:14.179682+0000","last_change":"2023-12-12T10:12:09.840613+0000","last_active":"2023-12-12T10:12:14.179682+0000","last_peered":"2023-12-12T10:12:14.179682+0000","last_clean":"2023-12-12T10:12:14.179682+0000","last_became_active":"2023-12-12T10:12:09.840305+0000","last_became_peered":"2023-12-12T10:12:09.840305+0000","last_unstale":"2023-12-12T10:12:14.179682+0000","last_undegraded":"2023-12-12T10:12:14.179682+0000","last_fullsized":"2023-12-12T10:12:14.179682+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:39:53.558801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.967272+0000","last_change":"2023-12-12T10:12:08.832234+0000","last_active":"2023-12-12T10:12:13.967272+0000","last_peered":"2023-12-12T10:12:13.967272+0000","last_clean":"2023-12-12T10:12:13.967272+0000","last_became_active":"2023-12-12T10:12:08.831933+0000","last_became_peered":"2023-12-12T10:12:08.831933+0000","last_unstale":"2023-12-12T10:12:13.967272+0000","last_undegraded":"2023-12-12T10:12:13.967272+0000","last_fullsized":"2023-12-12T10:12:13.967272+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_clean_scrub_stamp":"2023-12-12T10:12:07.792253+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:05:33.556015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-12T10:12:15.553874+0000","last_change":"2023-12-12T10:12:14.181013+0000","last_active":"2023-12-12T10:12:15.553874+0000","last_peered":"2023-12-12T10:12:15.553874+0000","last_clean":"2023-12-12T10:12:15.553874+0000","last_became_active":"2023-12-12T10:12:14.180237+0000","last_became_peered":"2023-12-12T10:12:14.180237+0000","last_unstale":"2023-12-12T10:12:15.553874+0000","last_undegraded":"2023-12-12T10:12:15.553874+0000","last_fullsized":"2023-12-12T10:12:15.553874+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_clean_scrub_stamp":"2023-12-12T10:12:12.929940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:41:41.466318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:14.179468+0000","last_change":"2023-12-12T10:12:09.843023+0000","last_active":"2023-12-12T10:12:14.179468+0000","last_peered":"2023-12-12T10:12:14.179468+0000","last_clean":"2023-12-12T10:12:14.179468+0000","last_became_active":"2023-12-12T10:12:09.839541+0000","last_became_peered":"2023-12-12T10:12:09.839541+0000","last_unstale":"2023-12-12T10:12:14.179468+0000","last_undegraded":"2023-12-12T10:12:14.179468+0000","last_fullsized":"2023-12-12T10:12:14.179468+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:11:15.110991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.947354+0000","last_change":"2023-12-12T10:12:08.837170+0000","last_active":"2023-12-12T10:12:13.947354+0000","last_peered":"2023-12-12T10:12:13.947354+0000","last_clean":"2023-12-12T10:12:13.947354+0000","last_became_active":"2023-12-12T10:12:08.836870+0000","last_became_peered":"2023-12-12T10:12:08.836870+0000","last_unstale":"2023-12-12T10:12:13.947354+0000","last_undegraded":"2023-12-12T10:12:13.947354+0000","last_fullsized":"2023-12-12T10:12:13.947354+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_clean_scrub_stamp":"2023-12-12T10:12:07.792253+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:02:02.748317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-12T10:12:14.943477+0000","last_change":"2023-12-12T10:12:13.961169+0000","last_active":"2023-12-12T10:12:14.943477+0000","last_peered":"2023-12-12T10:12:14.943477+0000","last_clean":"2023-12-12T10:12:14.943477+0000","last_became_active":"2023-12-12T10:12:13.960747+0000","last_became_peered":"2023-12-12T10:12:13.960747+0000","last_unstale":"2023-12-12T10:12:14.943477+0000","last_undegraded":"2023-12-12T10:12:14.943477+0000","last_fullsized":"2023-12-12T10:12:14.943477+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_clean_scrub_stamp":"2023-12-12T10:12:12.929940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:42:21.587913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:14.178613+0000","last_change":"2023-12-12T10:12:09.840229+0000","last_active":"2023-12-12T10:12:14.178613+0000","last_peered":"2023-12-12T10:12:14.178613+0000","last_clean":"2023-12-12T10:12:14.178613+0000","last_became_active":"2023-12-12T10:12:09.839022+0000","last_became_peered":"2023-12-12T10:12:09.839022+0000","last_unstale":"2023-12-12T10:12:14.178613+0000","last_undegraded":"2023-12-12T10:12:14.178613+0000","last_fullsized":"2023-12-12T10:12:14.178613+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:22:56.063355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.965950+0000","last_change":"2023-12-12T10:12:08.826707+0000","last_active":"2023-12-12T10:12:13.965950+0000","last_peered":"2023-12-12T10:12:13.965950+0000","last_clean":"2023-12-12T10:12:13.965950+0000","last_became_active":"2023-12-12T10:12:08.826379+0000","last_became_peered":"2023-12-12T10:12:08.826379+0000","last_unstale":"2023-12-12T10:12:13.965950+0000","last_undegraded":"2023-12-12T10:12:13.965950+0000","last_fullsized":"2023-12-12T10:12:13.965950+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_clean_scrub_stamp":"2023-12-12T10:12:07.792253+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:02:02.748317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-12T10:12:15.557190+0000","last_change":"2023-12-12T10:12:13.978141+0000","last_active":"2023-12-12T10:12:15.557190+0000","last_peered":"2023-12-12T10:12:15.557190+0000","last_clean":"2023-12-12T10:12:15.557190+0000","last_became_active":"2023-12-12T10:12:13.975903+0000","last_became_peered":"2023-12-12T10:12:13.975903+0000","last_unstale":"2023-12-12T10:12:15.557190+0000","last_undegraded":"2023-12-12T10:12:15.557190+0000","last_fullsized":"2023-12-12T10:12:15.557190+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_clean_scrub_stamp":"2023-12-12T10:12:12.929940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:03:54.367055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.945635+0000","last_change":"2023-12-12T10:12:09.823042+0000","last_active":"2023-12-12T10:12:13.945635+0000","last_peered":"2023-12-12T10:12:13.945635+0000","last_clean":"2023-12-12T10:12:13.945635+0000","last_became_active":"2023-12-12T10:12:09.822372+0000","last_became_peered":"2023-12-12T10:12:09.822372+0000","last_unstale":"2023-12-12T10:12:13.945635+0000","last_undegraded":"2023-12-12T10:12:13.945635+0000","last_fullsized":"2023-12-12T10:12:13.945635+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:05:45.545567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.949351+0000","last_change":"2023-12-12T10:12:08.831259+0000","last_active":"2023-12-12T10:12:13.949351+0000","last_peered":"2023-12-12T10:12:13.949351+0000","last_clean":"2023-12-12T10:12:13.949351+0000","last_became_active":"2023-12-12T10:12:08.830921+0000","last_became_peered":"2023-12-12T10:12:08.830921+0000","last_unstale":"2023-12-12T10:12:13.949351+0000","last_undegraded":"2023-12-12T10:12:13.949351+0000","last_fullsized":"2023-12-12T10:12:13.949351+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_clean_scrub_stamp":"2023-12-12T10:12:07.792253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:01:42.240854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-12T10:12:15.556830+0000","last_change":"2023-12-12T10:12:14.186089+0000","last_active":"2023-12-12T10:12:15.556830+0000","last_peered":"2023-12-12T10:12:15.556830+0000","last_clean":"2023-12-12T10:12:15.556830+0000","last_became_active":"2023-12-12T10:12:14.185616+0000","last_became_peered":"2023-12-12T10:12:14.185616+0000","last_unstale":"2023-12-12T10:12:15.556830+0000","last_undegraded":"2023-12-12T10:12:15.556830+0000","last_fullsized":"2023-12-12T10:12:15.556830+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_clean_scrub_stamp":"2023-12-12T10:12:12.929940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:44:39.253218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:14.178766+0000","last_change":"2023-12-12T10:12:09.839119+0000","last_active":"2023-12-12T10:12:14.178766+0000","last_peered":"2023-12-12T10:12:14.178766+0000","last_clean":"2023-12-12T10:12:14.178766+0000","last_became_active":"2023-12-12T10:12:09.838832+0000","last_became_peered":"2023-12-12T10:12:09.838832+0000","last_unstale":"2023-12-12T10:12:14.178766+0000","last_undegraded":"2023-12-12T10:12:14.178766+0000","last_fullsized":"2023-12-12T10:12:14.178766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:06:52.618740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.955540+0000","last_change":"2023-12-12T10:12:08.832946+0000","last_active":"2023-12-12T10:12:13.955540+0000","last_peered":"2023-12-12T10:12:13.955540+0000","last_clean":"2023-12-12T10:12:13.955540+0000","last_became_active":"2023-12-12T10:12:08.832657+0000","last_became_peered":"2023-12-12T10:12:08.832657+0000","last_unstale":"2023-12-12T10:12:13.955540+0000","last_undegraded":"2023-12-12T10:12:13.955540+0000","last_fullsized":"2023-12-12T10:12:13.955540+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_clean_scrub_stamp":"2023-12-12T10:12:07.792253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:45:52.005263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-12T10:12:15.556971+0000","last_change":"2023-12-12T10:12:14.183490+0000","last_active":"2023-12-12T10:12:15.556971+0000","last_peered":"2023-12-12T10:12:15.556971+0000","last_clean":"2023-12-12T10:12:15.556971+0000","last_became_active":"2023-12-12T10:12:14.182333+0000","last_became_peered":"2023-12-12T10:12:14.182333+0000","last_unstale":"2023-12-12T10:12:15.556971+0000","last_undegraded":"2023-12-12T10:12:15.556971+0000","last_fullsized":"2023-12-12T10:12:15.556971+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_clean_scrub_stamp":"2023-12-12T10:12:12.929940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:04:36.664695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.954813+0000","last_change":"2023-12-12T10:12:09.829410+0000","last_active":"2023-12-12T10:12:13.954813+0000","last_peered":"2023-12-12T10:12:13.954813+0000","last_clean":"2023-12-12T10:12:13.954813+0000","last_became_active":"2023-12-12T10:12:09.829144+0000","last_became_peered":"2023-12-12T10:12:09.829144+0000","last_unstale":"2023-12-12T10:12:13.954813+0000","last_undegraded":"2023-12-12T10:12:13.954813+0000","last_fullsized":"2023-12-12T10:12:13.954813+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:33:07.947544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.956073+0000","last_change":"2023-12-12T10:12:08.840254+0000","last_active":"2023-12-12T10:12:13.956073+0000","last_peered":"2023-12-12T10:12:13.956073+0000","last_clean":"2023-12-12T10:12:13.956073+0000","last_became_active":"2023-12-12T10:12:08.839962+0000","last_became_peered":"2023-12-12T10:12:08.839962+0000","last_unstale":"2023-12-12T10:12:13.956073+0000","last_undegraded":"2023-12-12T10:12:13.956073+0000","last_fullsized":"2023-12-12T10:12:13.956073+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_clean_scrub_stamp":"2023-12-12T10:12:07.792253+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:46:36.023306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-12T10:12:15.554704+0000","last_change":"2023-12-12T10:12:14.180551+0000","last_active":"2023-12-12T10:12:15.554704+0000","last_peered":"2023-12-12T10:12:15.554704+0000","last_clean":"2023-12-12T10:12:15.554704+0000","last_became_active":"2023-12-12T10:12:14.180147+0000","last_became_peered":"2023-12-12T10:12:14.180147+0000","last_unstale":"2023-12-12T10:12:15.554704+0000","last_undegraded":"2023-12-12T10:12:15.554704+0000","last_fullsized":"2023-12-12T10:12:15.554704+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_clean_scrub_stamp":"2023-12-12T10:12:12.929940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:46:26.737660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:14.178878+0000","last_change":"2023-12-12T10:12:09.840271+0000","last_active":"2023-12-12T10:12:14.178878+0000","last_peered":"2023-12-12T10:12:14.178878+0000","last_clean":"2023-12-12T10:12:14.178878+0000","last_became_active":"2023-12-12T10:12:09.839285+0000","last_became_peered":"2023-12-12T10:12:09.839285+0000","last_unstale":"2023-12-12T10:12:14.178878+0000","last_undegraded":"2023-12-12T10:12:14.178878+0000","last_fullsized":"2023-12-12T10:12:14.178878+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:08:12.099242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'8","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-12T10:12:18.763644+0000","last_change":"2023-12-12T10:12:08.833712+0000","last_active":"2023-12-12T10:12:18.763644+0000","last_peered":"2023-12-12T10:12:18.763644+0000","last_clean":"2023-12-12T10:12:18.763644+0000","last_became_active":"2023-12-12T10:12:08.833335+0000","last_became_peered":"2023-12-12T10:12:08.833335+0000","last_unstale":"2023-12-12T10:12:18.763644+0000","last_undegraded":"2023-12-12T10:12:18.763644+0000","last_fullsized":"2023-12-12T10:12:18.763644+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_clean_scrub_stamp":"2023-12-12T10:12:07.792253+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:41:37.226888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3698,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-12T10:12:15.184374+0000","last_change":"2023-12-12T10:12:13.969124+0000","last_active":"2023-12-12T10:12:15.184374+0000","last_peered":"2023-12-12T10:12:15.184374+0000","last_clean":"2023-12-12T10:12:15.184374+0000","last_became_active":"2023-12-12T10:12:13.968588+0000","last_became_peered":"2023-12-12T10:12:13.968588+0000","last_unstale":"2023-12-12T10:12:15.184374+0000","last_undegraded":"2023-12-12T10:12:15.184374+0000","last_fullsized":"2023-12-12T10:12:15.184374+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_clean_scrub_stamp":"2023-12-12T10:12:12.929940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:17:23.880191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.947087+0000","last_change":"2023-12-12T10:12:09.836126+0000","last_active":"2023-12-12T10:12:13.947087+0000","last_peered":"2023-12-12T10:12:13.947087+0000","last_clean":"2023-12-12T10:12:13.947087+0000","last_became_active":"2023-12-12T10:12:09.835866+0000","last_became_peered":"2023-12-12T10:12:09.835866+0000","last_unstale":"2023-12-12T10:12:13.947087+0000","last_undegraded":"2023-12-12T10:12:13.947087+0000","last_fullsized":"2023-12-12T10:12:13.947087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:01:43.247607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.963472+0000","last_change":"2023-12-12T10:12:08.835844+0000","last_active":"2023-12-12T10:12:13.963472+0000","last_peered":"2023-12-12T10:12:13.963472+0000","last_clean":"2023-12-12T10:12:13.963472+0000","last_became_active":"2023-12-12T10:12:08.835523+0000","last_became_peered":"2023-12-12T10:12:08.835523+0000","last_unstale":"2023-12-12T10:12:13.963472+0000","last_undegraded":"2023-12-12T10:12:13.963472+0000","last_fullsized":"2023-12-12T10:12:13.963472+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_clean_scrub_stamp":"2023-12-12T10:12:07.792253+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:22:26.547358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-12T10:12:14.944351+0000","last_change":"2023-12-12T10:12:13.963846+0000","last_active":"2023-12-12T10:12:14.944351+0000","last_peered":"2023-12-12T10:12:14.944351+0000","last_clean":"2023-12-12T10:12:14.944351+0000","last_became_active":"2023-12-12T10:12:13.963343+0000","last_became_peered":"2023-12-12T10:12:13.963343+0000","last_unstale":"2023-12-12T10:12:14.944351+0000","last_undegraded":"2023-12-12T10:12:14.944351+0000","last_fullsized":"2023-12-12T10:12:14.944351+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_clean_scrub_stamp":"2023-12-12T10:12:12.929940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:47:49.100393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.957119+0000","last_change":"2023-12-12T10:12:09.846702+0000","last_active":"2023-12-12T10:12:13.957119+0000","last_peered":"2023-12-12T10:12:13.957119+0000","last_clean":"2023-12-12T10:12:13.957119+0000","last_became_active":"2023-12-12T10:12:09.846459+0000","last_became_peered":"2023-12-12T10:12:09.846459+0000","last_unstale":"2023-12-12T10:12:13.957119+0000","last_undegraded":"2023-12-12T10:12:13.957119+0000","last_fullsized":"2023-12-12T10:12:13.957119+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:42:17.456979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.955160+0000","last_change":"2023-12-12T10:12:08.843421+0000","last_active":"2023-12-12T10:12:13.955160+0000","last_peered":"2023-12-12T10:12:13.955160+0000","last_clean":"2023-12-12T10:12:13.955160+0000","last_became_active":"2023-12-12T10:12:08.843122+0000","last_became_peered":"2023-12-12T10:12:08.843122+0000","last_unstale":"2023-12-12T10:12:13.955160+0000","last_undegraded":"2023-12-12T10:12:13.955160+0000","last_fullsized":"2023-12-12T10:12:13.955160+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_clean_scrub_stamp":"2023-12-12T10:12:07.792253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:59:45.615605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-12T10:12:15.555918+0000","last_change":"2023-12-12T10:12:13.964875+0000","last_active":"2023-12-12T10:12:15.555918+0000","last_peered":"2023-12-12T10:12:15.555918+0000","last_clean":"2023-12-12T10:12:15.555918+0000","last_became_active":"2023-12-12T10:12:13.964323+0000","last_became_peered":"2023-12-12T10:12:13.964323+0000","last_unstale":"2023-12-12T10:12:15.555918+0000","last_undegraded":"2023-12-12T10:12:15.555918+0000","last_fullsized":"2023-12-12T10:12:15.555918+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_clean_scrub_stamp":"2023-12-12T10:12:12.929940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:35:07.230080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.955023+0000","last_change":"2023-12-12T10:12:09.846552+0000","last_active":"2023-12-12T10:12:13.955023+0000","last_peered":"2023-12-12T10:12:13.955023+0000","last_clean":"2023-12-12T10:12:13.955023+0000","last_became_active":"2023-12-12T10:12:09.844321+0000","last_became_peered":"2023-12-12T10:12:09.844321+0000","last_unstale":"2023-12-12T10:12:13.955023+0000","last_undegraded":"2023-12-12T10:12:13.955023+0000","last_fullsized":"2023-12-12T10:12:13.955023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:47:44.969459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.945152+0000","last_change":"2023-12-12T10:12:08.833577+0000","last_active":"2023-12-12T10:12:13.945152+0000","last_peered":"2023-12-12T10:12:13.945152+0000","last_clean":"2023-12-12T10:12:13.945152+0000","last_became_active":"2023-12-12T10:12:08.833266+0000","last_became_peered":"2023-12-12T10:12:08.833266+0000","last_unstale":"2023-12-12T10:12:13.945152+0000","last_undegraded":"2023-12-12T10:12:13.945152+0000","last_fullsized":"2023-12-12T10:12:13.945152+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_clean_scrub_stamp":"2023-12-12T10:12:07.792253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:50:55.983027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-12T10:12:15.555695+0000","last_change":"2023-12-12T10:12:14.187838+0000","last_active":"2023-12-12T10:12:15.555695+0000","last_peered":"2023-12-12T10:12:15.555695+0000","last_clean":"2023-12-12T10:12:15.555695+0000","last_became_active":"2023-12-12T10:12:14.187430+0000","last_became_peered":"2023-12-12T10:12:14.187430+0000","last_unstale":"2023-12-12T10:12:15.555695+0000","last_undegraded":"2023-12-12T10:12:15.555695+0000","last_fullsized":"2023-12-12T10:12:15.555695+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_clean_scrub_stamp":"2023-12-12T10:12:12.929940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:10:11.022165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-12T10:12:15.557056+0000","last_change":"2023-12-12T10:12:14.186204+0000","last_active":"2023-12-12T10:12:15.557056+0000","last_peered":"2023-12-12T10:12:15.557056+0000","last_clean":"2023-12-12T10:12:15.557056+0000","last_became_active":"2023-12-12T10:12:14.185264+0000","last_became_peered":"2023-12-12T10:12:14.185264+0000","last_unstale":"2023-12-12T10:12:15.557056+0000","last_undegraded":"2023-12-12T10:12:15.557056+0000","last_fullsized":"2023-12-12T10:12:15.557056+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_clean_scrub_stamp":"2023-12-12T10:12:12.929940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:17:23.880191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.960807+0000","last_change":"2023-12-12T10:12:09.829976+0000","last_active":"2023-12-12T10:12:13.960807+0000","last_peered":"2023-12-12T10:12:13.960807+0000","last_clean":"2023-12-12T10:12:13.960807+0000","last_became_active":"2023-12-12T10:12:09.829573+0000","last_became_peered":"2023-12-12T10:12:09.829573+0000","last_unstale":"2023-12-12T10:12:13.960807+0000","last_undegraded":"2023-12-12T10:12:13.960807+0000","last_fullsized":"2023-12-12T10:12:13.960807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:05:45.545567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.954582+0000","last_change":"2023-12-12T10:12:08.820896+0000","last_active":"2023-12-12T10:12:13.954582+0000","last_peered":"2023-12-12T10:12:13.954582+0000","last_clean":"2023-12-12T10:12:13.954582+0000","last_became_active":"2023-12-12T10:12:08.819705+0000","last_became_peered":"2023-12-12T10:12:08.819705+0000","last_unstale":"2023-12-12T10:12:13.954582+0000","last_undegraded":"2023-12-12T10:12:13.954582+0000","last_fullsized":"2023-12-12T10:12:13.954582+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_clean_scrub_stamp":"2023-12-12T10:12:07.792253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:14:21.574354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-12T10:12:14.944814+0000","last_change":"2023-12-12T10:12:13.966284+0000","last_active":"2023-12-12T10:12:14.944814+0000","last_peered":"2023-12-12T10:12:14.944814+0000","last_clean":"2023-12-12T10:12:14.944814+0000","last_became_active":"2023-12-12T10:12:13.965836+0000","last_became_peered":"2023-12-12T10:12:13.965836+0000","last_unstale":"2023-12-12T10:12:14.944814+0000","last_undegraded":"2023-12-12T10:12:14.944814+0000","last_fullsized":"2023-12-12T10:12:14.944814+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_clean_scrub_stamp":"2023-12-12T10:12:12.929940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:29:09.752788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.942530+0000","last_change":"2023-12-12T10:12:09.836385+0000","last_active":"2023-12-12T10:12:13.942530+0000","last_peered":"2023-12-12T10:12:13.942530+0000","last_clean":"2023-12-12T10:12:13.942530+0000","last_became_active":"2023-12-12T10:12:09.836038+0000","last_became_peered":"2023-12-12T10:12:09.836038+0000","last_unstale":"2023-12-12T10:12:13.942530+0000","last_undegraded":"2023-12-12T10:12:13.942530+0000","last_fullsized":"2023-12-12T10:12:13.942530+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:08:12.099242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.942840+0000","last_change":"2023-12-12T10:12:08.842624+0000","last_active":"2023-12-12T10:12:13.942840+0000","last_peered":"2023-12-12T10:12:13.942840+0000","last_clean":"2023-12-12T10:12:13.942840+0000","last_became_active":"2023-12-12T10:12:08.842340+0000","last_became_peered":"2023-12-12T10:12:08.842340+0000","last_unstale":"2023-12-12T10:12:13.942840+0000","last_undegraded":"2023-12-12T10:12:13.942840+0000","last_fullsized":"2023-12-12T10:12:13.942840+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_clean_scrub_stamp":"2023-12-12T10:12:07.792253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:43:30.327223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.942405+0000","last_change":"2023-12-12T10:12:08.828385+0000","last_active":"2023-12-12T10:12:13.942405+0000","last_peered":"2023-12-12T10:12:13.942405+0000","last_clean":"2023-12-12T10:12:13.942405+0000","last_became_active":"2023-12-12T10:12:08.828078+0000","last_became_peered":"2023-12-12T10:12:08.828078+0000","last_unstale":"2023-12-12T10:12:13.942405+0000","last_undegraded":"2023-12-12T10:12:13.942405+0000","last_fullsized":"2023-12-12T10:12:13.942405+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_clean_scrub_stamp":"2023-12-12T10:12:07.792253+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:46:36.023306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.955847+0000","last_change":"2023-12-12T10:12:09.839770+0000","last_active":"2023-12-12T10:12:13.955847+0000","last_peered":"2023-12-12T10:12:13.955847+0000","last_clean":"2023-12-12T10:12:13.955847+0000","last_became_active":"2023-12-12T10:12:09.838270+0000","last_became_peered":"2023-12-12T10:12:09.838270+0000","last_unstale":"2023-12-12T10:12:13.955847+0000","last_undegraded":"2023-12-12T10:12:13.955847+0000","last_fullsized":"2023-12-12T10:12:13.955847+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:05:45.545567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-12T10:12:14.944264+0000","last_change":"2023-12-12T10:12:13.976903+0000","last_active":"2023-12-12T10:12:14.944264+0000","last_peered":"2023-12-12T10:12:14.944264+0000","last_clean":"2023-12-12T10:12:14.944264+0000","last_became_active":"2023-12-12T10:12:13.976414+0000","last_became_peered":"2023-12-12T10:12:13.976414+0000","last_unstale":"2023-12-12T10:12:14.944264+0000","last_undegraded":"2023-12-12T10:12:14.944264+0000","last_fullsized":"2023-12-12T10:12:14.944264+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_clean_scrub_stamp":"2023-12-12T10:12:12.929940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:22:31.685044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.943480+0000","last_change":"2023-12-12T10:12:08.841907+0000","last_active":"2023-12-12T10:12:13.943480+0000","last_peered":"2023-12-12T10:12:13.943480+0000","last_clean":"2023-12-12T10:12:13.943480+0000","last_became_active":"2023-12-12T10:12:08.841597+0000","last_became_peered":"2023-12-12T10:12:08.841597+0000","last_unstale":"2023-12-12T10:12:13.943480+0000","last_undegraded":"2023-12-12T10:12:13.943480+0000","last_fullsized":"2023-12-12T10:12:13.943480+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_clean_scrub_stamp":"2023-12-12T10:12:07.792253+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:50:55.983027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.945193+0000","last_change":"2023-12-12T10:12:09.825457+0000","last_active":"2023-12-12T10:12:13.945193+0000","last_peered":"2023-12-12T10:12:13.945193+0000","last_clean":"2023-12-12T10:12:13.945193+0000","last_became_active":"2023-12-12T10:12:09.824655+0000","last_became_peered":"2023-12-12T10:12:09.824655+0000","last_unstale":"2023-12-12T10:12:13.945193+0000","last_undegraded":"2023-12-12T10:12:13.945193+0000","last_fullsized":"2023-12-12T10:12:13.945193+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:46:37.030058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-12T10:12:15.556592+0000","last_change":"2023-12-12T10:12:13.978242+0000","last_active":"2023-12-12T10:12:15.556592+0000","last_peered":"2023-12-12T10:12:15.556592+0000","last_clean":"2023-12-12T10:12:15.556592+0000","last_became_active":"2023-12-12T10:12:13.977875+0000","last_became_peered":"2023-12-12T10:12:13.977875+0000","last_unstale":"2023-12-12T10:12:15.556592+0000","last_undegraded":"2023-12-12T10:12:15.556592+0000","last_fullsized":"2023-12-12T10:12:15.556592+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_clean_scrub_stamp":"2023-12-12T10:12:12.929940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:36:01.186241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.945551+0000","last_change":"2023-12-12T10:12:09.825518+0000","last_active":"2023-12-12T10:12:13.945551+0000","last_peered":"2023-12-12T10:12:13.945551+0000","last_clean":"2023-12-12T10:12:13.945551+0000","last_became_active":"2023-12-12T10:12:09.822775+0000","last_became_peered":"2023-12-12T10:12:09.822775+0000","last_unstale":"2023-12-12T10:12:13.945551+0000","last_undegraded":"2023-12-12T10:12:13.945551+0000","last_fullsized":"2023-12-12T10:12:13.945551+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:24:13.207348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.965244+0000","last_change":"2023-12-12T10:12:09.844690+0000","last_active":"2023-12-12T10:12:13.965244+0000","last_peered":"2023-12-12T10:12:13.965244+0000","last_clean":"2023-12-12T10:12:13.965244+0000","last_became_active":"2023-12-12T10:12:09.844429+0000","last_became_peered":"2023-12-12T10:12:09.844429+0000","last_unstale":"2023-12-12T10:12:13.965244+0000","last_undegraded":"2023-12-12T10:12:13.965244+0000","last_fullsized":"2023-12-12T10:12:13.965244+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:46:37.030058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.955446+0000","last_change":"2023-12-12T10:12:09.838818+0000","last_active":"2023-12-12T10:12:13.955446+0000","last_peered":"2023-12-12T10:12:13.955446+0000","last_clean":"2023-12-12T10:12:13.955446+0000","last_became_active":"2023-12-12T10:12:09.838507+0000","last_became_peered":"2023-12-12T10:12:09.838507+0000","last_unstale":"2023-12-12T10:12:13.955446+0000","last_undegraded":"2023-12-12T10:12:13.955446+0000","last_fullsized":"2023-12-12T10:12:13.955446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:08:12.099242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.955753+0000","last_change":"2023-12-12T10:12:09.831070+0000","last_active":"2023-12-12T10:12:13.955753+0000","last_peered":"2023-12-12T10:12:13.955753+0000","last_clean":"2023-12-12T10:12:13.955753+0000","last_became_active":"2023-12-12T10:12:09.830702+0000","last_became_peered":"2023-12-12T10:12:09.830702+0000","last_unstale":"2023-12-12T10:12:13.955753+0000","last_undegraded":"2023-12-12T10:12:13.955753+0000","last_fullsized":"2023-12-12T10:12:13.955753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:24:13.207348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.944609+0000","last_change":"2023-12-12T10:12:09.839496+0000","last_active":"2023-12-12T10:12:13.944609+0000","last_peered":"2023-12-12T10:12:13.944609+0000","last_clean":"2023-12-12T10:12:13.944609+0000","last_became_active":"2023-12-12T10:12:09.839184+0000","last_became_peered":"2023-12-12T10:12:09.839184+0000","last_unstale":"2023-12-12T10:12:13.944609+0000","last_undegraded":"2023-12-12T10:12:13.944609+0000","last_fullsized":"2023-12-12T10:12:13.944609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:14:22.581107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.963351+0000","last_change":"2023-12-12T10:12:09.833470+0000","last_active":"2023-12-12T10:12:13.963351+0000","last_peered":"2023-12-12T10:12:13.963351+0000","last_clean":"2023-12-12T10:12:13.963351+0000","last_became_active":"2023-12-12T10:12:09.833154+0000","last_became_peered":"2023-12-12T10:12:09.833154+0000","last_unstale":"2023-12-12T10:12:13.963351+0000","last_undegraded":"2023-12-12T10:12:13.963351+0000","last_fullsized":"2023-12-12T10:12:13.963351+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:42:17.456979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.945149+0000","last_change":"2023-12-12T10:12:09.826435+0000","last_active":"2023-12-12T10:12:13.945149+0000","last_peered":"2023-12-12T10:12:13.945149+0000","last_clean":"2023-12-12T10:12:13.945149+0000","last_became_active":"2023-12-12T10:12:09.826055+0000","last_became_peered":"2023-12-12T10:12:09.826055+0000","last_unstale":"2023-12-12T10:12:13.945149+0000","last_undegraded":"2023-12-12T10:12:13.945149+0000","last_fullsized":"2023-12-12T10:12:13.945149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:29:34.002418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.947105+0000","last_change":"2023-12-12T10:12:09.835389+0000","last_active":"2023-12-12T10:12:13.947105+0000","last_peered":"2023-12-12T10:12:13.947105+0000","last_clean":"2023-12-12T10:12:13.947105+0000","last_became_active":"2023-12-12T10:12:09.835119+0000","last_became_peered":"2023-12-12T10:12:09.835119+0000","last_unstale":"2023-12-12T10:12:13.947105+0000","last_undegraded":"2023-12-12T10:12:13.947105+0000","last_fullsized":"2023-12-12T10:12:13.947105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:29:34.002418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.953512+0000","last_change":"2023-12-12T10:12:09.840058+0000","last_active":"2023-12-12T10:12:13.953512+0000","last_peered":"2023-12-12T10:12:13.953512+0000","last_clean":"2023-12-12T10:12:13.953512+0000","last_became_active":"2023-12-12T10:12:09.839675+0000","last_became_peered":"2023-12-12T10:12:09.839675+0000","last_unstale":"2023-12-12T10:12:13.953512+0000","last_undegraded":"2023-12-12T10:12:13.953512+0000","last_fullsized":"2023-12-12T10:12:13.953512+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:29:34.002418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.942739+0000","last_change":"2023-12-12T10:12:09.842044+0000","last_active":"2023-12-12T10:12:13.942739+0000","last_peered":"2023-12-12T10:12:13.942739+0000","last_clean":"2023-12-12T10:12:13.942739+0000","last_became_active":"2023-12-12T10:12:09.841751+0000","last_became_peered":"2023-12-12T10:12:09.841751+0000","last_unstale":"2023-12-12T10:12:13.942739+0000","last_undegraded":"2023-12-12T10:12:13.942739+0000","last_fullsized":"2023-12-12T10:12:13.942739+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:42:17.456979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.955340+0000","last_change":"2023-12-12T10:12:09.835927+0000","last_active":"2023-12-12T10:12:13.955340+0000","last_peered":"2023-12-12T10:12:13.955340+0000","last_clean":"2023-12-12T10:12:13.955340+0000","last_became_active":"2023-12-12T10:12:09.835625+0000","last_became_peered":"2023-12-12T10:12:09.835625+0000","last_unstale":"2023-12-12T10:12:13.955340+0000","last_undegraded":"2023-12-12T10:12:13.955340+0000","last_fullsized":"2023-12-12T10:12:13.955340+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:22:56.063355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.955249+0000","last_change":"2023-12-12T10:12:09.834124+0000","last_active":"2023-12-12T10:12:13.955249+0000","last_peered":"2023-12-12T10:12:13.955249+0000","last_clean":"2023-12-12T10:12:13.955249+0000","last_became_active":"2023-12-12T10:12:09.833698+0000","last_became_peered":"2023-12-12T10:12:09.833698+0000","last_unstale":"2023-12-12T10:12:13.955249+0000","last_undegraded":"2023-12-12T10:12:13.955249+0000","last_fullsized":"2023-12-12T10:12:13.955249+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:45:53.012016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.944483+0000","last_change":"2023-12-12T10:12:09.831637+0000","last_active":"2023-12-12T10:12:13.944483+0000","last_peered":"2023-12-12T10:12:13.944483+0000","last_clean":"2023-12-12T10:12:13.944483+0000","last_became_active":"2023-12-12T10:12:09.831330+0000","last_became_peered":"2023-12-12T10:12:09.831330+0000","last_unstale":"2023-12-12T10:12:13.944483+0000","last_undegraded":"2023-12-12T10:12:13.944483+0000","last_fullsized":"2023-12-12T10:12:13.944483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:45:53.012016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:14.179084+0000","last_change":"2023-12-12T10:12:09.832795+0000","last_active":"2023-12-12T10:12:14.179084+0000","last_peered":"2023-12-12T10:12:14.179084+0000","last_clean":"2023-12-12T10:12:14.179084+0000","last_became_active":"2023-12-12T10:12:09.832536+0000","last_became_peered":"2023-12-12T10:12:09.832536+0000","last_unstale":"2023-12-12T10:12:14.179084+0000","last_undegraded":"2023-12-12T10:12:14.179084+0000","last_fullsized":"2023-12-12T10:12:14.179084+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:17:19.749257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.967788+0000","last_change":"2023-12-12T10:12:09.836093+0000","last_active":"2023-12-12T10:12:13.967788+0000","last_peered":"2023-12-12T10:12:13.967788+0000","last_clean":"2023-12-12T10:12:13.967788+0000","last_became_active":"2023-12-12T10:12:09.835900+0000","last_became_peered":"2023-12-12T10:12:09.835900+0000","last_unstale":"2023-12-12T10:12:13.967788+0000","last_undegraded":"2023-12-12T10:12:13.967788+0000","last_fullsized":"2023-12-12T10:12:13.967788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:41:38.233640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.955513+0000","last_change":"2023-12-12T10:12:09.842078+0000","last_active":"2023-12-12T10:12:13.955513+0000","last_peered":"2023-12-12T10:12:13.955513+0000","last_clean":"2023-12-12T10:12:13.955513+0000","last_became_active":"2023-12-12T10:12:09.841393+0000","last_became_peered":"2023-12-12T10:12:09.841393+0000","last_unstale":"2023-12-12T10:12:13.955513+0000","last_undegraded":"2023-12-12T10:12:13.955513+0000","last_fullsized":"2023-12-12T10:12:13.955513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:11:15.110991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.953508+0000","last_change":"2023-12-12T10:12:09.835453+0000","last_active":"2023-12-12T10:12:13.953508+0000","last_peered":"2023-12-12T10:12:13.953508+0000","last_clean":"2023-12-12T10:12:13.953508+0000","last_became_active":"2023-12-12T10:12:09.835078+0000","last_became_peered":"2023-12-12T10:12:09.835078+0000","last_unstale":"2023-12-12T10:12:13.953508+0000","last_undegraded":"2023-12-12T10:12:13.953508+0000","last_fullsized":"2023-12-12T10:12:13.953508+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:42:17.456979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.960892+0000","last_change":"2023-12-12T10:12:09.836102+0000","last_active":"2023-12-12T10:12:13.960892+0000","last_peered":"2023-12-12T10:12:13.960892+0000","last_clean":"2023-12-12T10:12:13.960892+0000","last_became_active":"2023-12-12T10:12:09.835809+0000","last_became_peered":"2023-12-12T10:12:09.835809+0000","last_unstale":"2023-12-12T10:12:13.960892+0000","last_undegraded":"2023-12-12T10:12:13.960892+0000","last_fullsized":"2023-12-12T10:12:13.960892+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:29:34.002418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.954718+0000","last_change":"2023-12-12T10:12:09.825563+0000","last_active":"2023-12-12T10:12:13.954718+0000","last_peered":"2023-12-12T10:12:13.954718+0000","last_clean":"2023-12-12T10:12:13.954718+0000","last_became_active":"2023-12-12T10:12:09.825296+0000","last_became_peered":"2023-12-12T10:12:09.825296+0000","last_unstale":"2023-12-12T10:12:13.954718+0000","last_undegraded":"2023-12-12T10:12:13.954718+0000","last_fullsized":"2023-12-12T10:12:13.954718+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:50:56.989780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.942544+0000","last_change":"2023-12-12T10:12:09.834352+0000","last_active":"2023-12-12T10:12:13.942544+0000","last_peered":"2023-12-12T10:12:13.942544+0000","last_clean":"2023-12-12T10:12:13.942544+0000","last_became_active":"2023-12-12T10:12:09.834163+0000","last_became_peered":"2023-12-12T10:12:09.834163+0000","last_unstale":"2023-12-12T10:12:13.942544+0000","last_undegraded":"2023-12-12T10:12:13.942544+0000","last_fullsized":"2023-12-12T10:12:13.942544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:45:53.012016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.946993+0000","last_change":"2023-12-12T10:12:09.833417+0000","last_active":"2023-12-12T10:12:13.946993+0000","last_peered":"2023-12-12T10:12:13.946993+0000","last_clean":"2023-12-12T10:12:13.946993+0000","last_became_active":"2023-12-12T10:12:09.833065+0000","last_became_peered":"2023-12-12T10:12:09.833065+0000","last_unstale":"2023-12-12T10:12:13.946993+0000","last_undegraded":"2023-12-12T10:12:13.946993+0000","last_fullsized":"2023-12-12T10:12:13.946993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:05:34.562768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.945203+0000","last_change":"2023-12-12T10:12:09.847547+0000","last_active":"2023-12-12T10:12:13.945203+0000","last_peered":"2023-12-12T10:12:13.945203+0000","last_clean":"2023-12-12T10:12:13.945203+0000","last_became_active":"2023-12-12T10:12:09.847242+0000","last_became_peered":"2023-12-12T10:12:09.847242+0000","last_unstale":"2023-12-12T10:12:13.945203+0000","last_undegraded":"2023-12-12T10:12:13.945203+0000","last_fullsized":"2023-12-12T10:12:13.945203+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:59:46.622358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.945295+0000","last_change":"2023-12-12T10:12:09.845347+0000","last_active":"2023-12-12T10:12:13.945295+0000","last_peered":"2023-12-12T10:12:13.945295+0000","last_clean":"2023-12-12T10:12:13.945295+0000","last_became_active":"2023-12-12T10:12:09.845043+0000","last_became_peered":"2023-12-12T10:12:09.845043+0000","last_unstale":"2023-12-12T10:12:13.945295+0000","last_undegraded":"2023-12-12T10:12:13.945295+0000","last_fullsized":"2023-12-12T10:12:13.945295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:42:17.456979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:14.179662+0000","last_change":"2023-12-12T10:12:09.846679+0000","last_active":"2023-12-12T10:12:14.179662+0000","last_peered":"2023-12-12T10:12:14.179662+0000","last_clean":"2023-12-12T10:12:14.179662+0000","last_became_active":"2023-12-12T10:12:09.846392+0000","last_became_peered":"2023-12-12T10:12:09.846392+0000","last_unstale":"2023-12-12T10:12:14.179662+0000","last_undegraded":"2023-12-12T10:12:14.179662+0000","last_fullsized":"2023-12-12T10:12:14.179662+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:51:42.379319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.941904+0000","last_change":"2023-12-12T10:12:09.839337+0000","last_active":"2023-12-12T10:12:13.941904+0000","last_peered":"2023-12-12T10:12:13.941904+0000","last_clean":"2023-12-12T10:12:13.941904+0000","last_became_active":"2023-12-12T10:12:09.838987+0000","last_became_peered":"2023-12-12T10:12:09.838987+0000","last_unstale":"2023-12-12T10:12:13.941904+0000","last_undegraded":"2023-12-12T10:12:13.941904+0000","last_fullsized":"2023-12-12T10:12:13.941904+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:22:56.063355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:14.178541+0000","last_change":"2023-12-12T10:12:09.827527+0000","last_active":"2023-12-12T10:12:14.178541+0000","last_peered":"2023-12-12T10:12:14.178541+0000","last_clean":"2023-12-12T10:12:14.178541+0000","last_became_active":"2023-12-12T10:12:09.827216+0000","last_became_peered":"2023-12-12T10:12:09.827216+0000","last_unstale":"2023-12-12T10:12:14.178541+0000","last_undegraded":"2023-12-12T10:12:14.178541+0000","last_fullsized":"2023-12-12T10:12:14.178541+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:47:44.969459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.955227+0000","last_change":"2023-12-12T10:12:09.835033+0000","last_active":"2023-12-12T10:12:13.955227+0000","last_peered":"2023-12-12T10:12:13.955227+0000","last_clean":"2023-12-12T10:12:13.955227+0000","last_became_active":"2023-12-12T10:12:09.834115+0000","last_became_peered":"2023-12-12T10:12:09.834115+0000","last_unstale":"2023-12-12T10:12:13.955227+0000","last_undegraded":"2023-12-12T10:12:13.955227+0000","last_fullsized":"2023-12-12T10:12:13.955227+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T22:01:05.110732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:14.178670+0000","last_change":"2023-12-12T10:12:09.831879+0000","last_active":"2023-12-12T10:12:14.178670+0000","last_peered":"2023-12-12T10:12:14.178670+0000","last_clean":"2023-12-12T10:12:14.178670+0000","last_became_active":"2023-12-12T10:12:09.831596+0000","last_became_peered":"2023-12-12T10:12:09.831596+0000","last_unstale":"2023-12-12T10:12:14.178670+0000","last_undegraded":"2023-12-12T10:12:14.178670+0000","last_fullsized":"2023-12-12T10:12:14.178670+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:29:05.621853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.954769+0000","last_change":"2023-12-12T10:12:09.844712+0000","last_active":"2023-12-12T10:12:13.954769+0000","last_peered":"2023-12-12T10:12:13.954769+0000","last_clean":"2023-12-12T10:12:13.954769+0000","last_became_active":"2023-12-12T10:12:09.843173+0000","last_became_peered":"2023-12-12T10:12:09.843173+0000","last_unstale":"2023-12-12T10:12:13.954769+0000","last_undegraded":"2023-12-12T10:12:13.954769+0000","last_fullsized":"2023-12-12T10:12:13.954769+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:45:57.506196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.955973+0000","last_change":"2023-12-12T10:12:09.833009+0000","last_active":"2023-12-12T10:12:13.955973+0000","last_peered":"2023-12-12T10:12:13.955973+0000","last_clean":"2023-12-12T10:12:13.955973+0000","last_became_active":"2023-12-12T10:12:09.832730+0000","last_became_peered":"2023-12-12T10:12:09.832730+0000","last_unstale":"2023-12-12T10:12:13.955973+0000","last_undegraded":"2023-12-12T10:12:13.955973+0000","last_fullsized":"2023-12-12T10:12:13.955973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:14:22.581107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.962427+0000","last_change":"2023-12-12T10:12:09.832531+0000","last_active":"2023-12-12T10:12:13.962427+0000","last_peered":"2023-12-12T10:12:13.962427+0000","last_clean":"2023-12-12T10:12:13.962427+0000","last_became_active":"2023-12-12T10:12:09.831562+0000","last_became_peered":"2023-12-12T10:12:09.831562+0000","last_unstale":"2023-12-12T10:12:13.962427+0000","last_undegraded":"2023-12-12T10:12:13.962427+0000","last_fullsized":"2023-12-12T10:12:13.962427+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T22:01:05.110732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:14.179520+0000","last_change":"2023-12-12T10:12:09.832536+0000","last_active":"2023-12-12T10:12:14.179520+0000","last_peered":"2023-12-12T10:12:14.179520+0000","last_clean":"2023-12-12T10:12:14.179520+0000","last_became_active":"2023-12-12T10:12:09.832284+0000","last_became_peered":"2023-12-12T10:12:09.832284+0000","last_unstale":"2023-12-12T10:12:14.179520+0000","last_undegraded":"2023-12-12T10:12:14.179520+0000","last_fullsized":"2023-12-12T10:12:14.179520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:03:50.236121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4496,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":851968,"data_stored":690742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73099999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":258048,"data_stored":99882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82899999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80500000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":266240,"data_stored":99918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78500000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76900000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81499999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.311}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74099999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":253952,"data_stored":99792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78800000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91400000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":262144,"data_stored":99952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77100000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81499999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":856064,"data_stored":689829,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.318}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3698,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3698,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-12T10:12:28.000 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-12T10:12:28.176 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.170+0000 7f8f6e617640 1 Processor -- start 2023-12-12T10:12:28.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.170+0000 7f8f6e617640 1 -- start start 2023-12-12T10:12:28.178 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.170+0000 7f8f6e617640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f8f6815e360 0x7f8f6806a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:28.178 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.170+0000 7f8f6e617640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8f6806bbc0 0x7f8f6815d720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:28.179 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.170+0000 7f8f6e617640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8f680b24b0 0x7f8f680b2920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:28.179 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.170+0000 7f8f6e617640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f6815e740 con 0x7f8f6806bbc0 2023-12-12T10:12:28.179 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.170+0000 7f8f6e617640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f680b2e60 con 0x7f8f6815e360 2023-12-12T10:12:28.179 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.170+0000 7f8f6e617640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f6806ab20 con 0x7f8f680b24b0 2023-12-12T10:12:28.179 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.170+0000 7f8f677fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8f6806bbc0 0x7f8f6815d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:28.179 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.170+0000 7f8f677fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8f6806bbc0 0x7f8f6815d720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47674/0 (socket says 172.21.15.78:47674) 2023-12-12T10:12:28.179 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.170+0000 7f8f677fe640 1 -- 172.21.15.78:0/804007457 learned_addr learned my addr 172.21.15.78:0/804007457 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:28.179 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.170+0000 7f8f67fff640 1 --2- 172.21.15.78:0/804007457 >> v2:172.21.15.187:3300/0 conn(0x7f8f6815e360 0x7f8f6806a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:28.179 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.170+0000 7f8f6cbb4640 1 --2- 172.21.15.78:0/804007457 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8f680b24b0 0x7f8f680b2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:28.179 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.170+0000 7f8f677fe640 1 -- 172.21.15.78:0/804007457 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8f680b24b0 msgr2=0x7f8f680b2920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:28.179 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.170+0000 7f8f677fe640 1 --2- 172.21.15.78:0/804007457 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8f680b24b0 0x7f8f680b2920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:28.179 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.170+0000 7f8f677fe640 1 -- 172.21.15.78:0/804007457 >> v2:172.21.15.187:3300/0 conn(0x7f8f6815e360 msgr2=0x7f8f6806a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:28.179 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.170+0000 7f8f677fe640 1 --2- 172.21.15.78:0/804007457 >> v2:172.21.15.187:3300/0 conn(0x7f8f6815e360 0x7f8f6806a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:28.179 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.170+0000 7f8f677fe640 1 -- 172.21.15.78:0/804007457 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f6806ae00 con 0x7f8f6806bbc0 2023-12-12T10:12:28.181 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.174+0000 7f8f677fe640 1 --2- 172.21.15.78:0/804007457 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f6806bbc0 0x7f8f6815d720 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f8f68073b60 tx=0x7f8f5c01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9ba524107f6dc15 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:28.181 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.174+0000 7f8f66ffd640 1 -- 172.21.15.78:0/804007457 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f5c0ad640 con 0x7f8f6806bbc0 2023-12-12T10:12:28.182 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.174+0000 7f8f66ffd640 1 -- 172.21.15.78:0/804007457 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f5c0ad7a0 con 0x7f8f6806bbc0 2023-12-12T10:12:28.182 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.174+0000 7f8f66ffd640 1 -- 172.21.15.78:0/804007457 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f5c0adb30 con 0x7f8f6806bbc0 2023-12-12T10:12:28.182 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.174+0000 7f8f6e617640 1 -- 172.21.15.78:0/804007457 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f6806bbc0 msgr2=0x7f8f6815d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:28.183 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.174+0000 7f8f6e617640 1 --2- 172.21.15.78:0/804007457 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f6806bbc0 0x7f8f6815d720 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f8f68073b60 tx=0x7f8f5c01c4a0 comp rx=0 tx=0).stop 2023-12-12T10:12:28.183 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.174+0000 7f8f6e617640 1 -- 172.21.15.78:0/804007457 shutdown_connections 2023-12-12T10:12:28.183 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.174+0000 7f8f6e617640 1 --2- 172.21.15.78:0/804007457 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8f680b24b0 0x7f8f680b2920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:28.183 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.174+0000 7f8f6e617640 1 --2- 172.21.15.78:0/804007457 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f6806bbc0 0x7f8f6815d720 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:28.183 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.174+0000 7f8f6e617640 1 --2- 172.21.15.78:0/804007457 >> v2:172.21.15.187:3300/0 conn(0x7f8f6815e360 0x7f8f6806a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:28.183 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.174+0000 7f8f6e617640 1 -- 172.21.15.78:0/804007457 >> 172.21.15.78:0/804007457 conn(0x7f8f680cf480 msgr2=0x7f8f680cf890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:28.183 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.174+0000 7f8f6e617640 1 -- 172.21.15.78:0/804007457 shutdown_connections 2023-12-12T10:12:28.183 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.174+0000 7f8f6e617640 1 -- 172.21.15.78:0/804007457 wait complete. 2023-12-12T10:12:28.184 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.178+0000 7f8f6e617640 1 Processor -- start 2023-12-12T10:12:28.184 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.178+0000 7f8f6e617640 1 -- start start 2023-12-12T10:12:28.186 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.178+0000 7f8f6e617640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f6806bbc0 0x7f8f681f6080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:28.187 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.178+0000 7f8f6e617640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8f680b24b0 0x7f8f681f8f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:28.187 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.178+0000 7f8f6e617640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8f6815e360 0x7f8f6815e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:28.187 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.178+0000 7f8f6e617640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f68156d20 con 0x7f8f6806bbc0 2023-12-12T10:12:28.187 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.178+0000 7f8f6e617640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f68141880 con 0x7f8f6815e360 2023-12-12T10:12:28.187 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.178+0000 7f8f6e617640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f68140c70 con 0x7f8f680b24b0 2023-12-12T10:12:28.187 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.178+0000 7f8f67fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f6806bbc0 0x7f8f681f6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:28.187 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.178+0000 7f8f67fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f6806bbc0 0x7f8f681f6080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47684/0 (socket says 172.21.15.78:47684) 2023-12-12T10:12:28.187 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.178+0000 7f8f67fff640 1 -- 172.21.15.78:0/2753150873 learned_addr learned my addr 172.21.15.78:0/2753150873 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:28.187 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.178+0000 7f8f6cbb4640 1 --2- 172.21.15.78:0/2753150873 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8f6815e360 0x7f8f6815e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:28.187 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.178+0000 7f8f677fe640 1 --2- 172.21.15.78:0/2753150873 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8f680b24b0 0x7f8f681f8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:28.187 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.178+0000 7f8f67fff640 1 -- 172.21.15.78:0/2753150873 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8f680b24b0 msgr2=0x7f8f681f8f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:28.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.178+0000 7f8f67fff640 1 --2- 172.21.15.78:0/2753150873 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8f680b24b0 0x7f8f681f8f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:28.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.178+0000 7f8f67fff640 1 -- 172.21.15.78:0/2753150873 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8f6815e360 msgr2=0x7f8f6815e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:28.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.178+0000 7f8f67fff640 1 --2- 172.21.15.78:0/2753150873 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8f6815e360 0x7f8f6815e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:28.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.178+0000 7f8f67fff640 1 -- 172.21.15.78:0/2753150873 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f5c0094d0 con 0x7f8f6806bbc0 2023-12-12T10:12:28.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.178+0000 7f8f67fff640 1 --2- 172.21.15.78:0/2753150873 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f6806bbc0 0x7f8f681f6080 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8f5800d5f0 tx=0x7f8f5800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:28.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.178+0000 7f8f64ff9640 1 -- 172.21.15.78:0/2753150873 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f580125f0 con 0x7f8f6806bbc0 2023-12-12T10:12:28.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.178+0000 7f8f64ff9640 1 -- 172.21.15.78:0/2753150873 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f58012750 con 0x7f8f6806bbc0 2023-12-12T10:12:28.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.178+0000 7f8f64ff9640 1 -- 172.21.15.78:0/2753150873 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f58012ae0 con 0x7f8f6806bbc0 2023-12-12T10:12:28.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.178+0000 7f8f6e617640 1 -- 172.21.15.78:0/2753150873 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f68140f50 con 0x7f8f6806bbc0 2023-12-12T10:12:28.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.182+0000 7f8f6e617640 1 -- 172.21.15.78:0/2753150873 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f68141510 con 0x7f8f6806bbc0 2023-12-12T10:12:28.189 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.182+0000 7f8f6e617640 1 -- 172.21.15.78:0/2753150873 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f680cf260 con 0x7f8f6806bbc0 2023-12-12T10:12:28.189 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.182+0000 7f8f64ff9640 1 -- 172.21.15.78:0/2753150873 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f8f58012c40 con 0x7f8f6806bbc0 2023-12-12T10:12:28.189 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.182+0000 7f8f64ff9640 1 --2- 172.21.15.78:0/2753150873 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f8f54066470 0x7f8f54068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:28.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.182+0000 7f8f64ff9640 1 -- 172.21.15.78:0/2753150873 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8f58084680 con 0x7f8f6806bbc0 2023-12-12T10:12:28.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.182+0000 7f8f677fe640 1 --2- 172.21.15.78:0/2753150873 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f8f54066470 0x7f8f54068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:28.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.182+0000 7f8f677fe640 1 --2- 172.21.15.78:0/2753150873 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f8f54066470 0x7f8f54068930 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f8f5c0af000 tx=0x7f8f5c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:28.193 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.186+0000 7f8f64ff9640 1 -- 172.21.15.78:0/2753150873 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8f58051800 con 0x7f8f6806bbc0 2023-12-12T10:12:28.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.334+0000 7f8f6e617640 1 -- 172.21.15.78:0/2753150873 --> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8f68066880 con 0x7f8f54066470 2023-12-12T10:12:28.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.342+0000 7f8f64ff9640 1 -- 172.21.15.78:0/2753150873 <== mgr.4104 v2:172.21.15.78:6832/1725498448 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345293 (secure 0 0 0) 0x7f8f5c0a6040 con 0x7f8f54066470 2023-12-12T10:12:28.351 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:12:28.353 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2023-12-12T10:12:28.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.346+0000 7f8f6e617640 1 -- 172.21.15.78:0/2753150873 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f8f54066470 msgr2=0x7f8f54068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:28.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.346+0000 7f8f6e617640 1 --2- 172.21.15.78:0/2753150873 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f8f54066470 0x7f8f54068930 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f8f5c0af000 tx=0x7f8f5c008040 comp rx=0 tx=0).stop 2023-12-12T10:12:28.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.346+0000 7f8f6e617640 1 -- 172.21.15.78:0/2753150873 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f6806bbc0 msgr2=0x7f8f681f6080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:28.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.346+0000 7f8f6e617640 1 --2- 172.21.15.78:0/2753150873 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f6806bbc0 0x7f8f681f6080 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8f5800d5f0 tx=0x7f8f5800dab0 comp rx=0 tx=0).stop 2023-12-12T10:12:28.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.346+0000 7f8f6e617640 1 -- 172.21.15.78:0/2753150873 shutdown_connections 2023-12-12T10:12:28.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.346+0000 7f8f6e617640 1 --2- 172.21.15.78:0/2753150873 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f8f54066470 0x7f8f54068930 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:28.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.346+0000 7f8f6e617640 1 --2- 172.21.15.78:0/2753150873 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8f6815e360 0x7f8f6815e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:28.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.346+0000 7f8f6e617640 1 --2- 172.21.15.78:0/2753150873 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8f680b24b0 0x7f8f681f8f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:28.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.346+0000 7f8f6e617640 1 --2- 172.21.15.78:0/2753150873 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f6806bbc0 0x7f8f681f6080 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:28.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.346+0000 7f8f6e617640 1 -- 172.21.15.78:0/2753150873 >> 172.21.15.78:0/2753150873 conn(0x7f8f680cf480 msgr2=0x7f8f680af020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:28.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.346+0000 7f8f6e617640 1 -- 172.21.15.78:0/2753150873 shutdown_connections 2023-12-12T10:12:28.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.346+0000 7f8f6e617640 1 -- 172.21.15.78:0/2753150873 wait complete. 2023-12-12T10:12:28.373 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":32,"stamp":"2023-12-12T10:12:26.993864+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594864,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":206,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158,"ondisk_log_size":158,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219392,"kb_used_data":3204,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755328,"statfs":{"total":773094113280,"available":772869455872,"internally_reserved":0,"allocated":3280896,"data_stored":1987095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2086,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002806"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.957388+0000","last_change":"2023-12-12T10:12:08.837046+0000","last_active":"2023-12-12T10:12:13.957388+0000","last_peered":"2023-12-12T10:12:13.957388+0000","last_clean":"2023-12-12T10:12:13.957388+0000","last_became_active":"2023-12-12T10:12:08.836763+0000","last_became_peered":"2023-12-12T10:12:08.836763+0000","last_unstale":"2023-12-12T10:12:13.957388+0000","last_undegraded":"2023-12-12T10:12:13.957388+0000","last_fullsized":"2023-12-12T10:12:13.957388+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_clean_scrub_stamp":"2023-12-12T10:12:07.792253+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:01:42.240854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.944527+0000","last_change":"2023-12-12T10:12:09.835821+0000","last_active":"2023-12-12T10:12:13.944527+0000","last_peered":"2023-12-12T10:12:13.944527+0000","last_clean":"2023-12-12T10:12:13.944527+0000","last_became_active":"2023-12-12T10:12:09.835565+0000","last_became_peered":"2023-12-12T10:12:09.835565+0000","last_unstale":"2023-12-12T10:12:13.944527+0000","last_undegraded":"2023-12-12T10:12:13.944527+0000","last_fullsized":"2023-12-12T10:12:13.944527+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:59:46.622358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-12T10:12:15.555553+0000","last_change":"2023-12-12T10:12:14.188368+0000","last_active":"2023-12-12T10:12:15.555553+0000","last_peered":"2023-12-12T10:12:15.555553+0000","last_clean":"2023-12-12T10:12:15.555553+0000","last_became_active":"2023-12-12T10:12:14.188013+0000","last_became_peered":"2023-12-12T10:12:14.188013+0000","last_unstale":"2023-12-12T10:12:15.555553+0000","last_undegraded":"2023-12-12T10:12:15.555553+0000","last_fullsized":"2023-12-12T10:12:15.555553+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_clean_scrub_stamp":"2023-12-12T10:12:12.929940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:41:41.466318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.946555+0000","last_change":"2023-12-12T10:12:08.841058+0000","last_active":"2023-12-12T10:12:13.946555+0000","last_peered":"2023-12-12T10:12:13.946555+0000","last_clean":"2023-12-12T10:12:13.946555+0000","last_became_active":"2023-12-12T10:12:08.840749+0000","last_became_peered":"2023-12-12T10:12:08.840749+0000","last_unstale":"2023-12-12T10:12:13.946555+0000","last_undegraded":"2023-12-12T10:12:13.946555+0000","last_fullsized":"2023-12-12T10:12:13.946555+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_clean_scrub_stamp":"2023-12-12T10:12:07.792253+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:01:42.240854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.955095+0000","last_change":"2023-12-12T10:12:09.846736+0000","last_active":"2023-12-12T10:12:13.955095+0000","last_peered":"2023-12-12T10:12:13.955095+0000","last_clean":"2023-12-12T10:12:13.955095+0000","last_became_active":"2023-12-12T10:12:09.846467+0000","last_became_peered":"2023-12-12T10:12:09.846467+0000","last_unstale":"2023-12-12T10:12:13.955095+0000","last_undegraded":"2023-12-12T10:12:13.955095+0000","last_fullsized":"2023-12-12T10:12:13.955095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:29:34.002418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-12T10:12:14.943582+0000","last_change":"2023-12-12T10:12:13.957767+0000","last_active":"2023-12-12T10:12:14.943582+0000","last_peered":"2023-12-12T10:12:14.943582+0000","last_clean":"2023-12-12T10:12:14.943582+0000","last_became_active":"2023-12-12T10:12:13.957289+0000","last_became_peered":"2023-12-12T10:12:13.957289+0000","last_unstale":"2023-12-12T10:12:14.943582+0000","last_undegraded":"2023-12-12T10:12:14.943582+0000","last_fullsized":"2023-12-12T10:12:14.943582+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_clean_scrub_stamp":"2023-12-12T10:12:12.929940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:29:38.133352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:14.179027+0000","last_change":"2023-12-12T10:12:08.846842+0000","last_active":"2023-12-12T10:12:14.179027+0000","last_peered":"2023-12-12T10:12:14.179027+0000","last_clean":"2023-12-12T10:12:14.179027+0000","last_became_active":"2023-12-12T10:12:08.846389+0000","last_became_peered":"2023-12-12T10:12:08.846389+0000","last_unstale":"2023-12-12T10:12:14.179027+0000","last_undegraded":"2023-12-12T10:12:14.179027+0000","last_fullsized":"2023-12-12T10:12:14.179027+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_clean_scrub_stamp":"2023-12-12T10:12:07.792253+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:14:21.574354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.954855+0000","last_change":"2023-12-12T10:12:09.846099+0000","last_active":"2023-12-12T10:12:13.954855+0000","last_peered":"2023-12-12T10:12:13.954855+0000","last_clean":"2023-12-12T10:12:13.954855+0000","last_became_active":"2023-12-12T10:12:09.843647+0000","last_became_peered":"2023-12-12T10:12:09.843647+0000","last_unstale":"2023-12-12T10:12:13.954855+0000","last_undegraded":"2023-12-12T10:12:13.954855+0000","last_fullsized":"2023-12-12T10:12:13.954855+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:06:52.618740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-12T10:12:14.944222+0000","last_change":"2023-12-12T10:12:13.966808+0000","last_active":"2023-12-12T10:12:14.944222+0000","last_peered":"2023-12-12T10:12:14.944222+0000","last_clean":"2023-12-12T10:12:14.944222+0000","last_became_active":"2023-12-12T10:12:13.966405+0000","last_became_peered":"2023-12-12T10:12:13.966405+0000","last_unstale":"2023-12-12T10:12:14.944222+0000","last_undegraded":"2023-12-12T10:12:14.944222+0000","last_fullsized":"2023-12-12T10:12:14.944222+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_clean_scrub_stamp":"2023-12-12T10:12:12.929940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:08:16.230176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:14.178844+0000","last_change":"2023-12-12T10:12:08.844404+0000","last_active":"2023-12-12T10:12:14.178844+0000","last_peered":"2023-12-12T10:12:14.178844+0000","last_clean":"2023-12-12T10:12:14.178844+0000","last_became_active":"2023-12-12T10:12:08.842413+0000","last_became_peered":"2023-12-12T10:12:08.842413+0000","last_unstale":"2023-12-12T10:12:14.178844+0000","last_undegraded":"2023-12-12T10:12:14.178844+0000","last_fullsized":"2023-12-12T10:12:14.178844+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_clean_scrub_stamp":"2023-12-12T10:12:07.792253+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:29:32.995665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.955015+0000","last_change":"2023-12-12T10:12:09.841014+0000","last_active":"2023-12-12T10:12:13.955015+0000","last_peered":"2023-12-12T10:12:13.955015+0000","last_clean":"2023-12-12T10:12:13.955015+0000","last_became_active":"2023-12-12T10:12:09.840537+0000","last_became_peered":"2023-12-12T10:12:09.840537+0000","last_unstale":"2023-12-12T10:12:13.955015+0000","last_undegraded":"2023-12-12T10:12:13.955015+0000","last_fullsized":"2023-12-12T10:12:13.955015+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:17:19.749257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-12T10:12:14.943939+0000","last_change":"2023-12-12T10:12:13.964740+0000","last_active":"2023-12-12T10:12:14.943939+0000","last_peered":"2023-12-12T10:12:14.943939+0000","last_clean":"2023-12-12T10:12:14.943939+0000","last_became_active":"2023-12-12T10:12:13.964322+0000","last_became_peered":"2023-12-12T10:12:13.964322+0000","last_unstale":"2023-12-12T10:12:14.943939+0000","last_undegraded":"2023-12-12T10:12:14.943939+0000","last_fullsized":"2023-12-12T10:12:14.943939+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_clean_scrub_stamp":"2023-12-12T10:12:12.929940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T22:01:09.241666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.942306+0000","last_change":"2023-12-12T10:12:09.830608+0000","last_active":"2023-12-12T10:12:13.942306+0000","last_peered":"2023-12-12T10:12:13.942306+0000","last_clean":"2023-12-12T10:12:13.942306+0000","last_became_active":"2023-12-12T10:12:09.830291+0000","last_became_peered":"2023-12-12T10:12:09.830291+0000","last_unstale":"2023-12-12T10:12:13.942306+0000","last_undegraded":"2023-12-12T10:12:13.942306+0000","last_fullsized":"2023-12-12T10:12:13.942306+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:14:22.581107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:14.178760+0000","last_change":"2023-12-12T10:12:08.842318+0000","last_active":"2023-12-12T10:12:14.178760+0000","last_peered":"2023-12-12T10:12:14.178760+0000","last_clean":"2023-12-12T10:12:14.178760+0000","last_became_active":"2023-12-12T10:12:08.841798+0000","last_became_peered":"2023-12-12T10:12:08.841798+0000","last_unstale":"2023-12-12T10:12:14.178760+0000","last_undegraded":"2023-12-12T10:12:14.178760+0000","last_fullsized":"2023-12-12T10:12:14.178760+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_clean_scrub_stamp":"2023-12-12T10:12:07.792253+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:05:44.538814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-12T10:12:14.945190+0000","last_change":"2023-12-12T10:12:13.966998+0000","last_active":"2023-12-12T10:12:14.945190+0000","last_peered":"2023-12-12T10:12:14.945190+0000","last_clean":"2023-12-12T10:12:14.945190+0000","last_became_active":"2023-12-12T10:12:13.966611+0000","last_became_peered":"2023-12-12T10:12:13.966611+0000","last_unstale":"2023-12-12T10:12:14.945190+0000","last_undegraded":"2023-12-12T10:12:14.945190+0000","last_fullsized":"2023-12-12T10:12:14.945190+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_clean_scrub_stamp":"2023-12-12T10:12:12.929940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:29:09.752788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.942671+0000","last_change":"2023-12-12T10:12:09.833899+0000","last_active":"2023-12-12T10:12:13.942671+0000","last_peered":"2023-12-12T10:12:13.942671+0000","last_clean":"2023-12-12T10:12:13.942671+0000","last_became_active":"2023-12-12T10:12:09.833515+0000","last_became_peered":"2023-12-12T10:12:09.833515+0000","last_unstale":"2023-12-12T10:12:13.942671+0000","last_undegraded":"2023-12-12T10:12:13.942671+0000","last_fullsized":"2023-12-12T10:12:13.942671+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:05:45.545567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.961555+0000","last_change":"2023-12-12T10:12:08.831931+0000","last_active":"2023-12-12T10:12:13.961555+0000","last_peered":"2023-12-12T10:12:13.961555+0000","last_clean":"2023-12-12T10:12:13.961555+0000","last_became_active":"2023-12-12T10:12:08.831620+0000","last_became_peered":"2023-12-12T10:12:08.831620+0000","last_unstale":"2023-12-12T10:12:13.961555+0000","last_undegraded":"2023-12-12T10:12:13.961555+0000","last_fullsized":"2023-12-12T10:12:13.961555+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_clean_scrub_stamp":"2023-12-12T10:12:07.792253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:33:06.940791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-12T10:12:14.944543+0000","last_change":"2023-12-12T10:12:13.963213+0000","last_active":"2023-12-12T10:12:14.944543+0000","last_peered":"2023-12-12T10:12:14.944543+0000","last_clean":"2023-12-12T10:12:14.944543+0000","last_became_active":"2023-12-12T10:12:13.962745+0000","last_became_peered":"2023-12-12T10:12:13.962745+0000","last_unstale":"2023-12-12T10:12:14.944543+0000","last_undegraded":"2023-12-12T10:12:14.944543+0000","last_fullsized":"2023-12-12T10:12:14.944543+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_clean_scrub_stamp":"2023-12-12T10:12:12.929940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:46:01.637131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.943109+0000","last_change":"2023-12-12T10:12:09.836176+0000","last_active":"2023-12-12T10:12:13.943109+0000","last_peered":"2023-12-12T10:12:13.943109+0000","last_clean":"2023-12-12T10:12:13.943109+0000","last_became_active":"2023-12-12T10:12:09.835770+0000","last_became_peered":"2023-12-12T10:12:09.835770+0000","last_unstale":"2023-12-12T10:12:13.943109+0000","last_undegraded":"2023-12-12T10:12:13.943109+0000","last_fullsized":"2023-12-12T10:12:13.943109+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:47:44.969459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.960982+0000","last_change":"2023-12-12T10:12:08.837492+0000","last_active":"2023-12-12T10:12:13.960982+0000","last_peered":"2023-12-12T10:12:13.960982+0000","last_clean":"2023-12-12T10:12:13.960982+0000","last_became_active":"2023-12-12T10:12:08.836946+0000","last_became_peered":"2023-12-12T10:12:08.836946+0000","last_unstale":"2023-12-12T10:12:13.960982+0000","last_undegraded":"2023-12-12T10:12:13.960982+0000","last_fullsized":"2023-12-12T10:12:13.960982+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_clean_scrub_stamp":"2023-12-12T10:12:07.792253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:43:30.327223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-12T10:12:15.184876+0000","last_change":"2023-12-12T10:12:14.185717+0000","last_active":"2023-12-12T10:12:15.184876+0000","last_peered":"2023-12-12T10:12:15.184876+0000","last_clean":"2023-12-12T10:12:15.184876+0000","last_became_active":"2023-12-12T10:12:14.185270+0000","last_became_peered":"2023-12-12T10:12:14.185270+0000","last_unstale":"2023-12-12T10:12:15.184876+0000","last_undegraded":"2023-12-12T10:12:15.184876+0000","last_fullsized":"2023-12-12T10:12:15.184876+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_clean_scrub_stamp":"2023-12-12T10:12:12.929940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:51:46.510253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.944571+0000","last_change":"2023-12-12T10:12:09.833775+0000","last_active":"2023-12-12T10:12:13.944571+0000","last_peered":"2023-12-12T10:12:13.944571+0000","last_clean":"2023-12-12T10:12:13.944571+0000","last_became_active":"2023-12-12T10:12:09.829608+0000","last_became_peered":"2023-12-12T10:12:09.829608+0000","last_unstale":"2023-12-12T10:12:13.944571+0000","last_undegraded":"2023-12-12T10:12:13.944571+0000","last_fullsized":"2023-12-12T10:12:13.944571+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:15:32.896143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:14.178440+0000","last_change":"2023-12-12T10:12:08.845929+0000","last_active":"2023-12-12T10:12:14.178440+0000","last_peered":"2023-12-12T10:12:14.178440+0000","last_clean":"2023-12-12T10:12:14.178440+0000","last_became_active":"2023-12-12T10:12:08.845586+0000","last_became_peered":"2023-12-12T10:12:08.845586+0000","last_unstale":"2023-12-12T10:12:14.178440+0000","last_undegraded":"2023-12-12T10:12:14.178440+0000","last_fullsized":"2023-12-12T10:12:14.178440+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_clean_scrub_stamp":"2023-12-12T10:12:07.792253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:05:33.556015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-12T10:12:14.944863+0000","last_change":"2023-12-12T10:12:13.963219+0000","last_active":"2023-12-12T10:12:14.944863+0000","last_peered":"2023-12-12T10:12:14.944863+0000","last_clean":"2023-12-12T10:12:14.944863+0000","last_became_active":"2023-12-12T10:12:13.962713+0000","last_became_peered":"2023-12-12T10:12:13.962713+0000","last_unstale":"2023-12-12T10:12:14.944863+0000","last_undegraded":"2023-12-12T10:12:14.944863+0000","last_fullsized":"2023-12-12T10:12:14.944863+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_clean_scrub_stamp":"2023-12-12T10:12:12.929940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:06:56.749674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.958203+0000","last_change":"2023-12-12T10:12:09.827158+0000","last_active":"2023-12-12T10:12:13.958203+0000","last_peered":"2023-12-12T10:12:13.958203+0000","last_clean":"2023-12-12T10:12:13.958203+0000","last_became_active":"2023-12-12T10:12:09.826822+0000","last_became_peered":"2023-12-12T10:12:09.826822+0000","last_unstale":"2023-12-12T10:12:13.958203+0000","last_undegraded":"2023-12-12T10:12:13.958203+0000","last_fullsized":"2023-12-12T10:12:13.958203+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:59:46.622358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.945235+0000","last_change":"2023-12-12T10:12:08.838343+0000","last_active":"2023-12-12T10:12:13.945235+0000","last_peered":"2023-12-12T10:12:13.945235+0000","last_clean":"2023-12-12T10:12:13.945235+0000","last_became_active":"2023-12-12T10:12:08.837997+0000","last_became_peered":"2023-12-12T10:12:08.837997+0000","last_unstale":"2023-12-12T10:12:13.945235+0000","last_undegraded":"2023-12-12T10:12:13.945235+0000","last_fullsized":"2023-12-12T10:12:13.945235+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_clean_scrub_stamp":"2023-12-12T10:12:07.792253+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:33:06.940791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-12T10:12:14.943970+0000","last_change":"2023-12-12T10:12:14.185225+0000","last_active":"2023-12-12T10:12:14.943970+0000","last_peered":"2023-12-12T10:12:14.943970+0000","last_clean":"2023-12-12T10:12:14.943970+0000","last_became_active":"2023-12-12T10:12:14.184122+0000","last_became_peered":"2023-12-12T10:12:14.184122+0000","last_unstale":"2023-12-12T10:12:14.943970+0000","last_undegraded":"2023-12-12T10:12:14.943970+0000","last_fullsized":"2023-12-12T10:12:14.943970+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_clean_scrub_stamp":"2023-12-12T10:12:12.929940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:23:00.194289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.947211+0000","last_change":"2023-12-12T10:12:09.835201+0000","last_active":"2023-12-12T10:12:13.947211+0000","last_peered":"2023-12-12T10:12:13.947211+0000","last_clean":"2023-12-12T10:12:13.947211+0000","last_became_active":"2023-12-12T10:12:09.834701+0000","last_became_peered":"2023-12-12T10:12:09.834701+0000","last_unstale":"2023-12-12T10:12:13.947211+0000","last_undegraded":"2023-12-12T10:12:13.947211+0000","last_fullsized":"2023-12-12T10:12:13.947211+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T22:01:05.110732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.962519+0000","last_change":"2023-12-12T10:12:08.842442+0000","last_active":"2023-12-12T10:12:13.962519+0000","last_peered":"2023-12-12T10:12:13.962519+0000","last_clean":"2023-12-12T10:12:13.962519+0000","last_became_active":"2023-12-12T10:12:08.842125+0000","last_became_peered":"2023-12-12T10:12:08.842125+0000","last_unstale":"2023-12-12T10:12:13.962519+0000","last_undegraded":"2023-12-12T10:12:13.962519+0000","last_fullsized":"2023-12-12T10:12:13.962519+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_clean_scrub_stamp":"2023-12-12T10:12:07.792253+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:24:12.200595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-12T10:12:15.555651+0000","last_change":"2023-12-12T10:12:14.185748+0000","last_active":"2023-12-12T10:12:15.555651+0000","last_peered":"2023-12-12T10:12:15.555651+0000","last_clean":"2023-12-12T10:12:15.555651+0000","last_became_active":"2023-12-12T10:12:14.185262+0000","last_became_peered":"2023-12-12T10:12:14.185262+0000","last_unstale":"2023-12-12T10:12:15.555651+0000","last_undegraded":"2023-12-12T10:12:15.555651+0000","last_fullsized":"2023-12-12T10:12:15.555651+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_clean_scrub_stamp":"2023-12-12T10:12:12.929940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:46:26.737660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.961127+0000","last_change":"2023-12-12T10:12:09.837089+0000","last_active":"2023-12-12T10:12:13.961127+0000","last_peered":"2023-12-12T10:12:13.961127+0000","last_clean":"2023-12-12T10:12:13.961127+0000","last_became_active":"2023-12-12T10:12:09.829551+0000","last_became_peered":"2023-12-12T10:12:09.829551+0000","last_unstale":"2023-12-12T10:12:13.961127+0000","last_undegraded":"2023-12-12T10:12:13.961127+0000","last_fullsized":"2023-12-12T10:12:13.961127+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:59:46.622358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:14.179291+0000","last_change":"2023-12-12T10:12:08.845099+0000","last_active":"2023-12-12T10:12:14.179291+0000","last_peered":"2023-12-12T10:12:14.179291+0000","last_clean":"2023-12-12T10:12:14.179291+0000","last_became_active":"2023-12-12T10:12:08.844823+0000","last_became_peered":"2023-12-12T10:12:08.844823+0000","last_unstale":"2023-12-12T10:12:14.179291+0000","last_undegraded":"2023-12-12T10:12:14.179291+0000","last_fullsized":"2023-12-12T10:12:14.179291+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_clean_scrub_stamp":"2023-12-12T10:12:07.792253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:42:16.450226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-12T10:12:15.556125+0000","last_change":"2023-12-12T10:12:14.182644+0000","last_active":"2023-12-12T10:12:15.556125+0000","last_peered":"2023-12-12T10:12:15.556125+0000","last_clean":"2023-12-12T10:12:15.556125+0000","last_became_active":"2023-12-12T10:12:14.182230+0000","last_became_peered":"2023-12-12T10:12:14.182230+0000","last_unstale":"2023-12-12T10:12:15.556125+0000","last_undegraded":"2023-12-12T10:12:15.556125+0000","last_fullsized":"2023-12-12T10:12:15.556125+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_clean_scrub_stamp":"2023-12-12T10:12:12.929940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:29:09.752788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.955037+0000","last_change":"2023-12-12T10:12:09.840836+0000","last_active":"2023-12-12T10:12:13.955037+0000","last_peered":"2023-12-12T10:12:13.955037+0000","last_clean":"2023-12-12T10:12:13.955037+0000","last_became_active":"2023-12-12T10:12:09.840219+0000","last_became_peered":"2023-12-12T10:12:09.840219+0000","last_unstale":"2023-12-12T10:12:13.955037+0000","last_undegraded":"2023-12-12T10:12:13.955037+0000","last_fullsized":"2023-12-12T10:12:13.955037+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:03:50.236121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.961215+0000","last_change":"2023-12-12T10:12:08.829665+0000","last_active":"2023-12-12T10:12:13.961215+0000","last_peered":"2023-12-12T10:12:13.961215+0000","last_clean":"2023-12-12T10:12:13.961215+0000","last_became_active":"2023-12-12T10:12:08.829433+0000","last_became_peered":"2023-12-12T10:12:08.829433+0000","last_unstale":"2023-12-12T10:12:13.961215+0000","last_undegraded":"2023-12-12T10:12:13.961215+0000","last_fullsized":"2023-12-12T10:12:13.961215+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_clean_scrub_stamp":"2023-12-12T10:12:07.792253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:41:37.226888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-12T10:12:15.184185+0000","last_change":"2023-12-12T10:12:13.973841+0000","last_active":"2023-12-12T10:12:15.184185+0000","last_peered":"2023-12-12T10:12:15.184185+0000","last_clean":"2023-12-12T10:12:15.184185+0000","last_became_active":"2023-12-12T10:12:13.973435+0000","last_became_peered":"2023-12-12T10:12:13.973435+0000","last_unstale":"2023-12-12T10:12:15.184185+0000","last_undegraded":"2023-12-12T10:12:15.184185+0000","last_fullsized":"2023-12-12T10:12:15.184185+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_clean_scrub_stamp":"2023-12-12T10:12:12.929940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:11:19.241925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.946358+0000","last_change":"2023-12-12T10:12:09.823582+0000","last_active":"2023-12-12T10:12:13.946358+0000","last_peered":"2023-12-12T10:12:13.946358+0000","last_clean":"2023-12-12T10:12:13.946358+0000","last_became_active":"2023-12-12T10:12:09.823307+0000","last_became_peered":"2023-12-12T10:12:09.823307+0000","last_unstale":"2023-12-12T10:12:13.946358+0000","last_undegraded":"2023-12-12T10:12:13.946358+0000","last_fullsized":"2023-12-12T10:12:13.946358+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:41:38.233640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.955628+0000","last_change":"2023-12-12T10:12:08.828970+0000","last_active":"2023-12-12T10:12:13.955628+0000","last_peered":"2023-12-12T10:12:13.955628+0000","last_clean":"2023-12-12T10:12:13.955628+0000","last_became_active":"2023-12-12T10:12:08.828622+0000","last_became_peered":"2023-12-12T10:12:08.828622+0000","last_unstale":"2023-12-12T10:12:13.955628+0000","last_undegraded":"2023-12-12T10:12:13.955628+0000","last_fullsized":"2023-12-12T10:12:13.955628+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_clean_scrub_stamp":"2023-12-12T10:12:07.792253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:05:44.538814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-12T10:12:15.184498+0000","last_change":"2023-12-12T10:12:13.971217+0000","last_active":"2023-12-12T10:12:15.184498+0000","last_peered":"2023-12-12T10:12:15.184498+0000","last_clean":"2023-12-12T10:12:15.184498+0000","last_became_active":"2023-12-12T10:12:13.970691+0000","last_became_peered":"2023-12-12T10:12:13.970691+0000","last_unstale":"2023-12-12T10:12:15.184498+0000","last_undegraded":"2023-12-12T10:12:15.184498+0000","last_fullsized":"2023-12-12T10:12:15.184498+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_clean_scrub_stamp":"2023-12-12T10:12:12.929940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:03:54.367055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.962282+0000","last_change":"2023-12-12T10:12:09.832708+0000","last_active":"2023-12-12T10:12:13.962282+0000","last_peered":"2023-12-12T10:12:13.962282+0000","last_clean":"2023-12-12T10:12:13.962282+0000","last_became_active":"2023-12-12T10:12:09.832344+0000","last_became_peered":"2023-12-12T10:12:09.832344+0000","last_unstale":"2023-12-12T10:12:13.962282+0000","last_undegraded":"2023-12-12T10:12:13.962282+0000","last_fullsized":"2023-12-12T10:12:13.962282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:14:22.581107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.965330+0000","last_change":"2023-12-12T10:12:08.837019+0000","last_active":"2023-12-12T10:12:13.965330+0000","last_peered":"2023-12-12T10:12:13.965330+0000","last_clean":"2023-12-12T10:12:13.965330+0000","last_became_active":"2023-12-12T10:12:08.832265+0000","last_became_peered":"2023-12-12T10:12:08.832265+0000","last_unstale":"2023-12-12T10:12:13.965330+0000","last_undegraded":"2023-12-12T10:12:13.965330+0000","last_fullsized":"2023-12-12T10:12:13.965330+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_clean_scrub_stamp":"2023-12-12T10:12:07.792253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:18:36.840178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-12T10:12:15.184922+0000","last_change":"2023-12-12T10:12:13.973617+0000","last_active":"2023-12-12T10:12:15.184922+0000","last_peered":"2023-12-12T10:12:15.184922+0000","last_clean":"2023-12-12T10:12:15.184922+0000","last_became_active":"2023-12-12T10:12:13.973205+0000","last_became_peered":"2023-12-12T10:12:13.973205+0000","last_unstale":"2023-12-12T10:12:15.184922+0000","last_undegraded":"2023-12-12T10:12:15.184922+0000","last_fullsized":"2023-12-12T10:12:15.184922+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_clean_scrub_stamp":"2023-12-12T10:12:12.929940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:39:57.689735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.954974+0000","last_change":"2023-12-12T10:12:09.825813+0000","last_active":"2023-12-12T10:12:13.954974+0000","last_peered":"2023-12-12T10:12:13.954974+0000","last_clean":"2023-12-12T10:12:13.954974+0000","last_became_active":"2023-12-12T10:12:09.824750+0000","last_became_peered":"2023-12-12T10:12:09.824750+0000","last_unstale":"2023-12-12T10:12:13.954974+0000","last_undegraded":"2023-12-12T10:12:13.954974+0000","last_fullsized":"2023-12-12T10:12:13.954974+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:22:27.554110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:14.178474+0000","last_change":"2023-12-12T10:12:08.843140+0000","last_active":"2023-12-12T10:12:14.178474+0000","last_peered":"2023-12-12T10:12:14.178474+0000","last_clean":"2023-12-12T10:12:14.178474+0000","last_became_active":"2023-12-12T10:12:08.842860+0000","last_became_peered":"2023-12-12T10:12:08.842860+0000","last_unstale":"2023-12-12T10:12:14.178474+0000","last_undegraded":"2023-12-12T10:12:14.178474+0000","last_fullsized":"2023-12-12T10:12:14.178474+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_clean_scrub_stamp":"2023-12-12T10:12:07.792253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:18:36.840178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-12T10:12:15.557319+0000","last_change":"2023-12-12T10:12:14.186432+0000","last_active":"2023-12-12T10:12:15.557319+0000","last_peered":"2023-12-12T10:12:15.557319+0000","last_clean":"2023-12-12T10:12:15.557319+0000","last_became_active":"2023-12-12T10:12:14.185836+0000","last_became_peered":"2023-12-12T10:12:14.185836+0000","last_unstale":"2023-12-12T10:12:15.557319+0000","last_undegraded":"2023-12-12T10:12:15.557319+0000","last_fullsized":"2023-12-12T10:12:15.557319+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_clean_scrub_stamp":"2023-12-12T10:12:12.929940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:51:46.510253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.942873+0000","last_change":"2023-12-12T10:12:09.837891+0000","last_active":"2023-12-12T10:12:13.942873+0000","last_peered":"2023-12-12T10:12:13.942873+0000","last_clean":"2023-12-12T10:12:13.942873+0000","last_became_active":"2023-12-12T10:12:09.837628+0000","last_became_peered":"2023-12-12T10:12:09.837628+0000","last_unstale":"2023-12-12T10:12:13.942873+0000","last_undegraded":"2023-12-12T10:12:13.942873+0000","last_fullsized":"2023-12-12T10:12:13.942873+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:24:13.207348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.954955+0000","last_change":"2023-12-12T10:12:08.828997+0000","last_active":"2023-12-12T10:12:13.954955+0000","last_peered":"2023-12-12T10:12:13.954955+0000","last_clean":"2023-12-12T10:12:13.954955+0000","last_became_active":"2023-12-12T10:12:08.828551+0000","last_became_peered":"2023-12-12T10:12:08.828551+0000","last_unstale":"2023-12-12T10:12:13.954955+0000","last_undegraded":"2023-12-12T10:12:13.954955+0000","last_fullsized":"2023-12-12T10:12:13.954955+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_clean_scrub_stamp":"2023-12-12T10:12:07.792253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:24:12.200595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":169,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:14.178565+0000","last_change":"2023-12-12T10:11:58.492812+0000","last_active":"2023-12-12T10:12:14.178565+0000","last_peered":"2023-12-12T10:12:14.178565+0000","last_clean":"2023-12-12T10:12:14.178565+0000","last_became_active":"2023-12-12T10:11:58.491470+0000","last_became_peered":"2023-12-12T10:11:58.491470+0000","last_unstale":"2023-12-12T10:12:14.178565+0000","last_undegraded":"2023-12-12T10:12:14.178565+0000","last_fullsized":"2023-12-12T10:12:14.178565+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:11:57.289641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:11:57.289641+0000","last_clean_scrub_stamp":"2023-12-12T10:11:57.289641+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:10:37.809139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-12T10:12:14.943985+0000","last_change":"2023-12-12T10:12:14.184491+0000","last_active":"2023-12-12T10:12:14.943985+0000","last_peered":"2023-12-12T10:12:14.943985+0000","last_clean":"2023-12-12T10:12:14.943985+0000","last_became_active":"2023-12-12T10:12:14.183538+0000","last_became_peered":"2023-12-12T10:12:14.183538+0000","last_unstale":"2023-12-12T10:12:14.943985+0000","last_undegraded":"2023-12-12T10:12:14.943985+0000","last_fullsized":"2023-12-12T10:12:14.943985+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_clean_scrub_stamp":"2023-12-12T10:12:12.929940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:06:56.749674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:14.178883+0000","last_change":"2023-12-12T10:12:09.848681+0000","last_active":"2023-12-12T10:12:14.178883+0000","last_peered":"2023-12-12T10:12:14.178883+0000","last_clean":"2023-12-12T10:12:14.178883+0000","last_became_active":"2023-12-12T10:12:09.848381+0000","last_became_peered":"2023-12-12T10:12:09.848381+0000","last_unstale":"2023-12-12T10:12:14.178883+0000","last_undegraded":"2023-12-12T10:12:14.178883+0000","last_fullsized":"2023-12-12T10:12:14.178883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:45:57.506196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.966788+0000","last_change":"2023-12-12T10:12:08.831000+0000","last_active":"2023-12-12T10:12:13.966788+0000","last_peered":"2023-12-12T10:12:13.966788+0000","last_clean":"2023-12-12T10:12:13.966788+0000","last_became_active":"2023-12-12T10:12:08.830638+0000","last_became_peered":"2023-12-12T10:12:08.830638+0000","last_unstale":"2023-12-12T10:12:13.966788+0000","last_undegraded":"2023-12-12T10:12:13.966788+0000","last_fullsized":"2023-12-12T10:12:13.966788+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_clean_scrub_stamp":"2023-12-12T10:12:07.792253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:15:31.889391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-12T10:12:14.943486+0000","last_change":"2023-12-12T10:12:14.183763+0000","last_active":"2023-12-12T10:12:14.943486+0000","last_peered":"2023-12-12T10:12:14.943486+0000","last_clean":"2023-12-12T10:12:14.943486+0000","last_became_active":"2023-12-12T10:12:14.183320+0000","last_became_peered":"2023-12-12T10:12:14.183320+0000","last_unstale":"2023-12-12T10:12:14.943486+0000","last_undegraded":"2023-12-12T10:12:14.943486+0000","last_fullsized":"2023-12-12T10:12:14.943486+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_clean_scrub_stamp":"2023-12-12T10:12:12.929940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:46:01.637131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.954867+0000","last_change":"2023-12-12T10:12:09.843426+0000","last_active":"2023-12-12T10:12:13.954867+0000","last_peered":"2023-12-12T10:12:13.954867+0000","last_clean":"2023-12-12T10:12:13.954867+0000","last_became_active":"2023-12-12T10:12:09.841783+0000","last_became_peered":"2023-12-12T10:12:09.841783+0000","last_unstale":"2023-12-12T10:12:13.954867+0000","last_undegraded":"2023-12-12T10:12:13.954867+0000","last_fullsized":"2023-12-12T10:12:13.954867+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:29:05.621853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.963537+0000","last_change":"2023-12-12T10:12:08.835533+0000","last_active":"2023-12-12T10:12:13.963537+0000","last_peered":"2023-12-12T10:12:13.963537+0000","last_clean":"2023-12-12T10:12:13.963537+0000","last_became_active":"2023-12-12T10:12:08.835230+0000","last_became_peered":"2023-12-12T10:12:08.835230+0000","last_unstale":"2023-12-12T10:12:13.963537+0000","last_undegraded":"2023-12-12T10:12:13.963537+0000","last_fullsized":"2023-12-12T10:12:13.963537+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_clean_scrub_stamp":"2023-12-12T10:12:07.792253+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:50:55.983027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-12T10:12:15.556326+0000","last_change":"2023-12-12T10:12:13.968062+0000","last_active":"2023-12-12T10:12:15.556326+0000","last_peered":"2023-12-12T10:12:15.556326+0000","last_clean":"2023-12-12T10:12:15.556326+0000","last_became_active":"2023-12-12T10:12:13.967558+0000","last_became_peered":"2023-12-12T10:12:13.967558+0000","last_unstale":"2023-12-12T10:12:15.556326+0000","last_undegraded":"2023-12-12T10:12:15.556326+0000","last_fullsized":"2023-12-12T10:12:15.556326+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_clean_scrub_stamp":"2023-12-12T10:12:12.929940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:11:19.241925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:14.179682+0000","last_change":"2023-12-12T10:12:09.840613+0000","last_active":"2023-12-12T10:12:14.179682+0000","last_peered":"2023-12-12T10:12:14.179682+0000","last_clean":"2023-12-12T10:12:14.179682+0000","last_became_active":"2023-12-12T10:12:09.840305+0000","last_became_peered":"2023-12-12T10:12:09.840305+0000","last_unstale":"2023-12-12T10:12:14.179682+0000","last_undegraded":"2023-12-12T10:12:14.179682+0000","last_fullsized":"2023-12-12T10:12:14.179682+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:39:53.558801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.967272+0000","last_change":"2023-12-12T10:12:08.832234+0000","last_active":"2023-12-12T10:12:13.967272+0000","last_peered":"2023-12-12T10:12:13.967272+0000","last_clean":"2023-12-12T10:12:13.967272+0000","last_became_active":"2023-12-12T10:12:08.831933+0000","last_became_peered":"2023-12-12T10:12:08.831933+0000","last_unstale":"2023-12-12T10:12:13.967272+0000","last_undegraded":"2023-12-12T10:12:13.967272+0000","last_fullsized":"2023-12-12T10:12:13.967272+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_clean_scrub_stamp":"2023-12-12T10:12:07.792253+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:05:33.556015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-12T10:12:15.553874+0000","last_change":"2023-12-12T10:12:14.181013+0000","last_active":"2023-12-12T10:12:15.553874+0000","last_peered":"2023-12-12T10:12:15.553874+0000","last_clean":"2023-12-12T10:12:15.553874+0000","last_became_active":"2023-12-12T10:12:14.180237+0000","last_became_peered":"2023-12-12T10:12:14.180237+0000","last_unstale":"2023-12-12T10:12:15.553874+0000","last_undegraded":"2023-12-12T10:12:15.553874+0000","last_fullsized":"2023-12-12T10:12:15.553874+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_clean_scrub_stamp":"2023-12-12T10:12:12.929940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:41:41.466318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:14.179468+0000","last_change":"2023-12-12T10:12:09.843023+0000","last_active":"2023-12-12T10:12:14.179468+0000","last_peered":"2023-12-12T10:12:14.179468+0000","last_clean":"2023-12-12T10:12:14.179468+0000","last_became_active":"2023-12-12T10:12:09.839541+0000","last_became_peered":"2023-12-12T10:12:09.839541+0000","last_unstale":"2023-12-12T10:12:14.179468+0000","last_undegraded":"2023-12-12T10:12:14.179468+0000","last_fullsized":"2023-12-12T10:12:14.179468+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:11:15.110991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.947354+0000","last_change":"2023-12-12T10:12:08.837170+0000","last_active":"2023-12-12T10:12:13.947354+0000","last_peered":"2023-12-12T10:12:13.947354+0000","last_clean":"2023-12-12T10:12:13.947354+0000","last_became_active":"2023-12-12T10:12:08.836870+0000","last_became_peered":"2023-12-12T10:12:08.836870+0000","last_unstale":"2023-12-12T10:12:13.947354+0000","last_undegraded":"2023-12-12T10:12:13.947354+0000","last_fullsized":"2023-12-12T10:12:13.947354+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_clean_scrub_stamp":"2023-12-12T10:12:07.792253+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:02:02.748317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-12T10:12:14.943477+0000","last_change":"2023-12-12T10:12:13.961169+0000","last_active":"2023-12-12T10:12:14.943477+0000","last_peered":"2023-12-12T10:12:14.943477+0000","last_clean":"2023-12-12T10:12:14.943477+0000","last_became_active":"2023-12-12T10:12:13.960747+0000","last_became_peered":"2023-12-12T10:12:13.960747+0000","last_unstale":"2023-12-12T10:12:14.943477+0000","last_undegraded":"2023-12-12T10:12:14.943477+0000","last_fullsized":"2023-12-12T10:12:14.943477+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_clean_scrub_stamp":"2023-12-12T10:12:12.929940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:42:21.587913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:14.178613+0000","last_change":"2023-12-12T10:12:09.840229+0000","last_active":"2023-12-12T10:12:14.178613+0000","last_peered":"2023-12-12T10:12:14.178613+0000","last_clean":"2023-12-12T10:12:14.178613+0000","last_became_active":"2023-12-12T10:12:09.839022+0000","last_became_peered":"2023-12-12T10:12:09.839022+0000","last_unstale":"2023-12-12T10:12:14.178613+0000","last_undegraded":"2023-12-12T10:12:14.178613+0000","last_fullsized":"2023-12-12T10:12:14.178613+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:22:56.063355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.965950+0000","last_change":"2023-12-12T10:12:08.826707+0000","last_active":"2023-12-12T10:12:13.965950+0000","last_peered":"2023-12-12T10:12:13.965950+0000","last_clean":"2023-12-12T10:12:13.965950+0000","last_became_active":"2023-12-12T10:12:08.826379+0000","last_became_peered":"2023-12-12T10:12:08.826379+0000","last_unstale":"2023-12-12T10:12:13.965950+0000","last_undegraded":"2023-12-12T10:12:13.965950+0000","last_fullsized":"2023-12-12T10:12:13.965950+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_clean_scrub_stamp":"2023-12-12T10:12:07.792253+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:02:02.748317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-12T10:12:15.557190+0000","last_change":"2023-12-12T10:12:13.978141+0000","last_active":"2023-12-12T10:12:15.557190+0000","last_peered":"2023-12-12T10:12:15.557190+0000","last_clean":"2023-12-12T10:12:15.557190+0000","last_became_active":"2023-12-12T10:12:13.975903+0000","last_became_peered":"2023-12-12T10:12:13.975903+0000","last_unstale":"2023-12-12T10:12:15.557190+0000","last_undegraded":"2023-12-12T10:12:15.557190+0000","last_fullsized":"2023-12-12T10:12:15.557190+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_clean_scrub_stamp":"2023-12-12T10:12:12.929940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:03:54.367055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.945635+0000","last_change":"2023-12-12T10:12:09.823042+0000","last_active":"2023-12-12T10:12:13.945635+0000","last_peered":"2023-12-12T10:12:13.945635+0000","last_clean":"2023-12-12T10:12:13.945635+0000","last_became_active":"2023-12-12T10:12:09.822372+0000","last_became_peered":"2023-12-12T10:12:09.822372+0000","last_unstale":"2023-12-12T10:12:13.945635+0000","last_undegraded":"2023-12-12T10:12:13.945635+0000","last_fullsized":"2023-12-12T10:12:13.945635+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:05:45.545567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.949351+0000","last_change":"2023-12-12T10:12:08.831259+0000","last_active":"2023-12-12T10:12:13.949351+0000","last_peered":"2023-12-12T10:12:13.949351+0000","last_clean":"2023-12-12T10:12:13.949351+0000","last_became_active":"2023-12-12T10:12:08.830921+0000","last_became_peered":"2023-12-12T10:12:08.830921+0000","last_unstale":"2023-12-12T10:12:13.949351+0000","last_undegraded":"2023-12-12T10:12:13.949351+0000","last_fullsized":"2023-12-12T10:12:13.949351+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_clean_scrub_stamp":"2023-12-12T10:12:07.792253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:01:42.240854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-12T10:12:15.556830+0000","last_change":"2023-12-12T10:12:14.186089+0000","last_active":"2023-12-12T10:12:15.556830+0000","last_peered":"2023-12-12T10:12:15.556830+0000","last_clean":"2023-12-12T10:12:15.556830+0000","last_became_active":"2023-12-12T10:12:14.185616+0000","last_became_peered":"2023-12-12T10:12:14.185616+0000","last_unstale":"2023-12-12T10:12:15.556830+0000","last_undegraded":"2023-12-12T10:12:15.556830+0000","last_fullsized":"2023-12-12T10:12:15.556830+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_clean_scrub_stamp":"2023-12-12T10:12:12.929940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:44:39.253218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:14.178766+0000","last_change":"2023-12-12T10:12:09.839119+0000","last_active":"2023-12-12T10:12:14.178766+0000","last_peered":"2023-12-12T10:12:14.178766+0000","last_clean":"2023-12-12T10:12:14.178766+0000","last_became_active":"2023-12-12T10:12:09.838832+0000","last_became_peered":"2023-12-12T10:12:09.838832+0000","last_unstale":"2023-12-12T10:12:14.178766+0000","last_undegraded":"2023-12-12T10:12:14.178766+0000","last_fullsized":"2023-12-12T10:12:14.178766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:06:52.618740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.955540+0000","last_change":"2023-12-12T10:12:08.832946+0000","last_active":"2023-12-12T10:12:13.955540+0000","last_peered":"2023-12-12T10:12:13.955540+0000","last_clean":"2023-12-12T10:12:13.955540+0000","last_became_active":"2023-12-12T10:12:08.832657+0000","last_became_peered":"2023-12-12T10:12:08.832657+0000","last_unstale":"2023-12-12T10:12:13.955540+0000","last_undegraded":"2023-12-12T10:12:13.955540+0000","last_fullsized":"2023-12-12T10:12:13.955540+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_clean_scrub_stamp":"2023-12-12T10:12:07.792253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:45:52.005263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-12T10:12:15.556971+0000","last_change":"2023-12-12T10:12:14.183490+0000","last_active":"2023-12-12T10:12:15.556971+0000","last_peered":"2023-12-12T10:12:15.556971+0000","last_clean":"2023-12-12T10:12:15.556971+0000","last_became_active":"2023-12-12T10:12:14.182333+0000","last_became_peered":"2023-12-12T10:12:14.182333+0000","last_unstale":"2023-12-12T10:12:15.556971+0000","last_undegraded":"2023-12-12T10:12:15.556971+0000","last_fullsized":"2023-12-12T10:12:15.556971+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_clean_scrub_stamp":"2023-12-12T10:12:12.929940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:04:36.664695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.954813+0000","last_change":"2023-12-12T10:12:09.829410+0000","last_active":"2023-12-12T10:12:13.954813+0000","last_peered":"2023-12-12T10:12:13.954813+0000","last_clean":"2023-12-12T10:12:13.954813+0000","last_became_active":"2023-12-12T10:12:09.829144+0000","last_became_peered":"2023-12-12T10:12:09.829144+0000","last_unstale":"2023-12-12T10:12:13.954813+0000","last_undegraded":"2023-12-12T10:12:13.954813+0000","last_fullsized":"2023-12-12T10:12:13.954813+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:33:07.947544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.956073+0000","last_change":"2023-12-12T10:12:08.840254+0000","last_active":"2023-12-12T10:12:13.956073+0000","last_peered":"2023-12-12T10:12:13.956073+0000","last_clean":"2023-12-12T10:12:13.956073+0000","last_became_active":"2023-12-12T10:12:08.839962+0000","last_became_peered":"2023-12-12T10:12:08.839962+0000","last_unstale":"2023-12-12T10:12:13.956073+0000","last_undegraded":"2023-12-12T10:12:13.956073+0000","last_fullsized":"2023-12-12T10:12:13.956073+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_clean_scrub_stamp":"2023-12-12T10:12:07.792253+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:46:36.023306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-12T10:12:15.554704+0000","last_change":"2023-12-12T10:12:14.180551+0000","last_active":"2023-12-12T10:12:15.554704+0000","last_peered":"2023-12-12T10:12:15.554704+0000","last_clean":"2023-12-12T10:12:15.554704+0000","last_became_active":"2023-12-12T10:12:14.180147+0000","last_became_peered":"2023-12-12T10:12:14.180147+0000","last_unstale":"2023-12-12T10:12:15.554704+0000","last_undegraded":"2023-12-12T10:12:15.554704+0000","last_fullsized":"2023-12-12T10:12:15.554704+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_clean_scrub_stamp":"2023-12-12T10:12:12.929940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:46:26.737660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:14.178878+0000","last_change":"2023-12-12T10:12:09.840271+0000","last_active":"2023-12-12T10:12:14.178878+0000","last_peered":"2023-12-12T10:12:14.178878+0000","last_clean":"2023-12-12T10:12:14.178878+0000","last_became_active":"2023-12-12T10:12:09.839285+0000","last_became_peered":"2023-12-12T10:12:09.839285+0000","last_unstale":"2023-12-12T10:12:14.178878+0000","last_undegraded":"2023-12-12T10:12:14.178878+0000","last_fullsized":"2023-12-12T10:12:14.178878+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:08:12.099242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'8","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-12T10:12:18.763644+0000","last_change":"2023-12-12T10:12:08.833712+0000","last_active":"2023-12-12T10:12:18.763644+0000","last_peered":"2023-12-12T10:12:18.763644+0000","last_clean":"2023-12-12T10:12:18.763644+0000","last_became_active":"2023-12-12T10:12:08.833335+0000","last_became_peered":"2023-12-12T10:12:08.833335+0000","last_unstale":"2023-12-12T10:12:18.763644+0000","last_undegraded":"2023-12-12T10:12:18.763644+0000","last_fullsized":"2023-12-12T10:12:18.763644+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_clean_scrub_stamp":"2023-12-12T10:12:07.792253+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:41:37.226888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3698,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-12T10:12:15.184374+0000","last_change":"2023-12-12T10:12:13.969124+0000","last_active":"2023-12-12T10:12:15.184374+0000","last_peered":"2023-12-12T10:12:15.184374+0000","last_clean":"2023-12-12T10:12:15.184374+0000","last_became_active":"2023-12-12T10:12:13.968588+0000","last_became_peered":"2023-12-12T10:12:13.968588+0000","last_unstale":"2023-12-12T10:12:15.184374+0000","last_undegraded":"2023-12-12T10:12:15.184374+0000","last_fullsized":"2023-12-12T10:12:15.184374+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_clean_scrub_stamp":"2023-12-12T10:12:12.929940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:17:23.880191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.947087+0000","last_change":"2023-12-12T10:12:09.836126+0000","last_active":"2023-12-12T10:12:13.947087+0000","last_peered":"2023-12-12T10:12:13.947087+0000","last_clean":"2023-12-12T10:12:13.947087+0000","last_became_active":"2023-12-12T10:12:09.835866+0000","last_became_peered":"2023-12-12T10:12:09.835866+0000","last_unstale":"2023-12-12T10:12:13.947087+0000","last_undegraded":"2023-12-12T10:12:13.947087+0000","last_fullsized":"2023-12-12T10:12:13.947087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:01:43.247607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.963472+0000","last_change":"2023-12-12T10:12:08.835844+0000","last_active":"2023-12-12T10:12:13.963472+0000","last_peered":"2023-12-12T10:12:13.963472+0000","last_clean":"2023-12-12T10:12:13.963472+0000","last_became_active":"2023-12-12T10:12:08.835523+0000","last_became_peered":"2023-12-12T10:12:08.835523+0000","last_unstale":"2023-12-12T10:12:13.963472+0000","last_undegraded":"2023-12-12T10:12:13.963472+0000","last_fullsized":"2023-12-12T10:12:13.963472+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_clean_scrub_stamp":"2023-12-12T10:12:07.792253+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:22:26.547358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-12T10:12:14.944351+0000","last_change":"2023-12-12T10:12:13.963846+0000","last_active":"2023-12-12T10:12:14.944351+0000","last_peered":"2023-12-12T10:12:14.944351+0000","last_clean":"2023-12-12T10:12:14.944351+0000","last_became_active":"2023-12-12T10:12:13.963343+0000","last_became_peered":"2023-12-12T10:12:13.963343+0000","last_unstale":"2023-12-12T10:12:14.944351+0000","last_undegraded":"2023-12-12T10:12:14.944351+0000","last_fullsized":"2023-12-12T10:12:14.944351+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_clean_scrub_stamp":"2023-12-12T10:12:12.929940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:47:49.100393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.957119+0000","last_change":"2023-12-12T10:12:09.846702+0000","last_active":"2023-12-12T10:12:13.957119+0000","last_peered":"2023-12-12T10:12:13.957119+0000","last_clean":"2023-12-12T10:12:13.957119+0000","last_became_active":"2023-12-12T10:12:09.846459+0000","last_became_peered":"2023-12-12T10:12:09.846459+0000","last_unstale":"2023-12-12T10:12:13.957119+0000","last_undegraded":"2023-12-12T10:12:13.957119+0000","last_fullsized":"2023-12-12T10:12:13.957119+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:42:17.456979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.955160+0000","last_change":"2023-12-12T10:12:08.843421+0000","last_active":"2023-12-12T10:12:13.955160+0000","last_peered":"2023-12-12T10:12:13.955160+0000","last_clean":"2023-12-12T10:12:13.955160+0000","last_became_active":"2023-12-12T10:12:08.843122+0000","last_became_peered":"2023-12-12T10:12:08.843122+0000","last_unstale":"2023-12-12T10:12:13.955160+0000","last_undegraded":"2023-12-12T10:12:13.955160+0000","last_fullsized":"2023-12-12T10:12:13.955160+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_clean_scrub_stamp":"2023-12-12T10:12:07.792253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:59:45.615605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-12T10:12:15.555918+0000","last_change":"2023-12-12T10:12:13.964875+0000","last_active":"2023-12-12T10:12:15.555918+0000","last_peered":"2023-12-12T10:12:15.555918+0000","last_clean":"2023-12-12T10:12:15.555918+0000","last_became_active":"2023-12-12T10:12:13.964323+0000","last_became_peered":"2023-12-12T10:12:13.964323+0000","last_unstale":"2023-12-12T10:12:15.555918+0000","last_undegraded":"2023-12-12T10:12:15.555918+0000","last_fullsized":"2023-12-12T10:12:15.555918+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_clean_scrub_stamp":"2023-12-12T10:12:12.929940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:35:07.230080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.955023+0000","last_change":"2023-12-12T10:12:09.846552+0000","last_active":"2023-12-12T10:12:13.955023+0000","last_peered":"2023-12-12T10:12:13.955023+0000","last_clean":"2023-12-12T10:12:13.955023+0000","last_became_active":"2023-12-12T10:12:09.844321+0000","last_became_peered":"2023-12-12T10:12:09.844321+0000","last_unstale":"2023-12-12T10:12:13.955023+0000","last_undegraded":"2023-12-12T10:12:13.955023+0000","last_fullsized":"2023-12-12T10:12:13.955023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:47:44.969459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.945152+0000","last_change":"2023-12-12T10:12:08.833577+0000","last_active":"2023-12-12T10:12:13.945152+0000","last_peered":"2023-12-12T10:12:13.945152+0000","last_clean":"2023-12-12T10:12:13.945152+0000","last_became_active":"2023-12-12T10:12:08.833266+0000","last_became_peered":"2023-12-12T10:12:08.833266+0000","last_unstale":"2023-12-12T10:12:13.945152+0000","last_undegraded":"2023-12-12T10:12:13.945152+0000","last_fullsized":"2023-12-12T10:12:13.945152+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_clean_scrub_stamp":"2023-12-12T10:12:07.792253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:50:55.983027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-12T10:12:15.555695+0000","last_change":"2023-12-12T10:12:14.187838+0000","last_active":"2023-12-12T10:12:15.555695+0000","last_peered":"2023-12-12T10:12:15.555695+0000","last_clean":"2023-12-12T10:12:15.555695+0000","last_became_active":"2023-12-12T10:12:14.187430+0000","last_became_peered":"2023-12-12T10:12:14.187430+0000","last_unstale":"2023-12-12T10:12:15.555695+0000","last_undegraded":"2023-12-12T10:12:15.555695+0000","last_fullsized":"2023-12-12T10:12:15.555695+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_clean_scrub_stamp":"2023-12-12T10:12:12.929940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:10:11.022165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-12T10:12:15.557056+0000","last_change":"2023-12-12T10:12:14.186204+0000","last_active":"2023-12-12T10:12:15.557056+0000","last_peered":"2023-12-12T10:12:15.557056+0000","last_clean":"2023-12-12T10:12:15.557056+0000","last_became_active":"2023-12-12T10:12:14.185264+0000","last_became_peered":"2023-12-12T10:12:14.185264+0000","last_unstale":"2023-12-12T10:12:15.557056+0000","last_undegraded":"2023-12-12T10:12:15.557056+0000","last_fullsized":"2023-12-12T10:12:15.557056+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_clean_scrub_stamp":"2023-12-12T10:12:12.929940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:17:23.880191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.960807+0000","last_change":"2023-12-12T10:12:09.829976+0000","last_active":"2023-12-12T10:12:13.960807+0000","last_peered":"2023-12-12T10:12:13.960807+0000","last_clean":"2023-12-12T10:12:13.960807+0000","last_became_active":"2023-12-12T10:12:09.829573+0000","last_became_peered":"2023-12-12T10:12:09.829573+0000","last_unstale":"2023-12-12T10:12:13.960807+0000","last_undegraded":"2023-12-12T10:12:13.960807+0000","last_fullsized":"2023-12-12T10:12:13.960807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:05:45.545567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.954582+0000","last_change":"2023-12-12T10:12:08.820896+0000","last_active":"2023-12-12T10:12:13.954582+0000","last_peered":"2023-12-12T10:12:13.954582+0000","last_clean":"2023-12-12T10:12:13.954582+0000","last_became_active":"2023-12-12T10:12:08.819705+0000","last_became_peered":"2023-12-12T10:12:08.819705+0000","last_unstale":"2023-12-12T10:12:13.954582+0000","last_undegraded":"2023-12-12T10:12:13.954582+0000","last_fullsized":"2023-12-12T10:12:13.954582+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_clean_scrub_stamp":"2023-12-12T10:12:07.792253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:14:21.574354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-12T10:12:14.944814+0000","last_change":"2023-12-12T10:12:13.966284+0000","last_active":"2023-12-12T10:12:14.944814+0000","last_peered":"2023-12-12T10:12:14.944814+0000","last_clean":"2023-12-12T10:12:14.944814+0000","last_became_active":"2023-12-12T10:12:13.965836+0000","last_became_peered":"2023-12-12T10:12:13.965836+0000","last_unstale":"2023-12-12T10:12:14.944814+0000","last_undegraded":"2023-12-12T10:12:14.944814+0000","last_fullsized":"2023-12-12T10:12:14.944814+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_clean_scrub_stamp":"2023-12-12T10:12:12.929940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:29:09.752788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.942530+0000","last_change":"2023-12-12T10:12:09.836385+0000","last_active":"2023-12-12T10:12:13.942530+0000","last_peered":"2023-12-12T10:12:13.942530+0000","last_clean":"2023-12-12T10:12:13.942530+0000","last_became_active":"2023-12-12T10:12:09.836038+0000","last_became_peered":"2023-12-12T10:12:09.836038+0000","last_unstale":"2023-12-12T10:12:13.942530+0000","last_undegraded":"2023-12-12T10:12:13.942530+0000","last_fullsized":"2023-12-12T10:12:13.942530+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:08:12.099242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.942840+0000","last_change":"2023-12-12T10:12:08.842624+0000","last_active":"2023-12-12T10:12:13.942840+0000","last_peered":"2023-12-12T10:12:13.942840+0000","last_clean":"2023-12-12T10:12:13.942840+0000","last_became_active":"2023-12-12T10:12:08.842340+0000","last_became_peered":"2023-12-12T10:12:08.842340+0000","last_unstale":"2023-12-12T10:12:13.942840+0000","last_undegraded":"2023-12-12T10:12:13.942840+0000","last_fullsized":"2023-12-12T10:12:13.942840+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_clean_scrub_stamp":"2023-12-12T10:12:07.792253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:43:30.327223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.942405+0000","last_change":"2023-12-12T10:12:08.828385+0000","last_active":"2023-12-12T10:12:13.942405+0000","last_peered":"2023-12-12T10:12:13.942405+0000","last_clean":"2023-12-12T10:12:13.942405+0000","last_became_active":"2023-12-12T10:12:08.828078+0000","last_became_peered":"2023-12-12T10:12:08.828078+0000","last_unstale":"2023-12-12T10:12:13.942405+0000","last_undegraded":"2023-12-12T10:12:13.942405+0000","last_fullsized":"2023-12-12T10:12:13.942405+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_clean_scrub_stamp":"2023-12-12T10:12:07.792253+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:46:36.023306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.955847+0000","last_change":"2023-12-12T10:12:09.839770+0000","last_active":"2023-12-12T10:12:13.955847+0000","last_peered":"2023-12-12T10:12:13.955847+0000","last_clean":"2023-12-12T10:12:13.955847+0000","last_became_active":"2023-12-12T10:12:09.838270+0000","last_became_peered":"2023-12-12T10:12:09.838270+0000","last_unstale":"2023-12-12T10:12:13.955847+0000","last_undegraded":"2023-12-12T10:12:13.955847+0000","last_fullsized":"2023-12-12T10:12:13.955847+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:05:45.545567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-12T10:12:14.944264+0000","last_change":"2023-12-12T10:12:13.976903+0000","last_active":"2023-12-12T10:12:14.944264+0000","last_peered":"2023-12-12T10:12:14.944264+0000","last_clean":"2023-12-12T10:12:14.944264+0000","last_became_active":"2023-12-12T10:12:13.976414+0000","last_became_peered":"2023-12-12T10:12:13.976414+0000","last_unstale":"2023-12-12T10:12:14.944264+0000","last_undegraded":"2023-12-12T10:12:14.944264+0000","last_fullsized":"2023-12-12T10:12:14.944264+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_clean_scrub_stamp":"2023-12-12T10:12:12.929940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:22:31.685044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.943480+0000","last_change":"2023-12-12T10:12:08.841907+0000","last_active":"2023-12-12T10:12:13.943480+0000","last_peered":"2023-12-12T10:12:13.943480+0000","last_clean":"2023-12-12T10:12:13.943480+0000","last_became_active":"2023-12-12T10:12:08.841597+0000","last_became_peered":"2023-12-12T10:12:08.841597+0000","last_unstale":"2023-12-12T10:12:13.943480+0000","last_undegraded":"2023-12-12T10:12:13.943480+0000","last_fullsized":"2023-12-12T10:12:13.943480+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_clean_scrub_stamp":"2023-12-12T10:12:07.792253+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:50:55.983027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.945193+0000","last_change":"2023-12-12T10:12:09.825457+0000","last_active":"2023-12-12T10:12:13.945193+0000","last_peered":"2023-12-12T10:12:13.945193+0000","last_clean":"2023-12-12T10:12:13.945193+0000","last_became_active":"2023-12-12T10:12:09.824655+0000","last_became_peered":"2023-12-12T10:12:09.824655+0000","last_unstale":"2023-12-12T10:12:13.945193+0000","last_undegraded":"2023-12-12T10:12:13.945193+0000","last_fullsized":"2023-12-12T10:12:13.945193+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:46:37.030058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-12T10:12:15.556592+0000","last_change":"2023-12-12T10:12:13.978242+0000","last_active":"2023-12-12T10:12:15.556592+0000","last_peered":"2023-12-12T10:12:15.556592+0000","last_clean":"2023-12-12T10:12:15.556592+0000","last_became_active":"2023-12-12T10:12:13.977875+0000","last_became_peered":"2023-12-12T10:12:13.977875+0000","last_unstale":"2023-12-12T10:12:15.556592+0000","last_undegraded":"2023-12-12T10:12:15.556592+0000","last_fullsized":"2023-12-12T10:12:15.556592+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_clean_scrub_stamp":"2023-12-12T10:12:12.929940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:36:01.186241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.945551+0000","last_change":"2023-12-12T10:12:09.825518+0000","last_active":"2023-12-12T10:12:13.945551+0000","last_peered":"2023-12-12T10:12:13.945551+0000","last_clean":"2023-12-12T10:12:13.945551+0000","last_became_active":"2023-12-12T10:12:09.822775+0000","last_became_peered":"2023-12-12T10:12:09.822775+0000","last_unstale":"2023-12-12T10:12:13.945551+0000","last_undegraded":"2023-12-12T10:12:13.945551+0000","last_fullsized":"2023-12-12T10:12:13.945551+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:24:13.207348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.965244+0000","last_change":"2023-12-12T10:12:09.844690+0000","last_active":"2023-12-12T10:12:13.965244+0000","last_peered":"2023-12-12T10:12:13.965244+0000","last_clean":"2023-12-12T10:12:13.965244+0000","last_became_active":"2023-12-12T10:12:09.844429+0000","last_became_peered":"2023-12-12T10:12:09.844429+0000","last_unstale":"2023-12-12T10:12:13.965244+0000","last_undegraded":"2023-12-12T10:12:13.965244+0000","last_fullsized":"2023-12-12T10:12:13.965244+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:46:37.030058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.955446+0000","last_change":"2023-12-12T10:12:09.838818+0000","last_active":"2023-12-12T10:12:13.955446+0000","last_peered":"2023-12-12T10:12:13.955446+0000","last_clean":"2023-12-12T10:12:13.955446+0000","last_became_active":"2023-12-12T10:12:09.838507+0000","last_became_peered":"2023-12-12T10:12:09.838507+0000","last_unstale":"2023-12-12T10:12:13.955446+0000","last_undegraded":"2023-12-12T10:12:13.955446+0000","last_fullsized":"2023-12-12T10:12:13.955446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:08:12.099242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.955753+0000","last_change":"2023-12-12T10:12:09.831070+0000","last_active":"2023-12-12T10:12:13.955753+0000","last_peered":"2023-12-12T10:12:13.955753+0000","last_clean":"2023-12-12T10:12:13.955753+0000","last_became_active":"2023-12-12T10:12:09.830702+0000","last_became_peered":"2023-12-12T10:12:09.830702+0000","last_unstale":"2023-12-12T10:12:13.955753+0000","last_undegraded":"2023-12-12T10:12:13.955753+0000","last_fullsized":"2023-12-12T10:12:13.955753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:24:13.207348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.944609+0000","last_change":"2023-12-12T10:12:09.839496+0000","last_active":"2023-12-12T10:12:13.944609+0000","last_peered":"2023-12-12T10:12:13.944609+0000","last_clean":"2023-12-12T10:12:13.944609+0000","last_became_active":"2023-12-12T10:12:09.839184+0000","last_became_peered":"2023-12-12T10:12:09.839184+0000","last_unstale":"2023-12-12T10:12:13.944609+0000","last_undegraded":"2023-12-12T10:12:13.944609+0000","last_fullsized":"2023-12-12T10:12:13.944609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:14:22.581107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.963351+0000","last_change":"2023-12-12T10:12:09.833470+0000","last_active":"2023-12-12T10:12:13.963351+0000","last_peered":"2023-12-12T10:12:13.963351+0000","last_clean":"2023-12-12T10:12:13.963351+0000","last_became_active":"2023-12-12T10:12:09.833154+0000","last_became_peered":"2023-12-12T10:12:09.833154+0000","last_unstale":"2023-12-12T10:12:13.963351+0000","last_undegraded":"2023-12-12T10:12:13.963351+0000","last_fullsized":"2023-12-12T10:12:13.963351+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:42:17.456979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.945149+0000","last_change":"2023-12-12T10:12:09.826435+0000","last_active":"2023-12-12T10:12:13.945149+0000","last_peered":"2023-12-12T10:12:13.945149+0000","last_clean":"2023-12-12T10:12:13.945149+0000","last_became_active":"2023-12-12T10:12:09.826055+0000","last_became_peered":"2023-12-12T10:12:09.826055+0000","last_unstale":"2023-12-12T10:12:13.945149+0000","last_undegraded":"2023-12-12T10:12:13.945149+0000","last_fullsized":"2023-12-12T10:12:13.945149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:29:34.002418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.947105+0000","last_change":"2023-12-12T10:12:09.835389+0000","last_active":"2023-12-12T10:12:13.947105+0000","last_peered":"2023-12-12T10:12:13.947105+0000","last_clean":"2023-12-12T10:12:13.947105+0000","last_became_active":"2023-12-12T10:12:09.835119+0000","last_became_peered":"2023-12-12T10:12:09.835119+0000","last_unstale":"2023-12-12T10:12:13.947105+0000","last_undegraded":"2023-12-12T10:12:13.947105+0000","last_fullsized":"2023-12-12T10:12:13.947105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:29:34.002418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.953512+0000","last_change":"2023-12-12T10:12:09.840058+0000","last_active":"2023-12-12T10:12:13.953512+0000","last_peered":"2023-12-12T10:12:13.953512+0000","last_clean":"2023-12-12T10:12:13.953512+0000","last_became_active":"2023-12-12T10:12:09.839675+0000","last_became_peered":"2023-12-12T10:12:09.839675+0000","last_unstale":"2023-12-12T10:12:13.953512+0000","last_undegraded":"2023-12-12T10:12:13.953512+0000","last_fullsized":"2023-12-12T10:12:13.953512+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:29:34.002418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.942739+0000","last_change":"2023-12-12T10:12:09.842044+0000","last_active":"2023-12-12T10:12:13.942739+0000","last_peered":"2023-12-12T10:12:13.942739+0000","last_clean":"2023-12-12T10:12:13.942739+0000","last_became_active":"2023-12-12T10:12:09.841751+0000","last_became_peered":"2023-12-12T10:12:09.841751+0000","last_unstale":"2023-12-12T10:12:13.942739+0000","last_undegraded":"2023-12-12T10:12:13.942739+0000","last_fullsized":"2023-12-12T10:12:13.942739+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:42:17.456979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.955340+0000","last_change":"2023-12-12T10:12:09.835927+0000","last_active":"2023-12-12T10:12:13.955340+0000","last_peered":"2023-12-12T10:12:13.955340+0000","last_clean":"2023-12-12T10:12:13.955340+0000","last_became_active":"2023-12-12T10:12:09.835625+0000","last_became_peered":"2023-12-12T10:12:09.835625+0000","last_unstale":"2023-12-12T10:12:13.955340+0000","last_undegraded":"2023-12-12T10:12:13.955340+0000","last_fullsized":"2023-12-12T10:12:13.955340+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:22:56.063355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.955249+0000","last_change":"2023-12-12T10:12:09.834124+0000","last_active":"2023-12-12T10:12:13.955249+0000","last_peered":"2023-12-12T10:12:13.955249+0000","last_clean":"2023-12-12T10:12:13.955249+0000","last_became_active":"2023-12-12T10:12:09.833698+0000","last_became_peered":"2023-12-12T10:12:09.833698+0000","last_unstale":"2023-12-12T10:12:13.955249+0000","last_undegraded":"2023-12-12T10:12:13.955249+0000","last_fullsized":"2023-12-12T10:12:13.955249+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:45:53.012016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.944483+0000","last_change":"2023-12-12T10:12:09.831637+0000","last_active":"2023-12-12T10:12:13.944483+0000","last_peered":"2023-12-12T10:12:13.944483+0000","last_clean":"2023-12-12T10:12:13.944483+0000","last_became_active":"2023-12-12T10:12:09.831330+0000","last_became_peered":"2023-12-12T10:12:09.831330+0000","last_unstale":"2023-12-12T10:12:13.944483+0000","last_undegraded":"2023-12-12T10:12:13.944483+0000","last_fullsized":"2023-12-12T10:12:13.944483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:45:53.012016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:14.179084+0000","last_change":"2023-12-12T10:12:09.832795+0000","last_active":"2023-12-12T10:12:14.179084+0000","last_peered":"2023-12-12T10:12:14.179084+0000","last_clean":"2023-12-12T10:12:14.179084+0000","last_became_active":"2023-12-12T10:12:09.832536+0000","last_became_peered":"2023-12-12T10:12:09.832536+0000","last_unstale":"2023-12-12T10:12:14.179084+0000","last_undegraded":"2023-12-12T10:12:14.179084+0000","last_fullsized":"2023-12-12T10:12:14.179084+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:17:19.749257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.967788+0000","last_change":"2023-12-12T10:12:09.836093+0000","last_active":"2023-12-12T10:12:13.967788+0000","last_peered":"2023-12-12T10:12:13.967788+0000","last_clean":"2023-12-12T10:12:13.967788+0000","last_became_active":"2023-12-12T10:12:09.835900+0000","last_became_peered":"2023-12-12T10:12:09.835900+0000","last_unstale":"2023-12-12T10:12:13.967788+0000","last_undegraded":"2023-12-12T10:12:13.967788+0000","last_fullsized":"2023-12-12T10:12:13.967788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:41:38.233640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.955513+0000","last_change":"2023-12-12T10:12:09.842078+0000","last_active":"2023-12-12T10:12:13.955513+0000","last_peered":"2023-12-12T10:12:13.955513+0000","last_clean":"2023-12-12T10:12:13.955513+0000","last_became_active":"2023-12-12T10:12:09.841393+0000","last_became_peered":"2023-12-12T10:12:09.841393+0000","last_unstale":"2023-12-12T10:12:13.955513+0000","last_undegraded":"2023-12-12T10:12:13.955513+0000","last_fullsized":"2023-12-12T10:12:13.955513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:11:15.110991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.953508+0000","last_change":"2023-12-12T10:12:09.835453+0000","last_active":"2023-12-12T10:12:13.953508+0000","last_peered":"2023-12-12T10:12:13.953508+0000","last_clean":"2023-12-12T10:12:13.953508+0000","last_became_active":"2023-12-12T10:12:09.835078+0000","last_became_peered":"2023-12-12T10:12:09.835078+0000","last_unstale":"2023-12-12T10:12:13.953508+0000","last_undegraded":"2023-12-12T10:12:13.953508+0000","last_fullsized":"2023-12-12T10:12:13.953508+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:42:17.456979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.960892+0000","last_change":"2023-12-12T10:12:09.836102+0000","last_active":"2023-12-12T10:12:13.960892+0000","last_peered":"2023-12-12T10:12:13.960892+0000","last_clean":"2023-12-12T10:12:13.960892+0000","last_became_active":"2023-12-12T10:12:09.835809+0000","last_became_peered":"2023-12-12T10:12:09.835809+0000","last_unstale":"2023-12-12T10:12:13.960892+0000","last_undegraded":"2023-12-12T10:12:13.960892+0000","last_fullsized":"2023-12-12T10:12:13.960892+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:29:34.002418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.954718+0000","last_change":"2023-12-12T10:12:09.825563+0000","last_active":"2023-12-12T10:12:13.954718+0000","last_peered":"2023-12-12T10:12:13.954718+0000","last_clean":"2023-12-12T10:12:13.954718+0000","last_became_active":"2023-12-12T10:12:09.825296+0000","last_became_peered":"2023-12-12T10:12:09.825296+0000","last_unstale":"2023-12-12T10:12:13.954718+0000","last_undegraded":"2023-12-12T10:12:13.954718+0000","last_fullsized":"2023-12-12T10:12:13.954718+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:50:56.989780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.942544+0000","last_change":"2023-12-12T10:12:09.834352+0000","last_active":"2023-12-12T10:12:13.942544+0000","last_peered":"2023-12-12T10:12:13.942544+0000","last_clean":"2023-12-12T10:12:13.942544+0000","last_became_active":"2023-12-12T10:12:09.834163+0000","last_became_peered":"2023-12-12T10:12:09.834163+0000","last_unstale":"2023-12-12T10:12:13.942544+0000","last_undegraded":"2023-12-12T10:12:13.942544+0000","last_fullsized":"2023-12-12T10:12:13.942544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:45:53.012016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.946993+0000","last_change":"2023-12-12T10:12:09.833417+0000","last_active":"2023-12-12T10:12:13.946993+0000","last_peered":"2023-12-12T10:12:13.946993+0000","last_clean":"2023-12-12T10:12:13.946993+0000","last_became_active":"2023-12-12T10:12:09.833065+0000","last_became_peered":"2023-12-12T10:12:09.833065+0000","last_unstale":"2023-12-12T10:12:13.946993+0000","last_undegraded":"2023-12-12T10:12:13.946993+0000","last_fullsized":"2023-12-12T10:12:13.946993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:05:34.562768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.945203+0000","last_change":"2023-12-12T10:12:09.847547+0000","last_active":"2023-12-12T10:12:13.945203+0000","last_peered":"2023-12-12T10:12:13.945203+0000","last_clean":"2023-12-12T10:12:13.945203+0000","last_became_active":"2023-12-12T10:12:09.847242+0000","last_became_peered":"2023-12-12T10:12:09.847242+0000","last_unstale":"2023-12-12T10:12:13.945203+0000","last_undegraded":"2023-12-12T10:12:13.945203+0000","last_fullsized":"2023-12-12T10:12:13.945203+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:59:46.622358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.945295+0000","last_change":"2023-12-12T10:12:09.845347+0000","last_active":"2023-12-12T10:12:13.945295+0000","last_peered":"2023-12-12T10:12:13.945295+0000","last_clean":"2023-12-12T10:12:13.945295+0000","last_became_active":"2023-12-12T10:12:09.845043+0000","last_became_peered":"2023-12-12T10:12:09.845043+0000","last_unstale":"2023-12-12T10:12:13.945295+0000","last_undegraded":"2023-12-12T10:12:13.945295+0000","last_fullsized":"2023-12-12T10:12:13.945295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:42:17.456979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:14.179662+0000","last_change":"2023-12-12T10:12:09.846679+0000","last_active":"2023-12-12T10:12:14.179662+0000","last_peered":"2023-12-12T10:12:14.179662+0000","last_clean":"2023-12-12T10:12:14.179662+0000","last_became_active":"2023-12-12T10:12:09.846392+0000","last_became_peered":"2023-12-12T10:12:09.846392+0000","last_unstale":"2023-12-12T10:12:14.179662+0000","last_undegraded":"2023-12-12T10:12:14.179662+0000","last_fullsized":"2023-12-12T10:12:14.179662+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:51:42.379319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.941904+0000","last_change":"2023-12-12T10:12:09.839337+0000","last_active":"2023-12-12T10:12:13.941904+0000","last_peered":"2023-12-12T10:12:13.941904+0000","last_clean":"2023-12-12T10:12:13.941904+0000","last_became_active":"2023-12-12T10:12:09.838987+0000","last_became_peered":"2023-12-12T10:12:09.838987+0000","last_unstale":"2023-12-12T10:12:13.941904+0000","last_undegraded":"2023-12-12T10:12:13.941904+0000","last_fullsized":"2023-12-12T10:12:13.941904+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:22:56.063355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:14.178541+0000","last_change":"2023-12-12T10:12:09.827527+0000","last_active":"2023-12-12T10:12:14.178541+0000","last_peered":"2023-12-12T10:12:14.178541+0000","last_clean":"2023-12-12T10:12:14.178541+0000","last_became_active":"2023-12-12T10:12:09.827216+0000","last_became_peered":"2023-12-12T10:12:09.827216+0000","last_unstale":"2023-12-12T10:12:14.178541+0000","last_undegraded":"2023-12-12T10:12:14.178541+0000","last_fullsized":"2023-12-12T10:12:14.178541+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:47:44.969459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.955227+0000","last_change":"2023-12-12T10:12:09.835033+0000","last_active":"2023-12-12T10:12:13.955227+0000","last_peered":"2023-12-12T10:12:13.955227+0000","last_clean":"2023-12-12T10:12:13.955227+0000","last_became_active":"2023-12-12T10:12:09.834115+0000","last_became_peered":"2023-12-12T10:12:09.834115+0000","last_unstale":"2023-12-12T10:12:13.955227+0000","last_undegraded":"2023-12-12T10:12:13.955227+0000","last_fullsized":"2023-12-12T10:12:13.955227+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T22:01:05.110732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:14.178670+0000","last_change":"2023-12-12T10:12:09.831879+0000","last_active":"2023-12-12T10:12:14.178670+0000","last_peered":"2023-12-12T10:12:14.178670+0000","last_clean":"2023-12-12T10:12:14.178670+0000","last_became_active":"2023-12-12T10:12:09.831596+0000","last_became_peered":"2023-12-12T10:12:09.831596+0000","last_unstale":"2023-12-12T10:12:14.178670+0000","last_undegraded":"2023-12-12T10:12:14.178670+0000","last_fullsized":"2023-12-12T10:12:14.178670+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:29:05.621853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.954769+0000","last_change":"2023-12-12T10:12:09.844712+0000","last_active":"2023-12-12T10:12:13.954769+0000","last_peered":"2023-12-12T10:12:13.954769+0000","last_clean":"2023-12-12T10:12:13.954769+0000","last_became_active":"2023-12-12T10:12:09.843173+0000","last_became_peered":"2023-12-12T10:12:09.843173+0000","last_unstale":"2023-12-12T10:12:13.954769+0000","last_undegraded":"2023-12-12T10:12:13.954769+0000","last_fullsized":"2023-12-12T10:12:13.954769+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:45:57.506196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.955973+0000","last_change":"2023-12-12T10:12:09.833009+0000","last_active":"2023-12-12T10:12:13.955973+0000","last_peered":"2023-12-12T10:12:13.955973+0000","last_clean":"2023-12-12T10:12:13.955973+0000","last_became_active":"2023-12-12T10:12:09.832730+0000","last_became_peered":"2023-12-12T10:12:09.832730+0000","last_unstale":"2023-12-12T10:12:13.955973+0000","last_undegraded":"2023-12-12T10:12:13.955973+0000","last_fullsized":"2023-12-12T10:12:13.955973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:14:22.581107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.962427+0000","last_change":"2023-12-12T10:12:09.832531+0000","last_active":"2023-12-12T10:12:13.962427+0000","last_peered":"2023-12-12T10:12:13.962427+0000","last_clean":"2023-12-12T10:12:13.962427+0000","last_became_active":"2023-12-12T10:12:09.831562+0000","last_became_peered":"2023-12-12T10:12:09.831562+0000","last_unstale":"2023-12-12T10:12:13.962427+0000","last_undegraded":"2023-12-12T10:12:13.962427+0000","last_fullsized":"2023-12-12T10:12:13.962427+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T22:01:05.110732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:14.179520+0000","last_change":"2023-12-12T10:12:09.832536+0000","last_active":"2023-12-12T10:12:14.179520+0000","last_peered":"2023-12-12T10:12:14.179520+0000","last_clean":"2023-12-12T10:12:14.179520+0000","last_became_active":"2023-12-12T10:12:09.832284+0000","last_became_peered":"2023-12-12T10:12:09.832284+0000","last_unstale":"2023-12-12T10:12:14.179520+0000","last_undegraded":"2023-12-12T10:12:14.179520+0000","last_fullsized":"2023-12-12T10:12:14.179520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:03:50.236121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4496,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":47,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":851968,"data_stored":690742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73099999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":258048,"data_stored":99882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.629}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82899999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80500000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":266240,"data_stored":99918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78500000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76900000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81499999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.311}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74099999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":253952,"data_stored":99792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78800000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91400000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":262144,"data_stored":99952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77100000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81499999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":856064,"data_stored":689829,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.318}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3698,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3698,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-12T10:12:28.379 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-12T10:12:28.379 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-12-12T10:12:28.379 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-12-12T10:12:28.379 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-12-12T10:12:28.380 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-12-12T10:12:28.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.546+0000 7faeeea09640 1 Processor -- start 2023-12-12T10:12:28.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.546+0000 7faeeea09640 1 -- start start 2023-12-12T10:12:28.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.546+0000 7faeeea09640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7faee80d3b10 0x7faee80d15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:28.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.546+0000 7faeeea09640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faee80d1ae0 0x7faee80b36e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:28.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.546+0000 7faeeea09640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faee80b3250 con 0x7faee815d3c0 2023-12-12T10:12:28.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.546+0000 7faeeea09640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faee80d1f70 con 0x7faee80d3b10 2023-12-12T10:12:28.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.546+0000 7faeeea09640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faee80cee50 con 0x7faee80d1ae0 2023-12-12T10:12:28.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.546+0000 7faee77fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7faee80d3b10 0x7faee80d15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:28.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.546+0000 7faee77fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7faee80d3b10 0x7faee80d15a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47690/0 (socket says 172.21.15.78:47690) 2023-12-12T10:12:28.554 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.546+0000 7faee77fe640 1 -- 172.21.15.78:0/3747574864 learned_addr learned my addr 172.21.15.78:0/3747574864 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:28.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.546+0000 7faeecfa6640 1 --2- 172.21.15.78:0/3747574864 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faee80d1ae0 0x7faee80b36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:28.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.546+0000 7faee77fe640 1 -- 172.21.15.78:0/3747574864 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faee80d1ae0 msgr2=0x7faee80b36e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:28.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.546+0000 7faee77fe640 1 --2- 172.21.15.78:0/3747574864 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faee80d1ae0 0x7faee80b36e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:28.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.546+0000 7faee77fe640 1 -- 172.21.15.78:0/3747574864 >> v1:172.21.15.187:6789/0 conn(0x7faee815d3c0 legacy=0x7faee80ce670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:28.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.546+0000 7faee77fe640 1 -- 172.21.15.78:0/3747574864 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faee80b2920 con 0x7faee80d3b10 2023-12-12T10:12:28.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.550+0000 7faee77fe640 1 --2- 172.21.15.78:0/3747574864 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faee80d3b10 0x7faee80d15a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7faedc009870 tx=0x7faedc01ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2464e2f0258713c server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:28.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.550+0000 7faee6ffd640 1 -- 172.21.15.78:0/3747574864 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faedc0a8a30 con 0x7faee80d3b10 2023-12-12T10:12:28.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.550+0000 7faee6ffd640 1 -- 172.21.15.78:0/3747574864 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faedc0a8b90 con 0x7faee80d3b10 2023-12-12T10:12:28.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.550+0000 7faee6ffd640 1 -- 172.21.15.78:0/3747574864 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faedc0b0440 con 0x7faee80d3b10 2023-12-12T10:12:28.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.550+0000 7faeeea09640 1 -- 172.21.15.78:0/3747574864 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faee80d3b10 msgr2=0x7faee80d15a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:28.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.550+0000 7faeeea09640 1 --2- 172.21.15.78:0/3747574864 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faee80d3b10 0x7faee80d15a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7faedc009870 tx=0x7faedc01ed30 comp rx=0 tx=0).stop 2023-12-12T10:12:28.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.550+0000 7faeeea09640 1 -- 172.21.15.78:0/3747574864 shutdown_connections 2023-12-12T10:12:28.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.550+0000 7faeeea09640 1 --2- 172.21.15.78:0/3747574864 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faee80d1ae0 0x7faee80b36e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:28.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.550+0000 7faeeea09640 1 --2- 172.21.15.78:0/3747574864 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faee80d3b10 0x7faee80d15a0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:28.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.550+0000 7faeeea09640 1 -- 172.21.15.78:0/3747574864 >> 172.21.15.78:0/3747574864 conn(0x7faee809c2a0 msgr2=0x7faee80d2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:28.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.550+0000 7faeeea09640 1 -- 172.21.15.78:0/3747574864 shutdown_connections 2023-12-12T10:12:28.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.550+0000 7faeeea09640 1 -- 172.21.15.78:0/3747574864 wait complete. 2023-12-12T10:12:28.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.554+0000 7faeeea09640 1 Processor -- start 2023-12-12T10:12:28.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.554+0000 7faeeea09640 1 -- start start 2023-12-12T10:12:28.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.554+0000 7faeeea09640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faee80d1ae0 0x7faee80b73e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:28.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.554+0000 7faeeea09640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faee80d3b10 0x7faee80cc970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:28.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.554+0000 7faeeea09640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faee815d3c0 0x7faee815b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:28.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.554+0000 7faeeea09640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faee80b8a60 con 0x7faee80d1ae0 2023-12-12T10:12:28.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.554+0000 7faeeea09640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faee80b79c0 con 0x7faee815d3c0 2023-12-12T10:12:28.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.554+0000 7faeeea09640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faee80b7ca0 con 0x7faee80d3b10 2023-12-12T10:12:28.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.554+0000 7faee7fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faee80d1ae0 0x7faee80b73e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:28.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.554+0000 7faee7fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faee80d1ae0 0x7faee80b73e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47704/0 (socket says 172.21.15.78:47704) 2023-12-12T10:12:28.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.554+0000 7faee7fff640 1 -- 172.21.15.78:0/4042901531 learned_addr learned my addr 172.21.15.78:0/4042901531 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:28.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.554+0000 7faee77fe640 1 --2- 172.21.15.78:0/4042901531 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faee80d3b10 0x7faee80cc970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:28.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.554+0000 7faeecfa6640 1 --2- 172.21.15.78:0/4042901531 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faee815d3c0 0x7faee815b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:28.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.554+0000 7faee7fff640 1 -- 172.21.15.78:0/4042901531 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faee80d3b10 msgr2=0x7faee80cc970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:28.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.554+0000 7faee7fff640 1 --2- 172.21.15.78:0/4042901531 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faee80d3b10 0x7faee80cc970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:28.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.554+0000 7faee7fff640 1 -- 172.21.15.78:0/4042901531 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faee815d3c0 msgr2=0x7faee815b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:28.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.554+0000 7faee7fff640 1 --2- 172.21.15.78:0/4042901531 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faee815d3c0 0x7faee815b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:28.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.554+0000 7faee7fff640 1 -- 172.21.15.78:0/4042901531 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faedc0094d0 con 0x7faee80d1ae0 2023-12-12T10:12:28.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.554+0000 7faee77fe640 1 --2- 172.21.15.78:0/4042901531 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faee80d3b10 0x7faee80cc970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T10:12:28.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.554+0000 7faee7fff640 1 --2- 172.21.15.78:0/4042901531 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faee80d1ae0 0x7faee80b73e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7faed800c3c0 tx=0x7faed800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:28.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.554+0000 7faee4ff9640 1 -- 172.21.15.78:0/4042901531 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed80052d0 con 0x7faee80d1ae0 2023-12-12T10:12:28.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.554+0000 7faee4ff9640 1 -- 172.21.15.78:0/4042901531 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faed8005430 con 0x7faee80d1ae0 2023-12-12T10:12:28.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.554+0000 7faee4ff9640 1 -- 172.21.15.78:0/4042901531 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed8003840 con 0x7faee80d1ae0 2023-12-12T10:12:28.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.554+0000 7faeeea09640 1 -- 172.21.15.78:0/4042901531 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faee80b7f80 con 0x7faee80d1ae0 2023-12-12T10:12:28.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.554+0000 7faeeea09640 1 -- 172.21.15.78:0/4042901531 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faee80b8540 con 0x7faee80d1ae0 2023-12-12T10:12:28.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.554+0000 7faeeea09640 1 -- 172.21.15.78:0/4042901531 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faee8067530 con 0x7faee80d1ae0 2023-12-12T10:12:28.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.558+0000 7faee4ff9640 1 -- 172.21.15.78:0/4042901531 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7faed80039a0 con 0x7faee80d1ae0 2023-12-12T10:12:28.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.558+0000 7faee4ff9640 1 --2- 172.21.15.78:0/4042901531 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7faed4066470 0x7faed4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:28.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.558+0000 7faee4ff9640 1 -- 172.21.15.78:0/4042901531 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7faed8083760 con 0x7faee80d1ae0 2023-12-12T10:12:28.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.558+0000 7faee77fe640 1 --2- 172.21.15.78:0/4042901531 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7faed4066470 0x7faed4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:28.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.558+0000 7faee77fe640 1 --2- 172.21.15.78:0/4042901531 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7faed4066470 0x7faed4068930 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7faedc0b2000 tx=0x7faedc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:28.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.562+0000 7faee4ff9640 1 -- 172.21.15.78:0/4042901531 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7faed8050850 con 0x7faee80d1ae0 2023-12-12T10:12:28.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.746+0000 7faeeea09640 1 -- 172.21.15.78:0/4042901531 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7faee80b71c0 con 0x7faee80d1ae0 2023-12-12T10:12:28.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.746+0000 7faee4ff9640 1 -- 172.21.15.78:0/4042901531 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+164430 (secure 0 0 0) 0x7faed8053e70 con 0x7faee80d1ae0 2023-12-12T10:12:28.756 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:12:28.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.750+0000 7faeeea09640 1 -- 172.21.15.78:0/4042901531 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7faed4066470 msgr2=0x7faed4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:28.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.750+0000 7faeeea09640 1 --2- 172.21.15.78:0/4042901531 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7faed4066470 0x7faed4068930 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7faedc0b2000 tx=0x7faedc008040 comp rx=0 tx=0).stop 2023-12-12T10:12:28.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.750+0000 7faeeea09640 1 -- 172.21.15.78:0/4042901531 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faee80d1ae0 msgr2=0x7faee80b73e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:28.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.750+0000 7faeeea09640 1 --2- 172.21.15.78:0/4042901531 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faee80d1ae0 0x7faee80b73e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7faed800c3c0 tx=0x7faed800c880 comp rx=0 tx=0).stop 2023-12-12T10:12:28.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.750+0000 7faeeea09640 1 -- 172.21.15.78:0/4042901531 shutdown_connections 2023-12-12T10:12:28.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.750+0000 7faeeea09640 1 --2- 172.21.15.78:0/4042901531 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7faed4066470 0x7faed4068930 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:28.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.750+0000 7faeeea09640 1 --2- 172.21.15.78:0/4042901531 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faee815d3c0 0x7faee815b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:28.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.750+0000 7faeeea09640 1 --2- 172.21.15.78:0/4042901531 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faee80d3b10 0x7faee80cc970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:28.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.750+0000 7faeeea09640 1 --2- 172.21.15.78:0/4042901531 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faee80d1ae0 0x7faee80b73e0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:28.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.750+0000 7faeeea09640 1 -- 172.21.15.78:0/4042901531 >> 172.21.15.78:0/4042901531 conn(0x7faee809c2a0 msgr2=0x7faee80b4e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:28.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.750+0000 7faeeea09640 1 -- 172.21.15.78:0/4042901531 shutdown_connections 2023-12-12T10:12:28.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.750+0000 7faeeea09640 1 -- 172.21.15.78:0/4042901531 wait complete. 2023-12-12T10:12:28.776 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":5,"active_gid":4104,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":1725498448},{"type":"v1","addr":"172.21.15.78:6833","nonce":1725498448}]},"active_addr":"172.21.15.78:6833/1725498448","active_change":"2023-12-12T10:11:48.975698+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4103,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.78:0","nonce":439955068}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.78:0","nonce":1132980508}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.78:0","nonce":2814915213}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.78:0","nonce":722961839}]}]} 2023-12-12T10:12:28.780 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-12-12T10:12:28.780 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-12-12T10:12:28.780 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T10:12:28.918 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.914+0000 7f4fdf59e640 1 Processor -- start 2023-12-12T10:12:28.919 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.914+0000 7f4fdf59e640 1 -- start start 2023-12-12T10:12:28.920 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.914+0000 7f4fdf59e640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4fe015d060 0x7f4fe00d0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:28.921 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.914+0000 7f4fdf59e640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f4fe00d18a0 0x7f4fe00cfdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:28.921 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.914+0000 7f4fdf59e640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fe00d3df0 con 0x7f4fe00d1440 2023-12-12T10:12:28.921 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.914+0000 7f4fdf59e640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fe00cee10 con 0x7f4fe00d18a0 2023-12-12T10:12:28.921 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.914+0000 7f4fdf59e640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fe00ce980 con 0x7f4fe015d060 2023-12-12T10:12:28.921 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.914+0000 7f4fded9d640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f4fe00d18a0 0x7f4fe00cfdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:28.921 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.914+0000 7f4fded9d640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f4fe00d18a0 0x7f4fe00cfdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47716/0 (socket says 172.21.15.78:47716) 2023-12-12T10:12:28.921 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.914+0000 7f4fded9d640 1 -- 172.21.15.78:0/2380517372 learned_addr learned my addr 172.21.15.78:0/2380517372 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:28.921 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.914+0000 7f4fde59c640 1 --2- 172.21.15.78:0/2380517372 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4fe015d060 0x7f4fe00d0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:28.921 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.914+0000 7f4fded9d640 1 -- 172.21.15.78:0/2380517372 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4fe015d060 msgr2=0x7f4fe00d0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:28.921 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.914+0000 7f4fded9d640 1 --2- 172.21.15.78:0/2380517372 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4fe015d060 0x7f4fe00d0ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:28.921 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.914+0000 7f4fded9d640 1 -- 172.21.15.78:0/2380517372 >> v1:172.21.15.78:6789/0 conn(0x7f4fe00d1440 legacy=0x7f4fe00cf6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:28.921 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.914+0000 7f4fded9d640 1 -- 172.21.15.78:0/2380517372 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fe00cdd70 con 0x7f4fe00d18a0 2023-12-12T10:12:28.923 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.918+0000 7f4fded9d640 1 --2- 172.21.15.78:0/2380517372 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4fe00d18a0 0x7f4fe00cfdd0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f4fd8009e50 tx=0x7f4fd801c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf5af07fd95dd679 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:28.923 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.918+0000 7f4fddd9b640 1 -- 172.21.15.78:0/2380517372 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fd80a58a0 con 0x7f4fe00d18a0 2023-12-12T10:12:28.924 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.918+0000 7f4fddd9b640 1 -- 172.21.15.78:0/2380517372 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fd80a5a00 con 0x7f4fe00d18a0 2023-12-12T10:12:28.924 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.918+0000 7f4fddd9b640 1 -- 172.21.15.78:0/2380517372 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fd80a5d90 con 0x7f4fe00d18a0 2023-12-12T10:12:28.924 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.918+0000 7f4fdf59e640 1 -- 172.21.15.78:0/2380517372 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4fe00d18a0 msgr2=0x7f4fe00cfdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:28.924 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.918+0000 7f4fdf59e640 1 --2- 172.21.15.78:0/2380517372 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4fe00d18a0 0x7f4fe00cfdd0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f4fd8009e50 tx=0x7f4fd801c9e0 comp rx=0 tx=0).stop 2023-12-12T10:12:28.924 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.918+0000 7f4fdf59e640 1 -- 172.21.15.78:0/2380517372 shutdown_connections 2023-12-12T10:12:28.925 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.918+0000 7f4fdf59e640 1 --2- 172.21.15.78:0/2380517372 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4fe00d18a0 0x7f4fe00cfdd0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:28.925 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.918+0000 7f4fdf59e640 1 --2- 172.21.15.78:0/2380517372 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4fe015d060 0x7f4fe00d0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:28.925 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.918+0000 7f4fdf59e640 1 -- 172.21.15.78:0/2380517372 >> 172.21.15.78:0/2380517372 conn(0x7f4fe009c160 msgr2=0x7f4fe00d2e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:28.925 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.918+0000 7f4fdf59e640 1 -- 172.21.15.78:0/2380517372 shutdown_connections 2023-12-12T10:12:28.925 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.918+0000 7f4fdf59e640 1 -- 172.21.15.78:0/2380517372 wait complete. 2023-12-12T10:12:28.926 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.918+0000 7f4fdf59e640 1 Processor -- start 2023-12-12T10:12:28.926 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.918+0000 7f4fdf59e640 1 -- start start 2023-12-12T10:12:28.929 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.922+0000 7f4fdf59e640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4fe00d1440 0x7f4fe0152b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:28.929 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.922+0000 7f4fdf59e640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4fe00d18a0 0x7f4fe00c79e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:28.929 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.922+0000 7f4fdf59e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4fe015d060 0x7f4fe015bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:28.929 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.922+0000 7f4fdf59e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fe00c9040 con 0x7f4fe015d060 2023-12-12T10:12:28.929 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.922+0000 7f4fdf59e640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fe00c83c0 con 0x7f4fe00d18a0 2023-12-12T10:12:28.929 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.922+0000 7f4fdf59e640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fe00c86a0 con 0x7f4fe00d1440 2023-12-12T10:12:28.929 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.922+0000 7f4fded9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4fe015d060 0x7f4fe015bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:28.929 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.922+0000 7f4fded9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4fe015d060 0x7f4fe015bc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47732/0 (socket says 172.21.15.78:47732) 2023-12-12T10:12:28.929 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.922+0000 7f4fded9d640 1 -- 172.21.15.78:0/3278893867 learned_addr learned my addr 172.21.15.78:0/3278893867 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:28.930 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.922+0000 7f4fde59c640 1 --2- 172.21.15.78:0/3278893867 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4fe00d1440 0x7f4fe0152b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:28.930 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.922+0000 7f4fd7fff640 1 --2- 172.21.15.78:0/3278893867 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4fe00d18a0 0x7f4fe00c79e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:28.930 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.922+0000 7f4fded9d640 1 -- 172.21.15.78:0/3278893867 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4fe00d1440 msgr2=0x7f4fe0152b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:28.930 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.922+0000 7f4fded9d640 1 --2- 172.21.15.78:0/3278893867 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4fe00d1440 0x7f4fe0152b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:28.930 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.922+0000 7f4fded9d640 1 -- 172.21.15.78:0/3278893867 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4fe00d18a0 msgr2=0x7f4fe00c79e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:28.930 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.922+0000 7f4fded9d640 1 --2- 172.21.15.78:0/3278893867 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4fe00d18a0 0x7f4fe00c79e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:28.930 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.922+0000 7f4fded9d640 1 -- 172.21.15.78:0/3278893867 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fd8009b30 con 0x7f4fe015d060 2023-12-12T10:12:28.930 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.922+0000 7f4fde59c640 1 --2- 172.21.15.78:0/3278893867 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4fe00d1440 0x7f4fe0152b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T10:12:28.930 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.922+0000 7f4fd7fff640 1 --2- 172.21.15.78:0/3278893867 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4fe00d18a0 0x7f4fe00c79e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T10:12:28.930 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.922+0000 7f4fded9d640 1 --2- 172.21.15.78:0/3278893867 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4fe015d060 0x7f4fe015bc30 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f4fd80af040 tx=0x7f4fd8019780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:28.930 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.922+0000 7f4fd6ffd640 1 -- 172.21.15.78:0/3278893867 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fd80b8670 con 0x7f4fe015d060 2023-12-12T10:12:28.930 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.922+0000 7f4fd6ffd640 1 -- 172.21.15.78:0/3278893867 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fd80b87d0 con 0x7f4fe015d060 2023-12-12T10:12:28.931 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.922+0000 7f4fdf59e640 1 -- 172.21.15.78:0/3278893867 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fe00c8980 con 0x7f4fe015d060 2023-12-12T10:12:28.931 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.922+0000 7f4fd6ffd640 1 -- 172.21.15.78:0/3278893867 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fd80b8b80 con 0x7f4fe015d060 2023-12-12T10:12:28.931 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.922+0000 7f4fdf59e640 1 -- 172.21.15.78:0/3278893867 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fe00c9460 con 0x7f4fe015d060 2023-12-12T10:12:28.932 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.922+0000 7f4fdf59e640 1 -- 172.21.15.78:0/3278893867 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fe00c9180 con 0x7f4fe015d060 2023-12-12T10:12:28.932 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.926+0000 7f4fd6ffd640 1 -- 172.21.15.78:0/3278893867 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4fd80b8ce0 con 0x7f4fe015d060 2023-12-12T10:12:28.932 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.926+0000 7f4fd6ffd640 1 --2- 172.21.15.78:0/3278893867 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f4fc00664a0 0x7f4fc0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:28.932 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.926+0000 7f4fd6ffd640 1 -- 172.21.15.78:0/3278893867 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4fd811f540 con 0x7f4fe015d060 2023-12-12T10:12:28.932 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.926+0000 7f4fde59c640 1 --2- 172.21.15.78:0/3278893867 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f4fc00664a0 0x7f4fc0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:28.932 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.926+0000 7f4fde59c640 1 --2- 172.21.15.78:0/3278893867 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f4fc00664a0 0x7f4fc0068960 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4fd0009a40 tx=0x7f4fd0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:28.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:28.930+0000 7f4fd6ffd640 1 -- 172.21.15.78:0/3278893867 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4fe00c9180 con 0x7f4fe015d060 2023-12-12T10:12:29.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.082+0000 7f4fdf59e640 1 -- 172.21.15.78:0/3278893867 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4fe00c9180 con 0x7f4fe015d060 2023-12-12T10:12:29.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.086+0000 7f4fd6ffd640 1 -- 172.21.15.78:0/3278893867 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18310 (secure 0 0 0) 0x7f4fe00c9180 con 0x7f4fe015d060 2023-12-12T10:12:29.091 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:12:29.091 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":24,"fsid":"fc81937c-bd26-483c-952b-d1324fcb0c9e","created":"2023-12-12T10:11:44.020214+0000","modified":"2023-12-12T10:12:14.355146+0000","last_up_change":"2023-12-12T10:11:56.278318+0000","last_in_change":"2023-12-12T10:11:46.553610+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T10:11:57.053584+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-12T10:12:07.454450+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-12T10:12:08.182909+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-12T10:12:11.977952+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"22dfdedf-5f6c-4b20-9f6c-30517a1db70a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6809","nonce":3345683600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6811","nonce":3345683600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6815","nonce":3345683600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6813","nonce":3345683600}]},"public_addr":"172.21.15.78:6809/3345683600","cluster_addr":"172.21.15.78:6811/3345683600","heartbeat_back_addr":"172.21.15.78:6815/3345683600","heartbeat_front_addr":"172.21.15.78:6813/3345683600","state":["exists","up"]},{"osd":1,"uuid":"be34a7f3-a69a-462e-9ddf-5e537448dba2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6801","nonce":962652768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6803","nonce":962652768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6807","nonce":962652768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6805","nonce":962652768}]},"public_addr":"172.21.15.78:6801/962652768","cluster_addr":"172.21.15.78:6803/962652768","heartbeat_back_addr":"172.21.15.78:6807/962652768","heartbeat_front_addr":"172.21.15.78:6805/962652768","state":["exists","up"]},{"osd":2,"uuid":"55b381de-5f56-4b14-80f7-e6e41e084a13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6818","nonce":2910206054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6822","nonce":2910206054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6829","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6831","nonce":2910206054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6826","nonce":2910206054}]},"public_addr":"172.21.15.78:6818/2910206054","cluster_addr":"172.21.15.78:6822/2910206054","heartbeat_back_addr":"172.21.15.78:6831/2910206054","heartbeat_front_addr":"172.21.15.78:6826/2910206054","state":["exists","up"]},{"osd":3,"uuid":"d7682de1-25cb-4cec-869f-8851c28b0e6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6819","nonce":3750796703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6821","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6823","nonce":3750796703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6830","nonce":3750796703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6825","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6827","nonce":3750796703}]},"public_addr":"172.21.15.78:6819/3750796703","cluster_addr":"172.21.15.78:6823/3750796703","heartbeat_back_addr":"172.21.15.78:6830/3750796703","heartbeat_front_addr":"172.21.15.78:6827/3750796703","state":["exists","up"]},{"osd":4,"uuid":"8279815a-d6c7-4199-871e-d28971b9dc07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6809","nonce":2944277204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6811","nonce":2944277204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6815","nonce":2944277204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6813","nonce":2944277204}]},"public_addr":"172.21.15.187:6809/2944277204","cluster_addr":"172.21.15.187:6811/2944277204","heartbeat_back_addr":"172.21.15.187:6815/2944277204","heartbeat_front_addr":"172.21.15.187:6813/2944277204","state":["exists","up"]},{"osd":5,"uuid":"0a714c65-f8ce-4340-968f-11a799677ef3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6801","nonce":185858620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6803","nonce":185858620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6807","nonce":185858620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6805","nonce":185858620}]},"public_addr":"172.21.15.187:6801/185858620","cluster_addr":"172.21.15.187:6803/185858620","heartbeat_back_addr":"172.21.15.187:6807/185858620","heartbeat_front_addr":"172.21.15.187:6805/185858620","state":["exists","up"]},{"osd":6,"uuid":"d0bba9ab-f7ee-449e-8999-1c0cf7e6d53c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6817","nonce":4213392126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6819","nonce":4213392126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6824","nonce":4213392126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6821","nonce":4213392126}]},"public_addr":"172.21.15.187:6817/4213392126","cluster_addr":"172.21.15.187:6819/4213392126","heartbeat_back_addr":"172.21.15.187:6824/4213392126","heartbeat_front_addr":"172.21.15.187:6821/4213392126","state":["exists","up"]},{"osd":7,"uuid":"efe5e0d9-2f87-4889-a27a-e2a95a632302","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6823","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6825","nonce":85774004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6827","nonce":85774004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6831","nonce":85774004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6829","nonce":85774004}]},"public_addr":"172.21.15.187:6825/85774004","cluster_addr":"172.21.15.187:6827/85774004","heartbeat_back_addr":"172.21.15.187:6831/85774004","heartbeat_front_addr":"172.21.15.187:6829/85774004","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.214447+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.448899+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.293107+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.564184+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.175026+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.097717+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.261141+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.287681+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T10:12:29.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.086+0000 7f4fdf59e640 1 -- 172.21.15.78:0/3278893867 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f4fc00664a0 msgr2=0x7f4fc0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:29.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.086+0000 7f4fdf59e640 1 --2- 172.21.15.78:0/3278893867 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f4fc00664a0 0x7f4fc0068960 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4fd0009a40 tx=0x7f4fd0008040 comp rx=0 tx=0).stop 2023-12-12T10:12:29.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.086+0000 7f4fdf59e640 1 -- 172.21.15.78:0/3278893867 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4fe015d060 msgr2=0x7f4fe015bc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:29.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.086+0000 7f4fdf59e640 1 --2- 172.21.15.78:0/3278893867 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4fe015d060 0x7f4fe015bc30 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f4fd80af040 tx=0x7f4fd8019780 comp rx=0 tx=0).stop 2023-12-12T10:12:29.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.086+0000 7f4fdf59e640 1 -- 172.21.15.78:0/3278893867 shutdown_connections 2023-12-12T10:12:29.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.086+0000 7f4fdf59e640 1 --2- 172.21.15.78:0/3278893867 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f4fc00664a0 0x7f4fc0068960 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:29.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.086+0000 7f4fdf59e640 1 --2- 172.21.15.78:0/3278893867 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4fe015d060 0x7f4fe015bc30 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:29.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.086+0000 7f4fdf59e640 1 --2- 172.21.15.78:0/3278893867 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4fe00d18a0 0x7f4fe00c79e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:29.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.086+0000 7f4fdf59e640 1 --2- 172.21.15.78:0/3278893867 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4fe00d1440 0x7f4fe0152b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:29.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.086+0000 7f4fdf59e640 1 -- 172.21.15.78:0/3278893867 >> 172.21.15.78:0/3278893867 conn(0x7f4fe009c160 msgr2=0x7f4fe006c540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:29.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.086+0000 7f4fdf59e640 1 -- 172.21.15.78:0/3278893867 shutdown_connections 2023-12-12T10:12:29.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.086+0000 7f4fdf59e640 1 -- 172.21.15.78:0/3278893867 wait complete. 2023-12-12T10:12:29.112 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-12-12T10:12:29.112 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T10:12:29.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.242+0000 7fd4055e7640 1 Processor -- start 2023-12-12T10:12:29.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.242+0000 7fd4055e7640 1 -- start start 2023-12-12T10:12:29.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.246+0000 7fd4055e7640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fd4000b3ba0 0x7fd4000d0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:29.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.246+0000 7fd4055e7640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4000cefc0 con 0x7fd4000b3490 2023-12-12T10:12:29.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.246+0000 7fd4055e7640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4000ce760 con 0x7fd4000d1d00 2023-12-12T10:12:29.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.246+0000 7fd4055e7640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4000cea00 con 0x7fd4000b3ba0 2023-12-12T10:12:29.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.246+0000 7fd3feffd640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fd4000b3490 0x7fd4000d15f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:34212/0 (socket says 172.21.15.78:34212) 2023-12-12T10:12:29.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.246+0000 7fd3feffd640 1 -- 172.21.15.78:0/1914854696 learned_addr learned my addr 172.21.15.78:0/1914854696 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-12-12T10:12:29.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.246+0000 7fd3ff7fe640 1 --2- 172.21.15.78:0/1914854696 >> v2:172.21.15.187:3300/0 conn(0x7fd4000b3ba0 0x7fd4000d0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:29.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.246+0000 7fd3fdffb640 1 -- 172.21.15.78:0/1914854696 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3802463150 0 0) 0x7fd4000cefc0 con 0x7fd4000b3490 2023-12-12T10:12:29.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.246+0000 7fd3fdffb640 1 -- 172.21.15.78:0/1914854696 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3e8003530 con 0x7fd4000b3490 2023-12-12T10:12:29.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.246+0000 7fd3fdffb640 1 -- 172.21.15.78:0/1914854696 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1960393291 0 0) 0x7fd3e8003530 con 0x7fd4000b3490 2023-12-12T10:12:29.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.246+0000 7fd3ff7fe640 1 -- 172.21.15.78:0/1914854696 >> v1:172.21.15.187:6789/0 conn(0x7fd4000d1d00 legacy=0x7fd4000b61d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:29.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.246+0000 7fd3ff7fe640 1 -- 172.21.15.78:0/1914854696 >> v1:172.21.15.78:6789/0 conn(0x7fd4000b3490 legacy=0x7fd4000d15f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:29.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.246+0000 7fd3ff7fe640 1 -- 172.21.15.78:0/1914854696 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4000cece0 con 0x7fd4000b3ba0 2023-12-12T10:12:29.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.250+0000 7fd3ff7fe640 1 --2- 172.21.15.78:0/1914854696 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd4000b3ba0 0x7fd4000d0df0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd3f8009d90 tx=0x7fd3f801d240 comp rx=0 tx=0).ready entity=mon.1 client_cookie=628f2317bc56d8a2 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:29.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.250+0000 7fd3fdffb640 1 -- 172.21.15.78:0/1914854696 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3f0001680 con 0x7fd4000b3ba0 2023-12-12T10:12:29.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.250+0000 7fd3fdffb640 1 -- 172.21.15.78:0/1914854696 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3f80a5640 con 0x7fd4000b3ba0 2023-12-12T10:12:29.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.250+0000 7fd3fdffb640 1 -- 172.21.15.78:0/1914854696 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3f80a59d0 con 0x7fd4000b3ba0 2023-12-12T10:12:29.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.250+0000 7fd4055e7640 1 -- 172.21.15.78:0/1914854696 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd4000b3ba0 msgr2=0x7fd4000d0df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:29.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.250+0000 7fd4055e7640 1 --2- 172.21.15.78:0/1914854696 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd4000b3ba0 0x7fd4000d0df0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd3f8009d90 tx=0x7fd3f801d240 comp rx=0 tx=0).stop 2023-12-12T10:12:29.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.250+0000 7fd4055e7640 1 -- 172.21.15.78:0/1914854696 shutdown_connections 2023-12-12T10:12:29.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.250+0000 7fd4055e7640 1 --2- 172.21.15.78:0/1914854696 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd4000b3ba0 0x7fd4000d0df0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:29.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.250+0000 7fd4055e7640 1 -- 172.21.15.78:0/1914854696 >> 172.21.15.78:0/1914854696 conn(0x7fd4000d3010 msgr2=0x7fd4000d33f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:29.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.250+0000 7fd4055e7640 1 -- 172.21.15.78:0/1914854696 shutdown_connections 2023-12-12T10:12:29.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.250+0000 7fd4055e7640 1 -- 172.21.15.78:0/1914854696 wait complete. 2023-12-12T10:12:29.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.250+0000 7fd4055e7640 1 Processor -- start 2023-12-12T10:12:29.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.250+0000 7fd4055e7640 1 -- start start 2023-12-12T10:12:29.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.254+0000 7fd4055e7640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd4000b3490 0x7fd40006c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:29.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.254+0000 7fd4055e7640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd4000b3ba0 0x7fd40014c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:29.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.254+0000 7fd4055e7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd4000d1d00 0x7fd40014c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:29.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.254+0000 7fd4055e7640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4000b1fa0 con 0x7fd4000d1d00 2023-12-12T10:12:29.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.254+0000 7fd4055e7640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4000b2210 con 0x7fd4000b3490 2023-12-12T10:12:29.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.254+0000 7fd4055e7640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4000b24f0 con 0x7fd4000b3ba0 2023-12-12T10:12:29.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.254+0000 7fd3ff7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd4000d1d00 0x7fd40014c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:29.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.254+0000 7fd3ff7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd4000d1d00 0x7fd40014c7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:36834/0 (socket says 172.21.15.78:36834) 2023-12-12T10:12:29.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.254+0000 7fd3ff7fe640 1 -- 172.21.15.78:0/2183006810 learned_addr learned my addr 172.21.15.78:0/2183006810 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:29.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.254+0000 7fd3feffd640 1 --2- 172.21.15.78:0/2183006810 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd4000b3490 0x7fd40006c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:29.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.254+0000 7fd3fe7fc640 1 --2- 172.21.15.78:0/2183006810 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd4000b3ba0 0x7fd40014c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:29.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.254+0000 7fd3ff7fe640 1 -- 172.21.15.78:0/2183006810 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd4000b3ba0 msgr2=0x7fd40014c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:29.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.254+0000 7fd3ff7fe640 1 --2- 172.21.15.78:0/2183006810 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd4000b3ba0 0x7fd40014c260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:29.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.254+0000 7fd3ff7fe640 1 -- 172.21.15.78:0/2183006810 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd4000b3490 msgr2=0x7fd40006c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:29.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.254+0000 7fd3ff7fe640 1 --2- 172.21.15.78:0/2183006810 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd4000b3490 0x7fd40006c5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:29.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.254+0000 7fd3ff7fe640 1 -- 172.21.15.78:0/2183006810 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3f8009a70 con 0x7fd4000d1d00 2023-12-12T10:12:29.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.254+0000 7fd3fe7fc640 1 --2- 172.21.15.78:0/2183006810 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd4000b3ba0 0x7fd40014c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T10:12:29.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.254+0000 7fd3ff7fe640 1 --2- 172.21.15.78:0/2183006810 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd4000d1d00 0x7fd40014c7a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd3f801ae90 tx=0x7fd3f8019580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:29.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.254+0000 7fd3e77fe640 1 -- 172.21.15.78:0/2183006810 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3f8003ba0 con 0x7fd4000d1d00 2023-12-12T10:12:29.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.254+0000 7fd3e77fe640 1 -- 172.21.15.78:0/2183006810 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3f8003d00 con 0x7fd4000d1d00 2023-12-12T10:12:29.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.254+0000 7fd3e77fe640 1 -- 172.21.15.78:0/2183006810 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3f80ad890 con 0x7fd4000d1d00 2023-12-12T10:12:29.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.254+0000 7fd4055e7640 1 -- 172.21.15.78:0/2183006810 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4000b27d0 con 0x7fd4000d1d00 2023-12-12T10:12:29.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.254+0000 7fd4055e7640 1 -- 172.21.15.78:0/2183006810 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd400160020 con 0x7fd4000d1d00 2023-12-12T10:12:29.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.254+0000 7fd4055e7640 1 -- 172.21.15.78:0/2183006810 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4000671f0 con 0x7fd4000d1d00 2023-12-12T10:12:29.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.258+0000 7fd3e77fe640 1 -- 172.21.15.78:0/2183006810 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd3f80b4040 con 0x7fd4000d1d00 2023-12-12T10:12:29.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.258+0000 7fd3e77fe640 1 --2- 172.21.15.78:0/2183006810 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fd3ec066470 0x7fd3ec068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:29.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.258+0000 7fd3e77fe640 1 -- 172.21.15.78:0/2183006810 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd3f811e470 con 0x7fd4000d1d00 2023-12-12T10:12:29.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.258+0000 7fd3feffd640 1 --2- 172.21.15.78:0/2183006810 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fd3ec066470 0x7fd3ec068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:29.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.258+0000 7fd3feffd640 1 --2- 172.21.15.78:0/2183006810 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fd3ec066470 0x7fd3ec068930 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd3f0000f70 tx=0x7fd3f0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:29.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.262+0000 7fd3e77fe640 1 -- 172.21.15.78:0/2183006810 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd3f80eb6a0 con 0x7fd4000d1d00 2023-12-12T10:12:29.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.410+0000 7fd4055e7640 1 -- 172.21.15.78:0/2183006810 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd400067530 con 0x7fd4000d1d00 2023-12-12T10:12:29.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.410+0000 7fd3e77fe640 1 -- 172.21.15.78:0/2183006810 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18310 (secure 0 0 0) 0x7fd3f8009450 con 0x7fd4000d1d00 2023-12-12T10:12:29.419 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:12:29.419 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":24,"fsid":"fc81937c-bd26-483c-952b-d1324fcb0c9e","created":"2023-12-12T10:11:44.020214+0000","modified":"2023-12-12T10:12:14.355146+0000","last_up_change":"2023-12-12T10:11:56.278318+0000","last_in_change":"2023-12-12T10:11:46.553610+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T10:11:57.053584+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-12T10:12:07.454450+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-12T10:12:08.182909+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-12T10:12:11.977952+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"22dfdedf-5f6c-4b20-9f6c-30517a1db70a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6809","nonce":3345683600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6811","nonce":3345683600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6815","nonce":3345683600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6813","nonce":3345683600}]},"public_addr":"172.21.15.78:6809/3345683600","cluster_addr":"172.21.15.78:6811/3345683600","heartbeat_back_addr":"172.21.15.78:6815/3345683600","heartbeat_front_addr":"172.21.15.78:6813/3345683600","state":["exists","up"]},{"osd":1,"uuid":"be34a7f3-a69a-462e-9ddf-5e537448dba2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6801","nonce":962652768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6803","nonce":962652768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6807","nonce":962652768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6805","nonce":962652768}]},"public_addr":"172.21.15.78:6801/962652768","cluster_addr":"172.21.15.78:6803/962652768","heartbeat_back_addr":"172.21.15.78:6807/962652768","heartbeat_front_addr":"172.21.15.78:6805/962652768","state":["exists","up"]},{"osd":2,"uuid":"55b381de-5f56-4b14-80f7-e6e41e084a13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6818","nonce":2910206054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6822","nonce":2910206054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6829","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6831","nonce":2910206054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6826","nonce":2910206054}]},"public_addr":"172.21.15.78:6818/2910206054","cluster_addr":"172.21.15.78:6822/2910206054","heartbeat_back_addr":"172.21.15.78:6831/2910206054","heartbeat_front_addr":"172.21.15.78:6826/2910206054","state":["exists","up"]},{"osd":3,"uuid":"d7682de1-25cb-4cec-869f-8851c28b0e6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6819","nonce":3750796703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6821","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6823","nonce":3750796703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6830","nonce":3750796703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6825","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6827","nonce":3750796703}]},"public_addr":"172.21.15.78:6819/3750796703","cluster_addr":"172.21.15.78:6823/3750796703","heartbeat_back_addr":"172.21.15.78:6830/3750796703","heartbeat_front_addr":"172.21.15.78:6827/3750796703","state":["exists","up"]},{"osd":4,"uuid":"8279815a-d6c7-4199-871e-d28971b9dc07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6809","nonce":2944277204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6811","nonce":2944277204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6815","nonce":2944277204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6813","nonce":2944277204}]},"public_addr":"172.21.15.187:6809/2944277204","cluster_addr":"172.21.15.187:6811/2944277204","heartbeat_back_addr":"172.21.15.187:6815/2944277204","heartbeat_front_addr":"172.21.15.187:6813/2944277204","state":["exists","up"]},{"osd":5,"uuid":"0a714c65-f8ce-4340-968f-11a799677ef3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6801","nonce":185858620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6803","nonce":185858620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6807","nonce":185858620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6805","nonce":185858620}]},"public_addr":"172.21.15.187:6801/185858620","cluster_addr":"172.21.15.187:6803/185858620","heartbeat_back_addr":"172.21.15.187:6807/185858620","heartbeat_front_addr":"172.21.15.187:6805/185858620","state":["exists","up"]},{"osd":6,"uuid":"d0bba9ab-f7ee-449e-8999-1c0cf7e6d53c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6817","nonce":4213392126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6819","nonce":4213392126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6824","nonce":4213392126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6821","nonce":4213392126}]},"public_addr":"172.21.15.187:6817/4213392126","cluster_addr":"172.21.15.187:6819/4213392126","heartbeat_back_addr":"172.21.15.187:6824/4213392126","heartbeat_front_addr":"172.21.15.187:6821/4213392126","state":["exists","up"]},{"osd":7,"uuid":"efe5e0d9-2f87-4889-a27a-e2a95a632302","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6823","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6825","nonce":85774004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6827","nonce":85774004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6831","nonce":85774004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6829","nonce":85774004}]},"public_addr":"172.21.15.187:6825/85774004","cluster_addr":"172.21.15.187:6827/85774004","heartbeat_back_addr":"172.21.15.187:6831/85774004","heartbeat_front_addr":"172.21.15.187:6829/85774004","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.214447+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.448899+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.293107+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.564184+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.175026+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.097717+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.261141+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.287681+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T10:12:29.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.414+0000 7fd4055e7640 1 -- 172.21.15.78:0/2183006810 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fd3ec066470 msgr2=0x7fd3ec068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:29.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.414+0000 7fd4055e7640 1 --2- 172.21.15.78:0/2183006810 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fd3ec066470 0x7fd3ec068930 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd3f0000f70 tx=0x7fd3f0009040 comp rx=0 tx=0).stop 2023-12-12T10:12:29.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.414+0000 7fd4055e7640 1 -- 172.21.15.78:0/2183006810 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd4000d1d00 msgr2=0x7fd40014c7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:29.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.414+0000 7fd4055e7640 1 --2- 172.21.15.78:0/2183006810 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd4000d1d00 0x7fd40014c7a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd3f801ae90 tx=0x7fd3f8019580 comp rx=0 tx=0).stop 2023-12-12T10:12:29.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.414+0000 7fd4055e7640 1 -- 172.21.15.78:0/2183006810 shutdown_connections 2023-12-12T10:12:29.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.414+0000 7fd4055e7640 1 --2- 172.21.15.78:0/2183006810 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fd3ec066470 0x7fd3ec068930 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:29.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.414+0000 7fd4055e7640 1 --2- 172.21.15.78:0/2183006810 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd4000d1d00 0x7fd40014c7a0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:29.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.414+0000 7fd4055e7640 1 --2- 172.21.15.78:0/2183006810 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd4000b3ba0 0x7fd40014c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:29.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.414+0000 7fd4055e7640 1 --2- 172.21.15.78:0/2183006810 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd4000b3490 0x7fd40006c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:29.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.414+0000 7fd4055e7640 1 -- 172.21.15.78:0/2183006810 >> 172.21.15.78:0/2183006810 conn(0x7fd4000d3010 msgr2=0x7fd4000b7660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:29.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.414+0000 7fd4055e7640 1 -- 172.21.15.78:0/2183006810 shutdown_connections 2023-12-12T10:12:29.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.414+0000 7fd4055e7640 1 -- 172.21.15.78:0/2183006810 wait complete. 2023-12-12T10:12:29.440 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-12-12T10:12:29.441 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-12-12T10:12:29.441 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-12-12T10:12:29.441 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-12-12T10:12:29.442 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-12-12T10:12:29.442 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-12-12T10:12:29.443 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-12-12T10:12:29.443 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-12-12T10:12:29.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.674+0000 7f496b357640 1 Processor -- start 2023-12-12T10:12:29.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.674+0000 7f496b357640 1 -- start start 2023-12-12T10:12:29.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.674+0000 7f496b357640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4964156be0 0x7f496415d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:29.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.674+0000 7f496b357640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f496415cba0 con 0x7f49640b2f30 2023-12-12T10:12:29.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.674+0000 7f496b357640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49640709d0 con 0x7f4964071e20 2023-12-12T10:12:29.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.674+0000 7f496b357640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4964156fc0 con 0x7f4964156be0 2023-12-12T10:12:29.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.678+0000 7f49690f3640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4964156be0 0x7f496415d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:29.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.678+0000 7f49698f4640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f49640b2f30 0x7f49641595b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:34218/0 (socket says 172.21.15.78:34218) 2023-12-12T10:12:29.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.678+0000 7f49698f4640 1 -- 172.21.15.78:0/3381315546 learned_addr learned my addr 172.21.15.78:0/3381315546 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-12-12T10:12:29.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.678+0000 7f495bfff640 1 -- 172.21.15.78:0/3381315546 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2596482993 0 0) 0x7f496415cba0 con 0x7f49640b2f30 2023-12-12T10:12:29.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.678+0000 7f495bfff640 1 -- 172.21.15.78:0/3381315546 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4950005740 con 0x7f49640b2f30 2023-12-12T10:12:29.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.678+0000 7f495bfff640 1 -- 172.21.15.78:0/3381315546 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 584770793 0 0) 0x7f49640709d0 con 0x7f4964071e20 2023-12-12T10:12:29.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.678+0000 7f49690f3640 1 -- 172.21.15.78:0/3381315546 >> v1:172.21.15.187:6789/0 conn(0x7f4964071e20 legacy=0x7f49640702c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:29.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.678+0000 7f49690f3640 1 -- 172.21.15.78:0/3381315546 >> v1:172.21.15.78:6789/0 conn(0x7f49640b2f30 legacy=0x7f49641595b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:29.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.678+0000 7f49690f3640 1 -- 172.21.15.78:0/3381315546 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4964070c80 con 0x7f4964156be0 2023-12-12T10:12:29.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.678+0000 7f9a42805640 1 Processor -- start 2023-12-12T10:12:29.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.678+0000 7f9a42805640 1 -- start start 2023-12-12T10:12:29.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.682+0000 7f65a5a5a640 1 Processor -- start 2023-12-12T10:12:29.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.682+0000 7f9a42805640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f9a3c0b2f30 0x7f9a3c0b3370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:29.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.682+0000 7f9a42805640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a3c0cc2f0 con 0x7f9a3c1613a0 2023-12-12T10:12:29.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.682+0000 7f9a42805640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a3c0b38b0 con 0x7f9a3c0cc720 2023-12-12T10:12:29.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.682+0000 7f9a42805640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a3c0710e0 con 0x7f9a3c0b2f30 2023-12-12T10:12:29.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.682+0000 7f49690f3640 1 --2- 172.21.15.78:0/3381315546 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4964156be0 0x7f496415d5f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f49600097f0 tx=0x7f496001c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=511ccb50ae5e5091 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:29.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.682+0000 7f65a5a5a640 1 -- start start 2023-12-12T10:12:29.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.682+0000 7f9a3bfff640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f9a3c1613a0 0x7f9a3c071460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:34234/0 (socket says 172.21.15.78:34234) 2023-12-12T10:12:29.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.682+0000 7f9a3bfff640 1 -- 172.21.15.78:0/1387966792 learned_addr learned my addr 172.21.15.78:0/1387966792 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-12-12T10:12:29.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.682+0000 7f9a40da2640 1 --1- 172.21.15.78:0/1387966792 >> v1:172.21.15.187:6789/0 conn(0x7f9a3c0cc720 0x7f9a3c0ccb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.78:51584/0 (socket says 172.21.15.78:51584) 2023-12-12T10:12:29.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.682+0000 7f495bfff640 1 -- 172.21.15.78:0/3381315546 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49600ac620 con 0x7f4964156be0 2023-12-12T10:12:29.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.682+0000 7f495bfff640 1 -- 172.21.15.78:0/3381315546 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49600ac780 con 0x7f4964156be0 2023-12-12T10:12:29.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.682+0000 7f495bfff640 1 -- 172.21.15.78:0/3381315546 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49600acb10 con 0x7f4964156be0 2023-12-12T10:12:29.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.682+0000 7f9a3b7fe640 1 --2- 172.21.15.78:0/1387966792 >> v2:172.21.15.187:3300/0 conn(0x7f9a3c0b2f30 0x7f9a3c0b3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:29.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.682+0000 7f9a3affd640 1 -- 172.21.15.78:0/1387966792 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1808658442 0 0) 0x7f9a3c0b38b0 con 0x7f9a3c0cc720 2023-12-12T10:12:29.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.682+0000 7f496b357640 1 -- 172.21.15.78:0/3381315546 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4964156be0 msgr2=0x7f496415d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:29.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.682+0000 7f496b357640 1 --2- 172.21.15.78:0/3381315546 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4964156be0 0x7f496415d5f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f49600097f0 tx=0x7f496001c3c0 comp rx=0 tx=0).stop 2023-12-12T10:12:29.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.682+0000 7f496b357640 1 -- 172.21.15.78:0/3381315546 shutdown_connections 2023-12-12T10:12:29.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.682+0000 7f496b357640 1 --2- 172.21.15.78:0/3381315546 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4964156be0 0x7f496415d5f0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:29.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.682+0000 7f496b357640 1 -- 172.21.15.78:0/3381315546 >> 172.21.15.78:0/3381315546 conn(0x7f49640b0b20 msgr2=0x7f49640b0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:29.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.686+0000 7f9a3affd640 1 -- 172.21.15.78:0/1387966792 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a28003530 con 0x7f9a3c0cc720 2023-12-12T10:12:29.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.682+0000 7f65a5a5a640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f65a0142890 0x7f65a015caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:29.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.682+0000 7f65a5a5a640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f65a0159f30 0x7f65a0070100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:29.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.682+0000 7f65a5a5a640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65a015a3c0 con 0x7f65a0070640 2023-12-12T10:12:29.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.686+0000 7f65a5a5a640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65a015d9d0 con 0x7f65a0159f30 2023-12-12T10:12:29.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.686+0000 7f65a5a5a640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65a0070a60 con 0x7f65a0142890 2023-12-12T10:12:29.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.686+0000 7f9a3affd640 1 -- 172.21.15.78:0/1387966792 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2702144444 0 0) 0x7f9a3c0cc2f0 con 0x7f9a3c1613a0 2023-12-12T10:12:29.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.686+0000 7f9a3affd640 1 -- 172.21.15.78:0/1387966792 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a3c0b38b0 con 0x7f9a3c1613a0 2023-12-12T10:12:29.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.686+0000 7f9a3affd640 1 -- 172.21.15.78:0/1387966792 <== mon.1 v1:172.21.15.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1548787918 0 0) 0x7f9a28003530 con 0x7f9a3c0cc720 2023-12-12T10:12:29.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.686+0000 7f9a3affd640 1 -- 172.21.15.78:0/1387966792 >> v2:172.21.15.187:3300/0 conn(0x7f9a3c0b2f30 msgr2=0x7f9a3c0b3370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:29.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.686+0000 7f9a3affd640 1 --2- 172.21.15.78:0/1387966792 >> v2:172.21.15.187:3300/0 conn(0x7f9a3c0b2f30 0x7f9a3c0b3370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:29.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.686+0000 7f9a3affd640 1 -- 172.21.15.78:0/1387966792 >> v1:172.21.15.78:6789/0 conn(0x7f9a3c1613a0 legacy=0x7f9a3c071460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:29.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.686+0000 7f9a3affd640 1 -- 172.21.15.78:0/1387966792 --> v1:172.21.15.187:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a3c0702c0 con 0x7f9a3c0cc720 2023-12-12T10:12:29.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.686+0000 7f9a3affd640 1 -- 172.21.15.78:0/1387966792 <== mon.1 v1:172.21.15.187:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 465499599 0 0) 0x7f9a240015b0 con 0x7f9a3c0cc720 2023-12-12T10:12:29.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.686+0000 7f659f7fe640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f65a0070640 0x7f65a006c160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.78:51586/0 (socket says 172.21.15.78:51586) 2023-12-12T10:12:29.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.686+0000 7f659f7fe640 1 -- 172.21.15.78:0/1062143477 learned_addr learned my addr 172.21.15.78:0/1062143477 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-12-12T10:12:29.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.686+0000 7f9a3affd640 1 -- 172.21.15.78:0/1387966792 >> v1:172.21.15.187:6789/0 conn(0x7f9a3c0cc720 legacy=0x7f9a3c0ccb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:29.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.686+0000 7f9a3affd640 1 --2- 172.21.15.78:0/1387966792 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9a28003bb0 0x7f9a28003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:29.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.686+0000 7f9a3affd640 1 --2- 172.21.15.78:0/1387966792 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9a280047d0 0x7f9a28004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:29.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.686+0000 7f9a3affd640 1 --2- 172.21.15.78:0/1387966792 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9a28005190 0x7f9a2800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:29.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.686+0000 7f9a3affd640 1 -- 172.21.15.78:0/1387966792 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a3c0710e0 con 0x7f9a28003bb0 2023-12-12T10:12:29.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.686+0000 7f9a3affd640 1 -- 172.21.15.78:0/1387966792 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a2800c0c0 con 0x7f9a28005190 2023-12-12T10:12:29.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.686+0000 7f9a3affd640 1 -- 172.21.15.78:0/1387966792 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a2800c280 con 0x7f9a280047d0 2023-12-12T10:12:29.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.686+0000 7f496b357640 1 -- 172.21.15.78:0/3381315546 shutdown_connections 2023-12-12T10:12:29.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.686+0000 7f496b357640 1 -- 172.21.15.78:0/3381315546 wait complete. 2023-12-12T10:12:29.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.686+0000 7f9a3bfff640 1 --2- 172.21.15.78:0/1387966792 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9a28003bb0 0x7f9a28003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:29.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.686+0000 7f9a3bfff640 1 -- 172.21.15.78:0/1387966792 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9a280047d0 msgr2=0x7f9a28004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:29.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.686+0000 7f9a3bfff640 1 --2- 172.21.15.78:0/1387966792 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9a280047d0 0x7f9a28004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:29.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.686+0000 7f9a3bfff640 1 -- 172.21.15.78:0/1387966792 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9a28005190 msgr2=0x7f9a2800b990 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-12-12T10:12:29.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.686+0000 7f9a3bfff640 1 --2- 172.21.15.78:0/1387966792 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9a28005190 0x7f9a2800b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:29.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.686+0000 7f9a3bfff640 1 -- 172.21.15.78:0/1387966792 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a28003530 con 0x7f9a28003bb0 2023-12-12T10:12:29.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.686+0000 7f9a40da2640 1 -- 172.21.15.78:0/1387966792 reap_dead start 2023-12-12T10:12:29.698 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.686+0000 7f659effd640 1 --2- 172.21.15.78:0/1062143477 >> v2:172.21.15.187:3300/0 conn(0x7f65a0142890 0x7f65a015caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:29.698 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.686+0000 7f659dffb640 1 -- 172.21.15.78:0/1062143477 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1338109997 0 0) 0x7f65a015a3c0 con 0x7f65a0070640 2023-12-12T10:12:29.698 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.686+0000 7f659dffb640 1 -- 172.21.15.78:0/1062143477 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6588003530 con 0x7f65a0070640 2023-12-12T10:12:29.698 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.686+0000 7f659e7fc640 1 --2- 172.21.15.78:0/1062143477 >> v2:172.21.15.78:3300/0 conn(0x7f65a0159f30 0x7f65a0070100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:29.698 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.686+0000 7f659effd640 1 -- 172.21.15.78:0/1062143477 >> v2:172.21.15.78:3300/0 conn(0x7f65a0159f30 msgr2=0x7f65a0070100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:29.698 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.686+0000 7f659effd640 1 --2- 172.21.15.78:0/1062143477 >> v2:172.21.15.78:3300/0 conn(0x7f65a0159f30 0x7f65a0070100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:29.698 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.686+0000 7f659effd640 1 -- 172.21.15.78:0/1062143477 >> v1:172.21.15.187:6789/0 conn(0x7f65a0070640 legacy=0x7f65a006c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:29.698 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.686+0000 7f659effd640 1 -- 172.21.15.78:0/1062143477 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65a00ce1d0 con 0x7f65a0142890 2023-12-12T10:12:29.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.690+0000 7f496b357640 1 Processor -- start 2023-12-12T10:12:29.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.690+0000 7f496b357640 1 -- start start 2023-12-12T10:12:29.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.690+0000 7f496b357640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4964071e20 0x7f4964145ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:29.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.690+0000 7f496b357640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f49640b2f30 0x7f49640acc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:29.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.690+0000 7f496b357640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4964156be0 0x7f4964142a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:29.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.690+0000 7f496b357640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49640ae0f0 con 0x7f4964156be0 2023-12-12T10:12:29.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.690+0000 7f496b357640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49640ad4e0 con 0x7f49640b2f30 2023-12-12T10:12:29.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.690+0000 7f496b357640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49640ad7c0 con 0x7f4964071e20 2023-12-12T10:12:29.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.690+0000 7f49690f3640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4964071e20 0x7f4964145ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:29.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.690+0000 7f49690f3640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4964071e20 0x7f4964145ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.78:47486/0 (socket says 172.21.15.78:47486) 2023-12-12T10:12:29.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.690+0000 7f49690f3640 1 -- 172.21.15.78:0/1049517226 learned_addr learned my addr 172.21.15.78:0/1049517226 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:29.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.690+0000 7f49688f2640 1 --2- 172.21.15.78:0/1049517226 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f49640b2f30 0x7f49640acc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:29.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.690+0000 7f49698f4640 1 --2- 172.21.15.78:0/1049517226 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4964156be0 0x7f4964142a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:29.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.690+0000 7f49690f3640 1 -- 172.21.15.78:0/1049517226 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f49640b2f30 msgr2=0x7f49640acc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:29.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.690+0000 7f49690f3640 1 --2- 172.21.15.78:0/1049517226 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f49640b2f30 0x7f49640acc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:29.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.690+0000 7f49690f3640 1 -- 172.21.15.78:0/1049517226 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4964156be0 msgr2=0x7f4964142a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:29.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.690+0000 7f49690f3640 1 --2- 172.21.15.78:0/1049517226 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4964156be0 0x7f4964142a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:29.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.690+0000 7f9a3bfff640 1 --2- 172.21.15.78:0/1387966792 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9a28003bb0 0x7f9a28003fb0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f9a2c0019e0 tx=0x7f9a2c01c610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=690a81283d22818d server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:29.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.690+0000 7f49690f3640 1 -- 172.21.15.78:0/1049517226 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4960009420 con 0x7f4964071e20 2023-12-12T10:12:29.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.690+0000 7f49698f4640 1 --2- 172.21.15.78:0/1049517226 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4964156be0 0x7f4964142a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T10:12:29.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.694+0000 7f9a3affd640 1 -- 172.21.15.78:0/1387966792 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a3c0cda90 con 0x7f9a28003bb0 2023-12-12T10:12:29.702 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.694+0000 7f49690f3640 1 --2- 172.21.15.78:0/1049517226 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4964071e20 0x7f4964145ff0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f49600af040 tx=0x7f496001ac00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:29.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.694+0000 7f9a3affd640 1 -- 172.21.15.78:0/1387966792 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a2c004ab0 con 0x7f9a28003bb0 2023-12-12T10:12:29.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.694+0000 7f9a3affd640 1 -- 172.21.15.78:0/1387966792 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a2c004e60 con 0x7f9a28003bb0 2023-12-12T10:12:29.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.694+0000 7fd56012a640 1 Processor -- start 2023-12-12T10:12:29.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.694+0000 7f659effd640 1 --2- 172.21.15.78:0/1062143477 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f65a0142890 0x7f65a015caa0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f65a00cc510 tx=0x7f659801c900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=70c34f770a20994f server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:29.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.694+0000 7f4959ffb640 1 -- 172.21.15.78:0/1049517226 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49600ac620 con 0x7f4964071e20 2023-12-12T10:12:29.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.694+0000 7f4959ffb640 1 -- 172.21.15.78:0/1049517226 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49600b8450 con 0x7f4964071e20 2023-12-12T10:12:29.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.694+0000 7f4959ffb640 1 -- 172.21.15.78:0/1049517226 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49600b87c0 con 0x7f4964071e20 2023-12-12T10:12:29.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.694+0000 7f659dffb640 1 -- 172.21.15.78:0/1062143477 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65980a59a0 con 0x7f65a0142890 2023-12-12T10:12:29.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.694+0000 7f659dffb640 1 -- 172.21.15.78:0/1062143477 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65980a5b00 con 0x7f65a0142890 2023-12-12T10:12:29.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.694+0000 7f659dffb640 1 -- 172.21.15.78:0/1062143477 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65980a5e90 con 0x7f65a0142890 2023-12-12T10:12:29.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.694+0000 7f9a42805640 1 -- 172.21.15.78:0/1387966792 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9a28003bb0 msgr2=0x7f9a28003fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:29.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.694+0000 7f9a42805640 1 --2- 172.21.15.78:0/1387966792 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9a28003bb0 0x7f9a28003fb0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f9a2c0019e0 tx=0x7f9a2c01c610 comp rx=0 tx=0).stop 2023-12-12T10:12:29.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.694+0000 7f496b357640 1 -- 172.21.15.78:0/1049517226 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49640adaa0 con 0x7f4964071e20 2023-12-12T10:12:29.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.694+0000 7fd56012a640 1 -- start start 2023-12-12T10:12:29.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.694+0000 7f496b357640 1 -- 172.21.15.78:0/1049517226 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49640ad140 con 0x7f4964071e20 2023-12-12T10:12:29.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.694+0000 7f8d56c4b640 1 Processor -- start 2023-12-12T10:12:29.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.694+0000 7f9a42805640 1 -- 172.21.15.78:0/1387966792 shutdown_connections 2023-12-12T10:12:29.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.694+0000 7f9a42805640 1 --2- 172.21.15.78:0/1387966792 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9a28003bb0 0x7f9a28003fb0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:29.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.694+0000 7f9a42805640 1 -- 172.21.15.78:0/1387966792 >> 172.21.15.78:0/1387966792 conn(0x7f9a3c0b0b20 msgr2=0x7f9a3c0b0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:29.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.694+0000 7f8d56c4b640 1 -- start start 2023-12-12T10:12:29.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.694+0000 7f49477fe640 1 -- 172.21.15.78:0/1049517226 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f49640b3790 con 0x7f4964071e20 2023-12-12T10:12:29.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.694+0000 7f9a42805640 1 -- 172.21.15.78:0/1387966792 shutdown_connections 2023-12-12T10:12:29.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.694+0000 7f7a59957640 1 Processor -- start 2023-12-12T10:12:29.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.694+0000 7f65a5a5a640 1 -- 172.21.15.78:0/1062143477 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f65a0142890 msgr2=0x7f65a015caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:29.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.694+0000 7f65a5a5a640 1 --2- 172.21.15.78:0/1062143477 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f65a0142890 0x7f65a015caa0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f65a00cc510 tx=0x7f659801c900 comp rx=0 tx=0).stop 2023-12-12T10:12:29.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.694+0000 7f7a59957640 1 -- start start 2023-12-12T10:12:29.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.694+0000 7fd56012a640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fd558071d40 0x7fd558164fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:29.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.694+0000 7fd56012a640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd5581654e0 0x7fd5580b2c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:29.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.694+0000 7fd56012a640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd5580b31b0 0x7fd558161960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:29.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.694+0000 7fd56012a640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd558072120 con 0x7fd5580b31b0 2023-12-12T10:12:29.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.694+0000 7fd56012a640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd558165940 con 0x7fd558071d40 2023-12-12T10:12:29.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.694+0000 7fd56012a640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5580b39a0 con 0x7fd5581654e0 2023-12-12T10:12:29.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.694+0000 7f9a42805640 1 -- 172.21.15.78:0/1387966792 wait complete. 2023-12-12T10:12:29.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.698+0000 7fd55d6c5640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd5581654e0 0x7fd5580b2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:29.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.698+0000 7fd55d6c5640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd5581654e0 0x7fd5580b2c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.78:47490/0 (socket says 172.21.15.78:47490) 2023-12-12T10:12:29.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.698+0000 7fd55d6c5640 1 -- 172.21.15.78:0/1396627958 learned_addr learned my addr 172.21.15.78:0/1396627958 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:29.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.698+0000 7fd55dec6640 1 --2- 172.21.15.78:0/1396627958 >> v2:172.21.15.187:3300/0 conn(0x7fd558071d40 0x7fd558164fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:29.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.698+0000 7f7a59957640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7a54160890 0x7f7a540b5e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:29.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.698+0000 7f7a59957640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a540d04f0 con 0x7f7a540d1ce0 2023-12-12T10:12:29.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.698+0000 7f7a59957640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a540b63a0 con 0x7f7a540d0be0 2023-12-12T10:12:29.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.698+0000 7f7a59957640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a540cdc20 con 0x7f7a54160890 2023-12-12T10:12:29.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.698+0000 7f8d56c4b640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8d500d13a0 0x7f8d500d1780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:29.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.698+0000 7f8d56c4b640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f8d500cfe90 0x7f8d500cd960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:29.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.698+0000 7f8d56c4b640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d500afe00 con 0x7f8d500b1d30 2023-12-12T10:12:29.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.698+0000 7f8d56c4b640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d500d1cc0 con 0x7f8d500d13a0 2023-12-12T10:12:29.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.698+0000 7f8d56c4b640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d500d0f10 con 0x7f8d500cfe90 2023-12-12T10:12:29.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.698+0000 7fd55d6c5640 1 -- 172.21.15.78:0/1396627958 >> v2:172.21.15.187:3300/0 conn(0x7fd558071d40 msgr2=0x7fd558164fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:29.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.698+0000 7fd55d6c5640 1 --2- 172.21.15.78:0/1396627958 >> v2:172.21.15.187:3300/0 conn(0x7fd558071d40 0x7fd558164fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:29.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.698+0000 7fd55d6c5640 1 -- 172.21.15.78:0/1396627958 >> v2:172.21.15.78:3300/0 conn(0x7fd5580b31b0 msgr2=0x7fd558161960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:29.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.698+0000 7fd55d6c5640 1 --2- 172.21.15.78:0/1396627958 >> v2:172.21.15.78:3300/0 conn(0x7fd5580b31b0 0x7fd558161960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:29.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.698+0000 7fd55d6c5640 1 -- 172.21.15.78:0/1396627958 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5580b3c80 con 0x7fd5581654e0 2023-12-12T10:12:29.713 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.698+0000 7f65a5a5a640 1 -- 172.21.15.78:0/1062143477 shutdown_connections 2023-12-12T10:12:29.713 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.698+0000 7f65a5a5a640 1 --2- 172.21.15.78:0/1062143477 >> v2:172.21.15.78:3300/0 conn(0x7f65a0159f30 0x7f65a0070100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:29.713 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.698+0000 7f65a5a5a640 1 --2- 172.21.15.78:0/1062143477 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f65a0142890 0x7f65a015caa0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:29.713 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.698+0000 7f65a5a5a640 1 -- 172.21.15.78:0/1062143477 >> 172.21.15.78:0/1062143477 conn(0x7f65a00b0750 msgr2=0x7f65a00b0b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:29.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.698+0000 7f8d55448640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f8d500cfe90 0x7f8d500cd960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:29.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.698+0000 7f8d55448640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f8d500cfe90 0x7f8d500cd960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.78:38406/0 (socket says 172.21.15.78:38406) 2023-12-12T10:12:29.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.698+0000 7f8d55448640 1 -- 172.21.15.78:0/2238832311 learned_addr learned my addr 172.21.15.78:0/2238832311 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:29.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.698+0000 7f4959ffb640 1 -- 172.21.15.78:0/1049517226 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f49600aa070 con 0x7f4964071e20 2023-12-12T10:12:29.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.698+0000 7f7a527fc640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f7a540d0be0 0x7f7a540d15d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.78:51592/0 (socket says 172.21.15.78:51592) 2023-12-12T10:12:29.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.698+0000 7f7a527fc640 1 -- 172.21.15.78:0/1334233005 learned_addr learned my addr 172.21.15.78:0/1334233005 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-12-12T10:12:29.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.698+0000 7f7a52ffd640 1 --2- 172.21.15.78:0/1334233005 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7a54160890 0x7f7a540b5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:29.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.698+0000 7f9a42805640 1 Processor -- start 2023-12-12T10:12:29.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.698+0000 7f9a42805640 1 -- start start 2023-12-12T10:12:29.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.698+0000 7f7a51ffb640 1 -- 172.21.15.78:0/1334233005 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1584500811 0 0) 0x7f7a540b63a0 con 0x7f7a540d0be0 2023-12-12T10:12:29.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.698+0000 7f8d55c49640 1 --2- 172.21.15.78:0/2238832311 >> v2:172.21.15.78:3300/0 conn(0x7f8d500d13a0 0x7f8d500d1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:29.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.698+0000 7f8d55448640 1 -- 172.21.15.78:0/2238832311 >> v2:172.21.15.78:3300/0 conn(0x7f8d500d13a0 msgr2=0x7f8d500d1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:29.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.698+0000 7f8d55448640 1 --2- 172.21.15.78:0/2238832311 >> v2:172.21.15.78:3300/0 conn(0x7f8d500d13a0 0x7f8d500d1780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:29.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.698+0000 7f8d55448640 1 -- 172.21.15.78:0/2238832311 >> v1:172.21.15.78:6789/0 conn(0x7f8d500b1d30 legacy=0x7f8d500cdea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:29.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.698+0000 7f8d55448640 1 -- 172.21.15.78:0/2238832311 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d500d3980 con 0x7f8d500cfe90 2023-12-12T10:12:29.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.698+0000 7f7a52ffd640 1 -- 172.21.15.78:0/1334233005 >> v1:172.21.15.187:6789/0 conn(0x7f7a540d0be0 legacy=0x7f7a540d15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:29.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.698+0000 7f7a52ffd640 1 -- 172.21.15.78:0/1334233005 >> v1:172.21.15.78:6789/0 conn(0x7f7a540d1ce0 legacy=0x7f7a540ce3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:29.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.698+0000 7f7a52ffd640 1 -- 172.21.15.78:0/1334233005 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a540cfc50 con 0x7f7a54160890 2023-12-12T10:12:29.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.698+0000 7f65a5a5a640 1 -- 172.21.15.78:0/1062143477 shutdown_connections 2023-12-12T10:12:29.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.702+0000 7f65a5a5a640 1 -- 172.21.15.78:0/1062143477 wait complete. 2023-12-12T10:12:29.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.702+0000 7f8d55c49640 1 --2- 172.21.15.78:0/2238832311 >> v2:172.21.15.78:3300/0 conn(0x7f8d500d13a0 0x7f8d500d1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T10:12:29.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.698+0000 7f4959ffb640 1 --2- 172.21.15.78:0/1049517226 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f4948066540 0x7f4948068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:29.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.698+0000 7f4959ffb640 1 -- 172.21.15.78:0/1049517226 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f496011ea20 con 0x7f4964071e20 2023-12-12T10:12:29.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.698+0000 7f4959ffb640 1 --2- 172.21.15.78:0/1049517226 >> [v2:172.21.15.78:6808/3345683600,v1:172.21.15.78:6809/3345683600] conn(0x7f494806fb80 0x7f4948071fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:29.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.698+0000 7f4959ffb640 1 -- 172.21.15.78:0/1049517226 --> [v2:172.21.15.78:6808/3345683600,v1:172.21.15.78:6809/3345683600] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4948072690 con 0x7f494806fb80 2023-12-12T10:12:29.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.698+0000 7f4959ffb640 1 -- 172.21.15.78:0/1049517226 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f496011edd0 con 0x7f4964071e20 2023-12-12T10:12:29.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.702+0000 7f49688f2640 1 --2- 172.21.15.78:0/1049517226 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f4948066540 0x7f4948068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:29.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.702+0000 7f49688f2640 1 --2- 172.21.15.78:0/1049517226 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f4948066540 0x7f4948068a00 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f49641f9590 tx=0x7f4954009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:29.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.698+0000 7f9a42805640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9a28003bb0 0x7f9a3c153490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:29.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.698+0000 7f9a42805640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9a3c1639d0 0x7f9a3c163e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:29.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.698+0000 7f9a42805640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9a3c158b40 0x7f9a3c158ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:29.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.698+0000 7f9a42805640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a3c164390 con 0x7f9a28003bb0 2023-12-12T10:12:29.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.698+0000 7f9a42805640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a3c159b90 con 0x7f9a3c1639d0 2023-12-12T10:12:29.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.698+0000 7f9a42805640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a3c1539d0 con 0x7f9a3c158b40 2023-12-12T10:12:29.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.702+0000 7f9a3bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9a28003bb0 0x7f9a3c153490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:29.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.702+0000 7f9a3bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9a28003bb0 0x7f9a3c153490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:36880/0 (socket says 172.21.15.78:36880) 2023-12-12T10:12:29.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.702+0000 7f9a3bfff640 1 -- 172.21.15.78:0/423199180 learned_addr learned my addr 172.21.15.78:0/423199180 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:29.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.702+0000 7f9a3bfff640 1 -- 172.21.15.78:0/423199180 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9a3c158b40 msgr2=0x7f9a3c158ff0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-12-12T10:12:29.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.702+0000 7f9a3bfff640 1 --2- 172.21.15.78:0/423199180 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9a3c158b40 0x7f9a3c158ff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:29.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.702+0000 7f9a3bfff640 1 -- 172.21.15.78:0/423199180 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9a3c1639d0 msgr2=0x7f9a3c163e50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-12T10:12:29.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.702+0000 7f9a3bfff640 1 --2- 172.21.15.78:0/423199180 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9a3c1639d0 0x7f9a3c163e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:29.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.702+0000 7f9a3bfff640 1 -- 172.21.15.78:0/423199180 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a3c0b3720 con 0x7f9a28003bb0 2023-12-12T10:12:29.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.702+0000 7f9a3bfff640 1 --2- 172.21.15.78:0/423199180 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9a28003bb0 0x7f9a3c153490 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f9a2c000c10 tx=0x7f9a28005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:29.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.702+0000 7fb12d901640 1 Processor -- start 2023-12-12T10:12:29.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.702+0000 7f9a38ff9640 1 -- 172.21.15.78:0/423199180 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a2c007180 con 0x7f9a28003bb0 2023-12-12T10:12:29.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.702+0000 7f9a38ff9640 1 -- 172.21.15.78:0/423199180 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a2c0072e0 con 0x7f9a28003bb0 2023-12-12T10:12:29.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.702+0000 7fd55d6c5640 1 --2- 172.21.15.78:0/1396627958 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd5581654e0 0x7fd5580b2c70 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fd55806e4c0 tx=0x7fd54801c4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f81bb5e5e61d660 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:29.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.702+0000 7f65a5a5a640 1 Processor -- start 2023-12-12T10:12:29.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.702+0000 7f9a38ff9640 1 -- 172.21.15.78:0/423199180 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a2c007650 con 0x7f9a28003bb0 2023-12-12T10:12:29.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.702+0000 7f9a42805640 1 -- 172.21.15.78:0/423199180 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a3c1598b0 con 0x7f9a28003bb0 2023-12-12T10:12:29.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.702+0000 7f9a42805640 1 -- 172.21.15.78:0/423199180 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a3c15b890 con 0x7f9a28003bb0 2023-12-12T10:12:29.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.702+0000 7f65a5a5a640 1 -- start start 2023-12-12T10:12:29.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.702+0000 7fd55cec4640 1 -- 172.21.15.78:0/1396627958 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5480aa5f0 con 0x7fd5581654e0 2023-12-12T10:12:29.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.702+0000 7fd55cec4640 1 -- 172.21.15.78:0/1396627958 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5480aa750 con 0x7fd5581654e0 2023-12-12T10:12:29.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.702+0000 7fd55cec4640 1 -- 172.21.15.78:0/1396627958 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5480aaae0 con 0x7fd5581654e0 2023-12-12T10:12:29.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.702+0000 7f49698f4640 1 --2- 172.21.15.78:0/1049517226 >> [v2:172.21.15.78:6808/3345683600,v1:172.21.15.78:6809/3345683600] conn(0x7f494806fb80 0x7f4948071fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:29.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.702+0000 7f49698f4640 1 --2- 172.21.15.78:0/1049517226 >> [v2:172.21.15.78:6808/3345683600,v1:172.21.15.78:6809/3345683600] conn(0x7f494806fb80 0x7f4948071fc0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:29.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.706+0000 7f7a52ffd640 1 --2- 172.21.15.78:0/1334233005 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7a54160890 0x7f7a540b5e60 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c009dc0 tx=0x7f7a4c01c960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b106b83f9c3c83a1 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:29.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.702+0000 7fb12d901640 1 -- start start 2023-12-12T10:12:29.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.706+0000 7fb12d901640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb128071d40 0x7fb128164fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:29.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.706+0000 7fb12d901640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb1280b3380 0x7fb12806cc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:29.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.706+0000 7fb12d901640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb128165940 con 0x7fb1281654e0 2023-12-12T10:12:29.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.706+0000 7fb12d901640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb128072120 con 0x7fb1280b3380 2023-12-12T10:12:29.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.706+0000 7fb12d901640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1280b39a0 con 0x7fb128071d40 2023-12-12T10:12:29.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.706+0000 7f7a51ffb640 1 -- 172.21.15.78:0/1334233005 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a4c0a5910 con 0x7f7a54160890 2023-12-12T10:12:29.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.706+0000 7fb126ffd640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb128071d40 0x7fb128164fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:29.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.706+0000 7f7a51ffb640 1 -- 172.21.15.78:0/1334233005 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a4c0a5a70 con 0x7f7a54160890 2023-12-12T10:12:29.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.706+0000 7f7a51ffb640 1 -- 172.21.15.78:0/1334233005 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a4c0a5e00 con 0x7f7a54160890 2023-12-12T10:12:29.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.706+0000 7fb126ffd640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb128071d40 0x7fb128164fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.78:47534/0 (socket says 172.21.15.78:47534) 2023-12-12T10:12:29.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.706+0000 7fb126ffd640 1 -- 172.21.15.78:0/3803827590 learned_addr learned my addr 172.21.15.78:0/3803827590 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:29.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.702+0000 7f9a42805640 1 -- 172.21.15.78:0/423199180 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9a3c070b20 con 0x7f9a28003bb0 2023-12-12T10:12:29.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.706+0000 7f65a5a5a640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f65a0070640 0x7f65a015bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:29.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.706+0000 7f65a5a5a640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f65a0142890 0x7f65a013ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:29.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.706+0000 7f65a5a5a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65a0159f30 0x7f65a013f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:29.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.706+0000 7f65a5a5a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65a00b2850 con 0x7f65a0159f30 2023-12-12T10:12:29.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.706+0000 7f65a5a5a640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65a0155a50 con 0x7f65a0142890 2023-12-12T10:12:29.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.706+0000 7f65a5a5a640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65a013f8d0 con 0x7f65a0070640 2023-12-12T10:12:29.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.706+0000 7f4959ffb640 1 -- 172.21.15.78:0/1049517226 <== osd.0 v2:172.21.15.78:6808/3345683600 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f4948072690 con 0x7f494806fb80 2023-12-12T10:12:29.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.706+0000 7fb1277fe640 1 --2- 172.21.15.78:0/3803827590 >> v2:172.21.15.78:3300/0 conn(0x7fb1280b3380 0x7fb12806cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:29.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.706+0000 7fd56012a640 1 -- 172.21.15.78:0/1396627958 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd5581654e0 msgr2=0x7fd5580b2c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:29.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.706+0000 7fd56012a640 1 --2- 172.21.15.78:0/1396627958 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd5581654e0 0x7fd5580b2c70 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fd55806e4c0 tx=0x7fd54801c4d0 comp rx=0 tx=0).stop 2023-12-12T10:12:29.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.706+0000 7f7a59957640 1 -- 172.21.15.78:0/1334233005 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7a54160890 msgr2=0x7f7a540b5e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:29.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.706+0000 7f7a59957640 1 --2- 172.21.15.78:0/1334233005 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7a54160890 0x7f7a540b5e60 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c009dc0 tx=0x7f7a4c01c960 comp rx=0 tx=0).stop 2023-12-12T10:12:29.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.706+0000 7f7a59957640 1 -- 172.21.15.78:0/1334233005 shutdown_connections 2023-12-12T10:12:29.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.706+0000 7f7a59957640 1 --2- 172.21.15.78:0/1334233005 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7a54160890 0x7f7a540b5e60 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:29.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.706+0000 7f7a59957640 1 -- 172.21.15.78:0/1334233005 >> 172.21.15.78:0/1334233005 conn(0x7f7a5409c2f0 msgr2=0x7f7a540d3010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:29.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.706+0000 7f659effd640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f65a0070640 0x7f65a015bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:29.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.706+0000 7f659effd640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f65a0070640 0x7f65a015bba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.78:47548/0 (socket says 172.21.15.78:47548) 2023-12-12T10:12:29.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.706+0000 7f659effd640 1 -- 172.21.15.78:0/3541143680 learned_addr learned my addr 172.21.15.78:0/3541143680 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:29.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.706+0000 7f659e7fc640 1 --2- 172.21.15.78:0/3541143680 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f65a0142890 0x7f65a013ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:29.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.706+0000 7f7a59957640 1 -- 172.21.15.78:0/1334233005 shutdown_connections 2023-12-12T10:12:29.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.706+0000 7f7a59957640 1 -- 172.21.15.78:0/1334233005 wait complete. 2023-12-12T10:12:29.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.706+0000 7f659f7fe640 1 --2- 172.21.15.78:0/3541143680 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65a0159f30 0x7f65a013f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:29.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.706+0000 7f659e7fc640 1 -- 172.21.15.78:0/3541143680 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f65a0070640 msgr2=0x7f65a015bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:29.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.706+0000 7f659e7fc640 1 --2- 172.21.15.78:0/3541143680 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f65a0070640 0x7f65a015bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:29.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.706+0000 7f659e7fc640 1 -- 172.21.15.78:0/3541143680 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65a0159f30 msgr2=0x7f65a013f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:29.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.706+0000 7f659e7fc640 1 --2- 172.21.15.78:0/3541143680 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65a0159f30 0x7f65a013f230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:29.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.706+0000 7f659e7fc640 1 -- 172.21.15.78:0/3541143680 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6598009a70 con 0x7f65a0142890 2023-12-12T10:12:29.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.706+0000 7fb126ffd640 1 -- 172.21.15.78:0/3803827590 >> v2:172.21.15.78:3300/0 conn(0x7fb1280b3380 msgr2=0x7fb12806cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:29.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.706+0000 7fb126ffd640 1 --2- 172.21.15.78:0/3803827590 >> v2:172.21.15.78:3300/0 conn(0x7fb1280b3380 0x7fb12806cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:29.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.706+0000 7fb126ffd640 1 -- 172.21.15.78:0/3803827590 >> v1:172.21.15.78:6789/0 conn(0x7fb1281654e0 legacy=0x7fb1280b2c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:29.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.706+0000 7f9a38ff9640 1 -- 172.21.15.78:0/423199180 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9a2c0bc450 con 0x7f9a28003bb0 2023-12-12T10:12:29.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.706+0000 7f8d55448640 1 --2- 172.21.15.78:0/2238832311 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8d500cfe90 0x7f8d500cd960 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8d50160c70 tx=0x7f8d4001c4f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fd01b14380369dab server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:29.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.706+0000 7fd56012a640 1 -- 172.21.15.78:0/1396627958 shutdown_connections 2023-12-12T10:12:29.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.706+0000 7fd56012a640 1 --2- 172.21.15.78:0/1396627958 >> v2:172.21.15.78:3300/0 conn(0x7fd5580b31b0 0x7fd558161960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:29.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.706+0000 7fd56012a640 1 --2- 172.21.15.78:0/1396627958 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd5581654e0 0x7fd5580b2c70 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:29.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.706+0000 7fd56012a640 1 --2- 172.21.15.78:0/1396627958 >> v2:172.21.15.187:3300/0 conn(0x7fd558071d40 0x7fd558164fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:29.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.706+0000 7fd56012a640 1 -- 172.21.15.78:0/1396627958 >> 172.21.15.78:0/1396627958 conn(0x7fd55806a710 msgr2=0x7fd55806ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:29.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.706+0000 7f659e7fc640 1 --2- 172.21.15.78:0/3541143680 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f65a0142890 0x7f65a013ecf0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f659400d5f0 tx=0x7f659400dab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:29.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.706+0000 7f6587fff640 1 -- 172.21.15.78:0/3541143680 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65940125f0 con 0x7f65a0142890 2023-12-12T10:12:29.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.706+0000 7f8d54c47640 1 -- 172.21.15.78:0/2238832311 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d400aa650 con 0x7f8d500cfe90 2023-12-12T10:12:29.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.706+0000 7f6587fff640 1 -- 172.21.15.78:0/3541143680 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6594012750 con 0x7f65a0142890 2023-12-12T10:12:29.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.706+0000 7f6587fff640 1 -- 172.21.15.78:0/3541143680 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6594012b00 con 0x7f65a0142890 2023-12-12T10:12:29.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.706+0000 7f65a5a5a640 1 -- 172.21.15.78:0/3541143680 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65a013fbb0 con 0x7f65a0142890 2023-12-12T10:12:29.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.706+0000 7f65a5a5a640 1 -- 172.21.15.78:0/3541143680 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65a00b2190 con 0x7f65a0142890 2023-12-12T10:12:29.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.706+0000 7fd56012a640 1 -- 172.21.15.78:0/1396627958 shutdown_connections 2023-12-12T10:12:29.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.710+0000 7f9a38ff9640 1 --2- 172.21.15.78:0/423199180 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f9a1c0664a0 0x7f9a1c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:29.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.710+0000 7fb83b032640 1 Processor -- start 2023-12-12T10:12:29.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.710+0000 7f7a59957640 1 Processor -- start 2023-12-12T10:12:29.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.710+0000 7f6585ffb640 1 -- 172.21.15.78:0/3541143680 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f65a00ccca0 con 0x7f65a0142890 2023-12-12T10:12:29.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.706+0000 7fd56012a640 1 -- 172.21.15.78:0/1396627958 wait complete. 2023-12-12T10:12:29.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.710+0000 7f9a38ff9640 1 -- 172.21.15.78:0/423199180 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9a2c11d980 con 0x7f9a28003bb0 2023-12-12T10:12:29.737 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.710+0000 7f9a38ff9640 1 --2- 172.21.15.78:0/423199180 >> [v2:172.21.15.78:6800/962652768,v1:172.21.15.78:6801/962652768] conn(0x7f9a1c06fae0 0x7f9a1c071f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:29.737 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.710+0000 7f9a38ff9640 1 -- 172.21.15.78:0/423199180 --> [v2:172.21.15.78:6800/962652768,v1:172.21.15.78:6801/962652768] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9a1c0725f0 con 0x7f9a1c06fae0 2023-12-12T10:12:29.737 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.710+0000 7f9a38ff9640 1 -- 172.21.15.78:0/423199180 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9a2c11dd30 con 0x7f9a28003bb0 2023-12-12T10:12:29.737 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.710+0000 7f9a3b7fe640 1 --2- 172.21.15.78:0/423199180 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f9a1c0664a0 0x7f9a1c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:29.737 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.710+0000 7f8d54c47640 1 -- 172.21.15.78:0/2238832311 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d400aa7b0 con 0x7f8d500cfe90 2023-12-12T10:12:29.737 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.710+0000 7f8d54c47640 1 -- 172.21.15.78:0/2238832311 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d400aa650 con 0x7f8d500cfe90 2023-12-12T10:12:29.737 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.710+0000 7f8d56c4b640 1 -- 172.21.15.78:0/2238832311 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8d500cfe90 msgr2=0x7f8d500cd960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:29.737 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.710+0000 7f8d56c4b640 1 --2- 172.21.15.78:0/2238832311 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8d500cfe90 0x7f8d500cd960 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8d50160c70 tx=0x7f8d4001c4f0 comp rx=0 tx=0).stop 2023-12-12T10:12:29.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.710+0000 7f8d56c4b640 1 -- 172.21.15.78:0/2238832311 shutdown_connections 2023-12-12T10:12:29.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.710+0000 7f8d56c4b640 1 --2- 172.21.15.78:0/2238832311 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8d500cfe90 0x7f8d500cd960 secure :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8d50160c70 tx=0x7f8d4001c4f0 comp rx=0 tx=0).stop 2023-12-12T10:12:29.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.710+0000 7f8d56c4b640 1 --2- 172.21.15.78:0/2238832311 >> v2:172.21.15.78:3300/0 conn(0x7f8d500d13a0 0x7f8d500d1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:29.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.710+0000 7f8d56c4b640 1 -- 172.21.15.78:0/2238832311 >> 172.21.15.78:0/2238832311 conn(0x7f8d500d2dc0 msgr2=0x7f8d500d31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:29.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.710+0000 7f7a59957640 1 -- start start 2023-12-12T10:12:29.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.706+0000 7fb126ffd640 1 -- 172.21.15.78:0/3803827590 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1280b3c80 con 0x7fb128071d40 2023-12-12T10:12:29.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.710+0000 7f7a59957640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7a540d0be0 0x7f7a540cca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:29.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.710+0000 7fb83b032640 1 -- start start 2023-12-12T10:12:29.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.710+0000 7fb83b032640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fb8341656b0 0x7fb8340b2c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:29.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.710+0000 7f7a59957640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7a540d1ce0 0x7f7a54150720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:29.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.710+0000 7fb83b032640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8340b39a0 con 0x7fb834071d40 2023-12-12T10:12:29.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.710+0000 7f7a52ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7a540d0be0 0x7f7a540cca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:29.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.710+0000 7f7a52ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7a540d0be0 0x7f7a540cca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:36912/0 (socket says 172.21.15.78:36912) 2023-12-12T10:12:29.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.710+0000 7f7a52ffd640 1 -- 172.21.15.78:0/2871261066 learned_addr learned my addr 172.21.15.78:0/2871261066 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:29.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.710+0000 7f7a59957640 1 --2- 172.21.15.78:0/2871261066 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7a54160890 0x7f7a54156920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:29.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.710+0000 7fb83b032640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8340b3c80 con 0x7fb8340b31b0 2023-12-12T10:12:29.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.710+0000 7f8d56c4b640 1 -- 172.21.15.78:0/2238832311 shutdown_connections 2023-12-12T10:12:29.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.710+0000 7fb83b032640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb834072120 con 0x7fb8341656b0 2023-12-12T10:12:29.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.710+0000 7f6587fff640 1 -- 172.21.15.78:0/3541143680 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6594012c60 con 0x7f65a0142890 2023-12-12T10:12:29.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.710+0000 7f7a59957640 1 -- 172.21.15.78:0/2871261066 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a540c6210 con 0x7f7a540d0be0 2023-12-12T10:12:29.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.710+0000 7f7a59957640 1 -- 172.21.15.78:0/2871261066 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a54150c60 con 0x7f7a54160890 2023-12-12T10:12:29.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.710+0000 7f9a40da2640 1 --2- 172.21.15.78:0/423199180 >> [v2:172.21.15.78:6800/962652768,v1:172.21.15.78:6801/962652768] conn(0x7f9a1c06fae0 0x7f9a1c071f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:29.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.714+0000 7f7a527fc640 1 --2- 172.21.15.78:0/2871261066 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7a540d1ce0 0x7f7a54150720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:29.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.710+0000 7f8d56c4b640 1 -- 172.21.15.78:0/2238832311 wait complete. 2023-12-12T10:12:29.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.714+0000 7f7a537fe640 1 --2- 172.21.15.78:0/2871261066 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7a54160890 0x7f7a54156920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:29.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.714+0000 7fb833fff640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fb8341656b0 0x7fb8340b2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:29.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.710+0000 7f7a59957640 1 -- 172.21.15.78:0/2871261066 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a540c8820 con 0x7f7a540d1ce0 2023-12-12T10:12:29.745 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.714+0000 7fd56012a640 1 Processor -- start 2023-12-12T10:12:29.745 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.714+0000 7fb833fff640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fb8341656b0 0x7fb8340b2c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.78:38426/0 (socket says 172.21.15.78:38426) 2023-12-12T10:12:29.745 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.714+0000 7fb833fff640 1 -- 172.21.15.78:0/3353898421 learned_addr learned my addr 172.21.15.78:0/3353898421 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:29.746 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.710+0000 7f9a3b7fe640 1 --2- 172.21.15.78:0/423199180 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f9a1c0664a0 0x7f9a1c068960 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f9a3c158450 tx=0x7f9a3400b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:29.746 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.710+0000 7f9a40da2640 1 --2- 172.21.15.78:0/423199180 >> [v2:172.21.15.78:6800/962652768,v1:172.21.15.78:6801/962652768] conn(0x7f9a1c06fae0 0x7f9a1c071f20 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:29.746 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.714+0000 7fd56012a640 1 -- start start 2023-12-12T10:12:29.746 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.714+0000 7fb126ffd640 1 --2- 172.21.15.78:0/3803827590 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb128071d40 0x7fb128164fa0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fb118009870 tx=0x7fb11801c4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6f880fc6dd691f2c server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:29.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.714+0000 7f6587fff640 1 --2- 172.21.15.78:0/3541143680 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f658c066470 0x7f658c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:29.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.714+0000 7f6587fff640 1 -- 172.21.15.78:0/3541143680 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6594085060 con 0x7f65a0142890 2023-12-12T10:12:29.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.714+0000 7fb125ffb640 1 -- 172.21.15.78:0/3803827590 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1180ac600 con 0x7fb128071d40 2023-12-12T10:12:29.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.714+0000 7f659effd640 1 --2- 172.21.15.78:0/3541143680 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f658c066470 0x7f658c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:29.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.714+0000 7f6587fff640 1 --2- 172.21.15.78:0/3541143680 >> [v2:172.21.15.78:6816/2910206054,v1:172.21.15.78:6818/2910206054] conn(0x7f658c06fa30 0x7f658c071e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:29.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.714+0000 7f6587fff640 1 -- 172.21.15.78:0/3541143680 --> [v2:172.21.15.78:6816/2910206054,v1:172.21.15.78:6818/2910206054] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f658c072540 con 0x7f658c06fa30 2023-12-12T10:12:29.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.714+0000 7f6587fff640 1 -- 172.21.15.78:0/3541143680 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f65940854b0 con 0x7f65a0142890 2023-12-12T10:12:29.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.714+0000 7fd56012a640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd558071d40 0x7fd558159070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:29.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.714+0000 7fd56012a640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd5580b31b0 0x7fd5581f9ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:29.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.714+0000 7fd56012a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd5581654e0 0x7fd558160310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:29.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.714+0000 7f7a537fe640 1 -- 172.21.15.78:0/2871261066 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7a540d1ce0 msgr2=0x7f7a54150720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:29.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.714+0000 7f7a537fe640 1 --2- 172.21.15.78:0/2871261066 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7a540d1ce0 0x7f7a54150720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:29.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.714+0000 7f7a537fe640 1 -- 172.21.15.78:0/2871261066 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7a540d0be0 msgr2=0x7f7a540cca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:29.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.714+0000 7f7a537fe640 1 --2- 172.21.15.78:0/2871261066 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7a540d0be0 0x7f7a540cca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:29.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.714+0000 7f7a537fe640 1 -- 172.21.15.78:0/2871261066 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a4c009a70 con 0x7f7a54160890 2023-12-12T10:12:29.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.714+0000 7f659f7fe640 1 --2- 172.21.15.78:0/3541143680 >> [v2:172.21.15.78:6816/2910206054,v1:172.21.15.78:6818/2910206054] conn(0x7f658c06fa30 0x7f658c071e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:29.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.714+0000 7fb125ffb640 1 -- 172.21.15.78:0/3803827590 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1180a8050 con 0x7fb128071d40 2023-12-12T10:12:29.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.714+0000 7fb125ffb640 1 -- 172.21.15.78:0/3803827590 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1180ac980 con 0x7fb128071d40 2023-12-12T10:12:29.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.714+0000 7f9a38ff9640 1 -- 172.21.15.78:0/423199180 <== osd.1 v2:172.21.15.78:6800/962652768 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f9a1c0725f0 con 0x7f9a1c06fae0 2023-12-12T10:12:29.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.714+0000 7f7a537fe640 1 --2- 172.21.15.78:0/2871261066 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7a54160890 0x7f7a54156920 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f7a4400c390 tx=0x7f7a4400c850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:29.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.714+0000 7fd56012a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd55815c850 con 0x7fd5581654e0 2023-12-12T10:12:29.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.714+0000 7fd56012a640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd55815cb30 con 0x7fd5580b31b0 2023-12-12T10:12:29.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.714+0000 7fd56012a640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd55815ce10 con 0x7fd558071d40 2023-12-12T10:12:29.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.714+0000 7fd55e6c7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd5581654e0 0x7fd558160310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:29.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.714+0000 7fd55e6c7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd5581654e0 0x7fd558160310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:36928/0 (socket says 172.21.15.78:36928) 2023-12-12T10:12:29.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.714+0000 7fd55e6c7640 1 -- 172.21.15.78:0/3463261534 learned_addr learned my addr 172.21.15.78:0/3463261534 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:29.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.714+0000 7fd55d6c5640 1 --2- 172.21.15.78:0/3463261534 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd5580b31b0 0x7fd5581f9ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:29.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.714+0000 7f8d56c4b640 1 Processor -- start 2023-12-12T10:12:29.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.714+0000 7f7a3bfff640 1 -- 172.21.15.78:0/2871261066 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a440052d0 con 0x7f7a54160890 2023-12-12T10:12:29.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.714+0000 7f659f7fe640 1 --2- 172.21.15.78:0/3541143680 >> [v2:172.21.15.78:6816/2910206054,v1:172.21.15.78:6818/2910206054] conn(0x7f658c06fa30 0x7f658c071e70 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:29.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.714+0000 7f7a59957640 1 -- 172.21.15.78:0/2871261066 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a540c82b0 con 0x7f7a54160890 2023-12-12T10:12:29.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.714+0000 7f7a59957640 1 -- 172.21.15.78:0/2871261066 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a540c7fd0 con 0x7f7a54160890 2023-12-12T10:12:29.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.714+0000 7f7a3bfff640 1 -- 172.21.15.78:0/2871261066 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a44005430 con 0x7f7a54160890 2023-12-12T10:12:29.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.714+0000 7f7a3bfff640 1 -- 172.21.15.78:0/2871261066 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a440052d0 con 0x7f7a54160890 2023-12-12T10:12:29.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.714+0000 7fb12d901640 1 -- 172.21.15.78:0/3803827590 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb128071d40 msgr2=0x7fb128164fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:29.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.714+0000 7fb12d901640 1 --2- 172.21.15.78:0/3803827590 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb128071d40 0x7fb128164fa0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fb118009870 tx=0x7fb11801c4d0 comp rx=0 tx=0).stop 2023-12-12T10:12:29.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.714+0000 7fd55e6c7640 1 -- 172.21.15.78:0/3463261534 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd558071d40 msgr2=0x7fd558159070 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-12T10:12:29.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.714+0000 7fd55e6c7640 1 --2- 172.21.15.78:0/3463261534 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd558071d40 0x7fd558159070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:29.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.714+0000 7fd55e6c7640 1 -- 172.21.15.78:0/3463261534 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd5580b31b0 msgr2=0x7fd5581f9ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:29.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.714+0000 7fd55e6c7640 1 --2- 172.21.15.78:0/3463261534 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd5580b31b0 0x7fd5581f9ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:29.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.714+0000 7fd55e6c7640 1 -- 172.21.15.78:0/3463261534 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5480094d0 con 0x7fd5581654e0 2023-12-12T10:12:29.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.714+0000 7fd55e6c7640 1 --2- 172.21.15.78:0/3463261534 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd5581654e0 0x7fd558160310 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fd55000b970 tx=0x7fd55000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:29.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.718+0000 7fd54e7fc640 1 -- 172.21.15.78:0/3463261534 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd55000cb40 con 0x7fd5581654e0 2023-12-12T10:12:29.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.718+0000 7fb833fff640 1 -- 172.21.15.78:0/3353898421 >> v1:172.21.15.187:6789/0 conn(0x7fb8340b31b0 legacy=0x7fb83406cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:29.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.718+0000 7fb833fff640 1 -- 172.21.15.78:0/3353898421 >> v1:172.21.15.78:6789/0 conn(0x7fb834071d40 legacy=0x7fb834164fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:29.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.718+0000 7fd56012a640 1 -- 172.21.15.78:0/3463261534 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd55815d0f0 con 0x7fd5581654e0 2023-12-12T10:12:29.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.718+0000 7fd56012a640 1 -- 172.21.15.78:0/3463261534 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5581595b0 con 0x7fd5581654e0 2023-12-12T10:12:29.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.718+0000 7f7a59957640 1 -- 172.21.15.78:0/2871261066 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7a54160c70 con 0x7f7a54160890 2023-12-12T10:12:29.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.714+0000 7f8d56c4b640 1 -- start start 2023-12-12T10:12:29.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.718+0000 7fb12d901640 1 -- 172.21.15.78:0/3803827590 shutdown_connections 2023-12-12T10:12:29.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.718+0000 7f8d56c4b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d500b1d30 0x7f8d500b26b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:29.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.718+0000 7f8d56c4b640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8d500d13a0 0x7f8d50151f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:29.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.718+0000 7f8d56c4b640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8d50202b40 0x7f8d500cf150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:29.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.718+0000 7fd54e7fc640 1 -- 172.21.15.78:0/3463261534 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd55000cca0 con 0x7fd5581654e0 2023-12-12T10:12:29.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.718+0000 7fd54e7fc640 1 -- 172.21.15.78:0/3463261534 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd550014640 con 0x7fd5581654e0 2023-12-12T10:12:29.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.718+0000 7fb12d901640 1 --2- 172.21.15.78:0/3803827590 >> v2:172.21.15.78:3300/0 conn(0x7fb1280b3380 0x7fb12806cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:29.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.718+0000 7f8d56c4b640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d50152450 con 0x7f8d500b1d30 2023-12-12T10:12:29.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.718+0000 7f8d56c4b640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d500b40a0 con 0x7f8d50202b40 2023-12-12T10:12:29.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.718+0000 7f8d56c4b640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d500b2c90 con 0x7f8d500d13a0 2023-12-12T10:12:29.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.718+0000 7fb12d901640 1 --2- 172.21.15.78:0/3803827590 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb128071d40 0x7fb128164fa0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:29.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.718+0000 7fb12d901640 1 -- 172.21.15.78:0/3803827590 >> 172.21.15.78:0/3803827590 conn(0x7fb12806a710 msgr2=0x7fb12806ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:29.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.718+0000 7fb12d901640 1 -- 172.21.15.78:0/3803827590 shutdown_connections 2023-12-12T10:12:29.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.718+0000 7fb833fff640 1 -- 172.21.15.78:0/3353898421 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8340b3f60 con 0x7fb8341656b0 2023-12-12T10:12:29.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.718+0000 7f8d5644a640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8d50202b40 0x7f8d500cf150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:29.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.718+0000 7f8d5644a640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8d50202b40 0x7f8d500cf150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.78:38450/0 (socket says 172.21.15.78:38450) 2023-12-12T10:12:29.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.718+0000 7f8d5644a640 1 -- 172.21.15.78:0/2499604518 learned_addr learned my addr 172.21.15.78:0/2499604518 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:29.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.718+0000 7f8d55c49640 1 --2- 172.21.15.78:0/2499604518 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d500b1d30 0x7f8d500b26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:29.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.718+0000 7fb12d901640 1 -- 172.21.15.78:0/3803827590 wait complete. 2023-12-12T10:12:29.760 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.718+0000 7f8d5644a640 1 -- 172.21.15.78:0/2499604518 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8d500d13a0 msgr2=0x7f8d50151f10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-12T10:12:29.760 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.718+0000 7f8d5644a640 1 --2- 172.21.15.78:0/2499604518 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8d500d13a0 0x7f8d50151f10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:29.760 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.718+0000 7f8d5644a640 1 -- 172.21.15.78:0/2499604518 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d500b1d30 msgr2=0x7f8d500b26b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:29.760 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.718+0000 7f8d5644a640 1 --2- 172.21.15.78:0/2499604518 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d500b1d30 0x7f8d500b26b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:29.760 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.718+0000 7f6587fff640 1 -- 172.21.15.78:0/3541143680 <== osd.2 v2:172.21.15.78:6816/2910206054 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f658c072540 con 0x7f658c06fa30 2023-12-12T10:12:29.761 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.718+0000 7f7a3bfff640 1 -- 172.21.15.78:0/2871261066 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7a44003600 con 0x7f7a54160890 2023-12-12T10:12:29.761 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.718+0000 7f8d5644a640 1 -- 172.21.15.78:0/2499604518 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d400094d0 con 0x7f8d50202b40 2023-12-12T10:12:29.761 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.718+0000 7f8d55c49640 1 --2- 172.21.15.78:0/2499604518 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8d500b1d30 0x7f8d500b26b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T10:12:29.761 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.718+0000 7fd54e7fc640 1 -- 172.21.15.78:0/3463261534 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd55001d3b0 con 0x7fd5581654e0 2023-12-12T10:12:29.761 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.722+0000 7f659effd640 1 --2- 172.21.15.78:0/3541143680 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f658c066470 0x7f658c068930 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f659801c940 tx=0x7f65980a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:29.762 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.722+0000 7f7a3bfff640 1 --2- 172.21.15.78:0/2871261066 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f7a40066530 0x7f7a400689f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:29.762 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.722+0000 7fb12d901640 1 Processor -- start 2023-12-12T10:12:29.762 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.722+0000 7f8d5644a640 1 --2- 172.21.15.78:0/2499604518 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8d50202b40 0x7f8d500cf150 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f8d4800c730 tx=0x7f8d4800cbf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:29.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.722+0000 7fd56012a640 1 -- 172.21.15.78:0/3463261534 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd540000fd0 con 0x7fd5581654e0 2023-12-12T10:12:29.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.722+0000 7f7a3bfff640 1 -- 172.21.15.78:0/2871261066 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7a44082f70 con 0x7f7a54160890 2023-12-12T10:12:29.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.722+0000 7fd54e7fc640 1 --2- 172.21.15.78:0/3463261534 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fd53c066470 0x7fd53c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:29.764 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.722+0000 7f8d467fc640 1 -- 172.21.15.78:0/2499604518 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d48003b80 con 0x7f8d50202b40 2023-12-12T10:12:29.764 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.722+0000 7f8d467fc640 1 -- 172.21.15.78:0/2499604518 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d48003ce0 con 0x7f8d50202b40 2023-12-12T10:12:29.764 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.722+0000 7f8d467fc640 1 -- 172.21.15.78:0/2499604518 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d4800aa30 con 0x7f8d50202b40 2023-12-12T10:12:29.764 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.722+0000 7f7a3bfff640 1 --2- 172.21.15.78:0/2871261066 >> [v2:172.21.15.187:6808/2944277204,v1:172.21.15.187:6809/2944277204] conn(0x7f7a4006fa70 0x7f7a40071eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:29.764 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.722+0000 7fd54e7fc640 1 -- 172.21.15.78:0/3463261534 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd550084010 con 0x7fd5581654e0 2023-12-12T10:12:29.765 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.722+0000 7f7a52ffd640 1 --2- 172.21.15.78:0/2871261066 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f7a40066530 0x7f7a400689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:29.765 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.722+0000 7fb12d901640 1 -- start start 2023-12-12T10:12:29.766 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.722+0000 7fd54e7fc640 1 --2- 172.21.15.78:0/3463261534 >> [v2:172.21.15.78:6817/3750796703,v1:172.21.15.78:6819/3750796703] conn(0x7fd53c06fab0 0x7fd53c071ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:29.766 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.722+0000 7fd55dec6640 1 --2- 172.21.15.78:0/3463261534 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fd53c066470 0x7fd53c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:29.766 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.722+0000 7fd54e7fc640 1 -- 172.21.15.78:0/3463261534 --> [v2:172.21.15.78:6817/3750796703,v1:172.21.15.78:6819/3750796703] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd53c0725c0 con 0x7fd53c06fab0 2023-12-12T10:12:29.766 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.722+0000 7f7a3bfff640 1 -- 172.21.15.78:0/2871261066 --> [v2:172.21.15.187:6808/2944277204,v1:172.21.15.187:6809/2944277204] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7a40072580 con 0x7f7a4006fa70 2023-12-12T10:12:29.766 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.722+0000 7f7a3bfff640 1 -- 172.21.15.78:0/2871261066 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7a440052d0 con 0x7f7a54160890 2023-12-12T10:12:29.767 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.722+0000 7fd54e7fc640 1 -- 172.21.15.78:0/3463261534 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd550086570 con 0x7fd5581654e0 2023-12-12T10:12:29.767 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.722+0000 7fd55d6c5640 1 --2- 172.21.15.78:0/3463261534 >> [v2:172.21.15.78:6817/3750796703,v1:172.21.15.78:6819/3750796703] conn(0x7fd53c06fab0 0x7fd53c071ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:29.767 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.722+0000 7f7a527fc640 1 --2- 172.21.15.78:0/2871261066 >> [v2:172.21.15.187:6808/2944277204,v1:172.21.15.187:6809/2944277204] conn(0x7f7a4006fa70 0x7f7a40071eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:29.767 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.722+0000 7f7a52ffd640 1 --2- 172.21.15.78:0/2871261066 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f7a40066530 0x7f7a400689f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c000f90 tx=0x7f7a4c0a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:29.768 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.726+0000 7fb12d901640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb128071d40 0x7fb128154800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:29.768 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.726+0000 7f8d56c4b640 1 -- 172.21.15.78:0/2499604518 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d500b2f70 con 0x7f8d50202b40 2023-12-12T10:12:29.768 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.726+0000 7f8d56c4b640 1 -- 172.21.15.78:0/2499604518 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d500b3530 con 0x7f8d50202b40 2023-12-12T10:12:29.769 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.726+0000 7fd55d6c5640 1 --2- 172.21.15.78:0/3463261534 >> [v2:172.21.15.78:6817/3750796703,v1:172.21.15.78:6819/3750796703] conn(0x7fd53c06fab0 0x7fd53c071ef0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:29.769 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.726+0000 7fb833fff640 1 --2- 172.21.15.78:0/3353898421 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb8341656b0 0x7fb8340b2c70 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb81c009870 tx=0x7fb81c01c530 comp rx=0 tx=0).ready entity=mon.1 client_cookie=84180ab57c704c01 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:29.769 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.726+0000 7fb12d901640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb1280b3380 0x7fb128157a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:29.769 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.726+0000 7fb12d901640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb1281654e0 0x7fb1281530e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:29.769 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.726+0000 7fb12d901640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb128152ea0 con 0x7fb128071d40 2023-12-12T10:12:29.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.726+0000 7fb12d901640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb128154d40 con 0x7fb1280b3380 2023-12-12T10:12:29.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.726+0000 7fb12d901640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb128152bc0 con 0x7fb1281654e0 2023-12-12T10:12:29.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.726+0000 7f8d56c4b640 1 -- 172.21.15.78:0/2499604518 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8d500d0ba0 con 0x7f8d50202b40 2023-12-12T10:12:29.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.726+0000 7fb1277fe640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb1281654e0 0x7fb1281530e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:29.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.726+0000 7fb1277fe640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb1281654e0 0x7fb1281530e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.78:47580/0 (socket says 172.21.15.78:47580) 2023-12-12T10:12:29.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.726+0000 7fb1277fe640 1 -- 172.21.15.78:0/1345659639 learned_addr learned my addr 172.21.15.78:0/1345659639 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:29.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.726+0000 7fb126ffd640 1 --2- 172.21.15.78:0/1345659639 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb128071d40 0x7fb128154800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:29.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.726+0000 7f7a527fc640 1 --2- 172.21.15.78:0/2871261066 >> [v2:172.21.15.187:6808/2944277204,v1:172.21.15.187:6809/2944277204] conn(0x7f7a4006fa70 0x7f7a40071eb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:29.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.726+0000 7fb8337fe640 1 -- 172.21.15.78:0/3353898421 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb81c0aa670 con 0x7fb8341656b0 2023-12-12T10:12:29.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.726+0000 7fb8337fe640 1 -- 172.21.15.78:0/3353898421 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb81c0aa7d0 con 0x7fb8341656b0 2023-12-12T10:12:29.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.726+0000 7fb8337fe640 1 -- 172.21.15.78:0/3353898421 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb81c0aab60 con 0x7fb8341656b0 2023-12-12T10:12:29.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.726+0000 7fb1267fc640 1 --2- 172.21.15.78:0/1345659639 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb1280b3380 0x7fb128157a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:29.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.726+0000 7fd55dec6640 1 --2- 172.21.15.78:0/3463261534 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fd53c066470 0x7fd53c068930 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd554009870 tx=0x7fd554008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:29.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.726+0000 7f7a3bfff640 1 -- 172.21.15.78:0/2871261066 <== osd.4 v2:172.21.15.187:6808/2944277204 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f7a40072580 con 0x7f7a4006fa70 2023-12-12T10:12:29.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.726+0000 7fb83b032640 1 -- 172.21.15.78:0/3353898421 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb8341656b0 msgr2=0x7fb8340b2c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:29.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.726+0000 7fb83b032640 1 --2- 172.21.15.78:0/3353898421 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb8341656b0 0x7fb8340b2c70 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb81c009870 tx=0x7fb81c01c530 comp rx=0 tx=0).stop 2023-12-12T10:12:29.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.726+0000 7fb126ffd640 1 -- 172.21.15.78:0/1345659639 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb1281654e0 msgr2=0x7fb1281530e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:29.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.726+0000 7fb126ffd640 1 --2- 172.21.15.78:0/1345659639 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb1281654e0 0x7fb1281530e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:29.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.726+0000 7fb83b032640 1 -- 172.21.15.78:0/3353898421 shutdown_connections 2023-12-12T10:12:29.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.726+0000 7fb83b032640 1 --2- 172.21.15.78:0/3353898421 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb8341656b0 0x7fb8340b2c70 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:29.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.726+0000 7fb83b032640 1 -- 172.21.15.78:0/3353898421 >> 172.21.15.78:0/3353898421 conn(0x7fb83406a710 msgr2=0x7fb83406ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:29.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.726+0000 7fb83b032640 1 -- 172.21.15.78:0/3353898421 shutdown_connections 2023-12-12T10:12:29.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.726+0000 7fb126ffd640 1 -- 172.21.15.78:0/1345659639 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb1280b3380 msgr2=0x7fb128157a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:29.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.726+0000 7fb126ffd640 1 --2- 172.21.15.78:0/1345659639 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb1280b3380 0x7fb128157a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:29.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.726+0000 7fb126ffd640 1 -- 172.21.15.78:0/1345659639 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1180094d0 con 0x7fb128071d40 2023-12-12T10:12:29.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.726+0000 7fd54e7fc640 1 -- 172.21.15.78:0/3463261534 <== osd.3 v2:172.21.15.78:6817/3750796703 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fd53c0725c0 con 0x7fd53c06fab0 2023-12-12T10:12:29.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.726+0000 7fb1277fe640 1 --2- 172.21.15.78:0/1345659639 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb1281654e0 0x7fb1281530e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-12T10:12:29.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.726+0000 7fb1267fc640 1 --2- 172.21.15.78:0/1345659639 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb1280b3380 0x7fb128157a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T10:12:29.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.726+0000 7f8d467fc640 1 -- 172.21.15.78:0/2499604518 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f8d4800ab90 con 0x7f8d50202b40 2023-12-12T10:12:29.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.726+0000 7fb83b032640 1 -- 172.21.15.78:0/3353898421 wait complete. 2023-12-12T10:12:29.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.730+0000 7fb126ffd640 1 --2- 172.21.15.78:0/1345659639 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb128071d40 0x7fb128154800 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fb1180ac000 tx=0x7fb11801ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:29.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.730+0000 7fb10ffff640 1 -- 172.21.15.78:0/1345659639 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1180b7420 con 0x7fb128071d40 2023-12-12T10:12:29.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.730+0000 7fb10ffff640 1 -- 172.21.15.78:0/1345659639 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1180b7580 con 0x7fb128071d40 2023-12-12T10:12:29.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.730+0000 7fb10ffff640 1 -- 172.21.15.78:0/1345659639 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1180b7930 con 0x7fb128071d40 2023-12-12T10:12:29.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.730+0000 7f8d467fc640 1 --2- 172.21.15.78:0/2499604518 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f8d340664f0 0x7f8d340689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:29.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.730+0000 7f8d467fc640 1 -- 172.21.15.78:0/2499604518 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8d48084a00 con 0x7f8d50202b40 2023-12-12T10:12:29.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.730+0000 7f8d467fc640 1 --2- 172.21.15.78:0/2499604518 >> [v2:172.21.15.187:6816/4213392126,v1:172.21.15.187:6817/4213392126] conn(0x7f8d3406fb30 0x7f8d34071f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:29.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.730+0000 7f8d467fc640 1 -- 172.21.15.78:0/2499604518 --> [v2:172.21.15.187:6816/4213392126,v1:172.21.15.187:6817/4213392126] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8d34072640 con 0x7f8d3406fb30 2023-12-12T10:12:29.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.730+0000 7f8d467fc640 1 -- 172.21.15.78:0/2499604518 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8d48084d70 con 0x7f8d50202b40 2023-12-12T10:12:29.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.730+0000 7f8d55c49640 1 --2- 172.21.15.78:0/2499604518 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f8d340664f0 0x7f8d340689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:29.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.730+0000 7fb83b032640 1 Processor -- start 2023-12-12T10:12:29.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.730+0000 7fb83b032640 1 -- start start 2023-12-12T10:12:29.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.730+0000 7f8d55c49640 1 --2- 172.21.15.78:0/2499604518 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f8d340664f0 0x7f8d340689b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8d4c00a9b0 tx=0x7f8d4c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:29.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.734+0000 7fb12d901640 1 -- 172.21.15.78:0/1345659639 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb128150610 con 0x7fb128071d40 2023-12-12T10:12:29.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.734+0000 7f8d55448640 1 --2- 172.21.15.78:0/2499604518 >> [v2:172.21.15.187:6816/4213392126,v1:172.21.15.187:6817/4213392126] conn(0x7f8d3406fb30 0x7f8d34071f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:29.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.734+0000 7fb83b032640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb834071d40 0x7fb8341546a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:29.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.734+0000 7fb83b032640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb8340b31b0 0x7fb8340cc570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:29.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.734+0000 7fb83b032640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb8341656b0 0x7fb8340ccab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:29.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.734+0000 7fb12d901640 1 -- 172.21.15.78:0/1345659639 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb128150bd0 con 0x7fb128071d40 2023-12-12T10:12:29.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.734+0000 7fb838dce640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb834071d40 0x7fb8341546a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:29.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.734+0000 7fb8395cf640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb8341656b0 0x7fb8340ccab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:29.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.734+0000 7fb838dce640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb834071d40 0x7fb8341546a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.78:38468/0 (socket says 172.21.15.78:38468) 2023-12-12T10:12:29.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.734+0000 7fb8395cf640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb8341656b0 0x7fb8340ccab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:36956/0 (socket says 172.21.15.78:36956) 2023-12-12T10:12:29.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.734+0000 7fb838dce640 1 -- 172.21.15.78:0/1974467428 learned_addr learned my addr 172.21.15.78:0/1974467428 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:29.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.734+0000 7fb83b032640 1 -- 172.21.15.78:0/1974467428 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8341405e0 con 0x7fb8341656b0 2023-12-12T10:12:29.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.734+0000 7fb83b032640 1 -- 172.21.15.78:0/1974467428 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb83413fcd0 con 0x7fb834071d40 2023-12-12T10:12:29.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.734+0000 7fb83b032640 1 -- 172.21.15.78:0/1974467428 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb834154be0 con 0x7fb8340b31b0 2023-12-12T10:12:29.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.734+0000 7fb12d901640 1 -- 172.21.15.78:0/1345659639 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb128067530 con 0x7fb128071d40 2023-12-12T10:12:29.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.734+0000 7fb833fff640 1 --2- 172.21.15.78:0/1974467428 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb8340b31b0 0x7fb8340cc570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:29.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.734+0000 7fb833fff640 1 -- 172.21.15.78:0/1974467428 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb834071d40 msgr2=0x7fb8341546a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:29.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.734+0000 7fb833fff640 1 --2- 172.21.15.78:0/1974467428 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb834071d40 0x7fb8341546a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:29.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.734+0000 7fb833fff640 1 -- 172.21.15.78:0/1974467428 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb8341656b0 msgr2=0x7fb8340ccab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:29.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.734+0000 7fb833fff640 1 --2- 172.21.15.78:0/1974467428 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb8341656b0 0x7fb8340ccab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:29.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.734+0000 7fb833fff640 1 -- 172.21.15.78:0/1974467428 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb81c0094d0 con 0x7fb8340b31b0 2023-12-12T10:12:29.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.734+0000 7fb8395cf640 1 --2- 172.21.15.78:0/1974467428 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb8341656b0 0x7fb8340ccab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-12T10:12:29.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.734+0000 7fb838dce640 1 --2- 172.21.15.78:0/1974467428 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb834071d40 0x7fb8341546a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T10:12:29.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.734+0000 7f8d55448640 1 --2- 172.21.15.78:0/2499604518 >> [v2:172.21.15.187:6816/4213392126,v1:172.21.15.187:6817/4213392126] conn(0x7f8d3406fb30 0x7f8d34071f70 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:29.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.734+0000 7fb833fff640 1 --2- 172.21.15.78:0/1974467428 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb8340b31b0 0x7fb8340cc570 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fb81c0ab000 tx=0x7fb81c0192d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:29.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.734+0000 7fb10ffff640 1 -- 172.21.15.78:0/1345659639 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb1180b3040 con 0x7fb128071d40 2023-12-12T10:12:29.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.738+0000 7fb8317fa640 1 -- 172.21.15.78:0/1974467428 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb81c0b4810 con 0x7fb8340b31b0 2023-12-12T10:12:29.784 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.738+0000 7fb8317fa640 1 -- 172.21.15.78:0/1974467428 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb81c0b4990 con 0x7fb8340b31b0 2023-12-12T10:12:29.784 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.738+0000 7fb83b032640 1 -- 172.21.15.78:0/1974467428 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb83413f6a0 con 0x7fb8340b31b0 2023-12-12T10:12:29.784 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.738+0000 7fb83b032640 1 -- 172.21.15.78:0/1974467428 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb834140200 con 0x7fb8340b31b0 2023-12-12T10:12:29.784 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.738+0000 7fb8317fa640 1 -- 172.21.15.78:0/1974467428 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb81c0b4d40 con 0x7fb8340b31b0 2023-12-12T10:12:29.785 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.738+0000 7fb10ffff640 1 --2- 172.21.15.78:0/1345659639 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fb1140664c0 0x7fb114068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:29.785 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.738+0000 7fb10ffff640 1 -- 172.21.15.78:0/1345659639 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb11811e120 con 0x7fb128071d40 2023-12-12T10:12:29.785 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.738+0000 7fb10ffff640 1 --2- 172.21.15.78:0/1345659639 >> [v2:172.21.15.187:6800/185858620,v1:172.21.15.187:6801/185858620] conn(0x7fb11406fb00 0x7fb114071f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:29.785 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.738+0000 7fb10ffff640 1 -- 172.21.15.78:0/1345659639 --> [v2:172.21.15.187:6800/185858620,v1:172.21.15.187:6801/185858620] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb114072610 con 0x7fb11406fb00 2023-12-12T10:12:29.785 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.738+0000 7fb10ffff640 1 -- 172.21.15.78:0/1345659639 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb118120700 con 0x7fb128071d40 2023-12-12T10:12:29.785 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.738+0000 7f8d467fc640 1 -- 172.21.15.78:0/2499604518 <== osd.6 v2:172.21.15.187:6816/4213392126 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f8d34072640 con 0x7f8d3406fb30 2023-12-12T10:12:29.786 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.738+0000 7fb1277fe640 1 --2- 172.21.15.78:0/1345659639 >> [v2:172.21.15.187:6800/185858620,v1:172.21.15.187:6801/185858620] conn(0x7fb11406fb00 0x7fb114071f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:29.786 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.738+0000 7fb1277fe640 1 --2- 172.21.15.78:0/1345659639 >> [v2:172.21.15.187:6800/185858620,v1:172.21.15.187:6801/185858620] conn(0x7fb11406fb00 0x7fb114071f40 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:29.786 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.742+0000 7f6585ffb640 1 -- 172.21.15.78:0/3541143680 --> [v2:172.21.15.78:6816/2910206054,v1:172.21.15.78:6818/2910206054] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f65a00b29c0 con 0x7f658c06fa30 2023-12-12T10:12:29.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.738+0000 7fb83b032640 1 -- 172.21.15.78:0/1974467428 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb818000fd0 con 0x7fb8340b31b0 2023-12-12T10:12:29.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.742+0000 7fb8317fa640 1 -- 172.21.15.78:0/1974467428 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb81c0be450 con 0x7fb8340b31b0 2023-12-12T10:12:29.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.742+0000 7f6587fff640 1 -- 172.21.15.78:0/3541143680 <== osd.2 v2:172.21.15.78:6816/2910206054 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f65a00b29c0 con 0x7f658c06fa30 2023-12-12T10:12:29.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.742+0000 7f49477fe640 1 -- 172.21.15.78:0/1049517226 --> [v2:172.21.15.78:6808/3345683600,v1:172.21.15.78:6809/3345683600] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f496415d900 con 0x7f494806fb80 2023-12-12T10:12:29.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.742+0000 7fb10ffff640 1 -- 172.21.15.78:0/1345659639 <== osd.5 v2:172.21.15.187:6800/185858620 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fb114072610 con 0x7fb11406fb00 2023-12-12T10:12:29.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.742+0000 7f6585ffb640 1 -- 172.21.15.78:0/3541143680 >> [v2:172.21.15.78:6816/2910206054,v1:172.21.15.78:6818/2910206054] conn(0x7f658c06fa30 msgr2=0x7f658c071e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:29.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.742+0000 7f6585ffb640 1 --2- 172.21.15.78:0/3541143680 >> [v2:172.21.15.78:6816/2910206054,v1:172.21.15.78:6818/2910206054] conn(0x7f658c06fa30 0x7f658c071e70 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:29.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.742+0000 7f6585ffb640 1 -- 172.21.15.78:0/3541143680 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f658c066470 msgr2=0x7f658c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:29.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.742+0000 7f6585ffb640 1 --2- 172.21.15.78:0/3541143680 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f658c066470 0x7f658c068930 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f659801c940 tx=0x7f65980a7070 comp rx=0 tx=0).stop 2023-12-12T10:12:29.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.742+0000 7f6585ffb640 1 -- 172.21.15.78:0/3541143680 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f65a0142890 msgr2=0x7f65a013ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:29.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.742+0000 7f6585ffb640 1 --2- 172.21.15.78:0/3541143680 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f65a0142890 0x7f65a013ecf0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f659400d5f0 tx=0x7f659400dab0 comp rx=0 tx=0).stop 2023-12-12T10:12:29.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.742+0000 7f659f7fe640 1 -- 172.21.15.78:0/3541143680 reap_dead start 2023-12-12T10:12:29.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.742+0000 7f6585ffb640 1 -- 172.21.15.78:0/3541143680 shutdown_connections 2023-12-12T10:12:29.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.742+0000 7f6585ffb640 1 -- 172.21.15.78:0/3541143680 >> 172.21.15.78:0/3541143680 conn(0x7f65a00b0750 msgr2=0x7f65a00ce3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:29.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.742+0000 7f6585ffb640 1 -- 172.21.15.78:0/3541143680 shutdown_connections 2023-12-12T10:12:29.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.742+0000 7f6585ffb640 1 -- 172.21.15.78:0/3541143680 wait complete. 2023-12-12T10:12:29.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.742+0000 7fb8317fa640 1 --2- 172.21.15.78:0/1974467428 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fb814066470 0x7fb814068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:29.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.742+0000 7fb8317fa640 1 -- 172.21.15.78:0/1974467428 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb81c11f3b0 con 0x7fb8340b31b0 2023-12-12T10:12:29.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.742+0000 7fb8317fa640 1 --2- 172.21.15.78:0/1974467428 >> [v2:172.21.15.187:6823/85774004,v1:172.21.15.187:6825/85774004] conn(0x7fb81406fab0 0x7fb814071ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:29.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.742+0000 7fb8317fa640 1 -- 172.21.15.78:0/1974467428 --> [v2:172.21.15.187:6823/85774004,v1:172.21.15.187:6825/85774004] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb8140725c0 con 0x7fb81406fab0 2023-12-12T10:12:29.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.742+0000 7fb8317fa640 1 -- 172.21.15.78:0/1974467428 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb81c1219d0 con 0x7fb8340b31b0 2023-12-12T10:12:29.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.742+0000 7fb8395cf640 1 --2- 172.21.15.78:0/1974467428 >> [v2:172.21.15.187:6823/85774004,v1:172.21.15.187:6825/85774004] conn(0x7fb81406fab0 0x7fb814071ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:29.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.742+0000 7f4959ffb640 1 -- 172.21.15.78:0/1049517226 <== osd.0 v2:172.21.15.78:6808/3345683600 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f496415d900 con 0x7f494806fb80 2023-12-12T10:12:29.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.742+0000 7fb1267fc640 1 --2- 172.21.15.78:0/1345659639 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fb1140664c0 0x7fb114068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:29.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.742+0000 7f496b357640 1 -- 172.21.15.78:0/1049517226 >> [v2:172.21.15.78:6808/3345683600,v1:172.21.15.78:6809/3345683600] conn(0x7f494806fb80 msgr2=0x7f4948071fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:29.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.742+0000 7f496b357640 1 --2- 172.21.15.78:0/1049517226 >> [v2:172.21.15.78:6808/3345683600,v1:172.21.15.78:6809/3345683600] conn(0x7f494806fb80 0x7f4948071fc0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:29.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.746+0000 7fb1267fc640 1 --2- 172.21.15.78:0/1345659639 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fb1140664c0 0x7fb114068980 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb128154450 tx=0x7fb11c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:29.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.746+0000 7fb8395cf640 1 --2- 172.21.15.78:0/1974467428 >> [v2:172.21.15.187:6823/85774004,v1:172.21.15.187:6825/85774004] conn(0x7fb81406fab0 0x7fb814071ef0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:29.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.746+0000 7fb838dce640 1 --2- 172.21.15.78:0/1974467428 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fb814066470 0x7fb814068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:29.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.746+0000 7fb8317fa640 1 -- 172.21.15.78:0/1974467428 <== osd.7 v2:172.21.15.187:6823/85774004 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fb8140725c0 con 0x7fb81406fab0 2023-12-12T10:12:29.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.746+0000 7fb838dce640 1 --2- 172.21.15.78:0/1974467428 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fb814066470 0x7fb814068930 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb8341585c0 tx=0x7fb82c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:29.793 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.746+0000 7f496b357640 1 -- 172.21.15.78:0/1049517226 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f4948066540 msgr2=0x7f4948068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:29.793 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.746+0000 7f496b357640 1 --2- 172.21.15.78:0/1049517226 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f4948066540 0x7f4948068a00 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f49641f9590 tx=0x7f4954009040 comp rx=0 tx=0).stop 2023-12-12T10:12:29.793 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.746+0000 7f496b357640 1 -- 172.21.15.78:0/1049517226 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4964071e20 msgr2=0x7f4964145ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:29.793 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.746+0000 7f496b357640 1 --2- 172.21.15.78:0/1049517226 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4964071e20 0x7f4964145ff0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f49600af040 tx=0x7f496001ac00 comp rx=0 tx=0).stop 2023-12-12T10:12:29.793 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.746+0000 7f9a42805640 1 -- 172.21.15.78:0/423199180 --> [v2:172.21.15.78:6800/962652768,v1:172.21.15.78:6801/962652768] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9a3c070e00 con 0x7f9a1c06fae0 2023-12-12T10:12:29.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.746+0000 7f49698f4640 1 -- 172.21.15.78:0/1049517226 reap_dead start 2023-12-12T10:12:29.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.746+0000 7f496b357640 1 -- 172.21.15.78:0/1049517226 shutdown_connections 2023-12-12T10:12:29.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.746+0000 7f496b357640 1 -- 172.21.15.78:0/1049517226 >> 172.21.15.78:0/1049517226 conn(0x7f49640b0b20 msgr2=0x7f49640cd180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:29.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.746+0000 7f9a38ff9640 1 -- 172.21.15.78:0/423199180 <== osd.1 v2:172.21.15.78:6800/962652768 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f9a24001990 con 0x7f9a1c06fae0 2023-12-12T10:12:29.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.746+0000 7f9a42805640 1 -- 172.21.15.78:0/423199180 >> [v2:172.21.15.78:6800/962652768,v1:172.21.15.78:6801/962652768] conn(0x7f9a1c06fae0 msgr2=0x7f9a1c071f20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:29.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.746+0000 7f9a42805640 1 --2- 172.21.15.78:0/423199180 >> [v2:172.21.15.78:6800/962652768,v1:172.21.15.78:6801/962652768] conn(0x7f9a1c06fae0 0x7f9a1c071f20 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:29.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.750+0000 7f9a42805640 1 -- 172.21.15.78:0/423199180 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f9a1c0664a0 msgr2=0x7f9a1c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:29.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.750+0000 7f9a42805640 1 --2- 172.21.15.78:0/423199180 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f9a1c0664a0 0x7f9a1c068960 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f9a3c158450 tx=0x7f9a3400b040 comp rx=0 tx=0).stop 2023-12-12T10:12:29.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.750+0000 7f9a42805640 1 -- 172.21.15.78:0/423199180 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9a28003bb0 msgr2=0x7f9a3c153490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:29.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.750+0000 7f9a42805640 1 --2- 172.21.15.78:0/423199180 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9a28003bb0 0x7f9a3c153490 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f9a2c000c10 tx=0x7f9a28005800 comp rx=0 tx=0).stop 2023-12-12T10:12:29.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.750+0000 7f9a40da2640 1 -- 172.21.15.78:0/423199180 reap_dead start 2023-12-12T10:12:29.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.750+0000 7f496b357640 1 -- 172.21.15.78:0/1049517226 shutdown_connections 2023-12-12T10:12:29.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.750+0000 7f496b357640 1 -- 172.21.15.78:0/1049517226 wait complete. 2023-12-12T10:12:29.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.750+0000 7f9a42805640 1 -- 172.21.15.78:0/423199180 shutdown_connections 2023-12-12T10:12:29.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.750+0000 7f9a42805640 1 -- 172.21.15.78:0/423199180 >> 172.21.15.78:0/423199180 conn(0x7f9a3c0b0b20 msgr2=0x7f9a3c0afbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:29.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.750+0000 7f9a42805640 1 -- 172.21.15.78:0/423199180 shutdown_connections 2023-12-12T10:12:29.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.750+0000 7f9a42805640 1 -- 172.21.15.78:0/423199180 wait complete. 2023-12-12T10:12:29.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.758+0000 7f7a59957640 1 -- 172.21.15.78:0/2871261066 --> [v2:172.21.15.187:6808/2944277204,v1:172.21.15.187:6809/2944277204] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7a540cef00 con 0x7f7a4006fa70 2023-12-12T10:12:29.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.758+0000 7f7a3bfff640 1 -- 172.21.15.78:0/2871261066 <== osd.4 v2:172.21.15.187:6808/2944277204 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f7a480047f0 con 0x7f7a4006fa70 2023-12-12T10:12:29.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.758+0000 7fd56012a640 1 -- 172.21.15.78:0/3463261534 --> [v2:172.21.15.78:6817/3750796703,v1:172.21.15.78:6819/3750796703] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd540002cc0 con 0x7fd53c06fab0 2023-12-12T10:12:29.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.762+0000 7f7a59957640 1 -- 172.21.15.78:0/2871261066 >> [v2:172.21.15.187:6808/2944277204,v1:172.21.15.187:6809/2944277204] conn(0x7f7a4006fa70 msgr2=0x7f7a40071eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:29.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.762+0000 7f7a59957640 1 --2- 172.21.15.78:0/2871261066 >> [v2:172.21.15.187:6808/2944277204,v1:172.21.15.187:6809/2944277204] conn(0x7f7a4006fa70 0x7f7a40071eb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:29.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.762+0000 7f7a59957640 1 -- 172.21.15.78:0/2871261066 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f7a40066530 msgr2=0x7f7a400689f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:29.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.762+0000 7f7a59957640 1 --2- 172.21.15.78:0/2871261066 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f7a40066530 0x7f7a400689f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c000f90 tx=0x7f7a4c0a7070 comp rx=0 tx=0).stop 2023-12-12T10:12:29.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.762+0000 7f7a59957640 1 -- 172.21.15.78:0/2871261066 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7a54160890 msgr2=0x7f7a54156920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:29.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.762+0000 7f7a59957640 1 --2- 172.21.15.78:0/2871261066 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7a54160890 0x7f7a54156920 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f7a4400c390 tx=0x7f7a4400c850 comp rx=0 tx=0).stop 2023-12-12T10:12:29.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.762+0000 7f7a537fe640 1 -- 172.21.15.78:0/2871261066 reap_dead start 2023-12-12T10:12:29.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.762+0000 7f7a59957640 1 -- 172.21.15.78:0/2871261066 shutdown_connections 2023-12-12T10:12:29.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.762+0000 7f7a59957640 1 -- 172.21.15.78:0/2871261066 >> 172.21.15.78:0/2871261066 conn(0x7f7a5409c2f0 msgr2=0x7f7a5406c950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:29.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.762+0000 7f7a59957640 1 -- 172.21.15.78:0/2871261066 shutdown_connections 2023-12-12T10:12:29.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.762+0000 7f7a59957640 1 -- 172.21.15.78:0/2871261066 wait complete. 2023-12-12T10:12:29.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.766+0000 7fd54e7fc640 1 -- 172.21.15.78:0/3463261534 <== osd.3 v2:172.21.15.78:6817/3750796703 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd540002cc0 con 0x7fd53c06fab0 2023-12-12T10:12:29.800 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.766+0000 7fd56012a640 1 -- 172.21.15.78:0/3463261534 >> [v2:172.21.15.78:6817/3750796703,v1:172.21.15.78:6819/3750796703] conn(0x7fd53c06fab0 msgr2=0x7fd53c071ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:29.800 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.766+0000 7fd56012a640 1 --2- 172.21.15.78:0/3463261534 >> [v2:172.21.15.78:6817/3750796703,v1:172.21.15.78:6819/3750796703] conn(0x7fd53c06fab0 0x7fd53c071ef0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:29.800 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.766+0000 7fd56012a640 1 -- 172.21.15.78:0/3463261534 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fd53c066470 msgr2=0x7fd53c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:29.800 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.766+0000 7fd56012a640 1 --2- 172.21.15.78:0/3463261534 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fd53c066470 0x7fd53c068930 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd554009870 tx=0x7fd554008040 comp rx=0 tx=0).stop 2023-12-12T10:12:29.800 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.766+0000 7fd56012a640 1 -- 172.21.15.78:0/3463261534 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd5581654e0 msgr2=0x7fd558160310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:29.800 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.766+0000 7fd56012a640 1 --2- 172.21.15.78:0/3463261534 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd5581654e0 0x7fd558160310 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fd55000b970 tx=0x7fd55000be30 comp rx=0 tx=0).stop 2023-12-12T10:12:29.800 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.766+0000 7fd55e6c7640 1 -- 172.21.15.78:0/3463261534 reap_dead start 2023-12-12T10:12:29.800 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.766+0000 7f8d56c4b640 1 -- 172.21.15.78:0/2499604518 --> [v2:172.21.15.187:6816/4213392126,v1:172.21.15.187:6817/4213392126] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8d500745a0 con 0x7f8d3406fb30 2023-12-12T10:12:29.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.766+0000 7fd56012a640 1 -- 172.21.15.78:0/3463261534 shutdown_connections 2023-12-12T10:12:29.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.766+0000 7fd56012a640 1 -- 172.21.15.78:0/3463261534 >> 172.21.15.78:0/3463261534 conn(0x7fd55806a710 msgr2=0x7fd5580af3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:29.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.766+0000 7f8d467fc640 1 -- 172.21.15.78:0/2499604518 <== osd.6 v2:172.21.15.187:6816/4213392126 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f8d500745a0 con 0x7f8d3406fb30 2023-12-12T10:12:29.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.766+0000 7fd56012a640 1 -- 172.21.15.78:0/3463261534 shutdown_connections 2023-12-12T10:12:29.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.766+0000 7fd56012a640 1 -- 172.21.15.78:0/3463261534 wait complete. 2023-12-12T10:12:29.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.770+0000 7f8d56c4b640 1 -- 172.21.15.78:0/2499604518 >> [v2:172.21.15.187:6816/4213392126,v1:172.21.15.187:6817/4213392126] conn(0x7f8d3406fb30 msgr2=0x7f8d34071f70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:29.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.770+0000 7f8d56c4b640 1 --2- 172.21.15.78:0/2499604518 >> [v2:172.21.15.187:6816/4213392126,v1:172.21.15.187:6817/4213392126] conn(0x7f8d3406fb30 0x7f8d34071f70 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:29.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.770+0000 7f8d56c4b640 1 -- 172.21.15.78:0/2499604518 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f8d340664f0 msgr2=0x7f8d340689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:29.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.770+0000 7f8d56c4b640 1 --2- 172.21.15.78:0/2499604518 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f8d340664f0 0x7f8d340689b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8d4c00a9b0 tx=0x7f8d4c008040 comp rx=0 tx=0).stop 2023-12-12T10:12:29.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.770+0000 7f8d56c4b640 1 -- 172.21.15.78:0/2499604518 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8d50202b40 msgr2=0x7f8d500cf150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:29.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.770+0000 7f8d56c4b640 1 --2- 172.21.15.78:0/2499604518 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8d50202b40 0x7f8d500cf150 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f8d4800c730 tx=0x7f8d4800cbf0 comp rx=0 tx=0).stop 2023-12-12T10:12:29.803 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.770+0000 7fb83b032640 1 -- 172.21.15.78:0/1974467428 --> [v2:172.21.15.187:6823/85774004,v1:172.21.15.187:6825/85774004] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb818002cc0 con 0x7fb81406fab0 2023-12-12T10:12:29.803 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.770+0000 7fb8317fa640 1 -- 172.21.15.78:0/1974467428 <== osd.7 v2:172.21.15.187:6823/85774004 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb818002cc0 con 0x7fb81406fab0 2023-12-12T10:12:29.803 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.770+0000 7fb83b032640 1 -- 172.21.15.78:0/1974467428 >> [v2:172.21.15.187:6823/85774004,v1:172.21.15.187:6825/85774004] conn(0x7fb81406fab0 msgr2=0x7fb814071ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:29.803 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.770+0000 7fb83b032640 1 --2- 172.21.15.78:0/1974467428 >> [v2:172.21.15.187:6823/85774004,v1:172.21.15.187:6825/85774004] conn(0x7fb81406fab0 0x7fb814071ef0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:29.803 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.770+0000 7fb83b032640 1 -- 172.21.15.78:0/1974467428 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fb814066470 msgr2=0x7fb814068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:29.803 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.770+0000 7fb83b032640 1 --2- 172.21.15.78:0/1974467428 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fb814066470 0x7fb814068930 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb8341585c0 tx=0x7fb82c009040 comp rx=0 tx=0).stop 2023-12-12T10:12:29.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.770+0000 7fb83b032640 1 -- 172.21.15.78:0/1974467428 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb8340b31b0 msgr2=0x7fb8340cc570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:29.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.770+0000 7fb83b032640 1 --2- 172.21.15.78:0/1974467428 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb8340b31b0 0x7fb8340cc570 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fb81c0ab000 tx=0x7fb81c0192d0 comp rx=0 tx=0).stop 2023-12-12T10:12:29.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.770+0000 7fb8395cf640 1 -- 172.21.15.78:0/1974467428 reap_dead start 2023-12-12T10:12:29.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.770+0000 7f8d5644a640 1 -- 172.21.15.78:0/2499604518 reap_dead start 2023-12-12T10:12:29.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.770+0000 7fb83b032640 1 -- 172.21.15.78:0/1974467428 shutdown_connections 2023-12-12T10:12:29.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.770+0000 7fb83b032640 1 -- 172.21.15.78:0/1974467428 >> 172.21.15.78:0/1974467428 conn(0x7fb83406a710 msgr2=0x7fb8340ce190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:29.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.770+0000 7f8d56c4b640 1 -- 172.21.15.78:0/2499604518 shutdown_connections 2023-12-12T10:12:29.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.770+0000 7f8d56c4b640 1 -- 172.21.15.78:0/2499604518 >> 172.21.15.78:0/2499604518 conn(0x7f8d500d2dc0 msgr2=0x7f8d501541f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:29.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.770+0000 7f8d56c4b640 1 -- 172.21.15.78:0/2499604518 shutdown_connections 2023-12-12T10:12:29.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.770+0000 7f8d56c4b640 1 -- 172.21.15.78:0/2499604518 wait complete. 2023-12-12T10:12:29.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.770+0000 7fb83b032640 1 -- 172.21.15.78:0/1974467428 shutdown_connections 2023-12-12T10:12:29.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.770+0000 7fb83b032640 1 -- 172.21.15.78:0/1974467428 wait complete. 2023-12-12T10:12:29.806 INFO:teuthology.orchestra.run.smithi078.stdout:55834574859 2023-12-12T10:12:29.807 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-12-12T10:12:29.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.778+0000 7fb12d901640 1 -- 172.21.15.78:0/1345659639 --> [v2:172.21.15.187:6800/185858620,v1:172.21.15.187:6801/185858620] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb128150dc0 con 0x7fb11406fb00 2023-12-12T10:12:29.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.778+0000 7fb10ffff640 1 -- 172.21.15.78:0/1345659639 <== osd.5 v2:172.21.15.187:6800/185858620 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb128150dc0 con 0x7fb11406fb00 2023-12-12T10:12:29.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.782+0000 7fb12d901640 1 -- 172.21.15.78:0/1345659639 >> [v2:172.21.15.187:6800/185858620,v1:172.21.15.187:6801/185858620] conn(0x7fb11406fb00 msgr2=0x7fb114071f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:29.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.782+0000 7fb12d901640 1 --2- 172.21.15.78:0/1345659639 >> [v2:172.21.15.187:6800/185858620,v1:172.21.15.187:6801/185858620] conn(0x7fb11406fb00 0x7fb114071f40 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:29.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.786+0000 7fb12d901640 1 -- 172.21.15.78:0/1345659639 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fb1140664c0 msgr2=0x7fb114068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:29.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.786+0000 7fb12d901640 1 --2- 172.21.15.78:0/1345659639 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fb1140664c0 0x7fb114068980 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb128154450 tx=0x7fb11c008040 comp rx=0 tx=0).stop 2023-12-12T10:12:29.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.786+0000 7fb12d901640 1 -- 172.21.15.78:0/1345659639 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb128071d40 msgr2=0x7fb128154800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:29.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.786+0000 7fb12d901640 1 --2- 172.21.15.78:0/1345659639 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb128071d40 0x7fb128154800 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fb1180ac000 tx=0x7fb11801ad10 comp rx=0 tx=0).stop 2023-12-12T10:12:29.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.786+0000 7fb1277fe640 1 -- 172.21.15.78:0/1345659639 reap_dead start 2023-12-12T10:12:29.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.786+0000 7fb12d901640 1 -- 172.21.15.78:0/1345659639 shutdown_connections 2023-12-12T10:12:29.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.786+0000 7fb12d901640 1 -- 172.21.15.78:0/1345659639 >> 172.21.15.78:0/1345659639 conn(0x7fb12806a710 msgr2=0x7fb1280b0250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:29.809 INFO:teuthology.orchestra.run.smithi078.stdout:55834574858 2023-12-12T10:12:29.809 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-12-12T10:12:29.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.786+0000 7fb12d901640 1 -- 172.21.15.78:0/1345659639 shutdown_connections 2023-12-12T10:12:29.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:29.786+0000 7fb12d901640 1 -- 172.21.15.78:0/1345659639 wait complete. 2023-12-12T10:12:29.811 INFO:teuthology.orchestra.run.smithi078.stdout:55834574858 2023-12-12T10:12:29.815 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-12-12T10:12:29.815 INFO:teuthology.orchestra.run.smithi078.stdout:55834574858 2023-12-12T10:12:29.816 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-12-12T10:12:29.817 INFO:teuthology.orchestra.run.smithi078.stdout:55834574857 2023-12-12T10:12:29.817 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-12-12T10:12:29.820 INFO:teuthology.orchestra.run.smithi078.stdout:55834574857 2023-12-12T10:12:29.820 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-12-12T10:12:29.821 INFO:teuthology.orchestra.run.smithi078.stdout:55834574857 2023-12-12T10:12:29.821 INFO:teuthology.orchestra.run.smithi078.stdout:55834574857 2023-12-12T10:12:29.821 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-12-12T10:12:29.822 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-12-12T10:12:30.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.058+0000 7f4653d80640 1 Processor -- start 2023-12-12T10:12:30.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.058+0000 7f71b6780640 1 Processor -- start 2023-12-12T10:12:30.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.062+0000 7f71b6780640 1 -- start start 2023-12-12T10:12:30.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.062+0000 7f4653d80640 1 -- start start 2023-12-12T10:12:30.069 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.062+0000 7f71b6780640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f71b0164e40 0x7f71b00ce370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:30.069 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.062+0000 7f71b6780640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71b0165d70 con 0x7f71b00cb3d0 2023-12-12T10:12:30.069 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.062+0000 7f71b6780640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71b01654d0 con 0x7f71b0161200 2023-12-12T10:12:30.069 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.062+0000 7f71b6780640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71b006c870 con 0x7f71b0164e40 2023-12-12T10:12:30.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.062+0000 7f4653d80640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f464c142890 0x7f464c15caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:30.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.062+0000 7f4653d80640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f464c159f30 0x7f464c06c870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:30.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.062+0000 7f4653d80640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f464c0ce1d0 con 0x7f464c0b1270 2023-12-12T10:12:30.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.062+0000 7f4653d80640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f464c15d9d0 con 0x7f464c142890 2023-12-12T10:12:30.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.062+0000 7f71b4d1d640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f71b00cb3d0 0x7f71b00cb840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:34286/0 (socket says 172.21.15.78:34286) 2023-12-12T10:12:30.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.062+0000 7f4653d80640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f464c15a380 con 0x7f464c159f30 2023-12-12T10:12:30.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.062+0000 7f71b4d1d640 1 -- 172.21.15.78:0/2723752189 learned_addr learned my addr 172.21.15.78:0/2723752189 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-12-12T10:12:30.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.062+0000 7f465231d640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f464c159f30 0x7f464c06c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:30.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.066+0000 7f465231d640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f464c159f30 0x7f464c06c870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.78:47600/0 (socket says 172.21.15.78:47600) 2023-12-12T10:12:30.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.066+0000 7f465231d640 1 -- 172.21.15.78:0/2532837120 learned_addr learned my addr 172.21.15.78:0/2532837120 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:30.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.066+0000 7f71aeffd640 1 -- 172.21.15.78:0/2723752189 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 332406392 0 0) 0x7f71b0165d70 con 0x7f71b00cb3d0 2023-12-12T10:12:30.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.066+0000 7f71aeffd640 1 -- 172.21.15.78:0/2723752189 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7198003530 con 0x7f71b00cb3d0 2023-12-12T10:12:30.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.066+0000 7f71af7fe640 1 --2- 172.21.15.78:0/2723752189 >> v2:172.21.15.187:3300/0 conn(0x7f71b0164e40 0x7f71b00ce370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:30.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.066+0000 7f465231d640 1 -- 172.21.15.78:0/2532837120 >> v2:172.21.15.187:3300/0 conn(0x7f464c142890 msgr2=0x7f464c15caa0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-12-12T10:12:30.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.066+0000 7f465231d640 1 --2- 172.21.15.78:0/2532837120 >> v2:172.21.15.187:3300/0 conn(0x7f464c142890 0x7f464c15caa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:30.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.066+0000 7f465231d640 1 -- 172.21.15.78:0/2532837120 >> v1:172.21.15.78:6789/0 conn(0x7f464c0b1270 legacy=0x7f464c06c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:30.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.066+0000 7f465231d640 1 -- 172.21.15.78:0/2532837120 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f464c15d130 con 0x7f464c159f30 2023-12-12T10:12:30.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.066+0000 7f71aeffd640 1 -- 172.21.15.78:0/2723752189 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1366111164 0 0) 0x7f71b01654d0 con 0x7f71b0161200 2023-12-12T10:12:30.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.066+0000 7f71aeffd640 1 -- 172.21.15.78:0/2723752189 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7198003850 con 0x7f71b0161200 2023-12-12T10:12:30.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.066+0000 7f71aeffd640 1 -- 172.21.15.78:0/2723752189 <== mon.1 v1:172.21.15.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1086187539 0 0) 0x7f7198003850 con 0x7f71b0161200 2023-12-12T10:12:30.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.066+0000 7f71aeffd640 1 -- 172.21.15.78:0/2723752189 >> v2:172.21.15.187:3300/0 conn(0x7f71b0164e40 msgr2=0x7f71b00ce370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:30.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.066+0000 7f71aeffd640 1 --2- 172.21.15.78:0/2723752189 >> v2:172.21.15.187:3300/0 conn(0x7f71b0164e40 0x7f71b00ce370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:30.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.066+0000 7f71aeffd640 1 -- 172.21.15.78:0/2723752189 >> v1:172.21.15.78:6789/0 conn(0x7f71b00cb3d0 legacy=0x7f71b00cb840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:30.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.066+0000 7f71aeffd640 1 -- 172.21.15.78:0/2723752189 --> v1:172.21.15.187:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71b01657b0 con 0x7f71b0161200 2023-12-12T10:12:30.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.066+0000 7f71aeffd640 1 -- 172.21.15.78:0/2723752189 <== mon.1 v1:172.21.15.187:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 465499599 0 0) 0x7f71a8001a00 con 0x7f71b0161200 2023-12-12T10:12:30.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.066+0000 7f71aeffd640 1 -- 172.21.15.78:0/2723752189 >> v1:172.21.15.187:6789/0 conn(0x7f71b0161200 legacy=0x7f71b006c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:30.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.066+0000 7f71aeffd640 1 --2- 172.21.15.78:0/2723752189 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7198003d10 0x7f7198004130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:30.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.066+0000 7f71aeffd640 1 --2- 172.21.15.78:0/2723752189 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7198004820 0x7f7198004ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:30.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.066+0000 7f71aeffd640 1 --2- 172.21.15.78:0/2723752189 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f71980053a0 0x7f719800ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:30.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.066+0000 7f71aeffd640 1 -- 172.21.15.78:0/2723752189 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71b006c870 con 0x7f71980053a0 2023-12-12T10:12:30.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.066+0000 7f71aeffd640 1 -- 172.21.15.78:0/2723752189 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f719800c2f0 con 0x7f7198004820 2023-12-12T10:12:30.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.066+0000 7f71aeffd640 1 -- 172.21.15.78:0/2723752189 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f719800c4b0 con 0x7f7198003d10 2023-12-12T10:12:30.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.066+0000 7f71af7fe640 1 --2- 172.21.15.78:0/2723752189 >> v2:172.21.15.187:3300/0 conn(0x7f71b0164e40 0x7f71b00ce370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T10:12:30.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.066+0000 7f71b4d1d640 1 --2- 172.21.15.78:0/2723752189 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f71980053a0 0x7f719800ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:30.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.066+0000 7f71af7fe640 1 --2- 172.21.15.78:0/2723752189 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7198004820 0x7f7198004ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:30.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.066+0000 7f71af7fe640 1 -- 172.21.15.78:0/2723752189 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7198003d10 msgr2=0x7f7198004130 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-12T10:12:30.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.066+0000 7f71af7fe640 1 --2- 172.21.15.78:0/2723752189 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7198003d10 0x7f7198004130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:30.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.066+0000 7f71af7fe640 1 -- 172.21.15.78:0/2723752189 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f71980053a0 msgr2=0x7f719800ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:30.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.066+0000 7f71af7fe640 1 --2- 172.21.15.78:0/2723752189 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f71980053a0 0x7f719800ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:30.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.066+0000 7f71af7fe640 1 -- 172.21.15.78:0/2723752189 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7198003850 con 0x7f7198004820 2023-12-12T10:12:30.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.070+0000 7f71b4d1d640 1 -- 172.21.15.78:0/2723752189 reap_dead start 2023-12-12T10:12:30.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.070+0000 7fbcb81f8640 1 Processor -- start 2023-12-12T10:12:30.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.070+0000 7f465231d640 1 --2- 172.21.15.78:0/2532837120 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f464c159f30 0x7f464c06c870 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f4644009e50 tx=0x7f464401ec10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=29128ac0dc5d8c38 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:30.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.074+0000 7f71af7fe640 1 --2- 172.21.15.78:0/2723752189 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7198004820 0x7f7198004ca0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f71a400ab90 tx=0x7f71a401c730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e39ffd002ab9dd9f server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:30.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.074+0000 7fbcb81f8640 1 -- start start 2023-12-12T10:12:30.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.074+0000 7fbcb81f8640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fbca8033e40 0x7fbca80eb180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:30.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.074+0000 7fbcb81f8640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbca8037bc0 con 0x7fbca8047c20 2023-12-12T10:12:30.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.074+0000 7fbcb81f8640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbca804f090 con 0x7fbca8005ea0 2023-12-12T10:12:30.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.074+0000 7fbcb81f8640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbca8050210 con 0x7fbca8033e40 2023-12-12T10:12:30.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.074+0000 7f4650b1a640 1 -- 172.21.15.78:0/2532837120 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46440a7ae0 con 0x7f464c159f30 2023-12-12T10:12:30.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.074+0000 7f4650b1a640 1 -- 172.21.15.78:0/2532837120 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46440a7c40 con 0x7f464c159f30 2023-12-12T10:12:30.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.074+0000 7f4650b1a640 1 -- 172.21.15.78:0/2532837120 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46440af3f0 con 0x7f464c159f30 2023-12-12T10:12:30.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.074+0000 7f71aeffd640 1 -- 172.21.15.78:0/2723752189 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a40a6620 con 0x7f7198004820 2023-12-12T10:12:30.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.074+0000 7f71aeffd640 1 -- 172.21.15.78:0/2723752189 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71a40a6780 con 0x7f7198004820 2023-12-12T10:12:30.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.074+0000 7f71aeffd640 1 -- 172.21.15.78:0/2723752189 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a40a6b30 con 0x7f7198004820 2023-12-12T10:12:30.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.074+0000 7f71b6780640 1 -- 172.21.15.78:0/2723752189 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7198004820 msgr2=0x7f7198004ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:30.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.074+0000 7f71b6780640 1 --2- 172.21.15.78:0/2723752189 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7198004820 0x7f7198004ca0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f71a400ab90 tx=0x7f71a401c730 comp rx=0 tx=0).stop 2023-12-12T10:12:30.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.074+0000 7f4653d80640 1 -- 172.21.15.78:0/2532837120 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f464c159f30 msgr2=0x7f464c06c870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:30.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.074+0000 7f4653d80640 1 --2- 172.21.15.78:0/2532837120 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f464c159f30 0x7f464c06c870 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f4644009e50 tx=0x7f464401ec10 comp rx=0 tx=0).stop 2023-12-12T10:12:30.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.074+0000 7fbcb5793640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fbca8047c20 0x7fbca80eb6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:34304/0 (socket says 172.21.15.78:34304) 2023-12-12T10:12:30.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.074+0000 7fbcb5793640 1 -- 172.21.15.78:0/1625148051 learned_addr learned my addr 172.21.15.78:0/1625148051 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-12-12T10:12:30.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.074+0000 7f9e1ce32640 1 Processor -- start 2023-12-12T10:12:30.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.074+0000 7fbcb5f94640 1 --2- 172.21.15.78:0/1625148051 >> v2:172.21.15.187:3300/0 conn(0x7fbca8033e40 0x7fbca80eb180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:30.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.078+0000 7f4653d80640 1 -- 172.21.15.78:0/2532837120 shutdown_connections 2023-12-12T10:12:30.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.078+0000 7f4653d80640 1 --2- 172.21.15.78:0/2532837120 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f464c159f30 0x7f464c06c870 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:30.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.078+0000 7f4653d80640 1 --2- 172.21.15.78:0/2532837120 >> v2:172.21.15.187:3300/0 conn(0x7f464c142890 0x7f464c15caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:30.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.078+0000 7f4653d80640 1 -- 172.21.15.78:0/2532837120 >> 172.21.15.78:0/2532837120 conn(0x7f464c0b0750 msgr2=0x7f464c0b0b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:30.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.074+0000 7f71b6780640 1 -- 172.21.15.78:0/2723752189 shutdown_connections 2023-12-12T10:12:30.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.074+0000 7f71b6780640 1 --2- 172.21.15.78:0/2723752189 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7198004820 0x7f7198004ca0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:30.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.074+0000 7f71b6780640 1 -- 172.21.15.78:0/2723752189 >> 172.21.15.78:0/2723752189 conn(0x7f71b00b0750 msgr2=0x7f71b00b0b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:30.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.074+0000 7f9e1ce32640 1 -- start start 2023-12-12T10:12:30.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.074+0000 7efe58809640 1 Processor -- start 2023-12-12T10:12:30.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.078+0000 7efe58809640 1 -- start start 2023-12-12T10:12:30.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.074+0000 7fbcb4f92640 1 -- 172.21.15.78:0/1625148051 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1847065598 0 0) 0x7fbca8037bc0 con 0x7fbca8047c20 2023-12-12T10:12:30.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.074+0000 7fbcb4f92640 1 -- 172.21.15.78:0/1625148051 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc9c003530 con 0x7fbca8047c20 2023-12-12T10:12:30.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.078+0000 7fbcb4f92640 1 -- 172.21.15.78:0/1625148051 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3638349235 0 0) 0x7fbca804f090 con 0x7fbca8005ea0 2023-12-12T10:12:30.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.078+0000 7fbcb4f92640 1 -- 172.21.15.78:0/1625148051 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbca8037bc0 con 0x7fbca8005ea0 2023-12-12T10:12:30.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.078+0000 7fbcb4f92640 1 -- 172.21.15.78:0/1625148051 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 565014330 0 0) 0x7fbc9c003530 con 0x7fbca8047c20 2023-12-12T10:12:30.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.078+0000 7fbcb4f92640 1 -- 172.21.15.78:0/1625148051 >> v2:172.21.15.187:3300/0 conn(0x7fbca8033e40 msgr2=0x7fbca80eb180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:30.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.078+0000 7fbcb4f92640 1 --2- 172.21.15.78:0/1625148051 >> v2:172.21.15.187:3300/0 conn(0x7fbca8033e40 0x7fbca80eb180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:30.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.078+0000 7fbcb4f92640 1 -- 172.21.15.78:0/1625148051 >> v1:172.21.15.187:6789/0 conn(0x7fbca8005ea0 legacy=0x7fbca80062b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:30.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.078+0000 7fbcb4f92640 1 -- 172.21.15.78:0/1625148051 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbca804fd80 con 0x7fbca8047c20 2023-12-12T10:12:30.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.078+0000 7fbcb4f92640 1 -- 172.21.15.78:0/1625148051 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 465499599 0 0) 0x7fbca0001680 con 0x7fbca8047c20 2023-12-12T10:12:30.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.078+0000 7f71b6780640 1 -- 172.21.15.78:0/2723752189 shutdown_connections 2023-12-12T10:12:30.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.078+0000 7f270c9f8640 1 Processor -- start 2023-12-12T10:12:30.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.078+0000 7fbcb4f92640 1 -- 172.21.15.78:0/1625148051 >> v1:172.21.15.78:6789/0 conn(0x7fbca8047c20 legacy=0x7fbca80eb6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:30.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.078+0000 7fbcb4f92640 1 --2- 172.21.15.78:0/1625148051 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbc9c003b40 0x7fbc9c003f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:30.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.078+0000 7fbcb4f92640 1 --2- 172.21.15.78:0/1625148051 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbc9c0047d0 0x7fbc9c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:30.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.078+0000 7fbcb4f92640 1 --2- 172.21.15.78:0/1625148051 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbc9c005190 0x7fbc9c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:30.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.078+0000 7fbcb4f92640 1 -- 172.21.15.78:0/1625148051 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcb0074380 con 0x7fbc9c005190 2023-12-12T10:12:30.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.078+0000 7fbcb4f92640 1 -- 172.21.15.78:0/1625148051 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbca8050210 con 0x7fbc9c0047d0 2023-12-12T10:12:30.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.078+0000 7fbcb4f92640 1 -- 172.21.15.78:0/1625148051 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc9c00bfd0 con 0x7fbc9c003b40 2023-12-12T10:12:30.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.078+0000 7fbcb5793640 1 --2- 172.21.15.78:0/1625148051 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbc9c0047d0 0x7fbc9c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:30.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.078+0000 7f71b6780640 1 -- 172.21.15.78:0/2723752189 wait complete. 2023-12-12T10:12:30.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.078+0000 7fbcb5f94640 1 --2- 172.21.15.78:0/1625148051 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbc9c003b40 0x7fbc9c003f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:30.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.078+0000 7fbcb5793640 1 -- 172.21.15.78:0/1625148051 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbc9c003b40 msgr2=0x7fbc9c003f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:30.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.078+0000 7fbcb5793640 1 --2- 172.21.15.78:0/1625148051 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbc9c003b40 0x7fbc9c003f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:30.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.078+0000 7fbcb5793640 1 -- 172.21.15.78:0/1625148051 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbc9c005190 msgr2=0x7fbc9c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:30.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.078+0000 7fbcb5793640 1 --2- 172.21.15.78:0/1625148051 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbc9c005190 0x7fbc9c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:30.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.078+0000 7fbcb5793640 1 -- 172.21.15.78:0/1625148051 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc9c003530 con 0x7fbc9c0047d0 2023-12-12T10:12:30.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.078+0000 7fbcb6795640 1 -- 172.21.15.78:0/1625148051 reap_dead start 2023-12-12T10:12:30.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.078+0000 7f4653d80640 1 -- 172.21.15.78:0/2532837120 shutdown_connections 2023-12-12T10:12:30.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.078+0000 7f9e1ce32640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f9e18160890 0x7f9e180b5e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:30.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.078+0000 7f9e1ce32640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f9e180d0be0 0x7f9e180d1040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:30.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.078+0000 7f9e1ce32640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e180d04f0 con 0x7f9e180d15d0 2023-12-12T10:12:30.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.078+0000 7f9e1ce32640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e180b63a0 con 0x7f9e180d0be0 2023-12-12T10:12:30.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.078+0000 7f9e1ce32640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e180cdc20 con 0x7f9e18160890 2023-12-12T10:12:30.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.078+0000 7f9e1659c640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f9e18160890 0x7f9e180b5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:30.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.078+0000 7f9e1659c640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f9e18160890 0x7f9e180b5e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.78:38518/0 (socket says 172.21.15.78:38518) 2023-12-12T10:12:30.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.078+0000 7f9e1659c640 1 -- 172.21.15.78:0/2469828756 learned_addr learned my addr 172.21.15.78:0/2469828756 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:30.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.078+0000 7f9e15d9b640 1 --2- 172.21.15.78:0/2469828756 >> v2:172.21.15.78:3300/0 conn(0x7f9e180d0be0 0x7f9e180d1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:30.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.078+0000 7f9e1659c640 1 -- 172.21.15.78:0/2469828756 >> v2:172.21.15.78:3300/0 conn(0x7f9e180d0be0 msgr2=0x7f9e180d1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:30.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.078+0000 7f9e1659c640 1 --2- 172.21.15.78:0/2469828756 >> v2:172.21.15.78:3300/0 conn(0x7f9e180d0be0 0x7f9e180d1040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:30.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.078+0000 7f9e1659c640 1 -- 172.21.15.78:0/2469828756 >> v1:172.21.15.187:6789/0 conn(0x7f9e180d15d0 legacy=0x7f9e180ce3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:30.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.078+0000 7f9e1659c640 1 -- 172.21.15.78:0/2469828756 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e180cfc50 con 0x7f9e18160890 2023-12-12T10:12:30.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.078+0000 7f270c9f8640 1 -- start start 2023-12-12T10:12:30.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.078+0000 7efe58809640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efe540d1d80 0x7efe54167f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:30.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.078+0000 7efe58809640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe5415d870 con 0x7efe5415d490 2023-12-12T10:12:30.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.078+0000 7efe58809640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe540cebb0 con 0x7efe540ce6b0 2023-12-12T10:12:30.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.078+0000 7efe58809640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe540b2af0 con 0x7efe540d1d80 2023-12-12T10:12:30.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.078+0000 7efe52d9d640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efe540d1d80 0x7efe54167f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:30.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.078+0000 7efe5259c640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7efe5415d490 0x7efe540d0e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:34312/0 (socket says 172.21.15.78:34312) 2023-12-12T10:12:30.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.078+0000 7efe5259c640 1 -- 172.21.15.78:0/3585208604 learned_addr learned my addr 172.21.15.78:0/3585208604 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-12-12T10:12:30.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.078+0000 7f4653d80640 1 -- 172.21.15.78:0/2532837120 wait complete. 2023-12-12T10:12:30.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.078+0000 7efe52d9d640 1 -- 172.21.15.78:0/3585208604 >> v1:172.21.15.187:6789/0 conn(0x7efe540ce6b0 legacy=0x7efe540d1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:30.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.078+0000 7efe52d9d640 1 -- 172.21.15.78:0/3585208604 >> v1:172.21.15.78:6789/0 conn(0x7efe5415d490 legacy=0x7efe540d0e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:30.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.078+0000 7efe52d9d640 1 -- 172.21.15.78:0/3585208604 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe540cee90 con 0x7efe540d1d80 2023-12-12T10:12:30.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.078+0000 7f75ef632640 1 Processor -- start 2023-12-12T10:12:30.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.082+0000 7f71b6780640 1 Processor -- start 2023-12-12T10:12:30.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.082+0000 7f4653d80640 1 Processor -- start 2023-12-12T10:12:30.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.082+0000 7f4653d80640 1 -- start start 2023-12-12T10:12:30.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.082+0000 7f71b6780640 1 -- start start 2023-12-12T10:12:30.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.082+0000 7f4653d80640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f464c0b1270 0x7f464c14d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:30.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.082+0000 7f4653d80640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f464c142890 0x7f464c1525f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:30.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.082+0000 7f4653d80640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f464c159f30 0x7f464c1534c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:30.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.082+0000 7f4653d80640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f464c152b30 con 0x7f464c159f30 2023-12-12T10:12:30.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.082+0000 7f4653d80640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f464c1516e0 con 0x7f464c0b1270 2023-12-12T10:12:30.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.082+0000 7f4653d80640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f464c14e340 con 0x7f464c142890 2023-12-12T10:12:30.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.082+0000 7f4651b1c640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f464c0b1270 0x7f464c14d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:30.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.082+0000 7f4651b1c640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f464c0b1270 0x7f464c14d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.78:38540/0 (socket says 172.21.15.78:38540) 2023-12-12T10:12:30.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.082+0000 7f4651b1c640 1 -- 172.21.15.78:0/1318403341 learned_addr learned my addr 172.21.15.78:0/1318403341 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:30.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.082+0000 7f465131b640 1 --2- 172.21.15.78:0/1318403341 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f464c142890 0x7f464c1525f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:30.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.082+0000 7f270c9f8640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f270815d490 0x7f27080d0e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:30.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.082+0000 7f270c9f8640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f27080ce6b0 0x7f27080d1670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:30.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.082+0000 7f270c9f8640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f270815d870 con 0x7f27080d1bb0 2023-12-12T10:12:30.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.082+0000 7f270c9f8640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27080b2af0 con 0x7f270815d490 2023-12-12T10:12:30.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.082+0000 7f270c9f8640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27080d2040 con 0x7f27080ce6b0 2023-12-12T10:12:30.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.082+0000 7f2705d9b640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f27080ce6b0 0x7f27080d1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:30.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.082+0000 7f2705d9b640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f27080ce6b0 0x7f27080d1670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.78:38528/0 (socket says 172.21.15.78:38528) 2023-12-12T10:12:30.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.082+0000 7f2705d9b640 1 -- 172.21.15.78:0/1323934273 learned_addr learned my addr 172.21.15.78:0/1323934273 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:30.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.082+0000 7f2705d9b640 1 -- 172.21.15.78:0/1323934273 >> v2:172.21.15.78:3300/0 conn(0x7f270815d490 msgr2=0x7f27080d0e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:30.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.082+0000 7f2705d9b640 1 --2- 172.21.15.78:0/1323934273 >> v2:172.21.15.78:3300/0 conn(0x7f270815d490 0x7f27080d0e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:30.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.082+0000 7f2705d9b640 1 -- 172.21.15.78:0/1323934273 >> v1:172.21.15.78:6789/0 conn(0x7f27080d1bb0 legacy=0x7f27080cf6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:30.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.082+0000 7f2705d9b640 1 -- 172.21.15.78:0/1323934273 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27080d13b0 con 0x7f27080ce6b0 2023-12-12T10:12:30.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.082+0000 7f71b6780640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7198004820 0x7f71b00b4400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:30.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.082+0000 7f71b6780640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f71b01ec370 0x7f71b01f6f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:30.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.082+0000 7fbcb5793640 1 --2- 172.21.15.78:0/1625148051 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbc9c0047d0 0x7fbc9c004c50 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fbca000c1c0 tx=0x7fbca001cb40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d73c2f1e8385a795 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:30.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.082+0000 7f465131b640 1 -- 172.21.15.78:0/1318403341 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f464c0b1270 msgr2=0x7f464c14d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:30.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.082+0000 7f71b6780640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f71b01ec7f0 0x7f71b0163da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:30.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.082+0000 7f75ef632640 1 -- start start 2023-12-12T10:12:30.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.086+0000 7f71affff640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7198004820 0x7f71b00b4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:30.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.086+0000 7f71affff640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7198004820 0x7f71b00b4400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.78:38542/0 (socket says 172.21.15.78:38542) 2023-12-12T10:12:30.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.086+0000 7f71affff640 1 -- 172.21.15.78:0/1702350695 learned_addr learned my addr 172.21.15.78:0/1702350695 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:30.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.082+0000 7f465131b640 1 --2- 172.21.15.78:0/1318403341 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f464c0b1270 0x7f464c14d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:30.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.082+0000 7f465131b640 1 -- 172.21.15.78:0/1318403341 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f464c159f30 msgr2=0x7f464c1534c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:30.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.082+0000 7f465131b640 1 --2- 172.21.15.78:0/1318403341 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f464c159f30 0x7f464c1534c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:30.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.086+0000 7f71b6780640 1 -- 172.21.15.78:0/1702350695 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71b01652f0 con 0x7f71b01ec370 2023-12-12T10:12:30.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.086+0000 7f71b6780640 1 -- 172.21.15.78:0/1702350695 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71b015b220 con 0x7f7198004820 2023-12-12T10:12:30.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.086+0000 7f71b4d1d640 1 --2- 172.21.15.78:0/1702350695 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f71b01ec7f0 0x7f71b0163da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:30.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.086+0000 7f465131b640 1 -- 172.21.15.78:0/1318403341 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4644009b30 con 0x7f464c142890 2023-12-12T10:12:30.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.086+0000 7f71b6780640 1 -- 172.21.15.78:0/1702350695 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71b00b4940 con 0x7f71b01ec7f0 2023-12-12T10:12:30.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.086+0000 7fbcb4f92640 1 -- 172.21.15.78:0/1625148051 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbca00058e0 con 0x7fbc9c0047d0 2023-12-12T10:12:30.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.086+0000 7fbcb4f92640 1 -- 172.21.15.78:0/1625148051 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbca0005a60 con 0x7fbc9c0047d0 2023-12-12T10:12:30.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.086+0000 7fbcb4f92640 1 -- 172.21.15.78:0/1625148051 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbca0005e10 con 0x7fbc9c0047d0 2023-12-12T10:12:30.103 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.086+0000 7f71af7fe640 1 --2- 172.21.15.78:0/1702350695 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f71b01ec370 0x7f71b01f6f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:30.103 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.086+0000 7f465131b640 1 --2- 172.21.15.78:0/1318403341 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f464c142890 0x7f464c1525f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f463c00c390 tx=0x7f463c00c850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:30.103 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.086+0000 7f9e1659c640 1 --2- 172.21.15.78:0/2469828756 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9e18160890 0x7f9e180b5e60 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f9e1808d720 tx=0x7f9e0c01c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b57472a08a540b36 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:30.103 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.086+0000 7fbcb81f8640 1 -- 172.21.15.78:0/1625148051 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbc9c0047d0 msgr2=0x7fbc9c004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:30.103 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.086+0000 7fbcb81f8640 1 --2- 172.21.15.78:0/1625148051 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbc9c0047d0 0x7fbc9c004c50 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fbca000c1c0 tx=0x7fbca001cb40 comp rx=0 tx=0).stop 2023-12-12T10:12:30.104 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.086+0000 7fbcb81f8640 1 -- 172.21.15.78:0/1625148051 shutdown_connections 2023-12-12T10:12:30.104 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.086+0000 7fbcb81f8640 1 --2- 172.21.15.78:0/1625148051 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbc9c0047d0 0x7fbc9c004c50 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:30.104 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.086+0000 7fbcb81f8640 1 -- 172.21.15.78:0/1625148051 >> 172.21.15.78:0/1625148051 conn(0x7fbca8009fc0 msgr2=0x7fbca800a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:30.104 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.086+0000 7f46427fc640 1 -- 172.21.15.78:0/1318403341 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f463c0052d0 con 0x7f464c142890 2023-12-12T10:12:30.104 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.086+0000 7f46427fc640 1 -- 172.21.15.78:0/1318403341 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f463c005430 con 0x7f464c142890 2023-12-12T10:12:30.104 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.086+0000 7f46427fc640 1 -- 172.21.15.78:0/1318403341 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f463c003860 con 0x7f464c142890 2023-12-12T10:12:30.104 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.086+0000 7f4653d80640 1 -- 172.21.15.78:0/1318403341 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f464c151390 con 0x7f464c142890 2023-12-12T10:12:30.104 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.086+0000 7f71b4d1d640 1 -- 172.21.15.78:0/1702350695 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7198004820 msgr2=0x7f71b00b4400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:30.105 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.086+0000 7f71b4d1d640 1 --2- 172.21.15.78:0/1702350695 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7198004820 0x7f71b00b4400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:30.105 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.086+0000 7f71b4d1d640 1 -- 172.21.15.78:0/1702350695 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f71b01ec370 msgr2=0x7f71b01f6f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:30.105 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.086+0000 7f71b4d1d640 1 --2- 172.21.15.78:0/1702350695 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f71b01ec370 0x7f71b01f6f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:30.105 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.086+0000 7f71b4d1d640 1 -- 172.21.15.78:0/1702350695 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71b0162d00 con 0x7f71b01ec7f0 2023-12-12T10:12:30.105 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.086+0000 7f71affff640 1 --2- 172.21.15.78:0/1702350695 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7198004820 0x7f71b00b4400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-12T10:12:30.105 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.086+0000 7f75ef632640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f75e8143830 0x7f75e80cf700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:30.105 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.086+0000 7f75ef632640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75e80ce680 con 0x7f75e806d7a0 2023-12-12T10:12:30.105 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.086+0000 7f75ef632640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75e80ce960 con 0x7f75e80cdbc0 2023-12-12T10:12:30.106 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.086+0000 7f9e1559a640 1 -- 172.21.15.78:0/2469828756 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e0c0aa5f0 con 0x7f9e18160890 2023-12-12T10:12:30.106 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.086+0000 7f9e1559a640 1 -- 172.21.15.78:0/2469828756 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e0c0aa750 con 0x7f9e18160890 2023-12-12T10:12:30.106 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.086+0000 7f9e1559a640 1 -- 172.21.15.78:0/2469828756 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e0c0aaae0 con 0x7f9e18160890 2023-12-12T10:12:30.106 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.086+0000 7efe52d9d640 1 --2- 172.21.15.78:0/3585208604 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efe540d1d80 0x7efe54167f40 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7efe4c009dc0 tx=0x7efe4c01c930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e1297f7f52498a8 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:30.106 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.086+0000 7efe5159a640 1 -- 172.21.15.78:0/3585208604 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe4c0a58e0 con 0x7efe540d1d80 2023-12-12T10:12:30.106 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.086+0000 7f75ef632640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75e8143c10 con 0x7f75e8143830 2023-12-12T10:12:30.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.086+0000 7f71b4d1d640 1 --2- 172.21.15.78:0/1702350695 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f71b01ec7f0 0x7f71b0163da0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f71b006d3c0 tx=0x7f71a0001830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:30.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.086+0000 7f4653d80640 1 -- 172.21.15.78:0/1318403341 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f464c14e060 con 0x7f464c142890 2023-12-12T10:12:30.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.086+0000 7fbcb81f8640 1 -- 172.21.15.78:0/1625148051 shutdown_connections 2023-12-12T10:12:30.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.086+0000 7fbcb81f8640 1 -- 172.21.15.78:0/1625148051 wait complete. 2023-12-12T10:12:30.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.086+0000 7efe5159a640 1 -- 172.21.15.78:0/3585208604 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe4c0a5a40 con 0x7efe540d1d80 2023-12-12T10:12:30.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.086+0000 7efe5159a640 1 -- 172.21.15.78:0/3585208604 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe4c0a5dd0 con 0x7efe540d1d80 2023-12-12T10:12:30.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.086+0000 7f75edbcf640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f75e806d7a0 0x7f75e80b2d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:34320/0 (socket says 172.21.15.78:34320) 2023-12-12T10:12:30.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.086+0000 7f75edbcf640 1 -- 172.21.15.78:0/4035613269 learned_addr learned my addr 172.21.15.78:0/4035613269 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-12-12T10:12:30.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.086+0000 7f2705d9b640 1 --2- 172.21.15.78:0/1323934273 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f27080ce6b0 0x7f27080d1670 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f27080a0f60 tx=0x7f26fc02d4f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=491c30ae8f106df server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:30.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.086+0000 7f75ed3ce640 1 --2- 172.21.15.78:0/4035613269 >> v2:172.21.15.78:3300/0 conn(0x7f75e8143830 0x7f75e80cf700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:30.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.086+0000 7f71acff9640 1 -- 172.21.15.78:0/1702350695 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a0017070 con 0x7f71b01ec7f0 2023-12-12T10:12:30.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.090+0000 7f9e1ce32640 1 -- 172.21.15.78:0/2469828756 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9e18160890 msgr2=0x7f9e180b5e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:30.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.086+0000 7efe58809640 1 -- 172.21.15.78:0/3585208604 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efe540d1d80 msgr2=0x7efe54167f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:30.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.086+0000 7efe58809640 1 --2- 172.21.15.78:0/3585208604 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efe540d1d80 0x7efe54167f40 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7efe4c009dc0 tx=0x7efe4c01c930 comp rx=0 tx=0).stop 2023-12-12T10:12:30.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.090+0000 7f9e1ce32640 1 --2- 172.21.15.78:0/2469828756 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9e18160890 0x7f9e180b5e60 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f9e1808d720 tx=0x7f9e0c01c490 comp rx=0 tx=0).stop 2023-12-12T10:12:30.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.090+0000 7f71acff9640 1 -- 172.21.15.78:0/1702350695 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71a0012560 con 0x7f71b01ec7f0 2023-12-12T10:12:30.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.090+0000 7f71acff9640 1 -- 172.21.15.78:0/1702350695 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a0012710 con 0x7f71b01ec7f0 2023-12-12T10:12:30.111 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.090+0000 7f71b6780640 1 -- 172.21.15.78:0/1702350695 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71b0162fe0 con 0x7f71b01ec7f0 2023-12-12T10:12:30.111 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.090+0000 7f71b6780640 1 -- 172.21.15.78:0/1702350695 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71b01635a0 con 0x7f71b01ec7f0 2023-12-12T10:12:30.111 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.090+0000 7f75dffff640 1 -- 172.21.15.78:0/4035613269 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 34099120 0 0) 0x7f75e80ce680 con 0x7f75e806d7a0 2023-12-12T10:12:30.111 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.090+0000 7f75dffff640 1 -- 172.21.15.78:0/4035613269 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75d4005740 con 0x7f75e806d7a0 2023-12-12T10:12:30.111 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.086+0000 7f270559a640 1 -- 172.21.15.78:0/1323934273 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26fc0bd620 con 0x7f27080ce6b0 2023-12-12T10:12:30.111 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.090+0000 7efe58809640 1 -- 172.21.15.78:0/3585208604 shutdown_connections 2023-12-12T10:12:30.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.090+0000 7efe58809640 1 --2- 172.21.15.78:0/3585208604 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efe540d1d80 0x7efe54167f40 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:30.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.090+0000 7efe58809640 1 -- 172.21.15.78:0/3585208604 >> 172.21.15.78:0/3585208604 conn(0x7efe540d3090 msgr2=0x7efe540d34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:30.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.090+0000 7f9e1ce32640 1 -- 172.21.15.78:0/2469828756 shutdown_connections 2023-12-12T10:12:30.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.090+0000 7f9e1ce32640 1 --2- 172.21.15.78:0/2469828756 >> v2:172.21.15.78:3300/0 conn(0x7f9e180d0be0 0x7f9e180d1040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:30.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.090+0000 7f75dffff640 1 -- 172.21.15.78:0/4035613269 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2305597294 0 0) 0x7f75e80ce960 con 0x7f75e80cdbc0 2023-12-12T10:12:30.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.090+0000 7f9e1ce32640 1 --2- 172.21.15.78:0/2469828756 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9e18160890 0x7f9e180b5e60 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:30.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.090+0000 7f9e1ce32640 1 -- 172.21.15.78:0/2469828756 >> 172.21.15.78:0/2469828756 conn(0x7f9e1809c2f0 msgr2=0x7f9e180d3010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:30.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.090+0000 7f4653d80640 1 -- 172.21.15.78:0/1318403341 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f464c0671f0 con 0x7f464c142890 2023-12-12T10:12:30.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.090+0000 7f75dffff640 1 -- 172.21.15.78:0/4035613269 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75e80ce680 con 0x7f75e80cdbc0 2023-12-12T10:12:30.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.090+0000 7f9e1ce32640 1 -- 172.21.15.78:0/2469828756 shutdown_connections 2023-12-12T10:12:30.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.090+0000 7f9e1ce32640 1 -- 172.21.15.78:0/2469828756 wait complete. 2023-12-12T10:12:30.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.090+0000 7f75dffff640 1 -- 172.21.15.78:0/4035613269 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3614592808 0 0) 0x7f75d4005740 con 0x7f75e806d7a0 2023-12-12T10:12:30.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.090+0000 7f75dffff640 1 -- 172.21.15.78:0/4035613269 >> v2:172.21.15.78:3300/0 conn(0x7f75e8143830 msgr2=0x7f75e80cf700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:30.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.090+0000 7f75dffff640 1 --2- 172.21.15.78:0/4035613269 >> v2:172.21.15.78:3300/0 conn(0x7f75e8143830 0x7f75e80cf700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:30.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.090+0000 7f75dffff640 1 -- 172.21.15.78:0/4035613269 >> v1:172.21.15.187:6789/0 conn(0x7f75e80cdbc0 legacy=0x7f75e806d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:30.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.090+0000 7f0b02da3640 1 Processor -- start 2023-12-12T10:12:30.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.090+0000 7f75dffff640 1 -- 172.21.15.78:0/4035613269 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75e80cec40 con 0x7f75e806d7a0 2023-12-12T10:12:30.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.090+0000 7f75ed3ce640 1 --2- 172.21.15.78:0/4035613269 >> v2:172.21.15.78:3300/0 conn(0x7f75e8143830 0x7f75e80cf700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T10:12:30.116 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.090+0000 7f270559a640 1 -- 172.21.15.78:0/1323934273 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26fc0bd780 con 0x7f27080ce6b0 2023-12-12T10:12:30.116 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.090+0000 7f75dffff640 1 -- 172.21.15.78:0/4035613269 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 465499599 0 0) 0x7f75e0001680 con 0x7f75e806d7a0 2023-12-12T10:12:30.116 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.090+0000 7f75dffff640 1 -- 172.21.15.78:0/4035613269 >> v1:172.21.15.78:6789/0 conn(0x7f75e806d7a0 legacy=0x7f75e80b2d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:30.116 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.090+0000 7f270559a640 1 -- 172.21.15.78:0/1323934273 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26fc0bd620 con 0x7f27080ce6b0 2023-12-12T10:12:30.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.090+0000 7f0b02da3640 1 -- start start 2023-12-12T10:12:30.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.090+0000 7f75dffff640 1 --2- 172.21.15.78:0/4035613269 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f75d4005d70 0x7f75d4006170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:30.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.090+0000 7f75dffff640 1 --2- 172.21.15.78:0/4035613269 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f75d40069e0 0x7f75d4006e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:30.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.090+0000 7f75dffff640 1 --2- 172.21.15.78:0/4035613269 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75d40073a0 0x7f75d400ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:30.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.090+0000 7f75dffff640 1 -- 172.21.15.78:0/4035613269 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75e8143c10 con 0x7f75d40073a0 2023-12-12T10:12:30.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.090+0000 7f75dffff640 1 -- 172.21.15.78:0/4035613269 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75d40104e0 con 0x7f75d4005d70 2023-12-12T10:12:30.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.090+0000 7f75dffff640 1 -- 172.21.15.78:0/4035613269 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75d4010650 con 0x7f75d40069e0 2023-12-12T10:12:30.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.090+0000 7f75edbcf640 1 --2- 172.21.15.78:0/4035613269 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75d40073a0 0x7f75d400ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:30.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.090+0000 7fbcb81f8640 1 Processor -- start 2023-12-12T10:12:30.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.090+0000 7fbcb81f8640 1 -- start start 2023-12-12T10:12:30.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.090+0000 7fbcb81f8640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbc9c0047d0 0x7fbca80ddc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:30.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.090+0000 7fbcb81f8640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbca80df2e0 0x7fbca80e99b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:30.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.090+0000 7fbcb81f8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbca80e4de0 0x7fbca80dbc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:30.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.090+0000 7fbcb81f8640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbca80ea330 con 0x7fbca80e4de0 2023-12-12T10:12:30.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.090+0000 7fbcb81f8640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbca80de240 con 0x7fbc9c0047d0 2023-12-12T10:12:30.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.090+0000 7fbcb81f8640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbca80de520 con 0x7fbca80df2e0 2023-12-12T10:12:30.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.094+0000 7fbcb5793640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbca80df2e0 0x7fbca80e99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:30.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.094+0000 7fbcb5793640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbca80df2e0 0x7fbca80e99b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.78:47644/0 (socket says 172.21.15.78:47644) 2023-12-12T10:12:30.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.094+0000 7fbcb5793640 1 -- 172.21.15.78:0/2532473030 learned_addr learned my addr 172.21.15.78:0/2532473030 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:30.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.094+0000 7fbcb6795640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbca80e4de0 0x7fbca80dbc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:30.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.090+0000 7f46427fc640 1 -- 172.21.15.78:0/1318403341 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f463c0039c0 con 0x7f464c142890 2023-12-12T10:12:30.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.090+0000 7f46427fc640 1 --2- 172.21.15.78:0/1318403341 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f4630066570 0x7f4630068a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:30.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.090+0000 7f46427fc640 1 -- 172.21.15.78:0/1318403341 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f463c083660 con 0x7f464c142890 2023-12-12T10:12:30.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.090+0000 7f71b6780640 1 -- 172.21.15.78:0/1702350695 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71b00671f0 con 0x7f71b01ec7f0 2023-12-12T10:12:30.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.090+0000 7f75ecbcd640 1 --2- 172.21.15.78:0/4035613269 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f75d40069e0 0x7f75d4006e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:30.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.090+0000 7f75edbcf640 1 -- 172.21.15.78:0/4035613269 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f75d40069e0 msgr2=0x7f75d4006e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:30.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.090+0000 7f75edbcf640 1 --2- 172.21.15.78:0/4035613269 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f75d40069e0 0x7f75d4006e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:30.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.090+0000 7f75edbcf640 1 -- 172.21.15.78:0/4035613269 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f75d4005d70 msgr2=0x7f75d4006170 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-12T10:12:30.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.090+0000 7f75edbcf640 1 --2- 172.21.15.78:0/4035613269 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f75d4005d70 0x7f75d4006170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:30.121 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.090+0000 7f75edbcf640 1 -- 172.21.15.78:0/4035613269 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75d4005740 con 0x7f75d40073a0 2023-12-12T10:12:30.121 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.094+0000 7f9e1ce32640 1 Processor -- start 2023-12-12T10:12:30.122 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.090+0000 7f270c9f8640 1 -- 172.21.15.78:0/1323934273 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f27080ce6b0 msgr2=0x7f27080d1670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:30.122 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.090+0000 7f270c9f8640 1 --2- 172.21.15.78:0/1323934273 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f27080ce6b0 0x7f27080d1670 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f27080a0f60 tx=0x7f26fc02d4f0 comp rx=0 tx=0).stop 2023-12-12T10:12:30.122 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.090+0000 7f0b02da3640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f0afc0d3a20 0x7f0afc0d1930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:30.122 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.090+0000 7f0b02da3640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0afc0ceb30 con 0x7f0afc15d070 2023-12-12T10:12:30.123 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.090+0000 7f0b02da3640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0afc0d0b70 con 0x7f0afc15d450 2023-12-12T10:12:30.123 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.090+0000 7f0b02da3640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0afc0d1e70 con 0x7f0afc0d3a20 2023-12-12T10:12:30.123 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.090+0000 7f0b01da1640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f0afc15d070 0x7f0afc0ce420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:34330/0 (socket says 172.21.15.78:34330) 2023-12-12T10:12:30.123 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.090+0000 7f0b01da1640 1 -- 172.21.15.78:0/198205065 learned_addr learned my addr 172.21.15.78:0/198205065 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-12-12T10:12:30.123 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.094+0000 7efe58809640 1 -- 172.21.15.78:0/3585208604 shutdown_connections 2023-12-12T10:12:30.123 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.094+0000 7f0b015a0640 1 --2- 172.21.15.78:0/198205065 >> v2:172.21.15.78:3300/0 conn(0x7f0afc0d3a20 0x7f0afc0d1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:30.124 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.094+0000 7efe58809640 1 -- 172.21.15.78:0/3585208604 wait complete. 2023-12-12T10:12:30.124 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.094+0000 7f9e1ce32640 1 -- start start 2023-12-12T10:12:30.124 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.094+0000 7f4651b1c640 1 --2- 172.21.15.78:0/1318403341 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f4630066570 0x7f4630068a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:30.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.094+0000 7fbcb5793640 1 -- 172.21.15.78:0/2532473030 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbc9c0047d0 msgr2=0x7fbca80ddc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:30.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.094+0000 7fbcb5793640 1 --2- 172.21.15.78:0/2532473030 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbc9c0047d0 0x7fbca80ddc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:30.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.094+0000 7fbcb5793640 1 -- 172.21.15.78:0/2532473030 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbca80e4de0 msgr2=0x7fbca80dbc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:30.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.094+0000 7fbcb5793640 1 --2- 172.21.15.78:0/2532473030 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbca80e4de0 0x7fbca80dbc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:30.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.094+0000 7fbcb5793640 1 -- 172.21.15.78:0/2532473030 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbca80de800 con 0x7fbca80df2e0 2023-12-12T10:12:30.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.094+0000 7f0b015a0640 1 -- 172.21.15.78:0/198205065 >> v1:172.21.15.187:6789/0 conn(0x7f0afc15d450 legacy=0x7f0afc160e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:30.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.094+0000 7f0b015a0640 1 -- 172.21.15.78:0/198205065 >> v1:172.21.15.78:6789/0 conn(0x7f0afc15d070 legacy=0x7f0afc0ce420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:30.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.094+0000 7f0b015a0640 1 -- 172.21.15.78:0/198205065 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0afc0d0e50 con 0x7f0afc0d3a20 2023-12-12T10:12:30.126 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.094+0000 7f71acff9640 1 -- 172.21.15.78:0/1702350695 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f71a0012870 con 0x7f71b01ec7f0 2023-12-12T10:12:30.126 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.094+0000 7fbcb5793640 1 --2- 172.21.15.78:0/2532473030 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbca80df2e0 0x7fbca80e99b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fbca000c1c0 tx=0x7fbc9c005800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:30.127 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.094+0000 7f270c9f8640 1 -- 172.21.15.78:0/1323934273 shutdown_connections 2023-12-12T10:12:30.127 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.094+0000 7f270c9f8640 1 --2- 172.21.15.78:0/1323934273 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f27080ce6b0 0x7f27080d1670 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:30.127 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.094+0000 7f270c9f8640 1 --2- 172.21.15.78:0/1323934273 >> v2:172.21.15.78:3300/0 conn(0x7f270815d490 0x7f27080d0e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:30.127 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.094+0000 7f270c9f8640 1 -- 172.21.15.78:0/1323934273 >> 172.21.15.78:0/1323934273 conn(0x7f27080d3090 msgr2=0x7f27080d34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:30.127 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.094+0000 7f9e1ce32640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9e180d0be0 0x7f9e180ca9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:30.128 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.094+0000 7f9e1ce32640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9e180d15d0 0x7f9e181587e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:30.128 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.094+0000 7f9e1ce32640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9e18160890 0x7f9e181fa1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:30.128 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.094+0000 7f9e1ce32640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e180c8500 con 0x7f9e180d0be0 2023-12-12T10:12:30.128 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.094+0000 7f9e1ce32640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e18152be0 con 0x7f9e18160890 2023-12-12T10:12:30.128 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.094+0000 7f9e1ce32640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e180c78f0 con 0x7f9e180d15d0 2023-12-12T10:12:30.128 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.094+0000 7f4651b1c640 1 --2- 172.21.15.78:0/1318403341 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f4630066570 0x7f4630068a30 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f4648009a50 tx=0x7f4648009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:30.128 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.094+0000 7f270c9f8640 1 -- 172.21.15.78:0/1323934273 shutdown_connections 2023-12-12T10:12:30.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.094+0000 7f9e1659c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9e180d0be0 0x7f9e180ca9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:30.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.094+0000 7f9e15d9b640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9e180d15d0 0x7f9e181587e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:30.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.094+0000 7f9e1659c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9e180d0be0 0x7f9e180ca9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37052/0 (socket says 172.21.15.78:37052) 2023-12-12T10:12:30.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.094+0000 7f9e1659c640 1 -- 172.21.15.78:0/2469005095 learned_addr learned my addr 172.21.15.78:0/2469005095 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:30.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.094+0000 7f71acff9640 1 --2- 172.21.15.78:0/1702350695 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f719c066540 0x7f719c068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:30.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.094+0000 7f71acff9640 1 -- 172.21.15.78:0/1702350695 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f71a0083610 con 0x7f71b01ec7f0 2023-12-12T10:12:30.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.094+0000 7efe58809640 1 Processor -- start 2023-12-12T10:12:30.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.094+0000 7f9e16d9d640 1 --2- 172.21.15.78:0/2469005095 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9e18160890 0x7f9e181fa1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:30.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.094+0000 7f9e1659c640 1 -- 172.21.15.78:0/2469005095 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9e180d15d0 msgr2=0x7f9e181587e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:30.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.094+0000 7f9e1659c640 1 --2- 172.21.15.78:0/2469005095 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9e180d15d0 0x7f9e181587e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:30.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.094+0000 7f9e1659c640 1 -- 172.21.15.78:0/2469005095 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9e18160890 msgr2=0x7f9e181fa1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:30.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.094+0000 7f9e1659c640 1 --2- 172.21.15.78:0/2469005095 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9e18160890 0x7f9e181fa1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:30.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.094+0000 7f9e1659c640 1 -- 172.21.15.78:0/2469005095 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e0c0094d0 con 0x7f9e180d0be0 2023-12-12T10:12:30.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.094+0000 7efe58809640 1 -- start start 2023-12-12T10:12:30.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.098+0000 7f9e1659c640 1 --2- 172.21.15.78:0/2469005095 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9e180d0be0 0x7f9e180ca9d0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f9e0c01a0c0 tx=0x7f9e0c01acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:30.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.094+0000 7f270c9f8640 1 -- 172.21.15.78:0/1323934273 wait complete. 2023-12-12T10:12:30.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.094+0000 7f71affff640 1 --2- 172.21.15.78:0/1702350695 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f719c066540 0x7f719c068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:30.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.098+0000 7f75edbcf640 1 -- 172.21.15.78:0/4035613269 reap_dead start 2023-12-12T10:12:30.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.098+0000 7f75edbcf640 1 --2- 172.21.15.78:0/4035613269 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75d40073a0 0x7f75d400ffa0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f75e0007fa0 tx=0x7f75e001f1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edaeef0cb8e8450d server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:30.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.098+0000 7f75dffff640 1 -- 172.21.15.78:0/4035613269 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75e00a8e70 con 0x7f75d40073a0 2023-12-12T10:12:30.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.098+0000 7f75dffff640 1 -- 172.21.15.78:0/4035613269 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75e00058e0 con 0x7f75d40073a0 2023-12-12T10:12:30.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.098+0000 7f75dffff640 1 -- 172.21.15.78:0/4035613269 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75e0005c70 con 0x7f75d40073a0 2023-12-12T10:12:30.133 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.098+0000 7f9e06ffd640 1 -- 172.21.15.78:0/2469005095 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e0c0b3800 con 0x7f9e180d0be0 2023-12-12T10:12:30.133 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.098+0000 7f9e06ffd640 1 -- 172.21.15.78:0/2469005095 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e0c0b3960 con 0x7f9e180d0be0 2023-12-12T10:12:30.133 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.098+0000 7f9e06ffd640 1 -- 172.21.15.78:0/2469005095 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e0c0b3d10 con 0x7f9e180d0be0 2023-12-12T10:12:30.133 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.098+0000 7f9e1ce32640 1 -- 172.21.15.78:0/2469005095 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e180c7bd0 con 0x7f9e180d0be0 2023-12-12T10:12:30.133 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.098+0000 7f71affff640 1 --2- 172.21.15.78:0/1702350695 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f719c066540 0x7f719c068a00 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f71b01fa4b0 tx=0x7f71a8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:30.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.098+0000 7f46427fc640 1 -- 172.21.15.78:0/1318403341 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f463c0507f0 con 0x7f464c142890 2023-12-12T10:12:30.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.098+0000 7efe58809640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efe540ce6b0 0x7efe5415b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:30.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.098+0000 7efe58809640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efe540d1d80 0x7efe541544c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:30.135 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.098+0000 7efe58809640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efe5415d490 0x7efe540b7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:30.135 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.098+0000 7efe58809640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe5415bdf0 con 0x7efe540d1d80 2023-12-12T10:12:30.135 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.098+0000 7efe58809640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe5415c0d0 con 0x7efe5415d490 2023-12-12T10:12:30.135 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.098+0000 7efe58809640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe5415c3b0 con 0x7efe540ce6b0 2023-12-12T10:12:30.135 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.098+0000 7f9e1ce32640 1 -- 172.21.15.78:0/2469005095 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e180c8190 con 0x7f9e180d0be0 2023-12-12T10:12:30.135 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.098+0000 7f270c9f8640 1 Processor -- start 2023-12-12T10:12:30.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.098+0000 7f0b015a0640 1 --2- 172.21.15.78:0/198205065 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0afc0d3a20 0x7f0afc0d1930 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0af80097c0 tx=0x7f0af801c2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67c4b05aa51afc58 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:30.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.098+0000 7f270c9f8640 1 -- start start 2023-12-12T10:12:30.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.098+0000 7f75ef632640 1 -- 172.21.15.78:0/4035613269 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75d40073a0 msgr2=0x7f75d400ffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:30.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.098+0000 7f75ef632640 1 --2- 172.21.15.78:0/4035613269 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75d40073a0 0x7f75d400ffa0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f75e0007fa0 tx=0x7f75e001f1f0 comp rx=0 tx=0).stop 2023-12-12T10:12:30.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.098+0000 7f9e1ce32640 1 -- 172.21.15.78:0/2469005095 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e180b86b0 con 0x7f9e180d0be0 2023-12-12T10:12:30.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.098+0000 7efe52d9d640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efe5415d490 0x7efe540b7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:30.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.098+0000 7efe5259c640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efe540ce6b0 0x7efe5415b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:30.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.098+0000 7efe5259c640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efe540ce6b0 0x7efe5415b590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.78:47660/0 (socket says 172.21.15.78:47660) 2023-12-12T10:12:30.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.098+0000 7efe5259c640 1 -- 172.21.15.78:0/204030975 learned_addr learned my addr 172.21.15.78:0/204030975 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:30.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.098+0000 7f75ef632640 1 -- 172.21.15.78:0/4035613269 shutdown_connections 2023-12-12T10:12:30.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.098+0000 7f75ef632640 1 --2- 172.21.15.78:0/4035613269 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75d40073a0 0x7f75d400ffa0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:30.138 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.098+0000 7f75ef632640 1 -- 172.21.15.78:0/4035613269 >> 172.21.15.78:0/4035613269 conn(0x7f75e806b650 msgr2=0x7f75e806ba60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:30.138 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.098+0000 7efe51d9b640 1 --2- 172.21.15.78:0/204030975 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efe540d1d80 0x7efe541544c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:30.138 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.098+0000 7f0b00d9f640 1 -- 172.21.15.78:0/198205065 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af80ab600 con 0x7f0afc0d3a20 2023-12-12T10:12:30.138 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.098+0000 7f0b00d9f640 1 -- 172.21.15.78:0/198205065 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0af80a7050 con 0x7f0afc0d3a20 2023-12-12T10:12:30.138 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.098+0000 7f0b00d9f640 1 -- 172.21.15.78:0/198205065 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af80ab980 con 0x7f0afc0d3a20 2023-12-12T10:12:30.139 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.098+0000 7f75ef632640 1 -- 172.21.15.78:0/4035613269 shutdown_connections 2023-12-12T10:12:30.139 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.098+0000 7f75ef632640 1 -- 172.21.15.78:0/4035613269 wait complete. 2023-12-12T10:12:30.139 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.098+0000 7efe5259c640 1 -- 172.21.15.78:0/204030975 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efe5415d490 msgr2=0x7efe540b7cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:30.139 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.098+0000 7efe5259c640 1 --2- 172.21.15.78:0/204030975 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efe5415d490 0x7efe540b7cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:30.139 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.098+0000 7efe5259c640 1 -- 172.21.15.78:0/204030975 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efe540d1d80 msgr2=0x7efe541544c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:30.139 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.098+0000 7efe5259c640 1 --2- 172.21.15.78:0/204030975 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efe540d1d80 0x7efe541544c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:30.139 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.098+0000 7efe5259c640 1 -- 172.21.15.78:0/204030975 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe4c009a70 con 0x7efe540ce6b0 2023-12-12T10:12:30.139 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.098+0000 7f0b02da3640 1 -- 172.21.15.78:0/198205065 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0afc0d3a20 msgr2=0x7f0afc0d1930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:30.140 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.098+0000 7f0b02da3640 1 --2- 172.21.15.78:0/198205065 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0afc0d3a20 0x7f0afc0d1930 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0af80097c0 tx=0x7f0af801c2a0 comp rx=0 tx=0).stop 2023-12-12T10:12:30.140 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.098+0000 7f270c9f8640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f27080ce6b0 0x7f27080b1030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:30.140 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.098+0000 7f0b02da3640 1 -- 172.21.15.78:0/198205065 shutdown_connections 2023-12-12T10:12:30.140 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.098+0000 7f0b02da3640 1 --2- 172.21.15.78:0/198205065 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0afc0d3a20 0x7f0afc0d1930 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:30.140 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.098+0000 7f0b02da3640 1 -- 172.21.15.78:0/198205065 >> 172.21.15.78:0/198205065 conn(0x7f0afc0d2e00 msgr2=0x7f0afc0d3210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:30.140 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.098+0000 7efe5259c640 1 --2- 172.21.15.78:0/204030975 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efe540ce6b0 0x7efe5415b590 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7efe4800c470 tx=0x7efe4800c930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:30.141 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.098+0000 7f270c9f8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f27080d1bb0 0x7f2708140f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:30.141 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.098+0000 7f0b02da3640 1 -- 172.21.15.78:0/198205065 shutdown_connections 2023-12-12T10:12:30.141 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.098+0000 7f0b02da3640 1 -- 172.21.15.78:0/198205065 wait complete. 2023-12-12T10:12:30.142 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.102+0000 7f270659c640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f27080ce6b0 0x7f27080b1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:30.142 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.102+0000 7f270659c640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f27080ce6b0 0x7f27080b1030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.78:38580/0 (socket says 172.21.15.78:38580) 2023-12-12T10:12:30.142 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.102+0000 7f2705d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f27080d1bb0 0x7f2708140f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:30.142 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.102+0000 7f270659c640 1 -- 172.21.15.78:0/819437127 learned_addr learned my addr 172.21.15.78:0/819437127 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:30.142 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.102+0000 7f9e06ffd640 1 -- 172.21.15.78:0/2469005095 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9e0c0c6390 con 0x7f9e180d0be0 2023-12-12T10:12:30.143 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.102+0000 7f270c9f8640 1 --2- 172.21.15.78:0/819437127 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f270815d490 0x7f27081414b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:30.143 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.102+0000 7f270c9f8640 1 -- 172.21.15.78:0/819437127 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27080aff90 con 0x7f27080d1bb0 2023-12-12T10:12:30.143 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.102+0000 7f270c9f8640 1 -- 172.21.15.78:0/819437127 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27080b0270 con 0x7f27080ce6b0 2023-12-12T10:12:30.143 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.102+0000 7f270c9f8640 1 -- 172.21.15.78:0/819437127 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27080b0550 con 0x7f270815d490 2023-12-12T10:12:30.143 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.102+0000 7f2706d9d640 1 --2- 172.21.15.78:0/819437127 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f270815d490 0x7f27081414b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:30.143 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.102+0000 7efe42ffd640 1 -- 172.21.15.78:0/204030975 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe48005cf0 con 0x7efe540ce6b0 2023-12-12T10:12:30.143 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.102+0000 7efe42ffd640 1 -- 172.21.15.78:0/204030975 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe48005e50 con 0x7efe540ce6b0 2023-12-12T10:12:30.143 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.102+0000 7efe42ffd640 1 -- 172.21.15.78:0/204030975 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe480072b0 con 0x7efe540ce6b0 2023-12-12T10:12:30.144 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.102+0000 7f75ef632640 1 Processor -- start 2023-12-12T10:12:30.144 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.102+0000 7f71acff9640 1 -- 172.21.15.78:0/1702350695 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f71a00508c0 con 0x7f71b01ec7f0 2023-12-12T10:12:30.144 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.102+0000 7f2706d9d640 1 -- 172.21.15.78:0/819437127 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f27080ce6b0 msgr2=0x7f27080b1030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:30.144 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.102+0000 7f2706d9d640 1 --2- 172.21.15.78:0/819437127 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f27080ce6b0 0x7f27080b1030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:30.145 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.102+0000 7f2706d9d640 1 -- 172.21.15.78:0/819437127 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f27080d1bb0 msgr2=0x7f2708140f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:30.145 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.102+0000 7f2706d9d640 1 --2- 172.21.15.78:0/819437127 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f27080d1bb0 0x7f2708140f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:30.145 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.102+0000 7f2706d9d640 1 -- 172.21.15.78:0/819437127 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26fc0094d0 con 0x7f270815d490 2023-12-12T10:12:30.145 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.102+0000 7f0b02da3640 1 Processor -- start 2023-12-12T10:12:30.145 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.102+0000 7f0b02da3640 1 -- start start 2023-12-12T10:12:30.145 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.102+0000 7f2706d9d640 1 --2- 172.21.15.78:0/819437127 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f270815d490 0x7f27081414b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f270000c780 tx=0x7f270000cc40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:30.146 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.102+0000 7fbca67fc640 1 -- 172.21.15.78:0/2532473030 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbca00a5a40 con 0x7fbca80df2e0 2023-12-12T10:12:30.146 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.102+0000 7fbca67fc640 1 -- 172.21.15.78:0/2532473030 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbca00a5ba0 con 0x7fbca80df2e0 2023-12-12T10:12:30.146 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.102+0000 7fbca67fc640 1 -- 172.21.15.78:0/2532473030 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbca00047f0 con 0x7fbca80df2e0 2023-12-12T10:12:30.146 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.102+0000 7f9e06ffd640 1 --2- 172.21.15.78:0/2469005095 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f9df80664f0 0x7f9df80689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:30.146 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.102+0000 7f9e06ffd640 1 -- 172.21.15.78:0/2469005095 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9e0c0a7070 con 0x7f9e180d0be0 2023-12-12T10:12:30.147 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.102+0000 7f26f6ffd640 1 -- 172.21.15.78:0/819437127 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2700003d90 con 0x7f270815d490 2023-12-12T10:12:30.147 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.102+0000 7f75ef632640 1 -- start start 2023-12-12T10:12:30.147 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.102+0000 7f26f6ffd640 1 -- 172.21.15.78:0/819437127 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f270000ce30 con 0x7f270815d490 2023-12-12T10:12:30.148 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.102+0000 7f75ef632640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75d40073a0 0x7f75e812f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:30.148 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.102+0000 7f75ef632640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f75e813e1d0 0x7f75e8141c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:30.148 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.102+0000 7f75ef632640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f75e80b0aa0 0x7f75e80b0f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:30.148 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.102+0000 7f75ef632640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75e80b1490 con 0x7f75d40073a0 2023-12-12T10:12:30.148 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.102+0000 7f75ef632640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75e812fa10 con 0x7f75e80b0aa0 2023-12-12T10:12:30.148 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.102+0000 7f75ef632640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75e812fcf0 con 0x7f75e813e1d0 2023-12-12T10:12:30.148 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.102+0000 7f26f6ffd640 1 -- 172.21.15.78:0/819437127 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27000052b0 con 0x7f270815d490 2023-12-12T10:12:30.149 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.102+0000 7efe58809640 1 -- 172.21.15.78:0/204030975 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe541560a0 con 0x7efe540ce6b0 2023-12-12T10:12:30.149 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.102+0000 7efe58809640 1 -- 172.21.15.78:0/204030975 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe5415bad0 con 0x7efe540ce6b0 2023-12-12T10:12:30.149 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.102+0000 7f75edbcf640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f75e80b0aa0 0x7f75e80b0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:30.149 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.102+0000 7f75edbcf640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f75e80b0aa0 0x7f75e80b0f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.78:38582/0 (socket says 172.21.15.78:38582) 2023-12-12T10:12:30.149 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.106+0000 7f75edbcf640 1 -- 172.21.15.78:0/762088281 learned_addr learned my addr 172.21.15.78:0/762088281 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:30.149 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.106+0000 7f75ecbcd640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f75e813e1d0 0x7f75e8141c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:30.149 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.106+0000 7f75ed3ce640 1 --2- 172.21.15.78:0/762088281 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75d40073a0 0x7f75e812f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:30.150 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.102+0000 7f0b02da3640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0afc0d3a20 0x7f0afc0c88d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:30.150 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.102+0000 7f0b02da3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0afc15d070 0x7f0afc158d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:30.150 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.102+0000 7f0b02da3640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0afc15d450 0x7f0afc159240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:30.150 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.102+0000 7f0b02da3640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0afc0b3320 con 0x7f0afc15d070 2023-12-12T10:12:30.150 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.102+0000 7f0b02da3640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0afc0b87d0 con 0x7f0afc15d450 2023-12-12T10:12:30.150 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.102+0000 7f0b02da3640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0afc0b8ab0 con 0x7f0afc0d3a20 2023-12-12T10:12:30.150 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.106+0000 7f0b025a2640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0afc15d450 0x7f0afc159240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:30.150 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.106+0000 7f0b025a2640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0afc15d450 0x7f0afc159240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.78:38592/0 (socket says 172.21.15.78:38592) 2023-12-12T10:12:30.153 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.106+0000 7f0b025a2640 1 -- 172.21.15.78:0/1001544654 learned_addr learned my addr 172.21.15.78:0/1001544654 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:30.154 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.106+0000 7f270c9f8640 1 -- 172.21.15.78:0/819437127 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27080b0830 con 0x7f270815d490 2023-12-12T10:12:30.154 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.106+0000 7f270c9f8640 1 -- 172.21.15.78:0/819437127 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2708147240 con 0x7f270815d490 2023-12-12T10:12:30.154 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.106+0000 7f75ecbcd640 1 -- 172.21.15.78:0/762088281 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f75e80b0aa0 msgr2=0x7f75e80b0f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:30.154 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.106+0000 7f75ecbcd640 1 --2- 172.21.15.78:0/762088281 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f75e80b0aa0 0x7f75e80b0f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:30.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.106+0000 7f75ecbcd640 1 -- 172.21.15.78:0/762088281 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75d40073a0 msgr2=0x7f75e812f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:30.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.106+0000 7f75ecbcd640 1 --2- 172.21.15.78:0/762088281 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75d40073a0 0x7f75e812f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:30.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.106+0000 7f75ecbcd640 1 -- 172.21.15.78:0/762088281 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75e80723c0 con 0x7f75e813e1d0 2023-12-12T10:12:30.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.106+0000 7f75edbcf640 1 --2- 172.21.15.78:0/762088281 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f75e80b0aa0 0x7f75e80b0f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T10:12:30.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.106+0000 7f0b01da1640 1 --2- 172.21.15.78:0/1001544654 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0afc0d3a20 0x7f0afc0c88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:30.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.106+0000 7f75ecbcd640 1 --2- 172.21.15.78:0/762088281 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f75e813e1d0 0x7f75e8141c30 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f75e400fb10 tx=0x7f75e4002170 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:30.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.106+0000 7fbcb81f8640 1 -- 172.21.15.78:0/2532473030 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbca80deae0 con 0x7fbca80df2e0 2023-12-12T10:12:30.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.106+0000 7f75ddffb640 1 -- 172.21.15.78:0/762088281 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75e4006e30 con 0x7f75e813e1d0 2023-12-12T10:12:30.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.106+0000 7f75ddffb640 1 -- 172.21.15.78:0/762088281 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75e4003980 con 0x7f75e813e1d0 2023-12-12T10:12:30.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.106+0000 7f75ddffb640 1 -- 172.21.15.78:0/762088281 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75e4003d30 con 0x7f75e813e1d0 2023-12-12T10:12:30.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.106+0000 7f0b01da1640 1 -- 172.21.15.78:0/1001544654 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0afc15d450 msgr2=0x7f0afc159240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:30.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.106+0000 7f0b01da1640 1 --2- 172.21.15.78:0/1001544654 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0afc15d450 0x7f0afc159240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:30.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.106+0000 7f0b01da1640 1 -- 172.21.15.78:0/1001544654 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0afc15d070 msgr2=0x7f0afc158d00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-12T10:12:30.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.106+0000 7fbcb81f8640 1 -- 172.21.15.78:0/2532473030 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbca80e5290 con 0x7fbca80df2e0 2023-12-12T10:12:30.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.106+0000 7f0b01da1640 1 --2- 172.21.15.78:0/1001544654 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0afc15d070 0x7f0afc158d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:30.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.106+0000 7f0b01da1640 1 -- 172.21.15.78:0/1001544654 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0af8009420 con 0x7f0afc0d3a20 2023-12-12T10:12:30.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.106+0000 7f9e15d9b640 1 --2- 172.21.15.78:0/2469005095 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f9df80664f0 0x7f9df80689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:30.159 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.106+0000 7f0b01da1640 1 --2- 172.21.15.78:0/1001544654 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0afc0d3a20 0x7f0afc0c88d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f0aec00c750 tx=0x7f0aec00cc10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:30.159 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.106+0000 7f9e15d9b640 1 --2- 172.21.15.78:0/2469005095 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f9df80664f0 0x7f9df80689b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f9e1806c500 tx=0x7f9e08008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:30.159 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.106+0000 7f75ef632640 1 -- 172.21.15.78:0/762088281 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75e812d120 con 0x7f75e813e1d0 2023-12-12T10:12:30.159 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.106+0000 7f75ef632640 1 -- 172.21.15.78:0/762088281 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75e812ffd0 con 0x7f75e813e1d0 2023-12-12T10:12:30.159 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.106+0000 7f270c9f8640 1 -- 172.21.15.78:0/819437127 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2708068610 con 0x7f270815d490 2023-12-12T10:12:30.160 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.110+0000 7f26f6ffd640 1 -- 172.21.15.78:0/819437127 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2700005410 con 0x7f270815d490 2023-12-12T10:12:30.160 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.110+0000 7efe42ffd640 1 -- 172.21.15.78:0/204030975 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7efe48007410 con 0x7efe540ce6b0 2023-12-12T10:12:30.160 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.110+0000 7efe58809640 1 -- 172.21.15.78:0/204030975 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe54068610 con 0x7efe540ce6b0 2023-12-12T10:12:30.160 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.106+0000 7f0af27fc640 1 -- 172.21.15.78:0/1001544654 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aec005a80 con 0x7f0afc0d3a20 2023-12-12T10:12:30.160 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.106+0000 7f0af27fc640 1 -- 172.21.15.78:0/1001544654 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0aec005be0 con 0x7f0afc0d3a20 2023-12-12T10:12:30.160 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.106+0000 7f0af27fc640 1 -- 172.21.15.78:0/1001544654 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aec005a80 con 0x7f0afc0d3a20 2023-12-12T10:12:30.161 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.110+0000 7fbcb81f8640 1 -- 172.21.15.78:0/2532473030 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbca80def90 con 0x7fbca80df2e0 2023-12-12T10:12:30.161 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.110+0000 7f0b02da3640 1 -- 172.21.15.78:0/1001544654 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0afc0b49d0 con 0x7f0afc0d3a20 2023-12-12T10:12:30.161 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.110+0000 7f9e06ffd640 1 -- 172.21.15.78:0/2469005095 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9e0c0ebb90 con 0x7f9e180d0be0 2023-12-12T10:12:30.161 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.110+0000 7fbca67fc640 1 -- 172.21.15.78:0/2532473030 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fbca0004b60 con 0x7fbca80df2e0 2023-12-12T10:12:30.162 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.110+0000 7f0b02da3640 1 -- 172.21.15.78:0/1001544654 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0afc0b4f90 con 0x7f0afc0d3a20 2023-12-12T10:12:30.162 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.110+0000 7f26f6ffd640 1 --2- 172.21.15.78:0/819437127 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f26e8066540 0x7f26e8068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:30.162 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.110+0000 7efe42ffd640 1 --2- 172.21.15.78:0/204030975 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7efe34066540 0x7efe34068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:30.162 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.110+0000 7efe42ffd640 1 -- 172.21.15.78:0/204030975 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7efe48083c20 con 0x7efe540ce6b0 2023-12-12T10:12:30.163 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.110+0000 7fbca67fc640 1 --2- 172.21.15.78:0/2532473030 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fbc940664c0 0x7fbc94068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:30.163 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.110+0000 7fbca67fc640 1 -- 172.21.15.78:0/2532473030 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fbca011de10 con 0x7fbca80df2e0 2023-12-12T10:12:30.163 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.110+0000 7f26f6ffd640 1 -- 172.21.15.78:0/819437127 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f27000838a0 con 0x7f270815d490 2023-12-12T10:12:30.163 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.110+0000 7f270659c640 1 --2- 172.21.15.78:0/819437127 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f26e8066540 0x7f26e8068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:30.163 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.110+0000 7efe51d9b640 1 --2- 172.21.15.78:0/204030975 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7efe34066540 0x7efe34068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:30.164 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.110+0000 7efe51d9b640 1 --2- 172.21.15.78:0/204030975 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7efe34066540 0x7efe34068a00 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7efe54158d40 tx=0x7efe44009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:30.164 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.110+0000 7fbcb5f94640 1 --2- 172.21.15.78:0/2532473030 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fbc940664c0 0x7fbc94068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:30.164 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.110+0000 7f270659c640 1 --2- 172.21.15.78:0/819437127 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f26e8066540 0x7f26e8068a00 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f26f80099b0 tx=0x7f26f8009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:30.164 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.110+0000 7f0b02da3640 1 -- 172.21.15.78:0/1001544654 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0afc0b4830 con 0x7f0afc0d3a20 2023-12-12T10:12:30.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.114+0000 7f75ef632640 1 -- 172.21.15.78:0/762088281 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75e812d640 con 0x7f75e813e1d0 2023-12-12T10:12:30.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.114+0000 7f26f6ffd640 1 -- 172.21.15.78:0/819437127 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2700050b50 con 0x7f270815d490 2023-12-12T10:12:30.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.114+0000 7fbcb5f94640 1 --2- 172.21.15.78:0/2532473030 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fbc940664c0 0x7fbc94068980 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fbca8003f90 tx=0x7fbcac00d280 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:30.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.114+0000 7f75ddffb640 1 -- 172.21.15.78:0/762088281 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f75e400d880 con 0x7f75e813e1d0 2023-12-12T10:12:30.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.114+0000 7f0af27fc640 1 -- 172.21.15.78:0/1001544654 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f0aec007070 con 0x7f0afc0d3a20 2023-12-12T10:12:30.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.118+0000 7f75ddffb640 1 --2- 172.21.15.78:0/762088281 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f75cc0664f0 0x7f75cc0689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:30.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.118+0000 7f0af27fc640 1 --2- 172.21.15.78:0/1001544654 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f0ae00664d0 0x7f0ae0068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:30.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.118+0000 7f0b015a0640 1 --2- 172.21.15.78:0/1001544654 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f0ae00664d0 0x7f0ae0068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:30.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.118+0000 7f75ed3ce640 1 --2- 172.21.15.78:0/762088281 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f75cc0664f0 0x7f75cc0689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:30.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.118+0000 7f75ed3ce640 1 --2- 172.21.15.78:0/762088281 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f75cc0664f0 0x7f75cc0689b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f75d8009980 tx=0x7f75d8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:30.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.118+0000 7f0b015a0640 1 --2- 172.21.15.78:0/1001544654 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f0ae00664d0 0x7f0ae0068990 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f0af80ad000 tx=0x7f0af8004740 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:30.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.118+0000 7fbca67fc640 1 -- 172.21.15.78:0/2532473030 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fbca00eb080 con 0x7fbca80df2e0 2023-12-12T10:12:30.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.122+0000 7f75ddffb640 1 -- 172.21.15.78:0/762088281 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f75e4055180 con 0x7f75e813e1d0 2023-12-12T10:12:30.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.122+0000 7f0af27fc640 1 -- 172.21.15.78:0/1001544654 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0aec054890 con 0x7f0afc0d3a20 2023-12-12T10:12:30.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.122+0000 7efe42ffd640 1 -- 172.21.15.78:0/204030975 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7efe48050e70 con 0x7efe540ce6b0 2023-12-12T10:12:30.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.126+0000 7f75ddffb640 1 -- 172.21.15.78:0/762088281 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f75e40514c0 con 0x7f75e813e1d0 2023-12-12T10:12:30.169 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.134+0000 7f0af27fc640 1 -- 172.21.15.78:0/1001544654 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0aec050bd0 con 0x7f0afc0d3a20 2023-12-12T10:12:30.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.426+0000 7f71b6780640 1 -- 172.21.15.78:0/1702350695 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f71b0074610 con 0x7f71b01ec7f0 2023-12-12T10:12:30.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.426+0000 7f71acff9640 1 -- 172.21.15.78:0/1702350695 <== mon.2 v2:172.21.15.187:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f71a00508c0 con 0x7f71b01ec7f0 2023-12-12T10:12:30.436 INFO:teuthology.orchestra.run.smithi078.stdout:55834574858 2023-12-12T10:12:30.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.430+0000 7f71b6780640 1 -- 172.21.15.78:0/1702350695 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f719c066540 msgr2=0x7f719c068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:30.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.430+0000 7f71b6780640 1 --2- 172.21.15.78:0/1702350695 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f719c066540 0x7f719c068a00 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f71b01fa4b0 tx=0x7f71a8009040 comp rx=0 tx=0).stop 2023-12-12T10:12:30.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.430+0000 7f71b6780640 1 -- 172.21.15.78:0/1702350695 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f71b01ec7f0 msgr2=0x7f71b0163da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:30.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.430+0000 7f71b6780640 1 --2- 172.21.15.78:0/1702350695 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f71b01ec7f0 0x7f71b0163da0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f71b006d3c0 tx=0x7f71a0001830 comp rx=0 tx=0).stop 2023-12-12T10:12:30.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.430+0000 7f71b6780640 1 -- 172.21.15.78:0/1702350695 shutdown_connections 2023-12-12T10:12:30.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.430+0000 7f71b6780640 1 --2- 172.21.15.78:0/1702350695 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f719c066540 0x7f719c068a00 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:30.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.430+0000 7f71b6780640 1 --2- 172.21.15.78:0/1702350695 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f71b01ec7f0 0x7f71b0163da0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:30.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.430+0000 7f71b6780640 1 --2- 172.21.15.78:0/1702350695 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f71b01ec370 0x7f71b01f6f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:30.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.430+0000 7f71b6780640 1 --2- 172.21.15.78:0/1702350695 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7198004820 0x7f71b00b4400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:30.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.430+0000 7f71b6780640 1 -- 172.21.15.78:0/1702350695 >> 172.21.15.78:0/1702350695 conn(0x7f71b00b0750 msgr2=0x7f71b00aeee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:30.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.430+0000 7f71b6780640 1 -- 172.21.15.78:0/1702350695 shutdown_connections 2023-12-12T10:12:30.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.430+0000 7f71b6780640 1 -- 172.21.15.78:0/1702350695 wait complete. 2023-12-12T10:12:30.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.434+0000 7f9e1ce32640 1 -- 172.21.15.78:0/2469005095 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f9e18067530 con 0x7f9e180d0be0 2023-12-12T10:12:30.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.438+0000 7f270c9f8640 1 -- 172.21.15.78:0/819437127 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f27080b0690 con 0x7f270815d490 2023-12-12T10:12:30.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.438+0000 7f9e06ffd640 1 -- 172.21.15.78:0/2469005095 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9e0c0ef1b0 con 0x7f9e180d0be0 2023-12-12T10:12:30.444 INFO:teuthology.orchestra.run.smithi078.stdout:55834574856 2023-12-12T10:12:30.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.438+0000 7f4653d80640 1 -- 172.21.15.78:0/1318403341 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f464c151850 con 0x7f464c142890 2023-12-12T10:12:30.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.438+0000 7f26f6ffd640 1 -- 172.21.15.78:0/819437127 <== mon.2 v2:172.21.15.187:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f27080b0690 con 0x7f270815d490 2023-12-12T10:12:30.446 INFO:teuthology.orchestra.run.smithi078.stdout:55834574857 2023-12-12T10:12:30.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.438+0000 7efe58809640 1 -- 172.21.15.78:0/204030975 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7efe5415c4f0 con 0x7efe540ce6b0 2023-12-12T10:12:30.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.442+0000 7f46427fc640 1 -- 172.21.15.78:0/1318403341 <== mon.2 v2:172.21.15.187:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f463c017020 con 0x7f464c142890 2023-12-12T10:12:30.447 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.442+0000 7f9e1ce32640 1 -- 172.21.15.78:0/2469005095 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f9df80664f0 msgr2=0x7f9df80689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:30.448 INFO:teuthology.orchestra.run.smithi078.stdout:55834574857 2023-12-12T10:12:30.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.442+0000 7f9e1ce32640 1 --2- 172.21.15.78:0/2469005095 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f9df80664f0 0x7f9df80689b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f9e1806c500 tx=0x7f9e08008040 comp rx=0 tx=0).stop 2023-12-12T10:12:30.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.442+0000 7f9e1ce32640 1 -- 172.21.15.78:0/2469005095 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9e180d0be0 msgr2=0x7f9e180ca9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:30.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.442+0000 7f9e1ce32640 1 --2- 172.21.15.78:0/2469005095 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9e180d0be0 0x7f9e180ca9d0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f9e0c01a0c0 tx=0x7f9e0c01acd0 comp rx=0 tx=0).stop 2023-12-12T10:12:30.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.442+0000 7efe42ffd640 1 -- 172.21.15.78:0/204030975 <== mon.2 v2:172.21.15.187:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7efe5415c4f0 con 0x7efe540ce6b0 2023-12-12T10:12:30.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.442+0000 7f9e1ce32640 1 -- 172.21.15.78:0/2469005095 shutdown_connections 2023-12-12T10:12:30.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.442+0000 7f9e1ce32640 1 --2- 172.21.15.78:0/2469005095 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f9df80664f0 0x7f9df80689b0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:30.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.442+0000 7f9e1ce32640 1 --2- 172.21.15.78:0/2469005095 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9e18160890 0x7f9e181fa1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:30.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.442+0000 7f9e1ce32640 1 --2- 172.21.15.78:0/2469005095 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9e180d15d0 0x7f9e181587e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:30.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.442+0000 7f9e1ce32640 1 --2- 172.21.15.78:0/2469005095 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9e180d0be0 0x7f9e180ca9d0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:30.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.442+0000 7f9e1ce32640 1 -- 172.21.15.78:0/2469005095 >> 172.21.15.78:0/2469005095 conn(0x7f9e1809c2f0 msgr2=0x7f9e1806c550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:30.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.442+0000 7f9e1ce32640 1 -- 172.21.15.78:0/2469005095 shutdown_connections 2023-12-12T10:12:30.451 INFO:teuthology.orchestra.run.smithi078.stdout:55834574856 2023-12-12T10:12:30.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.442+0000 7f4653d80640 1 -- 172.21.15.78:0/1318403341 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f4630066570 msgr2=0x7f4630068a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:30.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.442+0000 7f4653d80640 1 --2- 172.21.15.78:0/1318403341 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f4630066570 0x7f4630068a30 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f4648009a50 tx=0x7f4648009190 comp rx=0 tx=0).stop 2023-12-12T10:12:30.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.442+0000 7f4653d80640 1 -- 172.21.15.78:0/1318403341 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f464c142890 msgr2=0x7f464c1525f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:30.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.442+0000 7f4653d80640 1 --2- 172.21.15.78:0/1318403341 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f464c142890 0x7f464c1525f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f463c00c390 tx=0x7f463c00c850 comp rx=0 tx=0).stop 2023-12-12T10:12:30.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.442+0000 7f4653d80640 1 -- 172.21.15.78:0/1318403341 shutdown_connections 2023-12-12T10:12:30.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.442+0000 7f4653d80640 1 --2- 172.21.15.78:0/1318403341 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f4630066570 0x7f4630068a30 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:30.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.442+0000 7f4653d80640 1 --2- 172.21.15.78:0/1318403341 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f464c159f30 0x7f464c1534c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:30.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.442+0000 7f4653d80640 1 --2- 172.21.15.78:0/1318403341 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f464c142890 0x7f464c1525f0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:30.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.442+0000 7f4653d80640 1 --2- 172.21.15.78:0/1318403341 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f464c0b1270 0x7f464c14d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:30.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.442+0000 7f4653d80640 1 -- 172.21.15.78:0/1318403341 >> 172.21.15.78:0/1318403341 conn(0x7f464c0b0750 msgr2=0x7f464c06c160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:30.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.446+0000 7f4653d80640 1 -- 172.21.15.78:0/1318403341 shutdown_connections 2023-12-12T10:12:30.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.446+0000 7f4653d80640 1 -- 172.21.15.78:0/1318403341 wait complete. 2023-12-12T10:12:30.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.446+0000 7f9e1ce32640 1 -- 172.21.15.78:0/2469005095 wait complete. 2023-12-12T10:12:30.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.446+0000 7f270c9f8640 1 -- 172.21.15.78:0/819437127 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f26e8066540 msgr2=0x7f26e8068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:30.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.446+0000 7f270c9f8640 1 --2- 172.21.15.78:0/819437127 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f26e8066540 0x7f26e8068a00 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f26f80099b0 tx=0x7f26f8009190 comp rx=0 tx=0).stop 2023-12-12T10:12:30.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.446+0000 7f270c9f8640 1 -- 172.21.15.78:0/819437127 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f270815d490 msgr2=0x7f27081414b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:30.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.446+0000 7f270c9f8640 1 --2- 172.21.15.78:0/819437127 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f270815d490 0x7f27081414b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f270000c780 tx=0x7f270000cc40 comp rx=0 tx=0).stop 2023-12-12T10:12:30.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.446+0000 7f270c9f8640 1 -- 172.21.15.78:0/819437127 shutdown_connections 2023-12-12T10:12:30.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.446+0000 7f270c9f8640 1 --2- 172.21.15.78:0/819437127 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f26e8066540 0x7f26e8068a00 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:30.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.446+0000 7f270c9f8640 1 --2- 172.21.15.78:0/819437127 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f270815d490 0x7f27081414b0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:30.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.446+0000 7f270c9f8640 1 --2- 172.21.15.78:0/819437127 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f27080d1bb0 0x7f2708140f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:30.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.446+0000 7f270c9f8640 1 --2- 172.21.15.78:0/819437127 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f27080ce6b0 0x7f27080b1030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:30.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.446+0000 7f270c9f8640 1 -- 172.21.15.78:0/819437127 >> 172.21.15.78:0/819437127 conn(0x7f27080d3090 msgr2=0x7f27080b4bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:30.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.446+0000 7f270c9f8640 1 -- 172.21.15.78:0/819437127 shutdown_connections 2023-12-12T10:12:30.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.446+0000 7f270c9f8640 1 -- 172.21.15.78:0/819437127 wait complete. 2023-12-12T10:12:30.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.446+0000 7efe58809640 1 -- 172.21.15.78:0/204030975 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7efe34066540 msgr2=0x7efe34068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:30.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.446+0000 7efe58809640 1 --2- 172.21.15.78:0/204030975 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7efe34066540 0x7efe34068a00 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7efe54158d40 tx=0x7efe44009040 comp rx=0 tx=0).stop 2023-12-12T10:12:30.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.446+0000 7efe58809640 1 -- 172.21.15.78:0/204030975 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efe540ce6b0 msgr2=0x7efe5415b590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:30.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.446+0000 7efe58809640 1 --2- 172.21.15.78:0/204030975 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efe540ce6b0 0x7efe5415b590 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7efe4800c470 tx=0x7efe4800c930 comp rx=0 tx=0).stop 2023-12-12T10:12:30.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.446+0000 7efe58809640 1 -- 172.21.15.78:0/204030975 shutdown_connections 2023-12-12T10:12:30.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.446+0000 7efe58809640 1 --2- 172.21.15.78:0/204030975 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7efe34066540 0x7efe34068a00 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:30.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.446+0000 7efe58809640 1 --2- 172.21.15.78:0/204030975 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efe5415d490 0x7efe540b7cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:30.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.446+0000 7efe58809640 1 --2- 172.21.15.78:0/204030975 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efe540d1d80 0x7efe541544c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:30.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.446+0000 7efe58809640 1 --2- 172.21.15.78:0/204030975 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efe540ce6b0 0x7efe5415b590 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:30.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.446+0000 7efe58809640 1 -- 172.21.15.78:0/204030975 >> 172.21.15.78:0/204030975 conn(0x7efe540d3090 msgr2=0x7efe540d1670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:30.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.446+0000 7efe58809640 1 -- 172.21.15.78:0/204030975 shutdown_connections 2023-12-12T10:12:30.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.446+0000 7efe58809640 1 -- 172.21.15.78:0/204030975 wait complete. 2023-12-12T10:12:30.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.450+0000 7fbcb81f8640 1 -- 172.21.15.78:0/2532473030 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fbca8052830 con 0x7fbca80df2e0 2023-12-12T10:12:30.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.450+0000 7fbca67fc640 1 -- 172.21.15.78:0/2532473030 <== mon.2 v2:172.21.15.187:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbca00ee6a0 con 0x7fbca80df2e0 2023-12-12T10:12:30.461 INFO:teuthology.orchestra.run.smithi078.stdout:55834574857 2023-12-12T10:12:30.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.454+0000 7f75ef632640 1 -- 172.21.15.78:0/762088281 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f75e812fe30 con 0x7f75e813e1d0 2023-12-12T10:12:30.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.454+0000 7f0b02da3640 1 -- 172.21.15.78:0/1001544654 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f0afc0b4830 con 0x7f0afc0d3a20 2023-12-12T10:12:30.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.454+0000 7f75ddffb640 1 -- 172.21.15.78:0/762088281 <== mon.2 v2:172.21.15.187:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f75e812fe30 con 0x7f75e813e1d0 2023-12-12T10:12:30.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.454+0000 7fbcb81f8640 1 -- 172.21.15.78:0/2532473030 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fbc940664c0 msgr2=0x7fbc94068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:30.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.454+0000 7fbcb81f8640 1 --2- 172.21.15.78:0/2532473030 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fbc940664c0 0x7fbc94068980 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fbca8003f90 tx=0x7fbcac00d280 comp rx=0 tx=0).stop 2023-12-12T10:12:30.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.454+0000 7fbcb81f8640 1 -- 172.21.15.78:0/2532473030 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbca80df2e0 msgr2=0x7fbca80e99b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:30.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.454+0000 7fbcb81f8640 1 --2- 172.21.15.78:0/2532473030 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbca80df2e0 0x7fbca80e99b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fbca000c1c0 tx=0x7fbc9c005800 comp rx=0 tx=0).stop 2023-12-12T10:12:30.464 INFO:teuthology.orchestra.run.smithi078.stdout:55834574856 2023-12-12T10:12:30.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.454+0000 7f0af27fc640 1 -- 172.21.15.78:0/1001544654 <== mon.2 v2:172.21.15.187:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0afc0b4830 con 0x7f0afc0d3a20 2023-12-12T10:12:30.465 INFO:teuthology.orchestra.run.smithi078.stdout:55834574856 2023-12-12T10:12:30.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.458+0000 7fbcb81f8640 1 -- 172.21.15.78:0/2532473030 shutdown_connections 2023-12-12T10:12:30.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.458+0000 7fbcb81f8640 1 --2- 172.21.15.78:0/2532473030 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fbc940664c0 0x7fbc94068980 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:30.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.458+0000 7fbcb81f8640 1 --2- 172.21.15.78:0/2532473030 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbca80e4de0 0x7fbca80dbc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:30.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.458+0000 7fbcb81f8640 1 --2- 172.21.15.78:0/2532473030 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbca80df2e0 0x7fbca80e99b0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:30.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.458+0000 7fbcb81f8640 1 --2- 172.21.15.78:0/2532473030 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbc9c0047d0 0x7fbca80ddc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:30.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.458+0000 7fbcb81f8640 1 -- 172.21.15.78:0/2532473030 >> 172.21.15.78:0/2532473030 conn(0x7fbca8009fc0 msgr2=0x7fbca80396f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:30.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.458+0000 7f0b02da3640 1 -- 172.21.15.78:0/1001544654 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f0ae00664d0 msgr2=0x7f0ae0068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:30.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.458+0000 7f0b02da3640 1 --2- 172.21.15.78:0/1001544654 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f0ae00664d0 0x7f0ae0068990 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f0af80ad000 tx=0x7f0af8004740 comp rx=0 tx=0).stop 2023-12-12T10:12:30.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.458+0000 7f0b02da3640 1 -- 172.21.15.78:0/1001544654 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0afc0d3a20 msgr2=0x7f0afc0c88d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:30.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.458+0000 7f0b02da3640 1 --2- 172.21.15.78:0/1001544654 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0afc0d3a20 0x7f0afc0c88d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f0aec00c750 tx=0x7f0aec00cc10 comp rx=0 tx=0).stop 2023-12-12T10:12:30.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.458+0000 7f0b02da3640 1 -- 172.21.15.78:0/1001544654 shutdown_connections 2023-12-12T10:12:30.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.458+0000 7f0b02da3640 1 --2- 172.21.15.78:0/1001544654 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f0ae00664d0 0x7f0ae0068990 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:30.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.458+0000 7f0b02da3640 1 --2- 172.21.15.78:0/1001544654 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0afc15d450 0x7f0afc159240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:30.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.458+0000 7f0b02da3640 1 --2- 172.21.15.78:0/1001544654 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0afc15d070 0x7f0afc158d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:30.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.458+0000 7f0b02da3640 1 --2- 172.21.15.78:0/1001544654 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0afc0d3a20 0x7f0afc0c88d0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:30.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.458+0000 7f0b02da3640 1 -- 172.21.15.78:0/1001544654 >> 172.21.15.78:0/1001544654 conn(0x7f0afc0d2e00 msgr2=0x7f0afc0cf5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:30.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.458+0000 7fbcb81f8640 1 -- 172.21.15.78:0/2532473030 shutdown_connections 2023-12-12T10:12:30.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.458+0000 7fbcb81f8640 1 -- 172.21.15.78:0/2532473030 wait complete. 2023-12-12T10:12:30.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.458+0000 7f0b02da3640 1 -- 172.21.15.78:0/1001544654 shutdown_connections 2023-12-12T10:12:30.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.458+0000 7f0b02da3640 1 -- 172.21.15.78:0/1001544654 wait complete. 2023-12-12T10:12:30.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.458+0000 7f75ef632640 1 -- 172.21.15.78:0/762088281 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f75cc0664f0 msgr2=0x7f75cc0689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:30.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.462+0000 7f75ef632640 1 --2- 172.21.15.78:0/762088281 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f75cc0664f0 0x7f75cc0689b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f75d8009980 tx=0x7f75d8008040 comp rx=0 tx=0).stop 2023-12-12T10:12:30.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.462+0000 7f75ef632640 1 -- 172.21.15.78:0/762088281 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f75e813e1d0 msgr2=0x7f75e8141c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:30.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.462+0000 7f75ef632640 1 --2- 172.21.15.78:0/762088281 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f75e813e1d0 0x7f75e8141c30 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f75e400fb10 tx=0x7f75e4002170 comp rx=0 tx=0).stop 2023-12-12T10:12:30.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.462+0000 7f75ef632640 1 -- 172.21.15.78:0/762088281 shutdown_connections 2023-12-12T10:12:30.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.462+0000 7f75ef632640 1 --2- 172.21.15.78:0/762088281 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f75cc0664f0 0x7f75cc0689b0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:30.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.462+0000 7f75ef632640 1 --2- 172.21.15.78:0/762088281 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f75e80b0aa0 0x7f75e80b0f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:30.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.462+0000 7f75ef632640 1 --2- 172.21.15.78:0/762088281 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f75e813e1d0 0x7f75e8141c30 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:30.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.462+0000 7f75ef632640 1 --2- 172.21.15.78:0/762088281 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f75d40073a0 0x7f75e812f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:30.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.462+0000 7f75ef632640 1 -- 172.21.15.78:0/762088281 >> 172.21.15.78:0/762088281 conn(0x7f75e806b650 msgr2=0x7f75e806a540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:30.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.462+0000 7f75ef632640 1 -- 172.21.15.78:0/762088281 shutdown_connections 2023-12-12T10:12:30.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:30.462+0000 7f75ef632640 1 -- 172.21.15.78:0/762088281 wait complete. 2023-12-12T10:12:30.478 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.2 2023-12-12T10:12:30.493 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.6 2023-12-12T10:12:30.498 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.1 2023-12-12T10:12:30.499 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.3 2023-12-12T10:12:30.500 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.4 2023-12-12T10:12:30.502 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.0 2023-12-12T10:12:30.506 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.7 2023-12-12T10:12:30.507 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.5 2023-12-12T10:12:31.479 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-12-12T10:12:31.494 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-12-12T10:12:31.498 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-12-12T10:12:31.500 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-12-12T10:12:31.501 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-12-12T10:12:31.503 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-12-12T10:12:31.507 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-12-12T10:12:31.507 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-12-12T10:12:31.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.686+0000 7f77b01c4640 1 Processor -- start 2023-12-12T10:12:31.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.686+0000 7f77b01c4640 1 -- start start 2023-12-12T10:12:31.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.686+0000 7f77b01c4640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f77a8142890 0x7f77a815caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:31.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.686+0000 7f77b01c4640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f77a8070810 0x7f77a80cd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:31.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.690+0000 7f77b01c4640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77a815a3c0 con 0x7f77a8159f30 2023-12-12T10:12:31.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.690+0000 7f77adf60640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f77a8142890 0x7f77a815caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:31.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.690+0000 7f77ae761640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f77a8070810 0x7f77a80cd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:31.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.690+0000 7f77adf60640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f77a8142890 0x7f77a815caa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.78:38606/0 (socket says 172.21.15.78:38606) 2023-12-12T10:12:31.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.690+0000 7f77adf60640 1 -- 172.21.15.78:0/2367155152 learned_addr learned my addr 172.21.15.78:0/2367155152 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:31.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.690+0000 7f77ae761640 1 --2- 172.21.15.78:0/2367155152 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f77a8070810 0x7f77a80cd1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.78:47702/0 (socket says 172.21.15.78:47702) 2023-12-12T10:12:31.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.690+0000 7f77b01c4640 1 -- 172.21.15.78:0/2367155152 --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77a815d9d0 con 0x7f77a8142890 2023-12-12T10:12:31.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.690+0000 7f77b01c4640 1 -- 172.21.15.78:0/2367155152 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77a815d130 con 0x7f77a8070810 2023-12-12T10:12:31.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.690+0000 7f77acf5e640 1 -- 172.21.15.78:0/2367155152 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3586540008 0 0) 0x7f77a815a3c0 con 0x7f77a8159f30 2023-12-12T10:12:31.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.690+0000 7f77acf5e640 1 -- 172.21.15.78:0/2367155152 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7794005740 con 0x7f77a8159f30 2023-12-12T10:12:31.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.690+0000 7f77acf5e640 1 -- 172.21.15.78:0/2367155152 <== mon.1 v1:172.21.15.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2318015503 0 0) 0x7f7794005740 con 0x7f77a8159f30 2023-12-12T10:12:31.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.690+0000 7f77ae761640 1 -- 172.21.15.78:0/2367155152 >> v2:172.21.15.187:3300/0 conn(0x7f77a8142890 msgr2=0x7f77a815caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:31.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.690+0000 7f77ae761640 1 --2- 172.21.15.78:0/2367155152 >> v2:172.21.15.187:3300/0 conn(0x7f77a8142890 0x7f77a815caa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:31.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.690+0000 7f77ae761640 1 -- 172.21.15.78:0/2367155152 >> v1:172.21.15.187:6789/0 conn(0x7f77a8159f30 legacy=0x7f77a8070100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:31.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.690+0000 7f77ae761640 1 -- 172.21.15.78:0/2367155152 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77a815d410 con 0x7f77a8070810 2023-12-12T10:12:31.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.690+0000 7f77adf60640 1 --2- 172.21.15.78:0/2367155152 >> v2:172.21.15.187:3300/0 conn(0x7f77a8142890 0x7f77a815caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-12T10:12:31.702 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.694+0000 7f77ae761640 1 --2- 172.21.15.78:0/2367155152 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f77a8070810 0x7f77a80cd1c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f77a0009d90 tx=0x7f77a001c840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9645536c69bd088c server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:31.702 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.694+0000 7f77acf5e640 1 -- 172.21.15.78:0/2367155152 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77a40016a0 con 0x7f77a8070810 2023-12-12T10:12:31.702 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.694+0000 7f77acf5e640 1 -- 172.21.15.78:0/2367155152 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77a00a5640 con 0x7f77a8070810 2023-12-12T10:12:31.702 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.694+0000 7f77acf5e640 1 -- 172.21.15.78:0/2367155152 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77a00a59d0 con 0x7f77a8070810 2023-12-12T10:12:31.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.698+0000 7f77b01c4640 1 -- 172.21.15.78:0/2367155152 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f77a8070810 msgr2=0x7f77a80cd1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:31.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.698+0000 7f77b01c4640 1 --2- 172.21.15.78:0/2367155152 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f77a8070810 0x7f77a80cd1c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f77a0009d90 tx=0x7f77a001c840 comp rx=0 tx=0).stop 2023-12-12T10:12:31.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.698+0000 7f77b01c4640 1 -- 172.21.15.78:0/2367155152 shutdown_connections 2023-12-12T10:12:31.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.698+0000 7f77b01c4640 1 --2- 172.21.15.78:0/2367155152 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f77a8070810 0x7f77a80cd1c0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:31.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.698+0000 7f77b01c4640 1 --2- 172.21.15.78:0/2367155152 >> v2:172.21.15.187:3300/0 conn(0x7f77a8142890 0x7f77a815caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:31.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.698+0000 7f77b01c4640 1 -- 172.21.15.78:0/2367155152 >> 172.21.15.78:0/2367155152 conn(0x7f77a80b0750 msgr2=0x7f77a80b0b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:31.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.698+0000 7f77b01c4640 1 -- 172.21.15.78:0/2367155152 shutdown_connections 2023-12-12T10:12:31.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.698+0000 7f77b01c4640 1 -- 172.21.15.78:0/2367155152 wait complete. 2023-12-12T10:12:31.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.702+0000 7f77b01c4640 1 Processor -- start 2023-12-12T10:12:31.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.702+0000 7f77b01c4640 1 -- start start 2023-12-12T10:12:31.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.702+0000 7f77b01c4640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f77a8070810 0x7f77a815c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:31.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.702+0000 7f77b01c4640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f77a8142890 0x7f77a8155500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:31.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.702+0000 7f77b01c4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f77a8159f30 0x7f77a80af830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:31.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.702+0000 7f77b01c4640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77a813ff20 con 0x7f77a8159f30 2023-12-12T10:12:31.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.702+0000 7f77b01c4640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77a813e240 con 0x7f77a8070810 2023-12-12T10:12:31.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.702+0000 7f77b01c4640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77a813e4e0 con 0x7f77a8142890 2023-12-12T10:12:31.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.702+0000 7f77ad75f640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f77a8142890 0x7f77a8155500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:31.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.702+0000 7f77ad75f640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f77a8142890 0x7f77a8155500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.78:47710/0 (socket says 172.21.15.78:47710) 2023-12-12T10:12:31.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.702+0000 7f77ad75f640 1 -- 172.21.15.78:0/2101340714 learned_addr learned my addr 172.21.15.78:0/2101340714 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:31.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.702+0000 7f77adf60640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f77a8070810 0x7f77a815c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:31.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.702+0000 7f77ae761640 1 --2- 172.21.15.78:0/2101340714 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f77a8159f30 0x7f77a80af830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:31.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.706+0000 7f77ae761640 1 -- 172.21.15.78:0/2101340714 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f77a8142890 msgr2=0x7f77a8155500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:31.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.706+0000 7f77ae761640 1 --2- 172.21.15.78:0/2101340714 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f77a8142890 0x7f77a8155500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:31.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.706+0000 7f77ae761640 1 -- 172.21.15.78:0/2101340714 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f77a8070810 msgr2=0x7f77a815c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:31.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.706+0000 7f77ae761640 1 --2- 172.21.15.78:0/2101340714 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f77a8070810 0x7f77a815c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:31.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.706+0000 7f77ae761640 1 -- 172.21.15.78:0/2101340714 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7798008050 con 0x7f77a8159f30 2023-12-12T10:12:31.713 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.706+0000 7f77ae761640 1 --2- 172.21.15.78:0/2101340714 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f77a8159f30 0x7f77a80af830 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f77a00ac000 tx=0x7f77a00195e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:31.713 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.706+0000 7f779e7fc640 1 -- 172.21.15.78:0/2101340714 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77a00bcca0 con 0x7f77a8159f30 2023-12-12T10:12:31.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.706+0000 7f779e7fc640 1 -- 172.21.15.78:0/2101340714 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77a00c0070 con 0x7f77a8159f30 2023-12-12T10:12:31.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.706+0000 7f77b01c4640 1 -- 172.21.15.78:0/2101340714 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77a0009a70 con 0x7f77a8159f30 2023-12-12T10:12:31.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.706+0000 7f77b01c4640 1 -- 172.21.15.78:0/2101340714 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77a815c700 con 0x7f77a8159f30 2023-12-12T10:12:31.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.706+0000 7f779e7fc640 1 -- 172.21.15.78:0/2101340714 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77a00ad440 con 0x7f77a8159f30 2023-12-12T10:12:31.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.710+0000 7f779e7fc640 1 -- 172.21.15.78:0/2101340714 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f77a00ad5a0 con 0x7f77a8159f30 2023-12-12T10:12:31.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.714+0000 7f77b01c4640 1 -- 172.21.15.78:0/2101340714 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7790005260 con 0x7f77a8159f30 2023-12-12T10:12:31.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.714+0000 7f779e7fc640 1 --2- 172.21.15.78:0/2101340714 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f778c0664a0 0x7f778c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:31.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.714+0000 7f77adf60640 1 --2- 172.21.15.78:0/2101340714 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f778c0664a0 0x7f778c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:31.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.714+0000 7f779e7fc640 1 -- 172.21.15.78:0/2101340714 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f77a00c2070 con 0x7f77a8159f30 2023-12-12T10:12:31.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.714+0000 7f77adf60640 1 --2- 172.21.15.78:0/2101340714 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f778c0664a0 0x7f778c068960 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f77a80b06b0 tx=0x7f779800c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:31.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.722+0000 7f779e7fc640 1 -- 172.21.15.78:0/2101340714 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f77a00f3d90 con 0x7f77a8159f30 2023-12-12T10:12:31.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.770+0000 7feb90c17640 1 Processor -- start 2023-12-12T10:12:31.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.770+0000 7feb90c17640 1 -- start start 2023-12-12T10:12:31.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.770+0000 7feb90c17640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7feb840e77f0 0x7feb8404f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:31.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.770+0000 7feb90c17640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7feb8404f5a0 0x7feb840e6c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:31.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.770+0000 7feb90c17640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb84037b00 con 0x7feb840e30a0 2023-12-12T10:12:31.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.770+0000 7feb90c17640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb8404fb10 con 0x7feb8404f5a0 2023-12-12T10:12:31.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.770+0000 7feb90c17640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb8403a420 con 0x7feb840e77f0 2023-12-12T10:12:31.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.770+0000 7feb89d9b640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7feb840e77f0 0x7feb8404f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:31.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.770+0000 7feb8ad9d640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7feb8404f5a0 0x7feb840e6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:31.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.770+0000 7feb89d9b640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7feb840e77f0 0x7feb8404f060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.78:47726/0 (socket says 172.21.15.78:47726) 2023-12-12T10:12:31.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.770+0000 7feb89d9b640 1 -- 172.21.15.78:0/3269346801 learned_addr learned my addr 172.21.15.78:0/3269346801 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:31.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.770+0000 7feb8ad9d640 1 -- 172.21.15.78:0/3269346801 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7feb840e77f0 msgr2=0x7feb8404f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:31.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.770+0000 7feb8ad9d640 1 --2- 172.21.15.78:0/3269346801 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7feb840e77f0 0x7feb8404f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:31.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.770+0000 7feb8ad9d640 1 -- 172.21.15.78:0/3269346801 >> v1:172.21.15.187:6789/0 conn(0x7feb840e30a0 legacy=0x7feb84054200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:31.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.774+0000 7fc9a7f2a640 1 Processor -- start 2023-12-12T10:12:31.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.770+0000 7feb8ad9d640 1 -- 172.21.15.78:0/3269346801 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb8403a700 con 0x7feb8404f5a0 2023-12-12T10:12:31.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.774+0000 7fc9a7f2a640 1 -- start start 2023-12-12T10:12:31.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.774+0000 7fc9a7f2a640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc9a0146850 0x7fc9a015d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:31.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.774+0000 7fc9a7f2a640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fc9a00ae260 0x7fc9a01613a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:31.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.774+0000 7fc9a7f2a640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc9a01618e0 0x7fc9a00b2f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:31.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.774+0000 7fc9a7f2a640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9a0160f10 con 0x7fc9a0146850 2023-12-12T10:12:31.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.774+0000 7fc9a7f2a640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9a0160be0 con 0x7fc9a00ae260 2023-12-12T10:12:31.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.774+0000 7fc9a7f2a640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a0146c30 con 0x7fc9a01618e0 2023-12-12T10:12:31.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.774+0000 7feb8ad9d640 1 --2- 172.21.15.78:0/3269346801 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7feb8404f5a0 0x7feb840e6c00 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7feb8c02cef0 tx=0x7feb8c0990d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=47b1c22cafc03680 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:31.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.774+0000 7fc9a5cc6640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc9a0146850 0x7fc9a015d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:31.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.774+0000 7feb8959a640 1 -- 172.21.15.78:0/3269346801 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb8c122db0 con 0x7feb8404f5a0 2023-12-12T10:12:31.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.774+0000 7feb8959a640 1 -- 172.21.15.78:0/3269346801 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb8c12a440 con 0x7feb8404f5a0 2023-12-12T10:12:31.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.774+0000 7feb8959a640 1 -- 172.21.15.78:0/3269346801 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb8c12a830 con 0x7feb8404f5a0 2023-12-12T10:12:31.784 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.774+0000 7fc9a5cc6640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc9a0146850 0x7fc9a015d5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37106/0 (socket says 172.21.15.78:37106) 2023-12-12T10:12:31.784 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.774+0000 7fc9a64c7640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc9a01618e0 0x7fc9a00b2f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:31.784 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.774+0000 7fc9a5cc6640 1 -- 172.21.15.78:0/2744189610 learned_addr learned my addr 172.21.15.78:0/2744189610 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:31.784 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.774+0000 7fc9a5cc6640 1 -- 172.21.15.78:0/2744189610 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc9a01618e0 msgr2=0x7fc9a00b2f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:31.784 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.774+0000 7fc9a5cc6640 1 --2- 172.21.15.78:0/2744189610 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc9a01618e0 0x7fc9a00b2f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:31.784 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.774+0000 7fc9a5cc6640 1 -- 172.21.15.78:0/2744189610 >> v2:172.21.15.187:3300/0 conn(0x7fc9a00ae260 msgr2=0x7fc9a01613a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-12-12T10:12:31.785 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.774+0000 7fc9a5cc6640 1 --2- 172.21.15.78:0/2744189610 >> v2:172.21.15.187:3300/0 conn(0x7fc9a00ae260 0x7fc9a01613a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:31.785 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.774+0000 7fc9a5cc6640 1 -- 172.21.15.78:0/2744189610 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9a015deb0 con 0x7fc9a0146850 2023-12-12T10:12:31.785 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.778+0000 7fb8ab7c1640 1 Processor -- start 2023-12-12T10:12:31.785 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.778+0000 7feb90c17640 1 -- 172.21.15.78:0/3269346801 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7feb8404f5a0 msgr2=0x7feb840e6c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:31.786 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.778+0000 7feb90c17640 1 --2- 172.21.15.78:0/3269346801 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7feb8404f5a0 0x7feb840e6c00 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7feb8c02cef0 tx=0x7feb8c0990d0 comp rx=0 tx=0).stop 2023-12-12T10:12:31.786 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.778+0000 7feb90c17640 1 -- 172.21.15.78:0/3269346801 shutdown_connections 2023-12-12T10:12:31.786 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.778+0000 7feb90c17640 1 --2- 172.21.15.78:0/3269346801 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7feb8404f5a0 0x7feb840e6c00 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:31.786 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.778+0000 7feb90c17640 1 --2- 172.21.15.78:0/3269346801 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7feb840e77f0 0x7feb8404f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:31.786 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.778+0000 7feb90c17640 1 -- 172.21.15.78:0/3269346801 >> 172.21.15.78:0/3269346801 conn(0x7feb84009f90 msgr2=0x7feb8400a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:31.786 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.778+0000 7feb90c17640 1 -- 172.21.15.78:0/3269346801 shutdown_connections 2023-12-12T10:12:31.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.778+0000 7fb8ab7c1640 1 -- start start 2023-12-12T10:12:31.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.778+0000 7feb90c17640 1 -- 172.21.15.78:0/3269346801 wait complete. 2023-12-12T10:12:31.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.778+0000 7fc9a5cc6640 1 --2- 172.21.15.78:0/2744189610 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc9a0146850 0x7fc9a015d5f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fc998009e50 tx=0x7fc99801c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d570473026e81fd server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:31.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.782+0000 7feb90c17640 1 Processor -- start 2023-12-12T10:12:31.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.782+0000 7fb8ab7c1640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb8a40cc780 0x7fb8a40ccc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:31.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.782+0000 7fb8ab7c1640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fb8a40b39f0 0x7fb8a40b3df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:31.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.782+0000 7feb90c17640 1 -- start start 2023-12-12T10:12:31.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.782+0000 7fb8a955d640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7fb8a4141ac0 0x7fb8a40b1e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.78:51662/0 (socket says 172.21.15.78:51662) 2023-12-12T10:12:31.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.782+0000 7fb8a8d5c640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb8a40cc780 0x7fb8a40ccc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:31.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.782+0000 7fb8a8d5c640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb8a40cc780 0x7fb8a40ccc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37118/0 (socket says 172.21.15.78:37118) 2023-12-12T10:12:31.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.782+0000 7fec50859640 1 Processor -- start 2023-12-12T10:12:31.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.782+0000 7fc9a4cc4640 1 -- 172.21.15.78:0/2744189610 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9980a5750 con 0x7fc9a0146850 2023-12-12T10:12:31.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.782+0000 7fc9a4cc4640 1 -- 172.21.15.78:0/2744189610 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9980a58b0 con 0x7fc9a0146850 2023-12-12T10:12:31.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.782+0000 7fc9a4cc4640 1 -- 172.21.15.78:0/2744189610 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9980a5c40 con 0x7fc9a0146850 2023-12-12T10:12:31.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.782+0000 7fb8a955d640 1 -- 172.21.15.78:0/4187502048 learned_addr learned my addr 172.21.15.78:0/4187502048 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-12-12T10:12:31.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.782+0000 7fb8a9d5e640 1 --2- 172.21.15.78:0/4187502048 >> v2:172.21.15.187:3300/0 conn(0x7fb8a40b39f0 0x7fb8a40b3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:31.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.782+0000 7fb8ab7c1640 1 -- 172.21.15.78:0/4187502048 --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8a40b28e0 con 0x7fb8a4141ac0 2023-12-12T10:12:31.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.782+0000 7fc9a7f2a640 1 -- 172.21.15.78:0/2744189610 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc9a0146850 msgr2=0x7fc9a015d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:31.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.782+0000 7fc9a7f2a640 1 --2- 172.21.15.78:0/2744189610 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc9a0146850 0x7fc9a015d5f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fc998009e50 tx=0x7fc99801c9c0 comp rx=0 tx=0).stop 2023-12-12T10:12:31.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.782+0000 7feb90c17640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7feb840e30a0 0x7feb840d7270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:31.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.782+0000 7feb90c17640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7feb840e77f0 0x7feb84049c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:31.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.782+0000 7feb90c17640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb840e52d0 0x7feb84048270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:31.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.782+0000 7feb90c17640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb840d77b0 con 0x7feb840e52d0 2023-12-12T10:12:31.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.782+0000 7feb90c17640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb8404a1c0 con 0x7feb840e30a0 2023-12-12T10:12:31.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.782+0000 7feb90c17640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb84048be0 con 0x7feb840e77f0 2023-12-12T10:12:31.793 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.782+0000 7fb8ab7c1640 1 -- 172.21.15.78:0/4187502048 --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8a40b2ea0 con 0x7fb8a40cc780 2023-12-12T10:12:31.793 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.782+0000 7fb89bfff640 1 -- 172.21.15.78:0/4187502048 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3860237965 0 0) 0x7fb8a40b28e0 con 0x7fb8a4141ac0 2023-12-12T10:12:31.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.782+0000 7fc9a7f2a640 1 -- 172.21.15.78:0/2744189610 shutdown_connections 2023-12-12T10:12:31.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.782+0000 7fc9a7f2a640 1 --2- 172.21.15.78:0/2744189610 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc9a01618e0 0x7fc9a00b2f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:31.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.782+0000 7fc9a7f2a640 1 --2- 172.21.15.78:0/2744189610 >> v2:172.21.15.187:3300/0 conn(0x7fc9a00ae260 0x7fc9a01613a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:31.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.782+0000 7fc9a7f2a640 1 --2- 172.21.15.78:0/2744189610 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc9a0146850 0x7fc9a015d5f0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:31.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.782+0000 7feb8ad9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb840e52d0 0x7feb84048270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:31.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.782+0000 7fc9a7f2a640 1 -- 172.21.15.78:0/2744189610 >> 172.21.15.78:0/2744189610 conn(0x7fc9a00b0b20 msgr2=0x7fc9a00b0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:31.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.782+0000 7feb89d9b640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7feb840e77f0 0x7feb84049c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:31.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.782+0000 7feb89d9b640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7feb840e77f0 0x7feb84049c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.78:47738/0 (socket says 172.21.15.78:47738) 2023-12-12T10:12:31.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.782+0000 7feb89d9b640 1 -- 172.21.15.78:0/3586491428 learned_addr learned my addr 172.21.15.78:0/3586491428 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:31.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.782+0000 7fb8ab7c1640 1 -- 172.21.15.78:0/4187502048 --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8a40b4330 con 0x7fb8a40b39f0 2023-12-12T10:12:31.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.782+0000 7fec50859640 1 -- start start 2023-12-12T10:12:31.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.782+0000 7fec50859640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fec4c15cf40 0x7fec4c0ce3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:31.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.782+0000 7fec50859640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fec4c0ce930 0x7fec4c0d13b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:31.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.782+0000 7fec50859640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fec4c0d0410 0x7fec4c0d18f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:31.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.782+0000 7fec50859640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec4c0cfff0 con 0x7fec4c15cf40 2023-12-12T10:12:31.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.782+0000 7fec50859640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec4c0cf400 con 0x7fec4c0d0410 2023-12-12T10:12:31.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.782+0000 7fec50859640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec4c0cf650 con 0x7fec4c0ce930 2023-12-12T10:12:31.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.782+0000 7fb89bfff640 1 -- 172.21.15.78:0/4187502048 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb890003530 con 0x7fb8a4141ac0 2023-12-12T10:12:31.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.782+0000 7fec4a59c640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fec4c0ce930 0x7fec4c0d13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:31.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.782+0000 7feb89d9b640 1 -- 172.21.15.78:0/3586491428 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7feb840e30a0 msgr2=0x7feb840d7270 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-12-12T10:12:31.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.782+0000 7feb89d9b640 1 --2- 172.21.15.78:0/3586491428 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7feb840e30a0 0x7feb840d7270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:31.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.782+0000 7feb89d9b640 1 -- 172.21.15.78:0/3586491428 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb840e52d0 msgr2=0x7feb84048270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:31.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.782+0000 7feb89d9b640 1 --2- 172.21.15.78:0/3586491428 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb840e52d0 0x7feb84048270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:31.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.782+0000 7feb89d9b640 1 -- 172.21.15.78:0/3586491428 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb8c04f7e0 con 0x7feb840e77f0 2023-12-12T10:12:31.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.782+0000 7fec4b59e640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fec4c0d0410 0x7fec4c0d18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:31.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.782+0000 7fec4a59c640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fec4c0ce930 0x7fec4c0d13b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.78:47740/0 (socket says 172.21.15.78:47740) 2023-12-12T10:12:31.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.782+0000 7fec4a59c640 1 -- 172.21.15.78:0/643471261 learned_addr learned my addr 172.21.15.78:0/643471261 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:31.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.786+0000 7feb89d9b640 1 --2- 172.21.15.78:0/3586491428 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7feb840e77f0 0x7feb84049c80 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7feb7c00e7f0 tx=0x7feb7c00ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:31.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.782+0000 7fc4cea5a640 1 Processor -- start 2023-12-12T10:12:31.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.782+0000 7fc4cea5a640 1 -- start start 2023-12-12T10:12:31.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.782+0000 7fc4cea5a640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc4c8169be0 0x7fc4c806d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:31.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.786+0000 7fc4cea5a640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc4c8071a20 0x7fc4c80cc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:31.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.786+0000 7fc4cea5a640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4c80702c0 con 0x7fc4c806dc90 2023-12-12T10:12:31.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.786+0000 7fc4cea5a640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4c8070b60 con 0x7fc4c8071a20 2023-12-12T10:12:31.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.786+0000 7fc4cea5a640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4c8169fc0 con 0x7fc4c8169be0 2023-12-12T10:12:31.800 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.786+0000 7fc4c77fe640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7fc4c806dc90 0x7fc4c8071310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.78:51678/0 (socket says 172.21.15.78:51678) 2023-12-12T10:12:31.800 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.786+0000 7fc4c77fe640 1 -- 172.21.15.78:0/2851156974 learned_addr learned my addr 172.21.15.78:0/2851156974 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-12-12T10:12:31.800 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.786+0000 7fc9a7f2a640 1 -- 172.21.15.78:0/2744189610 shutdown_connections 2023-12-12T10:12:31.800 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.786+0000 7fc4c7fff640 1 --2- 172.21.15.78:0/2851156974 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc4c8169be0 0x7fc4c806d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:31.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.786+0000 7feb7affd640 1 -- 172.21.15.78:0/3586491428 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb7c009580 con 0x7feb840e77f0 2023-12-12T10:12:31.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.786+0000 7feb7affd640 1 -- 172.21.15.78:0/3586491428 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb7c00c940 con 0x7feb840e77f0 2023-12-12T10:12:31.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.786+0000 7feb7affd640 1 -- 172.21.15.78:0/3586491428 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb7c00ccf0 con 0x7feb840e77f0 2023-12-12T10:12:31.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.786+0000 7fc4c6ffd640 1 -- 172.21.15.78:0/2851156974 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3349660136 0 0) 0x7fc4c80702c0 con 0x7fc4c806dc90 2023-12-12T10:12:31.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.786+0000 7fc4c6ffd640 1 -- 172.21.15.78:0/2851156974 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc4bc003530 con 0x7fc4c806dc90 2023-12-12T10:12:31.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.786+0000 7feb90c17640 1 -- 172.21.15.78:0/3586491428 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb84048ec0 con 0x7feb840e77f0 2023-12-12T10:12:31.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.786+0000 7fc4c6ffd640 1 -- 172.21.15.78:0/2851156974 <== mon.1 v1:172.21.15.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1234862864 0 0) 0x7fc4bc003530 con 0x7fc4c806dc90 2023-12-12T10:12:31.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.786+0000 7fc4c6ffd640 1 -- 172.21.15.78:0/2851156974 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc4c8169be0 msgr2=0x7fc4c806d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:31.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.786+0000 7fc4c6ffd640 1 --2- 172.21.15.78:0/2851156974 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc4c8169be0 0x7fc4c806d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:31.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.786+0000 7fc4c6ffd640 1 -- 172.21.15.78:0/2851156974 >> v2:172.21.15.78:3300/0 conn(0x7fc4c8071a20 msgr2=0x7fc4c80cc2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:31.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.786+0000 7fc4c6ffd640 1 --2- 172.21.15.78:0/2851156974 >> v2:172.21.15.78:3300/0 conn(0x7fc4c8071a20 0x7fc4c80cc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:31.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.786+0000 7fc4c6ffd640 1 -- 172.21.15.78:0/2851156974 --> v1:172.21.15.187:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4c808a910 con 0x7fc4c806dc90 2023-12-12T10:12:31.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.786+0000 7fc4c6ffd640 1 -- 172.21.15.78:0/2851156974 <== mon.1 v1:172.21.15.187:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 465499599 0 0) 0x7fc4b8001680 con 0x7fc4c806dc90 2023-12-12T10:12:31.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.786+0000 7fc4c6ffd640 1 -- 172.21.15.78:0/2851156974 >> v1:172.21.15.187:6789/0 conn(0x7fc4c806dc90 legacy=0x7fc4c8071310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:31.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.786+0000 7fc4c6ffd640 1 --2- 172.21.15.78:0/2851156974 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc4bc003980 0x7fc4bc003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:31.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.786+0000 7fc4c6ffd640 1 --2- 172.21.15.78:0/2851156974 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc4bc0047d0 0x7fc4bc004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:31.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.786+0000 7fc4c6ffd640 1 --2- 172.21.15.78:0/2851156974 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc4bc009980 0x7fc4bc005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:31.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.786+0000 7fc4c6ffd640 1 -- 172.21.15.78:0/2851156974 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4c8070b60 con 0x7fc4bc0047d0 2023-12-12T10:12:31.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.786+0000 7fc4c6ffd640 1 -- 172.21.15.78:0/2851156974 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4c8169fc0 con 0x7fc4bc009980 2023-12-12T10:12:31.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.786+0000 7fc4c6ffd640 1 -- 172.21.15.78:0/2851156974 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4bc0148a0 con 0x7fc4bc003980 2023-12-12T10:12:31.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.786+0000 7fc9a7f2a640 1 -- 172.21.15.78:0/2744189610 wait complete. 2023-12-12T10:12:31.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.786+0000 7fc9a7f2a640 1 Processor -- start 2023-12-12T10:12:31.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.786+0000 7feb90c17640 1 -- 172.21.15.78:0/3586491428 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb84049480 con 0x7feb840e77f0 2023-12-12T10:12:31.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.786+0000 7fc4ccff7640 1 --2- 172.21.15.78:0/2851156974 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc4bc009980 0x7fc4bc005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:31.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.786+0000 7fc4c7fff640 1 --2- 172.21.15.78:0/2851156974 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc4bc003980 0x7fc4bc003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:31.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.786+0000 7fb8a8d5c640 1 -- 172.21.15.78:0/4187502048 >> v2:172.21.15.187:3300/0 conn(0x7fb8a40b39f0 msgr2=0x7fb8a40b3df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:31.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.786+0000 7fb8a8d5c640 1 --2- 172.21.15.78:0/4187502048 >> v2:172.21.15.187:3300/0 conn(0x7fb8a40b39f0 0x7fb8a40b3df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:31.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.786+0000 7fb8a8d5c640 1 -- 172.21.15.78:0/4187502048 >> v1:172.21.15.187:6789/0 conn(0x7fb8a4141ac0 legacy=0x7fb8a40b1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:31.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.786+0000 7fb8a8d5c640 1 -- 172.21.15.78:0/4187502048 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8a40b2bc0 con 0x7fb8a40cc780 2023-12-12T10:12:31.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.790+0000 7fc9a7f2a640 1 -- start start 2023-12-12T10:12:31.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.790+0000 7fc4ccff7640 1 -- 172.21.15.78:0/2851156974 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc4bc003980 msgr2=0x7fc4bc003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:31.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.790+0000 7fc4ccff7640 1 --2- 172.21.15.78:0/2851156974 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc4bc003980 0x7fc4bc003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:31.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.790+0000 7fc4ccff7640 1 -- 172.21.15.78:0/2851156974 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc4bc0047d0 msgr2=0x7fc4bc004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:31.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.790+0000 7fc4ccff7640 1 --2- 172.21.15.78:0/2851156974 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc4bc0047d0 0x7fc4bc004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:31.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.790+0000 7fc4ccff7640 1 -- 172.21.15.78:0/2851156974 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4c808a910 con 0x7fc4bc009980 2023-12-12T10:12:31.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.790+0000 7fc4c7fff640 1 --2- 172.21.15.78:0/2851156974 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc4bc003980 0x7fc4bc003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-12T10:12:31.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.786+0000 7fec4a59c640 1 -- 172.21.15.78:0/643471261 >> v2:172.21.15.187:3300/0 conn(0x7fec4c0d0410 msgr2=0x7fec4c0d18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:31.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.786+0000 7fec4a59c640 1 --2- 172.21.15.78:0/643471261 >> v2:172.21.15.187:3300/0 conn(0x7fec4c0d0410 0x7fec4c0d18f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:31.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.786+0000 7fec4a59c640 1 -- 172.21.15.78:0/643471261 >> v2:172.21.15.78:3300/0 conn(0x7fec4c15cf40 msgr2=0x7fec4c0ce3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:31.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.786+0000 7fec4a59c640 1 --2- 172.21.15.78:0/643471261 >> v2:172.21.15.78:3300/0 conn(0x7fec4c15cf40 0x7fec4c0ce3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:31.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.786+0000 7fec4a59c640 1 -- 172.21.15.78:0/643471261 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec4c0cf930 con 0x7fec4c0ce930 2023-12-12T10:12:31.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.790+0000 7fec4a59c640 1 --2- 172.21.15.78:0/643471261 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fec4c0ce930 0x7fec4c0d13b0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fec4c06ade0 tx=0x7fec4001c460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=26fee781b626db3b server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:31.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.790+0000 7fec49d9b640 1 -- 172.21.15.78:0/643471261 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec400ab640 con 0x7fec4c0ce930 2023-12-12T10:12:31.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.790+0000 7fec49d9b640 1 -- 172.21.15.78:0/643471261 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec400a7070 con 0x7fec4c0ce930 2023-12-12T10:12:31.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.790+0000 7fec49d9b640 1 -- 172.21.15.78:0/643471261 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec400ab640 con 0x7fec4c0ce930 2023-12-12T10:12:31.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.790+0000 7feb7affd640 1 -- 172.21.15.78:0/3586491428 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7feb7c013470 con 0x7feb840e77f0 2023-12-12T10:12:31.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.790+0000 7feb7affd640 1 --2- 172.21.15.78:0/3586491428 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7feb6c0664c0 0x7feb6c068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:31.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.790+0000 7feb90c17640 1 -- 172.21.15.78:0/3586491428 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb840089b0 con 0x7feb840e77f0 2023-12-12T10:12:31.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.790+0000 7fc9a7f2a640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc9a00ae260 0x7fc9a013ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:31.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.790+0000 7fc9a7f2a640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc9a0146850 0x7fc9a0159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:31.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.790+0000 7fc9a7f2a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc9a015a7d0 0x7fc9a015fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:31.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.790+0000 7fc9a5cc6640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc9a00ae260 0x7fc9a013ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:31.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.790+0000 7fc9a7f2a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a0142a60 con 0x7fc9a015a7d0 2023-12-12T10:12:31.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.790+0000 7fc9a7f2a640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a0142d40 con 0x7fc9a0146850 2023-12-12T10:12:31.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.790+0000 7fc9a7f2a640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a0143020 con 0x7fc9a00ae260 2023-12-12T10:12:31.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.790+0000 7fc9a54c5640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc9a0146850 0x7fc9a0159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:31.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.790+0000 7fc9a54c5640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc9a0146850 0x7fc9a0159fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.78:38684/0 (socket says 172.21.15.78:38684) 2023-12-12T10:12:31.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.790+0000 7fc9a54c5640 1 -- 172.21.15.78:0/346811333 learned_addr learned my addr 172.21.15.78:0/346811333 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:31.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.794+0000 7fc9a54c5640 1 -- 172.21.15.78:0/346811333 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc9a00ae260 msgr2=0x7fc9a013ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:31.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.794+0000 7fc9a54c5640 1 --2- 172.21.15.78:0/346811333 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc9a00ae260 0x7fc9a013ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:31.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.794+0000 7fc9a54c5640 1 -- 172.21.15.78:0/346811333 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc9a015a7d0 msgr2=0x7fc9a015fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:31.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.790+0000 7fec50859640 1 -- 172.21.15.78:0/643471261 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fec4c0ce930 msgr2=0x7fec4c0d13b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:31.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.790+0000 7fec50859640 1 --2- 172.21.15.78:0/643471261 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fec4c0ce930 0x7fec4c0d13b0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fec4c06ade0 tx=0x7fec4001c460 comp rx=0 tx=0).stop 2023-12-12T10:12:31.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.790+0000 7fec50859640 1 -- 172.21.15.78:0/643471261 shutdown_connections 2023-12-12T10:12:31.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.790+0000 7fec50859640 1 --2- 172.21.15.78:0/643471261 >> v2:172.21.15.187:3300/0 conn(0x7fec4c0d0410 0x7fec4c0d18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:31.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.790+0000 7fec50859640 1 --2- 172.21.15.78:0/643471261 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fec4c0ce930 0x7fec4c0d13b0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:31.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.794+0000 7fc9a54c5640 1 --2- 172.21.15.78:0/346811333 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc9a015a7d0 0x7fc9a015fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:31.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.794+0000 7fc9a54c5640 1 -- 172.21.15.78:0/346811333 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc998009b30 con 0x7fc9a0146850 2023-12-12T10:12:31.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.794+0000 7fc9a5cc6640 1 --2- 172.21.15.78:0/346811333 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc9a00ae260 0x7fc9a013ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T10:12:31.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.790+0000 7fec50859640 1 --2- 172.21.15.78:0/643471261 >> v2:172.21.15.78:3300/0 conn(0x7fec4c15cf40 0x7fec4c0ce3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:31.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.790+0000 7fec50859640 1 -- 172.21.15.78:0/643471261 >> 172.21.15.78:0/643471261 conn(0x7fec4c0d2dd0 msgr2=0x7fec4c0d31e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:31.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.790+0000 7fec50859640 1 -- 172.21.15.78:0/643471261 shutdown_connections 2023-12-12T10:12:31.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.790+0000 7fec50859640 1 -- 172.21.15.78:0/643471261 wait complete. 2023-12-12T10:12:31.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.790+0000 7feb8a59c640 1 --2- 172.21.15.78:0/3586491428 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7feb6c0664c0 0x7feb6c068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:31.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.790+0000 7feb7affd640 1 -- 172.21.15.78:0/3586491428 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7feb7c054f70 con 0x7feb840e77f0 2023-12-12T10:12:31.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.794+0000 7fc9a54c5640 1 --2- 172.21.15.78:0/346811333 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc9a0146850 0x7fc9a0159fa0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc99000b3e0 tx=0x7fc99000b8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:31.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.794+0000 7feb8a59c640 1 --2- 172.21.15.78:0/3586491428 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7feb6c0664c0 0x7feb6c068980 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7feb80000f70 tx=0x7feb800079c0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:31.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.794+0000 7fc4ccff7640 1 --2- 172.21.15.78:0/2851156974 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc4bc009980 0x7fc4bc005190 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc4c8070270 tx=0x7fc4b001cbf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8bb4f7c8fd1dd5f3 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:31.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.794+0000 7fc9967fc640 1 -- 172.21.15.78:0/346811333 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc990011830 con 0x7fc9a0146850 2023-12-12T10:12:31.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.794+0000 7fb8a8d5c640 1 --2- 172.21.15.78:0/4187502048 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb8a40cc780 0x7fb8a40ccc10 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb8a406e2c0 tx=0x7fb89401c710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b50397332987c9f server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:31.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.794+0000 7fc4c6ffd640 1 -- 172.21.15.78:0/2851156974 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4b00a5c00 con 0x7fc4bc009980 2023-12-12T10:12:31.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.794+0000 7fc4c6ffd640 1 -- 172.21.15.78:0/2851156974 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4b00a5d80 con 0x7fc4bc009980 2023-12-12T10:12:31.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.794+0000 7fc9a7f2a640 1 -- 172.21.15.78:0/346811333 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9a006e360 con 0x7fc9a0146850 2023-12-12T10:12:31.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.794+0000 7fc9a7f2a640 1 -- 172.21.15.78:0/346811333 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9a013f220 con 0x7fc9a0146850 2023-12-12T10:12:31.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.794+0000 7fc9967fc640 1 -- 172.21.15.78:0/346811333 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9900119b0 con 0x7fc9a0146850 2023-12-12T10:12:31.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.794+0000 7fc9967fc640 1 -- 172.21.15.78:0/346811333 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc990011d60 con 0x7fc9a0146850 2023-12-12T10:12:31.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.794+0000 7fc4c6ffd640 1 -- 172.21.15.78:0/2851156974 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4b00ad680 con 0x7fc4bc009980 2023-12-12T10:12:31.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.794+0000 7fc4cea5a640 1 -- 172.21.15.78:0/2851156974 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc4bc009980 msgr2=0x7fc4bc005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:31.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.794+0000 7fc4cea5a640 1 --2- 172.21.15.78:0/2851156974 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc4bc009980 0x7fc4bc005190 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc4c8070270 tx=0x7fc4b001cbf0 comp rx=0 tx=0).stop 2023-12-12T10:12:31.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.794+0000 7fb89bfff640 1 -- 172.21.15.78:0/4187502048 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8940a5790 con 0x7fb8a40cc780 2023-12-12T10:12:31.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.794+0000 7fc4ccff7640 1 -- 172.21.15.78:0/2851156974 reap_dead start 2023-12-12T10:12:31.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.794+0000 7fec50859640 1 Processor -- start 2023-12-12T10:12:31.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.794+0000 7fb89bfff640 1 -- 172.21.15.78:0/4187502048 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8940a58f0 con 0x7fb8a40cc780 2023-12-12T10:12:31.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.794+0000 7fc4cea5a640 1 -- 172.21.15.78:0/2851156974 shutdown_connections 2023-12-12T10:12:31.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.794+0000 7fc4cea5a640 1 -- 172.21.15.78:0/2851156974 >> 172.21.15.78:0/2851156974 conn(0x7fc4c80b0b20 msgr2=0x7fc4c80b0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:31.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.794+0000 7fec50859640 1 -- start start 2023-12-12T10:12:31.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.794+0000 7f212b31d640 1 Processor -- start 2023-12-12T10:12:31.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.794+0000 7fb89bfff640 1 -- 172.21.15.78:0/4187502048 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8940a5c80 con 0x7fb8a40cc780 2023-12-12T10:12:31.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.794+0000 7fc4cea5a640 1 -- 172.21.15.78:0/2851156974 shutdown_connections 2023-12-12T10:12:31.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.794+0000 7fc9a7f2a640 1 -- 172.21.15.78:0/346811333 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc988005260 con 0x7fc9a0146850 2023-12-12T10:12:31.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.794+0000 7fc4cea5a640 1 -- 172.21.15.78:0/2851156974 wait complete. 2023-12-12T10:12:31.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.798+0000 7fb8ab7c1640 1 -- 172.21.15.78:0/4187502048 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb8a40cc780 msgr2=0x7fb8a40ccc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:31.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.798+0000 7fb8ab7c1640 1 --2- 172.21.15.78:0/4187502048 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb8a40cc780 0x7fb8a40ccc10 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb8a406e2c0 tx=0x7fb89401c710 comp rx=0 tx=0).stop 2023-12-12T10:12:31.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.794+0000 7fcfbba32640 1 Processor -- start 2023-12-12T10:12:31.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.794+0000 7fcfbba32640 1 -- start start 2023-12-12T10:12:31.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.798+0000 7fec50859640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fec4c0ce930 0x7fec4c153f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:31.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.798+0000 7fec50859640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec4c0d0410 0x7fec4c0b79c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:31.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.798+0000 7fb8ab7c1640 1 -- 172.21.15.78:0/4187502048 shutdown_connections 2023-12-12T10:12:31.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.798+0000 7fb8ab7c1640 1 --2- 172.21.15.78:0/4187502048 >> v2:172.21.15.187:3300/0 conn(0x7fb8a40b39f0 0x7fb8a40b3df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:31.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.798+0000 7fb8ab7c1640 1 --2- 172.21.15.78:0/4187502048 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb8a40cc780 0x7fb8a40ccc10 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:31.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.798+0000 7fb8ab7c1640 1 -- 172.21.15.78:0/4187502048 >> 172.21.15.78:0/4187502048 conn(0x7fb8a406a710 msgr2=0x7fb8a406ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:31.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.798+0000 7fec50859640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fec4c15cf40 0x7fec4c15f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:31.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.798+0000 7fec50859640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec4c155090 con 0x7fec4c0d0410 2023-12-12T10:12:31.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.798+0000 7fec50859640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec4c155370 con 0x7fec4c15cf40 2023-12-12T10:12:31.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.798+0000 7fec50859640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec4c155650 con 0x7fec4c0ce930 2023-12-12T10:12:31.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.798+0000 7fec4ad9d640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fec4c0ce930 0x7fec4c153f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:31.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.798+0000 7fec4ad9d640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fec4c0ce930 0x7fec4c153f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.78:47766/0 (socket says 172.21.15.78:47766) 2023-12-12T10:12:31.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.798+0000 7fec4ad9d640 1 -- 172.21.15.78:0/3059535423 learned_addr learned my addr 172.21.15.78:0/3059535423 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:31.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.798+0000 7fcfbba32640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcfb40b21e0 0x7fcfb40d0f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:31.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.798+0000 7feb7affd640 1 -- 172.21.15.78:0/3586491428 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7feb7c051340 con 0x7feb840e77f0 2023-12-12T10:12:31.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.798+0000 7fcfbba32640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fcfb40d3bb0 0x7fcfb40d1440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:31.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.798+0000 7fcfbba32640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fcfb40d1980 0x7fcfb40cf8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:31.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.798+0000 7fcfbba32640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfb40cf230 con 0x7fcfb40d3bb0 2023-12-12T10:12:31.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.798+0000 7fcfbba32640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfb40ce6b0 con 0x7fcfb40d1980 2023-12-12T10:12:31.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.798+0000 7fcfbba32640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb40ce900 con 0x7fcfb40b21e0 2023-12-12T10:12:31.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.794+0000 7f212b31d640 1 -- start start 2023-12-12T10:12:31.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.798+0000 7f212b31d640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f211c0e32e0 0x7f211c03e850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:31.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.798+0000 7f212b31d640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f211c053c20 0x7f211c054080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:31.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.798+0000 7f212b31d640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f211c0e6c40 0x7f211c0e70d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:31.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.798+0000 7f212b31d640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f211c058690 con 0x7f211c0e6c40 2023-12-12T10:12:31.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.798+0000 7f212b31d640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f211c03bfd0 con 0x7f211c0e32e0 2023-12-12T10:12:31.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.798+0000 7f212b31d640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f211c0545c0 con 0x7f211c053c20 2023-12-12T10:12:31.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.798+0000 7fec4ad9d640 1 -- 172.21.15.78:0/3059535423 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fec4c15cf40 msgr2=0x7fec4c15f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:31.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.798+0000 7fec4ad9d640 1 --2- 172.21.15.78:0/3059535423 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fec4c15cf40 0x7fec4c15f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:31.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.798+0000 7fec4ad9d640 1 -- 172.21.15.78:0/3059535423 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec4c0d0410 msgr2=0x7fec4c0b79c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:31.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.798+0000 7fec4ad9d640 1 --2- 172.21.15.78:0/3059535423 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec4c0d0410 0x7fec4c0b79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:31.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.798+0000 7fec4ad9d640 1 -- 172.21.15.78:0/3059535423 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec400094d0 con 0x7fec4c0ce930 2023-12-12T10:12:31.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.798+0000 7f21288b8640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f211c053c20 0x7f211c054080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:31.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.798+0000 7f21288b8640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f211c053c20 0x7f211c054080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.78:47786/0 (socket says 172.21.15.78:47786) 2023-12-12T10:12:31.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.798+0000 7f21288b8640 1 -- 172.21.15.78:0/3174673354 learned_addr learned my addr 172.21.15.78:0/3174673354 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:31.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.798+0000 7fcfb97ce640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcfb40b21e0 0x7fcfb40d0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:31.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.798+0000 7fec4ad9d640 1 --2- 172.21.15.78:0/3059535423 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fec4c0ce930 0x7fec4c153f20 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fec4400ba50 tx=0x7fec4400bf10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:31.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.798+0000 7fc4cea5a640 1 Processor -- start 2023-12-12T10:12:31.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.798+0000 7fcfb97ce640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcfb40b21e0 0x7fcfb40d0f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.78:47770/0 (socket says 172.21.15.78:47770) 2023-12-12T10:12:31.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.798+0000 7fcfb97ce640 1 -- 172.21.15.78:0/1004764102 learned_addr learned my addr 172.21.15.78:0/1004764102 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:31.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.798+0000 7fcfb8fcd640 1 --2- 172.21.15.78:0/1004764102 >> v2:172.21.15.78:3300/0 conn(0x7fcfb40d3bb0 0x7fcfb40d1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:31.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.798+0000 7fec337fe640 1 -- 172.21.15.78:0/3059535423 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec4400cbe0 con 0x7fec4c0ce930 2023-12-12T10:12:31.831 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.798+0000 7f21288b8640 1 -- 172.21.15.78:0/3174673354 >> v2:172.21.15.187:3300/0 conn(0x7f211c0e32e0 msgr2=0x7f211c03e850 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-12-12T10:12:31.831 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.798+0000 7f21288b8640 1 --2- 172.21.15.78:0/3174673354 >> v2:172.21.15.187:3300/0 conn(0x7f211c0e32e0 0x7f211c03e850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:31.831 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.798+0000 7f21288b8640 1 -- 172.21.15.78:0/3174673354 >> v2:172.21.15.78:3300/0 conn(0x7f211c0e6c40 msgr2=0x7f211c0e70d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:31.831 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.798+0000 7f21288b8640 1 --2- 172.21.15.78:0/3174673354 >> v2:172.21.15.78:3300/0 conn(0x7f211c0e6c40 0x7f211c0e70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:31.831 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.798+0000 7f21288b8640 1 -- 172.21.15.78:0/3174673354 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f211c057df0 con 0x7f211c053c20 2023-12-12T10:12:31.831 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.798+0000 7fec337fe640 1 -- 172.21.15.78:0/3059535423 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec4400cd60 con 0x7fec4c0ce930 2023-12-12T10:12:31.831 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.798+0000 7fec337fe640 1 -- 172.21.15.78:0/3059535423 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec44014680 con 0x7fec4c0ce930 2023-12-12T10:12:31.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.798+0000 7fc4cea5a640 1 -- start start 2023-12-12T10:12:31.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.798+0000 7fcfb9fcf640 1 --2- 172.21.15.78:0/1004764102 >> v2:172.21.15.187:3300/0 conn(0x7fcfb40d1980 0x7fcfb40cf8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:31.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.798+0000 7fec50859640 1 -- 172.21.15.78:0/3059535423 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec4c155930 con 0x7fec4c0ce930 2023-12-12T10:12:31.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.798+0000 7fec50859640 1 -- 172.21.15.78:0/3059535423 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec4c154460 con 0x7fec4c0ce930 2023-12-12T10:12:31.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.798+0000 7fc9967fc640 1 -- 172.21.15.78:0/346811333 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc99001a400 con 0x7fc9a0146850 2023-12-12T10:12:31.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.798+0000 7fcfb97ce640 1 -- 172.21.15.78:0/1004764102 >> v2:172.21.15.187:3300/0 conn(0x7fcfb40d1980 msgr2=0x7fcfb40cf8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:31.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.798+0000 7fcfb97ce640 1 --2- 172.21.15.78:0/1004764102 >> v2:172.21.15.187:3300/0 conn(0x7fcfb40d1980 0x7fcfb40cf8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:31.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.798+0000 7fcfb97ce640 1 -- 172.21.15.78:0/1004764102 >> v2:172.21.15.78:3300/0 conn(0x7fcfb40d3bb0 msgr2=0x7fcfb40d1440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:31.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.798+0000 7fcfb97ce640 1 --2- 172.21.15.78:0/1004764102 >> v2:172.21.15.78:3300/0 conn(0x7fcfb40d3bb0 0x7fcfb40d1440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:31.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.802+0000 7fc4cea5a640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc4c80ca730 0x7fc4c81f3b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:31.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.798+0000 7fcfb97ce640 1 -- 172.21.15.78:0/1004764102 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfb40cebe0 con 0x7fcfb40b21e0 2023-12-12T10:12:31.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.802+0000 7fc4cea5a640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc4c8166260 0x7fc4c80c5c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:31.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.802+0000 7fc4cea5a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc4c80c6150 0x7fc4c8162da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:31.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.802+0000 7fc4cea5a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4c80c6600 con 0x7fc4c80c6150 2023-12-12T10:12:31.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.802+0000 7fc4cea5a640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4c8163d90 con 0x7fc4c80ca730 2023-12-12T10:12:31.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.802+0000 7fc4cea5a640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4c81f4140 con 0x7fc4c8166260 2023-12-12T10:12:31.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.802+0000 7fc4ccff7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc4c80c6150 0x7fc4c8162da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:31.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.802+0000 7fc4ccff7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc4c80c6150 0x7fc4c8162da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37206/0 (socket says 172.21.15.78:37206) 2023-12-12T10:12:31.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.802+0000 7fc4ccff7640 1 -- 172.21.15.78:0/2726910306 learned_addr learned my addr 172.21.15.78:0/2726910306 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:31.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.802+0000 7fc4ccff7640 1 -- 172.21.15.78:0/2726910306 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc4c8166260 msgr2=0x7fc4c80c5c10 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-12-12T10:12:31.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.802+0000 7fc4ccff7640 1 --2- 172.21.15.78:0/2726910306 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc4c8166260 0x7fc4c80c5c10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:31.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.802+0000 7fc4ccff7640 1 -- 172.21.15.78:0/2726910306 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc4c80ca730 msgr2=0x7fc4c81f3b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:31.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.802+0000 7fc4c7fff640 1 --2- 172.21.15.78:0/2726910306 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc4c80ca730 0x7fc4c81f3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:31.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.802+0000 7fec50859640 1 -- 172.21.15.78:0/3059535423 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec4c155e50 con 0x7fec4c0ce930 2023-12-12T10:12:31.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.802+0000 7fc4ccff7640 1 --2- 172.21.15.78:0/2726910306 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc4c80ca730 0x7fc4c81f3b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:31.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.802+0000 7fc4ccff7640 1 -- 172.21.15.78:0/2726910306 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4c81f4420 con 0x7fc4c80c6150 2023-12-12T10:12:31.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.802+0000 7fc9967fc640 1 --2- 172.21.15.78:0/346811333 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fc9840664a0 0x7fc984068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:31.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.802+0000 7fc9967fc640 1 -- 172.21.15.78:0/346811333 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc990084320 con 0x7fc9a0146850 2023-12-12T10:12:31.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.802+0000 7fc4c7fff640 1 --2- 172.21.15.78:0/2726910306 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc4c80ca730 0x7fc4c81f3b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T10:12:31.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.802+0000 7fc4ccff7640 1 --2- 172.21.15.78:0/2726910306 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc4c80c6150 0x7fc4c8162da0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fc4b0098720 tx=0x7fc4bc005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:31.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.802+0000 7fec337fe640 1 -- 172.21.15.78:0/3059535423 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fec440147e0 con 0x7fec4c0ce930 2023-12-12T10:12:31.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.802+0000 7fc9a5cc6640 1 --2- 172.21.15.78:0/346811333 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fc9840664a0 0x7fc984068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:31.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.802+0000 7fc4c4ff9640 1 -- 172.21.15.78:0/2726910306 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4b00a5c10 con 0x7fc4c80c6150 2023-12-12T10:12:31.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.802+0000 7fc4c4ff9640 1 -- 172.21.15.78:0/2726910306 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4b00ad900 con 0x7fc4c80c6150 2023-12-12T10:12:31.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.802+0000 7fc4c4ff9640 1 -- 172.21.15.78:0/2726910306 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4b00adcb0 con 0x7fc4c80c6150 2023-12-12T10:12:31.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.802+0000 7fc4cea5a640 1 -- 172.21.15.78:0/2726910306 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4c81f4700 con 0x7fc4c80c6150 2023-12-12T10:12:31.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.802+0000 7fc4cea5a640 1 -- 172.21.15.78:0/2726910306 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4c80c4fc0 con 0x7fc4c80c6150 2023-12-12T10:12:31.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.806+0000 7fc9a5cc6640 1 --2- 172.21.15.78:0/346811333 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fc9840664a0 0x7fc984068960 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc9980ae000 tx=0x7fc9980a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:31.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.806+0000 7fec337fe640 1 --2- 172.21.15.78:0/3059535423 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fec380664a0 0x7fec38068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:31.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.806+0000 7fec337fe640 1 -- 172.21.15.78:0/3059535423 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fec440840b0 con 0x7fec4c0ce930 2023-12-12T10:12:31.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.806+0000 7fc4cea5a640 1 -- 172.21.15.78:0/2726910306 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4c80671f0 con 0x7fc4c80c6150 2023-12-12T10:12:31.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.806+0000 7fec4a59c640 1 --2- 172.21.15.78:0/3059535423 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fec380664a0 0x7fec38068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:31.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.806+0000 7f21288b8640 1 --2- 172.21.15.78:0/3174673354 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f211c053c20 0x7f211c054080 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f211c056900 tx=0x7f212001c4f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db1e9ed30223533e server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:31.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.806+0000 7fcfb97ce640 1 --2- 172.21.15.78:0/1004764102 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcfb40b21e0 0x7fcfb40d0f00 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fcfb40d4160 tx=0x7fcfa801c440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=20f3c3ef43ba952f server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:31.841 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.806+0000 7fb8ab7c1640 1 -- 172.21.15.78:0/4187502048 shutdown_connections 2023-12-12T10:12:31.841 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.806+0000 7fb8ab7c1640 1 -- 172.21.15.78:0/4187502048 wait complete. 2023-12-12T10:12:31.841 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.806+0000 7fb8ab7c1640 1 Processor -- start 2023-12-12T10:12:31.841 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.806+0000 7fec4a59c640 1 --2- 172.21.15.78:0/3059535423 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fec380664a0 0x7fec38068960 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fec400af000 tx=0x7fec40008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:31.841 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.806+0000 7fc4c4ff9640 1 -- 172.21.15.78:0/2726910306 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc4b00b8420 con 0x7fc4c80c6150 2023-12-12T10:12:31.842 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.806+0000 7fb8ab7c1640 1 -- start start 2023-12-12T10:12:31.842 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.806+0000 7fc9967fc640 1 -- 172.21.15.78:0/346811333 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc990051410 con 0x7fc9a0146850 2023-12-12T10:12:31.842 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.810+0000 7fc4c4ff9640 1 --2- 172.21.15.78:0/2726910306 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fc4a8066470 0x7fc4a8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:31.843 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.810+0000 7fc4c4ff9640 1 -- 172.21.15.78:0/2726910306 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc4b011ebc0 con 0x7fc4c80c6150 2023-12-12T10:12:31.843 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.810+0000 7fc4c7fff640 1 --2- 172.21.15.78:0/2726910306 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fc4a8066470 0x7fc4a8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:31.843 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.810+0000 7fb8ab7c1640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb8a40b39f0 0x7fb8a4158850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:31.843 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.810+0000 7fb8ab7c1640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb8a40cc780 0x7fb8a40c9d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:31.843 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.810+0000 7fb8ab7c1640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb8a4141ac0 0x7fb8a40c83e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:31.843 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.810+0000 7fb8ab7c1640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a40c8ce0 con 0x7fb8a4141ac0 2023-12-12T10:12:31.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.810+0000 7fb8ab7c1640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a40c8fc0 con 0x7fb8a40cc780 2023-12-12T10:12:31.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.810+0000 7fb8ab7c1640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8a40c92a0 con 0x7fb8a40b39f0 2023-12-12T10:12:31.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.810+0000 7fb8a9d5e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb8a4141ac0 0x7fb8a40c83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:31.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.810+0000 7fb8a9d5e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb8a4141ac0 0x7fb8a40c83e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37216/0 (socket says 172.21.15.78:37216) 2023-12-12T10:12:31.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.810+0000 7fb8a9d5e640 1 -- 172.21.15.78:0/670056792 learned_addr learned my addr 172.21.15.78:0/670056792 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:31.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.810+0000 7f211bfff640 1 -- 172.21.15.78:0/3174673354 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21200aa610 con 0x7f211c053c20 2023-12-12T10:12:31.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.810+0000 7f211bfff640 1 -- 172.21.15.78:0/3174673354 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21200a6040 con 0x7f211c053c20 2023-12-12T10:12:31.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.810+0000 7f211bfff640 1 -- 172.21.15.78:0/3174673354 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21200aa990 con 0x7f211c053c20 2023-12-12T10:12:31.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.810+0000 7fcfa7fff640 1 -- 172.21.15.78:0/1004764102 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa80ac640 con 0x7fcfb40b21e0 2023-12-12T10:12:31.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.810+0000 7fcfa7fff640 1 -- 172.21.15.78:0/1004764102 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfa80ac7a0 con 0x7fcfb40b21e0 2023-12-12T10:12:31.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.810+0000 7fc4c7fff640 1 --2- 172.21.15.78:0/2726910306 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fc4a8066470 0x7fc4a8068930 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc4c80b44c0 tx=0x7fc4c0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:31.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.810+0000 7fcfa7fff640 1 -- 172.21.15.78:0/1004764102 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa80acb30 con 0x7fcfb40b21e0 2023-12-12T10:12:31.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.810+0000 7fb8a8d5c640 1 --2- 172.21.15.78:0/670056792 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb8a40cc780 0x7fb8a40c9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:31.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.810+0000 7fb8a9d5e640 1 -- 172.21.15.78:0/670056792 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb8a40b39f0 msgr2=0x7fb8a4158850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:31.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.810+0000 7fb8a9d5e640 1 --2- 172.21.15.78:0/670056792 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb8a40b39f0 0x7fb8a4158850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:31.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.810+0000 7fb8a9d5e640 1 -- 172.21.15.78:0/670056792 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb8a40cc780 msgr2=0x7fb8a40c9d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:31.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.810+0000 7fb8a9d5e640 1 --2- 172.21.15.78:0/670056792 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb8a40cc780 0x7fb8a40c9d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:31.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.810+0000 7fb8a9d5e640 1 -- 172.21.15.78:0/670056792 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb89400a4d0 con 0x7fb8a4141ac0 2023-12-12T10:12:31.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.810+0000 7f212b31d640 1 -- 172.21.15.78:0/3174673354 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f211c053c20 msgr2=0x7f211c054080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:31.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.810+0000 7f212b31d640 1 --2- 172.21.15.78:0/3174673354 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f211c053c20 0x7f211c054080 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f211c056900 tx=0x7f212001c4f0 comp rx=0 tx=0).stop 2023-12-12T10:12:31.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.810+0000 7f212b31d640 1 -- 172.21.15.78:0/3174673354 shutdown_connections 2023-12-12T10:12:31.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.810+0000 7f212b31d640 1 --2- 172.21.15.78:0/3174673354 >> v2:172.21.15.78:3300/0 conn(0x7f211c0e6c40 0x7f211c0e70d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:31.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.810+0000 7f212b31d640 1 --2- 172.21.15.78:0/3174673354 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f211c053c20 0x7f211c054080 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:31.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.810+0000 7f212b31d640 1 --2- 172.21.15.78:0/3174673354 >> v2:172.21.15.187:3300/0 conn(0x7f211c0e32e0 0x7f211c03e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:31.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.810+0000 7f212b31d640 1 -- 172.21.15.78:0/3174673354 >> 172.21.15.78:0/3174673354 conn(0x7f211c0559f0 msgr2=0x7f211c055e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:31.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.810+0000 7fcfbba32640 1 -- 172.21.15.78:0/1004764102 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcfb40b21e0 msgr2=0x7fcfb40d0f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:31.848 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.810+0000 7fcfbba32640 1 --2- 172.21.15.78:0/1004764102 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcfb40b21e0 0x7fcfb40d0f00 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fcfb40d4160 tx=0x7fcfa801c440 comp rx=0 tx=0).stop 2023-12-12T10:12:31.848 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.810+0000 7fb8a9d5e640 1 --2- 172.21.15.78:0/670056792 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb8a4141ac0 0x7fb8a40c83e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb89c00e7f0 tx=0x7fb89c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:31.848 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.810+0000 7f212b31d640 1 -- 172.21.15.78:0/3174673354 shutdown_connections 2023-12-12T10:12:31.848 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.810+0000 7f212b31d640 1 -- 172.21.15.78:0/3174673354 wait complete. 2023-12-12T10:12:31.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.810+0000 7fcfbba32640 1 -- 172.21.15.78:0/1004764102 shutdown_connections 2023-12-12T10:12:31.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.810+0000 7fcfbba32640 1 --2- 172.21.15.78:0/1004764102 >> v2:172.21.15.187:3300/0 conn(0x7fcfb40d1980 0x7fcfb40cf8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:31.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.810+0000 7fcfbba32640 1 --2- 172.21.15.78:0/1004764102 >> v2:172.21.15.78:3300/0 conn(0x7fcfb40d3bb0 0x7fcfb40d1440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:31.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.810+0000 7fcfbba32640 1 --2- 172.21.15.78:0/1004764102 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcfb40b21e0 0x7fcfb40d0f00 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:31.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.810+0000 7fcfbba32640 1 -- 172.21.15.78:0/1004764102 >> 172.21.15.78:0/1004764102 conn(0x7fcfb40d3090 msgr2=0x7fcfb40d34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:31.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.810+0000 7fec337fe640 1 -- 172.21.15.78:0/3059535423 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fec44051230 con 0x7fec4c0ce930 2023-12-12T10:12:31.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.810+0000 7fcfbba32640 1 -- 172.21.15.78:0/1004764102 shutdown_connections 2023-12-12T10:12:31.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.810+0000 7fcfbba32640 1 -- 172.21.15.78:0/1004764102 wait complete. 2023-12-12T10:12:31.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.814+0000 7f212b31d640 1 Processor -- start 2023-12-12T10:12:31.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.814+0000 7fcfbba32640 1 Processor -- start 2023-12-12T10:12:31.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.814+0000 7f212b31d640 1 -- start start 2023-12-12T10:12:31.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.814+0000 7fcfbba32640 1 -- start start 2023-12-12T10:12:31.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.814+0000 7fcfbba32640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcfb40b21e0 0x7fcfb4158790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:31.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.814+0000 7fcfbba32640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcfb40d1980 0x7fcfb40cace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:31.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.814+0000 7fcfbba32640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcfb40d3bb0 0x7fcfb406c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:31.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.814+0000 7fcfbba32640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb40ca850 con 0x7fcfb40d1980 2023-12-12T10:12:31.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.814+0000 7fcfbba32640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb40c78b0 con 0x7fcfb40d3bb0 2023-12-12T10:12:31.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.814+0000 7fcfbba32640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb40ca200 con 0x7fcfb40b21e0 2023-12-12T10:12:31.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.814+0000 7f212b31d640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f211c053c20 0x7f211c0d6680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:31.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.814+0000 7f212b31d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f211c0e6c40 0x7f211c00d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:31.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.814+0000 7f212b31d640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f211c00d680 0x7f211c184130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:31.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.814+0000 7f212b31d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f211c0d6bc0 con 0x7f211c0e6c40 2023-12-12T10:12:31.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.814+0000 7f212b31d640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f211c051200 con 0x7f211c00d680 2023-12-12T10:12:31.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.814+0000 7f212b31d640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f211c00db00 con 0x7f211c053c20 2023-12-12T10:12:31.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.814+0000 7fcfb8fcd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcfb40d1980 0x7fcfb40cace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:31.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.814+0000 7fcfb97ce640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcfb40b21e0 0x7fcfb4158790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:31.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.814+0000 7fb899ffb640 1 -- 172.21.15.78:0/670056792 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb89c00eea0 con 0x7fb8a4141ac0 2023-12-12T10:12:31.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.818+0000 7fb899ffb640 1 -- 172.21.15.78:0/670056792 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb89c00c940 con 0x7fb8a4141ac0 2023-12-12T10:12:31.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.818+0000 7f21290b9640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f211c053c20 0x7f211c0d6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:31.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.814+0000 7fcfb9fcf640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcfb40d3bb0 0x7fcfb406c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:31.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.814+0000 7fcfb9fcf640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcfb40d3bb0 0x7fcfb406c0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.78:38762/0 (socket says 172.21.15.78:38762) 2023-12-12T10:12:31.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.818+0000 7fcfb9fcf640 1 -- 172.21.15.78:0/2574497984 learned_addr learned my addr 172.21.15.78:0/2574497984 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:31.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.818+0000 7fb899ffb640 1 -- 172.21.15.78:0/670056792 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb89c00ccd0 con 0x7fb8a4141ac0 2023-12-12T10:12:31.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.818+0000 7fb8ab7c1640 1 -- 172.21.15.78:0/670056792 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8a40b26b0 con 0x7fb8a4141ac0 2023-12-12T10:12:31.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.818+0000 7f21290b9640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f211c053c20 0x7f211c0d6680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.78:47820/0 (socket says 172.21.15.78:47820) 2023-12-12T10:12:31.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.818+0000 7f21290b9640 1 -- 172.21.15.78:0/2580197822 learned_addr learned my addr 172.21.15.78:0/2580197822 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:31.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.818+0000 7f21298ba640 1 --2- 172.21.15.78:0/2580197822 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f211c00d680 0x7f211c184130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:31.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.814+0000 7fcfb8fcd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcfb40d1980 0x7fcfb40cace0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37226/0 (socket says 172.21.15.78:37226) 2023-12-12T10:12:31.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.814+0000 7fcfb97ce640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcfb40b21e0 0x7fcfb4158790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.78:47814/0 (socket says 172.21.15.78:47814) 2023-12-12T10:12:31.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.818+0000 7fcfb9fcf640 1 -- 172.21.15.78:0/2574497984 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcfb40b21e0 msgr2=0x7fcfb4158790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:31.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.818+0000 7fcfb9fcf640 1 --2- 172.21.15.78:0/2574497984 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcfb40b21e0 0x7fcfb4158790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:31.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.818+0000 7f21288b8640 1 --2- 172.21.15.78:0/2580197822 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f211c0e6c40 0x7f211c00d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:31.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.818+0000 7f21290b9640 1 -- 172.21.15.78:0/2580197822 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f211c00d680 msgr2=0x7f211c184130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:31.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.818+0000 7fcfb9fcf640 1 -- 172.21.15.78:0/2574497984 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcfb40d1980 msgr2=0x7fcfb40cace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:31.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.818+0000 7fcfb9fcf640 1 --2- 172.21.15.78:0/2574497984 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcfb40d1980 0x7fcfb40cace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:31.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.818+0000 7fcfb9fcf640 1 -- 172.21.15.78:0/2574497984 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfa80094d0 con 0x7fcfb40d3bb0 2023-12-12T10:12:31.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.818+0000 7fcfb97ce640 1 --2- 172.21.15.78:0/2574497984 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcfb40b21e0 0x7fcfb4158790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T10:12:31.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.818+0000 7fcfb8fcd640 1 --2- 172.21.15.78:0/2574497984 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcfb40d1980 0x7fcfb40cace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-12T10:12:31.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.818+0000 7fb8ab7c1640 1 -- 172.21.15.78:0/670056792 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8a40c9860 con 0x7fb8a4141ac0 2023-12-12T10:12:31.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.818+0000 7f21290b9640 1 --2- 172.21.15.78:0/2580197822 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f211c00d680 0x7f211c184130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:31.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.818+0000 7f21290b9640 1 -- 172.21.15.78:0/2580197822 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f211c0e6c40 msgr2=0x7f211c00d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:31.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.818+0000 7f21290b9640 1 --2- 172.21.15.78:0/2580197822 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f211c0e6c40 0x7f211c00d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:31.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.818+0000 7f21290b9640 1 -- 172.21.15.78:0/2580197822 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21200094d0 con 0x7f211c053c20 2023-12-12T10:12:31.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.818+0000 7fcfb9fcf640 1 --2- 172.21.15.78:0/2574497984 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcfb40d3bb0 0x7fcfb406c0d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fcfac007e60 tx=0x7fcfac00e4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:31.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.818+0000 7f21288b8640 1 --2- 172.21.15.78:0/2580197822 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f211c0e6c40 0x7f211c00d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T10:12:31.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.818+0000 7f21298ba640 1 --2- 172.21.15.78:0/2580197822 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f211c00d680 0x7f211c184130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T10:12:31.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.818+0000 7fc4c4ff9640 1 -- 172.21.15.78:0/2726910306 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc4b00ebe70 con 0x7fc4c80c6150 2023-12-12T10:12:31.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.818+0000 7f21290b9640 1 --2- 172.21.15.78:0/2580197822 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f211c053c20 0x7f211c0d6680 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2124079920 tx=0x7f2124074850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:31.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.818+0000 7fcfa5ffb640 1 -- 172.21.15.78:0/2574497984 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfac014620 con 0x7fcfb40d3bb0 2023-12-12T10:12:31.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.818+0000 7fcfa5ffb640 1 -- 172.21.15.78:0/2574497984 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfac00ee90 con 0x7fcfb40d3bb0 2023-12-12T10:12:31.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.818+0000 7fcfa5ffb640 1 -- 172.21.15.78:0/2574497984 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfac0149e0 con 0x7fcfb40d3bb0 2023-12-12T10:12:31.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.818+0000 7f2119ffb640 1 -- 172.21.15.78:0/2580197822 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2124073ee0 con 0x7f211c053c20 2023-12-12T10:12:31.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.818+0000 7fcfbba32640 1 -- 172.21.15.78:0/2574497984 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfb40ca4e0 con 0x7fcfb40d3bb0 2023-12-12T10:12:31.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.818+0000 7f2119ffb640 1 -- 172.21.15.78:0/2580197822 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f212406b6c0 con 0x7f211c053c20 2023-12-12T10:12:31.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.818+0000 7f2119ffb640 1 -- 172.21.15.78:0/2580197822 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2124073ee0 con 0x7f211c053c20 2023-12-12T10:12:31.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.818+0000 7f212b31d640 1 -- 172.21.15.78:0/2580197822 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f211c00dde0 con 0x7f211c053c20 2023-12-12T10:12:31.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.818+0000 7fcfbba32640 1 -- 172.21.15.78:0/2574497984 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfb4158cd0 con 0x7fcfb40d3bb0 2023-12-12T10:12:31.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.822+0000 7f212b31d640 1 -- 172.21.15.78:0/2580197822 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f211c0516f0 con 0x7f211c053c20 2023-12-12T10:12:31.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.822+0000 7fcfbba32640 1 -- 172.21.15.78:0/2574497984 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfb40b2d40 con 0x7fcfb40d3bb0 2023-12-12T10:12:31.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.818+0000 7fb8ab7c1640 1 -- 172.21.15.78:0/670056792 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8a40671f0 con 0x7fb8a4141ac0 2023-12-12T10:12:31.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.822+0000 7f212b31d640 1 -- 172.21.15.78:0/2580197822 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f211c00df70 con 0x7f211c053c20 2023-12-12T10:12:31.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.822+0000 7fb899ffb640 1 -- 172.21.15.78:0/670056792 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb89c013470 con 0x7fb8a4141ac0 2023-12-12T10:12:31.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.822+0000 7fb899ffb640 1 --2- 172.21.15.78:0/670056792 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fb8880664c0 0x7fb888068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:31.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.822+0000 7fb899ffb640 1 -- 172.21.15.78:0/670056792 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb89c0840e0 con 0x7fb8a4141ac0 2023-12-12T10:12:31.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.822+0000 7fb8a955d640 1 --2- 172.21.15.78:0/670056792 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fb8880664c0 0x7fb888068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:31.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.826+0000 7fb8a955d640 1 --2- 172.21.15.78:0/670056792 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fb8880664c0 0x7fb888068980 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb8a00064a0 tx=0x7fb8a0005d90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:31.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.822+0000 7fcfa5ffb640 1 -- 172.21.15.78:0/2574497984 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fcfac014b40 con 0x7fcfb40d3bb0 2023-12-12T10:12:31.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.826+0000 7fcfa5ffb640 1 --2- 172.21.15.78:0/2574497984 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fcf98066540 0x7fcf98068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:31.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.826+0000 7fcfa5ffb640 1 -- 172.21.15.78:0/2574497984 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fcfac084510 con 0x7fcfb40d3bb0 2023-12-12T10:12:31.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.826+0000 7f2119ffb640 1 -- 172.21.15.78:0/2580197822 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2124090020 con 0x7f211c053c20 2023-12-12T10:12:31.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.826+0000 7fcfb97ce640 1 --2- 172.21.15.78:0/2574497984 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fcf98066540 0x7fcf98068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:31.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.826+0000 7f2119ffb640 1 --2- 172.21.15.78:0/2580197822 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f21080664d0 0x7f2108068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:31.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.826+0000 7f2119ffb640 1 -- 172.21.15.78:0/2580197822 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f21240fd3c0 con 0x7f211c053c20 2023-12-12T10:12:31.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.830+0000 7fcfb97ce640 1 --2- 172.21.15.78:0/2574497984 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fcf98066540 0x7fcf98068a00 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fcfa80ae000 tx=0x7fcfa80a6070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:31.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.830+0000 7f21288b8640 1 --2- 172.21.15.78:0/2580197822 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f21080664d0 0x7f2108068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:31.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.830+0000 7fcfa5ffb640 1 -- 172.21.15.78:0/2574497984 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fcfb40b2d40 con 0x7fcfb40d3bb0 2023-12-12T10:12:31.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.830+0000 7f21288b8640 1 --2- 172.21.15.78:0/2580197822 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f21080664d0 0x7f2108068990 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f21200ae000 tx=0x7f2120008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:31.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.834+0000 7fb899ffb640 1 -- 172.21.15.78:0/670056792 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb89c054e70 con 0x7fb8a4141ac0 2023-12-12T10:12:31.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:31.834+0000 7f2119ffb640 1 -- 172.21.15.78:0/2580197822 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f21240ca540 con 0x7f211c053c20 2023-12-12T10:12:32.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.054+0000 7f77b01c4640 1 -- 172.21.15.78:0/2101340714 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f7790005510 con 0x7f77a8159f30 2023-12-12T10:12:32.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.054+0000 7f779e7fc640 1 -- 172.21.15.78:0/2101340714 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f77a00b2020 con 0x7f77a8159f30 2023-12-12T10:12:32.061 INFO:teuthology.orchestra.run.smithi078.stdout:55834574859 2023-12-12T10:12:32.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.058+0000 7f77b01c4640 1 -- 172.21.15.78:0/2101340714 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f778c0664a0 msgr2=0x7f778c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:32.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.058+0000 7f77b01c4640 1 --2- 172.21.15.78:0/2101340714 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f778c0664a0 0x7f778c068960 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f77a80b06b0 tx=0x7f779800c040 comp rx=0 tx=0).stop 2023-12-12T10:12:32.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.058+0000 7f77b01c4640 1 -- 172.21.15.78:0/2101340714 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f77a8159f30 msgr2=0x7f77a80af830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:32.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.058+0000 7f77b01c4640 1 --2- 172.21.15.78:0/2101340714 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f77a8159f30 0x7f77a80af830 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f77a00ac000 tx=0x7f77a00195e0 comp rx=0 tx=0).stop 2023-12-12T10:12:32.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.058+0000 7f77b01c4640 1 -- 172.21.15.78:0/2101340714 shutdown_connections 2023-12-12T10:12:32.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.058+0000 7f77b01c4640 1 --2- 172.21.15.78:0/2101340714 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f778c0664a0 0x7f778c068960 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:32.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.058+0000 7f77b01c4640 1 --2- 172.21.15.78:0/2101340714 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f77a8159f30 0x7f77a80af830 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:32.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.058+0000 7f77b01c4640 1 --2- 172.21.15.78:0/2101340714 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f77a8142890 0x7f77a8155500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:32.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.058+0000 7f77b01c4640 1 --2- 172.21.15.78:0/2101340714 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f77a8070810 0x7f77a815c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:32.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.058+0000 7f77b01c4640 1 -- 172.21.15.78:0/2101340714 >> 172.21.15.78:0/2101340714 conn(0x7f77a80b0750 msgr2=0x7f77a8157dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:32.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.058+0000 7f77b01c4640 1 -- 172.21.15.78:0/2101340714 shutdown_connections 2023-12-12T10:12:32.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.058+0000 7f77b01c4640 1 -- 172.21.15.78:0/2101340714 wait complete. 2023-12-12T10:12:32.097 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.2 2023-12-12T10:12:32.098 DEBUG:teuthology.parallel:result is None 2023-12-12T10:12:32.121 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.114+0000 7fc9a7f2a640 1 -- 172.21.15.78:0/346811333 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fc988005510 con 0x7fc9a0146850 2023-12-12T10:12:32.122 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.114+0000 7fc9967fc640 1 -- 172.21.15.78:0/346811333 <== mon.1 v2:172.21.15.187:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc9900091f0 con 0x7fc9a0146850 2023-12-12T10:12:32.122 INFO:teuthology.orchestra.run.smithi078.stdout:55834574858 2023-12-12T10:12:32.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.118+0000 7fc9a7f2a640 1 -- 172.21.15.78:0/346811333 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fc9840664a0 msgr2=0x7fc984068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:32.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.118+0000 7fc9a7f2a640 1 --2- 172.21.15.78:0/346811333 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fc9840664a0 0x7fc984068960 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc9980ae000 tx=0x7fc9980a7070 comp rx=0 tx=0).stop 2023-12-12T10:12:32.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.118+0000 7fc9a7f2a640 1 -- 172.21.15.78:0/346811333 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc9a0146850 msgr2=0x7fc9a0159fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:32.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.118+0000 7fc9a7f2a640 1 --2- 172.21.15.78:0/346811333 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc9a0146850 0x7fc9a0159fa0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc99000b3e0 tx=0x7fc99000b8a0 comp rx=0 tx=0).stop 2023-12-12T10:12:32.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.118+0000 7fc9a7f2a640 1 -- 172.21.15.78:0/346811333 shutdown_connections 2023-12-12T10:12:32.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.118+0000 7fc9a7f2a640 1 --2- 172.21.15.78:0/346811333 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fc9840664a0 0x7fc984068960 secure :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc9980ae000 tx=0x7fc9980a7070 comp rx=0 tx=0).stop 2023-12-12T10:12:32.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.118+0000 7fc9a7f2a640 1 --2- 172.21.15.78:0/346811333 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc9a015a7d0 0x7fc9a015fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:32.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.118+0000 7fc9a7f2a640 1 --2- 172.21.15.78:0/346811333 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc9a0146850 0x7fc9a0159fa0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:32.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.118+0000 7fc9a7f2a640 1 --2- 172.21.15.78:0/346811333 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc9a00ae260 0x7fc9a013ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:32.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.118+0000 7fc9a7f2a640 1 -- 172.21.15.78:0/346811333 >> 172.21.15.78:0/346811333 conn(0x7fc9a00b0b20 msgr2=0x7fc9a0144960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:32.126 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.118+0000 7fc9a7f2a640 1 -- 172.21.15.78:0/346811333 shutdown_connections 2023-12-12T10:12:32.126 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.118+0000 7fc9a7f2a640 1 -- 172.21.15.78:0/346811333 wait complete. 2023-12-12T10:12:32.143 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.138+0000 7feb90c17640 1 -- 172.21.15.78:0/3586491428 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7feb84005370 con 0x7feb840e77f0 2023-12-12T10:12:32.144 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.138+0000 7feb7affd640 1 -- 172.21.15.78:0/3586491428 <== mon.2 v2:172.21.15.187:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7feb7c0514e0 con 0x7feb840e77f0 2023-12-12T10:12:32.144 INFO:teuthology.orchestra.run.smithi078.stdout:55834574857 2023-12-12T10:12:32.146 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.1 2023-12-12T10:12:32.146 DEBUG:teuthology.parallel:result is None 2023-12-12T10:12:32.147 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.142+0000 7fec50859640 1 -- 172.21.15.78:0/3059535423 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fec4c155790 con 0x7fec4c0ce930 2023-12-12T10:12:32.147 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.142+0000 7feb90c17640 1 -- 172.21.15.78:0/3586491428 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7feb6c0664c0 msgr2=0x7feb6c068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:32.147 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.142+0000 7feb90c17640 1 --2- 172.21.15.78:0/3586491428 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7feb6c0664c0 0x7feb6c068980 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7feb80000f70 tx=0x7feb800079c0 comp rx=0 tx=0).stop 2023-12-12T10:12:32.147 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.142+0000 7feb90c17640 1 -- 172.21.15.78:0/3586491428 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7feb840e77f0 msgr2=0x7feb84049c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:32.147 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.142+0000 7feb90c17640 1 --2- 172.21.15.78:0/3586491428 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7feb840e77f0 0x7feb84049c80 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7feb7c00e7f0 tx=0x7feb7c00ecb0 comp rx=0 tx=0).stop 2023-12-12T10:12:32.147 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.142+0000 7fec337fe640 1 -- 172.21.15.78:0/3059535423 <== mon.2 v2:172.21.15.187:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fec44019020 con 0x7fec4c0ce930 2023-12-12T10:12:32.148 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.142+0000 7feb90c17640 1 -- 172.21.15.78:0/3586491428 shutdown_connections 2023-12-12T10:12:32.148 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.142+0000 7feb90c17640 1 --2- 172.21.15.78:0/3586491428 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7feb6c0664c0 0x7feb6c068980 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:32.148 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.142+0000 7feb90c17640 1 --2- 172.21.15.78:0/3586491428 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7feb840e52d0 0x7feb84048270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:32.148 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.142+0000 7feb90c17640 1 --2- 172.21.15.78:0/3586491428 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7feb840e77f0 0x7feb84049c80 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:32.148 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.142+0000 7feb90c17640 1 --2- 172.21.15.78:0/3586491428 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7feb840e30a0 0x7feb840d7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:32.148 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.142+0000 7feb90c17640 1 -- 172.21.15.78:0/3586491428 >> 172.21.15.78:0/3586491428 conn(0x7feb84009f90 msgr2=0x7feb840e22c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:32.148 INFO:teuthology.orchestra.run.smithi078.stdout:55834574858 2023-12-12T10:12:32.149 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.142+0000 7feb90c17640 1 -- 172.21.15.78:0/3586491428 shutdown_connections 2023-12-12T10:12:32.149 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.142+0000 7feb90c17640 1 -- 172.21.15.78:0/3586491428 wait complete. 2023-12-12T10:12:32.151 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.142+0000 7fec50859640 1 -- 172.21.15.78:0/3059535423 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fec380664a0 msgr2=0x7fec38068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:32.151 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.142+0000 7fec50859640 1 --2- 172.21.15.78:0/3059535423 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fec380664a0 0x7fec38068960 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fec400af000 tx=0x7fec40008040 comp rx=0 tx=0).stop 2023-12-12T10:12:32.151 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.142+0000 7fec50859640 1 -- 172.21.15.78:0/3059535423 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fec4c0ce930 msgr2=0x7fec4c153f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:32.151 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.142+0000 7fec50859640 1 --2- 172.21.15.78:0/3059535423 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fec4c0ce930 0x7fec4c153f20 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fec4400ba50 tx=0x7fec4400bf10 comp rx=0 tx=0).stop 2023-12-12T10:12:32.151 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.142+0000 7fec50859640 1 -- 172.21.15.78:0/3059535423 shutdown_connections 2023-12-12T10:12:32.151 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.142+0000 7fec50859640 1 --2- 172.21.15.78:0/3059535423 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fec380664a0 0x7fec38068960 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:32.151 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.142+0000 7fec50859640 1 --2- 172.21.15.78:0/3059535423 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fec4c15cf40 0x7fec4c15f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:32.151 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.142+0000 7fec50859640 1 --2- 172.21.15.78:0/3059535423 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec4c0d0410 0x7fec4c0b79c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:32.151 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.142+0000 7fec50859640 1 --2- 172.21.15.78:0/3059535423 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fec4c0ce930 0x7fec4c153f20 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:32.151 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.142+0000 7fec50859640 1 -- 172.21.15.78:0/3059535423 >> 172.21.15.78:0/3059535423 conn(0x7fec4c0d2dd0 msgr2=0x7fec4c0b14f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:32.151 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.146+0000 7fec50859640 1 -- 172.21.15.78:0/3059535423 shutdown_connections 2023-12-12T10:12:32.152 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.146+0000 7fc4cea5a640 1 -- 172.21.15.78:0/2726910306 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fc4c8163f00 con 0x7fc4c80c6150 2023-12-12T10:12:32.152 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.146+0000 7fec50859640 1 -- 172.21.15.78:0/3059535423 wait complete. 2023-12-12T10:12:32.152 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.146+0000 7fc4c4ff9640 1 -- 172.21.15.78:0/2726910306 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc4b00be090 con 0x7fc4c80c6150 2023-12-12T10:12:32.153 INFO:teuthology.orchestra.run.smithi078.stdout:55834574858 2023-12-12T10:12:32.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.150+0000 7fc4cea5a640 1 -- 172.21.15.78:0/2726910306 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fc4a8066470 msgr2=0x7fc4a8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:32.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.150+0000 7fc4cea5a640 1 --2- 172.21.15.78:0/2726910306 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fc4a8066470 0x7fc4a8068930 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc4c80b44c0 tx=0x7fc4c0008040 comp rx=0 tx=0).stop 2023-12-12T10:12:32.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.150+0000 7fc4cea5a640 1 -- 172.21.15.78:0/2726910306 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc4c80c6150 msgr2=0x7fc4c8162da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:32.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.150+0000 7fc4cea5a640 1 --2- 172.21.15.78:0/2726910306 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc4c80c6150 0x7fc4c8162da0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fc4b0098720 tx=0x7fc4bc005800 comp rx=0 tx=0).stop 2023-12-12T10:12:32.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.150+0000 7fc4cea5a640 1 -- 172.21.15.78:0/2726910306 shutdown_connections 2023-12-12T10:12:32.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.150+0000 7fc4cea5a640 1 --2- 172.21.15.78:0/2726910306 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fc4a8066470 0x7fc4a8068930 secure :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc4c80b44c0 tx=0x7fc4c0008040 comp rx=0 tx=0).stop 2023-12-12T10:12:32.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.150+0000 7fc4cea5a640 1 --2- 172.21.15.78:0/2726910306 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc4c80c6150 0x7fc4c8162da0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:32.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.150+0000 7fc4cea5a640 1 --2- 172.21.15.78:0/2726910306 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc4c8166260 0x7fc4c80c5c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:32.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.150+0000 7fc4cea5a640 1 --2- 172.21.15.78:0/2726910306 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc4c80ca730 0x7fc4c81f3b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:32.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.150+0000 7fc4cea5a640 1 -- 172.21.15.78:0/2726910306 >> 172.21.15.78:0/2726910306 conn(0x7fc4c80b0b20 msgr2=0x7fc4c80cda10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:32.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.150+0000 7fc4cea5a640 1 -- 172.21.15.78:0/2726910306 shutdown_connections 2023-12-12T10:12:32.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.150+0000 7fc4cea5a640 1 -- 172.21.15.78:0/2726910306 wait complete. 2023-12-12T10:12:32.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.154+0000 7fcfbba32640 1 -- 172.21.15.78:0/2574497984 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fcfb40b2d40 con 0x7fcfb40d3bb0 2023-12-12T10:12:32.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.158+0000 7fb8ab7c1640 1 -- 172.21.15.78:0/670056792 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb8a4067530 con 0x7fb8a4141ac0 2023-12-12T10:12:32.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.158+0000 7fb899ffb640 1 -- 172.21.15.78:0/670056792 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb89c021090 con 0x7fb8a4141ac0 2023-12-12T10:12:32.166 INFO:teuthology.orchestra.run.smithi078.stdout:55834574857 2023-12-12T10:12:32.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.162+0000 7fcfa5ffb640 1 -- 172.21.15.78:0/2574497984 <== mon.1 v2:172.21.15.187:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fcfac039020 con 0x7fcfb40d3bb0 2023-12-12T10:12:32.167 INFO:teuthology.orchestra.run.smithi078.stdout:55834574857 2023-12-12T10:12:32.170 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.162+0000 7fb8ab7c1640 1 -- 172.21.15.78:0/670056792 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fb8880664c0 msgr2=0x7fb888068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:32.170 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.162+0000 7fb8ab7c1640 1 --2- 172.21.15.78:0/670056792 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fb8880664c0 0x7fb888068980 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb8a00064a0 tx=0x7fb8a0005d90 comp rx=0 tx=0).stop 2023-12-12T10:12:32.171 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.162+0000 7fcfbba32640 1 -- 172.21.15.78:0/2574497984 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fcf98066540 msgr2=0x7fcf98068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:32.171 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.162+0000 7fcfbba32640 1 --2- 172.21.15.78:0/2574497984 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fcf98066540 0x7fcf98068a00 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fcfa80ae000 tx=0x7fcfa80a6070 comp rx=0 tx=0).stop 2023-12-12T10:12:32.171 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.162+0000 7fcfbba32640 1 -- 172.21.15.78:0/2574497984 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcfb40d3bb0 msgr2=0x7fcfb406c0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:32.171 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.162+0000 7fcfbba32640 1 --2- 172.21.15.78:0/2574497984 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcfb40d3bb0 0x7fcfb406c0d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fcfac007e60 tx=0x7fcfac00e4b0 comp rx=0 tx=0).stop 2023-12-12T10:12:32.171 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.162+0000 7fb8ab7c1640 1 -- 172.21.15.78:0/670056792 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb8a4141ac0 msgr2=0x7fb8a40c83e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:32.171 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.162+0000 7fb8ab7c1640 1 --2- 172.21.15.78:0/670056792 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb8a4141ac0 0x7fb8a40c83e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb89c00e7f0 tx=0x7fb89c00ecb0 comp rx=0 tx=0).stop 2023-12-12T10:12:32.172 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.166+0000 7fcfbba32640 1 -- 172.21.15.78:0/2574497984 shutdown_connections 2023-12-12T10:12:32.172 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.166+0000 7fcfbba32640 1 --2- 172.21.15.78:0/2574497984 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fcf98066540 0x7fcf98068a00 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:32.172 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.166+0000 7fcfbba32640 1 --2- 172.21.15.78:0/2574497984 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcfb40d3bb0 0x7fcfb406c0d0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:32.172 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.166+0000 7fcfbba32640 1 --2- 172.21.15.78:0/2574497984 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcfb40d1980 0x7fcfb40cace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:32.172 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.166+0000 7fcfbba32640 1 --2- 172.21.15.78:0/2574497984 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcfb40b21e0 0x7fcfb4158790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:32.172 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.166+0000 7fcfbba32640 1 -- 172.21.15.78:0/2574497984 >> 172.21.15.78:0/2574497984 conn(0x7fcfb40d3090 msgr2=0x7fcfb41648f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:32.172 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.166+0000 7fb8ab7c1640 1 -- 172.21.15.78:0/670056792 shutdown_connections 2023-12-12T10:12:32.172 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.166+0000 7fb8ab7c1640 1 --2- 172.21.15.78:0/670056792 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fb8880664c0 0x7fb888068980 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:32.172 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.166+0000 7fb8ab7c1640 1 --2- 172.21.15.78:0/670056792 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb8a4141ac0 0x7fb8a40c83e0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:32.172 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.166+0000 7fb8ab7c1640 1 --2- 172.21.15.78:0/670056792 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb8a40cc780 0x7fb8a40c9d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:32.173 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.166+0000 7fb8ab7c1640 1 --2- 172.21.15.78:0/670056792 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb8a40b39f0 0x7fb8a4158850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:32.173 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.166+0000 7fb8ab7c1640 1 -- 172.21.15.78:0/670056792 >> 172.21.15.78:0/670056792 conn(0x7fb8a406a710 msgr2=0x7fb8a40ce270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:32.173 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.166+0000 7f212b31d640 1 -- 172.21.15.78:0/2580197822 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f211c0057f0 con 0x7f211c053c20 2023-12-12T10:12:32.173 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.166+0000 7fcfbba32640 1 -- 172.21.15.78:0/2574497984 shutdown_connections 2023-12-12T10:12:32.173 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.166+0000 7fcfbba32640 1 -- 172.21.15.78:0/2574497984 wait complete. 2023-12-12T10:12:32.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.166+0000 7fb8ab7c1640 1 -- 172.21.15.78:0/670056792 shutdown_connections 2023-12-12T10:12:32.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.166+0000 7fb8ab7c1640 1 -- 172.21.15.78:0/670056792 wait complete. 2023-12-12T10:12:32.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.166+0000 7f2119ffb640 1 -- 172.21.15.78:0/2580197822 <== mon.2 v2:172.21.15.187:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f21240ca540 con 0x7f211c053c20 2023-12-12T10:12:32.175 INFO:teuthology.orchestra.run.smithi078.stdout:55834574857 2023-12-12T10:12:32.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.170+0000 7f212b31d640 1 -- 172.21.15.78:0/2580197822 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f21080664d0 msgr2=0x7f2108068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:32.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.170+0000 7f212b31d640 1 --2- 172.21.15.78:0/2580197822 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f21080664d0 0x7f2108068990 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f21200ae000 tx=0x7f2120008040 comp rx=0 tx=0).stop 2023-12-12T10:12:32.176 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.170+0000 7f212b31d640 1 -- 172.21.15.78:0/2580197822 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f211c053c20 msgr2=0x7f211c0d6680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:32.176 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.170+0000 7f212b31d640 1 --2- 172.21.15.78:0/2580197822 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f211c053c20 0x7f211c0d6680 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2124079920 tx=0x7f2124074850 comp rx=0 tx=0).stop 2023-12-12T10:12:32.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.170+0000 7f212b31d640 1 -- 172.21.15.78:0/2580197822 shutdown_connections 2023-12-12T10:12:32.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.170+0000 7f212b31d640 1 --2- 172.21.15.78:0/2580197822 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f21080664d0 0x7f2108068990 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:32.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.170+0000 7f212b31d640 1 --2- 172.21.15.78:0/2580197822 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f211c00d680 0x7f211c184130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:32.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.170+0000 7f212b31d640 1 --2- 172.21.15.78:0/2580197822 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f211c0e6c40 0x7f211c00d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:32.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.170+0000 7f212b31d640 1 --2- 172.21.15.78:0/2580197822 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f211c053c20 0x7f211c0d6680 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:32.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.170+0000 7f212b31d640 1 -- 172.21.15.78:0/2580197822 >> 172.21.15.78:0/2580197822 conn(0x7f211c0559f0 msgr2=0x7f211c038980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:32.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.170+0000 7f212b31d640 1 -- 172.21.15.78:0/2580197822 shutdown_connections 2023-12-12T10:12:32.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.170+0000 7f212b31d640 1 -- 172.21.15.78:0/2580197822 wait complete. 2023-12-12T10:12:32.180 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.6 2023-12-12T10:12:32.180 DEBUG:teuthology.parallel:result is None 2023-12-12T10:12:32.187 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.0 2023-12-12T10:12:32.187 DEBUG:teuthology.parallel:result is None 2023-12-12T10:12:32.188 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.4 2023-12-12T10:12:32.188 DEBUG:teuthology.parallel:result is None 2023-12-12T10:12:32.199 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.5 2023-12-12T10:12:32.199 DEBUG:teuthology.parallel:result is None 2023-12-12T10:12:32.200 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.3 2023-12-12T10:12:32.200 DEBUG:teuthology.parallel:result is None 2023-12-12T10:12:32.202 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.7 2023-12-12T10:12:32.203 DEBUG:teuthology.parallel:result is None 2023-12-12T10:12:32.203 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-12-12T10:12:32.203 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-12T10:12:32.387 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.382+0000 7f12a1009640 1 Processor -- start 2023-12-12T10:12:32.387 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.382+0000 7f12a1009640 1 -- start start 2023-12-12T10:12:32.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.382+0000 7f12a1009640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f129c0cec50 0x7f129c0cf0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:32.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.382+0000 7f12a1009640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f129c15b020 con 0x7f129c1436b0 2023-12-12T10:12:32.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.382+0000 7f12a1009640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f129c0b2640 con 0x7f129c070990 2023-12-12T10:12:32.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.382+0000 7f12a1009640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f129c0cf600 con 0x7f129c0cec50 2023-12-12T10:12:32.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.382+0000 7f129bfff640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f129c1436b0 0x7f129c15a910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:34340/0 (socket says 172.21.15.78:34340) 2023-12-12T10:12:32.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.382+0000 7f129bfff640 1 -- 172.21.15.78:0/2496432650 learned_addr learned my addr 172.21.15.78:0/2496432650 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-12-12T10:12:32.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.382+0000 7f129b7fe640 1 --2- 172.21.15.78:0/2496432650 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f129c0cec50 0x7f129c0cf0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:32.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.382+0000 7f129affd640 1 -- 172.21.15.78:0/2496432650 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1082824209 0 0) 0x7f128c001120 con 0x7f129c1436b0 2023-12-12T10:12:32.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.382+0000 7f129affd640 1 -- 172.21.15.78:0/2496432650 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1284005740 con 0x7f129c1436b0 2023-12-12T10:12:32.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.382+0000 7f129affd640 1 -- 172.21.15.78:0/2496432650 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1112481721 0 0) 0x7f1284005740 con 0x7f129c1436b0 2023-12-12T10:12:32.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.382+0000 7f129b7fe640 1 -- 172.21.15.78:0/2496432650 >> v1:172.21.15.187:6789/0 conn(0x7f129c070990 legacy=0x7f129c070e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:32.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.382+0000 7f129b7fe640 1 -- 172.21.15.78:0/2496432650 >> v1:172.21.15.78:6789/0 conn(0x7f129c1436b0 legacy=0x7f129c15a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:32.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.382+0000 7f129b7fe640 1 -- 172.21.15.78:0/2496432650 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f129c0b2920 con 0x7f129c0cec50 2023-12-12T10:12:32.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.386+0000 7f129b7fe640 1 --2- 172.21.15.78:0/2496432650 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f129c0cec50 0x7f129c0cf0c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f12900097d0 tx=0x7f129001c330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7337eb34eb87dac0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:32.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.386+0000 7f129affd640 1 -- 172.21.15.78:0/2496432650 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f128c001810 con 0x7f129c0cec50 2023-12-12T10:12:32.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.386+0000 7f129affd640 1 -- 172.21.15.78:0/2496432650 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12900a7050 con 0x7f129c0cec50 2023-12-12T10:12:32.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.386+0000 7f129affd640 1 -- 172.21.15.78:0/2496432650 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12900ab600 con 0x7f129c0cec50 2023-12-12T10:12:32.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.386+0000 7f12a1009640 1 -- 172.21.15.78:0/2496432650 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f129c0cec50 msgr2=0x7f129c0cf0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:32.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.386+0000 7f12a1009640 1 --2- 172.21.15.78:0/2496432650 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f129c0cec50 0x7f129c0cf0c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f12900097d0 tx=0x7f129001c330 comp rx=0 tx=0).stop 2023-12-12T10:12:32.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.386+0000 7f12a1009640 1 -- 172.21.15.78:0/2496432650 shutdown_connections 2023-12-12T10:12:32.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.386+0000 7f12a1009640 1 --2- 172.21.15.78:0/2496432650 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f129c0cec50 0x7f129c0cf0c0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:32.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.386+0000 7f12a1009640 1 -- 172.21.15.78:0/2496432650 >> 172.21.15.78:0/2496432650 conn(0x7f129c06a710 msgr2=0x7f129c06ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:32.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.386+0000 7f12a1009640 1 -- 172.21.15.78:0/2496432650 shutdown_connections 2023-12-12T10:12:32.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.386+0000 7f12a1009640 1 -- 172.21.15.78:0/2496432650 wait complete. 2023-12-12T10:12:32.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.390+0000 7f12a1009640 1 Processor -- start 2023-12-12T10:12:32.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.390+0000 7f12a1009640 1 -- start start 2023-12-12T10:12:32.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.390+0000 7f12a1009640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f129c070990 0x7f129c164780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:32.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.390+0000 7f12a1009640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f129c0cec50 0x7f129c0c39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:32.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.390+0000 7f12a1009640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f129c1436b0 0x7f129c13e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:32.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.390+0000 7f12a1009640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f129c1f5870 con 0x7f129c070990 2023-12-12T10:12:32.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.390+0000 7f12a1009640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f129c0c3f00 con 0x7f129c0cec50 2023-12-12T10:12:32.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.390+0000 7f12a1009640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f129c0c4130 con 0x7f129c1436b0 2023-12-12T10:12:32.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.390+0000 7f129bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f129c070990 0x7f129c164780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:32.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.390+0000 7f129bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f129c070990 0x7f129c164780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37240/0 (socket says 172.21.15.78:37240) 2023-12-12T10:12:32.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.390+0000 7f129bfff640 1 -- 172.21.15.78:0/3237054109 learned_addr learned my addr 172.21.15.78:0/3237054109 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:32.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.390+0000 7f129b7fe640 1 --2- 172.21.15.78:0/3237054109 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f129c0cec50 0x7f129c0c39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:32.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.390+0000 7f12a0808640 1 --2- 172.21.15.78:0/3237054109 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f129c1436b0 0x7f129c13e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:32.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.390+0000 7f129bfff640 1 -- 172.21.15.78:0/3237054109 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f129c1436b0 msgr2=0x7f129c13e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:32.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.390+0000 7f129bfff640 1 --2- 172.21.15.78:0/3237054109 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f129c1436b0 0x7f129c13e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:32.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.390+0000 7f129bfff640 1 -- 172.21.15.78:0/3237054109 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f129c0cec50 msgr2=0x7f129c0c39c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:32.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.390+0000 7f129bfff640 1 --2- 172.21.15.78:0/3237054109 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f129c0cec50 0x7f129c0c39c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:32.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.390+0000 7f129bfff640 1 -- 172.21.15.78:0/3237054109 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12900093b0 con 0x7f129c070990 2023-12-12T10:12:32.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.390+0000 7f12a0808640 1 --2- 172.21.15.78:0/3237054109 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f129c1436b0 0x7f129c13e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T10:12:32.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.390+0000 7f129bfff640 1 --2- 172.21.15.78:0/3237054109 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f129c070990 0x7f129c164780 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f128c00c550 tx=0x7f128c00ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:32.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.390+0000 7f1298ff9640 1 -- 172.21.15.78:0/3237054109 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f128c005cf0 con 0x7f129c070990 2023-12-12T10:12:32.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.390+0000 7f1298ff9640 1 -- 172.21.15.78:0/3237054109 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f128c005e50 con 0x7f129c070990 2023-12-12T10:12:32.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.390+0000 7f1298ff9640 1 -- 172.21.15.78:0/3237054109 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f128c0072b0 con 0x7f129c070990 2023-12-12T10:12:32.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.390+0000 7f12a1009640 1 -- 172.21.15.78:0/3237054109 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f129c0c4410 con 0x7f129c070990 2023-12-12T10:12:32.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.390+0000 7f12a1009640 1 -- 172.21.15.78:0/3237054109 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f129c13ec90 con 0x7f129c070990 2023-12-12T10:12:32.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.390+0000 7f12a1009640 1 -- 172.21.15.78:0/3237054109 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f129c0671f0 con 0x7f129c070990 2023-12-12T10:12:32.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.394+0000 7f1298ff9640 1 -- 172.21.15.78:0/3237054109 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f128c007410 con 0x7f129c070990 2023-12-12T10:12:32.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.394+0000 7f1298ff9640 1 --2- 172.21.15.78:0/3237054109 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f1288066470 0x7f1288068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:32.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.394+0000 7f1298ff9640 1 -- 172.21.15.78:0/3237054109 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f128c083670 con 0x7f129c070990 2023-12-12T10:12:32.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.394+0000 7f129b7fe640 1 --2- 172.21.15.78:0/3237054109 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f1288066470 0x7f1288068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:32.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.394+0000 7f129b7fe640 1 --2- 172.21.15.78:0/3237054109 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f1288066470 0x7f1288068930 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f12900ad000 tx=0x7f12900a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:32.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.398+0000 7f1298ff9640 1 -- 172.21.15.78:0/3237054109 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f128c050810 con 0x7f129c070990 2023-12-12T10:12:32.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.546+0000 7f12a1009640 1 -- 172.21.15.78:0/3237054109 --> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f129c06c0b0 con 0x7f1288066470 2023-12-12T10:12:32.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.554+0000 7f1298ff9640 1 -- 172.21.15.78:0/3237054109 <== mgr.4104 v2:172.21.15.78:6832/1725498448 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345242 (secure 0 0 0) 0x7f12900ba070 con 0x7f1288066470 2023-12-12T10:12:32.565 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:12:32.567 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2023-12-12T10:12:32.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.558+0000 7f12a1009640 1 -- 172.21.15.78:0/3237054109 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f1288066470 msgr2=0x7f1288068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:32.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.558+0000 7f12a1009640 1 --2- 172.21.15.78:0/3237054109 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f1288066470 0x7f1288068930 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f12900ad000 tx=0x7f12900a6000 comp rx=0 tx=0).stop 2023-12-12T10:12:32.569 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.558+0000 7f12a1009640 1 -- 172.21.15.78:0/3237054109 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f129c070990 msgr2=0x7f129c164780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:32.569 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.558+0000 7f12a1009640 1 --2- 172.21.15.78:0/3237054109 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f129c070990 0x7f129c164780 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f128c00c550 tx=0x7f128c00ca10 comp rx=0 tx=0).stop 2023-12-12T10:12:32.569 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.558+0000 7f12a1009640 1 -- 172.21.15.78:0/3237054109 shutdown_connections 2023-12-12T10:12:32.569 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.558+0000 7f12a1009640 1 --2- 172.21.15.78:0/3237054109 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f1288066470 0x7f1288068930 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:32.569 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.558+0000 7f12a1009640 1 --2- 172.21.15.78:0/3237054109 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f129c1436b0 0x7f129c13e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:32.569 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.558+0000 7f12a1009640 1 --2- 172.21.15.78:0/3237054109 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f129c0cec50 0x7f129c0c39c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:32.569 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.558+0000 7f12a1009640 1 --2- 172.21.15.78:0/3237054109 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f129c070990 0x7f129c164780 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:32.569 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.558+0000 7f12a1009640 1 -- 172.21.15.78:0/3237054109 >> 172.21.15.78:0/3237054109 conn(0x7f129c06a710 msgr2=0x7f129c0cbf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:32.569 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.558+0000 7f12a1009640 1 -- 172.21.15.78:0/3237054109 shutdown_connections 2023-12-12T10:12:32.569 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.558+0000 7f12a1009640 1 -- 172.21.15.78:0/3237054109 wait complete. 2023-12-12T10:12:32.585 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":34,"stamp":"2023-12-12T10:12:30.994715+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595005,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219392,"kb_used_data":3204,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755328,"statfs":{"total":773094113280,"available":772869455872,"internally_reserved":0,"allocated":3280896,"data_stored":1987377,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2227,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002752"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.957388+0000","last_change":"2023-12-12T10:12:08.837046+0000","last_active":"2023-12-12T10:12:13.957388+0000","last_peered":"2023-12-12T10:12:13.957388+0000","last_clean":"2023-12-12T10:12:13.957388+0000","last_became_active":"2023-12-12T10:12:08.836763+0000","last_became_peered":"2023-12-12T10:12:08.836763+0000","last_unstale":"2023-12-12T10:12:13.957388+0000","last_undegraded":"2023-12-12T10:12:13.957388+0000","last_fullsized":"2023-12-12T10:12:13.957388+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_clean_scrub_stamp":"2023-12-12T10:12:07.792253+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:01:42.240854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.944527+0000","last_change":"2023-12-12T10:12:09.835821+0000","last_active":"2023-12-12T10:12:13.944527+0000","last_peered":"2023-12-12T10:12:13.944527+0000","last_clean":"2023-12-12T10:12:13.944527+0000","last_became_active":"2023-12-12T10:12:09.835565+0000","last_became_peered":"2023-12-12T10:12:09.835565+0000","last_unstale":"2023-12-12T10:12:13.944527+0000","last_undegraded":"2023-12-12T10:12:13.944527+0000","last_fullsized":"2023-12-12T10:12:13.944527+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:59:46.622358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-12T10:12:15.555553+0000","last_change":"2023-12-12T10:12:14.188368+0000","last_active":"2023-12-12T10:12:15.555553+0000","last_peered":"2023-12-12T10:12:15.555553+0000","last_clean":"2023-12-12T10:12:15.555553+0000","last_became_active":"2023-12-12T10:12:14.188013+0000","last_became_peered":"2023-12-12T10:12:14.188013+0000","last_unstale":"2023-12-12T10:12:15.555553+0000","last_undegraded":"2023-12-12T10:12:15.555553+0000","last_fullsized":"2023-12-12T10:12:15.555553+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_clean_scrub_stamp":"2023-12-12T10:12:12.929940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:41:41.466318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.946555+0000","last_change":"2023-12-12T10:12:08.841058+0000","last_active":"2023-12-12T10:12:13.946555+0000","last_peered":"2023-12-12T10:12:13.946555+0000","last_clean":"2023-12-12T10:12:13.946555+0000","last_became_active":"2023-12-12T10:12:08.840749+0000","last_became_peered":"2023-12-12T10:12:08.840749+0000","last_unstale":"2023-12-12T10:12:13.946555+0000","last_undegraded":"2023-12-12T10:12:13.946555+0000","last_fullsized":"2023-12-12T10:12:13.946555+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_clean_scrub_stamp":"2023-12-12T10:12:07.792253+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:01:42.240854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.955095+0000","last_change":"2023-12-12T10:12:09.846736+0000","last_active":"2023-12-12T10:12:13.955095+0000","last_peered":"2023-12-12T10:12:13.955095+0000","last_clean":"2023-12-12T10:12:13.955095+0000","last_became_active":"2023-12-12T10:12:09.846467+0000","last_became_peered":"2023-12-12T10:12:09.846467+0000","last_unstale":"2023-12-12T10:12:13.955095+0000","last_undegraded":"2023-12-12T10:12:13.955095+0000","last_fullsized":"2023-12-12T10:12:13.955095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:29:34.002418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-12T10:12:14.943582+0000","last_change":"2023-12-12T10:12:13.957767+0000","last_active":"2023-12-12T10:12:14.943582+0000","last_peered":"2023-12-12T10:12:14.943582+0000","last_clean":"2023-12-12T10:12:14.943582+0000","last_became_active":"2023-12-12T10:12:13.957289+0000","last_became_peered":"2023-12-12T10:12:13.957289+0000","last_unstale":"2023-12-12T10:12:14.943582+0000","last_undegraded":"2023-12-12T10:12:14.943582+0000","last_fullsized":"2023-12-12T10:12:14.943582+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_clean_scrub_stamp":"2023-12-12T10:12:12.929940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:29:38.133352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:14.179027+0000","last_change":"2023-12-12T10:12:08.846842+0000","last_active":"2023-12-12T10:12:14.179027+0000","last_peered":"2023-12-12T10:12:14.179027+0000","last_clean":"2023-12-12T10:12:14.179027+0000","last_became_active":"2023-12-12T10:12:08.846389+0000","last_became_peered":"2023-12-12T10:12:08.846389+0000","last_unstale":"2023-12-12T10:12:14.179027+0000","last_undegraded":"2023-12-12T10:12:14.179027+0000","last_fullsized":"2023-12-12T10:12:14.179027+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_clean_scrub_stamp":"2023-12-12T10:12:07.792253+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:14:21.574354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.954855+0000","last_change":"2023-12-12T10:12:09.846099+0000","last_active":"2023-12-12T10:12:13.954855+0000","last_peered":"2023-12-12T10:12:13.954855+0000","last_clean":"2023-12-12T10:12:13.954855+0000","last_became_active":"2023-12-12T10:12:09.843647+0000","last_became_peered":"2023-12-12T10:12:09.843647+0000","last_unstale":"2023-12-12T10:12:13.954855+0000","last_undegraded":"2023-12-12T10:12:13.954855+0000","last_fullsized":"2023-12-12T10:12:13.954855+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:06:52.618740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-12T10:12:14.944222+0000","last_change":"2023-12-12T10:12:13.966808+0000","last_active":"2023-12-12T10:12:14.944222+0000","last_peered":"2023-12-12T10:12:14.944222+0000","last_clean":"2023-12-12T10:12:14.944222+0000","last_became_active":"2023-12-12T10:12:13.966405+0000","last_became_peered":"2023-12-12T10:12:13.966405+0000","last_unstale":"2023-12-12T10:12:14.944222+0000","last_undegraded":"2023-12-12T10:12:14.944222+0000","last_fullsized":"2023-12-12T10:12:14.944222+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_clean_scrub_stamp":"2023-12-12T10:12:12.929940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:08:16.230176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:14.178844+0000","last_change":"2023-12-12T10:12:08.844404+0000","last_active":"2023-12-12T10:12:14.178844+0000","last_peered":"2023-12-12T10:12:14.178844+0000","last_clean":"2023-12-12T10:12:14.178844+0000","last_became_active":"2023-12-12T10:12:08.842413+0000","last_became_peered":"2023-12-12T10:12:08.842413+0000","last_unstale":"2023-12-12T10:12:14.178844+0000","last_undegraded":"2023-12-12T10:12:14.178844+0000","last_fullsized":"2023-12-12T10:12:14.178844+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_clean_scrub_stamp":"2023-12-12T10:12:07.792253+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:29:32.995665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.955015+0000","last_change":"2023-12-12T10:12:09.841014+0000","last_active":"2023-12-12T10:12:13.955015+0000","last_peered":"2023-12-12T10:12:13.955015+0000","last_clean":"2023-12-12T10:12:13.955015+0000","last_became_active":"2023-12-12T10:12:09.840537+0000","last_became_peered":"2023-12-12T10:12:09.840537+0000","last_unstale":"2023-12-12T10:12:13.955015+0000","last_undegraded":"2023-12-12T10:12:13.955015+0000","last_fullsized":"2023-12-12T10:12:13.955015+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:17:19.749257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-12T10:12:14.943939+0000","last_change":"2023-12-12T10:12:13.964740+0000","last_active":"2023-12-12T10:12:14.943939+0000","last_peered":"2023-12-12T10:12:14.943939+0000","last_clean":"2023-12-12T10:12:14.943939+0000","last_became_active":"2023-12-12T10:12:13.964322+0000","last_became_peered":"2023-12-12T10:12:13.964322+0000","last_unstale":"2023-12-12T10:12:14.943939+0000","last_undegraded":"2023-12-12T10:12:14.943939+0000","last_fullsized":"2023-12-12T10:12:14.943939+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_clean_scrub_stamp":"2023-12-12T10:12:12.929940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T22:01:09.241666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.942306+0000","last_change":"2023-12-12T10:12:09.830608+0000","last_active":"2023-12-12T10:12:13.942306+0000","last_peered":"2023-12-12T10:12:13.942306+0000","last_clean":"2023-12-12T10:12:13.942306+0000","last_became_active":"2023-12-12T10:12:09.830291+0000","last_became_peered":"2023-12-12T10:12:09.830291+0000","last_unstale":"2023-12-12T10:12:13.942306+0000","last_undegraded":"2023-12-12T10:12:13.942306+0000","last_fullsized":"2023-12-12T10:12:13.942306+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:14:22.581107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:14.178760+0000","last_change":"2023-12-12T10:12:08.842318+0000","last_active":"2023-12-12T10:12:14.178760+0000","last_peered":"2023-12-12T10:12:14.178760+0000","last_clean":"2023-12-12T10:12:14.178760+0000","last_became_active":"2023-12-12T10:12:08.841798+0000","last_became_peered":"2023-12-12T10:12:08.841798+0000","last_unstale":"2023-12-12T10:12:14.178760+0000","last_undegraded":"2023-12-12T10:12:14.178760+0000","last_fullsized":"2023-12-12T10:12:14.178760+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_clean_scrub_stamp":"2023-12-12T10:12:07.792253+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:05:44.538814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-12T10:12:14.945190+0000","last_change":"2023-12-12T10:12:13.966998+0000","last_active":"2023-12-12T10:12:14.945190+0000","last_peered":"2023-12-12T10:12:14.945190+0000","last_clean":"2023-12-12T10:12:14.945190+0000","last_became_active":"2023-12-12T10:12:13.966611+0000","last_became_peered":"2023-12-12T10:12:13.966611+0000","last_unstale":"2023-12-12T10:12:14.945190+0000","last_undegraded":"2023-12-12T10:12:14.945190+0000","last_fullsized":"2023-12-12T10:12:14.945190+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_clean_scrub_stamp":"2023-12-12T10:12:12.929940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:29:09.752788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.942671+0000","last_change":"2023-12-12T10:12:09.833899+0000","last_active":"2023-12-12T10:12:13.942671+0000","last_peered":"2023-12-12T10:12:13.942671+0000","last_clean":"2023-12-12T10:12:13.942671+0000","last_became_active":"2023-12-12T10:12:09.833515+0000","last_became_peered":"2023-12-12T10:12:09.833515+0000","last_unstale":"2023-12-12T10:12:13.942671+0000","last_undegraded":"2023-12-12T10:12:13.942671+0000","last_fullsized":"2023-12-12T10:12:13.942671+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:05:45.545567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.961555+0000","last_change":"2023-12-12T10:12:08.831931+0000","last_active":"2023-12-12T10:12:13.961555+0000","last_peered":"2023-12-12T10:12:13.961555+0000","last_clean":"2023-12-12T10:12:13.961555+0000","last_became_active":"2023-12-12T10:12:08.831620+0000","last_became_peered":"2023-12-12T10:12:08.831620+0000","last_unstale":"2023-12-12T10:12:13.961555+0000","last_undegraded":"2023-12-12T10:12:13.961555+0000","last_fullsized":"2023-12-12T10:12:13.961555+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_clean_scrub_stamp":"2023-12-12T10:12:07.792253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:33:06.940791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-12T10:12:14.944543+0000","last_change":"2023-12-12T10:12:13.963213+0000","last_active":"2023-12-12T10:12:14.944543+0000","last_peered":"2023-12-12T10:12:14.944543+0000","last_clean":"2023-12-12T10:12:14.944543+0000","last_became_active":"2023-12-12T10:12:13.962745+0000","last_became_peered":"2023-12-12T10:12:13.962745+0000","last_unstale":"2023-12-12T10:12:14.944543+0000","last_undegraded":"2023-12-12T10:12:14.944543+0000","last_fullsized":"2023-12-12T10:12:14.944543+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_clean_scrub_stamp":"2023-12-12T10:12:12.929940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:46:01.637131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.943109+0000","last_change":"2023-12-12T10:12:09.836176+0000","last_active":"2023-12-12T10:12:13.943109+0000","last_peered":"2023-12-12T10:12:13.943109+0000","last_clean":"2023-12-12T10:12:13.943109+0000","last_became_active":"2023-12-12T10:12:09.835770+0000","last_became_peered":"2023-12-12T10:12:09.835770+0000","last_unstale":"2023-12-12T10:12:13.943109+0000","last_undegraded":"2023-12-12T10:12:13.943109+0000","last_fullsized":"2023-12-12T10:12:13.943109+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:47:44.969459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.960982+0000","last_change":"2023-12-12T10:12:08.837492+0000","last_active":"2023-12-12T10:12:13.960982+0000","last_peered":"2023-12-12T10:12:13.960982+0000","last_clean":"2023-12-12T10:12:13.960982+0000","last_became_active":"2023-12-12T10:12:08.836946+0000","last_became_peered":"2023-12-12T10:12:08.836946+0000","last_unstale":"2023-12-12T10:12:13.960982+0000","last_undegraded":"2023-12-12T10:12:13.960982+0000","last_fullsized":"2023-12-12T10:12:13.960982+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_clean_scrub_stamp":"2023-12-12T10:12:07.792253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:43:30.327223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-12T10:12:15.184876+0000","last_change":"2023-12-12T10:12:14.185717+0000","last_active":"2023-12-12T10:12:15.184876+0000","last_peered":"2023-12-12T10:12:15.184876+0000","last_clean":"2023-12-12T10:12:15.184876+0000","last_became_active":"2023-12-12T10:12:14.185270+0000","last_became_peered":"2023-12-12T10:12:14.185270+0000","last_unstale":"2023-12-12T10:12:15.184876+0000","last_undegraded":"2023-12-12T10:12:15.184876+0000","last_fullsized":"2023-12-12T10:12:15.184876+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_clean_scrub_stamp":"2023-12-12T10:12:12.929940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:51:46.510253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.944571+0000","last_change":"2023-12-12T10:12:09.833775+0000","last_active":"2023-12-12T10:12:13.944571+0000","last_peered":"2023-12-12T10:12:13.944571+0000","last_clean":"2023-12-12T10:12:13.944571+0000","last_became_active":"2023-12-12T10:12:09.829608+0000","last_became_peered":"2023-12-12T10:12:09.829608+0000","last_unstale":"2023-12-12T10:12:13.944571+0000","last_undegraded":"2023-12-12T10:12:13.944571+0000","last_fullsized":"2023-12-12T10:12:13.944571+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:15:32.896143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:14.178440+0000","last_change":"2023-12-12T10:12:08.845929+0000","last_active":"2023-12-12T10:12:14.178440+0000","last_peered":"2023-12-12T10:12:14.178440+0000","last_clean":"2023-12-12T10:12:14.178440+0000","last_became_active":"2023-12-12T10:12:08.845586+0000","last_became_peered":"2023-12-12T10:12:08.845586+0000","last_unstale":"2023-12-12T10:12:14.178440+0000","last_undegraded":"2023-12-12T10:12:14.178440+0000","last_fullsized":"2023-12-12T10:12:14.178440+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_clean_scrub_stamp":"2023-12-12T10:12:07.792253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:05:33.556015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-12T10:12:14.944863+0000","last_change":"2023-12-12T10:12:13.963219+0000","last_active":"2023-12-12T10:12:14.944863+0000","last_peered":"2023-12-12T10:12:14.944863+0000","last_clean":"2023-12-12T10:12:14.944863+0000","last_became_active":"2023-12-12T10:12:13.962713+0000","last_became_peered":"2023-12-12T10:12:13.962713+0000","last_unstale":"2023-12-12T10:12:14.944863+0000","last_undegraded":"2023-12-12T10:12:14.944863+0000","last_fullsized":"2023-12-12T10:12:14.944863+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_clean_scrub_stamp":"2023-12-12T10:12:12.929940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:06:56.749674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.958203+0000","last_change":"2023-12-12T10:12:09.827158+0000","last_active":"2023-12-12T10:12:13.958203+0000","last_peered":"2023-12-12T10:12:13.958203+0000","last_clean":"2023-12-12T10:12:13.958203+0000","last_became_active":"2023-12-12T10:12:09.826822+0000","last_became_peered":"2023-12-12T10:12:09.826822+0000","last_unstale":"2023-12-12T10:12:13.958203+0000","last_undegraded":"2023-12-12T10:12:13.958203+0000","last_fullsized":"2023-12-12T10:12:13.958203+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:59:46.622358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.945235+0000","last_change":"2023-12-12T10:12:08.838343+0000","last_active":"2023-12-12T10:12:13.945235+0000","last_peered":"2023-12-12T10:12:13.945235+0000","last_clean":"2023-12-12T10:12:13.945235+0000","last_became_active":"2023-12-12T10:12:08.837997+0000","last_became_peered":"2023-12-12T10:12:08.837997+0000","last_unstale":"2023-12-12T10:12:13.945235+0000","last_undegraded":"2023-12-12T10:12:13.945235+0000","last_fullsized":"2023-12-12T10:12:13.945235+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_clean_scrub_stamp":"2023-12-12T10:12:07.792253+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:33:06.940791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-12T10:12:14.943970+0000","last_change":"2023-12-12T10:12:14.185225+0000","last_active":"2023-12-12T10:12:14.943970+0000","last_peered":"2023-12-12T10:12:14.943970+0000","last_clean":"2023-12-12T10:12:14.943970+0000","last_became_active":"2023-12-12T10:12:14.184122+0000","last_became_peered":"2023-12-12T10:12:14.184122+0000","last_unstale":"2023-12-12T10:12:14.943970+0000","last_undegraded":"2023-12-12T10:12:14.943970+0000","last_fullsized":"2023-12-12T10:12:14.943970+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_clean_scrub_stamp":"2023-12-12T10:12:12.929940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:23:00.194289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.947211+0000","last_change":"2023-12-12T10:12:09.835201+0000","last_active":"2023-12-12T10:12:13.947211+0000","last_peered":"2023-12-12T10:12:13.947211+0000","last_clean":"2023-12-12T10:12:13.947211+0000","last_became_active":"2023-12-12T10:12:09.834701+0000","last_became_peered":"2023-12-12T10:12:09.834701+0000","last_unstale":"2023-12-12T10:12:13.947211+0000","last_undegraded":"2023-12-12T10:12:13.947211+0000","last_fullsized":"2023-12-12T10:12:13.947211+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T22:01:05.110732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.962519+0000","last_change":"2023-12-12T10:12:08.842442+0000","last_active":"2023-12-12T10:12:13.962519+0000","last_peered":"2023-12-12T10:12:13.962519+0000","last_clean":"2023-12-12T10:12:13.962519+0000","last_became_active":"2023-12-12T10:12:08.842125+0000","last_became_peered":"2023-12-12T10:12:08.842125+0000","last_unstale":"2023-12-12T10:12:13.962519+0000","last_undegraded":"2023-12-12T10:12:13.962519+0000","last_fullsized":"2023-12-12T10:12:13.962519+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_clean_scrub_stamp":"2023-12-12T10:12:07.792253+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:24:12.200595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-12T10:12:15.555651+0000","last_change":"2023-12-12T10:12:14.185748+0000","last_active":"2023-12-12T10:12:15.555651+0000","last_peered":"2023-12-12T10:12:15.555651+0000","last_clean":"2023-12-12T10:12:15.555651+0000","last_became_active":"2023-12-12T10:12:14.185262+0000","last_became_peered":"2023-12-12T10:12:14.185262+0000","last_unstale":"2023-12-12T10:12:15.555651+0000","last_undegraded":"2023-12-12T10:12:15.555651+0000","last_fullsized":"2023-12-12T10:12:15.555651+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_clean_scrub_stamp":"2023-12-12T10:12:12.929940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:46:26.737660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.961127+0000","last_change":"2023-12-12T10:12:09.837089+0000","last_active":"2023-12-12T10:12:13.961127+0000","last_peered":"2023-12-12T10:12:13.961127+0000","last_clean":"2023-12-12T10:12:13.961127+0000","last_became_active":"2023-12-12T10:12:09.829551+0000","last_became_peered":"2023-12-12T10:12:09.829551+0000","last_unstale":"2023-12-12T10:12:13.961127+0000","last_undegraded":"2023-12-12T10:12:13.961127+0000","last_fullsized":"2023-12-12T10:12:13.961127+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:59:46.622358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:14.179291+0000","last_change":"2023-12-12T10:12:08.845099+0000","last_active":"2023-12-12T10:12:14.179291+0000","last_peered":"2023-12-12T10:12:14.179291+0000","last_clean":"2023-12-12T10:12:14.179291+0000","last_became_active":"2023-12-12T10:12:08.844823+0000","last_became_peered":"2023-12-12T10:12:08.844823+0000","last_unstale":"2023-12-12T10:12:14.179291+0000","last_undegraded":"2023-12-12T10:12:14.179291+0000","last_fullsized":"2023-12-12T10:12:14.179291+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_clean_scrub_stamp":"2023-12-12T10:12:07.792253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:42:16.450226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-12T10:12:15.556125+0000","last_change":"2023-12-12T10:12:14.182644+0000","last_active":"2023-12-12T10:12:15.556125+0000","last_peered":"2023-12-12T10:12:15.556125+0000","last_clean":"2023-12-12T10:12:15.556125+0000","last_became_active":"2023-12-12T10:12:14.182230+0000","last_became_peered":"2023-12-12T10:12:14.182230+0000","last_unstale":"2023-12-12T10:12:15.556125+0000","last_undegraded":"2023-12-12T10:12:15.556125+0000","last_fullsized":"2023-12-12T10:12:15.556125+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_clean_scrub_stamp":"2023-12-12T10:12:12.929940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:29:09.752788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.955037+0000","last_change":"2023-12-12T10:12:09.840836+0000","last_active":"2023-12-12T10:12:13.955037+0000","last_peered":"2023-12-12T10:12:13.955037+0000","last_clean":"2023-12-12T10:12:13.955037+0000","last_became_active":"2023-12-12T10:12:09.840219+0000","last_became_peered":"2023-12-12T10:12:09.840219+0000","last_unstale":"2023-12-12T10:12:13.955037+0000","last_undegraded":"2023-12-12T10:12:13.955037+0000","last_fullsized":"2023-12-12T10:12:13.955037+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:03:50.236121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.961215+0000","last_change":"2023-12-12T10:12:08.829665+0000","last_active":"2023-12-12T10:12:13.961215+0000","last_peered":"2023-12-12T10:12:13.961215+0000","last_clean":"2023-12-12T10:12:13.961215+0000","last_became_active":"2023-12-12T10:12:08.829433+0000","last_became_peered":"2023-12-12T10:12:08.829433+0000","last_unstale":"2023-12-12T10:12:13.961215+0000","last_undegraded":"2023-12-12T10:12:13.961215+0000","last_fullsized":"2023-12-12T10:12:13.961215+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_clean_scrub_stamp":"2023-12-12T10:12:07.792253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:41:37.226888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-12T10:12:15.184185+0000","last_change":"2023-12-12T10:12:13.973841+0000","last_active":"2023-12-12T10:12:15.184185+0000","last_peered":"2023-12-12T10:12:15.184185+0000","last_clean":"2023-12-12T10:12:15.184185+0000","last_became_active":"2023-12-12T10:12:13.973435+0000","last_became_peered":"2023-12-12T10:12:13.973435+0000","last_unstale":"2023-12-12T10:12:15.184185+0000","last_undegraded":"2023-12-12T10:12:15.184185+0000","last_fullsized":"2023-12-12T10:12:15.184185+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_clean_scrub_stamp":"2023-12-12T10:12:12.929940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:11:19.241925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.946358+0000","last_change":"2023-12-12T10:12:09.823582+0000","last_active":"2023-12-12T10:12:13.946358+0000","last_peered":"2023-12-12T10:12:13.946358+0000","last_clean":"2023-12-12T10:12:13.946358+0000","last_became_active":"2023-12-12T10:12:09.823307+0000","last_became_peered":"2023-12-12T10:12:09.823307+0000","last_unstale":"2023-12-12T10:12:13.946358+0000","last_undegraded":"2023-12-12T10:12:13.946358+0000","last_fullsized":"2023-12-12T10:12:13.946358+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:41:38.233640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.955628+0000","last_change":"2023-12-12T10:12:08.828970+0000","last_active":"2023-12-12T10:12:13.955628+0000","last_peered":"2023-12-12T10:12:13.955628+0000","last_clean":"2023-12-12T10:12:13.955628+0000","last_became_active":"2023-12-12T10:12:08.828622+0000","last_became_peered":"2023-12-12T10:12:08.828622+0000","last_unstale":"2023-12-12T10:12:13.955628+0000","last_undegraded":"2023-12-12T10:12:13.955628+0000","last_fullsized":"2023-12-12T10:12:13.955628+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_clean_scrub_stamp":"2023-12-12T10:12:07.792253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:05:44.538814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-12T10:12:15.184498+0000","last_change":"2023-12-12T10:12:13.971217+0000","last_active":"2023-12-12T10:12:15.184498+0000","last_peered":"2023-12-12T10:12:15.184498+0000","last_clean":"2023-12-12T10:12:15.184498+0000","last_became_active":"2023-12-12T10:12:13.970691+0000","last_became_peered":"2023-12-12T10:12:13.970691+0000","last_unstale":"2023-12-12T10:12:15.184498+0000","last_undegraded":"2023-12-12T10:12:15.184498+0000","last_fullsized":"2023-12-12T10:12:15.184498+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_clean_scrub_stamp":"2023-12-12T10:12:12.929940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:03:54.367055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.962282+0000","last_change":"2023-12-12T10:12:09.832708+0000","last_active":"2023-12-12T10:12:13.962282+0000","last_peered":"2023-12-12T10:12:13.962282+0000","last_clean":"2023-12-12T10:12:13.962282+0000","last_became_active":"2023-12-12T10:12:09.832344+0000","last_became_peered":"2023-12-12T10:12:09.832344+0000","last_unstale":"2023-12-12T10:12:13.962282+0000","last_undegraded":"2023-12-12T10:12:13.962282+0000","last_fullsized":"2023-12-12T10:12:13.962282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:14:22.581107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.965330+0000","last_change":"2023-12-12T10:12:08.837019+0000","last_active":"2023-12-12T10:12:13.965330+0000","last_peered":"2023-12-12T10:12:13.965330+0000","last_clean":"2023-12-12T10:12:13.965330+0000","last_became_active":"2023-12-12T10:12:08.832265+0000","last_became_peered":"2023-12-12T10:12:08.832265+0000","last_unstale":"2023-12-12T10:12:13.965330+0000","last_undegraded":"2023-12-12T10:12:13.965330+0000","last_fullsized":"2023-12-12T10:12:13.965330+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_clean_scrub_stamp":"2023-12-12T10:12:07.792253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:18:36.840178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-12T10:12:15.184922+0000","last_change":"2023-12-12T10:12:13.973617+0000","last_active":"2023-12-12T10:12:15.184922+0000","last_peered":"2023-12-12T10:12:15.184922+0000","last_clean":"2023-12-12T10:12:15.184922+0000","last_became_active":"2023-12-12T10:12:13.973205+0000","last_became_peered":"2023-12-12T10:12:13.973205+0000","last_unstale":"2023-12-12T10:12:15.184922+0000","last_undegraded":"2023-12-12T10:12:15.184922+0000","last_fullsized":"2023-12-12T10:12:15.184922+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_clean_scrub_stamp":"2023-12-12T10:12:12.929940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:39:57.689735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.954974+0000","last_change":"2023-12-12T10:12:09.825813+0000","last_active":"2023-12-12T10:12:13.954974+0000","last_peered":"2023-12-12T10:12:13.954974+0000","last_clean":"2023-12-12T10:12:13.954974+0000","last_became_active":"2023-12-12T10:12:09.824750+0000","last_became_peered":"2023-12-12T10:12:09.824750+0000","last_unstale":"2023-12-12T10:12:13.954974+0000","last_undegraded":"2023-12-12T10:12:13.954974+0000","last_fullsized":"2023-12-12T10:12:13.954974+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:22:27.554110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:14.178474+0000","last_change":"2023-12-12T10:12:08.843140+0000","last_active":"2023-12-12T10:12:14.178474+0000","last_peered":"2023-12-12T10:12:14.178474+0000","last_clean":"2023-12-12T10:12:14.178474+0000","last_became_active":"2023-12-12T10:12:08.842860+0000","last_became_peered":"2023-12-12T10:12:08.842860+0000","last_unstale":"2023-12-12T10:12:14.178474+0000","last_undegraded":"2023-12-12T10:12:14.178474+0000","last_fullsized":"2023-12-12T10:12:14.178474+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_clean_scrub_stamp":"2023-12-12T10:12:07.792253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:18:36.840178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-12T10:12:15.557319+0000","last_change":"2023-12-12T10:12:14.186432+0000","last_active":"2023-12-12T10:12:15.557319+0000","last_peered":"2023-12-12T10:12:15.557319+0000","last_clean":"2023-12-12T10:12:15.557319+0000","last_became_active":"2023-12-12T10:12:14.185836+0000","last_became_peered":"2023-12-12T10:12:14.185836+0000","last_unstale":"2023-12-12T10:12:15.557319+0000","last_undegraded":"2023-12-12T10:12:15.557319+0000","last_fullsized":"2023-12-12T10:12:15.557319+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_clean_scrub_stamp":"2023-12-12T10:12:12.929940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:51:46.510253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.942873+0000","last_change":"2023-12-12T10:12:09.837891+0000","last_active":"2023-12-12T10:12:13.942873+0000","last_peered":"2023-12-12T10:12:13.942873+0000","last_clean":"2023-12-12T10:12:13.942873+0000","last_became_active":"2023-12-12T10:12:09.837628+0000","last_became_peered":"2023-12-12T10:12:09.837628+0000","last_unstale":"2023-12-12T10:12:13.942873+0000","last_undegraded":"2023-12-12T10:12:13.942873+0000","last_fullsized":"2023-12-12T10:12:13.942873+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:24:13.207348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.954955+0000","last_change":"2023-12-12T10:12:08.828997+0000","last_active":"2023-12-12T10:12:13.954955+0000","last_peered":"2023-12-12T10:12:13.954955+0000","last_clean":"2023-12-12T10:12:13.954955+0000","last_became_active":"2023-12-12T10:12:08.828551+0000","last_became_peered":"2023-12-12T10:12:08.828551+0000","last_unstale":"2023-12-12T10:12:13.954955+0000","last_undegraded":"2023-12-12T10:12:13.954955+0000","last_fullsized":"2023-12-12T10:12:13.954955+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_clean_scrub_stamp":"2023-12-12T10:12:07.792253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:24:12.200595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":169,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:14.178565+0000","last_change":"2023-12-12T10:11:58.492812+0000","last_active":"2023-12-12T10:12:14.178565+0000","last_peered":"2023-12-12T10:12:14.178565+0000","last_clean":"2023-12-12T10:12:14.178565+0000","last_became_active":"2023-12-12T10:11:58.491470+0000","last_became_peered":"2023-12-12T10:11:58.491470+0000","last_unstale":"2023-12-12T10:12:14.178565+0000","last_undegraded":"2023-12-12T10:12:14.178565+0000","last_fullsized":"2023-12-12T10:12:14.178565+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:11:57.289641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:11:57.289641+0000","last_clean_scrub_stamp":"2023-12-12T10:11:57.289641+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:10:37.809139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-12T10:12:14.943985+0000","last_change":"2023-12-12T10:12:14.184491+0000","last_active":"2023-12-12T10:12:14.943985+0000","last_peered":"2023-12-12T10:12:14.943985+0000","last_clean":"2023-12-12T10:12:14.943985+0000","last_became_active":"2023-12-12T10:12:14.183538+0000","last_became_peered":"2023-12-12T10:12:14.183538+0000","last_unstale":"2023-12-12T10:12:14.943985+0000","last_undegraded":"2023-12-12T10:12:14.943985+0000","last_fullsized":"2023-12-12T10:12:14.943985+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_clean_scrub_stamp":"2023-12-12T10:12:12.929940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:06:56.749674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:14.178883+0000","last_change":"2023-12-12T10:12:09.848681+0000","last_active":"2023-12-12T10:12:14.178883+0000","last_peered":"2023-12-12T10:12:14.178883+0000","last_clean":"2023-12-12T10:12:14.178883+0000","last_became_active":"2023-12-12T10:12:09.848381+0000","last_became_peered":"2023-12-12T10:12:09.848381+0000","last_unstale":"2023-12-12T10:12:14.178883+0000","last_undegraded":"2023-12-12T10:12:14.178883+0000","last_fullsized":"2023-12-12T10:12:14.178883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:45:57.506196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.966788+0000","last_change":"2023-12-12T10:12:08.831000+0000","last_active":"2023-12-12T10:12:13.966788+0000","last_peered":"2023-12-12T10:12:13.966788+0000","last_clean":"2023-12-12T10:12:13.966788+0000","last_became_active":"2023-12-12T10:12:08.830638+0000","last_became_peered":"2023-12-12T10:12:08.830638+0000","last_unstale":"2023-12-12T10:12:13.966788+0000","last_undegraded":"2023-12-12T10:12:13.966788+0000","last_fullsized":"2023-12-12T10:12:13.966788+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_clean_scrub_stamp":"2023-12-12T10:12:07.792253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:15:31.889391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-12T10:12:14.943486+0000","last_change":"2023-12-12T10:12:14.183763+0000","last_active":"2023-12-12T10:12:14.943486+0000","last_peered":"2023-12-12T10:12:14.943486+0000","last_clean":"2023-12-12T10:12:14.943486+0000","last_became_active":"2023-12-12T10:12:14.183320+0000","last_became_peered":"2023-12-12T10:12:14.183320+0000","last_unstale":"2023-12-12T10:12:14.943486+0000","last_undegraded":"2023-12-12T10:12:14.943486+0000","last_fullsized":"2023-12-12T10:12:14.943486+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_clean_scrub_stamp":"2023-12-12T10:12:12.929940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:46:01.637131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.954867+0000","last_change":"2023-12-12T10:12:09.843426+0000","last_active":"2023-12-12T10:12:13.954867+0000","last_peered":"2023-12-12T10:12:13.954867+0000","last_clean":"2023-12-12T10:12:13.954867+0000","last_became_active":"2023-12-12T10:12:09.841783+0000","last_became_peered":"2023-12-12T10:12:09.841783+0000","last_unstale":"2023-12-12T10:12:13.954867+0000","last_undegraded":"2023-12-12T10:12:13.954867+0000","last_fullsized":"2023-12-12T10:12:13.954867+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:29:05.621853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.963537+0000","last_change":"2023-12-12T10:12:08.835533+0000","last_active":"2023-12-12T10:12:13.963537+0000","last_peered":"2023-12-12T10:12:13.963537+0000","last_clean":"2023-12-12T10:12:13.963537+0000","last_became_active":"2023-12-12T10:12:08.835230+0000","last_became_peered":"2023-12-12T10:12:08.835230+0000","last_unstale":"2023-12-12T10:12:13.963537+0000","last_undegraded":"2023-12-12T10:12:13.963537+0000","last_fullsized":"2023-12-12T10:12:13.963537+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_clean_scrub_stamp":"2023-12-12T10:12:07.792253+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:50:55.983027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-12T10:12:15.556326+0000","last_change":"2023-12-12T10:12:13.968062+0000","last_active":"2023-12-12T10:12:15.556326+0000","last_peered":"2023-12-12T10:12:15.556326+0000","last_clean":"2023-12-12T10:12:15.556326+0000","last_became_active":"2023-12-12T10:12:13.967558+0000","last_became_peered":"2023-12-12T10:12:13.967558+0000","last_unstale":"2023-12-12T10:12:15.556326+0000","last_undegraded":"2023-12-12T10:12:15.556326+0000","last_fullsized":"2023-12-12T10:12:15.556326+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_clean_scrub_stamp":"2023-12-12T10:12:12.929940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:11:19.241925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:14.179682+0000","last_change":"2023-12-12T10:12:09.840613+0000","last_active":"2023-12-12T10:12:14.179682+0000","last_peered":"2023-12-12T10:12:14.179682+0000","last_clean":"2023-12-12T10:12:14.179682+0000","last_became_active":"2023-12-12T10:12:09.840305+0000","last_became_peered":"2023-12-12T10:12:09.840305+0000","last_unstale":"2023-12-12T10:12:14.179682+0000","last_undegraded":"2023-12-12T10:12:14.179682+0000","last_fullsized":"2023-12-12T10:12:14.179682+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:39:53.558801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.967272+0000","last_change":"2023-12-12T10:12:08.832234+0000","last_active":"2023-12-12T10:12:13.967272+0000","last_peered":"2023-12-12T10:12:13.967272+0000","last_clean":"2023-12-12T10:12:13.967272+0000","last_became_active":"2023-12-12T10:12:08.831933+0000","last_became_peered":"2023-12-12T10:12:08.831933+0000","last_unstale":"2023-12-12T10:12:13.967272+0000","last_undegraded":"2023-12-12T10:12:13.967272+0000","last_fullsized":"2023-12-12T10:12:13.967272+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_clean_scrub_stamp":"2023-12-12T10:12:07.792253+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:05:33.556015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-12T10:12:15.553874+0000","last_change":"2023-12-12T10:12:14.181013+0000","last_active":"2023-12-12T10:12:15.553874+0000","last_peered":"2023-12-12T10:12:15.553874+0000","last_clean":"2023-12-12T10:12:15.553874+0000","last_became_active":"2023-12-12T10:12:14.180237+0000","last_became_peered":"2023-12-12T10:12:14.180237+0000","last_unstale":"2023-12-12T10:12:15.553874+0000","last_undegraded":"2023-12-12T10:12:15.553874+0000","last_fullsized":"2023-12-12T10:12:15.553874+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_clean_scrub_stamp":"2023-12-12T10:12:12.929940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:41:41.466318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:14.179468+0000","last_change":"2023-12-12T10:12:09.843023+0000","last_active":"2023-12-12T10:12:14.179468+0000","last_peered":"2023-12-12T10:12:14.179468+0000","last_clean":"2023-12-12T10:12:14.179468+0000","last_became_active":"2023-12-12T10:12:09.839541+0000","last_became_peered":"2023-12-12T10:12:09.839541+0000","last_unstale":"2023-12-12T10:12:14.179468+0000","last_undegraded":"2023-12-12T10:12:14.179468+0000","last_fullsized":"2023-12-12T10:12:14.179468+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:11:15.110991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.947354+0000","last_change":"2023-12-12T10:12:08.837170+0000","last_active":"2023-12-12T10:12:13.947354+0000","last_peered":"2023-12-12T10:12:13.947354+0000","last_clean":"2023-12-12T10:12:13.947354+0000","last_became_active":"2023-12-12T10:12:08.836870+0000","last_became_peered":"2023-12-12T10:12:08.836870+0000","last_unstale":"2023-12-12T10:12:13.947354+0000","last_undegraded":"2023-12-12T10:12:13.947354+0000","last_fullsized":"2023-12-12T10:12:13.947354+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_clean_scrub_stamp":"2023-12-12T10:12:07.792253+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:02:02.748317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-12T10:12:14.943477+0000","last_change":"2023-12-12T10:12:13.961169+0000","last_active":"2023-12-12T10:12:14.943477+0000","last_peered":"2023-12-12T10:12:14.943477+0000","last_clean":"2023-12-12T10:12:14.943477+0000","last_became_active":"2023-12-12T10:12:13.960747+0000","last_became_peered":"2023-12-12T10:12:13.960747+0000","last_unstale":"2023-12-12T10:12:14.943477+0000","last_undegraded":"2023-12-12T10:12:14.943477+0000","last_fullsized":"2023-12-12T10:12:14.943477+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_clean_scrub_stamp":"2023-12-12T10:12:12.929940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:42:21.587913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:14.178613+0000","last_change":"2023-12-12T10:12:09.840229+0000","last_active":"2023-12-12T10:12:14.178613+0000","last_peered":"2023-12-12T10:12:14.178613+0000","last_clean":"2023-12-12T10:12:14.178613+0000","last_became_active":"2023-12-12T10:12:09.839022+0000","last_became_peered":"2023-12-12T10:12:09.839022+0000","last_unstale":"2023-12-12T10:12:14.178613+0000","last_undegraded":"2023-12-12T10:12:14.178613+0000","last_fullsized":"2023-12-12T10:12:14.178613+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:22:56.063355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.965950+0000","last_change":"2023-12-12T10:12:08.826707+0000","last_active":"2023-12-12T10:12:13.965950+0000","last_peered":"2023-12-12T10:12:13.965950+0000","last_clean":"2023-12-12T10:12:13.965950+0000","last_became_active":"2023-12-12T10:12:08.826379+0000","last_became_peered":"2023-12-12T10:12:08.826379+0000","last_unstale":"2023-12-12T10:12:13.965950+0000","last_undegraded":"2023-12-12T10:12:13.965950+0000","last_fullsized":"2023-12-12T10:12:13.965950+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_clean_scrub_stamp":"2023-12-12T10:12:07.792253+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:02:02.748317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-12T10:12:15.557190+0000","last_change":"2023-12-12T10:12:13.978141+0000","last_active":"2023-12-12T10:12:15.557190+0000","last_peered":"2023-12-12T10:12:15.557190+0000","last_clean":"2023-12-12T10:12:15.557190+0000","last_became_active":"2023-12-12T10:12:13.975903+0000","last_became_peered":"2023-12-12T10:12:13.975903+0000","last_unstale":"2023-12-12T10:12:15.557190+0000","last_undegraded":"2023-12-12T10:12:15.557190+0000","last_fullsized":"2023-12-12T10:12:15.557190+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_clean_scrub_stamp":"2023-12-12T10:12:12.929940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:03:54.367055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.945635+0000","last_change":"2023-12-12T10:12:09.823042+0000","last_active":"2023-12-12T10:12:13.945635+0000","last_peered":"2023-12-12T10:12:13.945635+0000","last_clean":"2023-12-12T10:12:13.945635+0000","last_became_active":"2023-12-12T10:12:09.822372+0000","last_became_peered":"2023-12-12T10:12:09.822372+0000","last_unstale":"2023-12-12T10:12:13.945635+0000","last_undegraded":"2023-12-12T10:12:13.945635+0000","last_fullsized":"2023-12-12T10:12:13.945635+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:05:45.545567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.949351+0000","last_change":"2023-12-12T10:12:08.831259+0000","last_active":"2023-12-12T10:12:13.949351+0000","last_peered":"2023-12-12T10:12:13.949351+0000","last_clean":"2023-12-12T10:12:13.949351+0000","last_became_active":"2023-12-12T10:12:08.830921+0000","last_became_peered":"2023-12-12T10:12:08.830921+0000","last_unstale":"2023-12-12T10:12:13.949351+0000","last_undegraded":"2023-12-12T10:12:13.949351+0000","last_fullsized":"2023-12-12T10:12:13.949351+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_clean_scrub_stamp":"2023-12-12T10:12:07.792253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:01:42.240854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-12T10:12:15.556830+0000","last_change":"2023-12-12T10:12:14.186089+0000","last_active":"2023-12-12T10:12:15.556830+0000","last_peered":"2023-12-12T10:12:15.556830+0000","last_clean":"2023-12-12T10:12:15.556830+0000","last_became_active":"2023-12-12T10:12:14.185616+0000","last_became_peered":"2023-12-12T10:12:14.185616+0000","last_unstale":"2023-12-12T10:12:15.556830+0000","last_undegraded":"2023-12-12T10:12:15.556830+0000","last_fullsized":"2023-12-12T10:12:15.556830+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_clean_scrub_stamp":"2023-12-12T10:12:12.929940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:44:39.253218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:14.178766+0000","last_change":"2023-12-12T10:12:09.839119+0000","last_active":"2023-12-12T10:12:14.178766+0000","last_peered":"2023-12-12T10:12:14.178766+0000","last_clean":"2023-12-12T10:12:14.178766+0000","last_became_active":"2023-12-12T10:12:09.838832+0000","last_became_peered":"2023-12-12T10:12:09.838832+0000","last_unstale":"2023-12-12T10:12:14.178766+0000","last_undegraded":"2023-12-12T10:12:14.178766+0000","last_fullsized":"2023-12-12T10:12:14.178766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:06:52.618740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.955540+0000","last_change":"2023-12-12T10:12:08.832946+0000","last_active":"2023-12-12T10:12:13.955540+0000","last_peered":"2023-12-12T10:12:13.955540+0000","last_clean":"2023-12-12T10:12:13.955540+0000","last_became_active":"2023-12-12T10:12:08.832657+0000","last_became_peered":"2023-12-12T10:12:08.832657+0000","last_unstale":"2023-12-12T10:12:13.955540+0000","last_undegraded":"2023-12-12T10:12:13.955540+0000","last_fullsized":"2023-12-12T10:12:13.955540+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_clean_scrub_stamp":"2023-12-12T10:12:07.792253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:45:52.005263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-12T10:12:15.556971+0000","last_change":"2023-12-12T10:12:14.183490+0000","last_active":"2023-12-12T10:12:15.556971+0000","last_peered":"2023-12-12T10:12:15.556971+0000","last_clean":"2023-12-12T10:12:15.556971+0000","last_became_active":"2023-12-12T10:12:14.182333+0000","last_became_peered":"2023-12-12T10:12:14.182333+0000","last_unstale":"2023-12-12T10:12:15.556971+0000","last_undegraded":"2023-12-12T10:12:15.556971+0000","last_fullsized":"2023-12-12T10:12:15.556971+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_clean_scrub_stamp":"2023-12-12T10:12:12.929940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:04:36.664695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.954813+0000","last_change":"2023-12-12T10:12:09.829410+0000","last_active":"2023-12-12T10:12:13.954813+0000","last_peered":"2023-12-12T10:12:13.954813+0000","last_clean":"2023-12-12T10:12:13.954813+0000","last_became_active":"2023-12-12T10:12:09.829144+0000","last_became_peered":"2023-12-12T10:12:09.829144+0000","last_unstale":"2023-12-12T10:12:13.954813+0000","last_undegraded":"2023-12-12T10:12:13.954813+0000","last_fullsized":"2023-12-12T10:12:13.954813+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:33:07.947544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.956073+0000","last_change":"2023-12-12T10:12:08.840254+0000","last_active":"2023-12-12T10:12:13.956073+0000","last_peered":"2023-12-12T10:12:13.956073+0000","last_clean":"2023-12-12T10:12:13.956073+0000","last_became_active":"2023-12-12T10:12:08.839962+0000","last_became_peered":"2023-12-12T10:12:08.839962+0000","last_unstale":"2023-12-12T10:12:13.956073+0000","last_undegraded":"2023-12-12T10:12:13.956073+0000","last_fullsized":"2023-12-12T10:12:13.956073+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_clean_scrub_stamp":"2023-12-12T10:12:07.792253+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:46:36.023306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-12T10:12:15.554704+0000","last_change":"2023-12-12T10:12:14.180551+0000","last_active":"2023-12-12T10:12:15.554704+0000","last_peered":"2023-12-12T10:12:15.554704+0000","last_clean":"2023-12-12T10:12:15.554704+0000","last_became_active":"2023-12-12T10:12:14.180147+0000","last_became_peered":"2023-12-12T10:12:14.180147+0000","last_unstale":"2023-12-12T10:12:15.554704+0000","last_undegraded":"2023-12-12T10:12:15.554704+0000","last_fullsized":"2023-12-12T10:12:15.554704+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_clean_scrub_stamp":"2023-12-12T10:12:12.929940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:46:26.737660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:14.178878+0000","last_change":"2023-12-12T10:12:09.840271+0000","last_active":"2023-12-12T10:12:14.178878+0000","last_peered":"2023-12-12T10:12:14.178878+0000","last_clean":"2023-12-12T10:12:14.178878+0000","last_became_active":"2023-12-12T10:12:09.839285+0000","last_became_peered":"2023-12-12T10:12:09.839285+0000","last_unstale":"2023-12-12T10:12:14.178878+0000","last_undegraded":"2023-12-12T10:12:14.178878+0000","last_fullsized":"2023-12-12T10:12:14.178878+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:08:12.099242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-12T10:12:20.479837+0000","last_change":"2023-12-12T10:12:08.833712+0000","last_active":"2023-12-12T10:12:20.479837+0000","last_peered":"2023-12-12T10:12:20.479837+0000","last_clean":"2023-12-12T10:12:20.479837+0000","last_became_active":"2023-12-12T10:12:08.833335+0000","last_became_peered":"2023-12-12T10:12:08.833335+0000","last_unstale":"2023-12-12T10:12:20.479837+0000","last_undegraded":"2023-12-12T10:12:20.479837+0000","last_fullsized":"2023-12-12T10:12:20.479837+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_clean_scrub_stamp":"2023-12-12T10:12:07.792253+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:41:37.226888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3839,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-12T10:12:15.184374+0000","last_change":"2023-12-12T10:12:13.969124+0000","last_active":"2023-12-12T10:12:15.184374+0000","last_peered":"2023-12-12T10:12:15.184374+0000","last_clean":"2023-12-12T10:12:15.184374+0000","last_became_active":"2023-12-12T10:12:13.968588+0000","last_became_peered":"2023-12-12T10:12:13.968588+0000","last_unstale":"2023-12-12T10:12:15.184374+0000","last_undegraded":"2023-12-12T10:12:15.184374+0000","last_fullsized":"2023-12-12T10:12:15.184374+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_clean_scrub_stamp":"2023-12-12T10:12:12.929940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:17:23.880191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.947087+0000","last_change":"2023-12-12T10:12:09.836126+0000","last_active":"2023-12-12T10:12:13.947087+0000","last_peered":"2023-12-12T10:12:13.947087+0000","last_clean":"2023-12-12T10:12:13.947087+0000","last_became_active":"2023-12-12T10:12:09.835866+0000","last_became_peered":"2023-12-12T10:12:09.835866+0000","last_unstale":"2023-12-12T10:12:13.947087+0000","last_undegraded":"2023-12-12T10:12:13.947087+0000","last_fullsized":"2023-12-12T10:12:13.947087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:01:43.247607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.963472+0000","last_change":"2023-12-12T10:12:08.835844+0000","last_active":"2023-12-12T10:12:13.963472+0000","last_peered":"2023-12-12T10:12:13.963472+0000","last_clean":"2023-12-12T10:12:13.963472+0000","last_became_active":"2023-12-12T10:12:08.835523+0000","last_became_peered":"2023-12-12T10:12:08.835523+0000","last_unstale":"2023-12-12T10:12:13.963472+0000","last_undegraded":"2023-12-12T10:12:13.963472+0000","last_fullsized":"2023-12-12T10:12:13.963472+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_clean_scrub_stamp":"2023-12-12T10:12:07.792253+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:22:26.547358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-12T10:12:14.944351+0000","last_change":"2023-12-12T10:12:13.963846+0000","last_active":"2023-12-12T10:12:14.944351+0000","last_peered":"2023-12-12T10:12:14.944351+0000","last_clean":"2023-12-12T10:12:14.944351+0000","last_became_active":"2023-12-12T10:12:13.963343+0000","last_became_peered":"2023-12-12T10:12:13.963343+0000","last_unstale":"2023-12-12T10:12:14.944351+0000","last_undegraded":"2023-12-12T10:12:14.944351+0000","last_fullsized":"2023-12-12T10:12:14.944351+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_clean_scrub_stamp":"2023-12-12T10:12:12.929940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:47:49.100393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.957119+0000","last_change":"2023-12-12T10:12:09.846702+0000","last_active":"2023-12-12T10:12:13.957119+0000","last_peered":"2023-12-12T10:12:13.957119+0000","last_clean":"2023-12-12T10:12:13.957119+0000","last_became_active":"2023-12-12T10:12:09.846459+0000","last_became_peered":"2023-12-12T10:12:09.846459+0000","last_unstale":"2023-12-12T10:12:13.957119+0000","last_undegraded":"2023-12-12T10:12:13.957119+0000","last_fullsized":"2023-12-12T10:12:13.957119+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:42:17.456979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.955160+0000","last_change":"2023-12-12T10:12:08.843421+0000","last_active":"2023-12-12T10:12:13.955160+0000","last_peered":"2023-12-12T10:12:13.955160+0000","last_clean":"2023-12-12T10:12:13.955160+0000","last_became_active":"2023-12-12T10:12:08.843122+0000","last_became_peered":"2023-12-12T10:12:08.843122+0000","last_unstale":"2023-12-12T10:12:13.955160+0000","last_undegraded":"2023-12-12T10:12:13.955160+0000","last_fullsized":"2023-12-12T10:12:13.955160+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_clean_scrub_stamp":"2023-12-12T10:12:07.792253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:59:45.615605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-12T10:12:15.555918+0000","last_change":"2023-12-12T10:12:13.964875+0000","last_active":"2023-12-12T10:12:15.555918+0000","last_peered":"2023-12-12T10:12:15.555918+0000","last_clean":"2023-12-12T10:12:15.555918+0000","last_became_active":"2023-12-12T10:12:13.964323+0000","last_became_peered":"2023-12-12T10:12:13.964323+0000","last_unstale":"2023-12-12T10:12:15.555918+0000","last_undegraded":"2023-12-12T10:12:15.555918+0000","last_fullsized":"2023-12-12T10:12:15.555918+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_clean_scrub_stamp":"2023-12-12T10:12:12.929940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:35:07.230080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.955023+0000","last_change":"2023-12-12T10:12:09.846552+0000","last_active":"2023-12-12T10:12:13.955023+0000","last_peered":"2023-12-12T10:12:13.955023+0000","last_clean":"2023-12-12T10:12:13.955023+0000","last_became_active":"2023-12-12T10:12:09.844321+0000","last_became_peered":"2023-12-12T10:12:09.844321+0000","last_unstale":"2023-12-12T10:12:13.955023+0000","last_undegraded":"2023-12-12T10:12:13.955023+0000","last_fullsized":"2023-12-12T10:12:13.955023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:47:44.969459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.945152+0000","last_change":"2023-12-12T10:12:08.833577+0000","last_active":"2023-12-12T10:12:13.945152+0000","last_peered":"2023-12-12T10:12:13.945152+0000","last_clean":"2023-12-12T10:12:13.945152+0000","last_became_active":"2023-12-12T10:12:08.833266+0000","last_became_peered":"2023-12-12T10:12:08.833266+0000","last_unstale":"2023-12-12T10:12:13.945152+0000","last_undegraded":"2023-12-12T10:12:13.945152+0000","last_fullsized":"2023-12-12T10:12:13.945152+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_clean_scrub_stamp":"2023-12-12T10:12:07.792253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:50:55.983027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-12T10:12:15.555695+0000","last_change":"2023-12-12T10:12:14.187838+0000","last_active":"2023-12-12T10:12:15.555695+0000","last_peered":"2023-12-12T10:12:15.555695+0000","last_clean":"2023-12-12T10:12:15.555695+0000","last_became_active":"2023-12-12T10:12:14.187430+0000","last_became_peered":"2023-12-12T10:12:14.187430+0000","last_unstale":"2023-12-12T10:12:15.555695+0000","last_undegraded":"2023-12-12T10:12:15.555695+0000","last_fullsized":"2023-12-12T10:12:15.555695+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_clean_scrub_stamp":"2023-12-12T10:12:12.929940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:10:11.022165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-12T10:12:15.557056+0000","last_change":"2023-12-12T10:12:14.186204+0000","last_active":"2023-12-12T10:12:15.557056+0000","last_peered":"2023-12-12T10:12:15.557056+0000","last_clean":"2023-12-12T10:12:15.557056+0000","last_became_active":"2023-12-12T10:12:14.185264+0000","last_became_peered":"2023-12-12T10:12:14.185264+0000","last_unstale":"2023-12-12T10:12:15.557056+0000","last_undegraded":"2023-12-12T10:12:15.557056+0000","last_fullsized":"2023-12-12T10:12:15.557056+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_clean_scrub_stamp":"2023-12-12T10:12:12.929940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:17:23.880191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.960807+0000","last_change":"2023-12-12T10:12:09.829976+0000","last_active":"2023-12-12T10:12:13.960807+0000","last_peered":"2023-12-12T10:12:13.960807+0000","last_clean":"2023-12-12T10:12:13.960807+0000","last_became_active":"2023-12-12T10:12:09.829573+0000","last_became_peered":"2023-12-12T10:12:09.829573+0000","last_unstale":"2023-12-12T10:12:13.960807+0000","last_undegraded":"2023-12-12T10:12:13.960807+0000","last_fullsized":"2023-12-12T10:12:13.960807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:05:45.545567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.954582+0000","last_change":"2023-12-12T10:12:08.820896+0000","last_active":"2023-12-12T10:12:13.954582+0000","last_peered":"2023-12-12T10:12:13.954582+0000","last_clean":"2023-12-12T10:12:13.954582+0000","last_became_active":"2023-12-12T10:12:08.819705+0000","last_became_peered":"2023-12-12T10:12:08.819705+0000","last_unstale":"2023-12-12T10:12:13.954582+0000","last_undegraded":"2023-12-12T10:12:13.954582+0000","last_fullsized":"2023-12-12T10:12:13.954582+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_clean_scrub_stamp":"2023-12-12T10:12:07.792253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:14:21.574354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-12T10:12:14.944814+0000","last_change":"2023-12-12T10:12:13.966284+0000","last_active":"2023-12-12T10:12:14.944814+0000","last_peered":"2023-12-12T10:12:14.944814+0000","last_clean":"2023-12-12T10:12:14.944814+0000","last_became_active":"2023-12-12T10:12:13.965836+0000","last_became_peered":"2023-12-12T10:12:13.965836+0000","last_unstale":"2023-12-12T10:12:14.944814+0000","last_undegraded":"2023-12-12T10:12:14.944814+0000","last_fullsized":"2023-12-12T10:12:14.944814+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_clean_scrub_stamp":"2023-12-12T10:12:12.929940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:29:09.752788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.942530+0000","last_change":"2023-12-12T10:12:09.836385+0000","last_active":"2023-12-12T10:12:13.942530+0000","last_peered":"2023-12-12T10:12:13.942530+0000","last_clean":"2023-12-12T10:12:13.942530+0000","last_became_active":"2023-12-12T10:12:09.836038+0000","last_became_peered":"2023-12-12T10:12:09.836038+0000","last_unstale":"2023-12-12T10:12:13.942530+0000","last_undegraded":"2023-12-12T10:12:13.942530+0000","last_fullsized":"2023-12-12T10:12:13.942530+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:08:12.099242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.942840+0000","last_change":"2023-12-12T10:12:08.842624+0000","last_active":"2023-12-12T10:12:13.942840+0000","last_peered":"2023-12-12T10:12:13.942840+0000","last_clean":"2023-12-12T10:12:13.942840+0000","last_became_active":"2023-12-12T10:12:08.842340+0000","last_became_peered":"2023-12-12T10:12:08.842340+0000","last_unstale":"2023-12-12T10:12:13.942840+0000","last_undegraded":"2023-12-12T10:12:13.942840+0000","last_fullsized":"2023-12-12T10:12:13.942840+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_clean_scrub_stamp":"2023-12-12T10:12:07.792253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:43:30.327223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.942405+0000","last_change":"2023-12-12T10:12:08.828385+0000","last_active":"2023-12-12T10:12:13.942405+0000","last_peered":"2023-12-12T10:12:13.942405+0000","last_clean":"2023-12-12T10:12:13.942405+0000","last_became_active":"2023-12-12T10:12:08.828078+0000","last_became_peered":"2023-12-12T10:12:08.828078+0000","last_unstale":"2023-12-12T10:12:13.942405+0000","last_undegraded":"2023-12-12T10:12:13.942405+0000","last_fullsized":"2023-12-12T10:12:13.942405+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_clean_scrub_stamp":"2023-12-12T10:12:07.792253+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:46:36.023306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.955847+0000","last_change":"2023-12-12T10:12:09.839770+0000","last_active":"2023-12-12T10:12:13.955847+0000","last_peered":"2023-12-12T10:12:13.955847+0000","last_clean":"2023-12-12T10:12:13.955847+0000","last_became_active":"2023-12-12T10:12:09.838270+0000","last_became_peered":"2023-12-12T10:12:09.838270+0000","last_unstale":"2023-12-12T10:12:13.955847+0000","last_undegraded":"2023-12-12T10:12:13.955847+0000","last_fullsized":"2023-12-12T10:12:13.955847+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:05:45.545567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-12T10:12:14.944264+0000","last_change":"2023-12-12T10:12:13.976903+0000","last_active":"2023-12-12T10:12:14.944264+0000","last_peered":"2023-12-12T10:12:14.944264+0000","last_clean":"2023-12-12T10:12:14.944264+0000","last_became_active":"2023-12-12T10:12:13.976414+0000","last_became_peered":"2023-12-12T10:12:13.976414+0000","last_unstale":"2023-12-12T10:12:14.944264+0000","last_undegraded":"2023-12-12T10:12:14.944264+0000","last_fullsized":"2023-12-12T10:12:14.944264+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_clean_scrub_stamp":"2023-12-12T10:12:12.929940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:22:31.685044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.943480+0000","last_change":"2023-12-12T10:12:08.841907+0000","last_active":"2023-12-12T10:12:13.943480+0000","last_peered":"2023-12-12T10:12:13.943480+0000","last_clean":"2023-12-12T10:12:13.943480+0000","last_became_active":"2023-12-12T10:12:08.841597+0000","last_became_peered":"2023-12-12T10:12:08.841597+0000","last_unstale":"2023-12-12T10:12:13.943480+0000","last_undegraded":"2023-12-12T10:12:13.943480+0000","last_fullsized":"2023-12-12T10:12:13.943480+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_clean_scrub_stamp":"2023-12-12T10:12:07.792253+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:50:55.983027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.945193+0000","last_change":"2023-12-12T10:12:09.825457+0000","last_active":"2023-12-12T10:12:13.945193+0000","last_peered":"2023-12-12T10:12:13.945193+0000","last_clean":"2023-12-12T10:12:13.945193+0000","last_became_active":"2023-12-12T10:12:09.824655+0000","last_became_peered":"2023-12-12T10:12:09.824655+0000","last_unstale":"2023-12-12T10:12:13.945193+0000","last_undegraded":"2023-12-12T10:12:13.945193+0000","last_fullsized":"2023-12-12T10:12:13.945193+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:46:37.030058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-12T10:12:15.556592+0000","last_change":"2023-12-12T10:12:13.978242+0000","last_active":"2023-12-12T10:12:15.556592+0000","last_peered":"2023-12-12T10:12:15.556592+0000","last_clean":"2023-12-12T10:12:15.556592+0000","last_became_active":"2023-12-12T10:12:13.977875+0000","last_became_peered":"2023-12-12T10:12:13.977875+0000","last_unstale":"2023-12-12T10:12:15.556592+0000","last_undegraded":"2023-12-12T10:12:15.556592+0000","last_fullsized":"2023-12-12T10:12:15.556592+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_clean_scrub_stamp":"2023-12-12T10:12:12.929940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:36:01.186241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.945551+0000","last_change":"2023-12-12T10:12:09.825518+0000","last_active":"2023-12-12T10:12:13.945551+0000","last_peered":"2023-12-12T10:12:13.945551+0000","last_clean":"2023-12-12T10:12:13.945551+0000","last_became_active":"2023-12-12T10:12:09.822775+0000","last_became_peered":"2023-12-12T10:12:09.822775+0000","last_unstale":"2023-12-12T10:12:13.945551+0000","last_undegraded":"2023-12-12T10:12:13.945551+0000","last_fullsized":"2023-12-12T10:12:13.945551+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:24:13.207348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.965244+0000","last_change":"2023-12-12T10:12:09.844690+0000","last_active":"2023-12-12T10:12:13.965244+0000","last_peered":"2023-12-12T10:12:13.965244+0000","last_clean":"2023-12-12T10:12:13.965244+0000","last_became_active":"2023-12-12T10:12:09.844429+0000","last_became_peered":"2023-12-12T10:12:09.844429+0000","last_unstale":"2023-12-12T10:12:13.965244+0000","last_undegraded":"2023-12-12T10:12:13.965244+0000","last_fullsized":"2023-12-12T10:12:13.965244+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:46:37.030058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.955446+0000","last_change":"2023-12-12T10:12:09.838818+0000","last_active":"2023-12-12T10:12:13.955446+0000","last_peered":"2023-12-12T10:12:13.955446+0000","last_clean":"2023-12-12T10:12:13.955446+0000","last_became_active":"2023-12-12T10:12:09.838507+0000","last_became_peered":"2023-12-12T10:12:09.838507+0000","last_unstale":"2023-12-12T10:12:13.955446+0000","last_undegraded":"2023-12-12T10:12:13.955446+0000","last_fullsized":"2023-12-12T10:12:13.955446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:08:12.099242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.955753+0000","last_change":"2023-12-12T10:12:09.831070+0000","last_active":"2023-12-12T10:12:13.955753+0000","last_peered":"2023-12-12T10:12:13.955753+0000","last_clean":"2023-12-12T10:12:13.955753+0000","last_became_active":"2023-12-12T10:12:09.830702+0000","last_became_peered":"2023-12-12T10:12:09.830702+0000","last_unstale":"2023-12-12T10:12:13.955753+0000","last_undegraded":"2023-12-12T10:12:13.955753+0000","last_fullsized":"2023-12-12T10:12:13.955753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:24:13.207348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.944609+0000","last_change":"2023-12-12T10:12:09.839496+0000","last_active":"2023-12-12T10:12:13.944609+0000","last_peered":"2023-12-12T10:12:13.944609+0000","last_clean":"2023-12-12T10:12:13.944609+0000","last_became_active":"2023-12-12T10:12:09.839184+0000","last_became_peered":"2023-12-12T10:12:09.839184+0000","last_unstale":"2023-12-12T10:12:13.944609+0000","last_undegraded":"2023-12-12T10:12:13.944609+0000","last_fullsized":"2023-12-12T10:12:13.944609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:14:22.581107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.963351+0000","last_change":"2023-12-12T10:12:09.833470+0000","last_active":"2023-12-12T10:12:13.963351+0000","last_peered":"2023-12-12T10:12:13.963351+0000","last_clean":"2023-12-12T10:12:13.963351+0000","last_became_active":"2023-12-12T10:12:09.833154+0000","last_became_peered":"2023-12-12T10:12:09.833154+0000","last_unstale":"2023-12-12T10:12:13.963351+0000","last_undegraded":"2023-12-12T10:12:13.963351+0000","last_fullsized":"2023-12-12T10:12:13.963351+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:42:17.456979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.945149+0000","last_change":"2023-12-12T10:12:09.826435+0000","last_active":"2023-12-12T10:12:13.945149+0000","last_peered":"2023-12-12T10:12:13.945149+0000","last_clean":"2023-12-12T10:12:13.945149+0000","last_became_active":"2023-12-12T10:12:09.826055+0000","last_became_peered":"2023-12-12T10:12:09.826055+0000","last_unstale":"2023-12-12T10:12:13.945149+0000","last_undegraded":"2023-12-12T10:12:13.945149+0000","last_fullsized":"2023-12-12T10:12:13.945149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:29:34.002418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.947105+0000","last_change":"2023-12-12T10:12:09.835389+0000","last_active":"2023-12-12T10:12:13.947105+0000","last_peered":"2023-12-12T10:12:13.947105+0000","last_clean":"2023-12-12T10:12:13.947105+0000","last_became_active":"2023-12-12T10:12:09.835119+0000","last_became_peered":"2023-12-12T10:12:09.835119+0000","last_unstale":"2023-12-12T10:12:13.947105+0000","last_undegraded":"2023-12-12T10:12:13.947105+0000","last_fullsized":"2023-12-12T10:12:13.947105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:29:34.002418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.953512+0000","last_change":"2023-12-12T10:12:09.840058+0000","last_active":"2023-12-12T10:12:13.953512+0000","last_peered":"2023-12-12T10:12:13.953512+0000","last_clean":"2023-12-12T10:12:13.953512+0000","last_became_active":"2023-12-12T10:12:09.839675+0000","last_became_peered":"2023-12-12T10:12:09.839675+0000","last_unstale":"2023-12-12T10:12:13.953512+0000","last_undegraded":"2023-12-12T10:12:13.953512+0000","last_fullsized":"2023-12-12T10:12:13.953512+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:29:34.002418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.942739+0000","last_change":"2023-12-12T10:12:09.842044+0000","last_active":"2023-12-12T10:12:13.942739+0000","last_peered":"2023-12-12T10:12:13.942739+0000","last_clean":"2023-12-12T10:12:13.942739+0000","last_became_active":"2023-12-12T10:12:09.841751+0000","last_became_peered":"2023-12-12T10:12:09.841751+0000","last_unstale":"2023-12-12T10:12:13.942739+0000","last_undegraded":"2023-12-12T10:12:13.942739+0000","last_fullsized":"2023-12-12T10:12:13.942739+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:42:17.456979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.955340+0000","last_change":"2023-12-12T10:12:09.835927+0000","last_active":"2023-12-12T10:12:13.955340+0000","last_peered":"2023-12-12T10:12:13.955340+0000","last_clean":"2023-12-12T10:12:13.955340+0000","last_became_active":"2023-12-12T10:12:09.835625+0000","last_became_peered":"2023-12-12T10:12:09.835625+0000","last_unstale":"2023-12-12T10:12:13.955340+0000","last_undegraded":"2023-12-12T10:12:13.955340+0000","last_fullsized":"2023-12-12T10:12:13.955340+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:22:56.063355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.955249+0000","last_change":"2023-12-12T10:12:09.834124+0000","last_active":"2023-12-12T10:12:13.955249+0000","last_peered":"2023-12-12T10:12:13.955249+0000","last_clean":"2023-12-12T10:12:13.955249+0000","last_became_active":"2023-12-12T10:12:09.833698+0000","last_became_peered":"2023-12-12T10:12:09.833698+0000","last_unstale":"2023-12-12T10:12:13.955249+0000","last_undegraded":"2023-12-12T10:12:13.955249+0000","last_fullsized":"2023-12-12T10:12:13.955249+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:45:53.012016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.944483+0000","last_change":"2023-12-12T10:12:09.831637+0000","last_active":"2023-12-12T10:12:13.944483+0000","last_peered":"2023-12-12T10:12:13.944483+0000","last_clean":"2023-12-12T10:12:13.944483+0000","last_became_active":"2023-12-12T10:12:09.831330+0000","last_became_peered":"2023-12-12T10:12:09.831330+0000","last_unstale":"2023-12-12T10:12:13.944483+0000","last_undegraded":"2023-12-12T10:12:13.944483+0000","last_fullsized":"2023-12-12T10:12:13.944483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:45:53.012016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:14.179084+0000","last_change":"2023-12-12T10:12:09.832795+0000","last_active":"2023-12-12T10:12:14.179084+0000","last_peered":"2023-12-12T10:12:14.179084+0000","last_clean":"2023-12-12T10:12:14.179084+0000","last_became_active":"2023-12-12T10:12:09.832536+0000","last_became_peered":"2023-12-12T10:12:09.832536+0000","last_unstale":"2023-12-12T10:12:14.179084+0000","last_undegraded":"2023-12-12T10:12:14.179084+0000","last_fullsized":"2023-12-12T10:12:14.179084+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:17:19.749257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.967788+0000","last_change":"2023-12-12T10:12:09.836093+0000","last_active":"2023-12-12T10:12:13.967788+0000","last_peered":"2023-12-12T10:12:13.967788+0000","last_clean":"2023-12-12T10:12:13.967788+0000","last_became_active":"2023-12-12T10:12:09.835900+0000","last_became_peered":"2023-12-12T10:12:09.835900+0000","last_unstale":"2023-12-12T10:12:13.967788+0000","last_undegraded":"2023-12-12T10:12:13.967788+0000","last_fullsized":"2023-12-12T10:12:13.967788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:41:38.233640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.955513+0000","last_change":"2023-12-12T10:12:09.842078+0000","last_active":"2023-12-12T10:12:13.955513+0000","last_peered":"2023-12-12T10:12:13.955513+0000","last_clean":"2023-12-12T10:12:13.955513+0000","last_became_active":"2023-12-12T10:12:09.841393+0000","last_became_peered":"2023-12-12T10:12:09.841393+0000","last_unstale":"2023-12-12T10:12:13.955513+0000","last_undegraded":"2023-12-12T10:12:13.955513+0000","last_fullsized":"2023-12-12T10:12:13.955513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:11:15.110991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.953508+0000","last_change":"2023-12-12T10:12:09.835453+0000","last_active":"2023-12-12T10:12:13.953508+0000","last_peered":"2023-12-12T10:12:13.953508+0000","last_clean":"2023-12-12T10:12:13.953508+0000","last_became_active":"2023-12-12T10:12:09.835078+0000","last_became_peered":"2023-12-12T10:12:09.835078+0000","last_unstale":"2023-12-12T10:12:13.953508+0000","last_undegraded":"2023-12-12T10:12:13.953508+0000","last_fullsized":"2023-12-12T10:12:13.953508+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:42:17.456979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.960892+0000","last_change":"2023-12-12T10:12:09.836102+0000","last_active":"2023-12-12T10:12:13.960892+0000","last_peered":"2023-12-12T10:12:13.960892+0000","last_clean":"2023-12-12T10:12:13.960892+0000","last_became_active":"2023-12-12T10:12:09.835809+0000","last_became_peered":"2023-12-12T10:12:09.835809+0000","last_unstale":"2023-12-12T10:12:13.960892+0000","last_undegraded":"2023-12-12T10:12:13.960892+0000","last_fullsized":"2023-12-12T10:12:13.960892+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:29:34.002418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.954718+0000","last_change":"2023-12-12T10:12:09.825563+0000","last_active":"2023-12-12T10:12:13.954718+0000","last_peered":"2023-12-12T10:12:13.954718+0000","last_clean":"2023-12-12T10:12:13.954718+0000","last_became_active":"2023-12-12T10:12:09.825296+0000","last_became_peered":"2023-12-12T10:12:09.825296+0000","last_unstale":"2023-12-12T10:12:13.954718+0000","last_undegraded":"2023-12-12T10:12:13.954718+0000","last_fullsized":"2023-12-12T10:12:13.954718+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:50:56.989780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.942544+0000","last_change":"2023-12-12T10:12:09.834352+0000","last_active":"2023-12-12T10:12:13.942544+0000","last_peered":"2023-12-12T10:12:13.942544+0000","last_clean":"2023-12-12T10:12:13.942544+0000","last_became_active":"2023-12-12T10:12:09.834163+0000","last_became_peered":"2023-12-12T10:12:09.834163+0000","last_unstale":"2023-12-12T10:12:13.942544+0000","last_undegraded":"2023-12-12T10:12:13.942544+0000","last_fullsized":"2023-12-12T10:12:13.942544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:45:53.012016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.946993+0000","last_change":"2023-12-12T10:12:09.833417+0000","last_active":"2023-12-12T10:12:13.946993+0000","last_peered":"2023-12-12T10:12:13.946993+0000","last_clean":"2023-12-12T10:12:13.946993+0000","last_became_active":"2023-12-12T10:12:09.833065+0000","last_became_peered":"2023-12-12T10:12:09.833065+0000","last_unstale":"2023-12-12T10:12:13.946993+0000","last_undegraded":"2023-12-12T10:12:13.946993+0000","last_fullsized":"2023-12-12T10:12:13.946993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:05:34.562768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.945203+0000","last_change":"2023-12-12T10:12:09.847547+0000","last_active":"2023-12-12T10:12:13.945203+0000","last_peered":"2023-12-12T10:12:13.945203+0000","last_clean":"2023-12-12T10:12:13.945203+0000","last_became_active":"2023-12-12T10:12:09.847242+0000","last_became_peered":"2023-12-12T10:12:09.847242+0000","last_unstale":"2023-12-12T10:12:13.945203+0000","last_undegraded":"2023-12-12T10:12:13.945203+0000","last_fullsized":"2023-12-12T10:12:13.945203+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:59:46.622358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.945295+0000","last_change":"2023-12-12T10:12:09.845347+0000","last_active":"2023-12-12T10:12:13.945295+0000","last_peered":"2023-12-12T10:12:13.945295+0000","last_clean":"2023-12-12T10:12:13.945295+0000","last_became_active":"2023-12-12T10:12:09.845043+0000","last_became_peered":"2023-12-12T10:12:09.845043+0000","last_unstale":"2023-12-12T10:12:13.945295+0000","last_undegraded":"2023-12-12T10:12:13.945295+0000","last_fullsized":"2023-12-12T10:12:13.945295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:42:17.456979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:14.179662+0000","last_change":"2023-12-12T10:12:09.846679+0000","last_active":"2023-12-12T10:12:14.179662+0000","last_peered":"2023-12-12T10:12:14.179662+0000","last_clean":"2023-12-12T10:12:14.179662+0000","last_became_active":"2023-12-12T10:12:09.846392+0000","last_became_peered":"2023-12-12T10:12:09.846392+0000","last_unstale":"2023-12-12T10:12:14.179662+0000","last_undegraded":"2023-12-12T10:12:14.179662+0000","last_fullsized":"2023-12-12T10:12:14.179662+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:51:42.379319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.941904+0000","last_change":"2023-12-12T10:12:09.839337+0000","last_active":"2023-12-12T10:12:13.941904+0000","last_peered":"2023-12-12T10:12:13.941904+0000","last_clean":"2023-12-12T10:12:13.941904+0000","last_became_active":"2023-12-12T10:12:09.838987+0000","last_became_peered":"2023-12-12T10:12:09.838987+0000","last_unstale":"2023-12-12T10:12:13.941904+0000","last_undegraded":"2023-12-12T10:12:13.941904+0000","last_fullsized":"2023-12-12T10:12:13.941904+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:22:56.063355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:14.178541+0000","last_change":"2023-12-12T10:12:09.827527+0000","last_active":"2023-12-12T10:12:14.178541+0000","last_peered":"2023-12-12T10:12:14.178541+0000","last_clean":"2023-12-12T10:12:14.178541+0000","last_became_active":"2023-12-12T10:12:09.827216+0000","last_became_peered":"2023-12-12T10:12:09.827216+0000","last_unstale":"2023-12-12T10:12:14.178541+0000","last_undegraded":"2023-12-12T10:12:14.178541+0000","last_fullsized":"2023-12-12T10:12:14.178541+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:47:44.969459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.955227+0000","last_change":"2023-12-12T10:12:09.835033+0000","last_active":"2023-12-12T10:12:13.955227+0000","last_peered":"2023-12-12T10:12:13.955227+0000","last_clean":"2023-12-12T10:12:13.955227+0000","last_became_active":"2023-12-12T10:12:09.834115+0000","last_became_peered":"2023-12-12T10:12:09.834115+0000","last_unstale":"2023-12-12T10:12:13.955227+0000","last_undegraded":"2023-12-12T10:12:13.955227+0000","last_fullsized":"2023-12-12T10:12:13.955227+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T22:01:05.110732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:14.178670+0000","last_change":"2023-12-12T10:12:09.831879+0000","last_active":"2023-12-12T10:12:14.178670+0000","last_peered":"2023-12-12T10:12:14.178670+0000","last_clean":"2023-12-12T10:12:14.178670+0000","last_became_active":"2023-12-12T10:12:09.831596+0000","last_became_peered":"2023-12-12T10:12:09.831596+0000","last_unstale":"2023-12-12T10:12:14.178670+0000","last_undegraded":"2023-12-12T10:12:14.178670+0000","last_fullsized":"2023-12-12T10:12:14.178670+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:29:05.621853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.954769+0000","last_change":"2023-12-12T10:12:09.844712+0000","last_active":"2023-12-12T10:12:13.954769+0000","last_peered":"2023-12-12T10:12:13.954769+0000","last_clean":"2023-12-12T10:12:13.954769+0000","last_became_active":"2023-12-12T10:12:09.843173+0000","last_became_peered":"2023-12-12T10:12:09.843173+0000","last_unstale":"2023-12-12T10:12:13.954769+0000","last_undegraded":"2023-12-12T10:12:13.954769+0000","last_fullsized":"2023-12-12T10:12:13.954769+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:45:57.506196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.955973+0000","last_change":"2023-12-12T10:12:09.833009+0000","last_active":"2023-12-12T10:12:13.955973+0000","last_peered":"2023-12-12T10:12:13.955973+0000","last_clean":"2023-12-12T10:12:13.955973+0000","last_became_active":"2023-12-12T10:12:09.832730+0000","last_became_peered":"2023-12-12T10:12:09.832730+0000","last_unstale":"2023-12-12T10:12:13.955973+0000","last_undegraded":"2023-12-12T10:12:13.955973+0000","last_fullsized":"2023-12-12T10:12:13.955973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:14:22.581107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.962427+0000","last_change":"2023-12-12T10:12:09.832531+0000","last_active":"2023-12-12T10:12:13.962427+0000","last_peered":"2023-12-12T10:12:13.962427+0000","last_clean":"2023-12-12T10:12:13.962427+0000","last_became_active":"2023-12-12T10:12:09.831562+0000","last_became_peered":"2023-12-12T10:12:09.831562+0000","last_unstale":"2023-12-12T10:12:13.962427+0000","last_undegraded":"2023-12-12T10:12:13.962427+0000","last_fullsized":"2023-12-12T10:12:13.962427+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T22:01:05.110732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:14.179520+0000","last_change":"2023-12-12T10:12:09.832536+0000","last_active":"2023-12-12T10:12:14.179520+0000","last_peered":"2023-12-12T10:12:14.179520+0000","last_clean":"2023-12-12T10:12:14.179520+0000","last_became_active":"2023-12-12T10:12:09.832284+0000","last_became_peered":"2023-12-12T10:12:09.832284+0000","last_unstale":"2023-12-12T10:12:14.179520+0000","last_undegraded":"2023-12-12T10:12:14.179520+0000","last_fullsized":"2023-12-12T10:12:14.179520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:03:50.236121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4637,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9274,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":851968,"data_stored":690742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69999999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.751}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79000000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":258048,"data_stored":99882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82499999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":266240,"data_stored":99918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.754}]}]},{"osd":3,"up_from":13,"seq":55834574857,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.879}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81100000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84199999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574859,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":253952,"data_stored":99792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.317}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34399999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":262144,"data_stored":99952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574858,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":856064,"data_stored":689829,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-12T10:12:32.590 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-12T10:12:32.767 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.758+0000 7fb97132a640 1 Processor -- start 2023-12-12T10:12:32.767 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.762+0000 7fb97132a640 1 -- start start 2023-12-12T10:12:32.768 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.762+0000 7fb97132a640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fb96c13ceb0 0x7fb96c13d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:32.768 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.762+0000 7fb97132a640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb96c13fc60 0x7fb96c072030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:32.768 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.762+0000 7fb97132a640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb96c0705a0 con 0x7fb96c071bf0 2023-12-12T10:12:32.768 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.762+0000 7fb97132a640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb96c140410 con 0x7fb96c13ceb0 2023-12-12T10:12:32.768 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.762+0000 7fb97132a640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb96c0cdc90 con 0x7fb96c13fc60 2023-12-12T10:12:32.769 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.762+0000 7fb96affd640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fb96c13ceb0 0x7fb96c13d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:32.769 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.762+0000 7fb96a7fc640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7fb96c071bf0 0x7fb96c13f550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.78:51702/0 (socket says 172.21.15.78:51702) 2023-12-12T10:12:32.769 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.762+0000 7fb96a7fc640 1 -- 172.21.15.78:0/2465419354 learned_addr learned my addr 172.21.15.78:0/2465419354 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-12-12T10:12:32.769 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.762+0000 7fb96b7fe640 1 --2- 172.21.15.78:0/2465419354 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb96c13fc60 0x7fb96c072030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:32.769 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.762+0000 7fb96affd640 1 -- 172.21.15.78:0/2465419354 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb96c13fc60 msgr2=0x7fb96c072030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:32.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.762+0000 7fb96affd640 1 --2- 172.21.15.78:0/2465419354 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb96c13fc60 0x7fb96c072030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:32.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.762+0000 7fb96affd640 1 -- 172.21.15.78:0/2465419354 >> v1:172.21.15.187:6789/0 conn(0x7fb96c071bf0 legacy=0x7fb96c13f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:32.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.762+0000 7fb96affd640 1 -- 172.21.15.78:0/2465419354 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb96c072570 con 0x7fb96c13ceb0 2023-12-12T10:12:32.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.762+0000 7fb96b7fe640 1 --2- 172.21.15.78:0/2465419354 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb96c13fc60 0x7fb96c072030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-12T10:12:32.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.766+0000 7fb96affd640 1 --2- 172.21.15.78:0/2465419354 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb96c13ceb0 0x7fb96c13d4c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb95c0097c0 tx=0x7fb95c01c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8571aec8bf4f73e1 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:32.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.766+0000 7fb969ffb640 1 -- 172.21.15.78:0/2465419354 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb95c0ab600 con 0x7fb96c13ceb0 2023-12-12T10:12:32.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.766+0000 7fb969ffb640 1 -- 172.21.15.78:0/2465419354 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb95c0a7050 con 0x7fb96c13ceb0 2023-12-12T10:12:32.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.766+0000 7fb969ffb640 1 -- 172.21.15.78:0/2465419354 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb95c0ab980 con 0x7fb96c13ceb0 2023-12-12T10:12:32.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.766+0000 7fb97132a640 1 -- 172.21.15.78:0/2465419354 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb96c13ceb0 msgr2=0x7fb96c13d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:32.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.766+0000 7fb97132a640 1 --2- 172.21.15.78:0/2465419354 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb96c13ceb0 0x7fb96c13d4c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb95c0097c0 tx=0x7fb95c01c480 comp rx=0 tx=0).stop 2023-12-12T10:12:32.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.766+0000 7fb97132a640 1 -- 172.21.15.78:0/2465419354 shutdown_connections 2023-12-12T10:12:32.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.766+0000 7fb97132a640 1 --2- 172.21.15.78:0/2465419354 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb96c13fc60 0x7fb96c072030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:32.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.766+0000 7fb97132a640 1 --2- 172.21.15.78:0/2465419354 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb96c13ceb0 0x7fb96c13d4c0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:32.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.766+0000 7fb97132a640 1 -- 172.21.15.78:0/2465419354 >> 172.21.15.78:0/2465419354 conn(0x7fb96c06c5d0 msgr2=0x7fb96c06c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:32.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.766+0000 7fb97132a640 1 -- 172.21.15.78:0/2465419354 shutdown_connections 2023-12-12T10:12:32.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.766+0000 7fb97132a640 1 -- 172.21.15.78:0/2465419354 wait complete. 2023-12-12T10:12:32.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.770+0000 7fb97132a640 1 Processor -- start 2023-12-12T10:12:32.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.770+0000 7fb97132a640 1 -- start start 2023-12-12T10:12:32.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.770+0000 7fb97132a640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb96c071bf0 0x7fb96c1504a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:32.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.770+0000 7fb97132a640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb96c13ceb0 0x7fb96c138a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:32.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.770+0000 7fb97132a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb96c13fc60 0x7fb96c153710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:32.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.770+0000 7fb97132a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb96c152f30 con 0x7fb96c13fc60 2023-12-12T10:12:32.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.770+0000 7fb97132a640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb96c138fc0 con 0x7fb96c13ceb0 2023-12-12T10:12:32.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.770+0000 7fb97132a640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb96c153ff0 con 0x7fb96c071bf0 2023-12-12T10:12:32.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.770+0000 7fb96b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb96c13fc60 0x7fb96c153710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:32.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.770+0000 7fb96b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb96c13fc60 0x7fb96c153710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37256/0 (socket says 172.21.15.78:37256) 2023-12-12T10:12:32.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.770+0000 7fb96b7fe640 1 -- 172.21.15.78:0/2224370922 learned_addr learned my addr 172.21.15.78:0/2224370922 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:32.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.770+0000 7fb96affd640 1 --2- 172.21.15.78:0/2224370922 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb96c071bf0 0x7fb96c1504a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:32.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.770+0000 7fb96a7fc640 1 --2- 172.21.15.78:0/2224370922 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb96c13ceb0 0x7fb96c138a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:32.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.770+0000 7fb96b7fe640 1 -- 172.21.15.78:0/2224370922 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb96c071bf0 msgr2=0x7fb96c1504a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:32.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.770+0000 7fb96b7fe640 1 --2- 172.21.15.78:0/2224370922 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb96c071bf0 0x7fb96c1504a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:32.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.770+0000 7fb96b7fe640 1 -- 172.21.15.78:0/2224370922 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb96c13ceb0 msgr2=0x7fb96c138a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:32.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.770+0000 7fb96b7fe640 1 --2- 172.21.15.78:0/2224370922 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb96c13ceb0 0x7fb96c138a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:32.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.770+0000 7fb96b7fe640 1 -- 172.21.15.78:0/2224370922 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb96400ba70 con 0x7fb96c13fc60 2023-12-12T10:12:32.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.770+0000 7fb96b7fe640 1 --2- 172.21.15.78:0/2224370922 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb96c13fc60 0x7fb96c153710 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fb964010fc0 tx=0x7fb96400e490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:32.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.770+0000 7fb9537fe640 1 -- 172.21.15.78:0/2224370922 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb96400ed30 con 0x7fb96c13fc60 2023-12-12T10:12:32.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.770+0000 7fb9537fe640 1 -- 172.21.15.78:0/2224370922 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb964011040 con 0x7fb96c13fc60 2023-12-12T10:12:32.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.770+0000 7fb97132a640 1 -- 172.21.15.78:0/2224370922 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb95c009420 con 0x7fb96c13fc60 2023-12-12T10:12:32.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.770+0000 7fb9537fe640 1 -- 172.21.15.78:0/2224370922 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb964003be0 con 0x7fb96c13fc60 2023-12-12T10:12:32.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.770+0000 7fb97132a640 1 -- 172.21.15.78:0/2224370922 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb96c0b1a30 con 0x7fb96c13fc60 2023-12-12T10:12:32.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.770+0000 7fb97132a640 1 -- 172.21.15.78:0/2224370922 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb96c0671f0 con 0x7fb96c13fc60 2023-12-12T10:12:32.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.774+0000 7fb9537fe640 1 -- 172.21.15.78:0/2224370922 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb964016480 con 0x7fb96c13fc60 2023-12-12T10:12:32.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.774+0000 7fb9537fe640 1 --2- 172.21.15.78:0/2224370922 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fb958066470 0x7fb958068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:32.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.774+0000 7fb9537fe640 1 -- 172.21.15.78:0/2224370922 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb964086b40 con 0x7fb96c13fc60 2023-12-12T10:12:32.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.774+0000 7fb96affd640 1 --2- 172.21.15.78:0/2224370922 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fb958066470 0x7fb958068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:32.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.774+0000 7fb96affd640 1 --2- 172.21.15.78:0/2224370922 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fb958066470 0x7fb958068930 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb95c0ad000 tx=0x7fb95c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:32.784 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.778+0000 7fb9537fe640 1 -- 172.21.15.78:0/2224370922 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb964053cc0 con 0x7fb96c13fc60 2023-12-12T10:12:32.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.926+0000 7fb97132a640 1 -- 172.21.15.78:0/2224370922 --> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb96c070ae0 con 0x7fb958066470 2023-12-12T10:12:32.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.938+0000 7fb9537fe640 1 -- 172.21.15.78:0/2224370922 <== mgr.4104 v2:172.21.15.78:6832/1725498448 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345242 (secure 0 0 0) 0x7fb95c0aa3a0 con 0x7fb958066470 2023-12-12T10:12:32.946 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:12:32.948 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2023-12-12T10:12:32.949 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.938+0000 7fb97132a640 1 -- 172.21.15.78:0/2224370922 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fb958066470 msgr2=0x7fb958068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:32.949 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.938+0000 7fb97132a640 1 --2- 172.21.15.78:0/2224370922 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fb958066470 0x7fb958068930 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fb95c0ad000 tx=0x7fb95c008040 comp rx=0 tx=0).stop 2023-12-12T10:12:32.949 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.938+0000 7fb97132a640 1 -- 172.21.15.78:0/2224370922 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb96c13fc60 msgr2=0x7fb96c153710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:32.949 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.938+0000 7fb97132a640 1 --2- 172.21.15.78:0/2224370922 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb96c13fc60 0x7fb96c153710 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fb964010fc0 tx=0x7fb96400e490 comp rx=0 tx=0).stop 2023-12-12T10:12:32.949 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.942+0000 7fb97132a640 1 -- 172.21.15.78:0/2224370922 shutdown_connections 2023-12-12T10:12:32.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.942+0000 7fb97132a640 1 --2- 172.21.15.78:0/2224370922 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fb958066470 0x7fb958068930 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:32.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.942+0000 7fb97132a640 1 --2- 172.21.15.78:0/2224370922 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb96c13fc60 0x7fb96c153710 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:32.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.942+0000 7fb97132a640 1 --2- 172.21.15.78:0/2224370922 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb96c13ceb0 0x7fb96c138a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:32.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.942+0000 7fb97132a640 1 --2- 172.21.15.78:0/2224370922 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb96c071bf0 0x7fb96c1504a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:32.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.942+0000 7fb97132a640 1 -- 172.21.15.78:0/2224370922 >> 172.21.15.78:0/2224370922 conn(0x7fb96c06c5d0 msgr2=0x7fb96c13dd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:32.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.942+0000 7fb97132a640 1 -- 172.21.15.78:0/2224370922 shutdown_connections 2023-12-12T10:12:32.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:32.942+0000 7fb97132a640 1 -- 172.21.15.78:0/2224370922 wait complete. 2023-12-12T10:12:32.966 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":34,"stamp":"2023-12-12T10:12:30.994715+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595005,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219392,"kb_used_data":3204,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755328,"statfs":{"total":773094113280,"available":772869455872,"internally_reserved":0,"allocated":3280896,"data_stored":1987377,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2227,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002752"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.957388+0000","last_change":"2023-12-12T10:12:08.837046+0000","last_active":"2023-12-12T10:12:13.957388+0000","last_peered":"2023-12-12T10:12:13.957388+0000","last_clean":"2023-12-12T10:12:13.957388+0000","last_became_active":"2023-12-12T10:12:08.836763+0000","last_became_peered":"2023-12-12T10:12:08.836763+0000","last_unstale":"2023-12-12T10:12:13.957388+0000","last_undegraded":"2023-12-12T10:12:13.957388+0000","last_fullsized":"2023-12-12T10:12:13.957388+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_clean_scrub_stamp":"2023-12-12T10:12:07.792253+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:01:42.240854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.944527+0000","last_change":"2023-12-12T10:12:09.835821+0000","last_active":"2023-12-12T10:12:13.944527+0000","last_peered":"2023-12-12T10:12:13.944527+0000","last_clean":"2023-12-12T10:12:13.944527+0000","last_became_active":"2023-12-12T10:12:09.835565+0000","last_became_peered":"2023-12-12T10:12:09.835565+0000","last_unstale":"2023-12-12T10:12:13.944527+0000","last_undegraded":"2023-12-12T10:12:13.944527+0000","last_fullsized":"2023-12-12T10:12:13.944527+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:59:46.622358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-12T10:12:15.555553+0000","last_change":"2023-12-12T10:12:14.188368+0000","last_active":"2023-12-12T10:12:15.555553+0000","last_peered":"2023-12-12T10:12:15.555553+0000","last_clean":"2023-12-12T10:12:15.555553+0000","last_became_active":"2023-12-12T10:12:14.188013+0000","last_became_peered":"2023-12-12T10:12:14.188013+0000","last_unstale":"2023-12-12T10:12:15.555553+0000","last_undegraded":"2023-12-12T10:12:15.555553+0000","last_fullsized":"2023-12-12T10:12:15.555553+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_clean_scrub_stamp":"2023-12-12T10:12:12.929940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:41:41.466318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.946555+0000","last_change":"2023-12-12T10:12:08.841058+0000","last_active":"2023-12-12T10:12:13.946555+0000","last_peered":"2023-12-12T10:12:13.946555+0000","last_clean":"2023-12-12T10:12:13.946555+0000","last_became_active":"2023-12-12T10:12:08.840749+0000","last_became_peered":"2023-12-12T10:12:08.840749+0000","last_unstale":"2023-12-12T10:12:13.946555+0000","last_undegraded":"2023-12-12T10:12:13.946555+0000","last_fullsized":"2023-12-12T10:12:13.946555+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_clean_scrub_stamp":"2023-12-12T10:12:07.792253+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:01:42.240854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.955095+0000","last_change":"2023-12-12T10:12:09.846736+0000","last_active":"2023-12-12T10:12:13.955095+0000","last_peered":"2023-12-12T10:12:13.955095+0000","last_clean":"2023-12-12T10:12:13.955095+0000","last_became_active":"2023-12-12T10:12:09.846467+0000","last_became_peered":"2023-12-12T10:12:09.846467+0000","last_unstale":"2023-12-12T10:12:13.955095+0000","last_undegraded":"2023-12-12T10:12:13.955095+0000","last_fullsized":"2023-12-12T10:12:13.955095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:29:34.002418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-12T10:12:14.943582+0000","last_change":"2023-12-12T10:12:13.957767+0000","last_active":"2023-12-12T10:12:14.943582+0000","last_peered":"2023-12-12T10:12:14.943582+0000","last_clean":"2023-12-12T10:12:14.943582+0000","last_became_active":"2023-12-12T10:12:13.957289+0000","last_became_peered":"2023-12-12T10:12:13.957289+0000","last_unstale":"2023-12-12T10:12:14.943582+0000","last_undegraded":"2023-12-12T10:12:14.943582+0000","last_fullsized":"2023-12-12T10:12:14.943582+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_clean_scrub_stamp":"2023-12-12T10:12:12.929940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:29:38.133352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:14.179027+0000","last_change":"2023-12-12T10:12:08.846842+0000","last_active":"2023-12-12T10:12:14.179027+0000","last_peered":"2023-12-12T10:12:14.179027+0000","last_clean":"2023-12-12T10:12:14.179027+0000","last_became_active":"2023-12-12T10:12:08.846389+0000","last_became_peered":"2023-12-12T10:12:08.846389+0000","last_unstale":"2023-12-12T10:12:14.179027+0000","last_undegraded":"2023-12-12T10:12:14.179027+0000","last_fullsized":"2023-12-12T10:12:14.179027+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_clean_scrub_stamp":"2023-12-12T10:12:07.792253+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:14:21.574354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.954855+0000","last_change":"2023-12-12T10:12:09.846099+0000","last_active":"2023-12-12T10:12:13.954855+0000","last_peered":"2023-12-12T10:12:13.954855+0000","last_clean":"2023-12-12T10:12:13.954855+0000","last_became_active":"2023-12-12T10:12:09.843647+0000","last_became_peered":"2023-12-12T10:12:09.843647+0000","last_unstale":"2023-12-12T10:12:13.954855+0000","last_undegraded":"2023-12-12T10:12:13.954855+0000","last_fullsized":"2023-12-12T10:12:13.954855+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:06:52.618740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-12T10:12:14.944222+0000","last_change":"2023-12-12T10:12:13.966808+0000","last_active":"2023-12-12T10:12:14.944222+0000","last_peered":"2023-12-12T10:12:14.944222+0000","last_clean":"2023-12-12T10:12:14.944222+0000","last_became_active":"2023-12-12T10:12:13.966405+0000","last_became_peered":"2023-12-12T10:12:13.966405+0000","last_unstale":"2023-12-12T10:12:14.944222+0000","last_undegraded":"2023-12-12T10:12:14.944222+0000","last_fullsized":"2023-12-12T10:12:14.944222+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_clean_scrub_stamp":"2023-12-12T10:12:12.929940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:08:16.230176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:14.178844+0000","last_change":"2023-12-12T10:12:08.844404+0000","last_active":"2023-12-12T10:12:14.178844+0000","last_peered":"2023-12-12T10:12:14.178844+0000","last_clean":"2023-12-12T10:12:14.178844+0000","last_became_active":"2023-12-12T10:12:08.842413+0000","last_became_peered":"2023-12-12T10:12:08.842413+0000","last_unstale":"2023-12-12T10:12:14.178844+0000","last_undegraded":"2023-12-12T10:12:14.178844+0000","last_fullsized":"2023-12-12T10:12:14.178844+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_clean_scrub_stamp":"2023-12-12T10:12:07.792253+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:29:32.995665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.955015+0000","last_change":"2023-12-12T10:12:09.841014+0000","last_active":"2023-12-12T10:12:13.955015+0000","last_peered":"2023-12-12T10:12:13.955015+0000","last_clean":"2023-12-12T10:12:13.955015+0000","last_became_active":"2023-12-12T10:12:09.840537+0000","last_became_peered":"2023-12-12T10:12:09.840537+0000","last_unstale":"2023-12-12T10:12:13.955015+0000","last_undegraded":"2023-12-12T10:12:13.955015+0000","last_fullsized":"2023-12-12T10:12:13.955015+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:17:19.749257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-12T10:12:14.943939+0000","last_change":"2023-12-12T10:12:13.964740+0000","last_active":"2023-12-12T10:12:14.943939+0000","last_peered":"2023-12-12T10:12:14.943939+0000","last_clean":"2023-12-12T10:12:14.943939+0000","last_became_active":"2023-12-12T10:12:13.964322+0000","last_became_peered":"2023-12-12T10:12:13.964322+0000","last_unstale":"2023-12-12T10:12:14.943939+0000","last_undegraded":"2023-12-12T10:12:14.943939+0000","last_fullsized":"2023-12-12T10:12:14.943939+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_clean_scrub_stamp":"2023-12-12T10:12:12.929940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T22:01:09.241666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.942306+0000","last_change":"2023-12-12T10:12:09.830608+0000","last_active":"2023-12-12T10:12:13.942306+0000","last_peered":"2023-12-12T10:12:13.942306+0000","last_clean":"2023-12-12T10:12:13.942306+0000","last_became_active":"2023-12-12T10:12:09.830291+0000","last_became_peered":"2023-12-12T10:12:09.830291+0000","last_unstale":"2023-12-12T10:12:13.942306+0000","last_undegraded":"2023-12-12T10:12:13.942306+0000","last_fullsized":"2023-12-12T10:12:13.942306+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:14:22.581107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:14.178760+0000","last_change":"2023-12-12T10:12:08.842318+0000","last_active":"2023-12-12T10:12:14.178760+0000","last_peered":"2023-12-12T10:12:14.178760+0000","last_clean":"2023-12-12T10:12:14.178760+0000","last_became_active":"2023-12-12T10:12:08.841798+0000","last_became_peered":"2023-12-12T10:12:08.841798+0000","last_unstale":"2023-12-12T10:12:14.178760+0000","last_undegraded":"2023-12-12T10:12:14.178760+0000","last_fullsized":"2023-12-12T10:12:14.178760+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_clean_scrub_stamp":"2023-12-12T10:12:07.792253+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:05:44.538814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-12T10:12:14.945190+0000","last_change":"2023-12-12T10:12:13.966998+0000","last_active":"2023-12-12T10:12:14.945190+0000","last_peered":"2023-12-12T10:12:14.945190+0000","last_clean":"2023-12-12T10:12:14.945190+0000","last_became_active":"2023-12-12T10:12:13.966611+0000","last_became_peered":"2023-12-12T10:12:13.966611+0000","last_unstale":"2023-12-12T10:12:14.945190+0000","last_undegraded":"2023-12-12T10:12:14.945190+0000","last_fullsized":"2023-12-12T10:12:14.945190+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_clean_scrub_stamp":"2023-12-12T10:12:12.929940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:29:09.752788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.942671+0000","last_change":"2023-12-12T10:12:09.833899+0000","last_active":"2023-12-12T10:12:13.942671+0000","last_peered":"2023-12-12T10:12:13.942671+0000","last_clean":"2023-12-12T10:12:13.942671+0000","last_became_active":"2023-12-12T10:12:09.833515+0000","last_became_peered":"2023-12-12T10:12:09.833515+0000","last_unstale":"2023-12-12T10:12:13.942671+0000","last_undegraded":"2023-12-12T10:12:13.942671+0000","last_fullsized":"2023-12-12T10:12:13.942671+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:05:45.545567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.961555+0000","last_change":"2023-12-12T10:12:08.831931+0000","last_active":"2023-12-12T10:12:13.961555+0000","last_peered":"2023-12-12T10:12:13.961555+0000","last_clean":"2023-12-12T10:12:13.961555+0000","last_became_active":"2023-12-12T10:12:08.831620+0000","last_became_peered":"2023-12-12T10:12:08.831620+0000","last_unstale":"2023-12-12T10:12:13.961555+0000","last_undegraded":"2023-12-12T10:12:13.961555+0000","last_fullsized":"2023-12-12T10:12:13.961555+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_clean_scrub_stamp":"2023-12-12T10:12:07.792253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:33:06.940791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-12T10:12:14.944543+0000","last_change":"2023-12-12T10:12:13.963213+0000","last_active":"2023-12-12T10:12:14.944543+0000","last_peered":"2023-12-12T10:12:14.944543+0000","last_clean":"2023-12-12T10:12:14.944543+0000","last_became_active":"2023-12-12T10:12:13.962745+0000","last_became_peered":"2023-12-12T10:12:13.962745+0000","last_unstale":"2023-12-12T10:12:14.944543+0000","last_undegraded":"2023-12-12T10:12:14.944543+0000","last_fullsized":"2023-12-12T10:12:14.944543+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_clean_scrub_stamp":"2023-12-12T10:12:12.929940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:46:01.637131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.943109+0000","last_change":"2023-12-12T10:12:09.836176+0000","last_active":"2023-12-12T10:12:13.943109+0000","last_peered":"2023-12-12T10:12:13.943109+0000","last_clean":"2023-12-12T10:12:13.943109+0000","last_became_active":"2023-12-12T10:12:09.835770+0000","last_became_peered":"2023-12-12T10:12:09.835770+0000","last_unstale":"2023-12-12T10:12:13.943109+0000","last_undegraded":"2023-12-12T10:12:13.943109+0000","last_fullsized":"2023-12-12T10:12:13.943109+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:47:44.969459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.960982+0000","last_change":"2023-12-12T10:12:08.837492+0000","last_active":"2023-12-12T10:12:13.960982+0000","last_peered":"2023-12-12T10:12:13.960982+0000","last_clean":"2023-12-12T10:12:13.960982+0000","last_became_active":"2023-12-12T10:12:08.836946+0000","last_became_peered":"2023-12-12T10:12:08.836946+0000","last_unstale":"2023-12-12T10:12:13.960982+0000","last_undegraded":"2023-12-12T10:12:13.960982+0000","last_fullsized":"2023-12-12T10:12:13.960982+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_clean_scrub_stamp":"2023-12-12T10:12:07.792253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:43:30.327223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-12T10:12:15.184876+0000","last_change":"2023-12-12T10:12:14.185717+0000","last_active":"2023-12-12T10:12:15.184876+0000","last_peered":"2023-12-12T10:12:15.184876+0000","last_clean":"2023-12-12T10:12:15.184876+0000","last_became_active":"2023-12-12T10:12:14.185270+0000","last_became_peered":"2023-12-12T10:12:14.185270+0000","last_unstale":"2023-12-12T10:12:15.184876+0000","last_undegraded":"2023-12-12T10:12:15.184876+0000","last_fullsized":"2023-12-12T10:12:15.184876+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_clean_scrub_stamp":"2023-12-12T10:12:12.929940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:51:46.510253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.944571+0000","last_change":"2023-12-12T10:12:09.833775+0000","last_active":"2023-12-12T10:12:13.944571+0000","last_peered":"2023-12-12T10:12:13.944571+0000","last_clean":"2023-12-12T10:12:13.944571+0000","last_became_active":"2023-12-12T10:12:09.829608+0000","last_became_peered":"2023-12-12T10:12:09.829608+0000","last_unstale":"2023-12-12T10:12:13.944571+0000","last_undegraded":"2023-12-12T10:12:13.944571+0000","last_fullsized":"2023-12-12T10:12:13.944571+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:15:32.896143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:14.178440+0000","last_change":"2023-12-12T10:12:08.845929+0000","last_active":"2023-12-12T10:12:14.178440+0000","last_peered":"2023-12-12T10:12:14.178440+0000","last_clean":"2023-12-12T10:12:14.178440+0000","last_became_active":"2023-12-12T10:12:08.845586+0000","last_became_peered":"2023-12-12T10:12:08.845586+0000","last_unstale":"2023-12-12T10:12:14.178440+0000","last_undegraded":"2023-12-12T10:12:14.178440+0000","last_fullsized":"2023-12-12T10:12:14.178440+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_clean_scrub_stamp":"2023-12-12T10:12:07.792253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:05:33.556015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-12T10:12:14.944863+0000","last_change":"2023-12-12T10:12:13.963219+0000","last_active":"2023-12-12T10:12:14.944863+0000","last_peered":"2023-12-12T10:12:14.944863+0000","last_clean":"2023-12-12T10:12:14.944863+0000","last_became_active":"2023-12-12T10:12:13.962713+0000","last_became_peered":"2023-12-12T10:12:13.962713+0000","last_unstale":"2023-12-12T10:12:14.944863+0000","last_undegraded":"2023-12-12T10:12:14.944863+0000","last_fullsized":"2023-12-12T10:12:14.944863+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_clean_scrub_stamp":"2023-12-12T10:12:12.929940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:06:56.749674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.958203+0000","last_change":"2023-12-12T10:12:09.827158+0000","last_active":"2023-12-12T10:12:13.958203+0000","last_peered":"2023-12-12T10:12:13.958203+0000","last_clean":"2023-12-12T10:12:13.958203+0000","last_became_active":"2023-12-12T10:12:09.826822+0000","last_became_peered":"2023-12-12T10:12:09.826822+0000","last_unstale":"2023-12-12T10:12:13.958203+0000","last_undegraded":"2023-12-12T10:12:13.958203+0000","last_fullsized":"2023-12-12T10:12:13.958203+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:59:46.622358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.945235+0000","last_change":"2023-12-12T10:12:08.838343+0000","last_active":"2023-12-12T10:12:13.945235+0000","last_peered":"2023-12-12T10:12:13.945235+0000","last_clean":"2023-12-12T10:12:13.945235+0000","last_became_active":"2023-12-12T10:12:08.837997+0000","last_became_peered":"2023-12-12T10:12:08.837997+0000","last_unstale":"2023-12-12T10:12:13.945235+0000","last_undegraded":"2023-12-12T10:12:13.945235+0000","last_fullsized":"2023-12-12T10:12:13.945235+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_clean_scrub_stamp":"2023-12-12T10:12:07.792253+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:33:06.940791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-12T10:12:14.943970+0000","last_change":"2023-12-12T10:12:14.185225+0000","last_active":"2023-12-12T10:12:14.943970+0000","last_peered":"2023-12-12T10:12:14.943970+0000","last_clean":"2023-12-12T10:12:14.943970+0000","last_became_active":"2023-12-12T10:12:14.184122+0000","last_became_peered":"2023-12-12T10:12:14.184122+0000","last_unstale":"2023-12-12T10:12:14.943970+0000","last_undegraded":"2023-12-12T10:12:14.943970+0000","last_fullsized":"2023-12-12T10:12:14.943970+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_clean_scrub_stamp":"2023-12-12T10:12:12.929940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:23:00.194289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.947211+0000","last_change":"2023-12-12T10:12:09.835201+0000","last_active":"2023-12-12T10:12:13.947211+0000","last_peered":"2023-12-12T10:12:13.947211+0000","last_clean":"2023-12-12T10:12:13.947211+0000","last_became_active":"2023-12-12T10:12:09.834701+0000","last_became_peered":"2023-12-12T10:12:09.834701+0000","last_unstale":"2023-12-12T10:12:13.947211+0000","last_undegraded":"2023-12-12T10:12:13.947211+0000","last_fullsized":"2023-12-12T10:12:13.947211+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T22:01:05.110732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.962519+0000","last_change":"2023-12-12T10:12:08.842442+0000","last_active":"2023-12-12T10:12:13.962519+0000","last_peered":"2023-12-12T10:12:13.962519+0000","last_clean":"2023-12-12T10:12:13.962519+0000","last_became_active":"2023-12-12T10:12:08.842125+0000","last_became_peered":"2023-12-12T10:12:08.842125+0000","last_unstale":"2023-12-12T10:12:13.962519+0000","last_undegraded":"2023-12-12T10:12:13.962519+0000","last_fullsized":"2023-12-12T10:12:13.962519+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_clean_scrub_stamp":"2023-12-12T10:12:07.792253+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:24:12.200595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-12T10:12:15.555651+0000","last_change":"2023-12-12T10:12:14.185748+0000","last_active":"2023-12-12T10:12:15.555651+0000","last_peered":"2023-12-12T10:12:15.555651+0000","last_clean":"2023-12-12T10:12:15.555651+0000","last_became_active":"2023-12-12T10:12:14.185262+0000","last_became_peered":"2023-12-12T10:12:14.185262+0000","last_unstale":"2023-12-12T10:12:15.555651+0000","last_undegraded":"2023-12-12T10:12:15.555651+0000","last_fullsized":"2023-12-12T10:12:15.555651+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_clean_scrub_stamp":"2023-12-12T10:12:12.929940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:46:26.737660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.961127+0000","last_change":"2023-12-12T10:12:09.837089+0000","last_active":"2023-12-12T10:12:13.961127+0000","last_peered":"2023-12-12T10:12:13.961127+0000","last_clean":"2023-12-12T10:12:13.961127+0000","last_became_active":"2023-12-12T10:12:09.829551+0000","last_became_peered":"2023-12-12T10:12:09.829551+0000","last_unstale":"2023-12-12T10:12:13.961127+0000","last_undegraded":"2023-12-12T10:12:13.961127+0000","last_fullsized":"2023-12-12T10:12:13.961127+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:59:46.622358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:14.179291+0000","last_change":"2023-12-12T10:12:08.845099+0000","last_active":"2023-12-12T10:12:14.179291+0000","last_peered":"2023-12-12T10:12:14.179291+0000","last_clean":"2023-12-12T10:12:14.179291+0000","last_became_active":"2023-12-12T10:12:08.844823+0000","last_became_peered":"2023-12-12T10:12:08.844823+0000","last_unstale":"2023-12-12T10:12:14.179291+0000","last_undegraded":"2023-12-12T10:12:14.179291+0000","last_fullsized":"2023-12-12T10:12:14.179291+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_clean_scrub_stamp":"2023-12-12T10:12:07.792253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:42:16.450226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-12T10:12:15.556125+0000","last_change":"2023-12-12T10:12:14.182644+0000","last_active":"2023-12-12T10:12:15.556125+0000","last_peered":"2023-12-12T10:12:15.556125+0000","last_clean":"2023-12-12T10:12:15.556125+0000","last_became_active":"2023-12-12T10:12:14.182230+0000","last_became_peered":"2023-12-12T10:12:14.182230+0000","last_unstale":"2023-12-12T10:12:15.556125+0000","last_undegraded":"2023-12-12T10:12:15.556125+0000","last_fullsized":"2023-12-12T10:12:15.556125+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_clean_scrub_stamp":"2023-12-12T10:12:12.929940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:29:09.752788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.955037+0000","last_change":"2023-12-12T10:12:09.840836+0000","last_active":"2023-12-12T10:12:13.955037+0000","last_peered":"2023-12-12T10:12:13.955037+0000","last_clean":"2023-12-12T10:12:13.955037+0000","last_became_active":"2023-12-12T10:12:09.840219+0000","last_became_peered":"2023-12-12T10:12:09.840219+0000","last_unstale":"2023-12-12T10:12:13.955037+0000","last_undegraded":"2023-12-12T10:12:13.955037+0000","last_fullsized":"2023-12-12T10:12:13.955037+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:03:50.236121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.961215+0000","last_change":"2023-12-12T10:12:08.829665+0000","last_active":"2023-12-12T10:12:13.961215+0000","last_peered":"2023-12-12T10:12:13.961215+0000","last_clean":"2023-12-12T10:12:13.961215+0000","last_became_active":"2023-12-12T10:12:08.829433+0000","last_became_peered":"2023-12-12T10:12:08.829433+0000","last_unstale":"2023-12-12T10:12:13.961215+0000","last_undegraded":"2023-12-12T10:12:13.961215+0000","last_fullsized":"2023-12-12T10:12:13.961215+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_clean_scrub_stamp":"2023-12-12T10:12:07.792253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:41:37.226888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-12T10:12:15.184185+0000","last_change":"2023-12-12T10:12:13.973841+0000","last_active":"2023-12-12T10:12:15.184185+0000","last_peered":"2023-12-12T10:12:15.184185+0000","last_clean":"2023-12-12T10:12:15.184185+0000","last_became_active":"2023-12-12T10:12:13.973435+0000","last_became_peered":"2023-12-12T10:12:13.973435+0000","last_unstale":"2023-12-12T10:12:15.184185+0000","last_undegraded":"2023-12-12T10:12:15.184185+0000","last_fullsized":"2023-12-12T10:12:15.184185+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_clean_scrub_stamp":"2023-12-12T10:12:12.929940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:11:19.241925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.946358+0000","last_change":"2023-12-12T10:12:09.823582+0000","last_active":"2023-12-12T10:12:13.946358+0000","last_peered":"2023-12-12T10:12:13.946358+0000","last_clean":"2023-12-12T10:12:13.946358+0000","last_became_active":"2023-12-12T10:12:09.823307+0000","last_became_peered":"2023-12-12T10:12:09.823307+0000","last_unstale":"2023-12-12T10:12:13.946358+0000","last_undegraded":"2023-12-12T10:12:13.946358+0000","last_fullsized":"2023-12-12T10:12:13.946358+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:41:38.233640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.955628+0000","last_change":"2023-12-12T10:12:08.828970+0000","last_active":"2023-12-12T10:12:13.955628+0000","last_peered":"2023-12-12T10:12:13.955628+0000","last_clean":"2023-12-12T10:12:13.955628+0000","last_became_active":"2023-12-12T10:12:08.828622+0000","last_became_peered":"2023-12-12T10:12:08.828622+0000","last_unstale":"2023-12-12T10:12:13.955628+0000","last_undegraded":"2023-12-12T10:12:13.955628+0000","last_fullsized":"2023-12-12T10:12:13.955628+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_clean_scrub_stamp":"2023-12-12T10:12:07.792253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:05:44.538814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-12T10:12:15.184498+0000","last_change":"2023-12-12T10:12:13.971217+0000","last_active":"2023-12-12T10:12:15.184498+0000","last_peered":"2023-12-12T10:12:15.184498+0000","last_clean":"2023-12-12T10:12:15.184498+0000","last_became_active":"2023-12-12T10:12:13.970691+0000","last_became_peered":"2023-12-12T10:12:13.970691+0000","last_unstale":"2023-12-12T10:12:15.184498+0000","last_undegraded":"2023-12-12T10:12:15.184498+0000","last_fullsized":"2023-12-12T10:12:15.184498+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_clean_scrub_stamp":"2023-12-12T10:12:12.929940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:03:54.367055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.962282+0000","last_change":"2023-12-12T10:12:09.832708+0000","last_active":"2023-12-12T10:12:13.962282+0000","last_peered":"2023-12-12T10:12:13.962282+0000","last_clean":"2023-12-12T10:12:13.962282+0000","last_became_active":"2023-12-12T10:12:09.832344+0000","last_became_peered":"2023-12-12T10:12:09.832344+0000","last_unstale":"2023-12-12T10:12:13.962282+0000","last_undegraded":"2023-12-12T10:12:13.962282+0000","last_fullsized":"2023-12-12T10:12:13.962282+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:14:22.581107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.965330+0000","last_change":"2023-12-12T10:12:08.837019+0000","last_active":"2023-12-12T10:12:13.965330+0000","last_peered":"2023-12-12T10:12:13.965330+0000","last_clean":"2023-12-12T10:12:13.965330+0000","last_became_active":"2023-12-12T10:12:08.832265+0000","last_became_peered":"2023-12-12T10:12:08.832265+0000","last_unstale":"2023-12-12T10:12:13.965330+0000","last_undegraded":"2023-12-12T10:12:13.965330+0000","last_fullsized":"2023-12-12T10:12:13.965330+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_clean_scrub_stamp":"2023-12-12T10:12:07.792253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:18:36.840178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-12T10:12:15.184922+0000","last_change":"2023-12-12T10:12:13.973617+0000","last_active":"2023-12-12T10:12:15.184922+0000","last_peered":"2023-12-12T10:12:15.184922+0000","last_clean":"2023-12-12T10:12:15.184922+0000","last_became_active":"2023-12-12T10:12:13.973205+0000","last_became_peered":"2023-12-12T10:12:13.973205+0000","last_unstale":"2023-12-12T10:12:15.184922+0000","last_undegraded":"2023-12-12T10:12:15.184922+0000","last_fullsized":"2023-12-12T10:12:15.184922+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_clean_scrub_stamp":"2023-12-12T10:12:12.929940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:39:57.689735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.954974+0000","last_change":"2023-12-12T10:12:09.825813+0000","last_active":"2023-12-12T10:12:13.954974+0000","last_peered":"2023-12-12T10:12:13.954974+0000","last_clean":"2023-12-12T10:12:13.954974+0000","last_became_active":"2023-12-12T10:12:09.824750+0000","last_became_peered":"2023-12-12T10:12:09.824750+0000","last_unstale":"2023-12-12T10:12:13.954974+0000","last_undegraded":"2023-12-12T10:12:13.954974+0000","last_fullsized":"2023-12-12T10:12:13.954974+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:22:27.554110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:14.178474+0000","last_change":"2023-12-12T10:12:08.843140+0000","last_active":"2023-12-12T10:12:14.178474+0000","last_peered":"2023-12-12T10:12:14.178474+0000","last_clean":"2023-12-12T10:12:14.178474+0000","last_became_active":"2023-12-12T10:12:08.842860+0000","last_became_peered":"2023-12-12T10:12:08.842860+0000","last_unstale":"2023-12-12T10:12:14.178474+0000","last_undegraded":"2023-12-12T10:12:14.178474+0000","last_fullsized":"2023-12-12T10:12:14.178474+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_clean_scrub_stamp":"2023-12-12T10:12:07.792253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:18:36.840178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-12T10:12:15.557319+0000","last_change":"2023-12-12T10:12:14.186432+0000","last_active":"2023-12-12T10:12:15.557319+0000","last_peered":"2023-12-12T10:12:15.557319+0000","last_clean":"2023-12-12T10:12:15.557319+0000","last_became_active":"2023-12-12T10:12:14.185836+0000","last_became_peered":"2023-12-12T10:12:14.185836+0000","last_unstale":"2023-12-12T10:12:15.557319+0000","last_undegraded":"2023-12-12T10:12:15.557319+0000","last_fullsized":"2023-12-12T10:12:15.557319+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_clean_scrub_stamp":"2023-12-12T10:12:12.929940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:51:46.510253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.942873+0000","last_change":"2023-12-12T10:12:09.837891+0000","last_active":"2023-12-12T10:12:13.942873+0000","last_peered":"2023-12-12T10:12:13.942873+0000","last_clean":"2023-12-12T10:12:13.942873+0000","last_became_active":"2023-12-12T10:12:09.837628+0000","last_became_peered":"2023-12-12T10:12:09.837628+0000","last_unstale":"2023-12-12T10:12:13.942873+0000","last_undegraded":"2023-12-12T10:12:13.942873+0000","last_fullsized":"2023-12-12T10:12:13.942873+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:24:13.207348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.954955+0000","last_change":"2023-12-12T10:12:08.828997+0000","last_active":"2023-12-12T10:12:13.954955+0000","last_peered":"2023-12-12T10:12:13.954955+0000","last_clean":"2023-12-12T10:12:13.954955+0000","last_became_active":"2023-12-12T10:12:08.828551+0000","last_became_peered":"2023-12-12T10:12:08.828551+0000","last_unstale":"2023-12-12T10:12:13.954955+0000","last_undegraded":"2023-12-12T10:12:13.954955+0000","last_fullsized":"2023-12-12T10:12:13.954955+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_clean_scrub_stamp":"2023-12-12T10:12:07.792253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:24:12.200595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":169,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:14.178565+0000","last_change":"2023-12-12T10:11:58.492812+0000","last_active":"2023-12-12T10:12:14.178565+0000","last_peered":"2023-12-12T10:12:14.178565+0000","last_clean":"2023-12-12T10:12:14.178565+0000","last_became_active":"2023-12-12T10:11:58.491470+0000","last_became_peered":"2023-12-12T10:11:58.491470+0000","last_unstale":"2023-12-12T10:12:14.178565+0000","last_undegraded":"2023-12-12T10:12:14.178565+0000","last_fullsized":"2023-12-12T10:12:14.178565+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:11:57.289641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:11:57.289641+0000","last_clean_scrub_stamp":"2023-12-12T10:11:57.289641+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:10:37.809139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-12T10:12:14.943985+0000","last_change":"2023-12-12T10:12:14.184491+0000","last_active":"2023-12-12T10:12:14.943985+0000","last_peered":"2023-12-12T10:12:14.943985+0000","last_clean":"2023-12-12T10:12:14.943985+0000","last_became_active":"2023-12-12T10:12:14.183538+0000","last_became_peered":"2023-12-12T10:12:14.183538+0000","last_unstale":"2023-12-12T10:12:14.943985+0000","last_undegraded":"2023-12-12T10:12:14.943985+0000","last_fullsized":"2023-12-12T10:12:14.943985+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_clean_scrub_stamp":"2023-12-12T10:12:12.929940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:06:56.749674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:14.178883+0000","last_change":"2023-12-12T10:12:09.848681+0000","last_active":"2023-12-12T10:12:14.178883+0000","last_peered":"2023-12-12T10:12:14.178883+0000","last_clean":"2023-12-12T10:12:14.178883+0000","last_became_active":"2023-12-12T10:12:09.848381+0000","last_became_peered":"2023-12-12T10:12:09.848381+0000","last_unstale":"2023-12-12T10:12:14.178883+0000","last_undegraded":"2023-12-12T10:12:14.178883+0000","last_fullsized":"2023-12-12T10:12:14.178883+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:45:57.506196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.966788+0000","last_change":"2023-12-12T10:12:08.831000+0000","last_active":"2023-12-12T10:12:13.966788+0000","last_peered":"2023-12-12T10:12:13.966788+0000","last_clean":"2023-12-12T10:12:13.966788+0000","last_became_active":"2023-12-12T10:12:08.830638+0000","last_became_peered":"2023-12-12T10:12:08.830638+0000","last_unstale":"2023-12-12T10:12:13.966788+0000","last_undegraded":"2023-12-12T10:12:13.966788+0000","last_fullsized":"2023-12-12T10:12:13.966788+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_clean_scrub_stamp":"2023-12-12T10:12:07.792253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:15:31.889391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-12T10:12:14.943486+0000","last_change":"2023-12-12T10:12:14.183763+0000","last_active":"2023-12-12T10:12:14.943486+0000","last_peered":"2023-12-12T10:12:14.943486+0000","last_clean":"2023-12-12T10:12:14.943486+0000","last_became_active":"2023-12-12T10:12:14.183320+0000","last_became_peered":"2023-12-12T10:12:14.183320+0000","last_unstale":"2023-12-12T10:12:14.943486+0000","last_undegraded":"2023-12-12T10:12:14.943486+0000","last_fullsized":"2023-12-12T10:12:14.943486+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_clean_scrub_stamp":"2023-12-12T10:12:12.929940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:46:01.637131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.954867+0000","last_change":"2023-12-12T10:12:09.843426+0000","last_active":"2023-12-12T10:12:13.954867+0000","last_peered":"2023-12-12T10:12:13.954867+0000","last_clean":"2023-12-12T10:12:13.954867+0000","last_became_active":"2023-12-12T10:12:09.841783+0000","last_became_peered":"2023-12-12T10:12:09.841783+0000","last_unstale":"2023-12-12T10:12:13.954867+0000","last_undegraded":"2023-12-12T10:12:13.954867+0000","last_fullsized":"2023-12-12T10:12:13.954867+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:29:05.621853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.963537+0000","last_change":"2023-12-12T10:12:08.835533+0000","last_active":"2023-12-12T10:12:13.963537+0000","last_peered":"2023-12-12T10:12:13.963537+0000","last_clean":"2023-12-12T10:12:13.963537+0000","last_became_active":"2023-12-12T10:12:08.835230+0000","last_became_peered":"2023-12-12T10:12:08.835230+0000","last_unstale":"2023-12-12T10:12:13.963537+0000","last_undegraded":"2023-12-12T10:12:13.963537+0000","last_fullsized":"2023-12-12T10:12:13.963537+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_clean_scrub_stamp":"2023-12-12T10:12:07.792253+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:50:55.983027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-12T10:12:15.556326+0000","last_change":"2023-12-12T10:12:13.968062+0000","last_active":"2023-12-12T10:12:15.556326+0000","last_peered":"2023-12-12T10:12:15.556326+0000","last_clean":"2023-12-12T10:12:15.556326+0000","last_became_active":"2023-12-12T10:12:13.967558+0000","last_became_peered":"2023-12-12T10:12:13.967558+0000","last_unstale":"2023-12-12T10:12:15.556326+0000","last_undegraded":"2023-12-12T10:12:15.556326+0000","last_fullsized":"2023-12-12T10:12:15.556326+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_clean_scrub_stamp":"2023-12-12T10:12:12.929940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:11:19.241925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:14.179682+0000","last_change":"2023-12-12T10:12:09.840613+0000","last_active":"2023-12-12T10:12:14.179682+0000","last_peered":"2023-12-12T10:12:14.179682+0000","last_clean":"2023-12-12T10:12:14.179682+0000","last_became_active":"2023-12-12T10:12:09.840305+0000","last_became_peered":"2023-12-12T10:12:09.840305+0000","last_unstale":"2023-12-12T10:12:14.179682+0000","last_undegraded":"2023-12-12T10:12:14.179682+0000","last_fullsized":"2023-12-12T10:12:14.179682+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:39:53.558801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.967272+0000","last_change":"2023-12-12T10:12:08.832234+0000","last_active":"2023-12-12T10:12:13.967272+0000","last_peered":"2023-12-12T10:12:13.967272+0000","last_clean":"2023-12-12T10:12:13.967272+0000","last_became_active":"2023-12-12T10:12:08.831933+0000","last_became_peered":"2023-12-12T10:12:08.831933+0000","last_unstale":"2023-12-12T10:12:13.967272+0000","last_undegraded":"2023-12-12T10:12:13.967272+0000","last_fullsized":"2023-12-12T10:12:13.967272+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_clean_scrub_stamp":"2023-12-12T10:12:07.792253+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:05:33.556015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-12T10:12:15.553874+0000","last_change":"2023-12-12T10:12:14.181013+0000","last_active":"2023-12-12T10:12:15.553874+0000","last_peered":"2023-12-12T10:12:15.553874+0000","last_clean":"2023-12-12T10:12:15.553874+0000","last_became_active":"2023-12-12T10:12:14.180237+0000","last_became_peered":"2023-12-12T10:12:14.180237+0000","last_unstale":"2023-12-12T10:12:15.553874+0000","last_undegraded":"2023-12-12T10:12:15.553874+0000","last_fullsized":"2023-12-12T10:12:15.553874+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_clean_scrub_stamp":"2023-12-12T10:12:12.929940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:41:41.466318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:14.179468+0000","last_change":"2023-12-12T10:12:09.843023+0000","last_active":"2023-12-12T10:12:14.179468+0000","last_peered":"2023-12-12T10:12:14.179468+0000","last_clean":"2023-12-12T10:12:14.179468+0000","last_became_active":"2023-12-12T10:12:09.839541+0000","last_became_peered":"2023-12-12T10:12:09.839541+0000","last_unstale":"2023-12-12T10:12:14.179468+0000","last_undegraded":"2023-12-12T10:12:14.179468+0000","last_fullsized":"2023-12-12T10:12:14.179468+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:11:15.110991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.947354+0000","last_change":"2023-12-12T10:12:08.837170+0000","last_active":"2023-12-12T10:12:13.947354+0000","last_peered":"2023-12-12T10:12:13.947354+0000","last_clean":"2023-12-12T10:12:13.947354+0000","last_became_active":"2023-12-12T10:12:08.836870+0000","last_became_peered":"2023-12-12T10:12:08.836870+0000","last_unstale":"2023-12-12T10:12:13.947354+0000","last_undegraded":"2023-12-12T10:12:13.947354+0000","last_fullsized":"2023-12-12T10:12:13.947354+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_clean_scrub_stamp":"2023-12-12T10:12:07.792253+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:02:02.748317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-12T10:12:14.943477+0000","last_change":"2023-12-12T10:12:13.961169+0000","last_active":"2023-12-12T10:12:14.943477+0000","last_peered":"2023-12-12T10:12:14.943477+0000","last_clean":"2023-12-12T10:12:14.943477+0000","last_became_active":"2023-12-12T10:12:13.960747+0000","last_became_peered":"2023-12-12T10:12:13.960747+0000","last_unstale":"2023-12-12T10:12:14.943477+0000","last_undegraded":"2023-12-12T10:12:14.943477+0000","last_fullsized":"2023-12-12T10:12:14.943477+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_clean_scrub_stamp":"2023-12-12T10:12:12.929940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:42:21.587913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:14.178613+0000","last_change":"2023-12-12T10:12:09.840229+0000","last_active":"2023-12-12T10:12:14.178613+0000","last_peered":"2023-12-12T10:12:14.178613+0000","last_clean":"2023-12-12T10:12:14.178613+0000","last_became_active":"2023-12-12T10:12:09.839022+0000","last_became_peered":"2023-12-12T10:12:09.839022+0000","last_unstale":"2023-12-12T10:12:14.178613+0000","last_undegraded":"2023-12-12T10:12:14.178613+0000","last_fullsized":"2023-12-12T10:12:14.178613+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:22:56.063355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.965950+0000","last_change":"2023-12-12T10:12:08.826707+0000","last_active":"2023-12-12T10:12:13.965950+0000","last_peered":"2023-12-12T10:12:13.965950+0000","last_clean":"2023-12-12T10:12:13.965950+0000","last_became_active":"2023-12-12T10:12:08.826379+0000","last_became_peered":"2023-12-12T10:12:08.826379+0000","last_unstale":"2023-12-12T10:12:13.965950+0000","last_undegraded":"2023-12-12T10:12:13.965950+0000","last_fullsized":"2023-12-12T10:12:13.965950+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_clean_scrub_stamp":"2023-12-12T10:12:07.792253+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:02:02.748317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-12T10:12:15.557190+0000","last_change":"2023-12-12T10:12:13.978141+0000","last_active":"2023-12-12T10:12:15.557190+0000","last_peered":"2023-12-12T10:12:15.557190+0000","last_clean":"2023-12-12T10:12:15.557190+0000","last_became_active":"2023-12-12T10:12:13.975903+0000","last_became_peered":"2023-12-12T10:12:13.975903+0000","last_unstale":"2023-12-12T10:12:15.557190+0000","last_undegraded":"2023-12-12T10:12:15.557190+0000","last_fullsized":"2023-12-12T10:12:15.557190+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_clean_scrub_stamp":"2023-12-12T10:12:12.929940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:03:54.367055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.945635+0000","last_change":"2023-12-12T10:12:09.823042+0000","last_active":"2023-12-12T10:12:13.945635+0000","last_peered":"2023-12-12T10:12:13.945635+0000","last_clean":"2023-12-12T10:12:13.945635+0000","last_became_active":"2023-12-12T10:12:09.822372+0000","last_became_peered":"2023-12-12T10:12:09.822372+0000","last_unstale":"2023-12-12T10:12:13.945635+0000","last_undegraded":"2023-12-12T10:12:13.945635+0000","last_fullsized":"2023-12-12T10:12:13.945635+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:05:45.545567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.949351+0000","last_change":"2023-12-12T10:12:08.831259+0000","last_active":"2023-12-12T10:12:13.949351+0000","last_peered":"2023-12-12T10:12:13.949351+0000","last_clean":"2023-12-12T10:12:13.949351+0000","last_became_active":"2023-12-12T10:12:08.830921+0000","last_became_peered":"2023-12-12T10:12:08.830921+0000","last_unstale":"2023-12-12T10:12:13.949351+0000","last_undegraded":"2023-12-12T10:12:13.949351+0000","last_fullsized":"2023-12-12T10:12:13.949351+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_clean_scrub_stamp":"2023-12-12T10:12:07.792253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:01:42.240854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-12T10:12:15.556830+0000","last_change":"2023-12-12T10:12:14.186089+0000","last_active":"2023-12-12T10:12:15.556830+0000","last_peered":"2023-12-12T10:12:15.556830+0000","last_clean":"2023-12-12T10:12:15.556830+0000","last_became_active":"2023-12-12T10:12:14.185616+0000","last_became_peered":"2023-12-12T10:12:14.185616+0000","last_unstale":"2023-12-12T10:12:15.556830+0000","last_undegraded":"2023-12-12T10:12:15.556830+0000","last_fullsized":"2023-12-12T10:12:15.556830+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_clean_scrub_stamp":"2023-12-12T10:12:12.929940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:44:39.253218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:14.178766+0000","last_change":"2023-12-12T10:12:09.839119+0000","last_active":"2023-12-12T10:12:14.178766+0000","last_peered":"2023-12-12T10:12:14.178766+0000","last_clean":"2023-12-12T10:12:14.178766+0000","last_became_active":"2023-12-12T10:12:09.838832+0000","last_became_peered":"2023-12-12T10:12:09.838832+0000","last_unstale":"2023-12-12T10:12:14.178766+0000","last_undegraded":"2023-12-12T10:12:14.178766+0000","last_fullsized":"2023-12-12T10:12:14.178766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:06:52.618740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.955540+0000","last_change":"2023-12-12T10:12:08.832946+0000","last_active":"2023-12-12T10:12:13.955540+0000","last_peered":"2023-12-12T10:12:13.955540+0000","last_clean":"2023-12-12T10:12:13.955540+0000","last_became_active":"2023-12-12T10:12:08.832657+0000","last_became_peered":"2023-12-12T10:12:08.832657+0000","last_unstale":"2023-12-12T10:12:13.955540+0000","last_undegraded":"2023-12-12T10:12:13.955540+0000","last_fullsized":"2023-12-12T10:12:13.955540+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_clean_scrub_stamp":"2023-12-12T10:12:07.792253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:45:52.005263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-12T10:12:15.556971+0000","last_change":"2023-12-12T10:12:14.183490+0000","last_active":"2023-12-12T10:12:15.556971+0000","last_peered":"2023-12-12T10:12:15.556971+0000","last_clean":"2023-12-12T10:12:15.556971+0000","last_became_active":"2023-12-12T10:12:14.182333+0000","last_became_peered":"2023-12-12T10:12:14.182333+0000","last_unstale":"2023-12-12T10:12:15.556971+0000","last_undegraded":"2023-12-12T10:12:15.556971+0000","last_fullsized":"2023-12-12T10:12:15.556971+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_clean_scrub_stamp":"2023-12-12T10:12:12.929940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:04:36.664695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.954813+0000","last_change":"2023-12-12T10:12:09.829410+0000","last_active":"2023-12-12T10:12:13.954813+0000","last_peered":"2023-12-12T10:12:13.954813+0000","last_clean":"2023-12-12T10:12:13.954813+0000","last_became_active":"2023-12-12T10:12:09.829144+0000","last_became_peered":"2023-12-12T10:12:09.829144+0000","last_unstale":"2023-12-12T10:12:13.954813+0000","last_undegraded":"2023-12-12T10:12:13.954813+0000","last_fullsized":"2023-12-12T10:12:13.954813+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:33:07.947544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.956073+0000","last_change":"2023-12-12T10:12:08.840254+0000","last_active":"2023-12-12T10:12:13.956073+0000","last_peered":"2023-12-12T10:12:13.956073+0000","last_clean":"2023-12-12T10:12:13.956073+0000","last_became_active":"2023-12-12T10:12:08.839962+0000","last_became_peered":"2023-12-12T10:12:08.839962+0000","last_unstale":"2023-12-12T10:12:13.956073+0000","last_undegraded":"2023-12-12T10:12:13.956073+0000","last_fullsized":"2023-12-12T10:12:13.956073+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_clean_scrub_stamp":"2023-12-12T10:12:07.792253+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:46:36.023306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-12T10:12:15.554704+0000","last_change":"2023-12-12T10:12:14.180551+0000","last_active":"2023-12-12T10:12:15.554704+0000","last_peered":"2023-12-12T10:12:15.554704+0000","last_clean":"2023-12-12T10:12:15.554704+0000","last_became_active":"2023-12-12T10:12:14.180147+0000","last_became_peered":"2023-12-12T10:12:14.180147+0000","last_unstale":"2023-12-12T10:12:15.554704+0000","last_undegraded":"2023-12-12T10:12:15.554704+0000","last_fullsized":"2023-12-12T10:12:15.554704+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_clean_scrub_stamp":"2023-12-12T10:12:12.929940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:46:26.737660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:14.178878+0000","last_change":"2023-12-12T10:12:09.840271+0000","last_active":"2023-12-12T10:12:14.178878+0000","last_peered":"2023-12-12T10:12:14.178878+0000","last_clean":"2023-12-12T10:12:14.178878+0000","last_became_active":"2023-12-12T10:12:09.839285+0000","last_became_peered":"2023-12-12T10:12:09.839285+0000","last_unstale":"2023-12-12T10:12:14.178878+0000","last_undegraded":"2023-12-12T10:12:14.178878+0000","last_fullsized":"2023-12-12T10:12:14.178878+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:08:12.099242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-12T10:12:20.479837+0000","last_change":"2023-12-12T10:12:08.833712+0000","last_active":"2023-12-12T10:12:20.479837+0000","last_peered":"2023-12-12T10:12:20.479837+0000","last_clean":"2023-12-12T10:12:20.479837+0000","last_became_active":"2023-12-12T10:12:08.833335+0000","last_became_peered":"2023-12-12T10:12:08.833335+0000","last_unstale":"2023-12-12T10:12:20.479837+0000","last_undegraded":"2023-12-12T10:12:20.479837+0000","last_fullsized":"2023-12-12T10:12:20.479837+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_clean_scrub_stamp":"2023-12-12T10:12:07.792253+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:41:37.226888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3839,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-12T10:12:15.184374+0000","last_change":"2023-12-12T10:12:13.969124+0000","last_active":"2023-12-12T10:12:15.184374+0000","last_peered":"2023-12-12T10:12:15.184374+0000","last_clean":"2023-12-12T10:12:15.184374+0000","last_became_active":"2023-12-12T10:12:13.968588+0000","last_became_peered":"2023-12-12T10:12:13.968588+0000","last_unstale":"2023-12-12T10:12:15.184374+0000","last_undegraded":"2023-12-12T10:12:15.184374+0000","last_fullsized":"2023-12-12T10:12:15.184374+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_clean_scrub_stamp":"2023-12-12T10:12:12.929940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:17:23.880191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.947087+0000","last_change":"2023-12-12T10:12:09.836126+0000","last_active":"2023-12-12T10:12:13.947087+0000","last_peered":"2023-12-12T10:12:13.947087+0000","last_clean":"2023-12-12T10:12:13.947087+0000","last_became_active":"2023-12-12T10:12:09.835866+0000","last_became_peered":"2023-12-12T10:12:09.835866+0000","last_unstale":"2023-12-12T10:12:13.947087+0000","last_undegraded":"2023-12-12T10:12:13.947087+0000","last_fullsized":"2023-12-12T10:12:13.947087+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:01:43.247607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.963472+0000","last_change":"2023-12-12T10:12:08.835844+0000","last_active":"2023-12-12T10:12:13.963472+0000","last_peered":"2023-12-12T10:12:13.963472+0000","last_clean":"2023-12-12T10:12:13.963472+0000","last_became_active":"2023-12-12T10:12:08.835523+0000","last_became_peered":"2023-12-12T10:12:08.835523+0000","last_unstale":"2023-12-12T10:12:13.963472+0000","last_undegraded":"2023-12-12T10:12:13.963472+0000","last_fullsized":"2023-12-12T10:12:13.963472+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_clean_scrub_stamp":"2023-12-12T10:12:07.792253+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:22:26.547358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-12T10:12:14.944351+0000","last_change":"2023-12-12T10:12:13.963846+0000","last_active":"2023-12-12T10:12:14.944351+0000","last_peered":"2023-12-12T10:12:14.944351+0000","last_clean":"2023-12-12T10:12:14.944351+0000","last_became_active":"2023-12-12T10:12:13.963343+0000","last_became_peered":"2023-12-12T10:12:13.963343+0000","last_unstale":"2023-12-12T10:12:14.944351+0000","last_undegraded":"2023-12-12T10:12:14.944351+0000","last_fullsized":"2023-12-12T10:12:14.944351+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_clean_scrub_stamp":"2023-12-12T10:12:12.929940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:47:49.100393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.957119+0000","last_change":"2023-12-12T10:12:09.846702+0000","last_active":"2023-12-12T10:12:13.957119+0000","last_peered":"2023-12-12T10:12:13.957119+0000","last_clean":"2023-12-12T10:12:13.957119+0000","last_became_active":"2023-12-12T10:12:09.846459+0000","last_became_peered":"2023-12-12T10:12:09.846459+0000","last_unstale":"2023-12-12T10:12:13.957119+0000","last_undegraded":"2023-12-12T10:12:13.957119+0000","last_fullsized":"2023-12-12T10:12:13.957119+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:42:17.456979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.955160+0000","last_change":"2023-12-12T10:12:08.843421+0000","last_active":"2023-12-12T10:12:13.955160+0000","last_peered":"2023-12-12T10:12:13.955160+0000","last_clean":"2023-12-12T10:12:13.955160+0000","last_became_active":"2023-12-12T10:12:08.843122+0000","last_became_peered":"2023-12-12T10:12:08.843122+0000","last_unstale":"2023-12-12T10:12:13.955160+0000","last_undegraded":"2023-12-12T10:12:13.955160+0000","last_fullsized":"2023-12-12T10:12:13.955160+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_clean_scrub_stamp":"2023-12-12T10:12:07.792253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:59:45.615605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-12T10:12:15.555918+0000","last_change":"2023-12-12T10:12:13.964875+0000","last_active":"2023-12-12T10:12:15.555918+0000","last_peered":"2023-12-12T10:12:15.555918+0000","last_clean":"2023-12-12T10:12:15.555918+0000","last_became_active":"2023-12-12T10:12:13.964323+0000","last_became_peered":"2023-12-12T10:12:13.964323+0000","last_unstale":"2023-12-12T10:12:15.555918+0000","last_undegraded":"2023-12-12T10:12:15.555918+0000","last_fullsized":"2023-12-12T10:12:15.555918+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_clean_scrub_stamp":"2023-12-12T10:12:12.929940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:35:07.230080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.955023+0000","last_change":"2023-12-12T10:12:09.846552+0000","last_active":"2023-12-12T10:12:13.955023+0000","last_peered":"2023-12-12T10:12:13.955023+0000","last_clean":"2023-12-12T10:12:13.955023+0000","last_became_active":"2023-12-12T10:12:09.844321+0000","last_became_peered":"2023-12-12T10:12:09.844321+0000","last_unstale":"2023-12-12T10:12:13.955023+0000","last_undegraded":"2023-12-12T10:12:13.955023+0000","last_fullsized":"2023-12-12T10:12:13.955023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:47:44.969459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.945152+0000","last_change":"2023-12-12T10:12:08.833577+0000","last_active":"2023-12-12T10:12:13.945152+0000","last_peered":"2023-12-12T10:12:13.945152+0000","last_clean":"2023-12-12T10:12:13.945152+0000","last_became_active":"2023-12-12T10:12:08.833266+0000","last_became_peered":"2023-12-12T10:12:08.833266+0000","last_unstale":"2023-12-12T10:12:13.945152+0000","last_undegraded":"2023-12-12T10:12:13.945152+0000","last_fullsized":"2023-12-12T10:12:13.945152+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_clean_scrub_stamp":"2023-12-12T10:12:07.792253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:50:55.983027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-12T10:12:15.555695+0000","last_change":"2023-12-12T10:12:14.187838+0000","last_active":"2023-12-12T10:12:15.555695+0000","last_peered":"2023-12-12T10:12:15.555695+0000","last_clean":"2023-12-12T10:12:15.555695+0000","last_became_active":"2023-12-12T10:12:14.187430+0000","last_became_peered":"2023-12-12T10:12:14.187430+0000","last_unstale":"2023-12-12T10:12:15.555695+0000","last_undegraded":"2023-12-12T10:12:15.555695+0000","last_fullsized":"2023-12-12T10:12:15.555695+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_clean_scrub_stamp":"2023-12-12T10:12:12.929940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:10:11.022165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-12T10:12:15.557056+0000","last_change":"2023-12-12T10:12:14.186204+0000","last_active":"2023-12-12T10:12:15.557056+0000","last_peered":"2023-12-12T10:12:15.557056+0000","last_clean":"2023-12-12T10:12:15.557056+0000","last_became_active":"2023-12-12T10:12:14.185264+0000","last_became_peered":"2023-12-12T10:12:14.185264+0000","last_unstale":"2023-12-12T10:12:15.557056+0000","last_undegraded":"2023-12-12T10:12:15.557056+0000","last_fullsized":"2023-12-12T10:12:15.557056+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_clean_scrub_stamp":"2023-12-12T10:12:12.929940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:17:23.880191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.960807+0000","last_change":"2023-12-12T10:12:09.829976+0000","last_active":"2023-12-12T10:12:13.960807+0000","last_peered":"2023-12-12T10:12:13.960807+0000","last_clean":"2023-12-12T10:12:13.960807+0000","last_became_active":"2023-12-12T10:12:09.829573+0000","last_became_peered":"2023-12-12T10:12:09.829573+0000","last_unstale":"2023-12-12T10:12:13.960807+0000","last_undegraded":"2023-12-12T10:12:13.960807+0000","last_fullsized":"2023-12-12T10:12:13.960807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:05:45.545567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.954582+0000","last_change":"2023-12-12T10:12:08.820896+0000","last_active":"2023-12-12T10:12:13.954582+0000","last_peered":"2023-12-12T10:12:13.954582+0000","last_clean":"2023-12-12T10:12:13.954582+0000","last_became_active":"2023-12-12T10:12:08.819705+0000","last_became_peered":"2023-12-12T10:12:08.819705+0000","last_unstale":"2023-12-12T10:12:13.954582+0000","last_undegraded":"2023-12-12T10:12:13.954582+0000","last_fullsized":"2023-12-12T10:12:13.954582+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_clean_scrub_stamp":"2023-12-12T10:12:07.792253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:14:21.574354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-12T10:12:14.944814+0000","last_change":"2023-12-12T10:12:13.966284+0000","last_active":"2023-12-12T10:12:14.944814+0000","last_peered":"2023-12-12T10:12:14.944814+0000","last_clean":"2023-12-12T10:12:14.944814+0000","last_became_active":"2023-12-12T10:12:13.965836+0000","last_became_peered":"2023-12-12T10:12:13.965836+0000","last_unstale":"2023-12-12T10:12:14.944814+0000","last_undegraded":"2023-12-12T10:12:14.944814+0000","last_fullsized":"2023-12-12T10:12:14.944814+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_clean_scrub_stamp":"2023-12-12T10:12:12.929940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:29:09.752788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.942530+0000","last_change":"2023-12-12T10:12:09.836385+0000","last_active":"2023-12-12T10:12:13.942530+0000","last_peered":"2023-12-12T10:12:13.942530+0000","last_clean":"2023-12-12T10:12:13.942530+0000","last_became_active":"2023-12-12T10:12:09.836038+0000","last_became_peered":"2023-12-12T10:12:09.836038+0000","last_unstale":"2023-12-12T10:12:13.942530+0000","last_undegraded":"2023-12-12T10:12:13.942530+0000","last_fullsized":"2023-12-12T10:12:13.942530+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:08:12.099242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.942840+0000","last_change":"2023-12-12T10:12:08.842624+0000","last_active":"2023-12-12T10:12:13.942840+0000","last_peered":"2023-12-12T10:12:13.942840+0000","last_clean":"2023-12-12T10:12:13.942840+0000","last_became_active":"2023-12-12T10:12:08.842340+0000","last_became_peered":"2023-12-12T10:12:08.842340+0000","last_unstale":"2023-12-12T10:12:13.942840+0000","last_undegraded":"2023-12-12T10:12:13.942840+0000","last_fullsized":"2023-12-12T10:12:13.942840+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_clean_scrub_stamp":"2023-12-12T10:12:07.792253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:43:30.327223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.942405+0000","last_change":"2023-12-12T10:12:08.828385+0000","last_active":"2023-12-12T10:12:13.942405+0000","last_peered":"2023-12-12T10:12:13.942405+0000","last_clean":"2023-12-12T10:12:13.942405+0000","last_became_active":"2023-12-12T10:12:08.828078+0000","last_became_peered":"2023-12-12T10:12:08.828078+0000","last_unstale":"2023-12-12T10:12:13.942405+0000","last_undegraded":"2023-12-12T10:12:13.942405+0000","last_fullsized":"2023-12-12T10:12:13.942405+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_clean_scrub_stamp":"2023-12-12T10:12:07.792253+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:46:36.023306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.955847+0000","last_change":"2023-12-12T10:12:09.839770+0000","last_active":"2023-12-12T10:12:13.955847+0000","last_peered":"2023-12-12T10:12:13.955847+0000","last_clean":"2023-12-12T10:12:13.955847+0000","last_became_active":"2023-12-12T10:12:09.838270+0000","last_became_peered":"2023-12-12T10:12:09.838270+0000","last_unstale":"2023-12-12T10:12:13.955847+0000","last_undegraded":"2023-12-12T10:12:13.955847+0000","last_fullsized":"2023-12-12T10:12:13.955847+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:05:45.545567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-12T10:12:14.944264+0000","last_change":"2023-12-12T10:12:13.976903+0000","last_active":"2023-12-12T10:12:14.944264+0000","last_peered":"2023-12-12T10:12:14.944264+0000","last_clean":"2023-12-12T10:12:14.944264+0000","last_became_active":"2023-12-12T10:12:13.976414+0000","last_became_peered":"2023-12-12T10:12:13.976414+0000","last_unstale":"2023-12-12T10:12:14.944264+0000","last_undegraded":"2023-12-12T10:12:14.944264+0000","last_fullsized":"2023-12-12T10:12:14.944264+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_clean_scrub_stamp":"2023-12-12T10:12:12.929940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:22:31.685044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.943480+0000","last_change":"2023-12-12T10:12:08.841907+0000","last_active":"2023-12-12T10:12:13.943480+0000","last_peered":"2023-12-12T10:12:13.943480+0000","last_clean":"2023-12-12T10:12:13.943480+0000","last_became_active":"2023-12-12T10:12:08.841597+0000","last_became_peered":"2023-12-12T10:12:08.841597+0000","last_unstale":"2023-12-12T10:12:13.943480+0000","last_undegraded":"2023-12-12T10:12:13.943480+0000","last_fullsized":"2023-12-12T10:12:13.943480+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:07.792253+0000","last_clean_scrub_stamp":"2023-12-12T10:12:07.792253+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:50:55.983027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.945193+0000","last_change":"2023-12-12T10:12:09.825457+0000","last_active":"2023-12-12T10:12:13.945193+0000","last_peered":"2023-12-12T10:12:13.945193+0000","last_clean":"2023-12-12T10:12:13.945193+0000","last_became_active":"2023-12-12T10:12:09.824655+0000","last_became_peered":"2023-12-12T10:12:09.824655+0000","last_unstale":"2023-12-12T10:12:13.945193+0000","last_undegraded":"2023-12-12T10:12:13.945193+0000","last_fullsized":"2023-12-12T10:12:13.945193+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:46:37.030058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-12T10:12:15.556592+0000","last_change":"2023-12-12T10:12:13.978242+0000","last_active":"2023-12-12T10:12:15.556592+0000","last_peered":"2023-12-12T10:12:15.556592+0000","last_clean":"2023-12-12T10:12:15.556592+0000","last_became_active":"2023-12-12T10:12:13.977875+0000","last_became_peered":"2023-12-12T10:12:13.977875+0000","last_unstale":"2023-12-12T10:12:15.556592+0000","last_undegraded":"2023-12-12T10:12:15.556592+0000","last_fullsized":"2023-12-12T10:12:15.556592+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:12.929940+0000","last_clean_scrub_stamp":"2023-12-12T10:12:12.929940+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:36:01.186241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.945551+0000","last_change":"2023-12-12T10:12:09.825518+0000","last_active":"2023-12-12T10:12:13.945551+0000","last_peered":"2023-12-12T10:12:13.945551+0000","last_clean":"2023-12-12T10:12:13.945551+0000","last_became_active":"2023-12-12T10:12:09.822775+0000","last_became_peered":"2023-12-12T10:12:09.822775+0000","last_unstale":"2023-12-12T10:12:13.945551+0000","last_undegraded":"2023-12-12T10:12:13.945551+0000","last_fullsized":"2023-12-12T10:12:13.945551+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:24:13.207348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.965244+0000","last_change":"2023-12-12T10:12:09.844690+0000","last_active":"2023-12-12T10:12:13.965244+0000","last_peered":"2023-12-12T10:12:13.965244+0000","last_clean":"2023-12-12T10:12:13.965244+0000","last_became_active":"2023-12-12T10:12:09.844429+0000","last_became_peered":"2023-12-12T10:12:09.844429+0000","last_unstale":"2023-12-12T10:12:13.965244+0000","last_undegraded":"2023-12-12T10:12:13.965244+0000","last_fullsized":"2023-12-12T10:12:13.965244+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:46:37.030058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.955446+0000","last_change":"2023-12-12T10:12:09.838818+0000","last_active":"2023-12-12T10:12:13.955446+0000","last_peered":"2023-12-12T10:12:13.955446+0000","last_clean":"2023-12-12T10:12:13.955446+0000","last_became_active":"2023-12-12T10:12:09.838507+0000","last_became_peered":"2023-12-12T10:12:09.838507+0000","last_unstale":"2023-12-12T10:12:13.955446+0000","last_undegraded":"2023-12-12T10:12:13.955446+0000","last_fullsized":"2023-12-12T10:12:13.955446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:08:12.099242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.955753+0000","last_change":"2023-12-12T10:12:09.831070+0000","last_active":"2023-12-12T10:12:13.955753+0000","last_peered":"2023-12-12T10:12:13.955753+0000","last_clean":"2023-12-12T10:12:13.955753+0000","last_became_active":"2023-12-12T10:12:09.830702+0000","last_became_peered":"2023-12-12T10:12:09.830702+0000","last_unstale":"2023-12-12T10:12:13.955753+0000","last_undegraded":"2023-12-12T10:12:13.955753+0000","last_fullsized":"2023-12-12T10:12:13.955753+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:24:13.207348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.944609+0000","last_change":"2023-12-12T10:12:09.839496+0000","last_active":"2023-12-12T10:12:13.944609+0000","last_peered":"2023-12-12T10:12:13.944609+0000","last_clean":"2023-12-12T10:12:13.944609+0000","last_became_active":"2023-12-12T10:12:09.839184+0000","last_became_peered":"2023-12-12T10:12:09.839184+0000","last_unstale":"2023-12-12T10:12:13.944609+0000","last_undegraded":"2023-12-12T10:12:13.944609+0000","last_fullsized":"2023-12-12T10:12:13.944609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:14:22.581107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.963351+0000","last_change":"2023-12-12T10:12:09.833470+0000","last_active":"2023-12-12T10:12:13.963351+0000","last_peered":"2023-12-12T10:12:13.963351+0000","last_clean":"2023-12-12T10:12:13.963351+0000","last_became_active":"2023-12-12T10:12:09.833154+0000","last_became_peered":"2023-12-12T10:12:09.833154+0000","last_unstale":"2023-12-12T10:12:13.963351+0000","last_undegraded":"2023-12-12T10:12:13.963351+0000","last_fullsized":"2023-12-12T10:12:13.963351+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:42:17.456979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.945149+0000","last_change":"2023-12-12T10:12:09.826435+0000","last_active":"2023-12-12T10:12:13.945149+0000","last_peered":"2023-12-12T10:12:13.945149+0000","last_clean":"2023-12-12T10:12:13.945149+0000","last_became_active":"2023-12-12T10:12:09.826055+0000","last_became_peered":"2023-12-12T10:12:09.826055+0000","last_unstale":"2023-12-12T10:12:13.945149+0000","last_undegraded":"2023-12-12T10:12:13.945149+0000","last_fullsized":"2023-12-12T10:12:13.945149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:29:34.002418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.947105+0000","last_change":"2023-12-12T10:12:09.835389+0000","last_active":"2023-12-12T10:12:13.947105+0000","last_peered":"2023-12-12T10:12:13.947105+0000","last_clean":"2023-12-12T10:12:13.947105+0000","last_became_active":"2023-12-12T10:12:09.835119+0000","last_became_peered":"2023-12-12T10:12:09.835119+0000","last_unstale":"2023-12-12T10:12:13.947105+0000","last_undegraded":"2023-12-12T10:12:13.947105+0000","last_fullsized":"2023-12-12T10:12:13.947105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:29:34.002418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.953512+0000","last_change":"2023-12-12T10:12:09.840058+0000","last_active":"2023-12-12T10:12:13.953512+0000","last_peered":"2023-12-12T10:12:13.953512+0000","last_clean":"2023-12-12T10:12:13.953512+0000","last_became_active":"2023-12-12T10:12:09.839675+0000","last_became_peered":"2023-12-12T10:12:09.839675+0000","last_unstale":"2023-12-12T10:12:13.953512+0000","last_undegraded":"2023-12-12T10:12:13.953512+0000","last_fullsized":"2023-12-12T10:12:13.953512+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:29:34.002418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.942739+0000","last_change":"2023-12-12T10:12:09.842044+0000","last_active":"2023-12-12T10:12:13.942739+0000","last_peered":"2023-12-12T10:12:13.942739+0000","last_clean":"2023-12-12T10:12:13.942739+0000","last_became_active":"2023-12-12T10:12:09.841751+0000","last_became_peered":"2023-12-12T10:12:09.841751+0000","last_unstale":"2023-12-12T10:12:13.942739+0000","last_undegraded":"2023-12-12T10:12:13.942739+0000","last_fullsized":"2023-12-12T10:12:13.942739+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:42:17.456979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.955340+0000","last_change":"2023-12-12T10:12:09.835927+0000","last_active":"2023-12-12T10:12:13.955340+0000","last_peered":"2023-12-12T10:12:13.955340+0000","last_clean":"2023-12-12T10:12:13.955340+0000","last_became_active":"2023-12-12T10:12:09.835625+0000","last_became_peered":"2023-12-12T10:12:09.835625+0000","last_unstale":"2023-12-12T10:12:13.955340+0000","last_undegraded":"2023-12-12T10:12:13.955340+0000","last_fullsized":"2023-12-12T10:12:13.955340+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:22:56.063355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.955249+0000","last_change":"2023-12-12T10:12:09.834124+0000","last_active":"2023-12-12T10:12:13.955249+0000","last_peered":"2023-12-12T10:12:13.955249+0000","last_clean":"2023-12-12T10:12:13.955249+0000","last_became_active":"2023-12-12T10:12:09.833698+0000","last_became_peered":"2023-12-12T10:12:09.833698+0000","last_unstale":"2023-12-12T10:12:13.955249+0000","last_undegraded":"2023-12-12T10:12:13.955249+0000","last_fullsized":"2023-12-12T10:12:13.955249+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:45:53.012016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.944483+0000","last_change":"2023-12-12T10:12:09.831637+0000","last_active":"2023-12-12T10:12:13.944483+0000","last_peered":"2023-12-12T10:12:13.944483+0000","last_clean":"2023-12-12T10:12:13.944483+0000","last_became_active":"2023-12-12T10:12:09.831330+0000","last_became_peered":"2023-12-12T10:12:09.831330+0000","last_unstale":"2023-12-12T10:12:13.944483+0000","last_undegraded":"2023-12-12T10:12:13.944483+0000","last_fullsized":"2023-12-12T10:12:13.944483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:45:53.012016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:14.179084+0000","last_change":"2023-12-12T10:12:09.832795+0000","last_active":"2023-12-12T10:12:14.179084+0000","last_peered":"2023-12-12T10:12:14.179084+0000","last_clean":"2023-12-12T10:12:14.179084+0000","last_became_active":"2023-12-12T10:12:09.832536+0000","last_became_peered":"2023-12-12T10:12:09.832536+0000","last_unstale":"2023-12-12T10:12:14.179084+0000","last_undegraded":"2023-12-12T10:12:14.179084+0000","last_fullsized":"2023-12-12T10:12:14.179084+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:17:19.749257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.967788+0000","last_change":"2023-12-12T10:12:09.836093+0000","last_active":"2023-12-12T10:12:13.967788+0000","last_peered":"2023-12-12T10:12:13.967788+0000","last_clean":"2023-12-12T10:12:13.967788+0000","last_became_active":"2023-12-12T10:12:09.835900+0000","last_became_peered":"2023-12-12T10:12:09.835900+0000","last_unstale":"2023-12-12T10:12:13.967788+0000","last_undegraded":"2023-12-12T10:12:13.967788+0000","last_fullsized":"2023-12-12T10:12:13.967788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:41:38.233640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.955513+0000","last_change":"2023-12-12T10:12:09.842078+0000","last_active":"2023-12-12T10:12:13.955513+0000","last_peered":"2023-12-12T10:12:13.955513+0000","last_clean":"2023-12-12T10:12:13.955513+0000","last_became_active":"2023-12-12T10:12:09.841393+0000","last_became_peered":"2023-12-12T10:12:09.841393+0000","last_unstale":"2023-12-12T10:12:13.955513+0000","last_undegraded":"2023-12-12T10:12:13.955513+0000","last_fullsized":"2023-12-12T10:12:13.955513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:11:15.110991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.953508+0000","last_change":"2023-12-12T10:12:09.835453+0000","last_active":"2023-12-12T10:12:13.953508+0000","last_peered":"2023-12-12T10:12:13.953508+0000","last_clean":"2023-12-12T10:12:13.953508+0000","last_became_active":"2023-12-12T10:12:09.835078+0000","last_became_peered":"2023-12-12T10:12:09.835078+0000","last_unstale":"2023-12-12T10:12:13.953508+0000","last_undegraded":"2023-12-12T10:12:13.953508+0000","last_fullsized":"2023-12-12T10:12:13.953508+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:42:17.456979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.960892+0000","last_change":"2023-12-12T10:12:09.836102+0000","last_active":"2023-12-12T10:12:13.960892+0000","last_peered":"2023-12-12T10:12:13.960892+0000","last_clean":"2023-12-12T10:12:13.960892+0000","last_became_active":"2023-12-12T10:12:09.835809+0000","last_became_peered":"2023-12-12T10:12:09.835809+0000","last_unstale":"2023-12-12T10:12:13.960892+0000","last_undegraded":"2023-12-12T10:12:13.960892+0000","last_fullsized":"2023-12-12T10:12:13.960892+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:29:34.002418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.954718+0000","last_change":"2023-12-12T10:12:09.825563+0000","last_active":"2023-12-12T10:12:13.954718+0000","last_peered":"2023-12-12T10:12:13.954718+0000","last_clean":"2023-12-12T10:12:13.954718+0000","last_became_active":"2023-12-12T10:12:09.825296+0000","last_became_peered":"2023-12-12T10:12:09.825296+0000","last_unstale":"2023-12-12T10:12:13.954718+0000","last_undegraded":"2023-12-12T10:12:13.954718+0000","last_fullsized":"2023-12-12T10:12:13.954718+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:50:56.989780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.942544+0000","last_change":"2023-12-12T10:12:09.834352+0000","last_active":"2023-12-12T10:12:13.942544+0000","last_peered":"2023-12-12T10:12:13.942544+0000","last_clean":"2023-12-12T10:12:13.942544+0000","last_became_active":"2023-12-12T10:12:09.834163+0000","last_became_peered":"2023-12-12T10:12:09.834163+0000","last_unstale":"2023-12-12T10:12:13.942544+0000","last_undegraded":"2023-12-12T10:12:13.942544+0000","last_fullsized":"2023-12-12T10:12:13.942544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:45:53.012016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.946993+0000","last_change":"2023-12-12T10:12:09.833417+0000","last_active":"2023-12-12T10:12:13.946993+0000","last_peered":"2023-12-12T10:12:13.946993+0000","last_clean":"2023-12-12T10:12:13.946993+0000","last_became_active":"2023-12-12T10:12:09.833065+0000","last_became_peered":"2023-12-12T10:12:09.833065+0000","last_unstale":"2023-12-12T10:12:13.946993+0000","last_undegraded":"2023-12-12T10:12:13.946993+0000","last_fullsized":"2023-12-12T10:12:13.946993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:05:34.562768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.945203+0000","last_change":"2023-12-12T10:12:09.847547+0000","last_active":"2023-12-12T10:12:13.945203+0000","last_peered":"2023-12-12T10:12:13.945203+0000","last_clean":"2023-12-12T10:12:13.945203+0000","last_became_active":"2023-12-12T10:12:09.847242+0000","last_became_peered":"2023-12-12T10:12:09.847242+0000","last_unstale":"2023-12-12T10:12:13.945203+0000","last_undegraded":"2023-12-12T10:12:13.945203+0000","last_fullsized":"2023-12-12T10:12:13.945203+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:59:46.622358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.945295+0000","last_change":"2023-12-12T10:12:09.845347+0000","last_active":"2023-12-12T10:12:13.945295+0000","last_peered":"2023-12-12T10:12:13.945295+0000","last_clean":"2023-12-12T10:12:13.945295+0000","last_became_active":"2023-12-12T10:12:09.845043+0000","last_became_peered":"2023-12-12T10:12:09.845043+0000","last_unstale":"2023-12-12T10:12:13.945295+0000","last_undegraded":"2023-12-12T10:12:13.945295+0000","last_fullsized":"2023-12-12T10:12:13.945295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:42:17.456979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:14.179662+0000","last_change":"2023-12-12T10:12:09.846679+0000","last_active":"2023-12-12T10:12:14.179662+0000","last_peered":"2023-12-12T10:12:14.179662+0000","last_clean":"2023-12-12T10:12:14.179662+0000","last_became_active":"2023-12-12T10:12:09.846392+0000","last_became_peered":"2023-12-12T10:12:09.846392+0000","last_unstale":"2023-12-12T10:12:14.179662+0000","last_undegraded":"2023-12-12T10:12:14.179662+0000","last_fullsized":"2023-12-12T10:12:14.179662+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:51:42.379319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.941904+0000","last_change":"2023-12-12T10:12:09.839337+0000","last_active":"2023-12-12T10:12:13.941904+0000","last_peered":"2023-12-12T10:12:13.941904+0000","last_clean":"2023-12-12T10:12:13.941904+0000","last_became_active":"2023-12-12T10:12:09.838987+0000","last_became_peered":"2023-12-12T10:12:09.838987+0000","last_unstale":"2023-12-12T10:12:13.941904+0000","last_undegraded":"2023-12-12T10:12:13.941904+0000","last_fullsized":"2023-12-12T10:12:13.941904+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:22:56.063355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:14.178541+0000","last_change":"2023-12-12T10:12:09.827527+0000","last_active":"2023-12-12T10:12:14.178541+0000","last_peered":"2023-12-12T10:12:14.178541+0000","last_clean":"2023-12-12T10:12:14.178541+0000","last_became_active":"2023-12-12T10:12:09.827216+0000","last_became_peered":"2023-12-12T10:12:09.827216+0000","last_unstale":"2023-12-12T10:12:14.178541+0000","last_undegraded":"2023-12-12T10:12:14.178541+0000","last_fullsized":"2023-12-12T10:12:14.178541+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:47:44.969459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.955227+0000","last_change":"2023-12-12T10:12:09.835033+0000","last_active":"2023-12-12T10:12:13.955227+0000","last_peered":"2023-12-12T10:12:13.955227+0000","last_clean":"2023-12-12T10:12:13.955227+0000","last_became_active":"2023-12-12T10:12:09.834115+0000","last_became_peered":"2023-12-12T10:12:09.834115+0000","last_unstale":"2023-12-12T10:12:13.955227+0000","last_undegraded":"2023-12-12T10:12:13.955227+0000","last_fullsized":"2023-12-12T10:12:13.955227+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T22:01:05.110732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:14.178670+0000","last_change":"2023-12-12T10:12:09.831879+0000","last_active":"2023-12-12T10:12:14.178670+0000","last_peered":"2023-12-12T10:12:14.178670+0000","last_clean":"2023-12-12T10:12:14.178670+0000","last_became_active":"2023-12-12T10:12:09.831596+0000","last_became_peered":"2023-12-12T10:12:09.831596+0000","last_unstale":"2023-12-12T10:12:14.178670+0000","last_undegraded":"2023-12-12T10:12:14.178670+0000","last_fullsized":"2023-12-12T10:12:14.178670+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:29:05.621853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.954769+0000","last_change":"2023-12-12T10:12:09.844712+0000","last_active":"2023-12-12T10:12:13.954769+0000","last_peered":"2023-12-12T10:12:13.954769+0000","last_clean":"2023-12-12T10:12:13.954769+0000","last_became_active":"2023-12-12T10:12:09.843173+0000","last_became_peered":"2023-12-12T10:12:09.843173+0000","last_unstale":"2023-12-12T10:12:13.954769+0000","last_undegraded":"2023-12-12T10:12:13.954769+0000","last_fullsized":"2023-12-12T10:12:13.954769+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:45:57.506196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.955973+0000","last_change":"2023-12-12T10:12:09.833009+0000","last_active":"2023-12-12T10:12:13.955973+0000","last_peered":"2023-12-12T10:12:13.955973+0000","last_clean":"2023-12-12T10:12:13.955973+0000","last_became_active":"2023-12-12T10:12:09.832730+0000","last_became_peered":"2023-12-12T10:12:09.832730+0000","last_unstale":"2023-12-12T10:12:13.955973+0000","last_undegraded":"2023-12-12T10:12:13.955973+0000","last_fullsized":"2023-12-12T10:12:13.955973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:14:22.581107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:13.962427+0000","last_change":"2023-12-12T10:12:09.832531+0000","last_active":"2023-12-12T10:12:13.962427+0000","last_peered":"2023-12-12T10:12:13.962427+0000","last_clean":"2023-12-12T10:12:13.962427+0000","last_became_active":"2023-12-12T10:12:09.831562+0000","last_became_peered":"2023-12-12T10:12:09.831562+0000","last_unstale":"2023-12-12T10:12:13.962427+0000","last_undegraded":"2023-12-12T10:12:13.962427+0000","last_fullsized":"2023-12-12T10:12:13.962427+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T22:01:05.110732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-12-12T10:12:14.179520+0000","last_change":"2023-12-12T10:12:09.832536+0000","last_active":"2023-12-12T10:12:14.179520+0000","last_peered":"2023-12-12T10:12:14.179520+0000","last_clean":"2023-12-12T10:12:14.179520+0000","last_became_active":"2023-12-12T10:12:09.832284+0000","last_became_peered":"2023-12-12T10:12:09.832284+0000","last_unstale":"2023-12-12T10:12:14.179520+0000","last_undegraded":"2023-12-12T10:12:14.179520+0000","last_fullsized":"2023-12-12T10:12:14.179520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:12:08.799005+0000","last_clean_scrub_stamp":"2023-12-12T10:12:08.799005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:03:50.236121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4637,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9274,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":851968,"data_stored":690742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69999999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.751}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79000000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":258048,"data_stored":99882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82499999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":266240,"data_stored":99918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67600000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.754}]}]},{"osd":3,"up_from":13,"seq":55834574857,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.879}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81100000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84199999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574859,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":253952,"data_stored":99792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.317}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34399999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59099999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":262144,"data_stored":99952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574858,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":836,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":856064,"data_stored":689829,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-12T10:12:32.972 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-12-12T10:12:32.972 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-12-12T10:12:32.972 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-12-12T10:12:32.972 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-12-12T10:12:33.148 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.142+0000 7f710ee32640 1 Processor -- start 2023-12-12T10:12:33.149 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.142+0000 7f710ee32640 1 -- start start 2023-12-12T10:12:33.150 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.142+0000 7f710ee32640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f71080cb7e0 0x7f71080b40c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:33.150 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.142+0000 7f710ee32640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f71080b4600 0x7f71081580a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:33.150 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.142+0000 7f710ee32640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71080ae1f0 con 0x7f71080ade10 2023-12-12T10:12:33.150 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.142+0000 7f710ee32640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71080b4a70 con 0x7f71080cb7e0 2023-12-12T10:12:33.150 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.142+0000 7f710ee32640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f710815c410 con 0x7f71080b4600 2023-12-12T10:12:33.150 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.142+0000 7f710cbce640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f71080ade10 0x7f71080ce5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:34346/0 (socket says 172.21.15.78:34346) 2023-12-12T10:12:33.150 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.142+0000 7f710cbce640 1 -- 172.21.15.78:0/3054989719 learned_addr learned my addr 172.21.15.78:0/3054989719 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-12-12T10:12:33.150 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.142+0000 7f7107fff640 1 --2- 172.21.15.78:0/3054989719 >> v2:172.21.15.78:3300/0 conn(0x7f71080cb7e0 0x7f71080b40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:33.151 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.142+0000 7f710d3cf640 1 --2- 172.21.15.78:0/3054989719 >> v2:172.21.15.187:3300/0 conn(0x7f71080b4600 0x7f71081580a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:33.151 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.142+0000 7f7107fff640 1 -- 172.21.15.78:0/3054989719 >> v2:172.21.15.187:3300/0 conn(0x7f71080b4600 msgr2=0x7f71081580a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:33.151 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.142+0000 7f7107fff640 1 --2- 172.21.15.78:0/3054989719 >> v2:172.21.15.187:3300/0 conn(0x7f71080b4600 0x7f71081580a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:33.151 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.142+0000 7f7107fff640 1 -- 172.21.15.78:0/3054989719 >> v1:172.21.15.78:6789/0 conn(0x7f71080ade10 legacy=0x7f71080ce5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:33.151 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.142+0000 7f7107fff640 1 -- 172.21.15.78:0/3054989719 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f710815b800 con 0x7f71080cb7e0 2023-12-12T10:12:33.151 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.142+0000 7f710d3cf640 1 --2- 172.21.15.78:0/3054989719 >> v2:172.21.15.187:3300/0 conn(0x7f71080b4600 0x7f71081580a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T10:12:33.151 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.142+0000 7f71077fe640 1 -- 172.21.15.78:0/3054989719 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1561359625 0 0) 0x7f71080ae1f0 con 0x7f71080ade10 2023-12-12T10:12:33.153 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.146+0000 7f7107fff640 1 --2- 172.21.15.78:0/3054989719 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f71080cb7e0 0x7f71080b40c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f71080cbf20 tx=0x7f70f401c280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0abc7faf901088f server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:33.153 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.146+0000 7f71077fe640 1 -- 172.21.15.78:0/3054989719 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f40ab400 con 0x7f71080cb7e0 2023-12-12T10:12:33.153 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.146+0000 7f71077fe640 1 -- 172.21.15.78:0/3054989719 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70f40a7050 con 0x7f71080cb7e0 2023-12-12T10:12:33.153 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.146+0000 7f71077fe640 1 -- 172.21.15.78:0/3054989719 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f40ab780 con 0x7f71080cb7e0 2023-12-12T10:12:33.154 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.146+0000 7f710ee32640 1 -- 172.21.15.78:0/3054989719 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f71080cb7e0 msgr2=0x7f71080b40c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:33.154 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.146+0000 7f710ee32640 1 --2- 172.21.15.78:0/3054989719 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f71080cb7e0 0x7f71080b40c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f71080cbf20 tx=0x7f70f401c280 comp rx=0 tx=0).stop 2023-12-12T10:12:33.154 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.146+0000 7f710ee32640 1 -- 172.21.15.78:0/3054989719 shutdown_connections 2023-12-12T10:12:33.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.146+0000 7f710ee32640 1 --2- 172.21.15.78:0/3054989719 >> v2:172.21.15.187:3300/0 conn(0x7f71080b4600 0x7f71081580a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:33.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.146+0000 7f710ee32640 1 --2- 172.21.15.78:0/3054989719 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f71080cb7e0 0x7f71080b40c0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:33.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.146+0000 7f710ee32640 1 -- 172.21.15.78:0/3054989719 >> 172.21.15.78:0/3054989719 conn(0x7f710806c5d0 msgr2=0x7f710806c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:33.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.146+0000 7f710ee32640 1 -- 172.21.15.78:0/3054989719 shutdown_connections 2023-12-12T10:12:33.155 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.146+0000 7f710ee32640 1 -- 172.21.15.78:0/3054989719 wait complete. 2023-12-12T10:12:33.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.150+0000 7f710ee32640 1 Processor -- start 2023-12-12T10:12:33.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.150+0000 7f710ee32640 1 -- start start 2023-12-12T10:12:33.159 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.150+0000 7f710ee32640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f71080ade10 0x7f710814f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:33.159 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.150+0000 7f710ee32640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f71080b4600 0x7f71081f5c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:33.159 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.150+0000 7f710ee32640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f71080cb7e0 0x7f71080ae920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:33.159 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.150+0000 7f710ee32640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71080af5d0 con 0x7f71080cb7e0 2023-12-12T10:12:33.159 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.150+0000 7f710ee32640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f710814fa00 con 0x7f71080ade10 2023-12-12T10:12:33.159 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.150+0000 7f710ee32640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71080b1fe0 con 0x7f71080b4600 2023-12-12T10:12:33.159 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.150+0000 7f710d3cf640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f71080cb7e0 0x7f71080ae920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:33.159 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.150+0000 7f710d3cf640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f71080cb7e0 0x7f71080ae920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37280/0 (socket says 172.21.15.78:37280) 2023-12-12T10:12:33.159 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.150+0000 7f710d3cf640 1 -- 172.21.15.78:0/1943661120 learned_addr learned my addr 172.21.15.78:0/1943661120 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:33.159 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.150+0000 7f710cbce640 1 --2- 172.21.15.78:0/1943661120 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f71080ade10 0x7f710814f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:33.159 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.150+0000 7f7107fff640 1 --2- 172.21.15.78:0/1943661120 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f71080b4600 0x7f71081f5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:33.159 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.150+0000 7f710d3cf640 1 -- 172.21.15.78:0/1943661120 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f71080b4600 msgr2=0x7f71081f5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:33.160 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.150+0000 7f710d3cf640 1 --2- 172.21.15.78:0/1943661120 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f71080b4600 0x7f71081f5c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:33.160 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.150+0000 7f710d3cf640 1 -- 172.21.15.78:0/1943661120 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f71080ade10 msgr2=0x7f710814f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:33.160 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.150+0000 7f710d3cf640 1 --2- 172.21.15.78:0/1943661120 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f71080ade10 0x7f710814f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:33.160 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.150+0000 7f710d3cf640 1 -- 172.21.15.78:0/1943661120 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70f4009420 con 0x7f71080cb7e0 2023-12-12T10:12:33.160 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.150+0000 7f710d3cf640 1 --2- 172.21.15.78:0/1943661120 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f71080cb7e0 0x7f71080ae920 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f710000cef0 tx=0x7f710000a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:33.160 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.150+0000 7f71057fa640 1 -- 172.21.15.78:0/1943661120 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f710000d840 con 0x7f71080cb7e0 2023-12-12T10:12:33.160 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.150+0000 7f71057fa640 1 -- 172.21.15.78:0/1943661120 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f710000d9c0 con 0x7f71080cb7e0 2023-12-12T10:12:33.160 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.150+0000 7f71057fa640 1 -- 172.21.15.78:0/1943661120 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f710000dd70 con 0x7f71080cb7e0 2023-12-12T10:12:33.160 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.150+0000 7f710ee32640 1 -- 172.21.15.78:0/1943661120 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71080b2280 con 0x7f71080cb7e0 2023-12-12T10:12:33.160 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.150+0000 7f710ee32640 1 -- 172.21.15.78:0/1943661120 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71080af1f0 con 0x7f71080cb7e0 2023-12-12T10:12:33.161 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.154+0000 7f710ee32640 1 -- 172.21.15.78:0/1943661120 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71080671f0 con 0x7f71080cb7e0 2023-12-12T10:12:33.161 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.154+0000 7f71057fa640 1 -- 172.21.15.78:0/1943661120 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f710001e3b0 con 0x7f71080cb7e0 2023-12-12T10:12:33.161 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.154+0000 7f71057fa640 1 --2- 172.21.15.78:0/1943661120 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f70ec0664a0 0x7f70ec068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:33.161 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.154+0000 7f71057fa640 1 -- 172.21.15.78:0/1943661120 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7100084bf0 con 0x7f71080cb7e0 2023-12-12T10:12:33.161 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.154+0000 7f710cbce640 1 --2- 172.21.15.78:0/1943661120 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f70ec0664a0 0x7f70ec068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:33.162 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.154+0000 7f710cbce640 1 --2- 172.21.15.78:0/1943661120 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f70ec0664a0 0x7f70ec068960 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f70fc000f70 tx=0x7f70fc007b80 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:33.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.158+0000 7f71057fa640 1 -- 172.21.15.78:0/1943661120 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7100051e30 con 0x7f71080cb7e0 2023-12-12T10:12:33.346 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.338+0000 7f710ee32640 1 -- 172.21.15.78:0/1943661120 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f710815c8a0 con 0x7f71080cb7e0 2023-12-12T10:12:33.346 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.338+0000 7f71057fa640 1 -- 172.21.15.78:0/1943661120 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f710815c8a0 con 0x7f71080cb7e0 2023-12-12T10:12:33.346 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:12:33.347 INFO:teuthology.orchestra.run.smithi078.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-12-12T10:12:33.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.342+0000 7f710ee32640 1 -- 172.21.15.78:0/1943661120 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f70ec0664a0 msgr2=0x7f70ec068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:33.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.342+0000 7f710ee32640 1 --2- 172.21.15.78:0/1943661120 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f70ec0664a0 0x7f70ec068960 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f70fc000f70 tx=0x7f70fc007b80 comp rx=0 tx=0).stop 2023-12-12T10:12:33.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.342+0000 7f710ee32640 1 -- 172.21.15.78:0/1943661120 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f71080cb7e0 msgr2=0x7f71080ae920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:33.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.342+0000 7f710ee32640 1 --2- 172.21.15.78:0/1943661120 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f71080cb7e0 0x7f71080ae920 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f710000cef0 tx=0x7f710000a710 comp rx=0 tx=0).stop 2023-12-12T10:12:33.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.342+0000 7f710ee32640 1 -- 172.21.15.78:0/1943661120 shutdown_connections 2023-12-12T10:12:33.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.342+0000 7f710ee32640 1 --2- 172.21.15.78:0/1943661120 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f70ec0664a0 0x7f70ec068960 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:33.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.342+0000 7f710ee32640 1 --2- 172.21.15.78:0/1943661120 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f71080cb7e0 0x7f71080ae920 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:33.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.342+0000 7f710ee32640 1 --2- 172.21.15.78:0/1943661120 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f71080b4600 0x7f71081f5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:33.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.342+0000 7f710ee32640 1 --2- 172.21.15.78:0/1943661120 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f71080ade10 0x7f710814f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:33.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.342+0000 7f710ee32640 1 -- 172.21.15.78:0/1943661120 >> 172.21.15.78:0/1943661120 conn(0x7f710806c5d0 msgr2=0x7f7108159770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:33.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.342+0000 7f710ee32640 1 -- 172.21.15.78:0/1943661120 shutdown_connections 2023-12-12T10:12:33.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.342+0000 7f710ee32640 1 -- 172.21.15.78:0/1943661120 wait complete. 2023-12-12T10:12:33.367 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-12-12T10:12:33.368 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T10:12:33.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.498+0000 7fd5ed46b640 1 Processor -- start 2023-12-12T10:12:33.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.498+0000 7fd5ed46b640 1 -- start start 2023-12-12T10:12:33.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.498+0000 7fd5ed46b640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd5e80cb7e0 0x7fd5e80b40c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:33.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.498+0000 7fd5ed46b640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd5e80b4600 0x7fd5e81580a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:33.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.498+0000 7fd5ed46b640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5e80ae1f0 con 0x7fd5e80ade10 2023-12-12T10:12:33.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.498+0000 7fd5ed46b640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5e80b4a80 con 0x7fd5e80b4600 2023-12-12T10:12:33.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.498+0000 7fd5ed46b640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5e815c410 con 0x7fd5e80cb7e0 2023-12-12T10:12:33.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.498+0000 7fd5e77fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd5e80b4600 0x7fd5e81580a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:33.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.498+0000 7fd5e77fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd5e80b4600 0x7fd5e81580a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37284/0 (socket says 172.21.15.78:37284) 2023-12-12T10:12:33.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.498+0000 7fd5e77fe640 1 -- 172.21.15.78:0/3554784926 learned_addr learned my addr 172.21.15.78:0/3554784926 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:33.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.498+0000 7fd5e6ffd640 1 --1- 172.21.15.78:0/3554784926 >> v1:172.21.15.78:6789/0 conn(0x7fd5e80ade10 0x7fd5e80ce5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:34356/0 (socket says 172.21.15.78:34356) 2023-12-12T10:12:33.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.498+0000 7fd5e77fe640 1 -- 172.21.15.78:0/3554784926 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd5e80cb7e0 msgr2=0x7fd5e80b40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:33.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.498+0000 7fd5e77fe640 1 --2- 172.21.15.78:0/3554784926 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd5e80cb7e0 0x7fd5e80b40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:33.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.498+0000 7fd5e77fe640 1 -- 172.21.15.78:0/3554784926 >> v1:172.21.15.78:6789/0 conn(0x7fd5e80ade10 legacy=0x7fd5e80ce5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:33.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.498+0000 7fd5e77fe640 1 -- 172.21.15.78:0/3554784926 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5e815b800 con 0x7fd5e80b4600 2023-12-12T10:12:33.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.502+0000 7fd5e77fe640 1 --2- 172.21.15.78:0/3554784926 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd5e80b4600 0x7fd5e81580a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd5e0009e50 tx=0x7fd5e001c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d740a08a4af4a88 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:33.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.502+0000 7fd5e67fc640 1 -- 172.21.15.78:0/3554784926 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5e00a55e0 con 0x7fd5e80b4600 2023-12-12T10:12:33.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.502+0000 7fd5e67fc640 1 -- 172.21.15.78:0/3554784926 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5e00a5740 con 0x7fd5e80b4600 2023-12-12T10:12:33.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.502+0000 7fd5e67fc640 1 -- 172.21.15.78:0/3554784926 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5e00a5ad0 con 0x7fd5e80b4600 2023-12-12T10:12:33.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.502+0000 7fd5ed46b640 1 -- 172.21.15.78:0/3554784926 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd5e80b4600 msgr2=0x7fd5e81580a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:33.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.502+0000 7fd5ed46b640 1 --2- 172.21.15.78:0/3554784926 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd5e80b4600 0x7fd5e81580a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd5e0009e50 tx=0x7fd5e001c830 comp rx=0 tx=0).stop 2023-12-12T10:12:33.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.502+0000 7fd5ed46b640 1 -- 172.21.15.78:0/3554784926 shutdown_connections 2023-12-12T10:12:33.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.502+0000 7fd5ed46b640 1 --2- 172.21.15.78:0/3554784926 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd5e80b4600 0x7fd5e81580a0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:33.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.502+0000 7fd5ed46b640 1 --2- 172.21.15.78:0/3554784926 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd5e80cb7e0 0x7fd5e80b40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:33.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.502+0000 7fd5ed46b640 1 -- 172.21.15.78:0/3554784926 >> 172.21.15.78:0/3554784926 conn(0x7fd5e806c5d0 msgr2=0x7fd5e806c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:33.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.502+0000 7fd5ed46b640 1 -- 172.21.15.78:0/3554784926 shutdown_connections 2023-12-12T10:12:33.512 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.502+0000 7fd5ed46b640 1 -- 172.21.15.78:0/3554784926 wait complete. 2023-12-12T10:12:33.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.506+0000 7fd5ed46b640 1 Processor -- start 2023-12-12T10:12:33.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.506+0000 7fd5ed46b640 1 -- start start 2023-12-12T10:12:33.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.506+0000 7fd5ed46b640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd5e80ade10 0x7fd5e81448c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:33.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.506+0000 7fd5ed46b640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd5e80b4600 0x7fd5e8151760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:33.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.506+0000 7fd5ed46b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd5e80cb7e0 0x7fd5e8151ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:33.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.506+0000 7fd5ed46b640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5e815a570 con 0x7fd5e80cb7e0 2023-12-12T10:12:33.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.506+0000 7fd5ed46b640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5e81521e0 con 0x7fd5e80ade10 2023-12-12T10:12:33.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.506+0000 7fd5ed46b640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5e80cb140 con 0x7fd5e80b4600 2023-12-12T10:12:33.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.506+0000 7fd5e77fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd5e80cb7e0 0x7fd5e8151ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:33.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.506+0000 7fd5e77fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd5e80cb7e0 0x7fd5e8151ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37286/0 (socket says 172.21.15.78:37286) 2023-12-12T10:12:33.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.506+0000 7fd5e77fe640 1 -- 172.21.15.78:0/691180630 learned_addr learned my addr 172.21.15.78:0/691180630 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:33.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.506+0000 7fd5e6ffd640 1 --2- 172.21.15.78:0/691180630 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd5e80ade10 0x7fd5e81448c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:33.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.506+0000 7fd5de7fc640 1 --2- 172.21.15.78:0/691180630 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd5e80b4600 0x7fd5e8151760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:33.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.506+0000 7fd5e77fe640 1 -- 172.21.15.78:0/691180630 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd5e80b4600 msgr2=0x7fd5e8151760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:33.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.506+0000 7fd5e77fe640 1 --2- 172.21.15.78:0/691180630 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd5e80b4600 0x7fd5e8151760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:33.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.506+0000 7fd5e77fe640 1 -- 172.21.15.78:0/691180630 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd5e80ade10 msgr2=0x7fd5e81448c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:33.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.506+0000 7fd5e77fe640 1 --2- 172.21.15.78:0/691180630 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd5e80ade10 0x7fd5e81448c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:33.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.506+0000 7fd5e77fe640 1 -- 172.21.15.78:0/691180630 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5e0009b30 con 0x7fd5e80cb7e0 2023-12-12T10:12:33.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.506+0000 7fd5e77fe640 1 --2- 172.21.15.78:0/691180630 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd5e80cb7e0 0x7fd5e8151ca0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd5e00af040 tx=0x7fd5e00195d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:33.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.506+0000 7fd5dffff640 1 -- 172.21.15.78:0/691180630 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5e00b8670 con 0x7fd5e80cb7e0 2023-12-12T10:12:33.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.506+0000 7fd5dffff640 1 -- 172.21.15.78:0/691180630 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5e00b87f0 con 0x7fd5e80cb7e0 2023-12-12T10:12:33.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.506+0000 7fd5dffff640 1 -- 172.21.15.78:0/691180630 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5e00b8ba0 con 0x7fd5e80cb7e0 2023-12-12T10:12:33.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.506+0000 7fd5ed46b640 1 -- 172.21.15.78:0/691180630 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5e80cb420 con 0x7fd5e80cb7e0 2023-12-12T10:12:33.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.506+0000 7fd5ed46b640 1 -- 172.21.15.78:0/691180630 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5e815a050 con 0x7fd5e80cb7e0 2023-12-12T10:12:33.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.510+0000 7fd5ed46b640 1 -- 172.21.15.78:0/691180630 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5e80671f0 con 0x7fd5e80cb7e0 2023-12-12T10:12:33.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.510+0000 7fd5dffff640 1 -- 172.21.15.78:0/691180630 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd5e00b8d00 con 0x7fd5e80cb7e0 2023-12-12T10:12:33.517 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.510+0000 7fd5dffff640 1 --2- 172.21.15.78:0/691180630 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fd5c80664a0 0x7fd5c8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:33.517 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.510+0000 7fd5dffff640 1 -- 172.21.15.78:0/691180630 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd5e011f7c0 con 0x7fd5e80cb7e0 2023-12-12T10:12:33.517 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.510+0000 7fd5e6ffd640 1 --2- 172.21.15.78:0/691180630 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fd5c80664a0 0x7fd5c8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:33.518 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.510+0000 7fd5e6ffd640 1 --2- 172.21.15.78:0/691180630 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fd5c80664a0 0x7fd5c8068960 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fd5d8000f70 tx=0x7fd5d8007c90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:33.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.514+0000 7fd5dffff640 1 -- 172.21.15.78:0/691180630 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd5e00ec9d0 con 0x7fd5e80cb7e0 2023-12-12T10:12:33.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.666+0000 7fd5ed46b640 1 -- 172.21.15.78:0/691180630 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd5e80cafa0 con 0x7fd5e80cb7e0 2023-12-12T10:12:33.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.666+0000 7fd5dffff640 1 -- 172.21.15.78:0/691180630 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18310 (secure 0 0 0) 0x7fd5e80cafa0 con 0x7fd5e80cb7e0 2023-12-12T10:12:33.672 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:12:33.673 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":24,"fsid":"fc81937c-bd26-483c-952b-d1324fcb0c9e","created":"2023-12-12T10:11:44.020214+0000","modified":"2023-12-12T10:12:14.355146+0000","last_up_change":"2023-12-12T10:11:56.278318+0000","last_in_change":"2023-12-12T10:11:46.553610+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T10:11:57.053584+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-12T10:12:07.454450+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-12T10:12:08.182909+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-12T10:12:11.977952+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"22dfdedf-5f6c-4b20-9f6c-30517a1db70a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6809","nonce":3345683600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6811","nonce":3345683600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6815","nonce":3345683600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6813","nonce":3345683600}]},"public_addr":"172.21.15.78:6809/3345683600","cluster_addr":"172.21.15.78:6811/3345683600","heartbeat_back_addr":"172.21.15.78:6815/3345683600","heartbeat_front_addr":"172.21.15.78:6813/3345683600","state":["exists","up"]},{"osd":1,"uuid":"be34a7f3-a69a-462e-9ddf-5e537448dba2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6801","nonce":962652768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6803","nonce":962652768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6807","nonce":962652768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6805","nonce":962652768}]},"public_addr":"172.21.15.78:6801/962652768","cluster_addr":"172.21.15.78:6803/962652768","heartbeat_back_addr":"172.21.15.78:6807/962652768","heartbeat_front_addr":"172.21.15.78:6805/962652768","state":["exists","up"]},{"osd":2,"uuid":"55b381de-5f56-4b14-80f7-e6e41e084a13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6818","nonce":2910206054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6822","nonce":2910206054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6829","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6831","nonce":2910206054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6826","nonce":2910206054}]},"public_addr":"172.21.15.78:6818/2910206054","cluster_addr":"172.21.15.78:6822/2910206054","heartbeat_back_addr":"172.21.15.78:6831/2910206054","heartbeat_front_addr":"172.21.15.78:6826/2910206054","state":["exists","up"]},{"osd":3,"uuid":"d7682de1-25cb-4cec-869f-8851c28b0e6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6819","nonce":3750796703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6821","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6823","nonce":3750796703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6830","nonce":3750796703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6825","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6827","nonce":3750796703}]},"public_addr":"172.21.15.78:6819/3750796703","cluster_addr":"172.21.15.78:6823/3750796703","heartbeat_back_addr":"172.21.15.78:6830/3750796703","heartbeat_front_addr":"172.21.15.78:6827/3750796703","state":["exists","up"]},{"osd":4,"uuid":"8279815a-d6c7-4199-871e-d28971b9dc07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6809","nonce":2944277204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6811","nonce":2944277204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6815","nonce":2944277204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6813","nonce":2944277204}]},"public_addr":"172.21.15.187:6809/2944277204","cluster_addr":"172.21.15.187:6811/2944277204","heartbeat_back_addr":"172.21.15.187:6815/2944277204","heartbeat_front_addr":"172.21.15.187:6813/2944277204","state":["exists","up"]},{"osd":5,"uuid":"0a714c65-f8ce-4340-968f-11a799677ef3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6801","nonce":185858620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6803","nonce":185858620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6807","nonce":185858620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6805","nonce":185858620}]},"public_addr":"172.21.15.187:6801/185858620","cluster_addr":"172.21.15.187:6803/185858620","heartbeat_back_addr":"172.21.15.187:6807/185858620","heartbeat_front_addr":"172.21.15.187:6805/185858620","state":["exists","up"]},{"osd":6,"uuid":"d0bba9ab-f7ee-449e-8999-1c0cf7e6d53c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6817","nonce":4213392126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6819","nonce":4213392126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6824","nonce":4213392126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6821","nonce":4213392126}]},"public_addr":"172.21.15.187:6817/4213392126","cluster_addr":"172.21.15.187:6819/4213392126","heartbeat_back_addr":"172.21.15.187:6824/4213392126","heartbeat_front_addr":"172.21.15.187:6821/4213392126","state":["exists","up"]},{"osd":7,"uuid":"efe5e0d9-2f87-4889-a27a-e2a95a632302","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6823","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6825","nonce":85774004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6827","nonce":85774004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6831","nonce":85774004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6829","nonce":85774004}]},"public_addr":"172.21.15.187:6825/85774004","cluster_addr":"172.21.15.187:6827/85774004","heartbeat_back_addr":"172.21.15.187:6831/85774004","heartbeat_front_addr":"172.21.15.187:6829/85774004","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.214447+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.448899+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.293107+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.564184+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.175026+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.097717+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.261141+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.287681+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T10:12:33.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.666+0000 7fd5ed46b640 1 -- 172.21.15.78:0/691180630 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fd5c80664a0 msgr2=0x7fd5c8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:33.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.666+0000 7fd5ed46b640 1 --2- 172.21.15.78:0/691180630 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fd5c80664a0 0x7fd5c8068960 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fd5d8000f70 tx=0x7fd5d8007c90 comp rx=0 tx=0).stop 2023-12-12T10:12:33.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.666+0000 7fd5ed46b640 1 -- 172.21.15.78:0/691180630 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd5e80cb7e0 msgr2=0x7fd5e8151ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:33.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.666+0000 7fd5ed46b640 1 --2- 172.21.15.78:0/691180630 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd5e80cb7e0 0x7fd5e8151ca0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd5e00af040 tx=0x7fd5e00195d0 comp rx=0 tx=0).stop 2023-12-12T10:12:33.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.666+0000 7fd5ed46b640 1 -- 172.21.15.78:0/691180630 shutdown_connections 2023-12-12T10:12:33.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.666+0000 7fd5ed46b640 1 --2- 172.21.15.78:0/691180630 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fd5c80664a0 0x7fd5c8068960 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:33.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.666+0000 7fd5ed46b640 1 --2- 172.21.15.78:0/691180630 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd5e80cb7e0 0x7fd5e8151ca0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:33.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.666+0000 7fd5ed46b640 1 --2- 172.21.15.78:0/691180630 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd5e80b4600 0x7fd5e8151760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:33.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.666+0000 7fd5ed46b640 1 --2- 172.21.15.78:0/691180630 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd5e80ade10 0x7fd5e81448c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:33.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.666+0000 7fd5ed46b640 1 -- 172.21.15.78:0/691180630 >> 172.21.15.78:0/691180630 conn(0x7fd5e806c5d0 msgr2=0x7fd5e8152560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:33.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.666+0000 7fd5ed46b640 1 -- 172.21.15.78:0/691180630 shutdown_connections 2023-12-12T10:12:33.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.666+0000 7fd5ed46b640 1 -- 172.21.15.78:0/691180630 wait complete. 2023-12-12T10:12:33.693 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-12T10:11:57.053584+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-12T10:12:07.454450+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-12T10:12:08.182909+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-12T10:12:11.977952+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-12T10:12:33.694 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-12T10:12:33.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.826+0000 7fbbe9f62640 1 Processor -- start 2023-12-12T10:12:33.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.826+0000 7fbbe9f62640 1 -- start start 2023-12-12T10:12:33.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.830+0000 7fbbe9f62640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbbe415d070 0x7fbbe40d1930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:33.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.830+0000 7fbbe9f62640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fbbe40d3a20 0x7fbbe40ce420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:33.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.830+0000 7fbbe9f62640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fbbe40ce960 0x7fbbe4160e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:33.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.830+0000 7fbbe9f62640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbe40d1e70 con 0x7fbbe40d3a20 2023-12-12T10:12:33.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.830+0000 7fbbe9f62640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbe40d0b70 con 0x7fbbe40ce960 2023-12-12T10:12:33.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.830+0000 7fbbe9f62640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe40d0e50 con 0x7fbbe415d070 2023-12-12T10:12:33.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.830+0000 7fbbe3fff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fbbe40d3a20 0x7fbbe40ce420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:33.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.830+0000 7fbbe3fff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fbbe40d3a20 0x7fbbe40ce420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37288/0 (socket says 172.21.15.78:37288) 2023-12-12T10:12:33.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.830+0000 7fbbe3fff640 1 -- 172.21.15.78:0/332642612 learned_addr learned my addr 172.21.15.78:0/332642612 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:33.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.830+0000 7fbbe9761640 1 --2- 172.21.15.78:0/332642612 >> v2:172.21.15.187:3300/0 conn(0x7fbbe40ce960 0x7fbbe4160e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:33.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.830+0000 7fbbe8f60640 1 --2- 172.21.15.78:0/332642612 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbbe415d070 0x7fbbe40d1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:33.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.830+0000 7fbbe3fff640 1 -- 172.21.15.78:0/332642612 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbbe415d070 msgr2=0x7fbbe40d1930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:33.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.830+0000 7fbbe3fff640 1 --2- 172.21.15.78:0/332642612 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbbe415d070 0x7fbbe40d1930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:33.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.830+0000 7fbbe3fff640 1 -- 172.21.15.78:0/332642612 >> v2:172.21.15.187:3300/0 conn(0x7fbbe40ce960 msgr2=0x7fbbe4160e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:33.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.830+0000 7fbbe3fff640 1 --2- 172.21.15.78:0/332642612 >> v2:172.21.15.187:3300/0 conn(0x7fbbe40ce960 0x7fbbe4160e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:33.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.830+0000 7fbbe3fff640 1 -- 172.21.15.78:0/332642612 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbe40d1130 con 0x7fbbe40d3a20 2023-12-12T10:12:33.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.834+0000 7fbbe3fff640 1 --2- 172.21.15.78:0/332642612 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbbe40d3a20 0x7fbbe40ce420 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fbbe408b230 tx=0x7fbbd001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3d74a690751f29a server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:33.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.834+0000 7fbbe37fe640 1 -- 172.21.15.78:0/332642612 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd00aa610 con 0x7fbbe40d3a20 2023-12-12T10:12:33.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.834+0000 7fbbe37fe640 1 -- 172.21.15.78:0/332642612 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbd00a6040 con 0x7fbbe40d3a20 2023-12-12T10:12:33.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.834+0000 7fbbe37fe640 1 -- 172.21.15.78:0/332642612 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd00aa990 con 0x7fbbe40d3a20 2023-12-12T10:12:33.841 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.834+0000 7fbbe9f62640 1 -- 172.21.15.78:0/332642612 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbbe40d3a20 msgr2=0x7fbbe40ce420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:33.841 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.834+0000 7fbbe9f62640 1 --2- 172.21.15.78:0/332642612 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbbe40d3a20 0x7fbbe40ce420 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fbbe408b230 tx=0x7fbbd001c4d0 comp rx=0 tx=0).stop 2023-12-12T10:12:33.841 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.834+0000 7fbbe9f62640 1 -- 172.21.15.78:0/332642612 shutdown_connections 2023-12-12T10:12:33.841 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.834+0000 7fbbe9f62640 1 --2- 172.21.15.78:0/332642612 >> v2:172.21.15.187:3300/0 conn(0x7fbbe40ce960 0x7fbbe4160e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:33.841 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.834+0000 7fbbe9f62640 1 --2- 172.21.15.78:0/332642612 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbbe40d3a20 0x7fbbe40ce420 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:33.842 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.834+0000 7fbbe9f62640 1 --2- 172.21.15.78:0/332642612 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbbe415d070 0x7fbbe40d1930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:33.842 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.834+0000 7fbbe9f62640 1 -- 172.21.15.78:0/332642612 >> 172.21.15.78:0/332642612 conn(0x7fbbe40d2e00 msgr2=0x7fbbe40d3210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:33.842 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.834+0000 7fbbe9f62640 1 -- 172.21.15.78:0/332642612 shutdown_connections 2023-12-12T10:12:33.842 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.834+0000 7fbbe9f62640 1 -- 172.21.15.78:0/332642612 wait complete. 2023-12-12T10:12:33.842 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.838+0000 7fbbe9f62640 1 Processor -- start 2023-12-12T10:12:33.842 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.838+0000 7fbbe9f62640 1 -- start start 2023-12-12T10:12:33.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.838+0000 7fbbe9f62640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbbe40ce960 0x7fbbe4155000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:33.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.838+0000 7fbbe9f62640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbbe40d3a20 0x7fbbe40b5290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:33.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.838+0000 7fbbe9f62640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbbe415d070 0x7fbbe415ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:33.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.838+0000 7fbbe9f62640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe40b57d0 con 0x7fbbe415d070 2023-12-12T10:12:33.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.838+0000 7fbbe9f62640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe4155690 con 0x7fbbe40ce960 2023-12-12T10:12:33.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.838+0000 7fbbe9f62640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbe4155980 con 0x7fbbe40d3a20 2023-12-12T10:12:33.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.838+0000 7fbbe9761640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbbe415d070 0x7fbbe415ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:33.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.838+0000 7fbbe8f60640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbbe40ce960 0x7fbbe4155000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:33.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.838+0000 7fbbe8f60640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbbe40ce960 0x7fbbe4155000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.78:38852/0 (socket says 172.21.15.78:38852) 2023-12-12T10:12:33.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.838+0000 7fbbe8f60640 1 -- 172.21.15.78:0/1084150219 learned_addr learned my addr 172.21.15.78:0/1084150219 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:33.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.838+0000 7fbbe3fff640 1 --2- 172.21.15.78:0/1084150219 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbbe40d3a20 0x7fbbe40b5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:33.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.838+0000 7fbbe9761640 1 -- 172.21.15.78:0/1084150219 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbbe40d3a20 msgr2=0x7fbbe40b5290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:33.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.838+0000 7fbbe9761640 1 --2- 172.21.15.78:0/1084150219 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbbe40d3a20 0x7fbbe40b5290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:33.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.838+0000 7fbbe9761640 1 -- 172.21.15.78:0/1084150219 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbbe40ce960 msgr2=0x7fbbe4155000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:33.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.838+0000 7fbbe9761640 1 --2- 172.21.15.78:0/1084150219 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbbe40ce960 0x7fbbe4155000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:33.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.838+0000 7fbbe9761640 1 -- 172.21.15.78:0/1084150219 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbd00094d0 con 0x7fbbe415d070 2023-12-12T10:12:33.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.838+0000 7fbbe8f60640 1 --2- 172.21.15.78:0/1084150219 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbbe40ce960 0x7fbbe4155000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-12T10:12:33.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.838+0000 7fbbe9761640 1 --2- 172.21.15.78:0/1084150219 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbbe415d070 0x7fbbe415ba50 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fbbdc00eea0 tx=0x7fbbdc00ef90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:33.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.838+0000 7fbbe17fa640 1 -- 172.21.15.78:0/1084150219 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbdc010040 con 0x7fbbe415d070 2023-12-12T10:12:33.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.838+0000 7fbbe17fa640 1 -- 172.21.15.78:0/1084150219 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbdc009e60 con 0x7fbbe415d070 2023-12-12T10:12:33.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.838+0000 7fbbe9f62640 1 -- 172.21.15.78:0/1084150219 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbe4155c60 con 0x7fbbe415d070 2023-12-12T10:12:33.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.838+0000 7fbbe17fa640 1 -- 172.21.15.78:0/1084150219 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbdc014640 con 0x7fbbe415d070 2023-12-12T10:12:33.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.838+0000 7fbbe9f62640 1 -- 172.21.15.78:0/1084150219 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbe4156220 con 0x7fbbe415d070 2023-12-12T10:12:33.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.838+0000 7fbbe9f62640 1 -- 172.21.15.78:0/1084150219 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbe4156410 con 0x7fbbe415d070 2023-12-12T10:12:33.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.842+0000 7fbbe17fa640 1 -- 172.21.15.78:0/1084150219 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fbbdc0147a0 con 0x7fbbe415d070 2023-12-12T10:12:33.848 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.842+0000 7fbbe17fa640 1 --2- 172.21.15.78:0/1084150219 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fbbc8066470 0x7fbbc8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:33.848 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.842+0000 7fbbe17fa640 1 -- 172.21.15.78:0/1084150219 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fbbdc084a10 con 0x7fbbe415d070 2023-12-12T10:12:33.848 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.842+0000 7fbbe8f60640 1 --2- 172.21.15.78:0/1084150219 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fbbc8066470 0x7fbbc8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:33.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.842+0000 7fbbe8f60640 1 --2- 172.21.15.78:0/1084150219 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fbbc8066470 0x7fbbc8068930 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fbbd8007e60 tx=0x7fbbd8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:33.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.846+0000 7fbbe17fa640 1 -- 172.21.15.78:0/1084150219 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fbbdc051cc0 con 0x7fbbe415d070 2023-12-12T10:12:34.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.998+0000 7fbbe9f62640 1 -- 172.21.15.78:0/1084150219 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbbe40745a0 con 0x7fbbe415d070 2023-12-12T10:12:34.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.998+0000 7fbbe17fa640 1 -- 172.21.15.78:0/1084150219 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbbdc018020 con 0x7fbbe415d070 2023-12-12T10:12:34.004 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2023-12-12T10:12:34.005 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.998+0000 7fbbe9f62640 1 -- 172.21.15.78:0/1084150219 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fbbc8066470 msgr2=0x7fbbc8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:34.005 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.998+0000 7fbbe9f62640 1 --2- 172.21.15.78:0/1084150219 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fbbc8066470 0x7fbbc8068930 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fbbd8007e60 tx=0x7fbbd8008040 comp rx=0 tx=0).stop 2023-12-12T10:12:34.005 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.998+0000 7fbbe9f62640 1 -- 172.21.15.78:0/1084150219 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbbe415d070 msgr2=0x7fbbe415ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:34.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.998+0000 7fbbe9f62640 1 --2- 172.21.15.78:0/1084150219 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbbe415d070 0x7fbbe415ba50 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fbbdc00eea0 tx=0x7fbbdc00ef90 comp rx=0 tx=0).stop 2023-12-12T10:12:34.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.998+0000 7fbbe9f62640 1 -- 172.21.15.78:0/1084150219 shutdown_connections 2023-12-12T10:12:34.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.998+0000 7fbbe9f62640 1 --2- 172.21.15.78:0/1084150219 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fbbc8066470 0x7fbbc8068930 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:34.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.998+0000 7fbbe9f62640 1 --2- 172.21.15.78:0/1084150219 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbbe415d070 0x7fbbe415ba50 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:34.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.998+0000 7fbbe9f62640 1 --2- 172.21.15.78:0/1084150219 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbbe40d3a20 0x7fbbe40b5290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:34.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.998+0000 7fbbe9f62640 1 --2- 172.21.15.78:0/1084150219 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbbe40ce960 0x7fbbe4155000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:34.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.998+0000 7fbbe9f62640 1 -- 172.21.15.78:0/1084150219 >> 172.21.15.78:0/1084150219 conn(0x7fbbe40d2e00 msgr2=0x7fbbe415d9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:34.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.998+0000 7fbbe9f62640 1 -- 172.21.15.78:0/1084150219 shutdown_connections 2023-12-12T10:12:34.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:33.998+0000 7fbbe9f62640 1 -- 172.21.15.78:0/1084150219 wait complete. 2023-12-12T10:12:34.025 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-12T10:12:34.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.158+0000 7ff292ddf640 1 Processor -- start 2023-12-12T10:12:34.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.158+0000 7ff292ddf640 1 -- start start 2023-12-12T10:12:34.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.158+0000 7ff292ddf640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff28c0cdf60 0x7ff28c070f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:34.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.158+0000 7ff292ddf640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff28c070a70 con 0x7ff28c071440 2023-12-12T10:12:34.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.162+0000 7ff292ddf640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff28c0ce3c0 con 0x7ff28c143770 2023-12-12T10:12:34.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.162+0000 7ff292ddf640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff28c0718b0 con 0x7ff28c0cdf60 2023-12-12T10:12:34.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.162+0000 7ff29137c640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7ff28c071440 0x7ff28c15d910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:34362/0 (socket says 172.21.15.78:34362) 2023-12-12T10:12:34.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.162+0000 7ff29137c640 1 -- 172.21.15.78:0/3988727217 learned_addr learned my addr 172.21.15.78:0/3988727217 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-12-12T10:12:34.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.162+0000 7ff28bfff640 1 --2- 172.21.15.78:0/3988727217 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff28c0cdf60 0x7ff28c070f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:34.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.162+0000 7ff28b7fe640 1 -- 172.21.15.78:0/3988727217 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1384342152 0 0) 0x7ff28c070a70 con 0x7ff28c071440 2023-12-12T10:12:34.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.162+0000 7ff28b7fe640 1 -- 172.21.15.78:0/3988727217 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff27c005740 con 0x7ff28c071440 2023-12-12T10:12:34.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.162+0000 7ff28b7fe640 1 -- 172.21.15.78:0/3988727217 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 542432881 0 0) 0x7ff28c0ce3c0 con 0x7ff28c143770 2023-12-12T10:12:34.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.162+0000 7ff28b7fe640 1 -- 172.21.15.78:0/3988727217 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff28c070a70 con 0x7ff28c143770 2023-12-12T10:12:34.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.162+0000 7ff28bfff640 1 -- 172.21.15.78:0/3988727217 >> v1:172.21.15.187:6789/0 conn(0x7ff28c143770 legacy=0x7ff28c0b1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:34.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.162+0000 7ff28bfff640 1 -- 172.21.15.78:0/3988727217 >> v1:172.21.15.78:6789/0 conn(0x7ff28c071440 legacy=0x7ff28c15d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:34.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.162+0000 7ff28b7fe640 1 -- 172.21.15.78:0/3988727217 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4134107446 0 0) 0x7ff27c005740 con 0x7ff28c071440 2023-12-12T10:12:34.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.162+0000 7ff28bfff640 1 -- 172.21.15.78:0/3988727217 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff28c070440 con 0x7ff28c0cdf60 2023-12-12T10:12:34.170 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.162+0000 7ff28bfff640 1 --2- 172.21.15.78:0/3988727217 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff28c0cdf60 0x7ff28c070f00 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff2780097f0 tx=0x7ff27801c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ea396566137e43e0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:34.171 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.166+0000 7ff28b7fe640 1 -- 172.21.15.78:0/3988727217 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff284001a00 con 0x7ff28c0cdf60 2023-12-12T10:12:34.171 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.166+0000 7ff28b7fe640 1 -- 172.21.15.78:0/3988727217 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2780ad480 con 0x7ff28c0cdf60 2023-12-12T10:12:34.171 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.166+0000 7ff28b7fe640 1 -- 172.21.15.78:0/3988727217 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2780ad810 con 0x7ff28c0cdf60 2023-12-12T10:12:34.171 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.166+0000 7ff292ddf640 1 -- 172.21.15.78:0/3988727217 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff28c0cdf60 msgr2=0x7ff28c070f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:34.172 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.166+0000 7ff292ddf640 1 --2- 172.21.15.78:0/3988727217 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff28c0cdf60 0x7ff28c070f00 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff2780097f0 tx=0x7ff27801c3e0 comp rx=0 tx=0).stop 2023-12-12T10:12:34.172 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.166+0000 7ff292ddf640 1 -- 172.21.15.78:0/3988727217 shutdown_connections 2023-12-12T10:12:34.172 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.166+0000 7ff292ddf640 1 --2- 172.21.15.78:0/3988727217 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff28c0cdf60 0x7ff28c070f00 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:34.172 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.166+0000 7ff292ddf640 1 -- 172.21.15.78:0/3988727217 >> 172.21.15.78:0/3988727217 conn(0x7ff28c06a710 msgr2=0x7ff28c06ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:34.172 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.166+0000 7ff292ddf640 1 -- 172.21.15.78:0/3988727217 shutdown_connections 2023-12-12T10:12:34.172 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.166+0000 7ff292ddf640 1 -- 172.21.15.78:0/3988727217 wait complete. 2023-12-12T10:12:34.173 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.166+0000 7ff292ddf640 1 Processor -- start 2023-12-12T10:12:34.173 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.166+0000 7ff292ddf640 1 -- start start 2023-12-12T10:12:34.176 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.166+0000 7ff292ddf640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff28c071440 0x7ff28c138ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:34.176 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.166+0000 7ff292ddf640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff28c0cdf60 0x7ff28c158a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:34.176 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.166+0000 7ff292ddf640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff28c143770 0x7ff28c135cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:34.176 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.166+0000 7ff292ddf640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff28c135820 con 0x7ff28c071440 2023-12-12T10:12:34.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.166+0000 7ff292ddf640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff28c139420 con 0x7ff28c143770 2023-12-12T10:12:34.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.166+0000 7ff292ddf640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff28c134c10 con 0x7ff28c0cdf60 2023-12-12T10:12:34.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.166+0000 7ff290b7b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff28c071440 0x7ff28c138ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:34.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.166+0000 7ff290b7b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff28c071440 0x7ff28c138ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37308/0 (socket says 172.21.15.78:37308) 2023-12-12T10:12:34.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.166+0000 7ff290b7b640 1 -- 172.21.15.78:0/3468837611 learned_addr learned my addr 172.21.15.78:0/3468837611 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:34.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.166+0000 7ff28bfff640 1 --2- 172.21.15.78:0/3468837611 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff28c0cdf60 0x7ff28c158a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:34.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.170+0000 7ff29137c640 1 --2- 172.21.15.78:0/3468837611 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff28c143770 0x7ff28c135cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:34.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.170+0000 7ff290b7b640 1 -- 172.21.15.78:0/3468837611 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff28c0cdf60 msgr2=0x7ff28c158a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:34.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.170+0000 7ff290b7b640 1 --2- 172.21.15.78:0/3468837611 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff28c0cdf60 0x7ff28c158a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:34.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.170+0000 7ff290b7b640 1 -- 172.21.15.78:0/3468837611 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff28c143770 msgr2=0x7ff28c135cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:34.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.170+0000 7ff290b7b640 1 --2- 172.21.15.78:0/3468837611 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff28c143770 0x7ff28c135cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:34.178 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.170+0000 7ff290b7b640 1 -- 172.21.15.78:0/3468837611 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff278009420 con 0x7ff28c071440 2023-12-12T10:12:34.178 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.170+0000 7ff290b7b640 1 --2- 172.21.15.78:0/3468837611 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff28c071440 0x7ff28c138ee0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff28000c430 tx=0x7ff28000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:34.178 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.170+0000 7ff2897fa640 1 -- 172.21.15.78:0/3468837611 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2800052d0 con 0x7ff28c071440 2023-12-12T10:12:34.178 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.170+0000 7ff2897fa640 1 -- 172.21.15.78:0/3468837611 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff280005450 con 0x7ff28c071440 2023-12-12T10:12:34.178 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.170+0000 7ff2897fa640 1 -- 172.21.15.78:0/3468837611 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff280003840 con 0x7ff28c071440 2023-12-12T10:12:34.178 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.170+0000 7ff292ddf640 1 -- 172.21.15.78:0/3468837611 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff28c134ef0 con 0x7ff28c071440 2023-12-12T10:12:34.179 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.170+0000 7ff292ddf640 1 -- 172.21.15.78:0/3468837611 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff28c1354b0 con 0x7ff28c071440 2023-12-12T10:12:34.179 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.170+0000 7ff292ddf640 1 -- 172.21.15.78:0/3468837611 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff28c0671f0 con 0x7ff28c071440 2023-12-12T10:12:34.180 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.170+0000 7ff2897fa640 1 -- 172.21.15.78:0/3468837611 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff2800039a0 con 0x7ff28c071440 2023-12-12T10:12:34.180 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.170+0000 7ff2897fa640 1 --2- 172.21.15.78:0/3468837611 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7ff2700664a0 0x7ff270068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:34.180 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.174+0000 7ff2897fa640 1 -- 172.21.15.78:0/3468837611 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff280083700 con 0x7ff28c071440 2023-12-12T10:12:34.180 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.174+0000 7ff28bfff640 1 --2- 172.21.15.78:0/3468837611 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7ff2700664a0 0x7ff270068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:34.180 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.174+0000 7ff28bfff640 1 --2- 172.21.15.78:0/3468837611 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7ff2700664a0 0x7ff270068960 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff2780af000 tx=0x7ff2780a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:34.183 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.178+0000 7ff2897fa640 1 -- 172.21.15.78:0/3468837611 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff280050930 con 0x7ff28c071440 2023-12-12T10:12:34.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.326+0000 7ff292ddf640 1 -- 172.21.15.78:0/3468837611 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff28c067530 con 0x7ff28c071440 2023-12-12T10:12:34.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.326+0000 7ff2897fa640 1 -- 172.21.15.78:0/3468837611 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff280053f50 con 0x7ff28c071440 2023-12-12T10:12:34.333 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2023-12-12T10:12:34.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.330+0000 7ff292ddf640 1 -- 172.21.15.78:0/3468837611 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7ff2700664a0 msgr2=0x7ff270068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:34.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.330+0000 7ff292ddf640 1 --2- 172.21.15.78:0/3468837611 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7ff2700664a0 0x7ff270068960 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff2780af000 tx=0x7ff2780a7000 comp rx=0 tx=0).stop 2023-12-12T10:12:34.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.330+0000 7ff292ddf640 1 -- 172.21.15.78:0/3468837611 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff28c071440 msgr2=0x7ff28c138ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:34.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.330+0000 7ff292ddf640 1 --2- 172.21.15.78:0/3468837611 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff28c071440 0x7ff28c138ee0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff28000c430 tx=0x7ff28000c8f0 comp rx=0 tx=0).stop 2023-12-12T10:12:34.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.330+0000 7ff292ddf640 1 -- 172.21.15.78:0/3468837611 shutdown_connections 2023-12-12T10:12:34.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.330+0000 7ff292ddf640 1 --2- 172.21.15.78:0/3468837611 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7ff2700664a0 0x7ff270068960 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:34.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.330+0000 7ff292ddf640 1 --2- 172.21.15.78:0/3468837611 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff28c143770 0x7ff28c135cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:34.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.330+0000 7ff292ddf640 1 --2- 172.21.15.78:0/3468837611 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff28c0cdf60 0x7ff28c158a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:34.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.330+0000 7ff292ddf640 1 --2- 172.21.15.78:0/3468837611 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff28c071440 0x7ff28c138ee0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:34.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.330+0000 7ff292ddf640 1 -- 172.21.15.78:0/3468837611 >> 172.21.15.78:0/3468837611 conn(0x7ff28c06a710 msgr2=0x7ff28c0cd410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:34.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.330+0000 7ff292ddf640 1 -- 172.21.15.78:0/3468837611 shutdown_connections 2023-12-12T10:12:34.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.330+0000 7ff292ddf640 1 -- 172.21.15.78:0/3468837611 wait complete. 2023-12-12T10:12:34.354 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-12T10:12:34.494 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.486+0000 7fbc0910f640 1 Processor -- start 2023-12-12T10:12:34.494 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.486+0000 7fbc0910f640 1 -- start start 2023-12-12T10:12:34.496 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.490+0000 7fbc0910f640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fbc040cb4b0 0x7fbc0415f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:34.496 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.490+0000 7fbc0910f640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fbc0406c850 0x7fbc0406ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:34.496 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.490+0000 7fbc0910f640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc040cea30 con 0x7fbc0415b390 2023-12-12T10:12:34.496 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.490+0000 7fbc0910f640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc0406d200 con 0x7fbc040cb4b0 2023-12-12T10:12:34.497 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.490+0000 7fbc0910f640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc0415bfc0 con 0x7fbc0406c850 2023-12-12T10:12:34.497 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.490+0000 7fbc02d9d640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fbc040cb4b0 0x7fbc0415f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:34.497 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.490+0000 7fbc02d9d640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fbc040cb4b0 0x7fbc0415f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37314/0 (socket says 172.21.15.78:37314) 2023-12-12T10:12:34.497 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.490+0000 7fbc02d9d640 1 -- 172.21.15.78:0/994681034 learned_addr learned my addr 172.21.15.78:0/994681034 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:34.497 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.490+0000 7fbc0259c640 1 --2- 172.21.15.78:0/994681034 >> v2:172.21.15.187:3300/0 conn(0x7fbc0406c850 0x7fbc0406ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:34.497 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.490+0000 7fbc02d9d640 1 -- 172.21.15.78:0/994681034 >> v2:172.21.15.187:3300/0 conn(0x7fbc0406c850 msgr2=0x7fbc0406ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:34.497 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.490+0000 7fbc02d9d640 1 --2- 172.21.15.78:0/994681034 >> v2:172.21.15.187:3300/0 conn(0x7fbc0406c850 0x7fbc0406ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:34.497 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.490+0000 7fbc02d9d640 1 -- 172.21.15.78:0/994681034 >> v1:172.21.15.78:6789/0 conn(0x7fbc0415b390 legacy=0x7fbc040714e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:34.497 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.490+0000 7fbc02d9d640 1 -- 172.21.15.78:0/994681034 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc0415c2a0 con 0x7fbc040cb4b0 2023-12-12T10:12:34.497 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.490+0000 7fbc0259c640 1 --2- 172.21.15.78:0/994681034 >> v2:172.21.15.187:3300/0 conn(0x7fbc0406c850 0x7fbc0406ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T10:12:34.499 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.494+0000 7fbc02d9d640 1 --2- 172.21.15.78:0/994681034 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbc040cb4b0 0x7fbc0415f500 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fbc040b44f0 tx=0x7fbbf401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ce5e90160b27469 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:34.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.494+0000 7fbc01d9b640 1 -- 172.21.15.78:0/994681034 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbf40ab640 con 0x7fbc040cb4b0 2023-12-12T10:12:34.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.494+0000 7fbc01d9b640 1 -- 172.21.15.78:0/994681034 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbf40a7070 con 0x7fbc040cb4b0 2023-12-12T10:12:34.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.494+0000 7fbc01d9b640 1 -- 172.21.15.78:0/994681034 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbf40ab9c0 con 0x7fbc040cb4b0 2023-12-12T10:12:34.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.494+0000 7fbc0910f640 1 -- 172.21.15.78:0/994681034 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbc040cb4b0 msgr2=0x7fbc0415f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:34.501 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.494+0000 7fbc0910f640 1 --2- 172.21.15.78:0/994681034 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbc040cb4b0 0x7fbc0415f500 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fbc040b44f0 tx=0x7fbbf401c440 comp rx=0 tx=0).stop 2023-12-12T10:12:34.501 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.494+0000 7fbc0910f640 1 -- 172.21.15.78:0/994681034 shutdown_connections 2023-12-12T10:12:34.501 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.494+0000 7fbc0910f640 1 --2- 172.21.15.78:0/994681034 >> v2:172.21.15.187:3300/0 conn(0x7fbc0406c850 0x7fbc0406ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:34.501 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.494+0000 7fbc0910f640 1 --2- 172.21.15.78:0/994681034 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbc040cb4b0 0x7fbc0415f500 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:34.501 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.494+0000 7fbc0910f640 1 -- 172.21.15.78:0/994681034 >> 172.21.15.78:0/994681034 conn(0x7fbc0406a710 msgr2=0x7fbc0406ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:34.501 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.494+0000 7fbc0910f640 1 -- 172.21.15.78:0/994681034 shutdown_connections 2023-12-12T10:12:34.501 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.494+0000 7fbc0910f640 1 -- 172.21.15.78:0/994681034 wait complete. 2023-12-12T10:12:34.502 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.494+0000 7fbc0910f640 1 Processor -- start 2023-12-12T10:12:34.502 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.494+0000 7fbc0910f640 1 -- start start 2023-12-12T10:12:34.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.498+0000 7fbc0910f640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbc0406c850 0x7fbc0413e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:34.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.498+0000 7fbc0910f640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbc040cb4b0 0x7fbc0415d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:34.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.498+0000 7fbc0910f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbc0415b390 0x7fbc0415dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:34.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.498+0000 7fbc0910f640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc0413ee10 con 0x7fbc0415b390 2023-12-12T10:12:34.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.498+0000 7fbc0910f640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc040b2880 con 0x7fbc0406c850 2023-12-12T10:12:34.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.498+0000 7fbc0910f640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc04142c10 con 0x7fbc040cb4b0 2023-12-12T10:12:34.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.498+0000 7fbc0359e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbc0415b390 0x7fbc0415dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:34.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.498+0000 7fbc0359e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbc0415b390 0x7fbc0415dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37322/0 (socket says 172.21.15.78:37322) 2023-12-12T10:12:34.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.498+0000 7fbc0359e640 1 -- 172.21.15.78:0/3432504139 learned_addr learned my addr 172.21.15.78:0/3432504139 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:34.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.498+0000 7fbc0259c640 1 --2- 172.21.15.78:0/3432504139 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbc040cb4b0 0x7fbc0415d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:34.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.498+0000 7fbc02d9d640 1 --2- 172.21.15.78:0/3432504139 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbc0406c850 0x7fbc0413e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:34.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.498+0000 7fbc0359e640 1 -- 172.21.15.78:0/3432504139 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbc040cb4b0 msgr2=0x7fbc0415d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:34.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.498+0000 7fbc0359e640 1 --2- 172.21.15.78:0/3432504139 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbc040cb4b0 0x7fbc0415d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:34.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.498+0000 7fbc0359e640 1 -- 172.21.15.78:0/3432504139 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbc0406c850 msgr2=0x7fbc0413e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:34.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.498+0000 7fbc0359e640 1 --2- 172.21.15.78:0/3432504139 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbc0406c850 0x7fbc0413e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:34.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.498+0000 7fbc0359e640 1 -- 172.21.15.78:0/3432504139 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbf40094d0 con 0x7fbc0415b390 2023-12-12T10:12:34.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.498+0000 7fbc0359e640 1 --2- 172.21.15.78:0/3432504139 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbc0415b390 0x7fbc0415dba0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fbbfc00c7a0 tx=0x7fbbfc00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:34.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.498+0000 7fbbeb7fe640 1 -- 172.21.15.78:0/3432504139 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbfc003b80 con 0x7fbc0415b390 2023-12-12T10:12:34.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.498+0000 7fbbeb7fe640 1 -- 172.21.15.78:0/3432504139 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbfc003ce0 con 0x7fbc0415b390 2023-12-12T10:12:34.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.498+0000 7fbbeb7fe640 1 -- 172.21.15.78:0/3432504139 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbfc00aa90 con 0x7fbc0415b390 2023-12-12T10:12:34.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.498+0000 7fbc0910f640 1 -- 172.21.15.78:0/3432504139 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc040b1cb0 con 0x7fbc0415b390 2023-12-12T10:12:34.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.498+0000 7fbc0910f640 1 -- 172.21.15.78:0/3432504139 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc040b2230 con 0x7fbc0415b390 2023-12-12T10:12:34.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.498+0000 7fbc0910f640 1 -- 172.21.15.78:0/3432504139 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc040671f0 con 0x7fbc0415b390 2023-12-12T10:12:34.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.502+0000 7fbbeb7fe640 1 -- 172.21.15.78:0/3432504139 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fbbfc00abf0 con 0x7fbc0415b390 2023-12-12T10:12:34.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.502+0000 7fbbeb7fe640 1 --2- 172.21.15.78:0/3432504139 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fbbf0066470 0x7fbbf0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:34.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.502+0000 7fbbeb7fe640 1 -- 172.21.15.78:0/3432504139 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fbbfc083e80 con 0x7fbc0415b390 2023-12-12T10:12:34.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.502+0000 7fbc02d9d640 1 --2- 172.21.15.78:0/3432504139 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fbbf0066470 0x7fbbf0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:34.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.502+0000 7fbc02d9d640 1 --2- 172.21.15.78:0/3432504139 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fbbf0066470 0x7fbbf0068930 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fbbf40af000 tx=0x7fbbf40b6040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:34.512 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.506+0000 7fbbeb7fe640 1 -- 172.21.15.78:0/3432504139 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fbbfc0510b0 con 0x7fbc0415b390 2023-12-12T10:12:34.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.654+0000 7fbc0910f640 1 -- 172.21.15.78:0/3432504139 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbc040b2a30 con 0x7fbc0415b390 2023-12-12T10:12:34.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.658+0000 7fbbeb7fe640 1 -- 172.21.15.78:0/3432504139 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbc040b2a30 con 0x7fbc0415b390 2023-12-12T10:12:34.663 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2023-12-12T10:12:34.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.658+0000 7fbc0910f640 1 -- 172.21.15.78:0/3432504139 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fbbf0066470 msgr2=0x7fbbf0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:34.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.658+0000 7fbc0910f640 1 --2- 172.21.15.78:0/3432504139 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fbbf0066470 0x7fbbf0068930 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fbbf40af000 tx=0x7fbbf40b6040 comp rx=0 tx=0).stop 2023-12-12T10:12:34.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.658+0000 7fbc0910f640 1 -- 172.21.15.78:0/3432504139 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbc0415b390 msgr2=0x7fbc0415dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:34.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.658+0000 7fbc0910f640 1 --2- 172.21.15.78:0/3432504139 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbc0415b390 0x7fbc0415dba0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fbbfc00c7a0 tx=0x7fbbfc00cc60 comp rx=0 tx=0).stop 2023-12-12T10:12:34.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.658+0000 7fbc0910f640 1 -- 172.21.15.78:0/3432504139 shutdown_connections 2023-12-12T10:12:34.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.658+0000 7fbc0910f640 1 --2- 172.21.15.78:0/3432504139 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fbbf0066470 0x7fbbf0068930 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:34.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.658+0000 7fbc0910f640 1 --2- 172.21.15.78:0/3432504139 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbc0415b390 0x7fbc0415dba0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:34.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.658+0000 7fbc0910f640 1 --2- 172.21.15.78:0/3432504139 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbc040cb4b0 0x7fbc0415d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:34.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.658+0000 7fbc0910f640 1 --2- 172.21.15.78:0/3432504139 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbc0406c850 0x7fbc0413e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:34.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.658+0000 7fbc0910f640 1 -- 172.21.15.78:0/3432504139 >> 172.21.15.78:0/3432504139 conn(0x7fbc0406a710 msgr2=0x7fbc040714e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:34.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.658+0000 7fbc0910f640 1 -- 172.21.15.78:0/3432504139 shutdown_connections 2023-12-12T10:12:34.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.658+0000 7fbc0910f640 1 -- 172.21.15.78:0/3432504139 wait complete. 2023-12-12T10:12:34.684 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-12T10:12:34.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.818+0000 7f5801079640 1 Processor -- start 2023-12-12T10:12:34.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.818+0000 7f5801079640 1 -- start start 2023-12-12T10:12:34.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.818+0000 7f5801079640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f57fc071610 0x7f57fc164ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:34.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.818+0000 7f5801079640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57fc070a70 con 0x7f57fc0cdf60 2023-12-12T10:12:34.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.818+0000 7f5801079640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57fc0ce3c0 con 0x7f57fc143770 2023-12-12T10:12:34.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.818+0000 7f5801079640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57fc15e920 con 0x7f57fc071610 2023-12-12T10:12:34.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.818+0000 7f57f3fff640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f57fc0cdf60 0x7f57fc070f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:34382/0 (socket says 172.21.15.78:34382) 2023-12-12T10:12:34.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.818+0000 7f57f3fff640 1 -- 172.21.15.78:0/984833874 learned_addr learned my addr 172.21.15.78:0/984833874 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-12-12T10:12:34.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.818+0000 7f57fb59e640 1 --2- 172.21.15.78:0/984833874 >> v2:172.21.15.187:3300/0 conn(0x7f57fc071610 0x7f57fc164ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:34.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.818+0000 7f57fa59c640 1 -- 172.21.15.78:0/984833874 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 630964726 0 0) 0x7f57fc070a70 con 0x7f57fc0cdf60 2023-12-12T10:12:34.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.818+0000 7f57fa59c640 1 -- 172.21.15.78:0/984833874 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57e8003530 con 0x7f57fc0cdf60 2023-12-12T10:12:34.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.818+0000 7f57fb59e640 1 -- 172.21.15.78:0/984833874 >> v1:172.21.15.187:6789/0 conn(0x7f57fc143770 legacy=0x7f57fc0b1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:34.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.818+0000 7f57fb59e640 1 -- 172.21.15.78:0/984833874 >> v1:172.21.15.78:6789/0 conn(0x7f57fc0cdf60 legacy=0x7f57fc070f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:34.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.818+0000 7f57fa59c640 1 -- 172.21.15.78:0/984833874 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 561476448 0 0) 0x7f57e8003530 con 0x7f57fc0cdf60 2023-12-12T10:12:34.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.818+0000 7f57fb59e640 1 -- 172.21.15.78:0/984833874 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57fc070440 con 0x7f57fc071610 2023-12-12T10:12:34.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.822+0000 7f57fb59e640 1 --2- 172.21.15.78:0/984833874 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f57fc071610 0x7f57fc164ca0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f57fc070630 tx=0x7f57f401c7c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6695f0d561964e0a server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:34.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.822+0000 7f57fa59c640 1 -- 172.21.15.78:0/984833874 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57e4001680 con 0x7f57fc071610 2023-12-12T10:12:34.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.822+0000 7f57fa59c640 1 -- 172.21.15.78:0/984833874 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57f40a5600 con 0x7f57fc071610 2023-12-12T10:12:34.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.822+0000 7f57fa59c640 1 -- 172.21.15.78:0/984833874 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57f40a5990 con 0x7f57fc071610 2023-12-12T10:12:34.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.822+0000 7f5801079640 1 -- 172.21.15.78:0/984833874 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f57fc071610 msgr2=0x7f57fc164ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:34.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.822+0000 7f5801079640 1 --2- 172.21.15.78:0/984833874 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f57fc071610 0x7f57fc164ca0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f57fc070630 tx=0x7f57f401c7c0 comp rx=0 tx=0).stop 2023-12-12T10:12:34.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.822+0000 7f5801079640 1 -- 172.21.15.78:0/984833874 shutdown_connections 2023-12-12T10:12:34.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.822+0000 7f5801079640 1 --2- 172.21.15.78:0/984833874 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f57fc071610 0x7f57fc164ca0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:34.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.822+0000 7f5801079640 1 -- 172.21.15.78:0/984833874 >> 172.21.15.78:0/984833874 conn(0x7f57fc06a710 msgr2=0x7f57fc06ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:34.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.822+0000 7f5801079640 1 -- 172.21.15.78:0/984833874 shutdown_connections 2023-12-12T10:12:34.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.822+0000 7f5801079640 1 -- 172.21.15.78:0/984833874 wait complete. 2023-12-12T10:12:34.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.826+0000 7f5801079640 1 Processor -- start 2023-12-12T10:12:34.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.826+0000 7f5801079640 1 -- start start 2023-12-12T10:12:34.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.826+0000 7f5801079640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f57fc071610 0x7f57fc136660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:34.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.826+0000 7f5801079640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f57fc0cdf60 0x7f57fc159230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:34.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.826+0000 7f5801079640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f57fc143770 0x7f57fc13bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:34.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.826+0000 7f5801079640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57fc0ae2d0 con 0x7f57fc143770 2023-12-12T10:12:34.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.826+0000 7f5801079640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57fc0ad2c0 con 0x7f57fc0cdf60 2023-12-12T10:12:34.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.826+0000 7f5801079640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57fc15cb30 con 0x7f57fc071610 2023-12-12T10:12:34.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.826+0000 7f57fb59e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f57fc143770 0x7f57fc13bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:34.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.826+0000 7f57fb59e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f57fc143770 0x7f57fc13bc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37324/0 (socket says 172.21.15.78:37324) 2023-12-12T10:12:34.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.826+0000 7f57fb59e640 1 -- 172.21.15.78:0/774584930 learned_addr learned my addr 172.21.15.78:0/774584930 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:34.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.826+0000 7f57f3fff640 1 --2- 172.21.15.78:0/774584930 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f57fc0cdf60 0x7f57fc159230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:34.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.826+0000 7f57fad9d640 1 --2- 172.21.15.78:0/774584930 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f57fc071610 0x7f57fc136660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:34.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.826+0000 7f57fb59e640 1 -- 172.21.15.78:0/774584930 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f57fc071610 msgr2=0x7f57fc136660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:34.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.826+0000 7f57fb59e640 1 --2- 172.21.15.78:0/774584930 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f57fc071610 0x7f57fc136660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:34.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.826+0000 7f57fb59e640 1 -- 172.21.15.78:0/774584930 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f57fc0cdf60 msgr2=0x7f57fc159230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:34.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.826+0000 7f57fb59e640 1 --2- 172.21.15.78:0/774584930 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f57fc0cdf60 0x7f57fc159230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:34.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.826+0000 7f57fb59e640 1 -- 172.21.15.78:0/774584930 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57f4009a70 con 0x7f57fc143770 2023-12-12T10:12:34.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.826+0000 7f57f3fff640 1 --2- 172.21.15.78:0/774584930 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f57fc0cdf60 0x7f57fc159230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T10:12:34.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.826+0000 7f57fb59e640 1 --2- 172.21.15.78:0/774584930 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f57fc143770 0x7f57fc13bc00 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f57f401cca0 tx=0x7f57f4019560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:34.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.826+0000 7f57f37fe640 1 -- 172.21.15.78:0/774584930 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57f40ad850 con 0x7f57fc143770 2023-12-12T10:12:34.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.826+0000 7f57f37fe640 1 -- 172.21.15.78:0/774584930 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57f40ad9b0 con 0x7f57fc143770 2023-12-12T10:12:34.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.826+0000 7f57f37fe640 1 -- 172.21.15.78:0/774584930 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57f40add60 con 0x7f57fc143770 2023-12-12T10:12:34.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.826+0000 7f5801079640 1 -- 172.21.15.78:0/774584930 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57fc0ad510 con 0x7f57fc143770 2023-12-12T10:12:34.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.826+0000 7f5801079640 1 -- 172.21.15.78:0/774584930 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57fc0adad0 con 0x7f57fc143770 2023-12-12T10:12:34.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.830+0000 7f5801079640 1 -- 172.21.15.78:0/774584930 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57fc0671f0 con 0x7f57fc143770 2023-12-12T10:12:34.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.830+0000 7f57f37fe640 1 -- 172.21.15.78:0/774584930 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f57f40b4050 con 0x7f57fc143770 2023-12-12T10:12:34.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.830+0000 7f57f37fe640 1 --2- 172.21.15.78:0/774584930 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f57dc066470 0x7f57dc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:34.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.830+0000 7f57f37fe640 1 -- 172.21.15.78:0/774584930 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f57f411f0d0 con 0x7f57fc143770 2023-12-12T10:12:34.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.830+0000 7f57fad9d640 1 --2- 172.21.15.78:0/774584930 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f57dc066470 0x7f57dc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:34.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.830+0000 7f57fad9d640 1 --2- 172.21.15.78:0/774584930 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f57dc066470 0x7f57dc068930 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f57fc15b530 tx=0x7f57ec009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:34.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.834+0000 7f57f37fe640 1 -- 172.21.15.78:0/774584930 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f57f40ec1d0 con 0x7f57fc143770 2023-12-12T10:12:34.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.986+0000 7f5801079640 1 -- 172.21.15.78:0/774584930 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f57fc159ed0 con 0x7f57fc143770 2023-12-12T10:12:34.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.986+0000 7f57f37fe640 1 -- 172.21.15.78:0/774584930 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7f57f40ef7f0 con 0x7f57fc143770 2023-12-12T10:12:34.994 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2023-12-12T10:12:34.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.990+0000 7f5801079640 1 -- 172.21.15.78:0/774584930 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f57dc066470 msgr2=0x7f57dc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:34.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.990+0000 7f5801079640 1 --2- 172.21.15.78:0/774584930 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f57dc066470 0x7f57dc068930 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f57fc15b530 tx=0x7f57ec009040 comp rx=0 tx=0).stop 2023-12-12T10:12:34.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.990+0000 7f5801079640 1 -- 172.21.15.78:0/774584930 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f57fc143770 msgr2=0x7f57fc13bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:34.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.990+0000 7f5801079640 1 --2- 172.21.15.78:0/774584930 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f57fc143770 0x7f57fc13bc00 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f57f401cca0 tx=0x7f57f4019560 comp rx=0 tx=0).stop 2023-12-12T10:12:34.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.990+0000 7f5801079640 1 -- 172.21.15.78:0/774584930 shutdown_connections 2023-12-12T10:12:34.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.990+0000 7f5801079640 1 --2- 172.21.15.78:0/774584930 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f57dc066470 0x7f57dc068930 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:34.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.990+0000 7f5801079640 1 --2- 172.21.15.78:0/774584930 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f57fc143770 0x7f57fc13bc00 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:34.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.990+0000 7f5801079640 1 --2- 172.21.15.78:0/774584930 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f57fc0cdf60 0x7f57fc159230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:34.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.990+0000 7f5801079640 1 --2- 172.21.15.78:0/774584930 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f57fc071610 0x7f57fc136660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:34.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.990+0000 7f5801079640 1 -- 172.21.15.78:0/774584930 >> 172.21.15.78:0/774584930 conn(0x7f57fc06a710 msgr2=0x7f57fc1390e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:34.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.990+0000 7f5801079640 1 -- 172.21.15.78:0/774584930 shutdown_connections 2023-12-12T10:12:34.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:34.990+0000 7f5801079640 1 -- 172.21.15.78:0/774584930 wait complete. 2023-12-12T10:12:35.015 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-12T10:12:35.154 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.146+0000 7fc5eb7f5640 1 Processor -- start 2023-12-12T10:12:35.154 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.146+0000 7fc5eb7f5640 1 -- start start 2023-12-12T10:12:35.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.150+0000 7fc5eb7f5640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc5e40b43f0 0x7fc5e415d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:35.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.150+0000 7fc5eb7f5640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc5e406a540 0x7fc5e406a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:35.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.150+0000 7fc5eb7f5640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5e41610a0 con 0x7fc5e4146930 2023-12-12T10:12:35.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.150+0000 7fc5eb7f5640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5e406af10 con 0x7fc5e40b43f0 2023-12-12T10:12:35.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.150+0000 7fc5eb7f5640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e415e560 con 0x7fc5e406a540 2023-12-12T10:12:35.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.150+0000 7fc5e8d90640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc5e40b43f0 0x7fc5e415d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:35.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.150+0000 7fc5e8d90640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc5e40b43f0 0x7fc5e415d710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37338/0 (socket says 172.21.15.78:37338) 2023-12-12T10:12:35.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.150+0000 7fc5e8d90640 1 -- 172.21.15.78:0/3258632906 learned_addr learned my addr 172.21.15.78:0/3258632906 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:35.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.150+0000 7fc5e9d92640 1 --2- 172.21.15.78:0/3258632906 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc5e406a540 0x7fc5e406a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:35.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.150+0000 7fc5e8d90640 1 -- 172.21.15.78:0/3258632906 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc5e406a540 msgr2=0x7fc5e406a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:35.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.150+0000 7fc5e8d90640 1 --2- 172.21.15.78:0/3258632906 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc5e406a540 0x7fc5e406a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:35.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.150+0000 7fc5e8d90640 1 -- 172.21.15.78:0/3258632906 >> v1:172.21.15.187:6789/0 conn(0x7fc5e4146930 legacy=0x7fc5e4161530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:35.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.150+0000 7fc5e8d90640 1 -- 172.21.15.78:0/3258632906 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5e415dfa0 con 0x7fc5e40b43f0 2023-12-12T10:12:35.159 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.154+0000 7fc5e8d90640 1 --2- 172.21.15.78:0/3258632906 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc5e40b43f0 0x7fc5e415d710 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fc5d4009870 tx=0x7fc5d401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2aee3e0052989b55 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:35.160 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.154+0000 7fc5dbfff640 1 -- 172.21.15.78:0/3258632906 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5d40ab680 con 0x7fc5e40b43f0 2023-12-12T10:12:35.160 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.154+0000 7fc5dbfff640 1 -- 172.21.15.78:0/3258632906 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5d40ab7e0 con 0x7fc5e40b43f0 2023-12-12T10:12:35.160 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.154+0000 7fc5dbfff640 1 -- 172.21.15.78:0/3258632906 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5d40abb70 con 0x7fc5e40b43f0 2023-12-12T10:12:35.160 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.154+0000 7fc5eb7f5640 1 -- 172.21.15.78:0/3258632906 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc5e40b43f0 msgr2=0x7fc5e415d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:35.160 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.154+0000 7fc5eb7f5640 1 --2- 172.21.15.78:0/3258632906 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc5e40b43f0 0x7fc5e415d710 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fc5d4009870 tx=0x7fc5d401c480 comp rx=0 tx=0).stop 2023-12-12T10:12:35.160 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.154+0000 7fc5eb7f5640 1 -- 172.21.15.78:0/3258632906 shutdown_connections 2023-12-12T10:12:35.160 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.154+0000 7fc5eb7f5640 1 --2- 172.21.15.78:0/3258632906 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc5e406a540 0x7fc5e406a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:35.160 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.154+0000 7fc5eb7f5640 1 --2- 172.21.15.78:0/3258632906 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc5e40b43f0 0x7fc5e415d710 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:35.161 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.154+0000 7fc5eb7f5640 1 -- 172.21.15.78:0/3258632906 >> 172.21.15.78:0/3258632906 conn(0x7fc5e40b1c10 msgr2=0x7fc5e40b2020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:35.161 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.154+0000 7fc5eb7f5640 1 -- 172.21.15.78:0/3258632906 shutdown_connections 2023-12-12T10:12:35.161 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.154+0000 7fc5eb7f5640 1 -- 172.21.15.78:0/3258632906 wait complete. 2023-12-12T10:12:35.162 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.154+0000 7fc5eb7f5640 1 Processor -- start 2023-12-12T10:12:35.162 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.154+0000 7fc5eb7f5640 1 -- start start 2023-12-12T10:12:35.162 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.158+0000 7fc5eb7f5640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc5e406a540 0x7fc5e41455f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:35.163 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.158+0000 7fc5eb7f5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc5e40b43f0 0x7fc5e4167950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:35.163 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.158+0000 7fc5eb7f5640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc5e4146930 0x7fc5e413d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:35.163 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.158+0000 7fc5eb7f5640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e413f770 con 0x7fc5e40b43f0 2023-12-12T10:12:35.163 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.158+0000 7fc5eb7f5640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e413fa50 con 0x7fc5e4146930 2023-12-12T10:12:35.163 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.158+0000 7fc5eb7f5640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5e413fd30 con 0x7fc5e406a540 2023-12-12T10:12:35.164 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.158+0000 7fc5e8d90640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc5e40b43f0 0x7fc5e4167950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:35.164 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.158+0000 7fc5e8d90640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc5e40b43f0 0x7fc5e4167950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37346/0 (socket says 172.21.15.78:37346) 2023-12-12T10:12:35.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.158+0000 7fc5e8d90640 1 -- 172.21.15.78:0/3359158711 learned_addr learned my addr 172.21.15.78:0/3359158711 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:35.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.158+0000 7fc5e9d92640 1 --2- 172.21.15.78:0/3359158711 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc5e4146930 0x7fc5e413d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:35.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.158+0000 7fc5e9591640 1 --2- 172.21.15.78:0/3359158711 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc5e406a540 0x7fc5e41455f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:35.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.158+0000 7fc5e8d90640 1 -- 172.21.15.78:0/3359158711 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc5e406a540 msgr2=0x7fc5e41455f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:35.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.158+0000 7fc5e8d90640 1 --2- 172.21.15.78:0/3359158711 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc5e406a540 0x7fc5e41455f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:35.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.158+0000 7fc5e8d90640 1 -- 172.21.15.78:0/3359158711 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc5e4146930 msgr2=0x7fc5e413d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:35.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.158+0000 7fc5e8d90640 1 --2- 172.21.15.78:0/3359158711 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc5e4146930 0x7fc5e413d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:35.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.158+0000 7fc5e8d90640 1 -- 172.21.15.78:0/3359158711 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5d40094d0 con 0x7fc5e40b43f0 2023-12-12T10:12:35.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.158+0000 7fc5e8d90640 1 --2- 172.21.15.78:0/3359158711 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc5e40b43f0 0x7fc5e4167950 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fc5d401a0b0 tx=0x7fc5d401acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:35.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.158+0000 7fc5d9ffb640 1 -- 172.21.15.78:0/3359158711 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5d40b4800 con 0x7fc5e40b43f0 2023-12-12T10:12:35.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.158+0000 7fc5d9ffb640 1 -- 172.21.15.78:0/3359158711 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5d40b4960 con 0x7fc5e40b43f0 2023-12-12T10:12:35.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.158+0000 7fc5eb7f5640 1 -- 172.21.15.78:0/3359158711 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5e4140010 con 0x7fc5e40b43f0 2023-12-12T10:12:35.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.158+0000 7fc5d9ffb640 1 -- 172.21.15.78:0/3359158711 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5d40b4d10 con 0x7fc5e40b43f0 2023-12-12T10:12:35.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.158+0000 7fc5eb7f5640 1 -- 172.21.15.78:0/3359158711 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5e4145bd0 con 0x7fc5e40b43f0 2023-12-12T10:12:35.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.158+0000 7fc5eb7f5640 1 -- 172.21.15.78:0/3359158711 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5e40671f0 con 0x7fc5e40b43f0 2023-12-12T10:12:35.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.158+0000 7fc5d9ffb640 1 -- 172.21.15.78:0/3359158711 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc5d40c7440 con 0x7fc5e40b43f0 2023-12-12T10:12:35.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.162+0000 7fc5d9ffb640 1 --2- 172.21.15.78:0/3359158711 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fc5c8066470 0x7fc5c8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:35.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.162+0000 7fc5d9ffb640 1 -- 172.21.15.78:0/3359158711 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc5d411eee0 con 0x7fc5e40b43f0 2023-12-12T10:12:35.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.162+0000 7fc5e9591640 1 --2- 172.21.15.78:0/3359158711 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fc5c8066470 0x7fc5c8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:35.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.162+0000 7fc5e9591640 1 --2- 172.21.15.78:0/3359158711 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fc5c8066470 0x7fc5c8068930 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc5e4145580 tx=0x7fc5e0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:35.171 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.166+0000 7fc5d9ffb640 1 -- 172.21.15.78:0/3359158711 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc5d40ec190 con 0x7fc5e40b43f0 2023-12-12T10:12:35.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.342+0000 7fc5eb7f5640 1 -- 172.21.15.78:0/3359158711 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc5e40725a0 con 0x7fc5e40b43f0 2023-12-12T10:12:35.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.346+0000 7fc5d9ffb640 1 -- 172.21.15.78:0/3359158711 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4912 (secure 0 0 0) 0x7fc5d40ef7b0 con 0x7fc5e40b43f0 2023-12-12T10:12:35.354 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:12:35.355 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/3747609982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":3747609982},{"type":"v1","addr":"172.21.15.187:6834","nonce":3747609982}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4282,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/3245919280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":3245919280},{"type":"v1","addr":"172.21.15.187:6835","nonce":3245919280}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4293,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/3902814576","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":3902814576},{"type":"v1","addr":"172.21.15.78:6835","nonce":3902814576}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-12T10:12:09.200933+0000","modified":"2023-12-12T10:12:26.296409+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4296},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4296":{"gid":4296,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.78:6837/739552946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":739552946},{"type":"v1","addr":"172.21.15.78:6837","nonce":739552946}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-12T10:12:35.356 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 9 2023-12-12T10:12:35.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.346+0000 7fc5eb7f5640 1 -- 172.21.15.78:0/3359158711 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fc5c8066470 msgr2=0x7fc5c8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:35.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.346+0000 7fc5eb7f5640 1 --2- 172.21.15.78:0/3359158711 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fc5c8066470 0x7fc5c8068930 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc5e4145580 tx=0x7fc5e0009040 comp rx=0 tx=0).stop 2023-12-12T10:12:35.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.346+0000 7fc5eb7f5640 1 -- 172.21.15.78:0/3359158711 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc5e40b43f0 msgr2=0x7fc5e4167950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:35.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.346+0000 7fc5eb7f5640 1 --2- 172.21.15.78:0/3359158711 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc5e40b43f0 0x7fc5e4167950 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fc5d401a0b0 tx=0x7fc5d401acc0 comp rx=0 tx=0).stop 2023-12-12T10:12:35.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.346+0000 7fc5eb7f5640 1 -- 172.21.15.78:0/3359158711 shutdown_connections 2023-12-12T10:12:35.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.346+0000 7fc5eb7f5640 1 --2- 172.21.15.78:0/3359158711 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fc5c8066470 0x7fc5c8068930 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:35.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.346+0000 7fc5eb7f5640 1 --2- 172.21.15.78:0/3359158711 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc5e4146930 0x7fc5e413d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:35.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.346+0000 7fc5eb7f5640 1 --2- 172.21.15.78:0/3359158711 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc5e40b43f0 0x7fc5e4167950 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:35.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.346+0000 7fc5eb7f5640 1 --2- 172.21.15.78:0/3359158711 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc5e406a540 0x7fc5e41455f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:35.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.346+0000 7fc5eb7f5640 1 -- 172.21.15.78:0/3359158711 >> 172.21.15.78:0/3359158711 conn(0x7fc5e40b1c10 msgr2=0x7fc5e415fe20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:35.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.346+0000 7fc5eb7f5640 1 -- 172.21.15.78:0/3359158711 shutdown_connections 2023-12-12T10:12:35.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.346+0000 7fc5eb7f5640 1 -- 172.21.15.78:0/3359158711 wait complete. 2023-12-12T10:12:35.372 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T10:12:35.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.502+0000 7f71abbaa640 1 Processor -- start 2023-12-12T10:12:35.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.502+0000 7f71abbaa640 1 -- start start 2023-12-12T10:12:35.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.502+0000 7f71abbaa640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f71a413ceb0 0x7f71a413d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:35.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.502+0000 7f71abbaa640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f71a4071bf0 0x7f71a4072030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:35.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.502+0000 7f71abbaa640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f71a413f550 0x7f71a413f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:35.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.502+0000 7f71abbaa640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71a413ff20 con 0x7f71a4071bf0 2023-12-12T10:12:35.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.502+0000 7f71abbaa640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71a40705a0 con 0x7f71a413ceb0 2023-12-12T10:12:35.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.502+0000 7f71abbaa640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71a4140410 con 0x7f71a413f550 2023-12-12T10:12:35.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.502+0000 7f71a9145640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f71a4071bf0 0x7f71a4072030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:35.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.502+0000 7f71a9145640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f71a4071bf0 0x7f71a4072030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37350/0 (socket says 172.21.15.78:37350) 2023-12-12T10:12:35.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.502+0000 7f71a9145640 1 -- 172.21.15.78:0/3147410538 learned_addr learned my addr 172.21.15.78:0/3147410538 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:35.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.502+0000 7f71a9946640 1 --2- 172.21.15.78:0/3147410538 >> v2:172.21.15.187:3300/0 conn(0x7f71a413ceb0 0x7f71a413d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:35.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.502+0000 7f71aa147640 1 --2- 172.21.15.78:0/3147410538 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f71a413f550 0x7f71a413f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:35.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.502+0000 7f71a9145640 1 -- 172.21.15.78:0/3147410538 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f71a413f550 msgr2=0x7f71a413f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:35.512 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.502+0000 7f71a9145640 1 --2- 172.21.15.78:0/3147410538 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f71a413f550 0x7f71a413f9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:35.512 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.502+0000 7f71a9145640 1 -- 172.21.15.78:0/3147410538 >> v2:172.21.15.187:3300/0 conn(0x7f71a413ceb0 msgr2=0x7f71a413d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:35.512 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.502+0000 7f71a9145640 1 --2- 172.21.15.78:0/3147410538 >> v2:172.21.15.187:3300/0 conn(0x7f71a413ceb0 0x7f71a413d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:35.512 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.506+0000 7f71a9145640 1 -- 172.21.15.78:0/3147410538 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71a40cdc90 con 0x7f71a4071bf0 2023-12-12T10:12:35.513 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.506+0000 7f71a9145640 1 --2- 172.21.15.78:0/3147410538 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f71a4071bf0 0x7f71a4072030 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f71a4072840 tx=0x7f719401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5f8ad83fab00fb7 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:35.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.506+0000 7f71a8944640 1 -- 172.21.15.78:0/3147410538 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71940ab600 con 0x7f71a4071bf0 2023-12-12T10:12:35.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.506+0000 7f71a8944640 1 -- 172.21.15.78:0/3147410538 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71940a7050 con 0x7f71a4071bf0 2023-12-12T10:12:35.514 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.506+0000 7f71a8944640 1 -- 172.21.15.78:0/3147410538 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71940ab980 con 0x7f71a4071bf0 2023-12-12T10:12:35.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.506+0000 7f71abbaa640 1 -- 172.21.15.78:0/3147410538 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f71a4071bf0 msgr2=0x7f71a4072030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:35.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.506+0000 7f71abbaa640 1 --2- 172.21.15.78:0/3147410538 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f71a4071bf0 0x7f71a4072030 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f71a4072840 tx=0x7f719401c500 comp rx=0 tx=0).stop 2023-12-12T10:12:35.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.506+0000 7f71abbaa640 1 -- 172.21.15.78:0/3147410538 shutdown_connections 2023-12-12T10:12:35.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.506+0000 7f71abbaa640 1 --2- 172.21.15.78:0/3147410538 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f71a413f550 0x7f71a413f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:35.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.506+0000 7f71abbaa640 1 --2- 172.21.15.78:0/3147410538 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f71a4071bf0 0x7f71a4072030 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:35.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.506+0000 7f71abbaa640 1 --2- 172.21.15.78:0/3147410538 >> v2:172.21.15.187:3300/0 conn(0x7f71a413ceb0 0x7f71a413d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:35.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.506+0000 7f71abbaa640 1 -- 172.21.15.78:0/3147410538 >> 172.21.15.78:0/3147410538 conn(0x7f71a406c5d0 msgr2=0x7f71a406c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:35.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.506+0000 7f71abbaa640 1 -- 172.21.15.78:0/3147410538 shutdown_connections 2023-12-12T10:12:35.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.506+0000 7f71abbaa640 1 -- 172.21.15.78:0/3147410538 wait complete. 2023-12-12T10:12:35.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.510+0000 7f71abbaa640 1 Processor -- start 2023-12-12T10:12:35.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.510+0000 7f71abbaa640 1 -- start start 2023-12-12T10:12:35.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.510+0000 7f71abbaa640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f71a4071bf0 0x7f71a4141370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:35.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.510+0000 7f71abbaa640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f71a413ceb0 0x7f71a4159090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:35.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.510+0000 7f71abbaa640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f71a413f550 0x7f71a4164e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:35.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.510+0000 7f71abbaa640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71a4140640 con 0x7f71a413ceb0 2023-12-12T10:12:35.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.510+0000 7f71abbaa640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71a4165bc0 con 0x7f71a4071bf0 2023-12-12T10:12:35.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.510+0000 7f71abbaa640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71a4140890 con 0x7f71a413f550 2023-12-12T10:12:35.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.510+0000 7f71a9145640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f71a413ceb0 0x7f71a4159090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:35.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.510+0000 7f71a9145640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f71a413ceb0 0x7f71a4159090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37358/0 (socket says 172.21.15.78:37358) 2023-12-12T10:12:35.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.510+0000 7f71a9145640 1 -- 172.21.15.78:0/288454793 learned_addr learned my addr 172.21.15.78:0/288454793 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:35.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.510+0000 7f71a9946640 1 --2- 172.21.15.78:0/288454793 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f71a4071bf0 0x7f71a4141370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:35.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.510+0000 7f71aa147640 1 --2- 172.21.15.78:0/288454793 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f71a413f550 0x7f71a4164e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:35.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.510+0000 7f71a9145640 1 -- 172.21.15.78:0/288454793 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f71a413f550 msgr2=0x7f71a4164e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:35.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.510+0000 7f71a9145640 1 --2- 172.21.15.78:0/288454793 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f71a413f550 0x7f71a4164e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:35.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.510+0000 7f71a9145640 1 -- 172.21.15.78:0/288454793 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f71a4071bf0 msgr2=0x7f71a4141370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:35.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.510+0000 7f71a9145640 1 --2- 172.21.15.78:0/288454793 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f71a4071bf0 0x7f71a4141370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:35.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.510+0000 7f71a9145640 1 -- 172.21.15.78:0/288454793 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71940094d0 con 0x7f71a413ceb0 2023-12-12T10:12:35.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.510+0000 7f71aa147640 1 --2- 172.21.15.78:0/288454793 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f71a413f550 0x7f71a4164e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T10:12:35.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.510+0000 7f71a9145640 1 --2- 172.21.15.78:0/288454793 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f71a413ceb0 0x7f71a4159090 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f719401abb0 tx=0x7f71940192a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:35.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.510+0000 7f719a7fc640 1 -- 172.21.15.78:0/288454793 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71940b4420 con 0x7f71a413ceb0 2023-12-12T10:12:35.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.510+0000 7f719a7fc640 1 -- 172.21.15.78:0/288454793 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71940b4580 con 0x7f71a413ceb0 2023-12-12T10:12:35.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.514+0000 7f719a7fc640 1 -- 172.21.15.78:0/288454793 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71940b48f0 con 0x7f71a413ceb0 2023-12-12T10:12:35.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.514+0000 7f71abbaa640 1 -- 172.21.15.78:0/288454793 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71a4140b70 con 0x7f71a413ceb0 2023-12-12T10:12:35.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.514+0000 7f71abbaa640 1 -- 172.21.15.78:0/288454793 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71a41418b0 con 0x7f71a413ceb0 2023-12-12T10:12:35.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.514+0000 7f71abbaa640 1 -- 172.21.15.78:0/288454793 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71a40671f0 con 0x7f71a413ceb0 2023-12-12T10:12:35.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.514+0000 7f719a7fc640 1 -- 172.21.15.78:0/288454793 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f71940b2070 con 0x7f71a413ceb0 2023-12-12T10:12:35.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.514+0000 7f719a7fc640 1 --2- 172.21.15.78:0/288454793 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f7188066470 0x7f7188068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:35.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.514+0000 7f719a7fc640 1 -- 172.21.15.78:0/288454793 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f719411d320 con 0x7f71a413ceb0 2023-12-12T10:12:35.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.514+0000 7f71a9946640 1 --2- 172.21.15.78:0/288454793 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f7188066470 0x7f7188068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:35.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.514+0000 7f71a9946640 1 --2- 172.21.15.78:0/288454793 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f7188066470 0x7f7188068930 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f71a00045f0 tx=0x7f71a0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:35.525 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.518+0000 7f719a7fc640 1 -- 172.21.15.78:0/288454793 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f71940ea4c0 con 0x7f71a413ceb0 2023-12-12T10:12:35.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.670+0000 7f71abbaa640 1 -- 172.21.15.78:0/288454793 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f71a4067530 con 0x7f71a413ceb0 2023-12-12T10:12:35.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.670+0000 7f719a7fc640 1 -- 172.21.15.78:0/288454793 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18310 (secure 0 0 0) 0x7f71940edae0 con 0x7f71a413ceb0 2023-12-12T10:12:35.678 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:12:35.678 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":24,"fsid":"fc81937c-bd26-483c-952b-d1324fcb0c9e","created":"2023-12-12T10:11:44.020214+0000","modified":"2023-12-12T10:12:14.355146+0000","last_up_change":"2023-12-12T10:11:56.278318+0000","last_in_change":"2023-12-12T10:11:46.553610+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T10:11:57.053584+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-12T10:12:07.454450+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-12T10:12:08.182909+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-12T10:12:11.977952+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"22dfdedf-5f6c-4b20-9f6c-30517a1db70a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6809","nonce":3345683600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6811","nonce":3345683600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6815","nonce":3345683600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6813","nonce":3345683600}]},"public_addr":"172.21.15.78:6809/3345683600","cluster_addr":"172.21.15.78:6811/3345683600","heartbeat_back_addr":"172.21.15.78:6815/3345683600","heartbeat_front_addr":"172.21.15.78:6813/3345683600","state":["exists","up"]},{"osd":1,"uuid":"be34a7f3-a69a-462e-9ddf-5e537448dba2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6801","nonce":962652768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6803","nonce":962652768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6807","nonce":962652768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6805","nonce":962652768}]},"public_addr":"172.21.15.78:6801/962652768","cluster_addr":"172.21.15.78:6803/962652768","heartbeat_back_addr":"172.21.15.78:6807/962652768","heartbeat_front_addr":"172.21.15.78:6805/962652768","state":["exists","up"]},{"osd":2,"uuid":"55b381de-5f56-4b14-80f7-e6e41e084a13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6818","nonce":2910206054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6822","nonce":2910206054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6829","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6831","nonce":2910206054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6826","nonce":2910206054}]},"public_addr":"172.21.15.78:6818/2910206054","cluster_addr":"172.21.15.78:6822/2910206054","heartbeat_back_addr":"172.21.15.78:6831/2910206054","heartbeat_front_addr":"172.21.15.78:6826/2910206054","state":["exists","up"]},{"osd":3,"uuid":"d7682de1-25cb-4cec-869f-8851c28b0e6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6819","nonce":3750796703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6821","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6823","nonce":3750796703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6830","nonce":3750796703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6825","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6827","nonce":3750796703}]},"public_addr":"172.21.15.78:6819/3750796703","cluster_addr":"172.21.15.78:6823/3750796703","heartbeat_back_addr":"172.21.15.78:6830/3750796703","heartbeat_front_addr":"172.21.15.78:6827/3750796703","state":["exists","up"]},{"osd":4,"uuid":"8279815a-d6c7-4199-871e-d28971b9dc07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6809","nonce":2944277204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6811","nonce":2944277204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6815","nonce":2944277204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6813","nonce":2944277204}]},"public_addr":"172.21.15.187:6809/2944277204","cluster_addr":"172.21.15.187:6811/2944277204","heartbeat_back_addr":"172.21.15.187:6815/2944277204","heartbeat_front_addr":"172.21.15.187:6813/2944277204","state":["exists","up"]},{"osd":5,"uuid":"0a714c65-f8ce-4340-968f-11a799677ef3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6801","nonce":185858620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6803","nonce":185858620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6807","nonce":185858620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6805","nonce":185858620}]},"public_addr":"172.21.15.187:6801/185858620","cluster_addr":"172.21.15.187:6803/185858620","heartbeat_back_addr":"172.21.15.187:6807/185858620","heartbeat_front_addr":"172.21.15.187:6805/185858620","state":["exists","up"]},{"osd":6,"uuid":"d0bba9ab-f7ee-449e-8999-1c0cf7e6d53c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6817","nonce":4213392126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6819","nonce":4213392126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6824","nonce":4213392126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6821","nonce":4213392126}]},"public_addr":"172.21.15.187:6817/4213392126","cluster_addr":"172.21.15.187:6819/4213392126","heartbeat_back_addr":"172.21.15.187:6824/4213392126","heartbeat_front_addr":"172.21.15.187:6821/4213392126","state":["exists","up"]},{"osd":7,"uuid":"efe5e0d9-2f87-4889-a27a-e2a95a632302","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6823","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6825","nonce":85774004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6827","nonce":85774004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6831","nonce":85774004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6829","nonce":85774004}]},"public_addr":"172.21.15.187:6825/85774004","cluster_addr":"172.21.15.187:6827/85774004","heartbeat_back_addr":"172.21.15.187:6831/85774004","heartbeat_front_addr":"172.21.15.187:6829/85774004","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.214447+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.448899+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.293107+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.564184+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.175026+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.097717+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.261141+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.287681+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T10:12:35.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.674+0000 7f71abbaa640 1 -- 172.21.15.78:0/288454793 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f7188066470 msgr2=0x7f7188068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:35.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.674+0000 7f71abbaa640 1 --2- 172.21.15.78:0/288454793 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f7188066470 0x7f7188068930 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f71a00045f0 tx=0x7f71a0008040 comp rx=0 tx=0).stop 2023-12-12T10:12:35.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.674+0000 7f71abbaa640 1 -- 172.21.15.78:0/288454793 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f71a413ceb0 msgr2=0x7f71a4159090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:35.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.674+0000 7f71abbaa640 1 --2- 172.21.15.78:0/288454793 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f71a413ceb0 0x7f71a4159090 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f719401abb0 tx=0x7f71940192a0 comp rx=0 tx=0).stop 2023-12-12T10:12:35.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.674+0000 7f71abbaa640 1 -- 172.21.15.78:0/288454793 shutdown_connections 2023-12-12T10:12:35.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.674+0000 7f71abbaa640 1 --2- 172.21.15.78:0/288454793 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f7188066470 0x7f7188068930 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:35.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.674+0000 7f71abbaa640 1 --2- 172.21.15.78:0/288454793 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f71a413f550 0x7f71a4164e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:35.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.674+0000 7f71abbaa640 1 --2- 172.21.15.78:0/288454793 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f71a413ceb0 0x7f71a4159090 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:35.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.674+0000 7f71abbaa640 1 --2- 172.21.15.78:0/288454793 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f71a4071bf0 0x7f71a4141370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:35.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.674+0000 7f71abbaa640 1 -- 172.21.15.78:0/288454793 >> 172.21.15.78:0/288454793 conn(0x7f71a406c5d0 msgr2=0x7f71a415b690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:35.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.674+0000 7f71abbaa640 1 -- 172.21.15.78:0/288454793 shutdown_connections 2023-12-12T10:12:35.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.674+0000 7f71abbaa640 1 -- 172.21.15.78:0/288454793 wait complete. 2023-12-12T10:12:35.699 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-12T10:11:57.053584+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-12T10:12:07.454450+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-12T10:12:08.182909+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-12T10:12:11.977952+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-12T10:12:35.700 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-12T10:12:35.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.834+0000 7f65f7c5a640 1 Processor -- start 2023-12-12T10:12:35.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.834+0000 7f65f7c5a640 1 -- start start 2023-12-12T10:12:35.842 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.834+0000 7f65f7c5a640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f65f01656b0 0x7f65f00b2c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:35.842 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.834+0000 7f65f7c5a640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65f00b39a0 con 0x7f65f0071d40 2023-12-12T10:12:35.842 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.834+0000 7f65f7c5a640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65f00b3c80 con 0x7f65f00b31b0 2023-12-12T10:12:35.842 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.834+0000 7f65f7c5a640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65f0072120 con 0x7f65f01656b0 2023-12-12T10:12:35.842 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.834+0000 7f65f59f6640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f65f0071d40 0x7f65f0164fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:34386/0 (socket says 172.21.15.78:34386) 2023-12-12T10:12:35.842 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.834+0000 7f65f59f6640 1 -- 172.21.15.78:0/2417642113 learned_addr learned my addr 172.21.15.78:0/2417642113 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-12-12T10:12:35.842 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.834+0000 7f65f51f5640 1 --2- 172.21.15.78:0/2417642113 >> v2:172.21.15.187:3300/0 conn(0x7f65f01656b0 0x7f65f00b2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:35.842 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.834+0000 7f65f49f4640 1 -- 172.21.15.78:0/2417642113 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1861006700 0 0) 0x7f65f00b39a0 con 0x7f65f0071d40 2023-12-12T10:12:35.842 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.834+0000 7f65f49f4640 1 -- 172.21.15.78:0/2417642113 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f65dc003530 con 0x7f65f0071d40 2023-12-12T10:12:35.843 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.834+0000 7f65f51f5640 1 -- 172.21.15.78:0/2417642113 >> v1:172.21.15.187:6789/0 conn(0x7f65f00b31b0 legacy=0x7f65f006cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:35.843 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.834+0000 7f65f51f5640 1 -- 172.21.15.78:0/2417642113 >> v1:172.21.15.78:6789/0 conn(0x7f65f0071d40 legacy=0x7f65f0164fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:35.843 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.834+0000 7f65f51f5640 1 -- 172.21.15.78:0/2417642113 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65f00b3f60 con 0x7f65f01656b0 2023-12-12T10:12:35.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.838+0000 7f65f51f5640 1 --2- 172.21.15.78:0/2417642113 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f65f01656b0 0x7f65f00b2c70 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f65e00097c0 tx=0x7f65e001c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b29d6013a9aa848a server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:35.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.838+0000 7f65f49f4640 1 -- 172.21.15.78:0/2417642113 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e00ab650 con 0x7f65f01656b0 2023-12-12T10:12:35.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.838+0000 7f65f49f4640 1 -- 172.21.15.78:0/2417642113 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65e00ab7b0 con 0x7f65f01656b0 2023-12-12T10:12:35.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.838+0000 7f65f49f4640 1 -- 172.21.15.78:0/2417642113 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e00abb40 con 0x7f65f01656b0 2023-12-12T10:12:35.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.838+0000 7f65f7c5a640 1 -- 172.21.15.78:0/2417642113 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f65f01656b0 msgr2=0x7f65f00b2c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:35.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.838+0000 7f65f7c5a640 1 --2- 172.21.15.78:0/2417642113 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f65f01656b0 0x7f65f00b2c70 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f65e00097c0 tx=0x7f65e001c450 comp rx=0 tx=0).stop 2023-12-12T10:12:35.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.838+0000 7f65f7c5a640 1 -- 172.21.15.78:0/2417642113 shutdown_connections 2023-12-12T10:12:35.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.838+0000 7f65f7c5a640 1 --2- 172.21.15.78:0/2417642113 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f65f01656b0 0x7f65f00b2c70 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:35.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.838+0000 7f65f7c5a640 1 -- 172.21.15.78:0/2417642113 >> 172.21.15.78:0/2417642113 conn(0x7f65f006a710 msgr2=0x7f65f006ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:35.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.838+0000 7f65f7c5a640 1 -- 172.21.15.78:0/2417642113 shutdown_connections 2023-12-12T10:12:35.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.838+0000 7f65f7c5a640 1 -- 172.21.15.78:0/2417642113 wait complete. 2023-12-12T10:12:35.848 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.842+0000 7f65f7c5a640 1 Processor -- start 2023-12-12T10:12:35.848 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.842+0000 7f65f7c5a640 1 -- start start 2023-12-12T10:12:35.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.842+0000 7f65f7c5a640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f65f0071d40 0x7f65f013f630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:35.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.842+0000 7f65f7c5a640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f65f00b31b0 0x7f65f00af190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:35.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.842+0000 7f65f7c5a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65f01656b0 0x7f65f013fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:35.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.842+0000 7f65f7c5a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65f00a9330 con 0x7f65f01656b0 2023-12-12T10:12:35.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.842+0000 7f65f7c5a640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65f013fb70 con 0x7f65f0071d40 2023-12-12T10:12:35.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.842+0000 7f65f7c5a640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65f013f1a0 con 0x7f65f00b31b0 2023-12-12T10:12:35.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.842+0000 7f65f61f7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65f01656b0 0x7f65f013fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:35.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.842+0000 7f65f61f7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65f01656b0 0x7f65f013fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37374/0 (socket says 172.21.15.78:37374) 2023-12-12T10:12:35.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.842+0000 7f65f61f7640 1 -- 172.21.15.78:0/2602780252 learned_addr learned my addr 172.21.15.78:0/2602780252 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:35.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.842+0000 7f65f59f6640 1 --2- 172.21.15.78:0/2602780252 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f65f0071d40 0x7f65f013f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:35.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.842+0000 7f65f61f7640 1 -- 172.21.15.78:0/2602780252 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f65f00b31b0 msgr2=0x7f65f00af190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:35.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.842+0000 7f65f51f5640 1 --2- 172.21.15.78:0/2602780252 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f65f00b31b0 0x7f65f00af190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:35.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.842+0000 7f65f61f7640 1 --2- 172.21.15.78:0/2602780252 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f65f00b31b0 0x7f65f00af190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:35.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.842+0000 7f65f61f7640 1 -- 172.21.15.78:0/2602780252 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f65f0071d40 msgr2=0x7f65f013f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:35.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.842+0000 7f65f61f7640 1 --2- 172.21.15.78:0/2602780252 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f65f0071d40 0x7f65f013f630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:35.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.842+0000 7f65f61f7640 1 -- 172.21.15.78:0/2602780252 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65e0009420 con 0x7f65f01656b0 2023-12-12T10:12:35.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.842+0000 7f65f59f6640 1 --2- 172.21.15.78:0/2602780252 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f65f0071d40 0x7f65f013f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T10:12:35.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.842+0000 7f65f51f5640 1 --2- 172.21.15.78:0/2602780252 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f65f00b31b0 0x7f65f00af190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T10:12:35.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.842+0000 7f65f61f7640 1 --2- 172.21.15.78:0/2602780252 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65f01656b0 0x7f65f013fd50 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f65e800c770 tx=0x7f65e800cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:35.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.842+0000 7f65e67fc640 1 -- 172.21.15.78:0/2602780252 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e8003b80 con 0x7f65f01656b0 2023-12-12T10:12:35.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.842+0000 7f65e67fc640 1 -- 172.21.15.78:0/2602780252 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65e8003ce0 con 0x7f65f01656b0 2023-12-12T10:12:35.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.842+0000 7f65f7c5a640 1 -- 172.21.15.78:0/2602780252 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65f01577d0 con 0x7f65f01656b0 2023-12-12T10:12:35.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.842+0000 7f65e67fc640 1 -- 172.21.15.78:0/2602780252 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65e800aa30 con 0x7f65f01656b0 2023-12-12T10:12:35.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.842+0000 7f65f7c5a640 1 -- 172.21.15.78:0/2602780252 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65f013eb50 con 0x7f65f01656b0 2023-12-12T10:12:35.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.846+0000 7f65f7c5a640 1 -- 172.21.15.78:0/2602780252 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65f00671f0 con 0x7f65f01656b0 2023-12-12T10:12:35.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.846+0000 7f65e67fc640 1 -- 172.21.15.78:0/2602780252 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f65e800ab90 con 0x7f65f01656b0 2023-12-12T10:12:35.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.846+0000 7f65e67fc640 1 --2- 172.21.15.78:0/2602780252 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f65d4066470 0x7f65d4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:35.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.846+0000 7f65e67fc640 1 -- 172.21.15.78:0/2602780252 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f65e8083fd0 con 0x7f65f01656b0 2023-12-12T10:12:35.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.846+0000 7f65f59f6640 1 --2- 172.21.15.78:0/2602780252 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f65d4066470 0x7f65d4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:35.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.846+0000 7f65f59f6640 1 --2- 172.21.15.78:0/2602780252 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f65d4066470 0x7f65d4068930 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f65ec0011f0 tx=0x7f65ec009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:35.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:35.850+0000 7f65e67fc640 1 -- 172.21.15.78:0/2602780252 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f65e80510c0 con 0x7f65f01656b0 2023-12-12T10:12:36.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.002+0000 7f65f7c5a640 1 -- 172.21.15.78:0/2602780252 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f65f013f310 con 0x7f65f01656b0 2023-12-12T10:12:36.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.002+0000 7f65e67fc640 1 -- 172.21.15.78:0/2602780252 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f65e80546e0 con 0x7f65f01656b0 2023-12-12T10:12:36.008 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2023-12-12T10:12:36.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.002+0000 7f65f7c5a640 1 -- 172.21.15.78:0/2602780252 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f65d4066470 msgr2=0x7f65d4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:36.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.002+0000 7f65f7c5a640 1 --2- 172.21.15.78:0/2602780252 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f65d4066470 0x7f65d4068930 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f65ec0011f0 tx=0x7f65ec009040 comp rx=0 tx=0).stop 2023-12-12T10:12:36.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.002+0000 7f65f7c5a640 1 -- 172.21.15.78:0/2602780252 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65f01656b0 msgr2=0x7f65f013fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:36.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.002+0000 7f65f7c5a640 1 --2- 172.21.15.78:0/2602780252 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65f01656b0 0x7f65f013fd50 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f65e800c770 tx=0x7f65e800cc30 comp rx=0 tx=0).stop 2023-12-12T10:12:36.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.002+0000 7f65f7c5a640 1 -- 172.21.15.78:0/2602780252 shutdown_connections 2023-12-12T10:12:36.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.002+0000 7f65f7c5a640 1 --2- 172.21.15.78:0/2602780252 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f65d4066470 0x7f65d4068930 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:36.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.002+0000 7f65f7c5a640 1 --2- 172.21.15.78:0/2602780252 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f65f01656b0 0x7f65f013fd50 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:36.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.002+0000 7f65f7c5a640 1 --2- 172.21.15.78:0/2602780252 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f65f00b31b0 0x7f65f00af190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:36.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.002+0000 7f65f7c5a640 1 --2- 172.21.15.78:0/2602780252 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f65f0071d40 0x7f65f013f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:36.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.002+0000 7f65f7c5a640 1 -- 172.21.15.78:0/2602780252 >> 172.21.15.78:0/2602780252 conn(0x7f65f006a710 msgr2=0x7f65f016c5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:36.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.002+0000 7f65f7c5a640 1 -- 172.21.15.78:0/2602780252 shutdown_connections 2023-12-12T10:12:36.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.002+0000 7f65f7c5a640 1 -- 172.21.15.78:0/2602780252 wait complete. 2023-12-12T10:12:36.029 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-12T10:12:36.169 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.166+0000 7fd3246e3640 1 Processor -- start 2023-12-12T10:12:36.169 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.166+0000 7fd3246e3640 1 -- start start 2023-12-12T10:12:36.173 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.166+0000 7fd3246e3640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd31c06cf60 0x7fd31c15f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:36.173 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.166+0000 7fd3246e3640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fd31c15b390 0x7fd31c15b840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:36.173 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.166+0000 7fd3246e3640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd31c0cea30 con 0x7fd31c0cb4b0 2023-12-12T10:12:36.173 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.166+0000 7fd3246e3640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd31c15bd80 con 0x7fd31c06cf60 2023-12-12T10:12:36.173 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.166+0000 7fd3246e3640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd31c15bfc0 con 0x7fd31c15b390 2023-12-12T10:12:36.173 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.166+0000 7fd321c7e640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd31c06cf60 0x7fd31c15f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:36.173 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.166+0000 7fd321c7e640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd31c06cf60 0x7fd31c15f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37384/0 (socket says 172.21.15.78:37384) 2023-12-12T10:12:36.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.166+0000 7fd321c7e640 1 -- 172.21.15.78:0/4005199232 learned_addr learned my addr 172.21.15.78:0/4005199232 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:36.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.166+0000 7fd322c80640 1 --2- 172.21.15.78:0/4005199232 >> v2:172.21.15.187:3300/0 conn(0x7fd31c15b390 0x7fd31c15b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:36.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.166+0000 7fd321c7e640 1 -- 172.21.15.78:0/4005199232 >> v2:172.21.15.187:3300/0 conn(0x7fd31c15b390 msgr2=0x7fd31c15b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:36.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.166+0000 7fd321c7e640 1 --2- 172.21.15.78:0/4005199232 >> v2:172.21.15.187:3300/0 conn(0x7fd31c15b390 0x7fd31c15b840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:36.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.166+0000 7fd321c7e640 1 -- 172.21.15.78:0/4005199232 >> v1:172.21.15.187:6789/0 conn(0x7fd31c0cb4b0 legacy=0x7fd31c06c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:36.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.166+0000 7fd321c7e640 1 -- 172.21.15.78:0/4005199232 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd31c15c2a0 con 0x7fd31c06cf60 2023-12-12T10:12:36.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.166+0000 7fd321c7e640 1 --2- 172.21.15.78:0/4005199232 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd31c06cf60 0x7fd31c15f500 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fd31c0ce120 tx=0x7fd30c01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72f6528cc773c1ed server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:36.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.166+0000 7fd32147d640 1 -- 172.21.15.78:0/4005199232 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd30c0ab600 con 0x7fd31c06cf60 2023-12-12T10:12:36.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.166+0000 7fd32147d640 1 -- 172.21.15.78:0/4005199232 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd30c0ab760 con 0x7fd31c06cf60 2023-12-12T10:12:36.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.166+0000 7fd32147d640 1 -- 172.21.15.78:0/4005199232 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd30c0abaf0 con 0x7fd31c06cf60 2023-12-12T10:12:36.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.170+0000 7fd3246e3640 1 -- 172.21.15.78:0/4005199232 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd31c06cf60 msgr2=0x7fd31c15f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:36.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.170+0000 7fd3246e3640 1 --2- 172.21.15.78:0/4005199232 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd31c06cf60 0x7fd31c15f500 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fd31c0ce120 tx=0x7fd30c01c400 comp rx=0 tx=0).stop 2023-12-12T10:12:36.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.170+0000 7fd3246e3640 1 -- 172.21.15.78:0/4005199232 shutdown_connections 2023-12-12T10:12:36.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.170+0000 7fd3246e3640 1 --2- 172.21.15.78:0/4005199232 >> v2:172.21.15.187:3300/0 conn(0x7fd31c15b390 0x7fd31c15b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:36.176 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.170+0000 7fd3246e3640 1 --2- 172.21.15.78:0/4005199232 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd31c06cf60 0x7fd31c15f500 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:36.176 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.170+0000 7fd3246e3640 1 -- 172.21.15.78:0/4005199232 >> 172.21.15.78:0/4005199232 conn(0x7fd31c06a710 msgr2=0x7fd31c06ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:36.176 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.170+0000 7fd3246e3640 1 -- 172.21.15.78:0/4005199232 shutdown_connections 2023-12-12T10:12:36.176 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.170+0000 7fd3246e3640 1 -- 172.21.15.78:0/4005199232 wait complete. 2023-12-12T10:12:36.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.170+0000 7fd3246e3640 1 Processor -- start 2023-12-12T10:12:36.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.170+0000 7fd3246e3640 1 -- start start 2023-12-12T10:12:36.179 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.170+0000 7fd3246e3640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd31c06cf60 0x7fd31c13f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:36.179 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.170+0000 7fd3246e3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd31c0cb4b0 0x7fd31c1652b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:36.179 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.170+0000 7fd3246e3640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd31c15b390 0x7fd31c163170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:36.179 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.170+0000 7fd3246e3640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd31c1609b0 con 0x7fd31c0cb4b0 2023-12-12T10:12:36.179 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.170+0000 7fd3246e3640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd31c160c90 con 0x7fd31c15b390 2023-12-12T10:12:36.179 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.170+0000 7fd3246e3640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd31c160f70 con 0x7fd31c06cf60 2023-12-12T10:12:36.179 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.170+0000 7fd321c7e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd31c0cb4b0 0x7fd31c1652b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:36.179 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.170+0000 7fd321c7e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd31c0cb4b0 0x7fd31c1652b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37400/0 (socket says 172.21.15.78:37400) 2023-12-12T10:12:36.179 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.170+0000 7fd321c7e640 1 -- 172.21.15.78:0/1849890477 learned_addr learned my addr 172.21.15.78:0/1849890477 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:36.179 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.170+0000 7fd32247f640 1 --2- 172.21.15.78:0/1849890477 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd31c06cf60 0x7fd31c13f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:36.179 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.170+0000 7fd322c80640 1 --2- 172.21.15.78:0/1849890477 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd31c15b390 0x7fd31c163170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:36.179 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.170+0000 7fd321c7e640 1 -- 172.21.15.78:0/1849890477 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd31c06cf60 msgr2=0x7fd31c13f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:36.180 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.170+0000 7fd321c7e640 1 --2- 172.21.15.78:0/1849890477 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd31c06cf60 0x7fd31c13f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:36.180 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.170+0000 7fd321c7e640 1 -- 172.21.15.78:0/1849890477 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd31c15b390 msgr2=0x7fd31c163170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:36.180 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.170+0000 7fd321c7e640 1 --2- 172.21.15.78:0/1849890477 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd31c15b390 0x7fd31c163170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:36.180 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.170+0000 7fd321c7e640 1 -- 172.21.15.78:0/1849890477 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd30c0094d0 con 0x7fd31c0cb4b0 2023-12-12T10:12:36.180 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.170+0000 7fd322c80640 1 --2- 172.21.15.78:0/1849890477 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd31c15b390 0x7fd31c163170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T10:12:36.180 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.174+0000 7fd321c7e640 1 --2- 172.21.15.78:0/1849890477 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd31c0cb4b0 0x7fd31c1652b0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fd30c01a030 tx=0x7fd30c01ac40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:36.181 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.174+0000 7fd312ffd640 1 -- 172.21.15.78:0/1849890477 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd30c0b4800 con 0x7fd31c0cb4b0 2023-12-12T10:12:36.181 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.174+0000 7fd312ffd640 1 -- 172.21.15.78:0/1849890477 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd30c0b4960 con 0x7fd31c0cb4b0 2023-12-12T10:12:36.181 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.174+0000 7fd3246e3640 1 -- 172.21.15.78:0/1849890477 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd31c161250 con 0x7fd31c0cb4b0 2023-12-12T10:12:36.181 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.174+0000 7fd312ffd640 1 -- 172.21.15.78:0/1849890477 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd30c0b4cf0 con 0x7fd31c0cb4b0 2023-12-12T10:12:36.181 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.174+0000 7fd3246e3640 1 -- 172.21.15.78:0/1849890477 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd31c13fa70 con 0x7fd31c0cb4b0 2023-12-12T10:12:36.181 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.174+0000 7fd3246e3640 1 -- 172.21.15.78:0/1849890477 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd31c0671f0 con 0x7fd31c0cb4b0 2023-12-12T10:12:36.181 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.174+0000 7fd312ffd640 1 -- 172.21.15.78:0/1849890477 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd30c0c7390 con 0x7fd31c0cb4b0 2023-12-12T10:12:36.182 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.174+0000 7fd312ffd640 1 --2- 172.21.15.78:0/1849890477 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fd300066470 0x7fd300068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:36.182 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.174+0000 7fd312ffd640 1 -- 172.21.15.78:0/1849890477 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd30c11ec00 con 0x7fd31c0cb4b0 2023-12-12T10:12:36.182 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.174+0000 7fd32247f640 1 --2- 172.21.15.78:0/1849890477 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fd300066470 0x7fd300068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:36.183 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.178+0000 7fd32247f640 1 --2- 172.21.15.78:0/1849890477 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fd300066470 0x7fd300068930 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd318007fd0 tx=0x7fd318007e40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:36.186 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.178+0000 7fd312ffd640 1 -- 172.21.15.78:0/1849890477 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd30c0ebda0 con 0x7fd31c0cb4b0 2023-12-12T10:12:36.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.326+0000 7fd3246e3640 1 -- 172.21.15.78:0/1849890477 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd31c067530 con 0x7fd31c0cb4b0 2023-12-12T10:12:36.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.330+0000 7fd312ffd640 1 -- 172.21.15.78:0/1849890477 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd30c0ef3c0 con 0x7fd31c0cb4b0 2023-12-12T10:12:36.335 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2023-12-12T10:12:36.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.330+0000 7fd3246e3640 1 -- 172.21.15.78:0/1849890477 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fd300066470 msgr2=0x7fd300068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:36.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.330+0000 7fd3246e3640 1 --2- 172.21.15.78:0/1849890477 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fd300066470 0x7fd300068930 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd318007fd0 tx=0x7fd318007e40 comp rx=0 tx=0).stop 2023-12-12T10:12:36.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.330+0000 7fd3246e3640 1 -- 172.21.15.78:0/1849890477 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd31c0cb4b0 msgr2=0x7fd31c1652b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:36.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.330+0000 7fd3246e3640 1 --2- 172.21.15.78:0/1849890477 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd31c0cb4b0 0x7fd31c1652b0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fd30c01a030 tx=0x7fd30c01ac40 comp rx=0 tx=0).stop 2023-12-12T10:12:36.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.330+0000 7fd3246e3640 1 -- 172.21.15.78:0/1849890477 shutdown_connections 2023-12-12T10:12:36.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.330+0000 7fd3246e3640 1 --2- 172.21.15.78:0/1849890477 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fd300066470 0x7fd300068930 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:36.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.330+0000 7fd3246e3640 1 --2- 172.21.15.78:0/1849890477 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd31c15b390 0x7fd31c163170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:36.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.330+0000 7fd3246e3640 1 --2- 172.21.15.78:0/1849890477 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd31c0cb4b0 0x7fd31c1652b0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:36.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.330+0000 7fd3246e3640 1 --2- 172.21.15.78:0/1849890477 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd31c06cf60 0x7fd31c13f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:36.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.330+0000 7fd3246e3640 1 -- 172.21.15.78:0/1849890477 >> 172.21.15.78:0/1849890477 conn(0x7fd31c06a710 msgr2=0x7fd31c0b0b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:36.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.330+0000 7fd3246e3640 1 -- 172.21.15.78:0/1849890477 shutdown_connections 2023-12-12T10:12:36.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.330+0000 7fd3246e3640 1 -- 172.21.15.78:0/1849890477 wait complete. 2023-12-12T10:12:36.356 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-12T10:12:36.495 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.490+0000 7f4060ddf640 1 Processor -- start 2023-12-12T10:12:36.495 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.490+0000 7f4060ddf640 1 -- start start 2023-12-12T10:12:36.497 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.490+0000 7f4060ddf640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f405c15d0f0 0x7f405c06b690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:36.497 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.490+0000 7f4060ddf640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f405c06bbd0 0x7f405c0b2520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:36.497 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.490+0000 7f4060ddf640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f405c06e290 con 0x7f405c0b2a60 2023-12-12T10:12:36.497 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.490+0000 7f4060ddf640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f405c06e570 con 0x7f405c15d0f0 2023-12-12T10:12:36.497 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.490+0000 7f4060ddf640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f405c06ae90 con 0x7f405c06bbd0 2023-12-12T10:12:36.497 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.490+0000 7f405a59c640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f405c15d0f0 0x7f405c06b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:36.497 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.490+0000 7f405a59c640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f405c15d0f0 0x7f405c06b690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37408/0 (socket says 172.21.15.78:37408) 2023-12-12T10:12:36.498 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.490+0000 7f405a59c640 1 -- 172.21.15.78:0/3935963382 learned_addr learned my addr 172.21.15.78:0/3935963382 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:36.498 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.490+0000 7f4059d9b640 1 --2- 172.21.15.78:0/3935963382 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f405c06bbd0 0x7f405c0b2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:36.498 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.490+0000 7f405a59c640 1 -- 172.21.15.78:0/3935963382 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f405c06bbd0 msgr2=0x7f405c0b2520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:36.498 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.490+0000 7f405a59c640 1 --2- 172.21.15.78:0/3935963382 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f405c06bbd0 0x7f405c0b2520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:36.498 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.490+0000 7f405a59c640 1 -- 172.21.15.78:0/3935963382 >> v1:172.21.15.78:6789/0 conn(0x7f405c0b2a60 legacy=0x7f405c06d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:36.498 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.490+0000 7f405a59c640 1 -- 172.21.15.78:0/3935963382 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f405c06b170 con 0x7f405c15d0f0 2023-12-12T10:12:36.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.494+0000 7f405a59c640 1 --2- 172.21.15.78:0/3935963382 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f405c15d0f0 0x7f405c06b690 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f404c009870 tx=0x7f404c01c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=992d27cb626d0bfd server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:36.501 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.494+0000 7f405959a640 1 -- 172.21.15.78:0/3935963382 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f404c0a9620 con 0x7f405c15d0f0 2023-12-12T10:12:36.501 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.494+0000 7f405959a640 1 -- 172.21.15.78:0/3935963382 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f404c0a9780 con 0x7f405c15d0f0 2023-12-12T10:12:36.501 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.494+0000 7f405959a640 1 -- 172.21.15.78:0/3935963382 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f404c0a9b10 con 0x7f405c15d0f0 2023-12-12T10:12:36.501 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.494+0000 7f4060ddf640 1 -- 172.21.15.78:0/3935963382 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f405c15d0f0 msgr2=0x7f405c06b690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:36.502 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.494+0000 7f4060ddf640 1 --2- 172.21.15.78:0/3935963382 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f405c15d0f0 0x7f405c06b690 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f404c009870 tx=0x7f404c01c540 comp rx=0 tx=0).stop 2023-12-12T10:12:36.502 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.494+0000 7f4060ddf640 1 -- 172.21.15.78:0/3935963382 shutdown_connections 2023-12-12T10:12:36.502 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.494+0000 7f4060ddf640 1 --2- 172.21.15.78:0/3935963382 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f405c06bbd0 0x7f405c0b2520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:36.502 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.494+0000 7f4060ddf640 1 --2- 172.21.15.78:0/3935963382 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f405c15d0f0 0x7f405c06b690 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:36.502 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.494+0000 7f4060ddf640 1 -- 172.21.15.78:0/3935963382 >> 172.21.15.78:0/3935963382 conn(0x7f405c0b1650 msgr2=0x7f405c0b1a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:36.502 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.494+0000 7f4060ddf640 1 -- 172.21.15.78:0/3935963382 shutdown_connections 2023-12-12T10:12:36.502 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.494+0000 7f4060ddf640 1 -- 172.21.15.78:0/3935963382 wait complete. 2023-12-12T10:12:36.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.498+0000 7f4060ddf640 1 Processor -- start 2023-12-12T10:12:36.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.498+0000 7f4060ddf640 1 -- start start 2023-12-12T10:12:36.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.498+0000 7f4060ddf640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f405c06bbd0 0x7f405c0ae2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:36.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.498+0000 7f4060ddf640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f405c0b2a60 0x7f405c0ad290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:36.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.498+0000 7f4060ddf640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f405c15d0f0 0x7f405c149e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:36.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.498+0000 7f4060ddf640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f405c147a90 con 0x7f405c15d0f0 2023-12-12T10:12:36.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.498+0000 7f4060ddf640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f405c0ae8a0 con 0x7f405c06bbd0 2023-12-12T10:12:36.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.498+0000 7f4060ddf640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f405c1490d0 con 0x7f405c0b2a60 2023-12-12T10:12:36.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.498+0000 7f405ad9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f405c15d0f0 0x7f405c149e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:36.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.498+0000 7f405ad9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f405c15d0f0 0x7f405c149e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37422/0 (socket says 172.21.15.78:37422) 2023-12-12T10:12:36.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.498+0000 7f405ad9d640 1 -- 172.21.15.78:0/1772722274 learned_addr learned my addr 172.21.15.78:0/1772722274 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:36.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.498+0000 7f4059d9b640 1 --2- 172.21.15.78:0/1772722274 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f405c0b2a60 0x7f405c0ad290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:36.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.498+0000 7f405a59c640 1 --2- 172.21.15.78:0/1772722274 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f405c06bbd0 0x7f405c0ae2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:36.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.498+0000 7f405ad9d640 1 -- 172.21.15.78:0/1772722274 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f405c0b2a60 msgr2=0x7f405c0ad290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:36.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.498+0000 7f405ad9d640 1 --2- 172.21.15.78:0/1772722274 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f405c0b2a60 0x7f405c0ad290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:36.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.498+0000 7f405ad9d640 1 -- 172.21.15.78:0/1772722274 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f405c06bbd0 msgr2=0x7f405c0ae2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:36.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.498+0000 7f405ad9d640 1 --2- 172.21.15.78:0/1772722274 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f405c06bbd0 0x7f405c0ae2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:36.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.498+0000 7f405ad9d640 1 -- 172.21.15.78:0/1772722274 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f404c0094d0 con 0x7f405c15d0f0 2023-12-12T10:12:36.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.498+0000 7f4059d9b640 1 --2- 172.21.15.78:0/1772722274 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f405c0b2a60 0x7f405c0ad290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T10:12:36.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.498+0000 7f405a59c640 1 --2- 172.21.15.78:0/1772722274 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f405c06bbd0 0x7f405c0ae2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T10:12:36.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.498+0000 7f405ad9d640 1 --2- 172.21.15.78:0/1772722274 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f405c15d0f0 0x7f405c149e90 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f405400c770 tx=0x7f405400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:36.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.498+0000 7f404affd640 1 -- 172.21.15.78:0/1772722274 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4054003b80 con 0x7f405c15d0f0 2023-12-12T10:12:36.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.498+0000 7f404affd640 1 -- 172.21.15.78:0/1772722274 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4054003ce0 con 0x7f405c15d0f0 2023-12-12T10:12:36.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.498+0000 7f404affd640 1 -- 172.21.15.78:0/1772722274 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f405400aa90 con 0x7f405c15d0f0 2023-12-12T10:12:36.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.498+0000 7f4060ddf640 1 -- 172.21.15.78:0/1772722274 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f405c1493b0 con 0x7f405c15d0f0 2023-12-12T10:12:36.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.498+0000 7f4060ddf640 1 -- 172.21.15.78:0/1772722274 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f405c149970 con 0x7f405c15d0f0 2023-12-12T10:12:36.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.498+0000 7f4060ddf640 1 -- 172.21.15.78:0/1772722274 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f405c149b90 con 0x7f405c15d0f0 2023-12-12T10:12:36.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.502+0000 7f404affd640 1 -- 172.21.15.78:0/1772722274 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f405400abf0 con 0x7f405c15d0f0 2023-12-12T10:12:36.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.502+0000 7f404affd640 1 --2- 172.21.15.78:0/1772722274 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f403c066470 0x7f403c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:36.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.502+0000 7f404affd640 1 -- 172.21.15.78:0/1772722274 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4054084070 con 0x7f405c15d0f0 2023-12-12T10:12:36.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.502+0000 7f405a59c640 1 --2- 172.21.15.78:0/1772722274 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f403c066470 0x7f403c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:36.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.502+0000 7f405a59c640 1 --2- 172.21.15.78:0/1772722274 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f403c066470 0x7f403c068930 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f404c0ae000 tx=0x7f404c0b3040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:36.512 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.506+0000 7f404affd640 1 -- 172.21.15.78:0/1772722274 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f40540b5280 con 0x7f405c15d0f0 2023-12-12T10:12:36.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.658+0000 7f4060ddf640 1 -- 172.21.15.78:0/1772722274 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f405c067530 con 0x7f405c15d0f0 2023-12-12T10:12:36.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.658+0000 7f404affd640 1 -- 172.21.15.78:0/1772722274 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4054051160 con 0x7f405c15d0f0 2023-12-12T10:12:36.662 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2023-12-12T10:12:36.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.662+0000 7f4060ddf640 1 -- 172.21.15.78:0/1772722274 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f403c066470 msgr2=0x7f403c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:36.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.662+0000 7f4060ddf640 1 --2- 172.21.15.78:0/1772722274 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f403c066470 0x7f403c068930 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f404c0ae000 tx=0x7f404c0b3040 comp rx=0 tx=0).stop 2023-12-12T10:12:36.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.662+0000 7f4060ddf640 1 -- 172.21.15.78:0/1772722274 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f405c15d0f0 msgr2=0x7f405c149e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:36.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.662+0000 7f4060ddf640 1 --2- 172.21.15.78:0/1772722274 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f405c15d0f0 0x7f405c149e90 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f405400c770 tx=0x7f405400cc30 comp rx=0 tx=0).stop 2023-12-12T10:12:36.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.662+0000 7f4060ddf640 1 -- 172.21.15.78:0/1772722274 shutdown_connections 2023-12-12T10:12:36.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.662+0000 7f4060ddf640 1 --2- 172.21.15.78:0/1772722274 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f403c066470 0x7f403c068930 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:36.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.662+0000 7f4060ddf640 1 --2- 172.21.15.78:0/1772722274 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f405c15d0f0 0x7f405c149e90 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:36.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.662+0000 7f4060ddf640 1 --2- 172.21.15.78:0/1772722274 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f405c0b2a60 0x7f405c0ad290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:36.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.662+0000 7f4060ddf640 1 --2- 172.21.15.78:0/1772722274 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f405c06bbd0 0x7f405c0ae2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:36.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.662+0000 7f4060ddf640 1 -- 172.21.15.78:0/1772722274 >> 172.21.15.78:0/1772722274 conn(0x7f405c0b1650 msgr2=0x7f405c0b22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:36.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.662+0000 7f4060ddf640 1 -- 172.21.15.78:0/1772722274 shutdown_connections 2023-12-12T10:12:36.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.662+0000 7f4060ddf640 1 -- 172.21.15.78:0/1772722274 wait complete. 2023-12-12T10:12:36.682 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-12T10:12:36.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.822+0000 7f085fe79640 1 Processor -- start 2023-12-12T10:12:36.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.822+0000 7f085fe79640 1 -- start start 2023-12-12T10:12:36.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.822+0000 7f085fe79640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f0858071d40 0x7f0858164fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:36.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.822+0000 7f085fe79640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f08581654e0 0x7f08580b2c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:36.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.822+0000 7f085fe79640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f08580b31b0 0x7f0858161960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:36.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.822+0000 7f085fe79640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0858072120 con 0x7f08581654e0 2023-12-12T10:12:36.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.822+0000 7f085fe79640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0858165940 con 0x7f0858071d40 2023-12-12T10:12:36.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.822+0000 7f085fe79640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08580b39a0 con 0x7f08580b31b0 2023-12-12T10:12:36.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.822+0000 7f085d414640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f08581654e0 0x7f08580b2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:36.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.822+0000 7f085d414640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f08581654e0 0x7f08580b2c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37436/0 (socket says 172.21.15.78:37436) 2023-12-12T10:12:36.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.822+0000 7f085d414640 1 -- 172.21.15.78:0/2623280676 learned_addr learned my addr 172.21.15.78:0/2623280676 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:36.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.822+0000 7f085dc15640 1 --2- 172.21.15.78:0/2623280676 >> v2:172.21.15.187:3300/0 conn(0x7f0858071d40 0x7f0858164fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:36.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.822+0000 7f085e416640 1 --2- 172.21.15.78:0/2623280676 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f08580b31b0 0x7f0858161960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:36.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.822+0000 7f085d414640 1 -- 172.21.15.78:0/2623280676 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f08580b31b0 msgr2=0x7f0858161960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:36.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.822+0000 7f085d414640 1 --2- 172.21.15.78:0/2623280676 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f08580b31b0 0x7f0858161960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:36.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.822+0000 7f085d414640 1 -- 172.21.15.78:0/2623280676 >> v2:172.21.15.187:3300/0 conn(0x7f0858071d40 msgr2=0x7f0858164fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:36.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.822+0000 7f085d414640 1 --2- 172.21.15.78:0/2623280676 >> v2:172.21.15.187:3300/0 conn(0x7f0858071d40 0x7f0858164fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:36.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.822+0000 7f085d414640 1 -- 172.21.15.78:0/2623280676 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08580b3c80 con 0x7f08581654e0 2023-12-12T10:12:36.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.826+0000 7f085d414640 1 --2- 172.21.15.78:0/2623280676 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f08581654e0 0x7f08580b2c70 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f085806e4c0 tx=0x7f084801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e748b92f11cc53f6 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:36.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.826+0000 7f085cc13640 1 -- 172.21.15.78:0/2623280676 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08480aa5f0 con 0x7f08581654e0 2023-12-12T10:12:36.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.826+0000 7f085cc13640 1 -- 172.21.15.78:0/2623280676 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08480aa750 con 0x7f08581654e0 2023-12-12T10:12:36.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.826+0000 7f085cc13640 1 -- 172.21.15.78:0/2623280676 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08480aaae0 con 0x7f08581654e0 2023-12-12T10:12:36.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.826+0000 7f085fe79640 1 -- 172.21.15.78:0/2623280676 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f08581654e0 msgr2=0x7f08580b2c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:36.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.826+0000 7f085fe79640 1 --2- 172.21.15.78:0/2623280676 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f08581654e0 0x7f08580b2c70 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f085806e4c0 tx=0x7f084801c4d0 comp rx=0 tx=0).stop 2023-12-12T10:12:36.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.826+0000 7f085fe79640 1 -- 172.21.15.78:0/2623280676 shutdown_connections 2023-12-12T10:12:36.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.826+0000 7f085fe79640 1 --2- 172.21.15.78:0/2623280676 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f08580b31b0 0x7f0858161960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:36.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.826+0000 7f085fe79640 1 --2- 172.21.15.78:0/2623280676 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f08581654e0 0x7f08580b2c70 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:36.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.826+0000 7f085fe79640 1 --2- 172.21.15.78:0/2623280676 >> v2:172.21.15.187:3300/0 conn(0x7f0858071d40 0x7f0858164fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:36.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.826+0000 7f085fe79640 1 -- 172.21.15.78:0/2623280676 >> 172.21.15.78:0/2623280676 conn(0x7f085806a710 msgr2=0x7f085806ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:36.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.826+0000 7f085fe79640 1 -- 172.21.15.78:0/2623280676 shutdown_connections 2023-12-12T10:12:36.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.826+0000 7f085fe79640 1 -- 172.21.15.78:0/2623280676 wait complete. 2023-12-12T10:12:36.831 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.830+0000 7f085fe79640 1 Processor -- start 2023-12-12T10:12:36.831 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.830+0000 7f085fe79640 1 -- start start 2023-12-12T10:12:36.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.830+0000 7f085fe79640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0858071d40 0x7f085813c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:36.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.830+0000 7f085fe79640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f08580b31b0 0x7f0858155190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:36.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.830+0000 7f085fe79640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f08581654e0 0x7f08580af330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:36.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.830+0000 7f085fe79640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f085816b840 con 0x7f08581654e0 2023-12-12T10:12:36.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.830+0000 7f085fe79640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08580cc340 con 0x7f0858071d40 2023-12-12T10:12:36.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.830+0000 7f085fe79640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f085816b280 con 0x7f08580b31b0 2023-12-12T10:12:36.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.830+0000 7f085e416640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f08581654e0 0x7f08580af330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:36.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.830+0000 7f085e416640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f08581654e0 0x7f08580af330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37446/0 (socket says 172.21.15.78:37446) 2023-12-12T10:12:36.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.830+0000 7f085e416640 1 -- 172.21.15.78:0/2685442133 learned_addr learned my addr 172.21.15.78:0/2685442133 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:36.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.830+0000 7f085d414640 1 --2- 172.21.15.78:0/2685442133 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f08580b31b0 0x7f0858155190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:36.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.830+0000 7f085dc15640 1 --2- 172.21.15.78:0/2685442133 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0858071d40 0x7f085813c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:36.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.830+0000 7f085e416640 1 -- 172.21.15.78:0/2685442133 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f08580b31b0 msgr2=0x7f0858155190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:36.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.830+0000 7f085e416640 1 --2- 172.21.15.78:0/2685442133 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f08580b31b0 0x7f0858155190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:36.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.830+0000 7f085e416640 1 -- 172.21.15.78:0/2685442133 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0858071d40 msgr2=0x7f085813c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:36.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.830+0000 7f085e416640 1 --2- 172.21.15.78:0/2685442133 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0858071d40 0x7f085813c890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:36.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.830+0000 7f085e416640 1 -- 172.21.15.78:0/2685442133 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08480094d0 con 0x7f08581654e0 2023-12-12T10:12:36.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.830+0000 7f085e416640 1 --2- 172.21.15.78:0/2685442133 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f08581654e0 0x7f08580af330 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f0850007e40 tx=0x7f085000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:36.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.830+0000 7f084e7fc640 1 -- 172.21.15.78:0/2685442133 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0850014620 con 0x7f08581654e0 2023-12-12T10:12:36.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.830+0000 7f084e7fc640 1 -- 172.21.15.78:0/2685442133 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f085000ee90 con 0x7f08581654e0 2023-12-12T10:12:36.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.830+0000 7f084e7fc640 1 -- 172.21.15.78:0/2685442133 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08500149e0 con 0x7f08581654e0 2023-12-12T10:12:36.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.830+0000 7f085fe79640 1 -- 172.21.15.78:0/2685442133 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f085816b560 con 0x7f08581654e0 2023-12-12T10:12:36.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.830+0000 7f085fe79640 1 -- 172.21.15.78:0/2685442133 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0858162ed0 con 0x7f08581654e0 2023-12-12T10:12:36.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.830+0000 7f085fe79640 1 -- 172.21.15.78:0/2685442133 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08580671f0 con 0x7f08581654e0 2023-12-12T10:12:36.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.834+0000 7f084e7fc640 1 -- 172.21.15.78:0/2685442133 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f0850014b40 con 0x7f08581654e0 2023-12-12T10:12:36.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.834+0000 7f084e7fc640 1 --2- 172.21.15.78:0/2685442133 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f083c066470 0x7f083c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:36.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.834+0000 7f084e7fc640 1 -- 172.21.15.78:0/2685442133 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0850084970 con 0x7f08581654e0 2023-12-12T10:12:36.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.834+0000 7f085dc15640 1 --2- 172.21.15.78:0/2685442133 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f083c066470 0x7f083c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:36.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.834+0000 7f085dc15640 1 --2- 172.21.15.78:0/2685442133 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f083c066470 0x7f083c068930 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f08580b0830 tx=0x7f0854008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:36.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.838+0000 7f084e7fc640 1 -- 172.21.15.78:0/2685442133 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0850051bb0 con 0x7f08581654e0 2023-12-12T10:12:36.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.986+0000 7f085fe79640 1 -- 172.21.15.78:0/2685442133 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f0858067530 con 0x7f08581654e0 2023-12-12T10:12:36.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.986+0000 7f084e7fc640 1 -- 172.21.15.78:0/2685442133 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7f08500551d0 con 0x7f08581654e0 2023-12-12T10:12:36.990 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2023-12-12T10:12:36.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.990+0000 7f085fe79640 1 -- 172.21.15.78:0/2685442133 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f083c066470 msgr2=0x7f083c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:36.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.990+0000 7f085fe79640 1 --2- 172.21.15.78:0/2685442133 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f083c066470 0x7f083c068930 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f08580b0830 tx=0x7f0854008040 comp rx=0 tx=0).stop 2023-12-12T10:12:36.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.990+0000 7f085fe79640 1 -- 172.21.15.78:0/2685442133 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f08581654e0 msgr2=0x7f08580af330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:36.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.990+0000 7f085fe79640 1 --2- 172.21.15.78:0/2685442133 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f08581654e0 0x7f08580af330 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f0850007e40 tx=0x7f085000e4b0 comp rx=0 tx=0).stop 2023-12-12T10:12:36.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.990+0000 7f085fe79640 1 -- 172.21.15.78:0/2685442133 shutdown_connections 2023-12-12T10:12:36.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.990+0000 7f085fe79640 1 --2- 172.21.15.78:0/2685442133 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f083c066470 0x7f083c068930 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:36.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.990+0000 7f085fe79640 1 --2- 172.21.15.78:0/2685442133 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f08581654e0 0x7f08580af330 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:36.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.990+0000 7f085fe79640 1 --2- 172.21.15.78:0/2685442133 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f08580b31b0 0x7f0858155190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:36.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.990+0000 7f085fe79640 1 --2- 172.21.15.78:0/2685442133 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0858071d40 0x7f085813c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:36.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.990+0000 7f085fe79640 1 -- 172.21.15.78:0/2685442133 >> 172.21.15.78:0/2685442133 conn(0x7f085806a710 msgr2=0x7f085806d760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:36.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.990+0000 7f085fe79640 1 -- 172.21.15.78:0/2685442133 shutdown_connections 2023-12-12T10:12:36.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:36.990+0000 7f085fe79640 1 -- 172.21.15.78:0/2685442133 wait complete. 2023-12-12T10:12:37.011 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-12T10:12:37.064 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T10:12:37.069 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T10:12:37.154 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.150+0000 7f2db3a17640 1 Processor -- start 2023-12-12T10:12:37.154 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.150+0000 7f2db3a17640 1 -- start start 2023-12-12T10:12:37.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.154+0000 7f2db3a17640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f2dac13ceb0 0x7f2dac13d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:37.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.154+0000 7f2db3a17640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2dac0705a0 con 0x7f2dac13fc60 2023-12-12T10:12:37.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.154+0000 7f2db3a17640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2dac140410 con 0x7f2dac071bf0 2023-12-12T10:12:37.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.154+0000 7f2db3a17640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2dac0cdc90 con 0x7f2dac13ceb0 2023-12-12T10:12:37.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.154+0000 7f2db17b3640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f2dac13ceb0 0x7f2dac13d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:37.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.154+0000 7f2db1fb4640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f2dac13fc60 0x7f2dac0ce120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:34400/0 (socket says 172.21.15.78:34400) 2023-12-12T10:12:37.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.154+0000 7f2db1fb4640 1 -- 172.21.15.78:0/1997020533 learned_addr learned my addr 172.21.15.78:0/1997020533 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-12-12T10:12:37.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.154+0000 7f2db17b3640 1 -- 172.21.15.78:0/1997020533 >> v1:172.21.15.187:6789/0 conn(0x7f2dac071bf0 legacy=0x7f2dac13f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:37.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.154+0000 7f2db17b3640 1 -- 172.21.15.78:0/1997020533 >> v1:172.21.15.78:6789/0 conn(0x7f2dac13fc60 legacy=0x7f2dac0ce120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:37.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.154+0000 7f2db17b3640 1 -- 172.21.15.78:0/1997020533 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dac140130 con 0x7f2dac13ceb0 2023-12-12T10:12:37.159 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.158+0000 7f2db17b3640 1 --2- 172.21.15.78:0/1997020533 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2dac13ceb0 0x7f2dac13d4c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f2da80097c0 tx=0x7f2da801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf85555d173c572c server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:37.159 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.158+0000 7f2da3fff640 1 -- 172.21.15.78:0/1997020533 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2da80ab600 con 0x7f2dac13ceb0 2023-12-12T10:12:37.159 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.158+0000 7f2da3fff640 1 -- 172.21.15.78:0/1997020533 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2da80a7050 con 0x7f2dac13ceb0 2023-12-12T10:12:37.160 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.158+0000 7f2da3fff640 1 -- 172.21.15.78:0/1997020533 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2da80ab980 con 0x7f2dac13ceb0 2023-12-12T10:12:37.160 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.158+0000 7f2db3a17640 1 -- 172.21.15.78:0/1997020533 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2dac13ceb0 msgr2=0x7f2dac13d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:37.160 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.158+0000 7f2db3a17640 1 --2- 172.21.15.78:0/1997020533 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2dac13ceb0 0x7f2dac13d4c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f2da80097c0 tx=0x7f2da801c480 comp rx=0 tx=0).stop 2023-12-12T10:12:37.161 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.158+0000 7f2db3a17640 1 -- 172.21.15.78:0/1997020533 shutdown_connections 2023-12-12T10:12:37.161 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.158+0000 7f2db3a17640 1 --2- 172.21.15.78:0/1997020533 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2dac13ceb0 0x7f2dac13d4c0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:37.161 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.158+0000 7f2db3a17640 1 -- 172.21.15.78:0/1997020533 >> 172.21.15.78:0/1997020533 conn(0x7f2dac06c5d0 msgr2=0x7f2dac06c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:37.161 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.158+0000 7f2db3a17640 1 -- 172.21.15.78:0/1997020533 shutdown_connections 2023-12-12T10:12:37.161 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.158+0000 7f2db3a17640 1 -- 172.21.15.78:0/1997020533 wait complete. 2023-12-12T10:12:37.162 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.158+0000 7f2db3a17640 1 Processor -- start 2023-12-12T10:12:37.162 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.158+0000 7f2db3a17640 1 -- start start 2023-12-12T10:12:37.164 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.162+0000 7f2db3a17640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2dac071bf0 0x7f2dac136170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:37.164 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.162+0000 7f2db3a17640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2dac13ceb0 0x7f2dac0aff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:37.164 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.162+0000 7f2db3a17640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2dac13fc60 0x7f2dac0b1b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:37.164 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.162+0000 7f2db3a17640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dac0afaf0 con 0x7f2dac13fc60 2023-12-12T10:12:37.164 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.162+0000 7f2db3a17640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dac0aee70 con 0x7f2dac071bf0 2023-12-12T10:12:37.164 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.162+0000 7f2db3a17640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dac0af150 con 0x7f2dac13ceb0 2023-12-12T10:12:37.164 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.162+0000 7f2db1fb4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2dac13fc60 0x7f2dac0b1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:37.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.162+0000 7f2db1fb4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2dac13fc60 0x7f2dac0b1b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37460/0 (socket says 172.21.15.78:37460) 2023-12-12T10:12:37.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.162+0000 7f2db1fb4640 1 -- 172.21.15.78:0/3723586444 learned_addr learned my addr 172.21.15.78:0/3723586444 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:37.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.162+0000 7f2db17b3640 1 --2- 172.21.15.78:0/3723586444 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2dac071bf0 0x7f2dac136170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:37.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.162+0000 7f2db0fb2640 1 --2- 172.21.15.78:0/3723586444 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2dac13ceb0 0x7f2dac0aff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:37.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.162+0000 7f2db1fb4640 1 -- 172.21.15.78:0/3723586444 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2dac13ceb0 msgr2=0x7f2dac0aff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:37.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.162+0000 7f2db1fb4640 1 --2- 172.21.15.78:0/3723586444 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2dac13ceb0 0x7f2dac0aff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:37.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.162+0000 7f2db1fb4640 1 -- 172.21.15.78:0/3723586444 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2dac071bf0 msgr2=0x7f2dac136170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:37.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.162+0000 7f2db1fb4640 1 --2- 172.21.15.78:0/3723586444 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2dac071bf0 0x7f2dac136170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:37.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.162+0000 7f2db1fb4640 1 -- 172.21.15.78:0/3723586444 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2da8009420 con 0x7f2dac13fc60 2023-12-12T10:12:37.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.162+0000 7f2db1fb4640 1 --2- 172.21.15.78:0/3723586444 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2dac13fc60 0x7f2dac0b1b80 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f2da400caa0 tx=0x7f2da400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:37.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.162+0000 7f2da1ffb640 1 -- 172.21.15.78:0/3723586444 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2da400ac00 con 0x7f2dac13fc60 2023-12-12T10:12:37.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.162+0000 7f2da1ffb640 1 -- 172.21.15.78:0/3723586444 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2da400ad60 con 0x7f2dac13fc60 2023-12-12T10:12:37.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.162+0000 7f2db3a17640 1 -- 172.21.15.78:0/3723586444 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2dac0af430 con 0x7f2dac13fc60 2023-12-12T10:12:37.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.162+0000 7f2da1ffb640 1 -- 172.21.15.78:0/3723586444 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2da4012600 con 0x7f2dac13fc60 2023-12-12T10:12:37.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.162+0000 7f2db3a17640 1 -- 172.21.15.78:0/3723586444 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2dac0aeb20 con 0x7f2dac13fc60 2023-12-12T10:12:37.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.162+0000 7f2db3a17640 1 -- 172.21.15.78:0/3723586444 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2dac0671f0 con 0x7f2dac13fc60 2023-12-12T10:12:37.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.162+0000 7f2da1ffb640 1 -- 172.21.15.78:0/3723586444 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2da4007070 con 0x7f2dac13fc60 2023-12-12T10:12:37.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.166+0000 7f2da1ffb640 1 --2- 172.21.15.78:0/3723586444 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f2d90066470 0x7f2d90068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:37.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.166+0000 7f2da1ffb640 1 -- 172.21.15.78:0/3723586444 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2da4083f80 con 0x7f2dac13fc60 2023-12-12T10:12:37.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.166+0000 7f2db17b3640 1 --2- 172.21.15.78:0/3723586444 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f2d90066470 0x7f2d90068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:37.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.166+0000 7f2db17b3640 1 --2- 172.21.15.78:0/3723586444 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f2d90066470 0x7f2d90068930 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2da80ad000 tx=0x7f2da8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:37.170 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.170+0000 7f2da1ffb640 1 -- 172.21.15.78:0/3723586444 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2da4051120 con 0x7f2dac13fc60 2023-12-12T10:12:37.352 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.350+0000 7f2db3a17640 1 -- 172.21.15.78:0/3723586444 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2dac0afc30 con 0x7f2dac13fc60 2023-12-12T10:12:37.353 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.350+0000 7f2da1ffb640 1 -- 172.21.15.78:0/3723586444 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4912 (secure 0 0 0) 0x7f2da4017090 con 0x7f2dac13fc60 2023-12-12T10:12:37.353 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:12:37.354 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/3747609982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":3747609982},{"type":"v1","addr":"172.21.15.187:6834","nonce":3747609982}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4282,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/3245919280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":3245919280},{"type":"v1","addr":"172.21.15.187:6835","nonce":3245919280}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4293,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/3902814576","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":3902814576},{"type":"v1","addr":"172.21.15.78:6835","nonce":3902814576}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-12T10:12:09.200933+0000","modified":"2023-12-12T10:12:26.296409+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4296},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4296":{"gid":4296,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.78:6837/739552946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":739552946},{"type":"v1","addr":"172.21.15.78:6837","nonce":739552946}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-12T10:12:37.354 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 9 2023-12-12T10:12:37.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.354+0000 7f2db3a17640 1 -- 172.21.15.78:0/3723586444 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f2d90066470 msgr2=0x7f2d90068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:37.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.354+0000 7f2db3a17640 1 --2- 172.21.15.78:0/3723586444 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f2d90066470 0x7f2d90068930 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2da80ad000 tx=0x7f2da8008040 comp rx=0 tx=0).stop 2023-12-12T10:12:37.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.354+0000 7f2db3a17640 1 -- 172.21.15.78:0/3723586444 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2dac13fc60 msgr2=0x7f2dac0b1b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:37.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.354+0000 7f2db3a17640 1 --2- 172.21.15.78:0/3723586444 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2dac13fc60 0x7f2dac0b1b80 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f2da400caa0 tx=0x7f2da400cf60 comp rx=0 tx=0).stop 2023-12-12T10:12:37.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.354+0000 7f2db3a17640 1 -- 172.21.15.78:0/3723586444 shutdown_connections 2023-12-12T10:12:37.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.354+0000 7f2db3a17640 1 --2- 172.21.15.78:0/3723586444 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f2d90066470 0x7f2d90068930 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:37.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.354+0000 7f2db3a17640 1 --2- 172.21.15.78:0/3723586444 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2dac13fc60 0x7f2dac0b1b80 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:37.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.354+0000 7f2db3a17640 1 --2- 172.21.15.78:0/3723586444 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2dac13ceb0 0x7f2dac0aff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:37.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.354+0000 7f2db3a17640 1 --2- 172.21.15.78:0/3723586444 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2dac071bf0 0x7f2dac136170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:37.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.354+0000 7f2db3a17640 1 -- 172.21.15.78:0/3723586444 >> 172.21.15.78:0/3723586444 conn(0x7f2dac06c5d0 msgr2=0x7f2dac070ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:37.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.354+0000 7f2db3a17640 1 -- 172.21.15.78:0/3723586444 shutdown_connections 2023-12-12T10:12:37.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.354+0000 7f2db3a17640 1 -- 172.21.15.78:0/3723586444 wait complete. 2023-12-12T10:12:37.375 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T10:12:37.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.558+0000 7f27d4e06640 1 Processor -- start 2023-12-12T10:12:37.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.558+0000 7f27d4e06640 1 -- start start 2023-12-12T10:12:37.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.558+0000 7f27d4e06640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f27d00d3940 0x7f27d00b15f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:37.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.558+0000 7f27d4e06640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f27d006cda0 0x7f27d00b1b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:37.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.558+0000 7f27d4e06640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27d00d1630 con 0x7f27d01607a0 2023-12-12T10:12:37.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.558+0000 7f27d4e06640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27d006c1a0 con 0x7f27d006cda0 2023-12-12T10:12:37.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.558+0000 7f27d4e06640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27d00d3dd0 con 0x7f27d00d3940 2023-12-12T10:12:37.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.558+0000 7f27cffff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f27d006cda0 0x7f27d00b1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:37.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.558+0000 7f27cffff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f27d006cda0 0x7f27d00b1b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37468/0 (socket says 172.21.15.78:37468) 2023-12-12T10:12:37.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.558+0000 7f27cf7fe640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f27d01607a0 0x7f27d006af50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:34410/0 (socket says 172.21.15.78:34410) 2023-12-12T10:12:37.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.558+0000 7f27cffff640 1 -- 172.21.15.78:0/1370957714 learned_addr learned my addr 172.21.15.78:0/1370957714 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:37.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.558+0000 7f27ceffd640 1 --2- 172.21.15.78:0/1370957714 >> v2:172.21.15.187:3300/0 conn(0x7f27d00d3940 0x7f27d00b15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:37.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.558+0000 7f27cffff640 1 -- 172.21.15.78:0/1370957714 >> v2:172.21.15.187:3300/0 conn(0x7f27d00d3940 msgr2=0x7f27d00b15f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:37.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.558+0000 7f27cffff640 1 --2- 172.21.15.78:0/1370957714 >> v2:172.21.15.187:3300/0 conn(0x7f27d00d3940 0x7f27d00b15f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:37.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.558+0000 7f27cffff640 1 -- 172.21.15.78:0/1370957714 >> v1:172.21.15.78:6789/0 conn(0x7f27d01607a0 legacy=0x7f27d006af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:37.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.558+0000 7f27cffff640 1 -- 172.21.15.78:0/1370957714 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27d006bc20 con 0x7f27d006cda0 2023-12-12T10:12:37.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.558+0000 7f27ceffd640 1 --2- 172.21.15.78:0/1370957714 >> v2:172.21.15.187:3300/0 conn(0x7f27d00d3940 0x7f27d00b15f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T10:12:37.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.562+0000 7f27cffff640 1 --2- 172.21.15.78:0/1370957714 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f27d006cda0 0x7f27d00b1b30 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f27d00b8ed0 tx=0x7f27c801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4873abc6228365b server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:37.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.562+0000 7f27ce7fc640 1 -- 172.21.15.78:0/1370957714 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c80a5770 con 0x7f27d006cda0 2023-12-12T10:12:37.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.562+0000 7f27ce7fc640 1 -- 172.21.15.78:0/1370957714 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27c80a58d0 con 0x7f27d006cda0 2023-12-12T10:12:37.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.562+0000 7f27ce7fc640 1 -- 172.21.15.78:0/1370957714 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c80a5c60 con 0x7f27d006cda0 2023-12-12T10:12:37.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.562+0000 7f27d4e06640 1 -- 172.21.15.78:0/1370957714 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f27d006cda0 msgr2=0x7f27d00b1b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:37.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.562+0000 7f27d4e06640 1 --2- 172.21.15.78:0/1370957714 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f27d006cda0 0x7f27d00b1b30 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f27d00b8ed0 tx=0x7f27c801c9a0 comp rx=0 tx=0).stop 2023-12-12T10:12:37.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.562+0000 7f27d4e06640 1 -- 172.21.15.78:0/1370957714 shutdown_connections 2023-12-12T10:12:37.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.562+0000 7f27d4e06640 1 --2- 172.21.15.78:0/1370957714 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f27d006cda0 0x7f27d00b1b30 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:37.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.562+0000 7f27d4e06640 1 --2- 172.21.15.78:0/1370957714 >> v2:172.21.15.187:3300/0 conn(0x7f27d00d3940 0x7f27d00b15f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:37.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.562+0000 7f27d4e06640 1 -- 172.21.15.78:0/1370957714 >> 172.21.15.78:0/1370957714 conn(0x7f27d00d2e20 msgr2=0x7f27d00d3230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:37.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.562+0000 7f27d4e06640 1 -- 172.21.15.78:0/1370957714 shutdown_connections 2023-12-12T10:12:37.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.562+0000 7f27d4e06640 1 -- 172.21.15.78:0/1370957714 wait complete. 2023-12-12T10:12:37.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.562+0000 7f27d4e06640 1 Processor -- start 2023-12-12T10:12:37.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.566+0000 7f27d4e06640 1 -- start start 2023-12-12T10:12:37.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.566+0000 7f27d4e06640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f27d006cda0 0x7f27d00caa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:37.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.566+0000 7f27d4e06640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f27d01607a0 0x7f27d014c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:37.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.566+0000 7f27d4e06640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f27d014c6b0 0x7f27d0158c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:37.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.566+0000 7f27d4e06640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27d00b6b30 con 0x7f27d01607a0 2023-12-12T10:12:37.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.566+0000 7f27d4e06640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27d014cb30 con 0x7f27d006cda0 2023-12-12T10:12:37.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.566+0000 7f27d4e06640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27d0157e50 con 0x7f27d014c6b0 2023-12-12T10:12:37.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.566+0000 7f27ceffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f27d01607a0 0x7f27d014c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:37.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.566+0000 7f27ceffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f27d01607a0 0x7f27d014c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37484/0 (socket says 172.21.15.78:37484) 2023-12-12T10:12:37.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.566+0000 7f27ceffd640 1 -- 172.21.15.78:0/2788252147 learned_addr learned my addr 172.21.15.78:0/2788252147 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:37.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.566+0000 7f27cf7fe640 1 --2- 172.21.15.78:0/2788252147 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f27d006cda0 0x7f27d00caa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:37.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.566+0000 7f27cffff640 1 --2- 172.21.15.78:0/2788252147 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f27d014c6b0 0x7f27d0158c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:37.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.566+0000 7f27ceffd640 1 -- 172.21.15.78:0/2788252147 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f27d014c6b0 msgr2=0x7f27d0158c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:37.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.566+0000 7f27ceffd640 1 --2- 172.21.15.78:0/2788252147 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f27d014c6b0 0x7f27d0158c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:37.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.566+0000 7f27ceffd640 1 -- 172.21.15.78:0/2788252147 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f27d006cda0 msgr2=0x7f27d00caa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:37.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.566+0000 7f27ceffd640 1 --2- 172.21.15.78:0/2788252147 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f27d006cda0 0x7f27d00caa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:37.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.566+0000 7f27ceffd640 1 -- 172.21.15.78:0/2788252147 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27c8009b30 con 0x7f27d01607a0 2023-12-12T10:12:37.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.566+0000 7f27ceffd640 1 --2- 172.21.15.78:0/2788252147 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f27d01607a0 0x7f27d014c170 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f27c400c7c0 tx=0x7f27c400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:37.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.566+0000 7f27b7fff640 1 -- 172.21.15.78:0/2788252147 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c4007a30 con 0x7f27d01607a0 2023-12-12T10:12:37.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.566+0000 7f27b7fff640 1 -- 172.21.15.78:0/2788252147 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27c4007b90 con 0x7f27d01607a0 2023-12-12T10:12:37.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.566+0000 7f27b7fff640 1 -- 172.21.15.78:0/2788252147 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27c400ce70 con 0x7f27d01607a0 2023-12-12T10:12:37.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.566+0000 7f27d4e06640 1 -- 172.21.15.78:0/2788252147 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27d0158130 con 0x7f27d01607a0 2023-12-12T10:12:37.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.566+0000 7f27d4e06640 1 -- 172.21.15.78:0/2788252147 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27d01586f0 con 0x7f27d01607a0 2023-12-12T10:12:37.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.566+0000 7f27d4e06640 1 -- 172.21.15.78:0/2788252147 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27d0158910 con 0x7f27d01607a0 2023-12-12T10:12:37.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.570+0000 7f27b7fff640 1 -- 172.21.15.78:0/2788252147 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f27c40113f0 con 0x7f27d01607a0 2023-12-12T10:12:37.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.570+0000 7f27b7fff640 1 --2- 172.21.15.78:0/2788252147 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f27bc066470 0x7f27bc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:37.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.570+0000 7f27b7fff640 1 -- 172.21.15.78:0/2788252147 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f27c4084660 con 0x7f27d01607a0 2023-12-12T10:12:37.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.570+0000 7f27cf7fe640 1 --2- 172.21.15.78:0/2788252147 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f27bc066470 0x7f27bc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:37.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.570+0000 7f27cf7fe640 1 --2- 172.21.15.78:0/2788252147 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f27bc066470 0x7f27bc068930 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f27c0000f70 tx=0x7f27c0007e50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:37.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.574+0000 7f27b7fff640 1 -- 172.21.15.78:0/2788252147 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f27c4051800 con 0x7f27d01607a0 2023-12-12T10:12:37.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.722+0000 7f27d4e06640 1 -- 172.21.15.78:0/2788252147 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f27d0068610 con 0x7f27d01607a0 2023-12-12T10:12:37.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.726+0000 7f27b7fff640 1 -- 172.21.15.78:0/2788252147 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18310 (secure 0 0 0) 0x7f27c4054e20 con 0x7f27d01607a0 2023-12-12T10:12:37.728 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:12:37.728 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":24,"fsid":"fc81937c-bd26-483c-952b-d1324fcb0c9e","created":"2023-12-12T10:11:44.020214+0000","modified":"2023-12-12T10:12:14.355146+0000","last_up_change":"2023-12-12T10:11:56.278318+0000","last_in_change":"2023-12-12T10:11:46.553610+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T10:11:57.053584+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-12T10:12:07.454450+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-12T10:12:08.182909+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-12T10:12:11.977952+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"22dfdedf-5f6c-4b20-9f6c-30517a1db70a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6809","nonce":3345683600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6811","nonce":3345683600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6815","nonce":3345683600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6813","nonce":3345683600}]},"public_addr":"172.21.15.78:6809/3345683600","cluster_addr":"172.21.15.78:6811/3345683600","heartbeat_back_addr":"172.21.15.78:6815/3345683600","heartbeat_front_addr":"172.21.15.78:6813/3345683600","state":["exists","up"]},{"osd":1,"uuid":"be34a7f3-a69a-462e-9ddf-5e537448dba2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6801","nonce":962652768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6803","nonce":962652768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6807","nonce":962652768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6805","nonce":962652768}]},"public_addr":"172.21.15.78:6801/962652768","cluster_addr":"172.21.15.78:6803/962652768","heartbeat_back_addr":"172.21.15.78:6807/962652768","heartbeat_front_addr":"172.21.15.78:6805/962652768","state":["exists","up"]},{"osd":2,"uuid":"55b381de-5f56-4b14-80f7-e6e41e084a13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6818","nonce":2910206054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6822","nonce":2910206054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6829","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6831","nonce":2910206054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6826","nonce":2910206054}]},"public_addr":"172.21.15.78:6818/2910206054","cluster_addr":"172.21.15.78:6822/2910206054","heartbeat_back_addr":"172.21.15.78:6831/2910206054","heartbeat_front_addr":"172.21.15.78:6826/2910206054","state":["exists","up"]},{"osd":3,"uuid":"d7682de1-25cb-4cec-869f-8851c28b0e6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6819","nonce":3750796703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6821","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6823","nonce":3750796703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6830","nonce":3750796703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6825","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6827","nonce":3750796703}]},"public_addr":"172.21.15.78:6819/3750796703","cluster_addr":"172.21.15.78:6823/3750796703","heartbeat_back_addr":"172.21.15.78:6830/3750796703","heartbeat_front_addr":"172.21.15.78:6827/3750796703","state":["exists","up"]},{"osd":4,"uuid":"8279815a-d6c7-4199-871e-d28971b9dc07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6809","nonce":2944277204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6811","nonce":2944277204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6815","nonce":2944277204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6813","nonce":2944277204}]},"public_addr":"172.21.15.187:6809/2944277204","cluster_addr":"172.21.15.187:6811/2944277204","heartbeat_back_addr":"172.21.15.187:6815/2944277204","heartbeat_front_addr":"172.21.15.187:6813/2944277204","state":["exists","up"]},{"osd":5,"uuid":"0a714c65-f8ce-4340-968f-11a799677ef3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6801","nonce":185858620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6803","nonce":185858620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6807","nonce":185858620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6805","nonce":185858620}]},"public_addr":"172.21.15.187:6801/185858620","cluster_addr":"172.21.15.187:6803/185858620","heartbeat_back_addr":"172.21.15.187:6807/185858620","heartbeat_front_addr":"172.21.15.187:6805/185858620","state":["exists","up"]},{"osd":6,"uuid":"d0bba9ab-f7ee-449e-8999-1c0cf7e6d53c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6817","nonce":4213392126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6819","nonce":4213392126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6824","nonce":4213392126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6821","nonce":4213392126}]},"public_addr":"172.21.15.187:6817/4213392126","cluster_addr":"172.21.15.187:6819/4213392126","heartbeat_back_addr":"172.21.15.187:6824/4213392126","heartbeat_front_addr":"172.21.15.187:6821/4213392126","state":["exists","up"]},{"osd":7,"uuid":"efe5e0d9-2f87-4889-a27a-e2a95a632302","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6823","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6825","nonce":85774004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6827","nonce":85774004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6831","nonce":85774004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6829","nonce":85774004}]},"public_addr":"172.21.15.187:6825/85774004","cluster_addr":"172.21.15.187:6827/85774004","heartbeat_back_addr":"172.21.15.187:6831/85774004","heartbeat_front_addr":"172.21.15.187:6829/85774004","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.214447+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.448899+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.293107+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.564184+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.175026+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.097717+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.261141+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.287681+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T10:12:37.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.726+0000 7f27d4e06640 1 -- 172.21.15.78:0/2788252147 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f27bc066470 msgr2=0x7f27bc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:37.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.726+0000 7f27d4e06640 1 --2- 172.21.15.78:0/2788252147 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f27bc066470 0x7f27bc068930 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f27c0000f70 tx=0x7f27c0007e50 comp rx=0 tx=0).stop 2023-12-12T10:12:37.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.726+0000 7f27d4e06640 1 -- 172.21.15.78:0/2788252147 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f27d01607a0 msgr2=0x7f27d014c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:37.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.726+0000 7f27d4e06640 1 --2- 172.21.15.78:0/2788252147 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f27d01607a0 0x7f27d014c170 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f27c400c7c0 tx=0x7f27c400cc80 comp rx=0 tx=0).stop 2023-12-12T10:12:37.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.726+0000 7f27d4e06640 1 -- 172.21.15.78:0/2788252147 shutdown_connections 2023-12-12T10:12:37.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.726+0000 7f27d4e06640 1 --2- 172.21.15.78:0/2788252147 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f27bc066470 0x7f27bc068930 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:37.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.726+0000 7f27d4e06640 1 --2- 172.21.15.78:0/2788252147 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f27d014c6b0 0x7f27d0158c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:37.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.726+0000 7f27d4e06640 1 --2- 172.21.15.78:0/2788252147 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f27d01607a0 0x7f27d014c170 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:37.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.726+0000 7f27d4e06640 1 --2- 172.21.15.78:0/2788252147 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f27d006cda0 0x7f27d00caa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:37.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.726+0000 7f27d4e06640 1 -- 172.21.15.78:0/2788252147 >> 172.21.15.78:0/2788252147 conn(0x7f27d00d2e20 msgr2=0x7f27d015f610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:37.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.726+0000 7f27d4e06640 1 -- 172.21.15.78:0/2788252147 shutdown_connections 2023-12-12T10:12:37.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.726+0000 7f27d4e06640 1 -- 172.21.15.78:0/2788252147 wait complete. 2023-12-12T10:12:37.749 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-12T10:12:37.887 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.886+0000 7faf6f2c8640 1 Processor -- start 2023-12-12T10:12:37.887 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.886+0000 7faf6f2c8640 1 -- start start 2023-12-12T10:12:37.888 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.886+0000 7faf6f2c8640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7faf681607a0 0x7faf6806af50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:37.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.886+0000 7faf6f2c8640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf680d1630 con 0x7faf6806cda0 2023-12-12T10:12:37.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.886+0000 7faf6f2c8640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf680b09f0 con 0x7faf680d3940 2023-12-12T10:12:37.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.886+0000 7faf6f2c8640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf6806c1a0 con 0x7faf681607a0 2023-12-12T10:12:37.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.886+0000 7faf6e2c6640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7faf681607a0 0x7faf6806af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:37.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.886+0000 7faf6e2c6640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7faf681607a0 0x7faf6806af50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37486/0 (socket says 172.21.15.78:37486) 2023-12-12T10:12:37.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.886+0000 7faf6e2c6640 1 -- 172.21.15.78:0/712896287 learned_addr learned my addr 172.21.15.78:0/712896287 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:37.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.886+0000 7faf6e2c6640 1 -- 172.21.15.78:0/712896287 >> v1:172.21.15.187:6789/0 conn(0x7faf680d3940 legacy=0x7faf680afbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:37.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.886+0000 7faf6e2c6640 1 -- 172.21.15.78:0/712896287 >> v1:172.21.15.78:6789/0 conn(0x7faf6806cda0 legacy=0x7faf680b02e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:37.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.886+0000 7faf6e2c6640 1 -- 172.21.15.78:0/712896287 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf6806bc20 con 0x7faf681607a0 2023-12-12T10:12:37.892 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.890+0000 7faf6e2c6640 1 --2- 172.21.15.78:0/712896287 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faf681607a0 0x7faf6806af50 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7faf64009870 tx=0x7faf6401cfa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbdcf98de197a188 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:37.892 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.890+0000 7faf6d2c4640 1 -- 172.21.15.78:0/712896287 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf640ab650 con 0x7faf681607a0 2023-12-12T10:12:37.892 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.890+0000 7faf6d2c4640 1 -- 172.21.15.78:0/712896287 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf640ab7b0 con 0x7faf681607a0 2023-12-12T10:12:37.892 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.890+0000 7faf6d2c4640 1 -- 172.21.15.78:0/712896287 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf640abb40 con 0x7faf681607a0 2023-12-12T10:12:37.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.890+0000 7faf6f2c8640 1 -- 172.21.15.78:0/712896287 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faf681607a0 msgr2=0x7faf6806af50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:37.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.890+0000 7faf6f2c8640 1 --2- 172.21.15.78:0/712896287 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faf681607a0 0x7faf6806af50 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7faf64009870 tx=0x7faf6401cfa0 comp rx=0 tx=0).stop 2023-12-12T10:12:37.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.890+0000 7faf6f2c8640 1 -- 172.21.15.78:0/712896287 shutdown_connections 2023-12-12T10:12:37.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.890+0000 7faf6f2c8640 1 --2- 172.21.15.78:0/712896287 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faf681607a0 0x7faf6806af50 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:37.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.890+0000 7faf6f2c8640 1 -- 172.21.15.78:0/712896287 >> 172.21.15.78:0/712896287 conn(0x7faf680d2e20 msgr2=0x7faf680d3230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:37.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.890+0000 7faf6f2c8640 1 -- 172.21.15.78:0/712896287 shutdown_connections 2023-12-12T10:12:37.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.890+0000 7faf6f2c8640 1 -- 172.21.15.78:0/712896287 wait complete. 2023-12-12T10:12:37.895 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.890+0000 7faf6f2c8640 1 Processor -- start 2023-12-12T10:12:37.895 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.894+0000 7faf6f2c8640 1 -- start start 2023-12-12T10:12:37.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.894+0000 7faf6f2c8640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faf6806cda0 0x7faf68155670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:37.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.894+0000 7faf6f2c8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faf681607a0 0x7faf6814ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:37.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.894+0000 7faf6f2c8640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faf680cc060 0x7faf6814cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:37.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.894+0000 7faf6f2c8640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf680ccd70 con 0x7faf681607a0 2023-12-12T10:12:37.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.894+0000 7faf6f2c8640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf68156880 con 0x7faf680cc060 2023-12-12T10:12:37.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.894+0000 7faf6f2c8640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf680ccad0 con 0x7faf6806cda0 2023-12-12T10:12:37.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.894+0000 7faf6dac5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faf681607a0 0x7faf6814ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:37.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.894+0000 7faf6dac5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faf681607a0 0x7faf6814ff80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37494/0 (socket says 172.21.15.78:37494) 2023-12-12T10:12:37.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.894+0000 7faf6dac5640 1 -- 172.21.15.78:0/1410923107 learned_addr learned my addr 172.21.15.78:0/1410923107 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:37.898 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.894+0000 7faf6e2c6640 1 --2- 172.21.15.78:0/1410923107 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faf6806cda0 0x7faf68155670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:37.898 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.894+0000 7faf6eac7640 1 --2- 172.21.15.78:0/1410923107 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faf680cc060 0x7faf6814cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:37.898 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.894+0000 7faf6dac5640 1 -- 172.21.15.78:0/1410923107 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faf6806cda0 msgr2=0x7faf68155670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:37.898 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.894+0000 7faf6dac5640 1 --2- 172.21.15.78:0/1410923107 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faf6806cda0 0x7faf68155670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:37.898 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.894+0000 7faf6dac5640 1 -- 172.21.15.78:0/1410923107 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faf680cc060 msgr2=0x7faf6814cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:37.898 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.894+0000 7faf6dac5640 1 --2- 172.21.15.78:0/1410923107 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faf680cc060 0x7faf6814cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:37.898 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.894+0000 7faf6dac5640 1 -- 172.21.15.78:0/1410923107 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf640094d0 con 0x7faf681607a0 2023-12-12T10:12:37.898 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.894+0000 7faf6eac7640 1 --2- 172.21.15.78:0/1410923107 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faf680cc060 0x7faf6814cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T10:12:37.898 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.894+0000 7faf6dac5640 1 --2- 172.21.15.78:0/1410923107 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faf681607a0 0x7faf6814ff80 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7faf5800c500 tx=0x7faf5800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:37.898 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.894+0000 7faf5effd640 1 -- 172.21.15.78:0/1410923107 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf58005220 con 0x7faf681607a0 2023-12-12T10:12:37.898 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.894+0000 7faf5effd640 1 -- 172.21.15.78:0/1410923107 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf58005380 con 0x7faf681607a0 2023-12-12T10:12:37.898 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.894+0000 7faf6f2c8640 1 -- 172.21.15.78:0/1410923107 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf68154b90 con 0x7faf681607a0 2023-12-12T10:12:37.898 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.894+0000 7faf5effd640 1 -- 172.21.15.78:0/1410923107 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf58007270 con 0x7faf681607a0 2023-12-12T10:12:37.898 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.894+0000 7faf6f2c8640 1 -- 172.21.15.78:0/1410923107 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf68155150 con 0x7faf681607a0 2023-12-12T10:12:37.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.894+0000 7faf6f2c8640 1 -- 172.21.15.78:0/1410923107 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf680d1aa0 con 0x7faf681607a0 2023-12-12T10:12:37.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.898+0000 7faf5effd640 1 -- 172.21.15.78:0/1410923107 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7faf580073d0 con 0x7faf681607a0 2023-12-12T10:12:37.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.898+0000 7faf5effd640 1 --2- 172.21.15.78:0/1410923107 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7faf4c066470 0x7faf4c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:37.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.898+0000 7faf5effd640 1 -- 172.21.15.78:0/1410923107 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7faf580839d0 con 0x7faf681607a0 2023-12-12T10:12:37.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.898+0000 7faf6e2c6640 1 --2- 172.21.15.78:0/1410923107 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7faf4c066470 0x7faf4c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:37.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.898+0000 7faf6e2c6640 1 --2- 172.21.15.78:0/1410923107 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7faf4c066470 0x7faf4c068930 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7faf640af000 tx=0x7faf640b6040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:37.903 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:37.902+0000 7faf5effd640 1 -- 172.21.15.78:0/1410923107 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7faf680d1aa0 con 0x7faf681607a0 2023-12-12T10:12:38.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.090+0000 7faf6f2c8640 1 -- 172.21.15.78:0/1410923107 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faf680d1aa0 con 0x7faf681607a0 2023-12-12T10:12:38.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.090+0000 7faf5effd640 1 -- 172.21.15.78:0/1410923107 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4912 (secure 0 0 0) 0x7faf680d1aa0 con 0x7faf681607a0 2023-12-12T10:12:38.092 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:12:38.092 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/3747609982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":3747609982},{"type":"v1","addr":"172.21.15.187:6834","nonce":3747609982}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4282,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/3245919280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":3245919280},{"type":"v1","addr":"172.21.15.187:6835","nonce":3245919280}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4293,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/3902814576","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":3902814576},{"type":"v1","addr":"172.21.15.78:6835","nonce":3902814576}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-12T10:12:09.200933+0000","modified":"2023-12-12T10:12:26.296409+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4296},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4296":{"gid":4296,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.78:6837/739552946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":739552946},{"type":"v1","addr":"172.21.15.78:6837","nonce":739552946}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-12T10:12:38.093 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 9 2023-12-12T10:12:38.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.090+0000 7faf6f2c8640 1 -- 172.21.15.78:0/1410923107 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7faf4c066470 msgr2=0x7faf4c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:38.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.090+0000 7faf6f2c8640 1 --2- 172.21.15.78:0/1410923107 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7faf4c066470 0x7faf4c068930 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7faf640af000 tx=0x7faf640b6040 comp rx=0 tx=0).stop 2023-12-12T10:12:38.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.090+0000 7faf6f2c8640 1 -- 172.21.15.78:0/1410923107 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faf681607a0 msgr2=0x7faf6814ff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:38.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.090+0000 7faf6f2c8640 1 --2- 172.21.15.78:0/1410923107 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faf681607a0 0x7faf6814ff80 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7faf5800c500 tx=0x7faf5800c9c0 comp rx=0 tx=0).stop 2023-12-12T10:12:38.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.090+0000 7faf6f2c8640 1 -- 172.21.15.78:0/1410923107 shutdown_connections 2023-12-12T10:12:38.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.090+0000 7faf6f2c8640 1 --2- 172.21.15.78:0/1410923107 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7faf4c066470 0x7faf4c068930 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:38.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.090+0000 7faf6f2c8640 1 --2- 172.21.15.78:0/1410923107 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faf680cc060 0x7faf6814cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:38.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.090+0000 7faf6f2c8640 1 --2- 172.21.15.78:0/1410923107 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faf681607a0 0x7faf6814ff80 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:38.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.090+0000 7faf6f2c8640 1 --2- 172.21.15.78:0/1410923107 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faf6806cda0 0x7faf68155670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:38.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.090+0000 7faf6f2c8640 1 -- 172.21.15.78:0/1410923107 >> 172.21.15.78:0/1410923107 conn(0x7faf680d2e20 msgr2=0x7faf68158520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:38.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.090+0000 7faf6f2c8640 1 -- 172.21.15.78:0/1410923107 shutdown_connections 2023-12-12T10:12:38.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.090+0000 7faf6f2c8640 1 -- 172.21.15.78:0/1410923107 wait complete. 2023-12-12T10:12:38.515 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-12T10:12:09.200933+0000', 'modified': '2023-12-12T10:12:26.296409+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4296}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4296': {'gid': 4296, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.78:6837/739552946', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.78:6836', 'nonce': 739552946}, {'type': 'v1', 'addr': '172.21.15.78:6837', 'nonce': 739552946}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-12T10:12:38.515 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-12T10:12:38.515 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-12-12T10:12:38.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.654+0000 7f532a165640 1 Processor -- start 2023-12-12T10:12:38.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.654+0000 7f532a165640 1 -- start start 2023-12-12T10:12:38.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.654+0000 7f532a165640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f532415d510 0x7f53240d0060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:38.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.654+0000 7f532a165640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f53240d1630 0x7f53240d1a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:38.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.654+0000 7f532a165640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f53240b0670 0x7f53240b0b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:38.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.654+0000 7f532a165640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f532415d8f0 con 0x7f532415d510 2023-12-12T10:12:38.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.654+0000 7f532a165640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53240d1fd0 con 0x7f53240d1630 2023-12-12T10:12:38.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.654+0000 7f532a165640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53240d3b70 con 0x7f53240b0670 2023-12-12T10:12:38.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.654+0000 7f53237fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f532415d510 0x7f53240d0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:38.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.654+0000 7f53237fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f532415d510 0x7f53240d0060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37504/0 (socket says 172.21.15.78:37504) 2023-12-12T10:12:38.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.654+0000 7f53237fe640 1 -- 172.21.15.78:0/588873384 learned_addr learned my addr 172.21.15.78:0/588873384 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:38.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.654+0000 7f53237fe640 1 -- 172.21.15.78:0/588873384 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f53240b0670 msgr2=0x7f53240b0b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:38.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.654+0000 7f5323fff640 1 --2- 172.21.15.78:0/588873384 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f53240b0670 0x7f53240b0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:38.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.654+0000 7f531bfff640 1 --2- 172.21.15.78:0/588873384 >> v2:172.21.15.187:3300/0 conn(0x7f53240d1630 0x7f53240d1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:38.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.654+0000 7f53237fe640 1 --2- 172.21.15.78:0/588873384 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f53240b0670 0x7f53240b0b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:38.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.654+0000 7f53237fe640 1 -- 172.21.15.78:0/588873384 >> v2:172.21.15.187:3300/0 conn(0x7f53240d1630 msgr2=0x7f53240d1a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:38.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.654+0000 7f53237fe640 1 --2- 172.21.15.78:0/588873384 >> v2:172.21.15.187:3300/0 conn(0x7f53240d1630 0x7f53240d1a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:38.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.654+0000 7f53237fe640 1 -- 172.21.15.78:0/588873384 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53240afc20 con 0x7f532415d510 2023-12-12T10:12:38.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.654+0000 7f5323fff640 1 --2- 172.21.15.78:0/588873384 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f53240b0670 0x7f53240b0b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T10:12:38.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.654+0000 7f531bfff640 1 --2- 172.21.15.78:0/588873384 >> v2:172.21.15.187:3300/0 conn(0x7f53240d1630 0x7f53240d1a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T10:12:38.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.658+0000 7f53237fe640 1 --2- 172.21.15.78:0/588873384 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f532415d510 0x7f53240d0060 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f53240cd650 tx=0x7f531401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6a24a33b6e58c18 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:38.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.658+0000 7f5322ffd640 1 -- 172.21.15.78:0/588873384 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53140aa5f0 con 0x7f532415d510 2023-12-12T10:12:38.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.658+0000 7f5322ffd640 1 -- 172.21.15.78:0/588873384 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53140aa750 con 0x7f532415d510 2023-12-12T10:12:38.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.658+0000 7f5322ffd640 1 -- 172.21.15.78:0/588873384 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53140aaae0 con 0x7f532415d510 2023-12-12T10:12:38.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.658+0000 7f532a165640 1 -- 172.21.15.78:0/588873384 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f532415d510 msgr2=0x7f53240d0060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:38.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.658+0000 7f532a165640 1 --2- 172.21.15.78:0/588873384 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f532415d510 0x7f53240d0060 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f53240cd650 tx=0x7f531401c4d0 comp rx=0 tx=0).stop 2023-12-12T10:12:38.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.658+0000 7f532a165640 1 -- 172.21.15.78:0/588873384 shutdown_connections 2023-12-12T10:12:38.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.658+0000 7f532a165640 1 --2- 172.21.15.78:0/588873384 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f53240b0670 0x7f53240b0b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:38.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.658+0000 7f532a165640 1 --2- 172.21.15.78:0/588873384 >> v2:172.21.15.187:3300/0 conn(0x7f53240d1630 0x7f53240d1a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:38.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.658+0000 7f532a165640 1 --2- 172.21.15.78:0/588873384 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f532415d510 0x7f53240d0060 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:38.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.658+0000 7f532a165640 1 -- 172.21.15.78:0/588873384 >> 172.21.15.78:0/588873384 conn(0x7f53240d3050 msgr2=0x7f53240d3460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:38.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.658+0000 7f532a165640 1 -- 172.21.15.78:0/588873384 shutdown_connections 2023-12-12T10:12:38.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.658+0000 7f532a165640 1 -- 172.21.15.78:0/588873384 wait complete. 2023-12-12T10:12:38.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.662+0000 7f532a165640 1 Processor -- start 2023-12-12T10:12:38.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.662+0000 7f532a165640 1 -- start start 2023-12-12T10:12:38.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.662+0000 7f532a165640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f53240b0670 0x7f532415c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:38.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.662+0000 7f532a165640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f53240d1630 0x7f53241549d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:38.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.662+0000 7f532a165640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f532415d510 0x7f532415e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:38.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.662+0000 7f532a165640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5324155590 con 0x7f53240b0670 2023-12-12T10:12:38.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.662+0000 7f532a165640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53241602f0 con 0x7f532415d510 2023-12-12T10:12:38.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.662+0000 7f532a165640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f532415db60 con 0x7f53240d1630 2023-12-12T10:12:38.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.662+0000 7f53237fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f53240b0670 0x7f532415c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:38.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.662+0000 7f53237fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f53240b0670 0x7f532415c660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37520/0 (socket says 172.21.15.78:37520) 2023-12-12T10:12:38.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.662+0000 7f53237fe640 1 -- 172.21.15.78:0/3683621003 learned_addr learned my addr 172.21.15.78:0/3683621003 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:38.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.662+0000 7f531bfff640 1 --2- 172.21.15.78:0/3683621003 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f53240d1630 0x7f53241549d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:38.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.662+0000 7f5323fff640 1 --2- 172.21.15.78:0/3683621003 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f532415d510 0x7f532415e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:38.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.662+0000 7f53237fe640 1 -- 172.21.15.78:0/3683621003 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f53240d1630 msgr2=0x7f53241549d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:38.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.662+0000 7f53237fe640 1 --2- 172.21.15.78:0/3683621003 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f53240d1630 0x7f53241549d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:38.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.662+0000 7f53237fe640 1 -- 172.21.15.78:0/3683621003 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f532415d510 msgr2=0x7f532415e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:38.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.662+0000 7f53237fe640 1 --2- 172.21.15.78:0/3683621003 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f532415d510 0x7f532415e640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:38.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.662+0000 7f53237fe640 1 -- 172.21.15.78:0/3683621003 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53140094d0 con 0x7f53240b0670 2023-12-12T10:12:38.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.662+0000 7f531bfff640 1 --2- 172.21.15.78:0/3683621003 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f53240d1630 0x7f53241549d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T10:12:38.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.662+0000 7f5323fff640 1 --2- 172.21.15.78:0/3683621003 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f532415d510 0x7f532415e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T10:12:38.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.662+0000 7f53237fe640 1 --2- 172.21.15.78:0/3683621003 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f53240b0670 0x7f532415c660 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f531401ab80 tx=0x7f531401ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:38.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.662+0000 7f5320ff9640 1 -- 172.21.15.78:0/3683621003 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53140b3800 con 0x7f53240b0670 2023-12-12T10:12:38.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.662+0000 7f5320ff9640 1 -- 172.21.15.78:0/3683621003 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53140b3980 con 0x7f53240b0670 2023-12-12T10:12:38.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.662+0000 7f5320ff9640 1 -- 172.21.15.78:0/3683621003 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53140b3d30 con 0x7f53240b0670 2023-12-12T10:12:38.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.662+0000 7f532a165640 1 -- 172.21.15.78:0/3683621003 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f532415de40 con 0x7f53240b0670 2023-12-12T10:12:38.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.662+0000 7f532a165640 1 -- 172.21.15.78:0/3683621003 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f532415cba0 con 0x7f53240b0670 2023-12-12T10:12:38.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.666+0000 7f5320ff9640 1 -- 172.21.15.78:0/3683621003 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f53140b2380 con 0x7f53240b0670 2023-12-12T10:12:38.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.666+0000 7f5320ff9640 1 --2- 172.21.15.78:0/3683621003 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f5304066470 0x7f5304068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:38.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.666+0000 7f5320ff9640 1 -- 172.21.15.78:0/3683621003 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f53140a7070 con 0x7f53240b0670 2023-12-12T10:12:38.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.666+0000 7f531bfff640 1 --2- 172.21.15.78:0/3683621003 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f5304066470 0x7f5304068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:38.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.666+0000 7f532d4c0000 1 Processor -- start 2023-12-12T10:12:38.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.666+0000 7f532d4c0000 1 -- start start 2023-12-12T10:12:38.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.666+0000 7f531bfff640 1 --2- 172.21.15.78:0/3683621003 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f5304066470 0x7f5304068930 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f530c006fd0 tx=0x7f530c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:38.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.670+0000 7f532d4c0000 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5586daa376b0 0x5586daa37a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:38.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.670+0000 7f532d4c0000 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5586daa37fd0 0x5586da9eab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:38.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.670+0000 7f532d4c0000 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5586da9eb050 0x5586da9eb430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:38.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.670+0000 7f532d4c0000 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586da857250 con 0x5586da9eb050 2023-12-12T10:12:38.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.670+0000 7f532d4c0000 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586da844d60 con 0x5586daa376b0 2023-12-12T10:12:38.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.670+0000 7f532d4c0000 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x5586da842290 con 0x5586daa37fd0 2023-12-12T10:12:38.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.670+0000 7f5323fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5586da9eb050 0x5586da9eb430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:38.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.670+0000 7f5323fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5586da9eb050 0x5586da9eb430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37534/0 (socket says 172.21.15.78:37534) 2023-12-12T10:12:38.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.670+0000 7f5323fff640 1 -- 172.21.15.78:0/4054138880 learned_addr learned my addr 172.21.15.78:0/4054138880 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:38.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.670+0000 7f53237fe640 1 --2- 172.21.15.78:0/4054138880 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5586daa376b0 0x5586daa37a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:38.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.670+0000 7f531bfff640 1 --2- 172.21.15.78:0/4054138880 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5586daa37fd0 0x5586da9eab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:38.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.670+0000 7f5323fff640 1 -- 172.21.15.78:0/4054138880 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5586daa37fd0 msgr2=0x5586da9eab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:38.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.670+0000 7f5323fff640 1 --2- 172.21.15.78:0/4054138880 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5586daa37fd0 0x5586da9eab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:38.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.670+0000 7f5323fff640 1 -- 172.21.15.78:0/4054138880 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5586daa376b0 msgr2=0x5586daa37a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:38.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.670+0000 7f5323fff640 1 --2- 172.21.15.78:0/4054138880 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5586daa376b0 0x5586daa37a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:38.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.670+0000 7f5323fff640 1 -- 172.21.15.78:0/4054138880 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5586da535890 con 0x5586da9eb050 2023-12-12T10:12:38.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.670+0000 7f5323fff640 1 --2- 172.21.15.78:0/4054138880 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5586da9eb050 0x5586da9eb430 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f531c00e4f0 tx=0x7f531c00e9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64830ca99d5e14d7 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:38.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.670+0000 7f53197fa640 1 -- 172.21.15.78:0/4054138880 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f531c00c9d0 con 0x5586da9eb050 2023-12-12T10:12:38.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.670+0000 7f53197fa640 1 -- 172.21.15.78:0/4054138880 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f531c00cb30 con 0x5586da9eb050 2023-12-12T10:12:38.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.670+0000 7f53197fa640 1 -- 172.21.15.78:0/4054138880 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f531c00cea0 con 0x5586da9eb050 2023-12-12T10:12:38.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.670+0000 7f532d4c0000 1 -- 172.21.15.78:0/4054138880 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5586da9eb050 msgr2=0x5586da9eb430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:38.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.670+0000 7f532d4c0000 1 --2- 172.21.15.78:0/4054138880 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5586da9eb050 0x5586da9eb430 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f531c00e4f0 tx=0x7f531c00e9b0 comp rx=0 tx=0).stop 2023-12-12T10:12:38.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.670+0000 7f532d4c0000 1 -- 172.21.15.78:0/4054138880 shutdown_connections 2023-12-12T10:12:38.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.670+0000 7f532d4c0000 1 --2- 172.21.15.78:0/4054138880 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5586da9eb050 0x5586da9eb430 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:38.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.670+0000 7f532d4c0000 1 --2- 172.21.15.78:0/4054138880 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5586daa37fd0 0x5586da9eab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:38.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.670+0000 7f532d4c0000 1 --2- 172.21.15.78:0/4054138880 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5586daa376b0 0x5586daa37a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:38.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.670+0000 7f532d4c0000 1 -- 172.21.15.78:0/4054138880 >> 172.21.15.78:0/4054138880 conn(0x5586daa18240 msgr2=0x5586daa1a630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:38.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.670+0000 7f532d4c0000 1 -- 172.21.15.78:0/4054138880 shutdown_connections 2023-12-12T10:12:38.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.670+0000 7f532d4c0000 1 -- 172.21.15.78:0/4054138880 wait complete. 2023-12-12T10:12:38.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.670+0000 7f532d4c0000 1 -- start start 2023-12-12T10:12:38.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.670+0000 7f532d4c0000 1 Processor -- start 2023-12-12T10:12:38.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.674+0000 7f532d4c0000 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5586da9eb050 0x5586da9f10e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:38.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.674+0000 7f532d4c0000 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5586daa376b0 0x5586da9f1620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:38.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.674+0000 7f532d4c0000 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5586daa37fd0 0x5586da9f1b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:38.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.674+0000 7f532d4c0000 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586da83db80 con 0x5586daa376b0 2023-12-12T10:12:38.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.674+0000 7f532d4c0000 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586da7f5bf0 con 0x5586daa37fd0 2023-12-12T10:12:38.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.674+0000 7f532d4c0000 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x5586da7fba90 con 0x5586da9eb050 2023-12-12T10:12:38.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.674+0000 7f532d4c0000 10 client.0 _ll_register_callbacks cb 0x5586da9d8970 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-12T10:12:38.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.674+0000 7f531bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5586daa376b0 0x5586da9f1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:38.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.674+0000 7f531bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5586daa376b0 0x5586da9f1620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37540/0 (socket says 172.21.15.78:37540) 2023-12-12T10:12:38.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.674+0000 7f531bfff640 1 -- 172.21.15.78:0/1194271489 learned_addr learned my addr 172.21.15.78:0/1194271489 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:38.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.674+0000 7f53237fe640 1 --2- 172.21.15.78:0/1194271489 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5586da9eb050 0x5586da9f10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:38.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.674+0000 7f5323fff640 1 --2- 172.21.15.78:0/1194271489 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5586daa37fd0 0x5586da9f1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:38.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.674+0000 7f531bfff640 1 -- 172.21.15.78:0/1194271489 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5586da9eb050 msgr2=0x5586da9f10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:38.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.674+0000 7f531bfff640 1 --2- 172.21.15.78:0/1194271489 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5586da9eb050 0x5586da9f10e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:38.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.674+0000 7f531bfff640 1 -- 172.21.15.78:0/1194271489 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5586daa37fd0 msgr2=0x5586da9f1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:38.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.674+0000 7f531bfff640 1 --2- 172.21.15.78:0/1194271489 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5586daa37fd0 0x5586da9f1b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:38.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.674+0000 7f531bfff640 1 -- 172.21.15.78:0/1194271489 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f531c007cd0 con 0x5586daa376b0 2023-12-12T10:12:38.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.674+0000 7f5323fff640 1 --2- 172.21.15.78:0/1194271489 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5586daa37fd0 0x5586da9f1b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T10:12:38.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.674+0000 7f531bfff640 1 --2- 172.21.15.78:0/1194271489 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5586daa376b0 0x5586da9f1620 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f530c0146e0 tx=0x7f530c004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=859080ab8d9f489f server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:38.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.674+0000 7f53027fc640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2023-12-12T10:12:38.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.674+0000 7f53027fc640 1 -- 172.21.15.78:0/1194271489 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f530c015960 con 0x5586daa376b0 2023-12-12T10:12:38.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.674+0000 7f532d4c0000 1 -- 172.21.15.78:0/1194271489 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5586da7fb420 con 0x5586daa376b0 2023-12-12T10:12:38.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.674+0000 7f53027fc640 1 -- 172.21.15.78:0/1194271489 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f530c015ac0 con 0x5586daa376b0 2023-12-12T10:12:38.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.674+0000 7f53027fc640 1 -- 172.21.15.78:0/1194271489 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7f530c015c80 con 0x5586daa376b0 2023-12-12T10:12:38.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.674+0000 7f532d4c0000 10 client.4806 fetch_fsmap learned FSMap version 9 2023-12-12T10:12:38.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.674+0000 7f532d4c0000 1 -- 172.21.15.78:0/1194271489 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x5586da7fe190 con 0x5586daa376b0 2023-12-12T10:12:38.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.674+0000 7f53027fc640 1 -- 172.21.15.78:0/1194271489 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5586da7fb420 con 0x5586daa376b0 2023-12-12T10:12:38.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.674+0000 7f53027fc640 1 -- 172.21.15.78:0/1194271489 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 9) v1 ==== 3302+0+0 (secure 0 0 0) 0x7f530c02a3f0 con 0x5586daa376b0 2023-12-12T10:12:38.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.674+0000 7f532d4c0000 10 client.4806 fetch_fsmap finished waiting for FSMap version 9 2023-12-12T10:12:38.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.674+0000 7f532d4c0000 10 client.4806 resolve_mds: resolved name 'c' to daemon mds.c 2023-12-12T10:12:38.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.674+0000 7f532d4c0000 20 client.4806 populate_metadata read hostname 'smithi078' 2023-12-12T10:12:38.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.674+0000 7f532d4c0000 1 --2- 172.21.15.78:0/1194271489 >> [v2:172.21.15.78:6836/739552946,v1:172.21.15.78:6837/739552946] conn(0x5586da9f2570 0x5586daa49970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:38.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.674+0000 7f532d4c0000 4 client.4806 mds_command: new command op to 4296 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-12T10:12:38.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.674+0000 7f532d4c0000 1 -- 172.21.15.78:0/1194271489 --> [v2:172.21.15.78:6836/739552946,v1:172.21.15.78:6837/739552946] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5586da83c4d0 con 0x5586da9f2570 2023-12-12T10:12:38.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.674+0000 7f53237fe640 1 --2- 172.21.15.78:0/1194271489 >> [v2:172.21.15.78:6836/739552946,v1:172.21.15.78:6837/739552946] conn(0x5586da9f2570 0x5586daa49970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:38.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.674+0000 7f53027fc640 10 client.4806 ms_handle_connect on v2:172.21.15.78:6836/739552946 2023-12-12T10:12:38.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.674+0000 7f53237fe640 1 --2- 172.21.15.78:0/1194271489 >> [v2:172.21.15.78:6836/739552946,v1:172.21.15.78:6837/739552946] conn(0x5586da9f2570 0x5586daa49970 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=acc980be0f232f59 server_cookie=50fdfeaa62be3676 in_seq=0 out_seq=0 2023-12-12T10:12:38.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.674+0000 7f53027fc640 1 -- 172.21.15.78:0/1194271489 <== mds.0 v2:172.21.15.78:6836/739552946 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5586da83c4d0 con 0x5586da9f2570 2023-12-12T10:12:38.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.674+0000 7f53027fc640 10 client.4806 handle_command_reply: tid=0 2023-12-12T10:12:38.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.674+0000 7f532d4c0000 1 client.4806 shutdown 2023-12-12T10:12:38.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.674+0000 7f532d4c0000 1 -- 172.21.15.78:0/1194271489 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5586daa376b0 msgr2=0x5586da9f1620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:38.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.674+0000 7f532d4c0000 1 --2- 172.21.15.78:0/1194271489 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5586daa376b0 0x5586da9f1620 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f530c0146e0 tx=0x7f530c004740 comp rx=0 tx=0).stop 2023-12-12T10:12:38.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.674+0000 7f532d4c0000 1 -- 172.21.15.78:0/1194271489 shutdown_connections 2023-12-12T10:12:38.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.674+0000 7f532d4c0000 1 --2- 172.21.15.78:0/1194271489 >> [v2:172.21.15.78:6836/739552946,v1:172.21.15.78:6837/739552946] conn(0x5586da9f2570 0x5586daa49970 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:38.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.674+0000 7f532d4c0000 1 --2- 172.21.15.78:0/1194271489 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5586daa37fd0 0x5586da9f1b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:38.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.674+0000 7f532d4c0000 1 --2- 172.21.15.78:0/1194271489 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5586daa376b0 0x5586da9f1620 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:38.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.674+0000 7f532d4c0000 1 --2- 172.21.15.78:0/1194271489 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5586da9eb050 0x5586da9f10e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:38.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.674+0000 7f53027fc640 0 client.4806 ms_handle_reset on v2:172.21.15.78:6836/739552946 2023-12-12T10:12:38.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.674+0000 7f532d4c0000 1 -- 172.21.15.78:0/1194271489 >> 172.21.15.78:0/1194271489 conn(0x5586daa18240 msgr2=0x5586da9ea200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:38.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.674+0000 7f532d4c0000 1 -- 172.21.15.78:0/1194271489 shutdown_connections 2023-12-12T10:12:38.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.674+0000 7f532d4c0000 1 -- 172.21.15.78:0/1194271489 wait complete. 2023-12-12T10:12:38.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.678+0000 7f532d4c0000 20 client.4806 trim_cache size 0 max 16384 2023-12-12T10:12:38.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.690+0000 7f532d4c0000 1 Processor -- start 2023-12-12T10:12:38.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.690+0000 7f532d4c0000 1 -- start start 2023-12-12T10:12:38.698 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.694+0000 7f532d4c0000 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5586da9eb050 0x5586daa4bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:38.698 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.694+0000 7f532d4c0000 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5586daa376b0 0x5586daa16d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:38.698 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.694+0000 7f532d4c0000 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5586daa37fd0 0x5586daa17260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:38.698 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.694+0000 7f532d4c0000 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586da4f6940 con 0x5586daa376b0 2023-12-12T10:12:38.698 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.694+0000 7f532d4c0000 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586da835380 con 0x5586da9eb050 2023-12-12T10:12:38.698 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.694+0000 7f532d4c0000 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x5586da7f8ea0 con 0x5586daa37fd0 2023-12-12T10:12:38.698 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.694+0000 7f531bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5586daa376b0 0x5586daa16d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:38.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.694+0000 7f531bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5586daa376b0 0x5586daa16d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37556/0 (socket says 172.21.15.78:37556) 2023-12-12T10:12:38.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.694+0000 7f531bfff640 1 -- 172.21.15.78:0/1981114960 learned_addr learned my addr 172.21.15.78:0/1981114960 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:38.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.694+0000 7f5323fff640 1 --2- 172.21.15.78:0/1981114960 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5586daa37fd0 0x5586daa17260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:38.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.694+0000 7f53237fe640 1 --2- 172.21.15.78:0/1981114960 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5586da9eb050 0x5586daa4bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:38.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.694+0000 7f531bfff640 1 -- 172.21.15.78:0/1981114960 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5586daa37fd0 msgr2=0x5586daa17260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:38.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.694+0000 7f531bfff640 1 --2- 172.21.15.78:0/1981114960 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5586daa37fd0 0x5586daa17260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:38.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.694+0000 7f531bfff640 1 -- 172.21.15.78:0/1981114960 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5586da9eb050 msgr2=0x5586daa4bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:38.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.694+0000 7f531bfff640 1 --2- 172.21.15.78:0/1981114960 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5586da9eb050 0x5586daa4bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:38.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.694+0000 7f531bfff640 1 -- 172.21.15.78:0/1981114960 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5586da7e4490 con 0x5586daa376b0 2023-12-12T10:12:38.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.694+0000 7f53237fe640 1 --2- 172.21.15.78:0/1981114960 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5586da9eb050 0x5586daa4bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T10:12:38.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.694+0000 7f531bfff640 1 --2- 172.21.15.78:0/1981114960 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5586daa376b0 0x5586daa16d20 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f530c000c10 tx=0x7f530c020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bd251ee4ab9290b server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:38.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.694+0000 7f5319ffb640 1 -- 172.21.15.78:0/1981114960 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f530c00fd60 con 0x5586daa376b0 2023-12-12T10:12:38.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.694+0000 7f5319ffb640 1 -- 172.21.15.78:0/1981114960 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f530c00fec0 con 0x5586daa376b0 2023-12-12T10:12:38.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.694+0000 7f5319ffb640 1 -- 172.21.15.78:0/1981114960 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f530c02aab0 con 0x5586daa376b0 2023-12-12T10:12:38.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.694+0000 7f532d4c0000 1 -- 172.21.15.78:0/1981114960 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5586daa376b0 msgr2=0x5586daa16d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:38.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.694+0000 7f532d4c0000 1 --2- 172.21.15.78:0/1981114960 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5586daa376b0 0x5586daa16d20 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f530c000c10 tx=0x7f530c020000 comp rx=0 tx=0).stop 2023-12-12T10:12:38.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.694+0000 7f532d4c0000 1 -- 172.21.15.78:0/1981114960 shutdown_connections 2023-12-12T10:12:38.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.694+0000 7f532d4c0000 1 --2- 172.21.15.78:0/1981114960 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5586daa37fd0 0x5586daa17260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:38.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.694+0000 7f532d4c0000 1 --2- 172.21.15.78:0/1981114960 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5586daa376b0 0x5586daa16d20 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:38.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.694+0000 7f532d4c0000 1 --2- 172.21.15.78:0/1981114960 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5586da9eb050 0x5586daa4bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:38.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.694+0000 7f532d4c0000 1 -- 172.21.15.78:0/1981114960 >> 172.21.15.78:0/1981114960 conn(0x5586daa18240 msgr2=0x5586da9e9270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:38.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.694+0000 7f532d4c0000 1 -- 172.21.15.78:0/1981114960 shutdown_connections 2023-12-12T10:12:38.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.694+0000 7f532d4c0000 1 -- 172.21.15.78:0/1981114960 wait complete. 2023-12-12T10:12:38.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.694+0000 7f532d4c0000 1 -- start start 2023-12-12T10:12:38.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.694+0000 7f532d4c0000 1 Processor -- start 2023-12-12T10:12:38.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.698+0000 7f532d4c0000 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5586da9eb050 0x5586daa97f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:38.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.698+0000 7f532d4c0000 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5586daa376b0 0x5586daa984c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:38.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.698+0000 7f532d4c0000 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5586daa37fd0 0x5586daa533f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:38.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.698+0000 7f532d4c0000 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586da83d390 con 0x5586daa37fd0 2023-12-12T10:12:38.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.698+0000 7f532d4c0000 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586daa37560 con 0x5586da9eb050 2023-12-12T10:12:38.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.698+0000 7f532d4c0000 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x5586da7f4cf0 con 0x5586daa376b0 2023-12-12T10:12:38.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.698+0000 7f532d4c0000 10 client.0 _ll_register_callbacks cb 0x5586da8571a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-12T10:12:38.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.698+0000 7f5323fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5586daa37fd0 0x5586daa533f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:38.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.698+0000 7f5323fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5586daa37fd0 0x5586daa533f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:37558/0 (socket says 172.21.15.78:37558) 2023-12-12T10:12:38.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.698+0000 7f5323fff640 1 -- 172.21.15.78:0/166915012 learned_addr learned my addr 172.21.15.78:0/166915012 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:38.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.698+0000 7f53237fe640 1 --2- 172.21.15.78:0/166915012 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5586da9eb050 0x5586daa97f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:38.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.698+0000 7f531bfff640 1 --2- 172.21.15.78:0/166915012 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5586daa376b0 0x5586daa984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:38.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.698+0000 7f5323fff640 1 -- 172.21.15.78:0/166915012 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5586daa376b0 msgr2=0x5586daa984c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:38.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.698+0000 7f5323fff640 1 --2- 172.21.15.78:0/166915012 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5586daa376b0 0x5586daa984c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:38.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.698+0000 7f5323fff640 1 -- 172.21.15.78:0/166915012 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5586da9eb050 msgr2=0x5586daa97f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:38.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.698+0000 7f5323fff640 1 --2- 172.21.15.78:0/166915012 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5586da9eb050 0x5586daa97f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:38.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.698+0000 7f5323fff640 1 -- 172.21.15.78:0/166915012 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5586da7fe190 con 0x5586daa37fd0 2023-12-12T10:12:38.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.698+0000 7f531bfff640 1 --2- 172.21.15.78:0/166915012 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5586daa376b0 0x5586daa984c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T10:12:38.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.698+0000 7f5323fff640 1 --2- 172.21.15.78:0/166915012 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5586daa37fd0 0x5586daa533f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f531c01a040 tx=0x7f531c010040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1490a255f4e1459b server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:38.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.698+0000 7f53027fc640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2023-12-12T10:12:38.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.698+0000 7f53027fc640 1 -- 172.21.15.78:0/166915012 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f531c00cb00 con 0x5586daa37fd0 2023-12-12T10:12:38.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.698+0000 7f53027fc640 1 -- 172.21.15.78:0/166915012 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f531c00cc60 con 0x5586daa37fd0 2023-12-12T10:12:38.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.698+0000 7f532d4c0000 1 -- 172.21.15.78:0/166915012 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5586da86bac0 con 0x5586daa37fd0 2023-12-12T10:12:38.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.698+0000 7f53027fc640 1 -- 172.21.15.78:0/166915012 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7f531c00ce20 con 0x5586daa37fd0 2023-12-12T10:12:38.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.698+0000 7f532d4c0000 10 client.4812 fetch_fsmap learned FSMap version 9 2023-12-12T10:12:38.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.698+0000 7f532d4c0000 1 -- 172.21.15.78:0/166915012 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x5586da535cc0 con 0x5586daa37fd0 2023-12-12T10:12:38.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.698+0000 7f53027fc640 1 -- 172.21.15.78:0/166915012 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5586da86bac0 con 0x5586daa37fd0 2023-12-12T10:12:38.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.698+0000 7f53027fc640 1 -- 172.21.15.78:0/166915012 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 9) v1 ==== 3302+0+0 (secure 0 0 0) 0x7f531c008040 con 0x5586daa37fd0 2023-12-12T10:12:38.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.698+0000 7f532d4c0000 10 client.4812 fetch_fsmap finished waiting for FSMap version 9 2023-12-12T10:12:38.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.698+0000 7f532d4c0000 10 client.4812 resolve_mds: resolved name 'c' to daemon mds.c 2023-12-12T10:12:38.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.698+0000 7f532d4c0000 20 client.4812 populate_metadata read hostname 'smithi078' 2023-12-12T10:12:38.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.698+0000 7f532d4c0000 1 --2- 172.21.15.78:0/166915012 >> [v2:172.21.15.78:6836/739552946,v1:172.21.15.78:6837/739552946] conn(0x5586daa54ac0 0x5586daaa0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:38.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.698+0000 7f532d4c0000 4 client.4812 mds_command: new command op to 4296 tid=0 multi_id=0 [{"prefix": "status"}] 2023-12-12T10:12:38.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.698+0000 7f532d4c0000 1 -- 172.21.15.78:0/166915012 --> [v2:172.21.15.78:6836/739552946,v1:172.21.15.78:6837/739552946] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5586da836a10 con 0x5586daa54ac0 2023-12-12T10:12:38.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.698+0000 7f53237fe640 1 --2- 172.21.15.78:0/166915012 >> [v2:172.21.15.78:6836/739552946,v1:172.21.15.78:6837/739552946] conn(0x5586daa54ac0 0x5586daaa0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:38.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.698+0000 7f53237fe640 1 --2- 172.21.15.78:0/166915012 >> [v2:172.21.15.78:6836/739552946,v1:172.21.15.78:6837/739552946] conn(0x5586daa54ac0 0x5586daaa0df0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7773207e70e9e2d6 server_cookie=8eafdbad3c41235 in_seq=0 out_seq=0 2023-12-12T10:12:38.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.698+0000 7f53027fc640 10 client.4812 ms_handle_connect on v2:172.21.15.78:6836/739552946 2023-12-12T10:12:38.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.698+0000 7f53027fc640 1 -- 172.21.15.78:0/166915012 <== mds.0 v2:172.21.15.78:6836/739552946 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x5586da836a10 con 0x5586daa54ac0 2023-12-12T10:12:38.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.698+0000 7f53027fc640 10 client.4812 handle_command_reply: tid=0 2023-12-12T10:12:38.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.698+0000 7f532d4c0000 1 client.4812 shutdown 2023-12-12T10:12:38.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.698+0000 7f532d4c0000 1 -- 172.21.15.78:0/166915012 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5586daa37fd0 msgr2=0x5586daa533f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:38.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.698+0000 7f532d4c0000 1 --2- 172.21.15.78:0/166915012 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5586daa37fd0 0x5586daa533f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f531c01a040 tx=0x7f531c010040 comp rx=0 tx=0).stop 2023-12-12T10:12:38.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.698+0000 7f532d4c0000 1 -- 172.21.15.78:0/166915012 shutdown_connections 2023-12-12T10:12:38.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.698+0000 7f532d4c0000 1 --2- 172.21.15.78:0/166915012 >> [v2:172.21.15.78:6836/739552946,v1:172.21.15.78:6837/739552946] conn(0x5586daa54ac0 0x5586daaa0df0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:38.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.698+0000 7f532d4c0000 1 --2- 172.21.15.78:0/166915012 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5586daa37fd0 0x5586daa533f0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:38.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.698+0000 7f532d4c0000 1 --2- 172.21.15.78:0/166915012 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5586daa376b0 0x5586daa984c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:38.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.698+0000 7f532d4c0000 1 --2- 172.21.15.78:0/166915012 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5586da9eb050 0x5586daa97f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:38.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.698+0000 7f53027fc640 0 client.4812 ms_handle_reset on v2:172.21.15.78:6836/739552946 2023-12-12T10:12:38.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.698+0000 7f532d4c0000 1 -- 172.21.15.78:0/166915012 >> 172.21.15.78:0/166915012 conn(0x5586daa18240 msgr2=0x5586da9e9b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:38.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.698+0000 7f532d4c0000 1 -- 172.21.15.78:0/166915012 shutdown_connections 2023-12-12T10:12:38.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.698+0000 7f532d4c0000 1 -- 172.21.15.78:0/166915012 wait complete. 2023-12-12T10:12:38.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.698+0000 7f532d4c0000 20 client.4812 trim_cache size 0 max 16384 2023-12-12T10:12:38.709 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2023-12-12T10:12:38.709 INFO:teuthology.orchestra.run.smithi078.stdout: "cluster_fsid": "fc81937c-bd26-483c-952b-d1324fcb0c9e", 2023-12-12T10:12:38.709 INFO:teuthology.orchestra.run.smithi078.stdout: "whoami": 0, 2023-12-12T10:12:38.710 INFO:teuthology.orchestra.run.smithi078.stdout: "id": 4296, 2023-12-12T10:12:38.710 INFO:teuthology.orchestra.run.smithi078.stdout: "want_state": "up:active", 2023-12-12T10:12:38.710 INFO:teuthology.orchestra.run.smithi078.stdout: "state": "up:active", 2023-12-12T10:12:38.710 INFO:teuthology.orchestra.run.smithi078.stdout: "fs_name": "cephfs", 2023-12-12T10:12:38.710 INFO:teuthology.orchestra.run.smithi078.stdout: "rank_uptime": 28.789234735000001, 2023-12-12T10:12:38.710 INFO:teuthology.orchestra.run.smithi078.stdout: "mdsmap_epoch": 9, 2023-12-12T10:12:38.710 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_epoch": 24, 2023-12-12T10:12:38.710 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_epoch_barrier": 24, 2023-12-12T10:12:38.710 INFO:teuthology.orchestra.run.smithi078.stdout: "uptime": 35.521995892 2023-12-12T10:12:38.710 INFO:teuthology.orchestra.run.smithi078.stdout:} 2023-12-12T10:12:38.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.698+0000 7f532a165640 1 -- 172.21.15.78:0/3683621003 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f5304066470 msgr2=0x7f5304068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:38.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.698+0000 7f532a165640 1 --2- 172.21.15.78:0/3683621003 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f5304066470 0x7f5304068930 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f530c006fd0 tx=0x7f530c008040 comp rx=0 tx=0).stop 2023-12-12T10:12:38.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.698+0000 7f532a165640 1 -- 172.21.15.78:0/3683621003 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f53240b0670 msgr2=0x7f532415c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:38.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.698+0000 7f532a165640 1 --2- 172.21.15.78:0/3683621003 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f53240b0670 0x7f532415c660 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f531401ab80 tx=0x7f531401ad10 comp rx=0 tx=0).stop 2023-12-12T10:12:38.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.702+0000 7f532a165640 1 -- 172.21.15.78:0/3683621003 shutdown_connections 2023-12-12T10:12:38.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.702+0000 7f532a165640 1 --2- 172.21.15.78:0/3683621003 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f5304066470 0x7f5304068930 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:38.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.702+0000 7f532a165640 1 --2- 172.21.15.78:0/3683621003 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f532415d510 0x7f532415e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:38.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.702+0000 7f532a165640 1 --2- 172.21.15.78:0/3683621003 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f53240d1630 0x7f53241549d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:38.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.702+0000 7f532a165640 1 --2- 172.21.15.78:0/3683621003 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f53240b0670 0x7f532415c660 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:38.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.702+0000 7f532a165640 1 -- 172.21.15.78:0/3683621003 >> 172.21.15.78:0/3683621003 conn(0x7f53240d3050 msgr2=0x7f53240b2bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:38.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.702+0000 7f532a165640 1 -- 172.21.15.78:0/3683621003 shutdown_connections 2023-12-12T10:12:38.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:38.702+0000 7f532a165640 1 -- 172.21.15.78:0/3683621003 wait complete. 2023-12-12T10:12:38.722 INFO:teuthology.run_tasks:Running task ceph-fuse... 2023-12-12T10:12:38.735 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2023-12-12T10:12:38.735 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-12-12T10:12:38.735 INFO:tasks.ceph_fuse:client.0 config is {} 2023-12-12T10:12:38.735 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-12T10:12:38.735 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-12T10:12:38.735 INFO:tasks.ceph_fuse:client.2 config is {} 2023-12-12T10:12:38.735 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-12T10:12:38.735 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-12-12T10:12:38.735 INFO:tasks.ceph_fuse:client.1 config is {} 2023-12-12T10:12:38.736 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-12T10:12:38.736 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-12T10:12:38.736 INFO:tasks.ceph_fuse:client.3 config is {} 2023-12-12T10:12:38.736 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-12T10:12:38.736 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-12-12T10:12:38.736 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T10:12:38.736 DEBUG:teuthology.orchestra.run.smithi187:> ip netns list 2023-12-12T10:12:38.747 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T10:12:38.747 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip link delete ceph-brx 2023-12-12T10:12:38.814 INFO:teuthology.orchestra.run.smithi187.stderr:Cannot find device "ceph-brx" 2023-12-12T10:12:38.816 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-12T10:12:38.816 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T10:12:38.817 DEBUG:teuthology.orchestra.run.smithi078:> ip netns list 2023-12-12T10:12:38.826 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2023-12-12T10:12:38.827 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T10:12:38.827 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-12-12T10:12:38.891 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T10:12:38.892 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link delete ceph-brx 2023-12-12T10:12:39.129 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2023-12-12T10:12:39.130 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-12T10:12:39.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:39.266+0000 7fb59b91d640 1 Processor -- start 2023-12-12T10:12:39.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:39.266+0000 7fb59b91d640 1 -- start start 2023-12-12T10:12:39.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:39.266+0000 7fb59b91d640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fb59413ceb0 0x7fb59413d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:39.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:39.266+0000 7fb59b91d640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb594071bf0 0x7fb594072030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:39.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:39.266+0000 7fb59b91d640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5940705a0 con 0x7fb59413f550 2023-12-12T10:12:39.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:39.266+0000 7fb59b91d640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb594140410 con 0x7fb594071bf0 2023-12-12T10:12:39.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:39.266+0000 7fb59b91d640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5940cdc90 con 0x7fb59413ceb0 2023-12-12T10:12:39.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:39.266+0000 7fb598eb8640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb594071bf0 0x7fb594072030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:39.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:39.266+0000 7fb598eb8640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb594071bf0 0x7fb594072030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55850/0 (socket says 172.21.15.78:55850) 2023-12-12T10:12:39.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:39.266+0000 7fb598eb8640 1 -- 172.21.15.78:0/1390753221 learned_addr learned my addr 172.21.15.78:0/1390753221 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:39.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:39.266+0000 7fb5996b9640 1 --2- 172.21.15.78:0/1390753221 >> v2:172.21.15.187:3300/0 conn(0x7fb59413ceb0 0x7fb59413d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:39.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:39.266+0000 7fb598eb8640 1 -- 172.21.15.78:0/1390753221 >> v2:172.21.15.187:3300/0 conn(0x7fb59413ceb0 msgr2=0x7fb59413d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:39.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:39.266+0000 7fb598eb8640 1 --2- 172.21.15.78:0/1390753221 >> v2:172.21.15.187:3300/0 conn(0x7fb59413ceb0 0x7fb59413d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:39.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:39.266+0000 7fb598eb8640 1 -- 172.21.15.78:0/1390753221 >> v1:172.21.15.78:6789/0 conn(0x7fb59413f550 legacy=0x7fb5940ce120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:39.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:39.266+0000 7fb598eb8640 1 -- 172.21.15.78:0/1390753221 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb594072570 con 0x7fb594071bf0 2023-12-12T10:12:39.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:39.266+0000 7fb5996b9640 1 --2- 172.21.15.78:0/1390753221 >> v2:172.21.15.187:3300/0 conn(0x7fb59413ceb0 0x7fb59413d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T10:12:39.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:39.270+0000 7fb598eb8640 1 --2- 172.21.15.78:0/1390753221 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb594071bf0 0x7fb594072030 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fb594072840 tx=0x7fb58401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e339e1ff4d648bec server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:39.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:39.270+0000 7fb58bfff640 1 -- 172.21.15.78:0/1390753221 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5840ab600 con 0x7fb594071bf0 2023-12-12T10:12:39.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:39.270+0000 7fb58bfff640 1 -- 172.21.15.78:0/1390753221 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5840a7050 con 0x7fb594071bf0 2023-12-12T10:12:39.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:39.270+0000 7fb58bfff640 1 -- 172.21.15.78:0/1390753221 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5840ab980 con 0x7fb594071bf0 2023-12-12T10:12:39.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:39.270+0000 7fb59b91d640 1 -- 172.21.15.78:0/1390753221 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb594071bf0 msgr2=0x7fb594072030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:39.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:39.270+0000 7fb59b91d640 1 --2- 172.21.15.78:0/1390753221 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb594071bf0 0x7fb594072030 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fb594072840 tx=0x7fb58401c500 comp rx=0 tx=0).stop 2023-12-12T10:12:39.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:39.270+0000 7fb59b91d640 1 -- 172.21.15.78:0/1390753221 shutdown_connections 2023-12-12T10:12:39.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:39.270+0000 7fb59b91d640 1 --2- 172.21.15.78:0/1390753221 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb594071bf0 0x7fb594072030 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:39.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:39.270+0000 7fb59b91d640 1 --2- 172.21.15.78:0/1390753221 >> v2:172.21.15.187:3300/0 conn(0x7fb59413ceb0 0x7fb59413d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:39.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:39.270+0000 7fb59b91d640 1 -- 172.21.15.78:0/1390753221 >> 172.21.15.78:0/1390753221 conn(0x7fb59406c5d0 msgr2=0x7fb59406c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:39.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:39.270+0000 7fb59b91d640 1 -- 172.21.15.78:0/1390753221 shutdown_connections 2023-12-12T10:12:39.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:39.270+0000 7fb59b91d640 1 -- 172.21.15.78:0/1390753221 wait complete. 2023-12-12T10:12:39.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:39.274+0000 7fb59b91d640 1 Processor -- start 2023-12-12T10:12:39.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:39.274+0000 7fb59b91d640 1 -- start start 2023-12-12T10:12:39.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:39.274+0000 7fb59b91d640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb594071bf0 0x7fb594143270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:39.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:39.274+0000 7fb59b91d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb59413ceb0 0x7fb5940af910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:39.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:39.274+0000 7fb59b91d640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb59413f550 0x7fb594138d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:39.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:39.274+0000 7fb59b91d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb59415c8d0 con 0x7fb59413ceb0 2023-12-12T10:12:39.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:39.274+0000 7fb59b91d640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb594153ac0 con 0x7fb594071bf0 2023-12-12T10:12:39.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:39.274+0000 7fb59b91d640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb59415bcc0 con 0x7fb59413f550 2023-12-12T10:12:39.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:39.274+0000 7fb598eb8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb59413ceb0 0x7fb5940af910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:39.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:39.274+0000 7fb598eb8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb59413ceb0 0x7fb5940af910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55852/0 (socket says 172.21.15.78:55852) 2023-12-12T10:12:39.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:39.274+0000 7fb598eb8640 1 -- 172.21.15.78:0/196348793 learned_addr learned my addr 172.21.15.78:0/196348793 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:39.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:39.274+0000 7fb5996b9640 1 --2- 172.21.15.78:0/196348793 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb594071bf0 0x7fb594143270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:39.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:39.274+0000 7fb599eba640 1 --2- 172.21.15.78:0/196348793 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb59413f550 0x7fb594138d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:39.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:39.274+0000 7fb598eb8640 1 -- 172.21.15.78:0/196348793 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb59413f550 msgr2=0x7fb594138d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:39.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:39.274+0000 7fb598eb8640 1 --2- 172.21.15.78:0/196348793 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb59413f550 0x7fb594138d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:39.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:39.274+0000 7fb598eb8640 1 -- 172.21.15.78:0/196348793 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb594071bf0 msgr2=0x7fb594143270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:39.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:39.274+0000 7fb598eb8640 1 --2- 172.21.15.78:0/196348793 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb594071bf0 0x7fb594143270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:39.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:39.274+0000 7fb598eb8640 1 -- 172.21.15.78:0/196348793 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5840094d0 con 0x7fb59413ceb0 2023-12-12T10:12:39.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:39.274+0000 7fb598eb8640 1 --2- 172.21.15.78:0/196348793 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb59413ceb0 0x7fb5940af910 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb584019110 tx=0x7fb5840192a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:39.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:39.274+0000 7fb589ffb640 1 -- 172.21.15.78:0/196348793 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5840b37d0 con 0x7fb59413ceb0 2023-12-12T10:12:39.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:39.274+0000 7fb589ffb640 1 -- 172.21.15.78:0/196348793 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5840b3930 con 0x7fb59413ceb0 2023-12-12T10:12:39.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:39.274+0000 7fb59b91d640 1 -- 172.21.15.78:0/196348793 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb59415bfa0 con 0x7fb59413ceb0 2023-12-12T10:12:39.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:39.274+0000 7fb589ffb640 1 -- 172.21.15.78:0/196348793 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5840b3ce0 con 0x7fb59413ceb0 2023-12-12T10:12:39.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:39.274+0000 7fb59b91d640 1 -- 172.21.15.78:0/196348793 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb59415c560 con 0x7fb59413ceb0 2023-12-12T10:12:39.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:39.278+0000 7fb59b91d640 1 -- 172.21.15.78:0/196348793 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5940671f0 con 0x7fb59413ceb0 2023-12-12T10:12:39.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:39.278+0000 7fb589ffb640 1 -- 172.21.15.78:0/196348793 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb5840b2070 con 0x7fb59413ceb0 2023-12-12T10:12:39.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:39.278+0000 7fb589ffb640 1 --2- 172.21.15.78:0/196348793 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fb578066470 0x7fb578068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:39.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:39.278+0000 7fb589ffb640 1 -- 172.21.15.78:0/196348793 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb58411e540 con 0x7fb59413ceb0 2023-12-12T10:12:39.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:39.278+0000 7fb5996b9640 1 --2- 172.21.15.78:0/196348793 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fb578066470 0x7fb578068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:39.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:39.278+0000 7fb5996b9640 1 --2- 172.21.15.78:0/196348793 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fb578066470 0x7fb578068930 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fb59000a9a0 tx=0x7fb590008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:39.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:39.282+0000 7fb589ffb640 1 -- 172.21.15.78:0/196348793 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb5840eb630 con 0x7fb59413ceb0 2023-12-12T10:12:39.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:39.462+0000 7fb59b91d640 1 -- 172.21.15.78:0/196348793 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fb594067530 con 0x7fb59413ceb0 2023-12-12T10:12:39.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:39.462+0000 7fb589ffb640 1 -- 172.21.15.78:0/196348793 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7fb5840eec50 con 0x7fb59413ceb0 2023-12-12T10:12:39.467 INFO:teuthology.orchestra.run.smithi078.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-12-12T10:12:39.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:39.466+0000 7fb59b91d640 1 -- 172.21.15.78:0/196348793 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fb578066470 msgr2=0x7fb578068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:39.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:39.466+0000 7fb59b91d640 1 --2- 172.21.15.78:0/196348793 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fb578066470 0x7fb578068930 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fb59000a9a0 tx=0x7fb590008040 comp rx=0 tx=0).stop 2023-12-12T10:12:39.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:39.466+0000 7fb59b91d640 1 -- 172.21.15.78:0/196348793 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb59413ceb0 msgr2=0x7fb5940af910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:39.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:39.466+0000 7fb59b91d640 1 --2- 172.21.15.78:0/196348793 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb59413ceb0 0x7fb5940af910 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb584019110 tx=0x7fb5840192a0 comp rx=0 tx=0).stop 2023-12-12T10:12:39.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:39.466+0000 7fb59b91d640 1 -- 172.21.15.78:0/196348793 shutdown_connections 2023-12-12T10:12:39.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:39.466+0000 7fb59b91d640 1 --2- 172.21.15.78:0/196348793 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fb578066470 0x7fb578068930 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:39.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:39.466+0000 7fb59b91d640 1 --2- 172.21.15.78:0/196348793 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb59413f550 0x7fb594138d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:39.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:39.466+0000 7fb59b91d640 1 --2- 172.21.15.78:0/196348793 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb59413ceb0 0x7fb5940af910 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:39.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:39.466+0000 7fb59b91d640 1 --2- 172.21.15.78:0/196348793 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb594071bf0 0x7fb594143270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:39.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:39.466+0000 7fb59b91d640 1 -- 172.21.15.78:0/196348793 >> 172.21.15.78:0/196348793 conn(0x7fb59406c5d0 msgr2=0x7fb5940ae6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:39.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:39.466+0000 7fb59b91d640 1 -- 172.21.15.78:0/196348793 shutdown_connections 2023-12-12T10:12:39.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:39.466+0000 7fb59b91d640 1 -- 172.21.15.78:0/196348793 wait complete. 2023-12-12T10:12:39.487 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-12T10:12:39.487 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-12T10:12:39.488 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi078.front.sepia.ceph.com 2023-12-12T10:12:39.488 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-12T10:12:39.488 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-12T10:12:39.488 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-12T10:12:39.488 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-12T10:12:39.488 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-12T10:12:39.488 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-12T10:12:39.488 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T10:12:39.488 DEBUG:teuthology.orchestra.run.smithi078:> ip addr 2023-12-12T10:12:39.498 INFO:teuthology.orchestra.run.smithi078.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-12T10:12:39.498 INFO:teuthology.orchestra.run.smithi078.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-12T10:12:39.499 INFO:teuthology.orchestra.run.smithi078.stdout: inet 127.0.0.1/8 scope host lo 2023-12-12T10:12:39.499 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-12-12T10:12:39.499 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 ::1/128 scope host 2023-12-12T10:12:39.499 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-12-12T10:12:39.499 INFO:teuthology.orchestra.run.smithi078.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-12T10:12:39.499 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:d8:a1:22 brd ff:ff:ff:ff:ff:ff 2023-12-12T10:12:39.499 INFO:teuthology.orchestra.run.smithi078.stdout: altname enp7s0f0 2023-12-12T10:12:39.499 INFO:teuthology.orchestra.run.smithi078.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-12T10:12:39.499 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:d8:a1:23 brd ff:ff:ff:ff:ff:ff 2023-12-12T10:12:39.499 INFO:teuthology.orchestra.run.smithi078.stdout: altname enp7s0f1 2023-12-12T10:12:39.499 INFO:teuthology.orchestra.run.smithi078.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-12T10:12:39.499 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:8f:d4:dc brd ff:ff:ff:ff:ff:ff 2023-12-12T10:12:39.499 INFO:teuthology.orchestra.run.smithi078.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-12T10:12:39.499 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:8f:d4:dd brd ff:ff:ff:ff:ff:ff 2023-12-12T10:12:39.500 INFO:teuthology.orchestra.run.smithi078.stdout: inet 172.21.15.78/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-12-12T10:12:39.500 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft 42372sec preferred_lft 42372sec 2023-12-12T10:12:39.500 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 fe80::ec4:7aff:fe8f:d4dd/64 scope link 2023-12-12T10:12:39.500 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-12-12T10:12:39.500 INFO:teuthology.orchestra.run.smithi078.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-12T10:12:39.500 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 02:42:b6:5e:55:45 brd ff:ff:ff:ff:ff:ff 2023-12-12T10:12:39.500 INFO:teuthology.orchestra.run.smithi078.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-12T10:12:39.500 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-12-12T10:12:39.500 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-12-12T10:12:39.500 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T10:12:39.500 DEBUG:teuthology.orchestra.run.smithi078:> (cd / && exec bash -c ' 2023-12-12T10:12:39.501 DEBUG:teuthology.orchestra.run.smithi078:> set -e 2023-12-12T10:12:39.501 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link add name ceph-brx type bridge 2023-12-12T10:12:39.501 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip addr flush dev ceph-brx 2023-12-12T10:12:39.501 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link set ceph-brx up 2023-12-12T10:12:39.501 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-12-12T10:12:39.501 DEBUG:teuthology.orchestra.run.smithi078:> ') 2023-12-12T10:12:39.611 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T10:12:39.611 DEBUG:teuthology.orchestra.run.smithi078:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-12T10:12:39.631 INFO:teuthology.orchestra.run.smithi078.stdout:1 2023-12-12T10:12:39.633 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T10:12:39.633 DEBUG:teuthology.orchestra.run.smithi078:> route 2023-12-12T10:12:39.690 INFO:teuthology.orchestra.run.smithi078.stdout:Kernel IP routing table 2023-12-12T10:12:39.690 INFO:teuthology.orchestra.run.smithi078.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-12T10:12:39.690 INFO:teuthology.orchestra.run.smithi078.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-12-12T10:12:39.690 INFO:teuthology.orchestra.run.smithi078.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-12T10:12:39.690 INFO:teuthology.orchestra.run.smithi078.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-12T10:12:39.690 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-12T10:12:39.690 INFO:teuthology.orchestra.run.smithi078.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-12T10:12:39.690 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-12T10:12:39.690 INFO:teuthology.orchestra.run.smithi078.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-12T10:12:39.690 INFO:teuthology.orchestra.run.smithi078.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-12T10:12:39.691 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T10:12:39.691 DEBUG:teuthology.orchestra.run.smithi078:> (cd / && exec bash -c ' 2023-12-12T10:12:39.691 DEBUG:teuthology.orchestra.run.smithi078:> set -e 2023-12-12T10:12:39.691 DEBUG:teuthology.orchestra.run.smithi078:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-12T10:12:39.691 DEBUG:teuthology.orchestra.run.smithi078:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-12T10:12:39.691 DEBUG:teuthology.orchestra.run.smithi078:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-12T10:12:39.691 DEBUG:teuthology.orchestra.run.smithi078:> ') 2023-12-12T10:12:39.781 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T10:12:39.781 DEBUG:teuthology.orchestra.run.smithi078:> ip netns list 2023-12-12T10:12:39.791 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T10:12:39.791 DEBUG:teuthology.orchestra.run.smithi078:> ip netns list-id 2023-12-12T10:12:39.847 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T10:12:39.848 DEBUG:teuthology.orchestra.run.smithi078:> (cd / && exec bash -c ' 2023-12-12T10:12:39.848 DEBUG:teuthology.orchestra.run.smithi078:> set -e 2023-12-12T10:12:39.848 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-12T10:12:39.848 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-12-12T10:12:39.848 DEBUG:teuthology.orchestra.run.smithi078:> ') 2023-12-12T10:12:39.934 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-12-12T10:12:39.935 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T10:12:39.935 DEBUG:teuthology.orchestra.run.smithi078:> (cd / && exec bash -c ' 2023-12-12T10:12:39.935 DEBUG:teuthology.orchestra.run.smithi078:> set -e 2023-12-12T10:12:39.935 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-12-12T10:12:39.935 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-12-12T10:12:39.935 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-12-12T10:12:39.935 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-12-12T10:12:39.935 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-12-12T10:12:39.935 DEBUG:teuthology.orchestra.run.smithi078:> ') 2023-12-12T10:12:40.079 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T10:12:40.079 DEBUG:teuthology.orchestra.run.smithi078:> (cd / && exec bash -c ' 2023-12-12T10:12:40.079 DEBUG:teuthology.orchestra.run.smithi078:> set -e 2023-12-12T10:12:40.079 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link set brx.0 up 2023-12-12T10:12:40.079 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link set dev brx.0 master ceph-brx 2023-12-12T10:12:40.079 DEBUG:teuthology.orchestra.run.smithi078:> ') 2023-12-12T10:12:40.120 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-12-12T10:12:40.120 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-12T10:12:40.120 DEBUG:teuthology.orchestra.run.smithi078:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-12T10:12:40.171 INFO:teuthology.orchestra.run.smithi078.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-12T10:12:40.171 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-12T10:12:40.172 DEBUG:teuthology.orchestra.run.smithi078:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-12T10:12:40.223 DEBUG:teuthology.orchestra.run.smithi078:> sudo modprobe fuse 2023-12-12T10:12:40.291 DEBUG:teuthology.orchestra.run.smithi078:> cat /proc/self/mounts | awk '{print $2}' 2023-12-12T10:12:40.344 INFO:teuthology.orchestra.run.smithi078.stdout:/sys 2023-12-12T10:12:40.344 INFO:teuthology.orchestra.run.smithi078.stdout:/proc 2023-12-12T10:12:40.345 INFO:teuthology.orchestra.run.smithi078.stdout:/dev 2023-12-12T10:12:40.345 INFO:teuthology.orchestra.run.smithi078.stdout:/dev/pts 2023-12-12T10:12:40.345 INFO:teuthology.orchestra.run.smithi078.stdout:/run 2023-12-12T10:12:40.345 INFO:teuthology.orchestra.run.smithi078.stdout:/ 2023-12-12T10:12:40.345 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/kernel/security 2023-12-12T10:12:40.345 INFO:teuthology.orchestra.run.smithi078.stdout:/dev/shm 2023-12-12T10:12:40.345 INFO:teuthology.orchestra.run.smithi078.stdout:/run/lock 2023-12-12T10:12:40.345 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/fs/cgroup 2023-12-12T10:12:40.345 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/fs/pstore 2023-12-12T10:12:40.345 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/fs/bpf 2023-12-12T10:12:40.345 INFO:teuthology.orchestra.run.smithi078.stdout:/proc/sys/fs/binfmt_misc 2023-12-12T10:12:40.345 INFO:teuthology.orchestra.run.smithi078.stdout:/dev/hugepages 2023-12-12T10:12:40.345 INFO:teuthology.orchestra.run.smithi078.stdout:/dev/mqueue 2023-12-12T10:12:40.345 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/kernel/debug 2023-12-12T10:12:40.345 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/kernel/tracing 2023-12-12T10:12:40.346 INFO:teuthology.orchestra.run.smithi078.stdout:/proc/fs/nfsd 2023-12-12T10:12:40.346 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/fs/fuse/connections 2023-12-12T10:12:40.346 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/kernel/config 2023-12-12T10:12:40.346 INFO:teuthology.orchestra.run.smithi078.stdout:/run/credentials/systemd-sysusers.service 2023-12-12T10:12:40.346 INFO:teuthology.orchestra.run.smithi078.stdout:/run/rpc_pipefs 2023-12-12T10:12:40.346 INFO:teuthology.orchestra.run.smithi078.stdout:/run/user/1000 2023-12-12T10:12:40.346 INFO:teuthology.orchestra.run.smithi078.stdout:/var/lib/ceph 2023-12-12T10:12:40.346 INFO:teuthology.orchestra.run.smithi078.stdout:/var/lib/ceph/osd/ceph-0 2023-12-12T10:12:40.346 INFO:teuthology.orchestra.run.smithi078.stdout:/var/lib/ceph/osd/ceph-1 2023-12-12T10:12:40.346 INFO:teuthology.orchestra.run.smithi078.stdout:/var/lib/ceph/osd/ceph-2 2023-12-12T10:12:40.346 INFO:teuthology.orchestra.run.smithi078.stdout:/var/lib/ceph/osd/ceph-3 2023-12-12T10:12:40.346 INFO:teuthology.orchestra.run.smithi078.stdout:/run/netns 2023-12-12T10:12:40.346 INFO:teuthology.orchestra.run.smithi078.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-12T10:12:40.346 INFO:teuthology.orchestra.run.smithi078.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-12T10:12:40.347 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T10:12:40.348 DEBUG:teuthology.orchestra.run.smithi078:> ls /sys/fs/fuse/connections 2023-12-12T10:12:40.399 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-12-12T10:12:40.399 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-12-12T10:12:40.446 DEBUG:teuthology.orchestra.run.smithi078:> sudo modprobe fuse 2023-12-12T10:12:40.467 DEBUG:teuthology.orchestra.run.smithi078:> cat /proc/self/mounts | awk '{print $2}' 2023-12-12T10:12:40.522 INFO:teuthology.orchestra.run.smithi078.stdout:/sys 2023-12-12T10:12:40.522 INFO:teuthology.orchestra.run.smithi078.stdout:/proc 2023-12-12T10:12:40.522 INFO:teuthology.orchestra.run.smithi078.stdout:/dev 2023-12-12T10:12:40.522 INFO:teuthology.orchestra.run.smithi078.stdout:/dev/pts 2023-12-12T10:12:40.522 INFO:teuthology.orchestra.run.smithi078.stdout:/run 2023-12-12T10:12:40.523 INFO:teuthology.orchestra.run.smithi078.stdout:/ 2023-12-12T10:12:40.523 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/kernel/security 2023-12-12T10:12:40.523 INFO:teuthology.orchestra.run.smithi078.stdout:/dev/shm 2023-12-12T10:12:40.523 INFO:teuthology.orchestra.run.smithi078.stdout:/run/lock 2023-12-12T10:12:40.523 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/fs/cgroup 2023-12-12T10:12:40.523 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/fs/pstore 2023-12-12T10:12:40.523 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/fs/bpf 2023-12-12T10:12:40.523 INFO:teuthology.orchestra.run.smithi078.stdout:/proc/sys/fs/binfmt_misc 2023-12-12T10:12:40.523 INFO:teuthology.orchestra.run.smithi078.stdout:/dev/hugepages 2023-12-12T10:12:40.523 INFO:teuthology.orchestra.run.smithi078.stdout:/dev/mqueue 2023-12-12T10:12:40.523 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/kernel/debug 2023-12-12T10:12:40.523 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/kernel/tracing 2023-12-12T10:12:40.523 INFO:teuthology.orchestra.run.smithi078.stdout:/proc/fs/nfsd 2023-12-12T10:12:40.524 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/fs/fuse/connections 2023-12-12T10:12:40.524 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/kernel/config 2023-12-12T10:12:40.524 INFO:teuthology.orchestra.run.smithi078.stdout:/run/credentials/systemd-sysusers.service 2023-12-12T10:12:40.524 INFO:teuthology.orchestra.run.smithi078.stdout:/run/rpc_pipefs 2023-12-12T10:12:40.524 INFO:teuthology.orchestra.run.smithi078.stdout:/run/user/1000 2023-12-12T10:12:40.524 INFO:teuthology.orchestra.run.smithi078.stdout:/var/lib/ceph 2023-12-12T10:12:40.524 INFO:teuthology.orchestra.run.smithi078.stdout:/var/lib/ceph/osd/ceph-0 2023-12-12T10:12:40.524 INFO:teuthology.orchestra.run.smithi078.stdout:/var/lib/ceph/osd/ceph-1 2023-12-12T10:12:40.524 INFO:teuthology.orchestra.run.smithi078.stdout:/var/lib/ceph/osd/ceph-2 2023-12-12T10:12:40.524 INFO:teuthology.orchestra.run.smithi078.stdout:/var/lib/ceph/osd/ceph-3 2023-12-12T10:12:40.524 INFO:teuthology.orchestra.run.smithi078.stdout:/run/netns 2023-12-12T10:12:40.524 INFO:teuthology.orchestra.run.smithi078.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-12T10:12:40.524 INFO:teuthology.orchestra.run.smithi078.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-12T10:12:40.525 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T10:12:40.525 DEBUG:teuthology.orchestra.run.smithi078:> ls /sys/fs/fuse/connections 2023-12-12T10:12:40.543 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi078.stderr:2023-12-12T10:12:40.538+0000 7ff3db108580 -1 init, newargv = 0x55ca002b7200 newargc=15 2023-12-12T10:12:40.543 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi078.stderr:ceph-fuse[46722]: starting ceph client 2023-12-12T10:12:40.550 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi078.stderr:ceph-fuse[46722]: starting fuse 2023-12-12T10:12:40.552 INFO:teuthology.orchestra.run.smithi078.stdout:43 2023-12-12T10:12:40.552 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2023-12-12T10:12:40.553 DEBUG:teuthology.orchestra.run.smithi078:> sudo stdin-killer -- python3 -c ' 2023-12-12T10:12:40.553 DEBUG:teuthology.orchestra.run.smithi078:> import glob 2023-12-12T10:12:40.553 DEBUG:teuthology.orchestra.run.smithi078:> import re 2023-12-12T10:12:40.553 DEBUG:teuthology.orchestra.run.smithi078:> import os 2023-12-12T10:12:40.553 DEBUG:teuthology.orchestra.run.smithi078:> import subprocess 2023-12-12T10:12:40.553 DEBUG:teuthology.orchestra.run.smithi078:> 2023-12-12T10:12:40.553 DEBUG:teuthology.orchestra.run.smithi078:> def _find_admin_socket(client_name): 2023-12-12T10:12:40.553 DEBUG:teuthology.orchestra.run.smithi078:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-12-12T10:12:40.553 DEBUG:teuthology.orchestra.run.smithi078:> files = glob.glob(asok_path) 2023-12-12T10:12:40.553 DEBUG:teuthology.orchestra.run.smithi078:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-12-12T10:12:40.553 DEBUG:teuthology.orchestra.run.smithi078:> 2023-12-12T10:12:40.553 DEBUG:teuthology.orchestra.run.smithi078:> # Given a non-glob path, it better be there 2023-12-12T10:12:40.553 DEBUG:teuthology.orchestra.run.smithi078:> if "*" not in asok_path: 2023-12-12T10:12:40.554 DEBUG:teuthology.orchestra.run.smithi078:> assert(len(files) == 1) 2023-12-12T10:12:40.554 DEBUG:teuthology.orchestra.run.smithi078:> return files[0] 2023-12-12T10:12:40.554 DEBUG:teuthology.orchestra.run.smithi078:> 2023-12-12T10:12:40.554 DEBUG:teuthology.orchestra.run.smithi078:> for f in files: 2023-12-12T10:12:40.554 DEBUG:teuthology.orchestra.run.smithi078:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-12T10:12:40.554 DEBUG:teuthology.orchestra.run.smithi078:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-12T10:12:40.554 DEBUG:teuthology.orchestra.run.smithi078:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-12T10:12:40.554 DEBUG:teuthology.orchestra.run.smithi078:> contents = proc_f.read() 2023-12-12T10:12:40.554 DEBUG:teuthology.orchestra.run.smithi078:> if mountpoint in contents: 2023-12-12T10:12:40.554 DEBUG:teuthology.orchestra.run.smithi078:> return f 2023-12-12T10:12:40.554 DEBUG:teuthology.orchestra.run.smithi078:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-12T10:12:40.554 DEBUG:teuthology.orchestra.run.smithi078:> 2023-12-12T10:12:40.554 DEBUG:teuthology.orchestra.run.smithi078:> print(_find_admin_socket("client.0")) 2023-12-12T10:12:40.554 DEBUG:teuthology.orchestra.run.smithi078:> ' 2023-12-12T10:12:40.676 INFO:teuthology.orchestra.run.smithi078.stdout:/var/run/ceph/ceph-client.0.46722.asok 2023-12-12T10:12:40.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-12-12T10:12:40.687 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.46722.asok 2023-12-12T10:12:40.687 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T10:12:40.687 DEBUG:teuthology.orchestra.run.smithi078:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.46722.asok status 2023-12-12T10:12:40.860 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2023-12-12T10:12:40.860 INFO:teuthology.orchestra.run.smithi078.stdout: "metadata": { 2023-12-12T10:12:40.860 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph_sha1": "f1fbf3c583d03e19f5e58eb618e78d8e10d075f9", 2023-12-12T10:12:40.860 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph_version": "ceph version 19.0.0-96-gf1fbf3c5 (f1fbf3c583d03e19f5e58eb618e78d8e10d075f9) reef (dev)", 2023-12-12T10:12:40.861 INFO:teuthology.orchestra.run.smithi078.stdout: "entity_id": "0", 2023-12-12T10:12:40.861 INFO:teuthology.orchestra.run.smithi078.stdout: "hostname": "smithi078", 2023-12-12T10:12:40.861 INFO:teuthology.orchestra.run.smithi078.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-12-12T10:12:40.861 INFO:teuthology.orchestra.run.smithi078.stdout: "pid": "46722", 2023-12-12T10:12:40.861 INFO:teuthology.orchestra.run.smithi078.stdout: "root": "/" 2023-12-12T10:12:40.861 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-12-12T10:12:40.861 INFO:teuthology.orchestra.run.smithi078.stdout: "dentry_count": 0, 2023-12-12T10:12:40.861 INFO:teuthology.orchestra.run.smithi078.stdout: "dentry_pinned_count": 0, 2023-12-12T10:12:40.861 INFO:teuthology.orchestra.run.smithi078.stdout: "id": 4821, 2023-12-12T10:12:40.861 INFO:teuthology.orchestra.run.smithi078.stdout: "inst": { 2023-12-12T10:12:40.861 INFO:teuthology.orchestra.run.smithi078.stdout: "name": { 2023-12-12T10:12:40.861 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "client", 2023-12-12T10:12:40.861 INFO:teuthology.orchestra.run.smithi078.stdout: "num": 4821 2023-12-12T10:12:40.861 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-12-12T10:12:40.861 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": { 2023-12-12T10:12:40.862 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v1", 2023-12-12T10:12:40.862 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "192.168.0.1:0", 2023-12-12T10:12:40.862 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 1564909128 2023-12-12T10:12:40.862 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-12-12T10:12:40.862 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-12-12T10:12:40.862 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": { 2023-12-12T10:12:40.862 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v1", 2023-12-12T10:12:40.862 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "192.168.0.1:0", 2023-12-12T10:12:40.862 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 1564909128 2023-12-12T10:12:40.862 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-12-12T10:12:40.862 INFO:teuthology.orchestra.run.smithi078.stdout: "inst_str": "client.4821 192.168.0.1:0/1564909128", 2023-12-12T10:12:40.862 INFO:teuthology.orchestra.run.smithi078.stdout: "addr_str": "192.168.0.1:0/1564909128", 2023-12-12T10:12:40.862 INFO:teuthology.orchestra.run.smithi078.stdout: "inode_count": 1, 2023-12-12T10:12:40.862 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_epoch": 9, 2023-12-12T10:12:40.862 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_epoch": 24, 2023-12-12T10:12:40.863 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_epoch_barrier": 0, 2023-12-12T10:12:40.863 INFO:teuthology.orchestra.run.smithi078.stdout: "blocklisted": false, 2023-12-12T10:12:40.863 INFO:teuthology.orchestra.run.smithi078.stdout: "fs_name": "cephfs" 2023-12-12T10:12:40.863 INFO:teuthology.orchestra.run.smithi078.stdout:} 2023-12-12T10:12:40.875 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-12T10:12:41.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:41.010+0000 7fcbbb557640 1 Processor -- start 2023-12-12T10:12:41.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:41.010+0000 7fcbbb557640 1 -- start start 2023-12-12T10:12:41.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:41.010+0000 7fcbbb557640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fcbb40b3880 0x7fcbb40b3c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:41.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:41.010+0000 7fcbbb557640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcbb4162620 0x7fcbb4165780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:41.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:41.010+0000 7fcbbb557640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbb4162a90 con 0x7fcbb41621a0 2023-12-12T10:12:41.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:41.010+0000 7fcbbb557640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbb40b41a0 con 0x7fcbb40b3880 2023-12-12T10:12:41.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:41.010+0000 7fcbbb557640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbb40b20e0 con 0x7fcbb4162620 2023-12-12T10:12:41.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:41.010+0000 7fcbb92f3640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fcbb40b3880 0x7fcbb40b3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:41.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:41.010+0000 7fcbb92f3640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fcbb40b3880 0x7fcbb40b3c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55868/0 (socket says 172.21.15.78:55868) 2023-12-12T10:12:41.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:41.010+0000 7fcbb92f3640 1 -- 172.21.15.78:0/733515817 learned_addr learned my addr 172.21.15.78:0/733515817 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:41.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:41.010+0000 7fcbb8af2640 1 --1- 172.21.15.78:0/733515817 >> v1:172.21.15.78:6789/0 conn(0x7fcbb41621a0 0x7fcbb4165070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:39748/0 (socket says 172.21.15.78:39748) 2023-12-12T10:12:41.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:41.010+0000 7fcbb92f3640 1 -- 172.21.15.78:0/733515817 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcbb4162620 msgr2=0x7fcbb4165780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:41.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:41.010+0000 7fcbb92f3640 1 --2- 172.21.15.78:0/733515817 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcbb4162620 0x7fcbb4165780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:41.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:41.010+0000 7fcbb92f3640 1 -- 172.21.15.78:0/733515817 >> v1:172.21.15.78:6789/0 conn(0x7fcbb41621a0 legacy=0x7fcbb4165070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:41.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:41.010+0000 7fcbb92f3640 1 -- 172.21.15.78:0/733515817 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbb40b23c0 con 0x7fcbb40b3880 2023-12-12T10:12:41.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:41.010+0000 7fcbabfff640 1 -- 172.21.15.78:0/733515817 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 230473622 0 0) 0x7fcbb4162a90 con 0x7fcbb41621a0 2023-12-12T10:12:41.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:41.014+0000 7fcbb92f3640 1 --2- 172.21.15.78:0/733515817 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcbb40b3880 0x7fcbb40b3c60 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fcbb0009870 tx=0x7fcbb001c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54b3c1fb783b22ae server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:41.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:41.014+0000 7fcbabfff640 1 -- 172.21.15.78:0/733515817 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb00a7070 con 0x7fcbb40b3880 2023-12-12T10:12:41.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:41.014+0000 7fcbabfff640 1 -- 172.21.15.78:0/733515817 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbb00ab430 con 0x7fcbb40b3880 2023-12-12T10:12:41.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:41.014+0000 7fcbabfff640 1 -- 172.21.15.78:0/733515817 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb00ab7c0 con 0x7fcbb40b3880 2023-12-12T10:12:41.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:41.014+0000 7fcbbb557640 1 -- 172.21.15.78:0/733515817 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcbb40b3880 msgr2=0x7fcbb40b3c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:41.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:41.014+0000 7fcbbb557640 1 --2- 172.21.15.78:0/733515817 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcbb40b3880 0x7fcbb40b3c60 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fcbb0009870 tx=0x7fcbb001c540 comp rx=0 tx=0).stop 2023-12-12T10:12:41.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:41.014+0000 7fcbbb557640 1 -- 172.21.15.78:0/733515817 shutdown_connections 2023-12-12T10:12:41.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:41.014+0000 7fcbbb557640 1 --2- 172.21.15.78:0/733515817 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcbb4162620 0x7fcbb4165780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:41.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:41.014+0000 7fcbbb557640 1 --2- 172.21.15.78:0/733515817 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcbb40b3880 0x7fcbb40b3c60 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:41.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:41.014+0000 7fcbbb557640 1 -- 172.21.15.78:0/733515817 >> 172.21.15.78:0/733515817 conn(0x7fcbb406c5d0 msgr2=0x7fcbb406c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:41.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:41.014+0000 7fcbbb557640 1 -- 172.21.15.78:0/733515817 shutdown_connections 2023-12-12T10:12:41.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:41.014+0000 7fcbbb557640 1 -- 172.21.15.78:0/733515817 wait complete. 2023-12-12T10:12:41.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:41.018+0000 7fcbbb557640 1 Processor -- start 2023-12-12T10:12:41.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:41.018+0000 7fcbbb557640 1 -- start start 2023-12-12T10:12:41.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:41.018+0000 7fcbbb557640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcbb40b3880 0x7fcbb4162fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:41.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:41.018+0000 7fcbbb557640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcbb41621a0 0x7fcbb4159c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:41.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:41.018+0000 7fcbbb557640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcbb4162620 0x7fcbb4141aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:41.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:41.018+0000 7fcbbb557640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbb4163920 con 0x7fcbb40b3880 2023-12-12T10:12:41.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:41.018+0000 7fcbbb557640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbb4163c00 con 0x7fcbb4162620 2023-12-12T10:12:41.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:41.018+0000 7fcbbb557640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbb4163ee0 con 0x7fcbb41621a0 2023-12-12T10:12:41.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:41.018+0000 7fcbb92f3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcbb40b3880 0x7fcbb4162fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:41.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:41.018+0000 7fcbb92f3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcbb40b3880 0x7fcbb4162fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55874/0 (socket says 172.21.15.78:55874) 2023-12-12T10:12:41.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:41.018+0000 7fcbb92f3640 1 -- 172.21.15.78:0/3663190711 learned_addr learned my addr 172.21.15.78:0/3663190711 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:41.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:41.018+0000 7fcbb8af2640 1 --2- 172.21.15.78:0/3663190711 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcbb41621a0 0x7fcbb4159c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:41.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:41.018+0000 7fcbb9af4640 1 --2- 172.21.15.78:0/3663190711 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcbb4162620 0x7fcbb4141aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:41.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:41.018+0000 7fcbb92f3640 1 -- 172.21.15.78:0/3663190711 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcbb41621a0 msgr2=0x7fcbb4159c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:41.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:41.018+0000 7fcbb92f3640 1 --2- 172.21.15.78:0/3663190711 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcbb41621a0 0x7fcbb4159c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:41.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:41.018+0000 7fcbb92f3640 1 -- 172.21.15.78:0/3663190711 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcbb4162620 msgr2=0x7fcbb4141aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:41.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:41.018+0000 7fcbb92f3640 1 --2- 172.21.15.78:0/3663190711 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcbb4162620 0x7fcbb4141aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:41.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:41.018+0000 7fcbb92f3640 1 -- 172.21.15.78:0/3663190711 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbb00094d0 con 0x7fcbb40b3880 2023-12-12T10:12:41.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:41.018+0000 7fcbb9af4640 1 --2- 172.21.15.78:0/3663190711 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcbb4162620 0x7fcbb4141aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T10:12:41.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:41.018+0000 7fcbb92f3640 1 --2- 172.21.15.78:0/3663190711 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcbb40b3880 0x7fcbb4162fd0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fcbb001a170 tx=0x7fcbb00192e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:41.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:41.018+0000 7fcba9ffb640 1 -- 172.21.15.78:0/3663190711 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb00b4830 con 0x7fcbb40b3880 2023-12-12T10:12:41.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:41.018+0000 7fcba9ffb640 1 -- 172.21.15.78:0/3663190711 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbb00abe90 con 0x7fcbb40b3880 2023-12-12T10:12:41.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:41.018+0000 7fcba9ffb640 1 -- 172.21.15.78:0/3663190711 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb00b4bd0 con 0x7fcbb40b3880 2023-12-12T10:12:41.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:41.018+0000 7fcbbb557640 1 -- 172.21.15.78:0/3663190711 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbb41641c0 con 0x7fcbb40b3880 2023-12-12T10:12:41.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:41.018+0000 7fcbbb557640 1 -- 172.21.15.78:0/3663190711 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbb41649c0 con 0x7fcbb40b3880 2023-12-12T10:12:41.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:41.022+0000 7fcbbb557640 1 -- 172.21.15.78:0/3663190711 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbb40671f0 con 0x7fcbb40b3880 2023-12-12T10:12:41.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:41.022+0000 7fcba9ffb640 1 -- 172.21.15.78:0/3663190711 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fcbb00b4d30 con 0x7fcbb40b3880 2023-12-12T10:12:41.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:41.022+0000 7fcba9ffb640 1 --2- 172.21.15.78:0/3663190711 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fcb98066470 0x7fcb98068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:41.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:41.022+0000 7fcba9ffb640 1 -- 172.21.15.78:0/3663190711 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fcbb011e750 con 0x7fcbb40b3880 2023-12-12T10:12:41.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:41.022+0000 7fcbb8af2640 1 --2- 172.21.15.78:0/3663190711 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fcb98066470 0x7fcb98068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:41.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:41.022+0000 7fcbb8af2640 1 --2- 172.21.15.78:0/3663190711 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fcb98066470 0x7fcb98068930 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fcbb4068750 tx=0x7fcba4007b60 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:41.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:41.026+0000 7fcba9ffb640 1 -- 172.21.15.78:0/3663190711 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fcbb00eb8d0 con 0x7fcbb40b3880 2023-12-12T10:12:41.210 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:41.206+0000 7fcbbb557640 1 -- 172.21.15.78:0/3663190711 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fcbb4067530 con 0x7fcbb40b3880 2023-12-12T10:12:41.210 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:41.206+0000 7fcba9ffb640 1 -- 172.21.15.78:0/3663190711 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7fcbb00ba070 con 0x7fcbb40b3880 2023-12-12T10:12:41.211 INFO:teuthology.orchestra.run.smithi078.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-12-12T10:12:41.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:41.210+0000 7fcbbb557640 1 -- 172.21.15.78:0/3663190711 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fcb98066470 msgr2=0x7fcb98068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:41.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:41.210+0000 7fcbbb557640 1 --2- 172.21.15.78:0/3663190711 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fcb98066470 0x7fcb98068930 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fcbb4068750 tx=0x7fcba4007b60 comp rx=0 tx=0).stop 2023-12-12T10:12:41.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:41.210+0000 7fcbbb557640 1 -- 172.21.15.78:0/3663190711 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcbb40b3880 msgr2=0x7fcbb4162fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:41.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:41.210+0000 7fcbbb557640 1 --2- 172.21.15.78:0/3663190711 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcbb40b3880 0x7fcbb4162fd0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fcbb001a170 tx=0x7fcbb00192e0 comp rx=0 tx=0).stop 2023-12-12T10:12:41.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:41.210+0000 7fcbbb557640 1 -- 172.21.15.78:0/3663190711 shutdown_connections 2023-12-12T10:12:41.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:41.210+0000 7fcbbb557640 1 --2- 172.21.15.78:0/3663190711 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fcb98066470 0x7fcb98068930 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:41.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:41.210+0000 7fcbbb557640 1 --2- 172.21.15.78:0/3663190711 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcbb4162620 0x7fcbb4141aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:41.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:41.210+0000 7fcbbb557640 1 --2- 172.21.15.78:0/3663190711 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcbb41621a0 0x7fcbb4159c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:41.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:41.210+0000 7fcbbb557640 1 --2- 172.21.15.78:0/3663190711 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcbb40b3880 0x7fcbb4162fd0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:41.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:41.210+0000 7fcbbb557640 1 -- 172.21.15.78:0/3663190711 >> 172.21.15.78:0/3663190711 conn(0x7fcbb406c5d0 msgr2=0x7fcbb40b00a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:41.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:41.210+0000 7fcbbb557640 1 -- 172.21.15.78:0/3663190711 shutdown_connections 2023-12-12T10:12:41.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:41.210+0000 7fcbbb557640 1 -- 172.21.15.78:0/3663190711 wait complete. 2023-12-12T10:12:41.231 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-12T10:12:41.231 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-12T10:12:41.231 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi078.front.sepia.ceph.com 2023-12-12T10:12:41.231 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-12-12T10:12:41.231 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-12-12T10:12:41.231 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-12T10:12:41.231 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-12T10:12:41.231 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-12T10:12:41.231 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-12-12T10:12:41.232 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T10:12:41.232 DEBUG:teuthology.orchestra.run.smithi078:> ip addr 2023-12-12T10:12:41.241 INFO:teuthology.orchestra.run.smithi078.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-12T10:12:41.241 INFO:teuthology.orchestra.run.smithi078.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-12T10:12:41.242 INFO:teuthology.orchestra.run.smithi078.stdout: inet 127.0.0.1/8 scope host lo 2023-12-12T10:12:41.242 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-12-12T10:12:41.242 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 ::1/128 scope host 2023-12-12T10:12:41.242 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-12-12T10:12:41.242 INFO:teuthology.orchestra.run.smithi078.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-12T10:12:41.242 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:d8:a1:22 brd ff:ff:ff:ff:ff:ff 2023-12-12T10:12:41.242 INFO:teuthology.orchestra.run.smithi078.stdout: altname enp7s0f0 2023-12-12T10:12:41.242 INFO:teuthology.orchestra.run.smithi078.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-12T10:12:41.242 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:d8:a1:23 brd ff:ff:ff:ff:ff:ff 2023-12-12T10:12:41.242 INFO:teuthology.orchestra.run.smithi078.stdout: altname enp7s0f1 2023-12-12T10:12:41.242 INFO:teuthology.orchestra.run.smithi078.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-12T10:12:41.242 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:8f:d4:dc brd ff:ff:ff:ff:ff:ff 2023-12-12T10:12:41.242 INFO:teuthology.orchestra.run.smithi078.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-12T10:12:41.242 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:8f:d4:dd brd ff:ff:ff:ff:ff:ff 2023-12-12T10:12:41.243 INFO:teuthology.orchestra.run.smithi078.stdout: inet 172.21.15.78/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-12-12T10:12:41.243 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft 42370sec preferred_lft 42370sec 2023-12-12T10:12:41.243 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 fe80::ec4:7aff:fe8f:d4dd/64 scope link 2023-12-12T10:12:41.243 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-12-12T10:12:41.243 INFO:teuthology.orchestra.run.smithi078.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-12T10:12:41.243 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 02:42:b6:5e:55:45 brd ff:ff:ff:ff:ff:ff 2023-12-12T10:12:41.243 INFO:teuthology.orchestra.run.smithi078.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-12T10:12:41.243 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-12-12T10:12:41.243 INFO:teuthology.orchestra.run.smithi078.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-12T10:12:41.243 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-12-12T10:12:41.243 INFO:teuthology.orchestra.run.smithi078.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-12T10:12:41.243 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-12-12T10:12:41.243 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link tentative 2023-12-12T10:12:41.243 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-12-12T10:12:41.244 INFO:teuthology.orchestra.run.smithi078.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-12T10:12:41.244 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-12T10:12:41.244 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link tentative 2023-12-12T10:12:41.244 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-12-12T10:12:41.244 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T10:12:41.244 DEBUG:teuthology.orchestra.run.smithi078:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-12T10:12:41.305 INFO:teuthology.orchestra.run.smithi078.stdout:1 2023-12-12T10:12:41.307 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T10:12:41.307 DEBUG:teuthology.orchestra.run.smithi078:> route 2023-12-12T10:12:41.362 INFO:teuthology.orchestra.run.smithi078.stdout:Kernel IP routing table 2023-12-12T10:12:41.362 INFO:teuthology.orchestra.run.smithi078.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-12T10:12:41.362 INFO:teuthology.orchestra.run.smithi078.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-12-12T10:12:41.362 INFO:teuthology.orchestra.run.smithi078.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-12T10:12:41.362 INFO:teuthology.orchestra.run.smithi078.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-12T10:12:41.362 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-12T10:12:41.363 INFO:teuthology.orchestra.run.smithi078.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-12T10:12:41.363 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-12T10:12:41.363 INFO:teuthology.orchestra.run.smithi078.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-12T10:12:41.363 INFO:teuthology.orchestra.run.smithi078.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-12T10:12:41.363 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T10:12:41.363 DEBUG:teuthology.orchestra.run.smithi078:> (cd / && exec bash -c ' 2023-12-12T10:12:41.363 DEBUG:teuthology.orchestra.run.smithi078:> set -e 2023-12-12T10:12:41.363 DEBUG:teuthology.orchestra.run.smithi078:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-12T10:12:41.363 DEBUG:teuthology.orchestra.run.smithi078:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-12T10:12:41.363 DEBUG:teuthology.orchestra.run.smithi078:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-12T10:12:41.364 DEBUG:teuthology.orchestra.run.smithi078:> ') 2023-12-12T10:12:41.458 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T10:12:41.458 DEBUG:teuthology.orchestra.run.smithi078:> ip netns list 2023-12-12T10:12:41.467 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-12T10:12:41.468 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T10:12:41.468 DEBUG:teuthology.orchestra.run.smithi078:> ip netns list-id 2023-12-12T10:12:41.520 INFO:teuthology.orchestra.run.smithi078.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-12-12T10:12:41.520 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T10:12:41.520 DEBUG:teuthology.orchestra.run.smithi078:> (cd / && exec bash -c ' 2023-12-12T10:12:41.520 DEBUG:teuthology.orchestra.run.smithi078:> set -e 2023-12-12T10:12:41.520 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-12T10:12:41.520 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-12-12T10:12:41.520 DEBUG:teuthology.orchestra.run.smithi078:> ') 2023-12-12T10:12:41.603 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T10:12:41.603 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-12-12T10:12:41.671 INFO:teuthology.orchestra.run.smithi078.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-12T10:12:41.672 INFO:teuthology.orchestra.run.smithi078.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-12T10:12:41.672 INFO:teuthology.orchestra.run.smithi078.stdout: inet 127.0.0.1/8 scope host lo 2023-12-12T10:12:41.672 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-12-12T10:12:41.672 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 ::1/128 scope host 2023-12-12T10:12:41.672 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-12-12T10:12:41.672 INFO:teuthology.orchestra.run.smithi078.stdout:2: veth0@if10: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-12T10:12:41.672 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 52:8f:91:a7:34:9b brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-12-12T10:12:41.672 INFO:teuthology.orchestra.run.smithi078.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-12-12T10:12:41.672 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-12-12T10:12:41.672 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 fe80::508f:91ff:fea7:349b/64 scope link tentative 2023-12-12T10:12:41.672 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-12-12T10:12:41.673 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T10:12:41.674 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-12-12T10:12:41.735 INFO:teuthology.orchestra.run.smithi078.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-12T10:12:41.736 INFO:teuthology.orchestra.run.smithi078.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-12T10:12:41.736 INFO:teuthology.orchestra.run.smithi078.stdout: inet 127.0.0.1/8 scope host lo 2023-12-12T10:12:41.736 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-12-12T10:12:41.736 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 ::1/128 scope host 2023-12-12T10:12:41.736 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-12-12T10:12:41.736 INFO:teuthology.orchestra.run.smithi078.stdout:2: veth0@if10: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-12T10:12:41.736 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 52:8f:91:a7:34:9b brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-12-12T10:12:41.736 INFO:teuthology.orchestra.run.smithi078.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-12-12T10:12:41.736 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-12-12T10:12:41.736 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 fe80::508f:91ff:fea7:349b/64 scope link tentative 2023-12-12T10:12:41.736 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-12-12T10:12:41.738 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-12-12T10:12:41.738 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T10:12:41.738 DEBUG:teuthology.orchestra.run.smithi078:> (cd / && exec bash -c ' 2023-12-12T10:12:41.738 DEBUG:teuthology.orchestra.run.smithi078:> set -e 2023-12-12T10:12:41.738 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-12-12T10:12:41.738 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-12-12T10:12:41.738 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-12-12T10:12:41.738 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-12-12T10:12:41.738 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-12-12T10:12:41.738 DEBUG:teuthology.orchestra.run.smithi078:> ') 2023-12-12T10:12:41.884 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T10:12:41.884 DEBUG:teuthology.orchestra.run.smithi078:> (cd / && exec bash -c ' 2023-12-12T10:12:41.884 DEBUG:teuthology.orchestra.run.smithi078:> set -e 2023-12-12T10:12:41.884 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link set brx.1 up 2023-12-12T10:12:41.884 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link set dev brx.1 master ceph-brx 2023-12-12T10:12:41.884 DEBUG:teuthology.orchestra.run.smithi078:> ') 2023-12-12T10:12:41.925 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2023-12-12T10:12:41.926 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-12T10:12:41.926 DEBUG:teuthology.orchestra.run.smithi078:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-12-12T10:12:41.979 INFO:teuthology.orchestra.run.smithi078.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-12-12T10:12:41.979 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-12T10:12:41.980 DEBUG:teuthology.orchestra.run.smithi078:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-12-12T10:12:42.031 DEBUG:teuthology.orchestra.run.smithi078:> sudo modprobe fuse 2023-12-12T10:12:42.096 DEBUG:teuthology.orchestra.run.smithi078:> cat /proc/self/mounts | awk '{print $2}' 2023-12-12T10:12:42.149 INFO:teuthology.orchestra.run.smithi078.stdout:/sys 2023-12-12T10:12:42.149 INFO:teuthology.orchestra.run.smithi078.stdout:/proc 2023-12-12T10:12:42.149 INFO:teuthology.orchestra.run.smithi078.stdout:/dev 2023-12-12T10:12:42.149 INFO:teuthology.orchestra.run.smithi078.stdout:/dev/pts 2023-12-12T10:12:42.149 INFO:teuthology.orchestra.run.smithi078.stdout:/run 2023-12-12T10:12:42.149 INFO:teuthology.orchestra.run.smithi078.stdout:/ 2023-12-12T10:12:42.149 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/kernel/security 2023-12-12T10:12:42.149 INFO:teuthology.orchestra.run.smithi078.stdout:/dev/shm 2023-12-12T10:12:42.149 INFO:teuthology.orchestra.run.smithi078.stdout:/run/lock 2023-12-12T10:12:42.149 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/fs/cgroup 2023-12-12T10:12:42.149 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/fs/pstore 2023-12-12T10:12:42.150 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/fs/bpf 2023-12-12T10:12:42.150 INFO:teuthology.orchestra.run.smithi078.stdout:/proc/sys/fs/binfmt_misc 2023-12-12T10:12:42.150 INFO:teuthology.orchestra.run.smithi078.stdout:/dev/hugepages 2023-12-12T10:12:42.150 INFO:teuthology.orchestra.run.smithi078.stdout:/dev/mqueue 2023-12-12T10:12:42.150 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/kernel/debug 2023-12-12T10:12:42.150 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/kernel/tracing 2023-12-12T10:12:42.150 INFO:teuthology.orchestra.run.smithi078.stdout:/proc/fs/nfsd 2023-12-12T10:12:42.150 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/fs/fuse/connections 2023-12-12T10:12:42.150 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/kernel/config 2023-12-12T10:12:42.150 INFO:teuthology.orchestra.run.smithi078.stdout:/run/credentials/systemd-sysusers.service 2023-12-12T10:12:42.150 INFO:teuthology.orchestra.run.smithi078.stdout:/run/rpc_pipefs 2023-12-12T10:12:42.150 INFO:teuthology.orchestra.run.smithi078.stdout:/run/user/1000 2023-12-12T10:12:42.150 INFO:teuthology.orchestra.run.smithi078.stdout:/var/lib/ceph 2023-12-12T10:12:42.150 INFO:teuthology.orchestra.run.smithi078.stdout:/var/lib/ceph/osd/ceph-0 2023-12-12T10:12:42.150 INFO:teuthology.orchestra.run.smithi078.stdout:/var/lib/ceph/osd/ceph-1 2023-12-12T10:12:42.151 INFO:teuthology.orchestra.run.smithi078.stdout:/var/lib/ceph/osd/ceph-2 2023-12-12T10:12:42.151 INFO:teuthology.orchestra.run.smithi078.stdout:/var/lib/ceph/osd/ceph-3 2023-12-12T10:12:42.151 INFO:teuthology.orchestra.run.smithi078.stdout:/run/netns 2023-12-12T10:12:42.151 INFO:teuthology.orchestra.run.smithi078.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-12T10:12:42.151 INFO:teuthology.orchestra.run.smithi078.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-12T10:12:42.151 INFO:teuthology.orchestra.run.smithi078.stdout:/home/ubuntu/cephtest/mnt.0 2023-12-12T10:12:42.151 INFO:teuthology.orchestra.run.smithi078.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-12T10:12:42.151 INFO:teuthology.orchestra.run.smithi078.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-12T10:12:42.152 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T10:12:42.152 DEBUG:teuthology.orchestra.run.smithi078:> ls /sys/fs/fuse/connections 2023-12-12T10:12:42.203 INFO:teuthology.orchestra.run.smithi078.stdout:43 2023-12-12T10:12:42.203 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [43] 2023-12-12T10:12:42.203 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.2 --id 2) 2023-12-12T10:12:42.249 DEBUG:teuthology.orchestra.run.smithi078:> sudo modprobe fuse 2023-12-12T10:12:42.272 DEBUG:teuthology.orchestra.run.smithi078:> cat /proc/self/mounts | awk '{print $2}' 2023-12-12T10:12:42.325 INFO:teuthology.orchestra.run.smithi078.stdout:/sys 2023-12-12T10:12:42.325 INFO:teuthology.orchestra.run.smithi078.stdout:/proc 2023-12-12T10:12:42.325 INFO:teuthology.orchestra.run.smithi078.stdout:/dev 2023-12-12T10:12:42.325 INFO:teuthology.orchestra.run.smithi078.stdout:/dev/pts 2023-12-12T10:12:42.325 INFO:teuthology.orchestra.run.smithi078.stdout:/run 2023-12-12T10:12:42.325 INFO:teuthology.orchestra.run.smithi078.stdout:/ 2023-12-12T10:12:42.325 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/kernel/security 2023-12-12T10:12:42.325 INFO:teuthology.orchestra.run.smithi078.stdout:/dev/shm 2023-12-12T10:12:42.325 INFO:teuthology.orchestra.run.smithi078.stdout:/run/lock 2023-12-12T10:12:42.325 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/fs/cgroup 2023-12-12T10:12:42.325 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/fs/pstore 2023-12-12T10:12:42.326 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/fs/bpf 2023-12-12T10:12:42.326 INFO:teuthology.orchestra.run.smithi078.stdout:/proc/sys/fs/binfmt_misc 2023-12-12T10:12:42.326 INFO:teuthology.orchestra.run.smithi078.stdout:/dev/hugepages 2023-12-12T10:12:42.326 INFO:teuthology.orchestra.run.smithi078.stdout:/dev/mqueue 2023-12-12T10:12:42.326 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/kernel/debug 2023-12-12T10:12:42.326 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/kernel/tracing 2023-12-12T10:12:42.326 INFO:teuthology.orchestra.run.smithi078.stdout:/proc/fs/nfsd 2023-12-12T10:12:42.326 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/fs/fuse/connections 2023-12-12T10:12:42.326 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/kernel/config 2023-12-12T10:12:42.326 INFO:teuthology.orchestra.run.smithi078.stdout:/run/credentials/systemd-sysusers.service 2023-12-12T10:12:42.326 INFO:teuthology.orchestra.run.smithi078.stdout:/run/rpc_pipefs 2023-12-12T10:12:42.326 INFO:teuthology.orchestra.run.smithi078.stdout:/run/user/1000 2023-12-12T10:12:42.326 INFO:teuthology.orchestra.run.smithi078.stdout:/var/lib/ceph 2023-12-12T10:12:42.326 INFO:teuthology.orchestra.run.smithi078.stdout:/var/lib/ceph/osd/ceph-0 2023-12-12T10:12:42.327 INFO:teuthology.orchestra.run.smithi078.stdout:/var/lib/ceph/osd/ceph-1 2023-12-12T10:12:42.327 INFO:teuthology.orchestra.run.smithi078.stdout:/var/lib/ceph/osd/ceph-2 2023-12-12T10:12:42.327 INFO:teuthology.orchestra.run.smithi078.stdout:/var/lib/ceph/osd/ceph-3 2023-12-12T10:12:42.327 INFO:teuthology.orchestra.run.smithi078.stdout:/run/netns 2023-12-12T10:12:42.327 INFO:teuthology.orchestra.run.smithi078.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-12T10:12:42.327 INFO:teuthology.orchestra.run.smithi078.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-12T10:12:42.327 INFO:teuthology.orchestra.run.smithi078.stdout:/home/ubuntu/cephtest/mnt.0 2023-12-12T10:12:42.327 INFO:teuthology.orchestra.run.smithi078.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-12T10:12:42.327 INFO:teuthology.orchestra.run.smithi078.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-12T10:12:42.328 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T10:12:42.328 DEBUG:teuthology.orchestra.run.smithi078:> ls /sys/fs/fuse/connections 2023-12-12T10:12:42.344 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi078.stderr:2023-12-12T10:12:42.342+0000 7fcb03e3a580 -1 init, newargv = 0x560a5bc72090 newargc=15 2023-12-12T10:12:42.344 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi078.stderr:ceph-fuse[46857]: starting ceph client 2023-12-12T10:12:42.351 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi078.stderr:ceph-fuse[46857]: starting fuse 2023-12-12T10:12:42.353 INFO:teuthology.orchestra.run.smithi078.stdout:43 2023-12-12T10:12:42.353 INFO:teuthology.orchestra.run.smithi078.stdout:44 2023-12-12T10:12:42.353 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43, 44] 2023-12-12T10:12:42.354 DEBUG:teuthology.orchestra.run.smithi078:> sudo stdin-killer -- python3 -c ' 2023-12-12T10:12:42.354 DEBUG:teuthology.orchestra.run.smithi078:> import glob 2023-12-12T10:12:42.354 DEBUG:teuthology.orchestra.run.smithi078:> import re 2023-12-12T10:12:42.354 DEBUG:teuthology.orchestra.run.smithi078:> import os 2023-12-12T10:12:42.354 DEBUG:teuthology.orchestra.run.smithi078:> import subprocess 2023-12-12T10:12:42.354 DEBUG:teuthology.orchestra.run.smithi078:> 2023-12-12T10:12:42.354 DEBUG:teuthology.orchestra.run.smithi078:> def _find_admin_socket(client_name): 2023-12-12T10:12:42.354 DEBUG:teuthology.orchestra.run.smithi078:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2023-12-12T10:12:42.354 DEBUG:teuthology.orchestra.run.smithi078:> files = glob.glob(asok_path) 2023-12-12T10:12:42.354 DEBUG:teuthology.orchestra.run.smithi078:> mountpoint = "/home/ubuntu/cephtest/mnt.2" 2023-12-12T10:12:42.354 DEBUG:teuthology.orchestra.run.smithi078:> 2023-12-12T10:12:42.354 DEBUG:teuthology.orchestra.run.smithi078:> # Given a non-glob path, it better be there 2023-12-12T10:12:42.354 DEBUG:teuthology.orchestra.run.smithi078:> if "*" not in asok_path: 2023-12-12T10:12:42.354 DEBUG:teuthology.orchestra.run.smithi078:> assert(len(files) == 1) 2023-12-12T10:12:42.354 DEBUG:teuthology.orchestra.run.smithi078:> return files[0] 2023-12-12T10:12:42.355 DEBUG:teuthology.orchestra.run.smithi078:> 2023-12-12T10:12:42.355 DEBUG:teuthology.orchestra.run.smithi078:> for f in files: 2023-12-12T10:12:42.355 DEBUG:teuthology.orchestra.run.smithi078:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-12T10:12:42.355 DEBUG:teuthology.orchestra.run.smithi078:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-12T10:12:42.355 DEBUG:teuthology.orchestra.run.smithi078:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-12T10:12:42.355 DEBUG:teuthology.orchestra.run.smithi078:> contents = proc_f.read() 2023-12-12T10:12:42.355 DEBUG:teuthology.orchestra.run.smithi078:> if mountpoint in contents: 2023-12-12T10:12:42.355 DEBUG:teuthology.orchestra.run.smithi078:> return f 2023-12-12T10:12:42.355 DEBUG:teuthology.orchestra.run.smithi078:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-12T10:12:42.355 DEBUG:teuthology.orchestra.run.smithi078:> 2023-12-12T10:12:42.355 DEBUG:teuthology.orchestra.run.smithi078:> print(_find_admin_socket("client.2")) 2023-12-12T10:12:42.355 DEBUG:teuthology.orchestra.run.smithi078:> ' 2023-12-12T10:12:42.475 INFO:teuthology.orchestra.run.smithi078.stdout:/var/run/ceph/ceph-client.2.46857.asok 2023-12-12T10:12:42.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:42 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-12-12T10:12:42.486 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.46857.asok 2023-12-12T10:12:42.486 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T10:12:42.486 DEBUG:teuthology.orchestra.run.smithi078:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.46857.asok status 2023-12-12T10:12:42.658 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2023-12-12T10:12:42.659 INFO:teuthology.orchestra.run.smithi078.stdout: "metadata": { 2023-12-12T10:12:42.659 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph_sha1": "f1fbf3c583d03e19f5e58eb618e78d8e10d075f9", 2023-12-12T10:12:42.659 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph_version": "ceph version 19.0.0-96-gf1fbf3c5 (f1fbf3c583d03e19f5e58eb618e78d8e10d075f9) reef (dev)", 2023-12-12T10:12:42.659 INFO:teuthology.orchestra.run.smithi078.stdout: "entity_id": "2", 2023-12-12T10:12:42.659 INFO:teuthology.orchestra.run.smithi078.stdout: "hostname": "smithi078", 2023-12-12T10:12:42.659 INFO:teuthology.orchestra.run.smithi078.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2023-12-12T10:12:42.659 INFO:teuthology.orchestra.run.smithi078.stdout: "pid": "46857", 2023-12-12T10:12:42.659 INFO:teuthology.orchestra.run.smithi078.stdout: "root": "/" 2023-12-12T10:12:42.659 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-12-12T10:12:42.659 INFO:teuthology.orchestra.run.smithi078.stdout: "dentry_count": 0, 2023-12-12T10:12:42.659 INFO:teuthology.orchestra.run.smithi078.stdout: "dentry_pinned_count": 0, 2023-12-12T10:12:42.659 INFO:teuthology.orchestra.run.smithi078.stdout: "id": 4839, 2023-12-12T10:12:42.660 INFO:teuthology.orchestra.run.smithi078.stdout: "inst": { 2023-12-12T10:12:42.660 INFO:teuthology.orchestra.run.smithi078.stdout: "name": { 2023-12-12T10:12:42.660 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "client", 2023-12-12T10:12:42.660 INFO:teuthology.orchestra.run.smithi078.stdout: "num": 4839 2023-12-12T10:12:42.660 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-12-12T10:12:42.660 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": { 2023-12-12T10:12:42.660 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v1", 2023-12-12T10:12:42.660 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "192.168.0.2:0", 2023-12-12T10:12:42.660 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 393608806 2023-12-12T10:12:42.660 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-12-12T10:12:42.660 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-12-12T10:12:42.660 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": { 2023-12-12T10:12:42.660 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v1", 2023-12-12T10:12:42.660 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "192.168.0.2:0", 2023-12-12T10:12:42.661 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 393608806 2023-12-12T10:12:42.661 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-12-12T10:12:42.661 INFO:teuthology.orchestra.run.smithi078.stdout: "inst_str": "client.4839 192.168.0.2:0/393608806", 2023-12-12T10:12:42.661 INFO:teuthology.orchestra.run.smithi078.stdout: "addr_str": "192.168.0.2:0/393608806", 2023-12-12T10:12:42.661 INFO:teuthology.orchestra.run.smithi078.stdout: "inode_count": 1, 2023-12-12T10:12:42.661 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_epoch": 9, 2023-12-12T10:12:42.661 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_epoch": 24, 2023-12-12T10:12:42.661 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_epoch_barrier": 0, 2023-12-12T10:12:42.661 INFO:teuthology.orchestra.run.smithi078.stdout: "blocklisted": false, 2023-12-12T10:12:42.661 INFO:teuthology.orchestra.run.smithi078.stdout: "fs_name": "cephfs" 2023-12-12T10:12:42.661 INFO:teuthology.orchestra.run.smithi078.stdout:} 2023-12-12T10:12:42.673 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-12T10:12:42.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:42.810+0000 7f5e718f5640 1 Processor -- start 2023-12-12T10:12:42.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:42.810+0000 7f5e718f5640 1 -- start start 2023-12-12T10:12:42.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:42.810+0000 7f5e718f5640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5e6c1607a0 0x7f5e6c06af50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:42.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:42.810+0000 7f5e718f5640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f5e6c0d3940 0x7f5e6c06b490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:42.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:42.810+0000 7f5e718f5640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e6c0d1630 con 0x7f5e6c06cda0 2023-12-12T10:12:42.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:42.810+0000 7f5e718f5640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e6c06c1a0 con 0x7f5e6c0d3940 2023-12-12T10:12:42.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:42.810+0000 7f5e718f5640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e6c0d3dd0 con 0x7f5e6c1607a0 2023-12-12T10:12:42.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:42.810+0000 7f5e6bfff640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f5e6c0d3940 0x7f5e6c06b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:42.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:42.810+0000 7f5e708f3640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5e6c1607a0 0x7f5e6c06af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:42.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:42.810+0000 7f5e6bfff640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f5e6c0d3940 0x7f5e6c06b490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.78:41916/0 (socket says 172.21.15.78:41916) 2023-12-12T10:12:42.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:42.810+0000 7f5e6bfff640 1 -- 172.21.15.78:0/1525661148 learned_addr learned my addr 172.21.15.78:0/1525661148 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:42.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:42.810+0000 7f5e710f4640 1 --1- 172.21.15.78:0/1525661148 >> v1:172.21.15.187:6789/0 conn(0x7f5e6c06cda0 0x7f5e6c0afbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.78:50268/0 (socket says 172.21.15.78:50268) 2023-12-12T10:12:42.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:42.810+0000 7f5e6bfff640 1 -- 172.21.15.78:0/1525661148 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5e6c1607a0 msgr2=0x7f5e6c06af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:42.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:42.810+0000 7f5e6bfff640 1 --2- 172.21.15.78:0/1525661148 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5e6c1607a0 0x7f5e6c06af50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:42.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:42.810+0000 7f5e6bfff640 1 -- 172.21.15.78:0/1525661148 >> v1:172.21.15.187:6789/0 conn(0x7f5e6c06cda0 legacy=0x7f5e6c0afbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:42.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:42.810+0000 7f5e6bfff640 1 -- 172.21.15.78:0/1525661148 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e6c06b9d0 con 0x7f5e6c0d3940 2023-12-12T10:12:42.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:42.810+0000 7f5e6b7fe640 1 -- 172.21.15.78:0/1525661148 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 932427506 0 0) 0x7f5e6c0d1630 con 0x7f5e6c06cda0 2023-12-12T10:12:42.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:42.814+0000 7f5e6bfff640 1 --2- 172.21.15.78:0/1525661148 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5e6c0d3940 0x7f5e6c06b490 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f5e580098a0 tx=0x7f5e5801cf80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6f5dcb6eb03813eb server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:42.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:42.814+0000 7f5e6b7fe640 1 -- 172.21.15.78:0/1525661148 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e580a7070 con 0x7f5e6c0d3940 2023-12-12T10:12:42.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:42.814+0000 7f5e6b7fe640 1 -- 172.21.15.78:0/1525661148 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e580ab430 con 0x7f5e6c0d3940 2023-12-12T10:12:42.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:42.814+0000 7f5e6b7fe640 1 -- 172.21.15.78:0/1525661148 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e580ab7c0 con 0x7f5e6c0d3940 2023-12-12T10:12:42.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:42.814+0000 7f5e718f5640 1 -- 172.21.15.78:0/1525661148 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5e6c0d3940 msgr2=0x7f5e6c06b490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:42.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:42.814+0000 7f5e718f5640 1 --2- 172.21.15.78:0/1525661148 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5e6c0d3940 0x7f5e6c06b490 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f5e580098a0 tx=0x7f5e5801cf80 comp rx=0 tx=0).stop 2023-12-12T10:12:42.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:42.814+0000 7f5e718f5640 1 -- 172.21.15.78:0/1525661148 shutdown_connections 2023-12-12T10:12:42.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:42.814+0000 7f5e718f5640 1 --2- 172.21.15.78:0/1525661148 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5e6c0d3940 0x7f5e6c06b490 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:42.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:42.814+0000 7f5e718f5640 1 --2- 172.21.15.78:0/1525661148 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5e6c1607a0 0x7f5e6c06af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:42.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:42.814+0000 7f5e718f5640 1 -- 172.21.15.78:0/1525661148 >> 172.21.15.78:0/1525661148 conn(0x7f5e6c0d2e20 msgr2=0x7f5e6c0d3230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:42.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:42.814+0000 7f5e718f5640 1 -- 172.21.15.78:0/1525661148 shutdown_connections 2023-12-12T10:12:42.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:42.814+0000 7f5e718f5640 1 -- 172.21.15.78:0/1525661148 wait complete. 2023-12-12T10:12:42.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:42.814+0000 7f5e718f5640 1 Processor -- start 2023-12-12T10:12:42.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:42.818+0000 7f5e718f5640 1 -- start start 2023-12-12T10:12:42.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:42.818+0000 7f5e718f5640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5e6c06cda0 0x7f5e6c0b83e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:42.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:42.818+0000 7f5e718f5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5e6c1607a0 0x7f5e6c159cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:42.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:42.818+0000 7f5e718f5640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5e6c155d00 0x7f5e6c157880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:42.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:42.818+0000 7f5e718f5640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e6c155b00 con 0x7f5e6c1607a0 2023-12-12T10:12:42.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:42.818+0000 7f5e718f5640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e6c15f390 con 0x7f5e6c155d00 2023-12-12T10:12:42.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:42.818+0000 7f5e718f5640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e6c15f5e0 con 0x7f5e6c06cda0 2023-12-12T10:12:42.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:42.818+0000 7f5e6bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5e6c1607a0 0x7f5e6c159cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:42.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:42.818+0000 7f5e6bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5e6c1607a0 0x7f5e6c159cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55882/0 (socket says 172.21.15.78:55882) 2023-12-12T10:12:42.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:42.818+0000 7f5e6bfff640 1 -- 172.21.15.78:0/1013859430 learned_addr learned my addr 172.21.15.78:0/1013859430 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:42.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:42.818+0000 7f5e708f3640 1 --2- 172.21.15.78:0/1013859430 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5e6c06cda0 0x7f5e6c0b83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:42.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:42.818+0000 7f5e6bfff640 1 -- 172.21.15.78:0/1013859430 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5e6c06cda0 msgr2=0x7f5e6c0b83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:42.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:42.818+0000 7f5e6bfff640 1 --2- 172.21.15.78:0/1013859430 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5e6c06cda0 0x7f5e6c0b83e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:42.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:42.818+0000 7f5e710f4640 1 --2- 172.21.15.78:0/1013859430 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5e6c155d00 0x7f5e6c157880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:42.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:42.818+0000 7f5e6bfff640 1 -- 172.21.15.78:0/1013859430 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5e6c155d00 msgr2=0x7f5e6c157880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:42.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:42.818+0000 7f5e6bfff640 1 --2- 172.21.15.78:0/1013859430 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5e6c155d00 0x7f5e6c157880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:42.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:42.818+0000 7f5e6bfff640 1 -- 172.21.15.78:0/1013859430 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e580094d0 con 0x7f5e6c1607a0 2023-12-12T10:12:42.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:42.818+0000 7f5e6bfff640 1 --2- 172.21.15.78:0/1013859430 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5e6c1607a0 0x7f5e6c159cd0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f5e580ad040 tx=0x7f5e580192c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:42.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:42.818+0000 7f5e697fa640 1 -- 172.21.15.78:0/1013859430 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e580ba070 con 0x7f5e6c1607a0 2023-12-12T10:12:42.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:42.818+0000 7f5e697fa640 1 -- 172.21.15.78:0/1013859430 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e580b4420 con 0x7f5e6c1607a0 2023-12-12T10:12:42.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:42.818+0000 7f5e697fa640 1 -- 172.21.15.78:0/1013859430 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e580b47f0 con 0x7f5e6c1607a0 2023-12-12T10:12:42.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:42.818+0000 7f5e718f5640 1 -- 172.21.15.78:0/1013859430 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e6c15f8c0 con 0x7f5e6c1607a0 2023-12-12T10:12:42.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:42.818+0000 7f5e718f5640 1 -- 172.21.15.78:0/1013859430 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e6c15a210 con 0x7f5e6c1607a0 2023-12-12T10:12:42.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:42.818+0000 7f5e718f5640 1 -- 172.21.15.78:0/1013859430 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e6c15a400 con 0x7f5e6c1607a0 2023-12-12T10:12:42.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:42.822+0000 7f5e697fa640 1 -- 172.21.15.78:0/1013859430 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5e580b4950 con 0x7f5e6c1607a0 2023-12-12T10:12:42.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:42.822+0000 7f5e697fa640 1 --2- 172.21.15.78:0/1013859430 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f5e50066470 0x7f5e50068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:42.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:42.822+0000 7f5e697fa640 1 -- 172.21.15.78:0/1013859430 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5e5811db20 con 0x7f5e6c1607a0 2023-12-12T10:12:42.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:42.822+0000 7f5e708f3640 1 --2- 172.21.15.78:0/1013859430 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f5e50066470 0x7f5e50068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:42.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:42.822+0000 7f5e708f3640 1 --2- 172.21.15.78:0/1013859430 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f5e50066470 0x7f5e50068930 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f5e60009990 tx=0x7f5e60008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:42.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:42.826+0000 7f5e697fa640 1 -- 172.21.15.78:0/1013859430 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5e6c15a400 con 0x7f5e6c1607a0 2023-12-12T10:12:43.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:43.010+0000 7f5e718f5640 1 -- 172.21.15.78:0/1013859430 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f5e6c0b6450 con 0x7f5e6c1607a0 2023-12-12T10:12:43.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:43.014+0000 7f5e697fa640 1 -- 172.21.15.78:0/1013859430 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f5e6c0b6450 con 0x7f5e6c1607a0 2023-12-12T10:12:43.015 INFO:teuthology.orchestra.run.smithi078.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-12-12T10:12:43.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:43.014+0000 7f5e718f5640 1 -- 172.21.15.78:0/1013859430 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f5e50066470 msgr2=0x7f5e50068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:43.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:43.014+0000 7f5e718f5640 1 --2- 172.21.15.78:0/1013859430 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f5e50066470 0x7f5e50068930 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f5e60009990 tx=0x7f5e60008040 comp rx=0 tx=0).stop 2023-12-12T10:12:43.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:43.014+0000 7f5e718f5640 1 -- 172.21.15.78:0/1013859430 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5e6c1607a0 msgr2=0x7f5e6c159cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:43.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:43.014+0000 7f5e718f5640 1 --2- 172.21.15.78:0/1013859430 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5e6c1607a0 0x7f5e6c159cd0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f5e580ad040 tx=0x7f5e580192c0 comp rx=0 tx=0).stop 2023-12-12T10:12:43.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:43.014+0000 7f5e718f5640 1 -- 172.21.15.78:0/1013859430 shutdown_connections 2023-12-12T10:12:43.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:43.014+0000 7f5e718f5640 1 --2- 172.21.15.78:0/1013859430 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f5e50066470 0x7f5e50068930 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:43.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:43.014+0000 7f5e718f5640 1 --2- 172.21.15.78:0/1013859430 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5e6c155d00 0x7f5e6c157880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:43.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:43.014+0000 7f5e718f5640 1 --2- 172.21.15.78:0/1013859430 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5e6c1607a0 0x7f5e6c159cd0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:43.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:43.014+0000 7f5e718f5640 1 --2- 172.21.15.78:0/1013859430 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5e6c06cda0 0x7f5e6c0b83e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:43.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:43.014+0000 7f5e718f5640 1 -- 172.21.15.78:0/1013859430 >> 172.21.15.78:0/1013859430 conn(0x7f5e6c0d2e20 msgr2=0x7f5e6c0ce460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:43.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:43.014+0000 7f5e718f5640 1 -- 172.21.15.78:0/1013859430 shutdown_connections 2023-12-12T10:12:43.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:43.014+0000 7f5e718f5640 1 -- 172.21.15.78:0/1013859430 wait complete. 2023-12-12T10:12:43.036 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-12T10:12:43.036 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-12T10:12:43.036 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi187.front.sepia.ceph.com 2023-12-12T10:12:43.036 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-12-12T10:12:43.036 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-12T10:12:43.036 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-12T10:12:43.036 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-12T10:12:43.036 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-12T10:12:43.036 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-12T10:12:43.036 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T10:12:43.036 DEBUG:teuthology.orchestra.run.smithi187:> ip addr 2023-12-12T10:12:43.046 INFO:teuthology.orchestra.run.smithi187.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-12T10:12:43.046 INFO:teuthology.orchestra.run.smithi187.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-12T10:12:43.047 INFO:teuthology.orchestra.run.smithi187.stdout: inet 127.0.0.1/8 scope host lo 2023-12-12T10:12:43.047 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-12-12T10:12:43.047 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 ::1/128 scope host 2023-12-12T10:12:43.047 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-12-12T10:12:43.047 INFO:teuthology.orchestra.run.smithi187.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-12T10:12:43.047 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:d9:36:78 brd ff:ff:ff:ff:ff:ff 2023-12-12T10:12:43.047 INFO:teuthology.orchestra.run.smithi187.stdout: altname enp7s0f0 2023-12-12T10:12:43.047 INFO:teuthology.orchestra.run.smithi187.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-12T10:12:43.047 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:d9:36:79 brd ff:ff:ff:ff:ff:ff 2023-12-12T10:12:43.047 INFO:teuthology.orchestra.run.smithi187.stdout: altname enp7s0f1 2023-12-12T10:12:43.047 INFO:teuthology.orchestra.run.smithi187.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-12T10:12:43.047 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:88:77:b0 brd ff:ff:ff:ff:ff:ff 2023-12-12T10:12:43.047 INFO:teuthology.orchestra.run.smithi187.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-12T10:12:43.048 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:88:77:b1 brd ff:ff:ff:ff:ff:ff 2023-12-12T10:12:43.048 INFO:teuthology.orchestra.run.smithi187.stdout: inet 172.21.15.187/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-12-12T10:12:43.048 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft 42370sec preferred_lft 42370sec 2023-12-12T10:12:43.048 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 fe80::ec4:7aff:fe88:77b1/64 scope link 2023-12-12T10:12:43.048 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-12-12T10:12:43.048 INFO:teuthology.orchestra.run.smithi187.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-12T10:12:43.048 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 02:42:61:fd:6e:8d brd ff:ff:ff:ff:ff:ff 2023-12-12T10:12:43.048 INFO:teuthology.orchestra.run.smithi187.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-12T10:12:43.048 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-12-12T10:12:43.049 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-12-12T10:12:43.049 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T10:12:43.049 DEBUG:teuthology.orchestra.run.smithi187:> (cd / && exec bash -c ' 2023-12-12T10:12:43.049 DEBUG:teuthology.orchestra.run.smithi187:> set -e 2023-12-12T10:12:43.049 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip link add name ceph-brx type bridge 2023-12-12T10:12:43.049 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip addr flush dev ceph-brx 2023-12-12T10:12:43.050 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip link set ceph-brx up 2023-12-12T10:12:43.050 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-12-12T10:12:43.050 DEBUG:teuthology.orchestra.run.smithi187:> ') 2023-12-12T10:12:43.167 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T10:12:43.167 DEBUG:teuthology.orchestra.run.smithi187:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-12T10:12:43.186 INFO:teuthology.orchestra.run.smithi187.stdout:1 2023-12-12T10:12:43.188 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T10:12:43.189 DEBUG:teuthology.orchestra.run.smithi187:> route 2023-12-12T10:12:43.259 INFO:teuthology.orchestra.run.smithi187.stdout:Kernel IP routing table 2023-12-12T10:12:43.259 INFO:teuthology.orchestra.run.smithi187.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-12T10:12:43.259 INFO:teuthology.orchestra.run.smithi187.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-12-12T10:12:43.259 INFO:teuthology.orchestra.run.smithi187.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-12T10:12:43.259 INFO:teuthology.orchestra.run.smithi187.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-12T10:12:43.259 INFO:teuthology.orchestra.run.smithi187.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-12T10:12:43.259 INFO:teuthology.orchestra.run.smithi187.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-12T10:12:43.259 INFO:teuthology.orchestra.run.smithi187.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-12T10:12:43.260 INFO:teuthology.orchestra.run.smithi187.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-12T10:12:43.260 INFO:teuthology.orchestra.run.smithi187.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-12T10:12:43.260 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T10:12:43.260 DEBUG:teuthology.orchestra.run.smithi187:> (cd / && exec bash -c ' 2023-12-12T10:12:43.260 DEBUG:teuthology.orchestra.run.smithi187:> set -e 2023-12-12T10:12:43.260 DEBUG:teuthology.orchestra.run.smithi187:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-12T10:12:43.260 DEBUG:teuthology.orchestra.run.smithi187:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-12T10:12:43.261 DEBUG:teuthology.orchestra.run.smithi187:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-12T10:12:43.261 DEBUG:teuthology.orchestra.run.smithi187:> ') 2023-12-12T10:12:43.351 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T10:12:43.351 DEBUG:teuthology.orchestra.run.smithi187:> ip netns list 2023-12-12T10:12:43.362 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T10:12:43.362 DEBUG:teuthology.orchestra.run.smithi187:> ip netns list-id 2023-12-12T10:12:43.414 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T10:12:43.414 DEBUG:teuthology.orchestra.run.smithi187:> (cd / && exec bash -c ' 2023-12-12T10:12:43.414 DEBUG:teuthology.orchestra.run.smithi187:> set -e 2023-12-12T10:12:43.414 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-12T10:12:43.414 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-12-12T10:12:43.414 DEBUG:teuthology.orchestra.run.smithi187:> ') 2023-12-12T10:12:43.498 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-12-12T10:12:43.498 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T10:12:43.498 DEBUG:teuthology.orchestra.run.smithi187:> (cd / && exec bash -c ' 2023-12-12T10:12:43.498 DEBUG:teuthology.orchestra.run.smithi187:> set -e 2023-12-12T10:12:43.499 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-12-12T10:12:43.499 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-12-12T10:12:43.499 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-12-12T10:12:43.499 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-12-12T10:12:43.499 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-12-12T10:12:43.499 DEBUG:teuthology.orchestra.run.smithi187:> ') 2023-12-12T10:12:43.665 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T10:12:43.665 DEBUG:teuthology.orchestra.run.smithi187:> (cd / && exec bash -c ' 2023-12-12T10:12:43.665 DEBUG:teuthology.orchestra.run.smithi187:> set -e 2023-12-12T10:12:43.665 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip link set brx.0 up 2023-12-12T10:12:43.665 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip link set dev brx.0 master ceph-brx 2023-12-12T10:12:43.665 DEBUG:teuthology.orchestra.run.smithi187:> ') 2023-12-12T10:12:43.706 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-12-12T10:12:43.706 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-12T10:12:43.706 DEBUG:teuthology.orchestra.run.smithi187:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-12T10:12:43.757 INFO:teuthology.orchestra.run.smithi187.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-12T10:12:43.758 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-12T10:12:43.758 DEBUG:teuthology.orchestra.run.smithi187:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-12T10:12:43.809 DEBUG:teuthology.orchestra.run.smithi187:> sudo modprobe fuse 2023-12-12T10:12:43.870 DEBUG:teuthology.orchestra.run.smithi187:> cat /proc/self/mounts | awk '{print $2}' 2023-12-12T10:12:43.923 INFO:teuthology.orchestra.run.smithi187.stdout:/sys 2023-12-12T10:12:43.924 INFO:teuthology.orchestra.run.smithi187.stdout:/proc 2023-12-12T10:12:43.924 INFO:teuthology.orchestra.run.smithi187.stdout:/dev 2023-12-12T10:12:43.924 INFO:teuthology.orchestra.run.smithi187.stdout:/dev/pts 2023-12-12T10:12:43.924 INFO:teuthology.orchestra.run.smithi187.stdout:/run 2023-12-12T10:12:43.924 INFO:teuthology.orchestra.run.smithi187.stdout:/ 2023-12-12T10:12:43.924 INFO:teuthology.orchestra.run.smithi187.stdout:/sys/kernel/security 2023-12-12T10:12:43.924 INFO:teuthology.orchestra.run.smithi187.stdout:/dev/shm 2023-12-12T10:12:43.924 INFO:teuthology.orchestra.run.smithi187.stdout:/run/lock 2023-12-12T10:12:43.924 INFO:teuthology.orchestra.run.smithi187.stdout:/sys/fs/cgroup 2023-12-12T10:12:43.924 INFO:teuthology.orchestra.run.smithi187.stdout:/sys/fs/pstore 2023-12-12T10:12:43.924 INFO:teuthology.orchestra.run.smithi187.stdout:/sys/fs/bpf 2023-12-12T10:12:43.924 INFO:teuthology.orchestra.run.smithi187.stdout:/proc/sys/fs/binfmt_misc 2023-12-12T10:12:43.924 INFO:teuthology.orchestra.run.smithi187.stdout:/dev/hugepages 2023-12-12T10:12:43.925 INFO:teuthology.orchestra.run.smithi187.stdout:/dev/mqueue 2023-12-12T10:12:43.925 INFO:teuthology.orchestra.run.smithi187.stdout:/sys/kernel/debug 2023-12-12T10:12:43.925 INFO:teuthology.orchestra.run.smithi187.stdout:/sys/kernel/tracing 2023-12-12T10:12:43.925 INFO:teuthology.orchestra.run.smithi187.stdout:/proc/fs/nfsd 2023-12-12T10:12:43.925 INFO:teuthology.orchestra.run.smithi187.stdout:/sys/fs/fuse/connections 2023-12-12T10:12:43.925 INFO:teuthology.orchestra.run.smithi187.stdout:/sys/kernel/config 2023-12-12T10:12:43.925 INFO:teuthology.orchestra.run.smithi187.stdout:/run/credentials/systemd-sysusers.service 2023-12-12T10:12:43.925 INFO:teuthology.orchestra.run.smithi187.stdout:/run/rpc_pipefs 2023-12-12T10:12:43.925 INFO:teuthology.orchestra.run.smithi187.stdout:/run/user/1000 2023-12-12T10:12:43.925 INFO:teuthology.orchestra.run.smithi187.stdout:/var/lib/ceph 2023-12-12T10:12:43.925 INFO:teuthology.orchestra.run.smithi187.stdout:/var/lib/ceph/osd/ceph-4 2023-12-12T10:12:43.925 INFO:teuthology.orchestra.run.smithi187.stdout:/var/lib/ceph/osd/ceph-5 2023-12-12T10:12:43.925 INFO:teuthology.orchestra.run.smithi187.stdout:/var/lib/ceph/osd/ceph-6 2023-12-12T10:12:43.926 INFO:teuthology.orchestra.run.smithi187.stdout:/var/lib/ceph/osd/ceph-7 2023-12-12T10:12:43.926 INFO:teuthology.orchestra.run.smithi187.stdout:/run/netns 2023-12-12T10:12:43.926 INFO:teuthology.orchestra.run.smithi187.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-12T10:12:43.926 INFO:teuthology.orchestra.run.smithi187.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-12T10:12:43.927 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T10:12:43.927 DEBUG:teuthology.orchestra.run.smithi187:> ls /sys/fs/fuse/connections 2023-12-12T10:12:43.978 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-12-12T10:12:43.978 DEBUG:teuthology.orchestra.run.smithi187:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-12-12T10:12:44.024 DEBUG:teuthology.orchestra.run.smithi187:> sudo modprobe fuse 2023-12-12T10:12:44.045 DEBUG:teuthology.orchestra.run.smithi187:> cat /proc/self/mounts | awk '{print $2}' 2023-12-12T10:12:44.103 INFO:teuthology.orchestra.run.smithi187.stdout:/sys 2023-12-12T10:12:44.103 INFO:teuthology.orchestra.run.smithi187.stdout:/proc 2023-12-12T10:12:44.103 INFO:teuthology.orchestra.run.smithi187.stdout:/dev 2023-12-12T10:12:44.103 INFO:teuthology.orchestra.run.smithi187.stdout:/dev/pts 2023-12-12T10:12:44.103 INFO:teuthology.orchestra.run.smithi187.stdout:/run 2023-12-12T10:12:44.103 INFO:teuthology.orchestra.run.smithi187.stdout:/ 2023-12-12T10:12:44.103 INFO:teuthology.orchestra.run.smithi187.stdout:/sys/kernel/security 2023-12-12T10:12:44.103 INFO:teuthology.orchestra.run.smithi187.stdout:/dev/shm 2023-12-12T10:12:44.104 INFO:teuthology.orchestra.run.smithi187.stdout:/run/lock 2023-12-12T10:12:44.104 INFO:teuthology.orchestra.run.smithi187.stdout:/sys/fs/cgroup 2023-12-12T10:12:44.104 INFO:teuthology.orchestra.run.smithi187.stdout:/sys/fs/pstore 2023-12-12T10:12:44.104 INFO:teuthology.orchestra.run.smithi187.stdout:/sys/fs/bpf 2023-12-12T10:12:44.104 INFO:teuthology.orchestra.run.smithi187.stdout:/proc/sys/fs/binfmt_misc 2023-12-12T10:12:44.104 INFO:teuthology.orchestra.run.smithi187.stdout:/dev/hugepages 2023-12-12T10:12:44.104 INFO:teuthology.orchestra.run.smithi187.stdout:/dev/mqueue 2023-12-12T10:12:44.104 INFO:teuthology.orchestra.run.smithi187.stdout:/sys/kernel/debug 2023-12-12T10:12:44.104 INFO:teuthology.orchestra.run.smithi187.stdout:/sys/kernel/tracing 2023-12-12T10:12:44.104 INFO:teuthology.orchestra.run.smithi187.stdout:/proc/fs/nfsd 2023-12-12T10:12:44.104 INFO:teuthology.orchestra.run.smithi187.stdout:/sys/fs/fuse/connections 2023-12-12T10:12:44.104 INFO:teuthology.orchestra.run.smithi187.stdout:/sys/kernel/config 2023-12-12T10:12:44.104 INFO:teuthology.orchestra.run.smithi187.stdout:/run/credentials/systemd-sysusers.service 2023-12-12T10:12:44.104 INFO:teuthology.orchestra.run.smithi187.stdout:/run/rpc_pipefs 2023-12-12T10:12:44.104 INFO:teuthology.orchestra.run.smithi187.stdout:/run/user/1000 2023-12-12T10:12:44.105 INFO:teuthology.orchestra.run.smithi187.stdout:/var/lib/ceph 2023-12-12T10:12:44.105 INFO:teuthology.orchestra.run.smithi187.stdout:/var/lib/ceph/osd/ceph-4 2023-12-12T10:12:44.105 INFO:teuthology.orchestra.run.smithi187.stdout:/var/lib/ceph/osd/ceph-5 2023-12-12T10:12:44.105 INFO:teuthology.orchestra.run.smithi187.stdout:/var/lib/ceph/osd/ceph-6 2023-12-12T10:12:44.105 INFO:teuthology.orchestra.run.smithi187.stdout:/var/lib/ceph/osd/ceph-7 2023-12-12T10:12:44.105 INFO:teuthology.orchestra.run.smithi187.stdout:/run/netns 2023-12-12T10:12:44.105 INFO:teuthology.orchestra.run.smithi187.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-12T10:12:44.105 INFO:teuthology.orchestra.run.smithi187.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-12T10:12:44.106 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T10:12:44.106 DEBUG:teuthology.orchestra.run.smithi187:> ls /sys/fs/fuse/connections 2023-12-12T10:12:44.129 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi187.stderr:2023-12-12T10:12:44.120+0000 7ff5f0d09580 -1 init, newargv = 0x55993e972460 newargc=15 2023-12-12T10:12:44.130 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi187.stderr:ceph-fuse[44038]: starting ceph client 2023-12-12T10:12:44.138 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi187.stderr:ceph-fuse[44038]: starting fuse 2023-12-12T10:12:45.240 DEBUG:teuthology.orchestra.run.smithi187:> sudo modprobe fuse 2023-12-12T10:12:45.264 DEBUG:teuthology.orchestra.run.smithi187:> cat /proc/self/mounts | awk '{print $2}' 2023-12-12T10:12:45.320 INFO:teuthology.orchestra.run.smithi187.stdout:/sys 2023-12-12T10:12:45.320 INFO:teuthology.orchestra.run.smithi187.stdout:/proc 2023-12-12T10:12:45.320 INFO:teuthology.orchestra.run.smithi187.stdout:/dev 2023-12-12T10:12:45.320 INFO:teuthology.orchestra.run.smithi187.stdout:/dev/pts 2023-12-12T10:12:45.320 INFO:teuthology.orchestra.run.smithi187.stdout:/run 2023-12-12T10:12:45.320 INFO:teuthology.orchestra.run.smithi187.stdout:/ 2023-12-12T10:12:45.320 INFO:teuthology.orchestra.run.smithi187.stdout:/sys/kernel/security 2023-12-12T10:12:45.320 INFO:teuthology.orchestra.run.smithi187.stdout:/dev/shm 2023-12-12T10:12:45.320 INFO:teuthology.orchestra.run.smithi187.stdout:/run/lock 2023-12-12T10:12:45.321 INFO:teuthology.orchestra.run.smithi187.stdout:/sys/fs/cgroup 2023-12-12T10:12:45.321 INFO:teuthology.orchestra.run.smithi187.stdout:/sys/fs/pstore 2023-12-12T10:12:45.321 INFO:teuthology.orchestra.run.smithi187.stdout:/sys/fs/bpf 2023-12-12T10:12:45.321 INFO:teuthology.orchestra.run.smithi187.stdout:/proc/sys/fs/binfmt_misc 2023-12-12T10:12:45.321 INFO:teuthology.orchestra.run.smithi187.stdout:/dev/hugepages 2023-12-12T10:12:45.321 INFO:teuthology.orchestra.run.smithi187.stdout:/dev/mqueue 2023-12-12T10:12:45.321 INFO:teuthology.orchestra.run.smithi187.stdout:/sys/kernel/debug 2023-12-12T10:12:45.321 INFO:teuthology.orchestra.run.smithi187.stdout:/sys/kernel/tracing 2023-12-12T10:12:45.321 INFO:teuthology.orchestra.run.smithi187.stdout:/proc/fs/nfsd 2023-12-12T10:12:45.321 INFO:teuthology.orchestra.run.smithi187.stdout:/sys/fs/fuse/connections 2023-12-12T10:12:45.321 INFO:teuthology.orchestra.run.smithi187.stdout:/sys/kernel/config 2023-12-12T10:12:45.322 INFO:teuthology.orchestra.run.smithi187.stdout:/run/credentials/systemd-sysusers.service 2023-12-12T10:12:45.322 INFO:teuthology.orchestra.run.smithi187.stdout:/run/rpc_pipefs 2023-12-12T10:12:45.322 INFO:teuthology.orchestra.run.smithi187.stdout:/run/user/1000 2023-12-12T10:12:45.322 INFO:teuthology.orchestra.run.smithi187.stdout:/var/lib/ceph 2023-12-12T10:12:45.322 INFO:teuthology.orchestra.run.smithi187.stdout:/var/lib/ceph/osd/ceph-4 2023-12-12T10:12:45.322 INFO:teuthology.orchestra.run.smithi187.stdout:/var/lib/ceph/osd/ceph-5 2023-12-12T10:12:45.322 INFO:teuthology.orchestra.run.smithi187.stdout:/var/lib/ceph/osd/ceph-6 2023-12-12T10:12:45.322 INFO:teuthology.orchestra.run.smithi187.stdout:/var/lib/ceph/osd/ceph-7 2023-12-12T10:12:45.322 INFO:teuthology.orchestra.run.smithi187.stdout:/run/netns 2023-12-12T10:12:45.322 INFO:teuthology.orchestra.run.smithi187.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-12T10:12:45.323 INFO:teuthology.orchestra.run.smithi187.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-12T10:12:45.323 INFO:teuthology.orchestra.run.smithi187.stdout:/home/ubuntu/cephtest/mnt.1 2023-12-12T10:12:45.324 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T10:12:45.325 DEBUG:teuthology.orchestra.run.smithi187:> ls /sys/fs/fuse/connections 2023-12-12T10:12:45.374 INFO:teuthology.orchestra.run.smithi187.stdout:43 2023-12-12T10:12:45.375 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2023-12-12T10:12:45.375 DEBUG:teuthology.orchestra.run.smithi187:> sudo stdin-killer -- python3 -c ' 2023-12-12T10:12:45.375 DEBUG:teuthology.orchestra.run.smithi187:> import glob 2023-12-12T10:12:45.375 DEBUG:teuthology.orchestra.run.smithi187:> import re 2023-12-12T10:12:45.375 DEBUG:teuthology.orchestra.run.smithi187:> import os 2023-12-12T10:12:45.375 DEBUG:teuthology.orchestra.run.smithi187:> import subprocess 2023-12-12T10:12:45.376 DEBUG:teuthology.orchestra.run.smithi187:> 2023-12-12T10:12:45.376 DEBUG:teuthology.orchestra.run.smithi187:> def _find_admin_socket(client_name): 2023-12-12T10:12:45.376 DEBUG:teuthology.orchestra.run.smithi187:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-12-12T10:12:45.376 DEBUG:teuthology.orchestra.run.smithi187:> files = glob.glob(asok_path) 2023-12-12T10:12:45.376 DEBUG:teuthology.orchestra.run.smithi187:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-12-12T10:12:45.376 DEBUG:teuthology.orchestra.run.smithi187:> 2023-12-12T10:12:45.376 DEBUG:teuthology.orchestra.run.smithi187:> # Given a non-glob path, it better be there 2023-12-12T10:12:45.376 DEBUG:teuthology.orchestra.run.smithi187:> if "*" not in asok_path: 2023-12-12T10:12:45.376 DEBUG:teuthology.orchestra.run.smithi187:> assert(len(files) == 1) 2023-12-12T10:12:45.376 DEBUG:teuthology.orchestra.run.smithi187:> return files[0] 2023-12-12T10:12:45.376 DEBUG:teuthology.orchestra.run.smithi187:> 2023-12-12T10:12:45.376 DEBUG:teuthology.orchestra.run.smithi187:> for f in files: 2023-12-12T10:12:45.376 DEBUG:teuthology.orchestra.run.smithi187:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-12T10:12:45.376 DEBUG:teuthology.orchestra.run.smithi187:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-12T10:12:45.377 DEBUG:teuthology.orchestra.run.smithi187:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-12T10:12:45.377 DEBUG:teuthology.orchestra.run.smithi187:> contents = proc_f.read() 2023-12-12T10:12:45.377 DEBUG:teuthology.orchestra.run.smithi187:> if mountpoint in contents: 2023-12-12T10:12:45.377 DEBUG:teuthology.orchestra.run.smithi187:> return f 2023-12-12T10:12:45.377 DEBUG:teuthology.orchestra.run.smithi187:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-12T10:12:45.377 DEBUG:teuthology.orchestra.run.smithi187:> 2023-12-12T10:12:45.377 DEBUG:teuthology.orchestra.run.smithi187:> print(_find_admin_socket("client.1")) 2023-12-12T10:12:45.377 DEBUG:teuthology.orchestra.run.smithi187:> ' 2023-12-12T10:12:45.505 INFO:teuthology.orchestra.run.smithi187.stdout:/var/run/ceph/ceph-client.1.44038.asok 2023-12-12T10:12:45.509 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:12:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-12-12T10:12:45.518 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.44038.asok 2023-12-12T10:12:45.518 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T10:12:45.518 DEBUG:teuthology.orchestra.run.smithi187:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.44038.asok status 2023-12-12T10:12:45.692 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2023-12-12T10:12:45.692 INFO:teuthology.orchestra.run.smithi187.stdout: "metadata": { 2023-12-12T10:12:45.692 INFO:teuthology.orchestra.run.smithi187.stdout: "ceph_sha1": "f1fbf3c583d03e19f5e58eb618e78d8e10d075f9", 2023-12-12T10:12:45.692 INFO:teuthology.orchestra.run.smithi187.stdout: "ceph_version": "ceph version 19.0.0-96-gf1fbf3c5 (f1fbf3c583d03e19f5e58eb618e78d8e10d075f9) reef (dev)", 2023-12-12T10:12:45.692 INFO:teuthology.orchestra.run.smithi187.stdout: "entity_id": "1", 2023-12-12T10:12:45.692 INFO:teuthology.orchestra.run.smithi187.stdout: "hostname": "smithi187", 2023-12-12T10:12:45.692 INFO:teuthology.orchestra.run.smithi187.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-12-12T10:12:45.693 INFO:teuthology.orchestra.run.smithi187.stdout: "pid": "44038", 2023-12-12T10:12:45.693 INFO:teuthology.orchestra.run.smithi187.stdout: "root": "/" 2023-12-12T10:12:45.693 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-12-12T10:12:45.693 INFO:teuthology.orchestra.run.smithi187.stdout: "dentry_count": 0, 2023-12-12T10:12:45.693 INFO:teuthology.orchestra.run.smithi187.stdout: "dentry_pinned_count": 0, 2023-12-12T10:12:45.693 INFO:teuthology.orchestra.run.smithi187.stdout: "id": 4828, 2023-12-12T10:12:45.693 INFO:teuthology.orchestra.run.smithi187.stdout: "inst": { 2023-12-12T10:12:45.693 INFO:teuthology.orchestra.run.smithi187.stdout: "name": { 2023-12-12T10:12:45.693 INFO:teuthology.orchestra.run.smithi187.stdout: "type": "client", 2023-12-12T10:12:45.693 INFO:teuthology.orchestra.run.smithi187.stdout: "num": 4828 2023-12-12T10:12:45.693 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-12-12T10:12:45.693 INFO:teuthology.orchestra.run.smithi187.stdout: "addr": { 2023-12-12T10:12:45.693 INFO:teuthology.orchestra.run.smithi187.stdout: "type": "v1", 2023-12-12T10:12:45.693 INFO:teuthology.orchestra.run.smithi187.stdout: "addr": "192.168.0.1:0", 2023-12-12T10:12:45.693 INFO:teuthology.orchestra.run.smithi187.stdout: "nonce": 706532324 2023-12-12T10:12:45.694 INFO:teuthology.orchestra.run.smithi187.stdout: } 2023-12-12T10:12:45.694 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-12-12T10:12:45.694 INFO:teuthology.orchestra.run.smithi187.stdout: "addr": { 2023-12-12T10:12:45.694 INFO:teuthology.orchestra.run.smithi187.stdout: "type": "v1", 2023-12-12T10:12:45.694 INFO:teuthology.orchestra.run.smithi187.stdout: "addr": "192.168.0.1:0", 2023-12-12T10:12:45.694 INFO:teuthology.orchestra.run.smithi187.stdout: "nonce": 706532324 2023-12-12T10:12:45.694 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-12-12T10:12:45.694 INFO:teuthology.orchestra.run.smithi187.stdout: "inst_str": "client.4828 192.168.0.1:0/706532324", 2023-12-12T10:12:45.694 INFO:teuthology.orchestra.run.smithi187.stdout: "addr_str": "192.168.0.1:0/706532324", 2023-12-12T10:12:45.694 INFO:teuthology.orchestra.run.smithi187.stdout: "inode_count": 1, 2023-12-12T10:12:45.694 INFO:teuthology.orchestra.run.smithi187.stdout: "mds_epoch": 9, 2023-12-12T10:12:45.694 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_epoch": 24, 2023-12-12T10:12:45.694 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_epoch_barrier": 0, 2023-12-12T10:12:45.695 INFO:teuthology.orchestra.run.smithi187.stdout: "blocklisted": false, 2023-12-12T10:12:45.695 INFO:teuthology.orchestra.run.smithi187.stdout: "fs_name": "cephfs" 2023-12-12T10:12:45.695 INFO:teuthology.orchestra.run.smithi187.stdout:} 2023-12-12T10:12:45.707 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-12T10:12:45.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:45.850+0000 7fd7da5aa640 1 Processor -- start 2023-12-12T10:12:45.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:45.850+0000 7fd7da5aa640 1 -- start start 2023-12-12T10:12:45.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:45.854+0000 7fd7da5aa640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fd7d41621a0 0x7fd7d4162620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:45.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:45.854+0000 7fd7da5aa640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd7d4070250 0x7fd7d40706e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:45.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:45.854+0000 7fd7da5aa640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7d40b20e0 con 0x7fd7d40b3880 2023-12-12T10:12:45.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:45.854+0000 7fd7da5aa640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7d40b23c0 con 0x7fd7d41621a0 2023-12-12T10:12:45.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:45.854+0000 7fd7da5aa640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7d40b26a0 con 0x7fd7d4070250 2023-12-12T10:12:45.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:45.854+0000 7fd7d37fe640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fd7d41621a0 0x7fd7d4162620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:45.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:45.854+0000 7fd7d8b47640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd7d4070250 0x7fd7d40706e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:45.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:45.854+0000 7fd7d3fff640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7fd7d40b3880 0x7fd7d40b3c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.78:50274/0 (socket says 172.21.15.78:50274) 2023-12-12T10:12:45.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:45.854+0000 7fd7d3fff640 1 -- 172.21.15.78:0/3488359726 learned_addr learned my addr 172.21.15.78:0/3488359726 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-12-12T10:12:45.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:45.854+0000 7fd7d2ffd640 1 -- 172.21.15.78:0/3488359726 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1936305986 0 0) 0x7fd7d40b20e0 con 0x7fd7d40b3880 2023-12-12T10:12:45.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:45.854+0000 7fd7d2ffd640 1 -- 172.21.15.78:0/3488359726 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7bc003530 con 0x7fd7d40b3880 2023-12-12T10:12:45.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:45.854+0000 7fd7d8b47640 1 -- 172.21.15.78:0/3488359726 >> v2:172.21.15.187:3300/0 conn(0x7fd7d41621a0 msgr2=0x7fd7d4162620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:45.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:45.854+0000 7fd7d8b47640 1 --2- 172.21.15.78:0/3488359726 >> v2:172.21.15.187:3300/0 conn(0x7fd7d41621a0 0x7fd7d4162620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:45.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:45.854+0000 7fd7d8b47640 1 -- 172.21.15.78:0/3488359726 >> v1:172.21.15.187:6789/0 conn(0x7fd7d40b3880 legacy=0x7fd7d40b3c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:45.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:45.854+0000 7fd7d8b47640 1 -- 172.21.15.78:0/3488359726 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7d40b2980 con 0x7fd7d4070250 2023-12-12T10:12:45.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:45.854+0000 7fd7d37fe640 1 --2- 172.21.15.78:0/3488359726 >> v2:172.21.15.187:3300/0 conn(0x7fd7d41621a0 0x7fd7d4162620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-12T10:12:45.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:45.858+0000 7fd7d8b47640 1 --2- 172.21.15.78:0/3488359726 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd7d4070250 0x7fd7d40706e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd7cc009d90 tx=0x7fd7cc01c770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d534a57611e6a14b server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:45.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:45.858+0000 7fd7d2ffd640 1 -- 172.21.15.78:0/3488359726 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7cc0a66d0 con 0x7fd7d4070250 2023-12-12T10:12:45.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:45.858+0000 7fd7d2ffd640 1 -- 172.21.15.78:0/3488359726 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7cc0a6830 con 0x7fd7d4070250 2023-12-12T10:12:45.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:45.858+0000 7fd7d2ffd640 1 -- 172.21.15.78:0/3488359726 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7cc0a6ba0 con 0x7fd7d4070250 2023-12-12T10:12:45.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:45.858+0000 7fd7da5aa640 1 -- 172.21.15.78:0/3488359726 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd7d4070250 msgr2=0x7fd7d40706e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:45.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:45.858+0000 7fd7da5aa640 1 --2- 172.21.15.78:0/3488359726 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd7d4070250 0x7fd7d40706e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd7cc009d90 tx=0x7fd7cc01c770 comp rx=0 tx=0).stop 2023-12-12T10:12:45.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:45.858+0000 7fd7da5aa640 1 -- 172.21.15.78:0/3488359726 shutdown_connections 2023-12-12T10:12:45.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:45.858+0000 7fd7da5aa640 1 --2- 172.21.15.78:0/3488359726 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd7d4070250 0x7fd7d40706e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:45.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:45.858+0000 7fd7da5aa640 1 --2- 172.21.15.78:0/3488359726 >> v2:172.21.15.187:3300/0 conn(0x7fd7d41621a0 0x7fd7d4162620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:45.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:45.858+0000 7fd7da5aa640 1 -- 172.21.15.78:0/3488359726 >> 172.21.15.78:0/3488359726 conn(0x7fd7d406c5d0 msgr2=0x7fd7d406c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:45.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:45.858+0000 7fd7da5aa640 1 -- 172.21.15.78:0/3488359726 shutdown_connections 2023-12-12T10:12:45.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:45.858+0000 7fd7da5aa640 1 -- 172.21.15.78:0/3488359726 wait complete. 2023-12-12T10:12:45.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:45.858+0000 7fd7da5aa640 1 Processor -- start 2023-12-12T10:12:45.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:45.858+0000 7fd7da5aa640 1 -- start start 2023-12-12T10:12:45.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:45.862+0000 7fd7da5aa640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd7d4070250 0x7fd7d4151b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:45.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:45.862+0000 7fd7da5aa640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd7d40b3880 0x7fd7d415ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:45.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:45.862+0000 7fd7da5aa640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd7d41621a0 0x7fd7d414fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:45.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:45.862+0000 7fd7da5aa640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7d415a740 con 0x7fd7d40b3880 2023-12-12T10:12:45.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:45.862+0000 7fd7da5aa640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7d415a430 con 0x7fd7d41621a0 2023-12-12T10:12:45.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:45.862+0000 7fd7da5aa640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7d415c350 con 0x7fd7d4070250 2023-12-12T10:12:45.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:45.862+0000 7fd7d37fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd7d40b3880 0x7fd7d415ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:45.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:45.862+0000 7fd7d37fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd7d40b3880 0x7fd7d415ab60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55890/0 (socket says 172.21.15.78:55890) 2023-12-12T10:12:45.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:45.862+0000 7fd7d37fe640 1 -- 172.21.15.78:0/2545191583 learned_addr learned my addr 172.21.15.78:0/2545191583 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:45.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:45.862+0000 7fd7d8b47640 1 --2- 172.21.15.78:0/2545191583 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd7d41621a0 0x7fd7d414fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:45.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:45.862+0000 7fd7d3fff640 1 --2- 172.21.15.78:0/2545191583 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd7d4070250 0x7fd7d4151b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:45.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:45.862+0000 7fd7d37fe640 1 -- 172.21.15.78:0/2545191583 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd7d4070250 msgr2=0x7fd7d4151b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:45.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:45.862+0000 7fd7d37fe640 1 --2- 172.21.15.78:0/2545191583 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd7d4070250 0x7fd7d4151b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:45.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:45.862+0000 7fd7d37fe640 1 -- 172.21.15.78:0/2545191583 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd7d41621a0 msgr2=0x7fd7d414fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:45.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:45.862+0000 7fd7d37fe640 1 --2- 172.21.15.78:0/2545191583 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd7d41621a0 0x7fd7d414fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:45.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:45.862+0000 7fd7d37fe640 1 -- 172.21.15.78:0/2545191583 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7c8009420 con 0x7fd7d40b3880 2023-12-12T10:12:45.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:45.862+0000 7fd7d37fe640 1 --2- 172.21.15.78:0/2545191583 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd7d40b3880 0x7fd7d415ab60 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fd7c800e980 tx=0x7fd7c800ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:45.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:45.862+0000 7fd7d0ff9640 1 -- 172.21.15.78:0/2545191583 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7c800ca00 con 0x7fd7d40b3880 2023-12-12T10:12:45.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:45.862+0000 7fd7d0ff9640 1 -- 172.21.15.78:0/2545191583 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7c800cb60 con 0x7fd7d40b3880 2023-12-12T10:12:45.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:45.862+0000 7fd7d0ff9640 1 -- 172.21.15.78:0/2545191583 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7c8013470 con 0x7fd7d40b3880 2023-12-12T10:12:45.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:45.862+0000 7fd7da5aa640 1 -- 172.21.15.78:0/2545191583 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7cc009a70 con 0x7fd7d40b3880 2023-12-12T10:12:45.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:45.862+0000 7fd7da5aa640 1 -- 172.21.15.78:0/2545191583 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7d41561e0 con 0x7fd7d40b3880 2023-12-12T10:12:45.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:45.862+0000 7fd7da5aa640 1 -- 172.21.15.78:0/2545191583 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7d415a9b0 con 0x7fd7d40b3880 2023-12-12T10:12:45.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:45.862+0000 7fd7d0ff9640 1 -- 172.21.15.78:0/2545191583 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd7c80135d0 con 0x7fd7d40b3880 2023-12-12T10:12:45.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:45.866+0000 7fd7d0ff9640 1 --2- 172.21.15.78:0/2545191583 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fd7c0066470 0x7fd7c0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:45.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:45.866+0000 7fd7d0ff9640 1 -- 172.21.15.78:0/2545191583 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd7c8084390 con 0x7fd7d40b3880 2023-12-12T10:12:45.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:45.866+0000 7fd7d3fff640 1 --2- 172.21.15.78:0/2545191583 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fd7c0066470 0x7fd7c0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:45.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:45.866+0000 7fd7d3fff640 1 --2- 172.21.15.78:0/2545191583 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fd7c0066470 0x7fd7c0068930 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fd7c40011f0 tx=0x7fd7c4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:45.871 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:45.870+0000 7fd7d0ff9640 1 -- 172.21.15.78:0/2545191583 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd7c8051500 con 0x7fd7d40b3880 2023-12-12T10:12:46.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:46.058+0000 7fd7da5aa640 1 -- 172.21.15.78:0/2545191583 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fd7d40671f0 con 0x7fd7d40b3880 2023-12-12T10:12:46.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:46.058+0000 7fd7d0ff9640 1 -- 172.21.15.78:0/2545191583 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7fd7c8054b20 con 0x7fd7d40b3880 2023-12-12T10:12:46.061 INFO:teuthology.orchestra.run.smithi078.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-12-12T10:12:46.063 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:46.058+0000 7fd7da5aa640 1 -- 172.21.15.78:0/2545191583 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fd7c0066470 msgr2=0x7fd7c0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:46.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:46.058+0000 7fd7da5aa640 1 --2- 172.21.15.78:0/2545191583 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fd7c0066470 0x7fd7c0068930 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fd7c40011f0 tx=0x7fd7c4009040 comp rx=0 tx=0).stop 2023-12-12T10:12:46.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:46.058+0000 7fd7da5aa640 1 -- 172.21.15.78:0/2545191583 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd7d40b3880 msgr2=0x7fd7d415ab60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:46.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:46.058+0000 7fd7da5aa640 1 --2- 172.21.15.78:0/2545191583 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd7d40b3880 0x7fd7d415ab60 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fd7c800e980 tx=0x7fd7c800ee40 comp rx=0 tx=0).stop 2023-12-12T10:12:46.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:46.058+0000 7fd7da5aa640 1 -- 172.21.15.78:0/2545191583 shutdown_connections 2023-12-12T10:12:46.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:46.058+0000 7fd7da5aa640 1 --2- 172.21.15.78:0/2545191583 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fd7c0066470 0x7fd7c0068930 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:46.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:46.058+0000 7fd7da5aa640 1 --2- 172.21.15.78:0/2545191583 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd7d41621a0 0x7fd7d414fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:46.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:46.058+0000 7fd7da5aa640 1 --2- 172.21.15.78:0/2545191583 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd7d40b3880 0x7fd7d415ab60 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:46.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:46.058+0000 7fd7da5aa640 1 --2- 172.21.15.78:0/2545191583 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd7d4070250 0x7fd7d4151b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:46.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:46.058+0000 7fd7da5aa640 1 -- 172.21.15.78:0/2545191583 >> 172.21.15.78:0/2545191583 conn(0x7fd7d406c5d0 msgr2=0x7fd7d4072190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:46.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:46.062+0000 7fd7da5aa640 1 -- 172.21.15.78:0/2545191583 shutdown_connections 2023-12-12T10:12:46.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:46.062+0000 7fd7da5aa640 1 -- 172.21.15.78:0/2545191583 wait complete. 2023-12-12T10:12:46.082 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-12T10:12:46.082 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-12T10:12:46.082 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi187.front.sepia.ceph.com 2023-12-12T10:12:46.083 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-12-12T10:12:46.083 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-12-12T10:12:46.083 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-12T10:12:46.083 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-12T10:12:46.083 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-12T10:12:46.083 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-12-12T10:12:46.083 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T10:12:46.084 DEBUG:teuthology.orchestra.run.smithi187:> ip addr 2023-12-12T10:12:46.095 INFO:teuthology.orchestra.run.smithi187.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-12T10:12:46.096 INFO:teuthology.orchestra.run.smithi187.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-12T10:12:46.096 INFO:teuthology.orchestra.run.smithi187.stdout: inet 127.0.0.1/8 scope host lo 2023-12-12T10:12:46.096 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-12-12T10:12:46.096 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 ::1/128 scope host 2023-12-12T10:12:46.096 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-12-12T10:12:46.097 INFO:teuthology.orchestra.run.smithi187.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-12T10:12:46.097 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:d9:36:78 brd ff:ff:ff:ff:ff:ff 2023-12-12T10:12:46.097 INFO:teuthology.orchestra.run.smithi187.stdout: altname enp7s0f0 2023-12-12T10:12:46.097 INFO:teuthology.orchestra.run.smithi187.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-12T10:12:46.097 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:d9:36:79 brd ff:ff:ff:ff:ff:ff 2023-12-12T10:12:46.097 INFO:teuthology.orchestra.run.smithi187.stdout: altname enp7s0f1 2023-12-12T10:12:46.097 INFO:teuthology.orchestra.run.smithi187.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-12T10:12:46.097 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:88:77:b0 brd ff:ff:ff:ff:ff:ff 2023-12-12T10:12:46.097 INFO:teuthology.orchestra.run.smithi187.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-12T10:12:46.097 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:88:77:b1 brd ff:ff:ff:ff:ff:ff 2023-12-12T10:12:46.097 INFO:teuthology.orchestra.run.smithi187.stdout: inet 172.21.15.187/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-12-12T10:12:46.098 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft 42367sec preferred_lft 42367sec 2023-12-12T10:12:46.098 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 fe80::ec4:7aff:fe88:77b1/64 scope link 2023-12-12T10:12:46.098 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-12-12T10:12:46.098 INFO:teuthology.orchestra.run.smithi187.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-12T10:12:46.098 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 02:42:61:fd:6e:8d brd ff:ff:ff:ff:ff:ff 2023-12-12T10:12:46.098 INFO:teuthology.orchestra.run.smithi187.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-12T10:12:46.098 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-12-12T10:12:46.098 INFO:teuthology.orchestra.run.smithi187.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-12T10:12:46.098 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-12-12T10:12:46.098 INFO:teuthology.orchestra.run.smithi187.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-12T10:12:46.099 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-12-12T10:12:46.099 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-12-12T10:12:46.099 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-12-12T10:12:46.099 INFO:teuthology.orchestra.run.smithi187.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-12T10:12:46.099 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-12T10:12:46.099 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-12-12T10:12:46.100 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-12-12T10:12:46.100 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T10:12:46.100 DEBUG:teuthology.orchestra.run.smithi187:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-12T10:12:46.156 INFO:teuthology.orchestra.run.smithi187.stdout:1 2023-12-12T10:12:46.158 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T10:12:46.158 DEBUG:teuthology.orchestra.run.smithi187:> route 2023-12-12T10:12:46.212 INFO:teuthology.orchestra.run.smithi187.stdout:Kernel IP routing table 2023-12-12T10:12:46.212 INFO:teuthology.orchestra.run.smithi187.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-12T10:12:46.212 INFO:teuthology.orchestra.run.smithi187.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-12-12T10:12:46.212 INFO:teuthology.orchestra.run.smithi187.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-12T10:12:46.212 INFO:teuthology.orchestra.run.smithi187.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-12T10:12:46.212 INFO:teuthology.orchestra.run.smithi187.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-12T10:12:46.212 INFO:teuthology.orchestra.run.smithi187.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-12T10:12:46.213 INFO:teuthology.orchestra.run.smithi187.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-12T10:12:46.213 INFO:teuthology.orchestra.run.smithi187.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-12T10:12:46.213 INFO:teuthology.orchestra.run.smithi187.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-12T10:12:46.213 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T10:12:46.213 DEBUG:teuthology.orchestra.run.smithi187:> (cd / && exec bash -c ' 2023-12-12T10:12:46.213 DEBUG:teuthology.orchestra.run.smithi187:> set -e 2023-12-12T10:12:46.213 DEBUG:teuthology.orchestra.run.smithi187:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-12T10:12:46.213 DEBUG:teuthology.orchestra.run.smithi187:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-12T10:12:46.213 DEBUG:teuthology.orchestra.run.smithi187:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-12T10:12:46.213 DEBUG:teuthology.orchestra.run.smithi187:> ') 2023-12-12T10:12:46.308 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T10:12:46.308 DEBUG:teuthology.orchestra.run.smithi187:> ip netns list 2023-12-12T10:12:46.318 INFO:teuthology.orchestra.run.smithi187.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-12T10:12:46.319 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T10:12:46.319 DEBUG:teuthology.orchestra.run.smithi187:> ip netns list-id 2023-12-12T10:12:46.370 INFO:teuthology.orchestra.run.smithi187.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-12-12T10:12:46.370 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T10:12:46.371 DEBUG:teuthology.orchestra.run.smithi187:> (cd / && exec bash -c ' 2023-12-12T10:12:46.371 DEBUG:teuthology.orchestra.run.smithi187:> set -e 2023-12-12T10:12:46.371 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-12-12T10:12:46.371 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-12-12T10:12:46.371 DEBUG:teuthology.orchestra.run.smithi187:> ') 2023-12-12T10:12:46.453 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T10:12:46.453 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-12-12T10:12:46.514 INFO:teuthology.orchestra.run.smithi187.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-12T10:12:46.514 INFO:teuthology.orchestra.run.smithi187.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-12T10:12:46.514 INFO:teuthology.orchestra.run.smithi187.stdout: inet 127.0.0.1/8 scope host lo 2023-12-12T10:12:46.514 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-12-12T10:12:46.514 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 ::1/128 scope host 2023-12-12T10:12:46.515 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-12-12T10:12:46.515 INFO:teuthology.orchestra.run.smithi187.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-12T10:12:46.515 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether de:f6:b9:c4:fd:04 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-12-12T10:12:46.515 INFO:teuthology.orchestra.run.smithi187.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-12-12T10:12:46.515 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-12-12T10:12:46.515 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 fe80::dcf6:b9ff:fec4:fd04/64 scope link 2023-12-12T10:12:46.515 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-12-12T10:12:46.517 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T10:12:46.517 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-12-12T10:12:46.586 INFO:teuthology.orchestra.run.smithi187.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-12T10:12:46.586 INFO:teuthology.orchestra.run.smithi187.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-12T10:12:46.586 INFO:teuthology.orchestra.run.smithi187.stdout: inet 127.0.0.1/8 scope host lo 2023-12-12T10:12:46.587 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-12-12T10:12:46.587 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 ::1/128 scope host 2023-12-12T10:12:46.587 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-12-12T10:12:46.587 INFO:teuthology.orchestra.run.smithi187.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-12T10:12:46.587 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether de:f6:b9:c4:fd:04 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-12-12T10:12:46.587 INFO:teuthology.orchestra.run.smithi187.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-12-12T10:12:46.588 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-12-12T10:12:46.588 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 fe80::dcf6:b9ff:fec4:fd04/64 scope link 2023-12-12T10:12:46.588 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-12-12T10:12:46.590 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-12-12T10:12:46.590 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T10:12:46.590 DEBUG:teuthology.orchestra.run.smithi187:> (cd / && exec bash -c ' 2023-12-12T10:12:46.590 DEBUG:teuthology.orchestra.run.smithi187:> set -e 2023-12-12T10:12:46.591 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-12-12T10:12:46.591 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-12-12T10:12:46.591 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-12-12T10:12:46.591 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-12-12T10:12:46.591 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-12-12T10:12:46.591 DEBUG:teuthology.orchestra.run.smithi187:> ') 2023-12-12T10:12:46.731 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T10:12:46.732 DEBUG:teuthology.orchestra.run.smithi187:> (cd / && exec bash -c ' 2023-12-12T10:12:46.732 DEBUG:teuthology.orchestra.run.smithi187:> set -e 2023-12-12T10:12:46.732 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip link set brx.1 up 2023-12-12T10:12:46.732 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip link set dev brx.1 master ceph-brx 2023-12-12T10:12:46.732 DEBUG:teuthology.orchestra.run.smithi187:> ') 2023-12-12T10:12:46.772 INFO:tasks.cephfs.fuse_mount:Client client.3 config is {} 2023-12-12T10:12:46.772 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-12T10:12:46.772 DEBUG:teuthology.orchestra.run.smithi187:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-12-12T10:12:46.822 INFO:teuthology.orchestra.run.smithi187.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-12-12T10:12:46.823 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-12T10:12:46.823 DEBUG:teuthology.orchestra.run.smithi187:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-12-12T10:12:46.873 DEBUG:teuthology.orchestra.run.smithi187:> sudo modprobe fuse 2023-12-12T10:12:46.934 DEBUG:teuthology.orchestra.run.smithi187:> cat /proc/self/mounts | awk '{print $2}' 2023-12-12T10:12:46.987 INFO:teuthology.orchestra.run.smithi187.stdout:/sys 2023-12-12T10:12:46.987 INFO:teuthology.orchestra.run.smithi187.stdout:/proc 2023-12-12T10:12:46.987 INFO:teuthology.orchestra.run.smithi187.stdout:/dev 2023-12-12T10:12:46.987 INFO:teuthology.orchestra.run.smithi187.stdout:/dev/pts 2023-12-12T10:12:46.987 INFO:teuthology.orchestra.run.smithi187.stdout:/run 2023-12-12T10:12:46.988 INFO:teuthology.orchestra.run.smithi187.stdout:/ 2023-12-12T10:12:46.988 INFO:teuthology.orchestra.run.smithi187.stdout:/sys/kernel/security 2023-12-12T10:12:46.988 INFO:teuthology.orchestra.run.smithi187.stdout:/dev/shm 2023-12-12T10:12:46.988 INFO:teuthology.orchestra.run.smithi187.stdout:/run/lock 2023-12-12T10:12:46.988 INFO:teuthology.orchestra.run.smithi187.stdout:/sys/fs/cgroup 2023-12-12T10:12:46.988 INFO:teuthology.orchestra.run.smithi187.stdout:/sys/fs/pstore 2023-12-12T10:12:46.988 INFO:teuthology.orchestra.run.smithi187.stdout:/sys/fs/bpf 2023-12-12T10:12:46.988 INFO:teuthology.orchestra.run.smithi187.stdout:/proc/sys/fs/binfmt_misc 2023-12-12T10:12:46.988 INFO:teuthology.orchestra.run.smithi187.stdout:/dev/hugepages 2023-12-12T10:12:46.988 INFO:teuthology.orchestra.run.smithi187.stdout:/dev/mqueue 2023-12-12T10:12:46.988 INFO:teuthology.orchestra.run.smithi187.stdout:/sys/kernel/debug 2023-12-12T10:12:46.988 INFO:teuthology.orchestra.run.smithi187.stdout:/sys/kernel/tracing 2023-12-12T10:12:46.988 INFO:teuthology.orchestra.run.smithi187.stdout:/proc/fs/nfsd 2023-12-12T10:12:46.988 INFO:teuthology.orchestra.run.smithi187.stdout:/sys/fs/fuse/connections 2023-12-12T10:12:46.988 INFO:teuthology.orchestra.run.smithi187.stdout:/sys/kernel/config 2023-12-12T10:12:46.989 INFO:teuthology.orchestra.run.smithi187.stdout:/run/credentials/systemd-sysusers.service 2023-12-12T10:12:46.989 INFO:teuthology.orchestra.run.smithi187.stdout:/run/rpc_pipefs 2023-12-12T10:12:46.989 INFO:teuthology.orchestra.run.smithi187.stdout:/run/user/1000 2023-12-12T10:12:46.989 INFO:teuthology.orchestra.run.smithi187.stdout:/var/lib/ceph 2023-12-12T10:12:46.989 INFO:teuthology.orchestra.run.smithi187.stdout:/var/lib/ceph/osd/ceph-4 2023-12-12T10:12:46.989 INFO:teuthology.orchestra.run.smithi187.stdout:/var/lib/ceph/osd/ceph-5 2023-12-12T10:12:46.989 INFO:teuthology.orchestra.run.smithi187.stdout:/var/lib/ceph/osd/ceph-6 2023-12-12T10:12:46.989 INFO:teuthology.orchestra.run.smithi187.stdout:/var/lib/ceph/osd/ceph-7 2023-12-12T10:12:46.989 INFO:teuthology.orchestra.run.smithi187.stdout:/run/netns 2023-12-12T10:12:46.989 INFO:teuthology.orchestra.run.smithi187.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-12T10:12:46.989 INFO:teuthology.orchestra.run.smithi187.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-12T10:12:46.989 INFO:teuthology.orchestra.run.smithi187.stdout:/home/ubuntu/cephtest/mnt.1 2023-12-12T10:12:46.989 INFO:teuthology.orchestra.run.smithi187.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-12-12T10:12:46.990 INFO:teuthology.orchestra.run.smithi187.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-12-12T10:12:46.991 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T10:12:46.991 DEBUG:teuthology.orchestra.run.smithi187:> ls /sys/fs/fuse/connections 2023-12-12T10:12:47.041 INFO:teuthology.orchestra.run.smithi187.stdout:43 2023-12-12T10:12:47.042 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [43] 2023-12-12T10:12:47.042 DEBUG:teuthology.orchestra.run.smithi187:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.3 --id 3) 2023-12-12T10:12:47.088 DEBUG:teuthology.orchestra.run.smithi187:> sudo modprobe fuse 2023-12-12T10:12:47.110 DEBUG:teuthology.orchestra.run.smithi187:> cat /proc/self/mounts | awk '{print $2}' 2023-12-12T10:12:47.163 INFO:teuthology.orchestra.run.smithi187.stdout:/sys 2023-12-12T10:12:47.164 INFO:teuthology.orchestra.run.smithi187.stdout:/proc 2023-12-12T10:12:47.164 INFO:teuthology.orchestra.run.smithi187.stdout:/dev 2023-12-12T10:12:47.164 INFO:teuthology.orchestra.run.smithi187.stdout:/dev/pts 2023-12-12T10:12:47.164 INFO:teuthology.orchestra.run.smithi187.stdout:/run 2023-12-12T10:12:47.164 INFO:teuthology.orchestra.run.smithi187.stdout:/ 2023-12-12T10:12:47.164 INFO:teuthology.orchestra.run.smithi187.stdout:/sys/kernel/security 2023-12-12T10:12:47.164 INFO:teuthology.orchestra.run.smithi187.stdout:/dev/shm 2023-12-12T10:12:47.164 INFO:teuthology.orchestra.run.smithi187.stdout:/run/lock 2023-12-12T10:12:47.164 INFO:teuthology.orchestra.run.smithi187.stdout:/sys/fs/cgroup 2023-12-12T10:12:47.165 INFO:teuthology.orchestra.run.smithi187.stdout:/sys/fs/pstore 2023-12-12T10:12:47.165 INFO:teuthology.orchestra.run.smithi187.stdout:/sys/fs/bpf 2023-12-12T10:12:47.165 INFO:teuthology.orchestra.run.smithi187.stdout:/proc/sys/fs/binfmt_misc 2023-12-12T10:12:47.165 INFO:teuthology.orchestra.run.smithi187.stdout:/dev/hugepages 2023-12-12T10:12:47.165 INFO:teuthology.orchestra.run.smithi187.stdout:/dev/mqueue 2023-12-12T10:12:47.165 INFO:teuthology.orchestra.run.smithi187.stdout:/sys/kernel/debug 2023-12-12T10:12:47.165 INFO:teuthology.orchestra.run.smithi187.stdout:/sys/kernel/tracing 2023-12-12T10:12:47.165 INFO:teuthology.orchestra.run.smithi187.stdout:/proc/fs/nfsd 2023-12-12T10:12:47.166 INFO:teuthology.orchestra.run.smithi187.stdout:/sys/fs/fuse/connections 2023-12-12T10:12:47.166 INFO:teuthology.orchestra.run.smithi187.stdout:/sys/kernel/config 2023-12-12T10:12:47.166 INFO:teuthology.orchestra.run.smithi187.stdout:/run/credentials/systemd-sysusers.service 2023-12-12T10:12:47.166 INFO:teuthology.orchestra.run.smithi187.stdout:/run/rpc_pipefs 2023-12-12T10:12:47.166 INFO:teuthology.orchestra.run.smithi187.stdout:/run/user/1000 2023-12-12T10:12:47.166 INFO:teuthology.orchestra.run.smithi187.stdout:/var/lib/ceph 2023-12-12T10:12:47.166 INFO:teuthology.orchestra.run.smithi187.stdout:/var/lib/ceph/osd/ceph-4 2023-12-12T10:12:47.167 INFO:teuthology.orchestra.run.smithi187.stdout:/var/lib/ceph/osd/ceph-5 2023-12-12T10:12:47.167 INFO:teuthology.orchestra.run.smithi187.stdout:/var/lib/ceph/osd/ceph-6 2023-12-12T10:12:47.167 INFO:teuthology.orchestra.run.smithi187.stdout:/var/lib/ceph/osd/ceph-7 2023-12-12T10:12:47.167 INFO:teuthology.orchestra.run.smithi187.stdout:/run/netns 2023-12-12T10:12:47.167 INFO:teuthology.orchestra.run.smithi187.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-12T10:12:47.167 INFO:teuthology.orchestra.run.smithi187.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-12T10:12:47.167 INFO:teuthology.orchestra.run.smithi187.stdout:/home/ubuntu/cephtest/mnt.1 2023-12-12T10:12:47.167 INFO:teuthology.orchestra.run.smithi187.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-12-12T10:12:47.168 INFO:teuthology.orchestra.run.smithi187.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-12-12T10:12:47.169 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T10:12:47.169 DEBUG:teuthology.orchestra.run.smithi187:> ls /sys/fs/fuse/connections 2023-12-12T10:12:47.185 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi187.stderr:2023-12-12T10:12:47.180+0000 7ff75afd7580 -1 init, newargv = 0x56540959d030 newargc=15 2023-12-12T10:12:47.185 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi187.stderr:ceph-fuse[44152]: starting ceph client 2023-12-12T10:12:47.192 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi187.stderr:ceph-fuse[44152]: starting fuse 2023-12-12T10:12:47.194 INFO:teuthology.orchestra.run.smithi187.stdout:43 2023-12-12T10:12:47.195 INFO:teuthology.orchestra.run.smithi187.stdout:44 2023-12-12T10:12:47.195 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43, 44] 2023-12-12T10:12:47.196 DEBUG:teuthology.orchestra.run.smithi187:> sudo stdin-killer -- python3 -c ' 2023-12-12T10:12:47.196 DEBUG:teuthology.orchestra.run.smithi187:> import glob 2023-12-12T10:12:47.196 DEBUG:teuthology.orchestra.run.smithi187:> import re 2023-12-12T10:12:47.196 DEBUG:teuthology.orchestra.run.smithi187:> import os 2023-12-12T10:12:47.196 DEBUG:teuthology.orchestra.run.smithi187:> import subprocess 2023-12-12T10:12:47.196 DEBUG:teuthology.orchestra.run.smithi187:> 2023-12-12T10:12:47.196 DEBUG:teuthology.orchestra.run.smithi187:> def _find_admin_socket(client_name): 2023-12-12T10:12:47.196 DEBUG:teuthology.orchestra.run.smithi187:> asok_path = "/var/run/ceph/ceph-client.3.*.asok" 2023-12-12T10:12:47.196 DEBUG:teuthology.orchestra.run.smithi187:> files = glob.glob(asok_path) 2023-12-12T10:12:47.197 DEBUG:teuthology.orchestra.run.smithi187:> mountpoint = "/home/ubuntu/cephtest/mnt.3" 2023-12-12T10:12:47.197 DEBUG:teuthology.orchestra.run.smithi187:> 2023-12-12T10:12:47.197 DEBUG:teuthology.orchestra.run.smithi187:> # Given a non-glob path, it better be there 2023-12-12T10:12:47.197 DEBUG:teuthology.orchestra.run.smithi187:> if "*" not in asok_path: 2023-12-12T10:12:47.197 DEBUG:teuthology.orchestra.run.smithi187:> assert(len(files) == 1) 2023-12-12T10:12:47.197 DEBUG:teuthology.orchestra.run.smithi187:> return files[0] 2023-12-12T10:12:47.197 DEBUG:teuthology.orchestra.run.smithi187:> 2023-12-12T10:12:47.197 DEBUG:teuthology.orchestra.run.smithi187:> for f in files: 2023-12-12T10:12:47.197 DEBUG:teuthology.orchestra.run.smithi187:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-12T10:12:47.198 DEBUG:teuthology.orchestra.run.smithi187:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-12T10:12:47.198 DEBUG:teuthology.orchestra.run.smithi187:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-12T10:12:47.198 DEBUG:teuthology.orchestra.run.smithi187:> contents = proc_f.read() 2023-12-12T10:12:47.198 DEBUG:teuthology.orchestra.run.smithi187:> if mountpoint in contents: 2023-12-12T10:12:47.198 DEBUG:teuthology.orchestra.run.smithi187:> return f 2023-12-12T10:12:47.198 DEBUG:teuthology.orchestra.run.smithi187:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-12T10:12:47.198 DEBUG:teuthology.orchestra.run.smithi187:> 2023-12-12T10:12:47.198 DEBUG:teuthology.orchestra.run.smithi187:> print(_find_admin_socket("client.3")) 2023-12-12T10:12:47.198 DEBUG:teuthology.orchestra.run.smithi187:> ' 2023-12-12T10:12:47.317 INFO:teuthology.orchestra.run.smithi187.stdout:/var/run/ceph/ceph-client.3.44152.asok 2023-12-12T10:12:47.320 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-12T10:12:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-12-12T10:12:47.328 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.3.44152.asok 2023-12-12T10:12:47.328 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T10:12:47.328 DEBUG:teuthology.orchestra.run.smithi187:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.3.44152.asok status 2023-12-12T10:12:47.498 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2023-12-12T10:12:47.499 INFO:teuthology.orchestra.run.smithi187.stdout: "metadata": { 2023-12-12T10:12:47.499 INFO:teuthology.orchestra.run.smithi187.stdout: "ceph_sha1": "f1fbf3c583d03e19f5e58eb618e78d8e10d075f9", 2023-12-12T10:12:47.499 INFO:teuthology.orchestra.run.smithi187.stdout: "ceph_version": "ceph version 19.0.0-96-gf1fbf3c5 (f1fbf3c583d03e19f5e58eb618e78d8e10d075f9) reef (dev)", 2023-12-12T10:12:47.499 INFO:teuthology.orchestra.run.smithi187.stdout: "entity_id": "3", 2023-12-12T10:12:47.499 INFO:teuthology.orchestra.run.smithi187.stdout: "hostname": "smithi187", 2023-12-12T10:12:47.499 INFO:teuthology.orchestra.run.smithi187.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.3", 2023-12-12T10:12:47.499 INFO:teuthology.orchestra.run.smithi187.stdout: "pid": "44152", 2023-12-12T10:12:47.499 INFO:teuthology.orchestra.run.smithi187.stdout: "root": "/" 2023-12-12T10:12:47.499 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-12-12T10:12:47.499 INFO:teuthology.orchestra.run.smithi187.stdout: "dentry_count": 0, 2023-12-12T10:12:47.499 INFO:teuthology.orchestra.run.smithi187.stdout: "dentry_pinned_count": 0, 2023-12-12T10:12:47.499 INFO:teuthology.orchestra.run.smithi187.stdout: "id": 4658, 2023-12-12T10:12:47.500 INFO:teuthology.orchestra.run.smithi187.stdout: "inst": { 2023-12-12T10:12:47.500 INFO:teuthology.orchestra.run.smithi187.stdout: "name": { 2023-12-12T10:12:47.500 INFO:teuthology.orchestra.run.smithi187.stdout: "type": "client", 2023-12-12T10:12:47.500 INFO:teuthology.orchestra.run.smithi187.stdout: "num": 4658 2023-12-12T10:12:47.500 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-12-12T10:12:47.500 INFO:teuthology.orchestra.run.smithi187.stdout: "addr": { 2023-12-12T10:12:47.500 INFO:teuthology.orchestra.run.smithi187.stdout: "type": "v1", 2023-12-12T10:12:47.500 INFO:teuthology.orchestra.run.smithi187.stdout: "addr": "192.168.0.2:0", 2023-12-12T10:12:47.501 INFO:teuthology.orchestra.run.smithi187.stdout: "nonce": 811213296 2023-12-12T10:12:47.501 INFO:teuthology.orchestra.run.smithi187.stdout: } 2023-12-12T10:12:47.501 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-12-12T10:12:47.501 INFO:teuthology.orchestra.run.smithi187.stdout: "addr": { 2023-12-12T10:12:47.501 INFO:teuthology.orchestra.run.smithi187.stdout: "type": "v1", 2023-12-12T10:12:47.501 INFO:teuthology.orchestra.run.smithi187.stdout: "addr": "192.168.0.2:0", 2023-12-12T10:12:47.502 INFO:teuthology.orchestra.run.smithi187.stdout: "nonce": 811213296 2023-12-12T10:12:47.502 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-12-12T10:12:47.502 INFO:teuthology.orchestra.run.smithi187.stdout: "inst_str": "client.4658 192.168.0.2:0/811213296", 2023-12-12T10:12:47.502 INFO:teuthology.orchestra.run.smithi187.stdout: "addr_str": "192.168.0.2:0/811213296", 2023-12-12T10:12:47.502 INFO:teuthology.orchestra.run.smithi187.stdout: "inode_count": 1, 2023-12-12T10:12:47.502 INFO:teuthology.orchestra.run.smithi187.stdout: "mds_epoch": 9, 2023-12-12T10:12:47.502 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_epoch": 24, 2023-12-12T10:12:47.503 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_epoch_barrier": 0, 2023-12-12T10:12:47.503 INFO:teuthology.orchestra.run.smithi187.stdout: "blocklisted": false, 2023-12-12T10:12:47.503 INFO:teuthology.orchestra.run.smithi187.stdout: "fs_name": "cephfs" 2023-12-12T10:12:47.503 INFO:teuthology.orchestra.run.smithi187.stdout:} 2023-12-12T10:12:47.514 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T10:12:47.514 DEBUG:teuthology.orchestra.run.smithi078:> stat --file-system '--printf=%T 2023-12-12T10:12:47.514 DEBUG:teuthology.orchestra.run.smithi078:> ' -- /home/ubuntu/cephtest/mnt.0 2023-12-12T10:12:47.525 INFO:teuthology.orchestra.run.smithi078.stdout:fuseblk 2023-12-12T10:12:47.525 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-12-12T10:12:47.526 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T10:12:47.526 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-12T10:12:47.593 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T10:12:47.594 DEBUG:teuthology.orchestra.run.smithi078:> stat --file-system '--printf=%T 2023-12-12T10:12:47.594 DEBUG:teuthology.orchestra.run.smithi078:> ' -- /home/ubuntu/cephtest/mnt.2 2023-12-12T10:12:47.644 INFO:teuthology.orchestra.run.smithi078.stdout:fuseblk 2023-12-12T10:12:47.645 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2023-12-12T10:12:47.645 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T10:12:47.645 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-12-12T10:12:47.709 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T10:12:47.709 DEBUG:teuthology.orchestra.run.smithi187:> stat --file-system '--printf=%T 2023-12-12T10:12:47.709 DEBUG:teuthology.orchestra.run.smithi187:> ' -- /home/ubuntu/cephtest/mnt.1 2023-12-12T10:12:47.719 INFO:teuthology.orchestra.run.smithi187.stdout:fuseblk 2023-12-12T10:12:47.719 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-12-12T10:12:47.719 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T10:12:47.719 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-12T10:12:47.781 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T10:12:47.781 DEBUG:teuthology.orchestra.run.smithi187:> stat --file-system '--printf=%T 2023-12-12T10:12:47.781 DEBUG:teuthology.orchestra.run.smithi187:> ' -- /home/ubuntu/cephtest/mnt.3 2023-12-12T10:12:47.834 INFO:teuthology.orchestra.run.smithi187.stdout:fuseblk 2023-12-12T10:12:47.834 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2023-12-12T10:12:47.834 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T10:12:47.834 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-12-12T10:12:47.898 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-12-12T10:12:47.920 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T10:12:48.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.062+0000 7fd598417640 1 Processor -- start 2023-12-12T10:12:48.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.062+0000 7fd598417640 1 -- start start 2023-12-12T10:12:48.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.066+0000 7fd598417640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fd59013ceb0 0x7fd59013d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:48.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.066+0000 7fd598417640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd590071bf0 0x7fd590072030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:48.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.066+0000 7fd598417640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd59013f550 0x7fd59013f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:48.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.066+0000 7fd598417640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd59013ff20 con 0x7fd59013f550 2023-12-12T10:12:48.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.066+0000 7fd598417640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5900705a0 con 0x7fd59013ceb0 2023-12-12T10:12:48.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.066+0000 7fd598417640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd590140410 con 0x7fd590071bf0 2023-12-12T10:12:48.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.066+0000 7fd5969b4640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd59013f550 0x7fd59013f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:48.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.066+0000 7fd5969b4640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd59013f550 0x7fd59013f9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55900/0 (socket says 172.21.15.78:55900) 2023-12-12T10:12:48.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.066+0000 7fd5969b4640 1 -- 172.21.15.78:0/436687047 learned_addr learned my addr 172.21.15.78:0/436687047 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:48.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.066+0000 7fd5959b2640 1 --2- 172.21.15.78:0/436687047 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd590071bf0 0x7fd590072030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:48.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.066+0000 7fd5961b3640 1 --2- 172.21.15.78:0/436687047 >> v2:172.21.15.187:3300/0 conn(0x7fd59013ceb0 0x7fd59013d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:48.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.066+0000 7fd5969b4640 1 -- 172.21.15.78:0/436687047 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd590071bf0 msgr2=0x7fd590072030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:48.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.066+0000 7fd5969b4640 1 --2- 172.21.15.78:0/436687047 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd590071bf0 0x7fd590072030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:48.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.066+0000 7fd5969b4640 1 -- 172.21.15.78:0/436687047 >> v2:172.21.15.187:3300/0 conn(0x7fd59013ceb0 msgr2=0x7fd59013d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:48.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.066+0000 7fd5969b4640 1 --2- 172.21.15.78:0/436687047 >> v2:172.21.15.187:3300/0 conn(0x7fd59013ceb0 0x7fd59013d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:48.069 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.066+0000 7fd5969b4640 1 -- 172.21.15.78:0/436687047 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5900cdc90 con 0x7fd59013f550 2023-12-12T10:12:48.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.066+0000 7fd5969b4640 1 --2- 172.21.15.78:0/436687047 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd59013f550 0x7fd59013f9e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fd590072840 tx=0x7fd58801c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76ebe10d945ab8a1 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:48.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.066+0000 7fd5951b1640 1 -- 172.21.15.78:0/436687047 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5880a5650 con 0x7fd59013f550 2023-12-12T10:12:48.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.066+0000 7fd5951b1640 1 -- 172.21.15.78:0/436687047 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5880a57b0 con 0x7fd59013f550 2023-12-12T10:12:48.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.066+0000 7fd5951b1640 1 -- 172.21.15.78:0/436687047 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5880a5b40 con 0x7fd59013f550 2023-12-12T10:12:48.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.070+0000 7fd598417640 1 -- 172.21.15.78:0/436687047 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd59013f550 msgr2=0x7fd59013f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:48.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.070+0000 7fd598417640 1 --2- 172.21.15.78:0/436687047 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd59013f550 0x7fd59013f9e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fd590072840 tx=0x7fd58801c9d0 comp rx=0 tx=0).stop 2023-12-12T10:12:48.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.070+0000 7fd598417640 1 -- 172.21.15.78:0/436687047 shutdown_connections 2023-12-12T10:12:48.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.070+0000 7fd598417640 1 --2- 172.21.15.78:0/436687047 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd59013f550 0x7fd59013f9e0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:48.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.070+0000 7fd598417640 1 --2- 172.21.15.78:0/436687047 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd590071bf0 0x7fd590072030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:48.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.070+0000 7fd598417640 1 --2- 172.21.15.78:0/436687047 >> v2:172.21.15.187:3300/0 conn(0x7fd59013ceb0 0x7fd59013d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:48.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.070+0000 7fd598417640 1 -- 172.21.15.78:0/436687047 >> 172.21.15.78:0/436687047 conn(0x7fd59006c5d0 msgr2=0x7fd59006c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:48.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.070+0000 7fd598417640 1 -- 172.21.15.78:0/436687047 shutdown_connections 2023-12-12T10:12:48.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.070+0000 7fd598417640 1 -- 172.21.15.78:0/436687047 wait complete. 2023-12-12T10:12:48.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.070+0000 7fd598417640 1 Processor -- start 2023-12-12T10:12:48.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.070+0000 7fd598417640 1 -- start start 2023-12-12T10:12:48.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.070+0000 7fd598417640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd590071bf0 0x7fd590137e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:48.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.070+0000 7fd598417640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd59013ceb0 0x7fd5900b4390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:48.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.070+0000 7fd598417640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd59013f550 0x7fd5900b1a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:48.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.070+0000 7fd598417640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5900b28f0 con 0x7fd59013f550 2023-12-12T10:12:48.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.070+0000 7fd598417640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5900b3f00 con 0x7fd590071bf0 2023-12-12T10:12:48.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.070+0000 7fd598417640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5900b2330 con 0x7fd59013ceb0 2023-12-12T10:12:48.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.070+0000 7fd5969b4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd59013f550 0x7fd5900b1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:48.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.070+0000 7fd5961b3640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd590071bf0 0x7fd590137e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:48.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.070+0000 7fd5969b4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd59013f550 0x7fd5900b1a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55908/0 (socket says 172.21.15.78:55908) 2023-12-12T10:12:48.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.070+0000 7fd5969b4640 1 -- 172.21.15.78:0/2771927647 learned_addr learned my addr 172.21.15.78:0/2771927647 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:48.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.070+0000 7fd5959b2640 1 --2- 172.21.15.78:0/2771927647 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd59013ceb0 0x7fd5900b4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:48.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.074+0000 7fd5961b3640 1 -- 172.21.15.78:0/2771927647 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd59013ceb0 msgr2=0x7fd5900b4390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:48.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.074+0000 7fd5961b3640 1 --2- 172.21.15.78:0/2771927647 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd59013ceb0 0x7fd5900b4390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:48.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.074+0000 7fd5961b3640 1 -- 172.21.15.78:0/2771927647 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd59013f550 msgr2=0x7fd5900b1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:48.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.074+0000 7fd5961b3640 1 --2- 172.21.15.78:0/2771927647 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd59013f550 0x7fd5900b1a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:48.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.074+0000 7fd5961b3640 1 -- 172.21.15.78:0/2771927647 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd588009b30 con 0x7fd590071bf0 2023-12-12T10:12:48.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.074+0000 7fd5961b3640 1 --2- 172.21.15.78:0/2771927647 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd590071bf0 0x7fd590137e60 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fd58c00e870 tx=0x7fd58c00ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:48.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.074+0000 7fd586ffd640 1 -- 172.21.15.78:0/2771927647 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd58c0095d0 con 0x7fd590071bf0 2023-12-12T10:12:48.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.074+0000 7fd586ffd640 1 -- 172.21.15.78:0/2771927647 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd58c00c940 con 0x7fd590071bf0 2023-12-12T10:12:48.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.074+0000 7fd598417640 1 -- 172.21.15.78:0/2771927647 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5900b2610 con 0x7fd590071bf0 2023-12-12T10:12:48.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.074+0000 7fd586ffd640 1 -- 172.21.15.78:0/2771927647 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd58c00ccb0 con 0x7fd590071bf0 2023-12-12T10:12:48.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.074+0000 7fd598417640 1 -- 172.21.15.78:0/2771927647 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5900b1f70 con 0x7fd590071bf0 2023-12-12T10:12:48.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.078+0000 7fd598417640 1 -- 172.21.15.78:0/2771927647 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5900b48d0 con 0x7fd590071bf0 2023-12-12T10:12:48.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.078+0000 7fd586ffd640 1 -- 172.21.15.78:0/2771927647 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd58c013470 con 0x7fd590071bf0 2023-12-12T10:12:48.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.078+0000 7fd586ffd640 1 --2- 172.21.15.78:0/2771927647 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fd574066470 0x7fd574068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:48.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.078+0000 7fd586ffd640 1 -- 172.21.15.78:0/2771927647 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd58c0842e0 con 0x7fd590071bf0 2023-12-12T10:12:48.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.078+0000 7fd5959b2640 1 --2- 172.21.15.78:0/2771927647 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fd574066470 0x7fd574068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:48.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.078+0000 7fd5959b2640 1 --2- 172.21.15.78:0/2771927647 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fd574066470 0x7fd574068930 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fd5900a9cc0 tx=0x7fd580009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:48.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.082+0000 7fd586ffd640 1 -- 172.21.15.78:0/2771927647 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd58c051480 con 0x7fd590071bf0 2023-12-12T10:12:48.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.234+0000 7fd598417640 1 -- 172.21.15.78:0/2771927647 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd5900671f0 con 0x7fd590071bf0 2023-12-12T10:12:48.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.234+0000 7fd586ffd640 1 -- 172.21.15.78:0/2771927647 <== mon.1 v2:172.21.15.187:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18310 (secure 0 0 0) 0x7fd58c054aa0 con 0x7fd590071bf0 2023-12-12T10:12:48.239 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:12:48.239 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":24,"fsid":"fc81937c-bd26-483c-952b-d1324fcb0c9e","created":"2023-12-12T10:11:44.020214+0000","modified":"2023-12-12T10:12:14.355146+0000","last_up_change":"2023-12-12T10:11:56.278318+0000","last_in_change":"2023-12-12T10:11:46.553610+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T10:11:57.053584+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-12T10:12:07.454450+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-12T10:12:08.182909+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-12T10:12:11.977952+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"22dfdedf-5f6c-4b20-9f6c-30517a1db70a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6809","nonce":3345683600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6811","nonce":3345683600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6815","nonce":3345683600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6813","nonce":3345683600}]},"public_addr":"172.21.15.78:6809/3345683600","cluster_addr":"172.21.15.78:6811/3345683600","heartbeat_back_addr":"172.21.15.78:6815/3345683600","heartbeat_front_addr":"172.21.15.78:6813/3345683600","state":["exists","up"]},{"osd":1,"uuid":"be34a7f3-a69a-462e-9ddf-5e537448dba2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6801","nonce":962652768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6803","nonce":962652768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6807","nonce":962652768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6805","nonce":962652768}]},"public_addr":"172.21.15.78:6801/962652768","cluster_addr":"172.21.15.78:6803/962652768","heartbeat_back_addr":"172.21.15.78:6807/962652768","heartbeat_front_addr":"172.21.15.78:6805/962652768","state":["exists","up"]},{"osd":2,"uuid":"55b381de-5f56-4b14-80f7-e6e41e084a13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6818","nonce":2910206054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6822","nonce":2910206054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6829","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6831","nonce":2910206054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6826","nonce":2910206054}]},"public_addr":"172.21.15.78:6818/2910206054","cluster_addr":"172.21.15.78:6822/2910206054","heartbeat_back_addr":"172.21.15.78:6831/2910206054","heartbeat_front_addr":"172.21.15.78:6826/2910206054","state":["exists","up"]},{"osd":3,"uuid":"d7682de1-25cb-4cec-869f-8851c28b0e6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6819","nonce":3750796703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6821","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6823","nonce":3750796703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6830","nonce":3750796703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6825","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6827","nonce":3750796703}]},"public_addr":"172.21.15.78:6819/3750796703","cluster_addr":"172.21.15.78:6823/3750796703","heartbeat_back_addr":"172.21.15.78:6830/3750796703","heartbeat_front_addr":"172.21.15.78:6827/3750796703","state":["exists","up"]},{"osd":4,"uuid":"8279815a-d6c7-4199-871e-d28971b9dc07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6809","nonce":2944277204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6811","nonce":2944277204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6815","nonce":2944277204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6813","nonce":2944277204}]},"public_addr":"172.21.15.187:6809/2944277204","cluster_addr":"172.21.15.187:6811/2944277204","heartbeat_back_addr":"172.21.15.187:6815/2944277204","heartbeat_front_addr":"172.21.15.187:6813/2944277204","state":["exists","up"]},{"osd":5,"uuid":"0a714c65-f8ce-4340-968f-11a799677ef3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6801","nonce":185858620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6803","nonce":185858620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6807","nonce":185858620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6805","nonce":185858620}]},"public_addr":"172.21.15.187:6801/185858620","cluster_addr":"172.21.15.187:6803/185858620","heartbeat_back_addr":"172.21.15.187:6807/185858620","heartbeat_front_addr":"172.21.15.187:6805/185858620","state":["exists","up"]},{"osd":6,"uuid":"d0bba9ab-f7ee-449e-8999-1c0cf7e6d53c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6817","nonce":4213392126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6819","nonce":4213392126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6824","nonce":4213392126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6821","nonce":4213392126}]},"public_addr":"172.21.15.187:6817/4213392126","cluster_addr":"172.21.15.187:6819/4213392126","heartbeat_back_addr":"172.21.15.187:6824/4213392126","heartbeat_front_addr":"172.21.15.187:6821/4213392126","state":["exists","up"]},{"osd":7,"uuid":"efe5e0d9-2f87-4889-a27a-e2a95a632302","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6823","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6825","nonce":85774004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6827","nonce":85774004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6831","nonce":85774004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6829","nonce":85774004}]},"public_addr":"172.21.15.187:6825/85774004","cluster_addr":"172.21.15.187:6827/85774004","heartbeat_back_addr":"172.21.15.187:6831/85774004","heartbeat_front_addr":"172.21.15.187:6829/85774004","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.214447+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.448899+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.293107+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.564184+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.175026+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.097717+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.261141+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.287681+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T10:12:48.241 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.238+0000 7fd598417640 1 -- 172.21.15.78:0/2771927647 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fd574066470 msgr2=0x7fd574068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:48.241 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.238+0000 7fd598417640 1 --2- 172.21.15.78:0/2771927647 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fd574066470 0x7fd574068930 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fd5900a9cc0 tx=0x7fd580009190 comp rx=0 tx=0).stop 2023-12-12T10:12:48.241 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.238+0000 7fd598417640 1 -- 172.21.15.78:0/2771927647 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd590071bf0 msgr2=0x7fd590137e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:48.241 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.238+0000 7fd598417640 1 --2- 172.21.15.78:0/2771927647 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd590071bf0 0x7fd590137e60 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fd58c00e870 tx=0x7fd58c00ed30 comp rx=0 tx=0).stop 2023-12-12T10:12:48.241 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.238+0000 7fd598417640 1 -- 172.21.15.78:0/2771927647 shutdown_connections 2023-12-12T10:12:48.241 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.238+0000 7fd598417640 1 --2- 172.21.15.78:0/2771927647 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fd574066470 0x7fd574068930 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:48.241 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.238+0000 7fd598417640 1 --2- 172.21.15.78:0/2771927647 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd59013f550 0x7fd5900b1a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:48.241 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.238+0000 7fd598417640 1 --2- 172.21.15.78:0/2771927647 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd59013ceb0 0x7fd5900b4390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:48.241 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.238+0000 7fd598417640 1 --2- 172.21.15.78:0/2771927647 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd590071bf0 0x7fd590137e60 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:48.241 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.238+0000 7fd598417640 1 -- 172.21.15.78:0/2771927647 >> 172.21.15.78:0/2771927647 conn(0x7fd59006c5d0 msgr2=0x7fd590071460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:48.241 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.238+0000 7fd598417640 1 -- 172.21.15.78:0/2771927647 shutdown_connections 2023-12-12T10:12:48.241 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.238+0000 7fd598417640 1 -- 172.21.15.78:0/2771927647 wait complete. 2023-12-12T10:12:48.260 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-12T10:11:57.053584+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-12T10:12:07.454450+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-12T10:12:08.182909+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-12T10:12:11.977952+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-12T10:12:48.260 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-12T10:12:48.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.398+0000 7f80a6fdf640 1 Processor -- start 2023-12-12T10:12:48.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.398+0000 7f80a6fdf640 1 -- start start 2023-12-12T10:12:48.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.398+0000 7f80a6fdf640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f80a0071610 0x7f80a0164ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:48.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.398+0000 7f80a6fdf640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80a0070a70 con 0x7f80a0143770 2023-12-12T10:12:48.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.398+0000 7f80a6fdf640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80a00ce3c0 con 0x7f80a00cdf60 2023-12-12T10:12:48.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.398+0000 7f80a6fdf640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80a015e920 con 0x7f80a0071610 2023-12-12T10:12:48.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.398+0000 7f80a4d7b640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f80a0143770 0x7f80a00b1e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:39762/0 (socket says 172.21.15.78:39762) 2023-12-12T10:12:48.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.398+0000 7f80a4d7b640 1 -- 172.21.15.78:0/439107801 learned_addr learned my addr 172.21.15.78:0/439107801 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-12-12T10:12:48.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.398+0000 7f80a557c640 1 --2- 172.21.15.78:0/439107801 >> v2:172.21.15.78:3300/0 conn(0x7f80a0071610 0x7f80a0164ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:48.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.398+0000 7f809f7fe640 1 -- 172.21.15.78:0/439107801 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1828775661 0 0) 0x7f80a0070a70 con 0x7f80a0143770 2023-12-12T10:12:48.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.398+0000 7f809f7fe640 1 -- 172.21.15.78:0/439107801 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8090005740 con 0x7f80a0143770 2023-12-12T10:12:48.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.398+0000 7f809f7fe640 1 -- 172.21.15.78:0/439107801 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3333865287 0 0) 0x7f80a00ce3c0 con 0x7f80a00cdf60 2023-12-12T10:12:48.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.398+0000 7f80a557c640 1 -- 172.21.15.78:0/439107801 >> v1:172.21.15.187:6789/0 conn(0x7f80a00cdf60 legacy=0x7f80a0070f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:48.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.398+0000 7f80a557c640 1 -- 172.21.15.78:0/439107801 >> v1:172.21.15.78:6789/0 conn(0x7f80a0143770 legacy=0x7f80a00b1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:48.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.398+0000 7f80a557c640 1 -- 172.21.15.78:0/439107801 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80a0070440 con 0x7f80a0071610 2023-12-12T10:12:48.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.402+0000 7f80a557c640 1 --2- 172.21.15.78:0/439107801 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f80a0071610 0x7f80a0164ca0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f80a0070630 tx=0x7f809801c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=110a7a8549ba0e39 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:48.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.402+0000 7f809f7fe640 1 -- 172.21.15.78:0/439107801 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80980a5a10 con 0x7f80a0071610 2023-12-12T10:12:48.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.402+0000 7f809f7fe640 1 -- 172.21.15.78:0/439107801 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80980a5b70 con 0x7f80a0071610 2023-12-12T10:12:48.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.402+0000 7f809f7fe640 1 -- 172.21.15.78:0/439107801 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80980ad440 con 0x7f80a0071610 2023-12-12T10:12:48.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.402+0000 7f80a6fdf640 1 -- 172.21.15.78:0/439107801 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f80a0071610 msgr2=0x7f80a0164ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:48.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.402+0000 7f80a6fdf640 1 --2- 172.21.15.78:0/439107801 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f80a0071610 0x7f80a0164ca0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f80a0070630 tx=0x7f809801c930 comp rx=0 tx=0).stop 2023-12-12T10:12:48.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.402+0000 7f80a6fdf640 1 -- 172.21.15.78:0/439107801 shutdown_connections 2023-12-12T10:12:48.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.402+0000 7f80a6fdf640 1 --2- 172.21.15.78:0/439107801 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f80a0071610 0x7f80a0164ca0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:48.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.402+0000 7f80a6fdf640 1 -- 172.21.15.78:0/439107801 >> 172.21.15.78:0/439107801 conn(0x7f80a006a710 msgr2=0x7f80a006ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:48.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.402+0000 7f80a6fdf640 1 -- 172.21.15.78:0/439107801 shutdown_connections 2023-12-12T10:12:48.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.402+0000 7f80a6fdf640 1 -- 172.21.15.78:0/439107801 wait complete. 2023-12-12T10:12:48.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.406+0000 7f80a6fdf640 1 Processor -- start 2023-12-12T10:12:48.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.406+0000 7f80a6fdf640 1 -- start start 2023-12-12T10:12:48.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.406+0000 7f80a6fdf640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f80a0071610 0x7f80a01520d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:48.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.406+0000 7f80a6fdf640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f80a00cdf60 0x7f80a01362d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:48.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.406+0000 7f80a6fdf640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f80a0143770 0x7f80a0136810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:48.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.406+0000 7f80a6fdf640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80a0139ba0 con 0x7f80a00cdf60 2023-12-12T10:12:48.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.406+0000 7f80a6fdf640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80a01573a0 con 0x7f80a0143770 2023-12-12T10:12:48.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.406+0000 7f80a6fdf640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80a0135ac0 con 0x7f80a0071610 2023-12-12T10:12:48.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.406+0000 7f809ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f80a00cdf60 0x7f80a01362d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:48.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.406+0000 7f809ffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f80a00cdf60 0x7f80a01362d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55924/0 (socket says 172.21.15.78:55924) 2023-12-12T10:12:48.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.406+0000 7f809ffff640 1 -- 172.21.15.78:0/1497552485 learned_addr learned my addr 172.21.15.78:0/1497552485 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:48.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.406+0000 7f80a4d7b640 1 --2- 172.21.15.78:0/1497552485 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f80a0071610 0x7f80a01520d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:48.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.406+0000 7f80a557c640 1 --2- 172.21.15.78:0/1497552485 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f80a0143770 0x7f80a0136810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:48.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.406+0000 7f809ffff640 1 -- 172.21.15.78:0/1497552485 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f80a0071610 msgr2=0x7f80a01520d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:48.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.406+0000 7f809ffff640 1 --2- 172.21.15.78:0/1497552485 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f80a0071610 0x7f80a01520d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:48.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.406+0000 7f809ffff640 1 -- 172.21.15.78:0/1497552485 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f80a0143770 msgr2=0x7f80a0136810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:48.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.406+0000 7f809ffff640 1 --2- 172.21.15.78:0/1497552485 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f80a0143770 0x7f80a0136810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:48.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.406+0000 7f809ffff640 1 -- 172.21.15.78:0/1497552485 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8098009a70 con 0x7f80a00cdf60 2023-12-12T10:12:48.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.406+0000 7f809ffff640 1 --2- 172.21.15.78:0/1497552485 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f80a00cdf60 0x7f80a01362d0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f808c00c4d0 tx=0x7f808c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:48.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.406+0000 7f809d7fa640 1 -- 172.21.15.78:0/1497552485 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f808c005480 con 0x7f80a00cdf60 2023-12-12T10:12:48.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.406+0000 7f809d7fa640 1 -- 172.21.15.78:0/1497552485 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f808c003600 con 0x7f80a00cdf60 2023-12-12T10:12:48.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.406+0000 7f809d7fa640 1 -- 172.21.15.78:0/1497552485 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f808c0039b0 con 0x7f80a00cdf60 2023-12-12T10:12:48.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.406+0000 7f80a6fdf640 1 -- 172.21.15.78:0/1497552485 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80a0135da0 con 0x7f80a00cdf60 2023-12-12T10:12:48.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.406+0000 7f80a6fdf640 1 -- 172.21.15.78:0/1497552485 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80a0157920 con 0x7f80a00cdf60 2023-12-12T10:12:48.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.406+0000 7f80a6fdf640 1 -- 172.21.15.78:0/1497552485 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80a00671f0 con 0x7f80a00cdf60 2023-12-12T10:12:48.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.410+0000 7f809d7fa640 1 -- 172.21.15.78:0/1497552485 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f808c003b10 con 0x7f80a00cdf60 2023-12-12T10:12:48.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.410+0000 7f809d7fa640 1 --2- 172.21.15.78:0/1497552485 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f80840664a0 0x7f8084068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:48.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.410+0000 7f809d7fa640 1 -- 172.21.15.78:0/1497552485 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f808c083700 con 0x7f80a00cdf60 2023-12-12T10:12:48.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.410+0000 7f80a4d7b640 1 --2- 172.21.15.78:0/1497552485 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f80840664a0 0x7f8084068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:48.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.410+0000 7f80a4d7b640 1 --2- 172.21.15.78:0/1497552485 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f80840664a0 0x7f8084068960 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f8094007fd0 tx=0x7f8094009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:48.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.414+0000 7f809d7fa640 1 -- 172.21.15.78:0/1497552485 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f808c050960 con 0x7f80a00cdf60 2023-12-12T10:12:48.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.566+0000 7f80a6fdf640 1 -- 172.21.15.78:0/1497552485 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f80a0157b40 con 0x7f80a00cdf60 2023-12-12T10:12:48.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.566+0000 7f809d7fa640 1 -- 172.21.15.78:0/1497552485 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f808c0170a0 con 0x7f80a00cdf60 2023-12-12T10:12:48.568 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2023-12-12T10:12:48.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.566+0000 7f80a6fdf640 1 -- 172.21.15.78:0/1497552485 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f80840664a0 msgr2=0x7f8084068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:48.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.566+0000 7f80a6fdf640 1 --2- 172.21.15.78:0/1497552485 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f80840664a0 0x7f8084068960 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f8094007fd0 tx=0x7f8094009040 comp rx=0 tx=0).stop 2023-12-12T10:12:48.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.566+0000 7f80a6fdf640 1 -- 172.21.15.78:0/1497552485 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f80a00cdf60 msgr2=0x7f80a01362d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:48.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.566+0000 7f80a6fdf640 1 --2- 172.21.15.78:0/1497552485 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f80a00cdf60 0x7f80a01362d0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f808c00c4d0 tx=0x7f808c00c990 comp rx=0 tx=0).stop 2023-12-12T10:12:48.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.566+0000 7f80a6fdf640 1 -- 172.21.15.78:0/1497552485 shutdown_connections 2023-12-12T10:12:48.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.566+0000 7f80a6fdf640 1 --2- 172.21.15.78:0/1497552485 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f80840664a0 0x7f8084068960 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:48.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.566+0000 7f80a6fdf640 1 --2- 172.21.15.78:0/1497552485 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f80a0143770 0x7f80a0136810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:48.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.566+0000 7f80a6fdf640 1 --2- 172.21.15.78:0/1497552485 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f80a00cdf60 0x7f80a01362d0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:48.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.566+0000 7f80a6fdf640 1 --2- 172.21.15.78:0/1497552485 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f80a0071610 0x7f80a01520d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:48.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.566+0000 7f80a6fdf640 1 -- 172.21.15.78:0/1497552485 >> 172.21.15.78:0/1497552485 conn(0x7f80a006a710 msgr2=0x7f80a00b3040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:48.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.566+0000 7f80a6fdf640 1 -- 172.21.15.78:0/1497552485 shutdown_connections 2023-12-12T10:12:48.571 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.566+0000 7f80a6fdf640 1 -- 172.21.15.78:0/1497552485 wait complete. 2023-12-12T10:12:48.589 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-12T10:12:48.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.726+0000 7f2f096e3640 1 Processor -- start 2023-12-12T10:12:48.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.726+0000 7f2f096e3640 1 -- start start 2023-12-12T10:12:48.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.726+0000 7f2f096e3640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f2f0415d510 0x7f2f040d0060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:48.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.726+0000 7f2f096e3640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2f040cec70 0x7f2f040d1a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:48.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.726+0000 7f2f096e3640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f040d1fd0 con 0x7f2f040d1630 2023-12-12T10:12:48.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.726+0000 7f2f096e3640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f0415d8f0 con 0x7f2f0415d510 2023-12-12T10:12:48.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.726+0000 7f2f096e3640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f040cf100 con 0x7f2f040cec70 2023-12-12T10:12:48.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.726+0000 7f2f02ffd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f2f0415d510 0x7f2f040d0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:48.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.726+0000 7f2f02ffd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f2f0415d510 0x7f2f040d0060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55940/0 (socket says 172.21.15.78:55940) 2023-12-12T10:12:48.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.726+0000 7f2f02ffd640 1 -- 172.21.15.78:0/2712971678 learned_addr learned my addr 172.21.15.78:0/2712971678 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:48.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.726+0000 7f2f037fe640 1 --2- 172.21.15.78:0/2712971678 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2f040cec70 0x7f2f040d1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:48.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.726+0000 7f2f02ffd640 1 -- 172.21.15.78:0/2712971678 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2f040cec70 msgr2=0x7f2f040d1a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:48.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.726+0000 7f2f02ffd640 1 --2- 172.21.15.78:0/2712971678 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2f040cec70 0x7f2f040d1a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:48.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.726+0000 7f2f02ffd640 1 -- 172.21.15.78:0/2712971678 >> v1:172.21.15.187:6789/0 conn(0x7f2f040d1630 legacy=0x7f2f040b0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:48.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.726+0000 7f2f02ffd640 1 -- 172.21.15.78:0/2712971678 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f040d3b70 con 0x7f2f0415d510 2023-12-12T10:12:48.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.730+0000 7f2f02ffd640 1 --2- 172.21.15.78:0/2712971678 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f0415d510 0x7f2f040d0060 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f2ef4009870 tx=0x7f2ef401c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5731f66e458d277b server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:48.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.730+0000 7f2f027fc640 1 -- 172.21.15.78:0/2712971678 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ef40a7070 con 0x7f2f0415d510 2023-12-12T10:12:48.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.730+0000 7f2f027fc640 1 -- 172.21.15.78:0/2712971678 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ef40ab430 con 0x7f2f0415d510 2023-12-12T10:12:48.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.730+0000 7f2f027fc640 1 -- 172.21.15.78:0/2712971678 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ef40ab7c0 con 0x7f2f0415d510 2023-12-12T10:12:48.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.730+0000 7f2f096e3640 1 -- 172.21.15.78:0/2712971678 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f0415d510 msgr2=0x7f2f040d0060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:48.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.730+0000 7f2f096e3640 1 --2- 172.21.15.78:0/2712971678 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f0415d510 0x7f2f040d0060 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f2ef4009870 tx=0x7f2ef401c540 comp rx=0 tx=0).stop 2023-12-12T10:12:48.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.730+0000 7f2f096e3640 1 -- 172.21.15.78:0/2712971678 shutdown_connections 2023-12-12T10:12:48.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.730+0000 7f2f096e3640 1 --2- 172.21.15.78:0/2712971678 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2f040cec70 0x7f2f040d1a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:48.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.730+0000 7f2f096e3640 1 --2- 172.21.15.78:0/2712971678 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f0415d510 0x7f2f040d0060 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:48.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.730+0000 7f2f096e3640 1 -- 172.21.15.78:0/2712971678 >> 172.21.15.78:0/2712971678 conn(0x7f2f040d3050 msgr2=0x7f2f040d3460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:48.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.730+0000 7f2f096e3640 1 -- 172.21.15.78:0/2712971678 shutdown_connections 2023-12-12T10:12:48.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.730+0000 7f2f096e3640 1 -- 172.21.15.78:0/2712971678 wait complete. 2023-12-12T10:12:48.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.734+0000 7f2f096e3640 1 Processor -- start 2023-12-12T10:12:48.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.734+0000 7f2f096e3640 1 -- start start 2023-12-12T10:12:48.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.734+0000 7f2f096e3640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2f040cec70 0x7f2f040b3d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:48.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.734+0000 7f2f096e3640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2f040d1630 0x7f2f040cb700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:48.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.734+0000 7f2f096e3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f0415d510 0x7f2f0415ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:48.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.734+0000 7f2f096e3640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f04154060 con 0x7f2f0415d510 2023-12-12T10:12:48.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.734+0000 7f2f096e3640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f041554f0 con 0x7f2f040d1630 2023-12-12T10:12:48.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.734+0000 7f2f096e3640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f0415f690 con 0x7f2f040cec70 2023-12-12T10:12:48.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.734+0000 7f2f037fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f0415d510 0x7f2f0415ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:48.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.734+0000 7f2f037fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f0415d510 0x7f2f0415ea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55954/0 (socket says 172.21.15.78:55954) 2023-12-12T10:12:48.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.734+0000 7f2f037fe640 1 -- 172.21.15.78:0/2899058462 learned_addr learned my addr 172.21.15.78:0/2899058462 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:48.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.734+0000 7f2f02ffd640 1 --2- 172.21.15.78:0/2899058462 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2f040cec70 0x7f2f040b3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:48.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.734+0000 7f2efa7fc640 1 --2- 172.21.15.78:0/2899058462 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2f040d1630 0x7f2f040cb700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:48.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.734+0000 7f2f037fe640 1 -- 172.21.15.78:0/2899058462 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2f040cec70 msgr2=0x7f2f040b3d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:48.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.734+0000 7f2f037fe640 1 --2- 172.21.15.78:0/2899058462 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2f040cec70 0x7f2f040b3d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:48.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.734+0000 7f2f037fe640 1 -- 172.21.15.78:0/2899058462 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2f040d1630 msgr2=0x7f2f040cb700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:48.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.734+0000 7f2f037fe640 1 --2- 172.21.15.78:0/2899058462 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2f040d1630 0x7f2f040cb700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:48.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.734+0000 7f2f037fe640 1 -- 172.21.15.78:0/2899058462 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ef40094d0 con 0x7f2f0415d510 2023-12-12T10:12:48.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.734+0000 7f2f037fe640 1 --2- 172.21.15.78:0/2899058462 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f0415d510 0x7f2f0415ea80 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f2efc007e40 tx=0x7f2efc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:48.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.734+0000 7f2efbfff640 1 -- 172.21.15.78:0/2899058462 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2efc014620 con 0x7f2f0415d510 2023-12-12T10:12:48.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.734+0000 7f2efbfff640 1 -- 172.21.15.78:0/2899058462 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2efc00ee90 con 0x7f2f0415d510 2023-12-12T10:12:48.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.734+0000 7f2f096e3640 1 -- 172.21.15.78:0/2899058462 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f0415f970 con 0x7f2f0415d510 2023-12-12T10:12:48.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.734+0000 7f2efbfff640 1 -- 172.21.15.78:0/2899058462 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2efc0149e0 con 0x7f2f0415d510 2023-12-12T10:12:48.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.734+0000 7f2f096e3640 1 -- 172.21.15.78:0/2899058462 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f04153c80 con 0x7f2f0415d510 2023-12-12T10:12:48.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.738+0000 7f2f096e3640 1 -- 172.21.15.78:0/2899058462 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f040671f0 con 0x7f2f0415d510 2023-12-12T10:12:48.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.738+0000 7f2efbfff640 1 -- 172.21.15.78:0/2899058462 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2efc014b40 con 0x7f2f0415d510 2023-12-12T10:12:48.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.738+0000 7f2efbfff640 1 --2- 172.21.15.78:0/2899058462 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f2ee4066470 0x7f2ee4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:48.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.738+0000 7f2efbfff640 1 -- 172.21.15.78:0/2899058462 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2efc0849a0 con 0x7f2f0415d510 2023-12-12T10:12:48.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.738+0000 7f2f02ffd640 1 --2- 172.21.15.78:0/2899058462 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f2ee4066470 0x7f2ee4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:48.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.738+0000 7f2f02ffd640 1 --2- 172.21.15.78:0/2899058462 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f2ee4066470 0x7f2ee4068930 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f2ef40af000 tx=0x7f2ef4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:48.745 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.742+0000 7f2efbfff640 1 -- 172.21.15.78:0/2899058462 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2efc051bd0 con 0x7f2f0415d510 2023-12-12T10:12:48.898 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.894+0000 7f2f096e3640 1 -- 172.21.15.78:0/2899058462 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2f041541a0 con 0x7f2f0415d510 2023-12-12T10:12:48.898 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.894+0000 7f2efbfff640 1 -- 172.21.15.78:0/2899058462 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2f041541a0 con 0x7f2f0415d510 2023-12-12T10:12:48.899 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2023-12-12T10:12:48.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.898+0000 7f2f096e3640 1 -- 172.21.15.78:0/2899058462 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f2ee4066470 msgr2=0x7f2ee4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:48.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.898+0000 7f2f096e3640 1 --2- 172.21.15.78:0/2899058462 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f2ee4066470 0x7f2ee4068930 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f2ef40af000 tx=0x7f2ef4008040 comp rx=0 tx=0).stop 2023-12-12T10:12:48.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.898+0000 7f2f096e3640 1 -- 172.21.15.78:0/2899058462 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f0415d510 msgr2=0x7f2f0415ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:48.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.898+0000 7f2f096e3640 1 --2- 172.21.15.78:0/2899058462 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f0415d510 0x7f2f0415ea80 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f2efc007e40 tx=0x7f2efc00e4b0 comp rx=0 tx=0).stop 2023-12-12T10:12:48.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.898+0000 7f2f096e3640 1 -- 172.21.15.78:0/2899058462 shutdown_connections 2023-12-12T10:12:48.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.898+0000 7f2f096e3640 1 --2- 172.21.15.78:0/2899058462 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f2ee4066470 0x7f2ee4068930 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:48.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.898+0000 7f2f096e3640 1 --2- 172.21.15.78:0/2899058462 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2f0415d510 0x7f2f0415ea80 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:48.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.898+0000 7f2f096e3640 1 --2- 172.21.15.78:0/2899058462 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2f040d1630 0x7f2f040cb700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:48.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.898+0000 7f2f096e3640 1 --2- 172.21.15.78:0/2899058462 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2f040cec70 0x7f2f040b3d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:48.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.898+0000 7f2f096e3640 1 -- 172.21.15.78:0/2899058462 >> 172.21.15.78:0/2899058462 conn(0x7f2f040d3050 msgr2=0x7f2f04155d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:48.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.898+0000 7f2f096e3640 1 -- 172.21.15.78:0/2899058462 shutdown_connections 2023-12-12T10:12:48.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:48.898+0000 7f2f096e3640 1 -- 172.21.15.78:0/2899058462 wait complete. 2023-12-12T10:12:48.920 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-12T10:12:49.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.058+0000 7fa7b3454640 1 Processor -- start 2023-12-12T10:12:49.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.058+0000 7fa7b3454640 1 -- start start 2023-12-12T10:12:49.063 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.058+0000 7fa7b3454640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fa7ac15e6d0 0x7fa7ac06fe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:49.063 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.058+0000 7fa7b3454640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa7ac0703a0 0x7fa7ac099a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:49.063 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.058+0000 7fa7b3454640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7ac0cf3c0 con 0x7fa7ac099f50 2023-12-12T10:12:49.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.058+0000 7fa7b3454640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7ac09a790 con 0x7fa7ac0703a0 2023-12-12T10:12:49.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.058+0000 7fa7b3454640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7ac0cf680 con 0x7fa7ac15e6d0 2023-12-12T10:12:49.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.058+0000 7fa7b19f1640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fa7ac099f50 0x7fa7ac06e540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:39772/0 (socket says 172.21.15.78:39772) 2023-12-12T10:12:49.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.058+0000 7fa7b19f1640 1 -- 172.21.15.78:0/846425822 learned_addr learned my addr 172.21.15.78:0/846425822 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-12-12T10:12:49.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.058+0000 7fa7b09ef640 1 --2- 172.21.15.78:0/846425822 >> v2:172.21.15.78:3300/0 conn(0x7fa7ac0703a0 0x7fa7ac099a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:49.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.058+0000 7fa7b11f0640 1 --2- 172.21.15.78:0/846425822 >> v2:172.21.15.187:3300/0 conn(0x7fa7ac15e6d0 0x7fa7ac06fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:49.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.062+0000 7fa7b09ef640 1 -- 172.21.15.78:0/846425822 >> v2:172.21.15.187:3300/0 conn(0x7fa7ac15e6d0 msgr2=0x7fa7ac06fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:49.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.062+0000 7fa7b09ef640 1 --2- 172.21.15.78:0/846425822 >> v2:172.21.15.187:3300/0 conn(0x7fa7ac15e6d0 0x7fa7ac06fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:49.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.062+0000 7fa7b09ef640 1 -- 172.21.15.78:0/846425822 >> v1:172.21.15.78:6789/0 conn(0x7fa7ac099f50 legacy=0x7fa7ac06e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:49.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.062+0000 7fa7b09ef640 1 -- 172.21.15.78:0/846425822 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7ac0cf960 con 0x7fa7ac0703a0 2023-12-12T10:12:49.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.062+0000 7fa7b11f0640 1 --2- 172.21.15.78:0/846425822 >> v2:172.21.15.187:3300/0 conn(0x7fa7ac15e6d0 0x7fa7ac06fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-12T10:12:49.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.062+0000 7fa7b09ef640 1 --2- 172.21.15.78:0/846425822 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa7ac0703a0 0x7fa7ac099a10 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fa7ac073ae0 tx=0x7fa79c01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3c9c458d7cf6466 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:49.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.062+0000 7fa7a3fff640 1 -- 172.21.15.78:0/846425822 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7ac09a590 con 0x7fa7ac0703a0 2023-12-12T10:12:49.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.062+0000 7fa7a3fff640 1 -- 172.21.15.78:0/846425822 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa79c0ab680 con 0x7fa7ac0703a0 2023-12-12T10:12:49.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.062+0000 7fa7a3fff640 1 -- 172.21.15.78:0/846425822 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa79c0aba10 con 0x7fa7ac0703a0 2023-12-12T10:12:49.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.062+0000 7fa7b3454640 1 -- 172.21.15.78:0/846425822 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa7ac0703a0 msgr2=0x7fa7ac099a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:49.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.062+0000 7fa7b3454640 1 --2- 172.21.15.78:0/846425822 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa7ac0703a0 0x7fa7ac099a10 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fa7ac073ae0 tx=0x7fa79c01c460 comp rx=0 tx=0).stop 2023-12-12T10:12:49.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.066+0000 7fa7b3454640 1 -- 172.21.15.78:0/846425822 shutdown_connections 2023-12-12T10:12:49.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.066+0000 7fa7b3454640 1 --2- 172.21.15.78:0/846425822 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa7ac0703a0 0x7fa7ac099a10 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:49.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.066+0000 7fa7b3454640 1 --2- 172.21.15.78:0/846425822 >> v2:172.21.15.187:3300/0 conn(0x7fa7ac15e6d0 0x7fa7ac06fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:49.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.066+0000 7fa7b3454640 1 -- 172.21.15.78:0/846425822 >> 172.21.15.78:0/846425822 conn(0x7fa7ac0d0de0 msgr2=0x7fa7ac0d11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:49.069 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.066+0000 7fa7b3454640 1 -- 172.21.15.78:0/846425822 shutdown_connections 2023-12-12T10:12:49.069 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.066+0000 7fa7b3454640 1 -- 172.21.15.78:0/846425822 wait complete. 2023-12-12T10:12:49.069 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.066+0000 7fa7b3454640 1 Processor -- start 2023-12-12T10:12:49.069 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.066+0000 7fa7b3454640 1 -- start start 2023-12-12T10:12:49.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.066+0000 7fa7b3454640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa7ac0703a0 0x7fa7ac15a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:49.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.066+0000 7fa7b3454640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa7ac099f50 0x7fa7ac164890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:49.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.066+0000 7fa7b3454640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa7ac15e6d0 0x7fa7ac0b60b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:49.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.066+0000 7fa7b3454640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7ac0b5170 con 0x7fa7ac099f50 2023-12-12T10:12:49.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.066+0000 7fa7b3454640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7ac164dd0 con 0x7fa7ac15e6d0 2023-12-12T10:12:49.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.066+0000 7fa7b3454640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7ac0b4e90 con 0x7fa7ac0703a0 2023-12-12T10:12:49.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.066+0000 7fa7b09ef640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa7ac099f50 0x7fa7ac164890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:49.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.066+0000 7fa7b09ef640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa7ac099f50 0x7fa7ac164890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55978/0 (socket says 172.21.15.78:55978) 2023-12-12T10:12:49.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.066+0000 7fa7b09ef640 1 -- 172.21.15.78:0/361806402 learned_addr learned my addr 172.21.15.78:0/361806402 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:49.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.066+0000 7fa7b11f0640 1 --2- 172.21.15.78:0/361806402 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa7ac0703a0 0x7fa7ac15a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:49.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.066+0000 7fa7b19f1640 1 --2- 172.21.15.78:0/361806402 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa7ac15e6d0 0x7fa7ac0b60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:49.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.066+0000 7fa7b09ef640 1 -- 172.21.15.78:0/361806402 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa7ac0703a0 msgr2=0x7fa7ac15a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:49.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.066+0000 7fa7b09ef640 1 --2- 172.21.15.78:0/361806402 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa7ac0703a0 0x7fa7ac15a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:49.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.066+0000 7fa7b09ef640 1 -- 172.21.15.78:0/361806402 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa7ac15e6d0 msgr2=0x7fa7ac0b60b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:49.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.066+0000 7fa7b09ef640 1 --2- 172.21.15.78:0/361806402 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa7ac15e6d0 0x7fa7ac0b60b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:49.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.066+0000 7fa7b09ef640 1 -- 172.21.15.78:0/361806402 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7a8009420 con 0x7fa7ac099f50 2023-12-12T10:12:49.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.066+0000 7fa7b19f1640 1 --2- 172.21.15.78:0/361806402 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa7ac15e6d0 0x7fa7ac0b60b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T10:12:49.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.066+0000 7fa7b09ef640 1 --2- 172.21.15.78:0/361806402 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa7ac099f50 0x7fa7ac164890 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fa79c019070 tx=0x7fa79c01aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:49.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.070+0000 7fa7a1ffb640 1 -- 172.21.15.78:0/361806402 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa79c0b5610 con 0x7fa7ac099f50 2023-12-12T10:12:49.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.070+0000 7fa7a1ffb640 1 -- 172.21.15.78:0/361806402 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa79c0b5790 con 0x7fa7ac099f50 2023-12-12T10:12:49.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.070+0000 7fa7a1ffb640 1 -- 172.21.15.78:0/361806402 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa79c0b5b40 con 0x7fa7ac099f50 2023-12-12T10:12:49.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.070+0000 7fa7b3454640 1 -- 172.21.15.78:0/361806402 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa79c009420 con 0x7fa7ac099f50 2023-12-12T10:12:49.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.070+0000 7fa7b3454640 1 -- 172.21.15.78:0/361806402 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7ac164090 con 0x7fa7ac099f50 2023-12-12T10:12:49.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.070+0000 7fa7b3454640 1 -- 172.21.15.78:0/361806402 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7ac0671f0 con 0x7fa7ac099f50 2023-12-12T10:12:49.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.070+0000 7fa7a1ffb640 1 -- 172.21.15.78:0/361806402 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa79c0b5ca0 con 0x7fa7ac099f50 2023-12-12T10:12:49.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.070+0000 7fa7a1ffb640 1 --2- 172.21.15.78:0/361806402 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fa790066470 0x7fa790068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:49.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.074+0000 7fa7a1ffb640 1 -- 172.21.15.78:0/361806402 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa79c11eb70 con 0x7fa7ac099f50 2023-12-12T10:12:49.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.074+0000 7fa7b11f0640 1 --2- 172.21.15.78:0/361806402 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fa790066470 0x7fa790068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:49.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.074+0000 7fa7b11f0640 1 --2- 172.21.15.78:0/361806402 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fa790066470 0x7fa790068930 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa7a8009c60 tx=0x7fa7a8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:49.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.078+0000 7fa7a1ffb640 1 -- 172.21.15.78:0/361806402 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa79c0ebce0 con 0x7fa7ac099f50 2023-12-12T10:12:49.230 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.226+0000 7fa7b3454640 1 -- 172.21.15.78:0/361806402 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa7ac0d0770 con 0x7fa7ac099f50 2023-12-12T10:12:49.230 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.226+0000 7fa7a1ffb640 1 -- 172.21.15.78:0/361806402 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa79c0ef300 con 0x7fa7ac099f50 2023-12-12T10:12:49.231 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2023-12-12T10:12:49.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.230+0000 7fa7b3454640 1 -- 172.21.15.78:0/361806402 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fa790066470 msgr2=0x7fa790068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:49.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.230+0000 7fa7b3454640 1 --2- 172.21.15.78:0/361806402 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fa790066470 0x7fa790068930 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa7a8009c60 tx=0x7fa7a8008040 comp rx=0 tx=0).stop 2023-12-12T10:12:49.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.230+0000 7fa7b3454640 1 -- 172.21.15.78:0/361806402 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa7ac099f50 msgr2=0x7fa7ac164890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:49.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.230+0000 7fa7b3454640 1 --2- 172.21.15.78:0/361806402 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa7ac099f50 0x7fa7ac164890 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fa79c019070 tx=0x7fa79c01aca0 comp rx=0 tx=0).stop 2023-12-12T10:12:49.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.230+0000 7fa7b3454640 1 -- 172.21.15.78:0/361806402 shutdown_connections 2023-12-12T10:12:49.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.230+0000 7fa7b3454640 1 --2- 172.21.15.78:0/361806402 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fa790066470 0x7fa790068930 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:49.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.230+0000 7fa7b3454640 1 --2- 172.21.15.78:0/361806402 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa7ac15e6d0 0x7fa7ac0b60b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:49.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.230+0000 7fa7b3454640 1 --2- 172.21.15.78:0/361806402 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa7ac099f50 0x7fa7ac164890 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:49.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.230+0000 7fa7b3454640 1 --2- 172.21.15.78:0/361806402 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa7ac0703a0 0x7fa7ac15a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:49.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.230+0000 7fa7b3454640 1 -- 172.21.15.78:0/361806402 >> 172.21.15.78:0/361806402 conn(0x7fa7ac0d0de0 msgr2=0x7fa7ac0ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:49.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.230+0000 7fa7b3454640 1 -- 172.21.15.78:0/361806402 shutdown_connections 2023-12-12T10:12:49.234 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.230+0000 7fa7b3454640 1 -- 172.21.15.78:0/361806402 wait complete. 2023-12-12T10:12:49.251 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-12T10:12:49.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.390+0000 7f9299ad6640 1 Processor -- start 2023-12-12T10:12:49.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.390+0000 7f9299ad6640 1 -- start start 2023-12-12T10:12:49.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.390+0000 7f9299ad6640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9294143770 0x7f92940cdf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:49.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.390+0000 7f9299ad6640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f9294071610 0x7f929415d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:49.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.390+0000 7f9299ad6640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9294070a70 con 0x7f92940b1e20 2023-12-12T10:12:49.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.390+0000 7f9299ad6640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9294070440 con 0x7f9294071610 2023-12-12T10:12:49.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.390+0000 7f9299ad6640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9294143b50 con 0x7f9294143770 2023-12-12T10:12:49.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.390+0000 7f9293fff640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f9294071610 0x7f929415d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:49.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.390+0000 7f92937fe640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9294143770 0x7f92940cdf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:49.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.390+0000 7f92937fe640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9294143770 0x7f92940cdf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.78:59150/0 (socket says 172.21.15.78:59150) 2023-12-12T10:12:49.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.390+0000 7f928bfff640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f92940b1e20 0x7f9294070f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.78:57678/0 (socket says 172.21.15.78:57678) 2023-12-12T10:12:49.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.390+0000 7f92937fe640 1 -- 172.21.15.78:0/272592124 learned_addr learned my addr 172.21.15.78:0/272592124 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:49.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.390+0000 7f9293fff640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f9294071610 0x7f929415d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.78:45058/0 (socket says 172.21.15.78:45058) 2023-12-12T10:12:49.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.390+0000 7f92937fe640 1 -- 172.21.15.78:0/272592124 >> v2:172.21.15.187:3300/0 conn(0x7f9294071610 msgr2=0x7f929415d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:49.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.390+0000 7f92937fe640 1 --2- 172.21.15.78:0/272592124 >> v2:172.21.15.187:3300/0 conn(0x7f9294071610 0x7f929415d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:49.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.390+0000 7f92937fe640 1 -- 172.21.15.78:0/272592124 >> v1:172.21.15.187:6789/0 conn(0x7f92940b1e20 legacy=0x7f9294070f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:49.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.390+0000 7f92937fe640 1 -- 172.21.15.78:0/272592124 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92940ce620 con 0x7f9294143770 2023-12-12T10:12:49.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.390+0000 7f9292ffd640 1 -- 172.21.15.78:0/272592124 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1759929912 0 0) 0x7f9294070a70 con 0x7f92940b1e20 2023-12-12T10:12:49.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.394+0000 7f92937fe640 1 --2- 172.21.15.78:0/272592124 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9294143770 0x7f92940cdf60 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f928400bb10 tx=0x7f928401eb80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9cbc7d59c2a3b655 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:49.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.394+0000 7f9292ffd640 1 -- 172.21.15.78:0/272592124 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92840a7c70 con 0x7f9294143770 2023-12-12T10:12:49.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.394+0000 7f9292ffd640 1 -- 172.21.15.78:0/272592124 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92840a7dd0 con 0x7f9294143770 2023-12-12T10:12:49.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.394+0000 7f9292ffd640 1 -- 172.21.15.78:0/272592124 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92840af660 con 0x7f9294143770 2023-12-12T10:12:49.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.394+0000 7f9299ad6640 1 -- 172.21.15.78:0/272592124 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9294143770 msgr2=0x7f92940cdf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:49.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.394+0000 7f9299ad6640 1 --2- 172.21.15.78:0/272592124 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9294143770 0x7f92940cdf60 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f928400bb10 tx=0x7f928401eb80 comp rx=0 tx=0).stop 2023-12-12T10:12:49.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.394+0000 7f9299ad6640 1 -- 172.21.15.78:0/272592124 shutdown_connections 2023-12-12T10:12:49.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.394+0000 7f9299ad6640 1 --2- 172.21.15.78:0/272592124 >> v2:172.21.15.187:3300/0 conn(0x7f9294071610 0x7f929415d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:49.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.394+0000 7f9299ad6640 1 --2- 172.21.15.78:0/272592124 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9294143770 0x7f92940cdf60 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:49.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.394+0000 7f9299ad6640 1 -- 172.21.15.78:0/272592124 >> 172.21.15.78:0/272592124 conn(0x7f929406a710 msgr2=0x7f929406ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:49.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.394+0000 7f9299ad6640 1 -- 172.21.15.78:0/272592124 shutdown_connections 2023-12-12T10:12:49.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.394+0000 7f9299ad6640 1 -- 172.21.15.78:0/272592124 wait complete. 2023-12-12T10:12:49.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.398+0000 7f9299ad6640 1 Processor -- start 2023-12-12T10:12:49.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.398+0000 7f9299ad6640 1 -- start start 2023-12-12T10:12:49.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.398+0000 7f9299ad6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9294071610 0x7f92940ab3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:49.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.398+0000 7f9299ad6640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f92940b1e20 0x7f9294139030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:49.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.398+0000 7f9299ad6640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9294143770 0x7f9294139570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:49.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.398+0000 7f9299ad6640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9294139ab0 con 0x7f9294071610 2023-12-12T10:12:49.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.398+0000 7f9299ad6640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f929413a8e0 con 0x7f9294143770 2023-12-12T10:12:49.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.398+0000 7f9299ad6640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9294139cd0 con 0x7f92940b1e20 2023-12-12T10:12:49.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.398+0000 7f92937fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9294071610 0x7f92940ab3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:49.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.398+0000 7f92937fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9294071610 0x7f92940ab3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58686/0 (socket says 172.21.15.78:58686) 2023-12-12T10:12:49.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.398+0000 7f92937fe640 1 -- 172.21.15.78:0/1991239455 learned_addr learned my addr 172.21.15.78:0/1991239455 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:49.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.398+0000 7f928bfff640 1 --2- 172.21.15.78:0/1991239455 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f92940b1e20 0x7f9294139030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:49.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.398+0000 7f9293fff640 1 --2- 172.21.15.78:0/1991239455 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9294143770 0x7f9294139570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:49.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.398+0000 7f92937fe640 1 -- 172.21.15.78:0/1991239455 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f92940b1e20 msgr2=0x7f9294139030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:49.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.398+0000 7f92937fe640 1 --2- 172.21.15.78:0/1991239455 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f92940b1e20 0x7f9294139030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:49.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.398+0000 7f92937fe640 1 -- 172.21.15.78:0/1991239455 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9294143770 msgr2=0x7f9294139570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:49.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.398+0000 7f92937fe640 1 --2- 172.21.15.78:0/1991239455 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9294143770 0x7f9294139570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:49.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.398+0000 7f92937fe640 1 -- 172.21.15.78:0/1991239455 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f928400b770 con 0x7f9294071610 2023-12-12T10:12:49.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.398+0000 7f9293fff640 1 --2- 172.21.15.78:0/1991239455 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9294143770 0x7f9294139570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T10:12:49.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.398+0000 7f92937fe640 1 --2- 172.21.15.78:0/1991239455 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9294071610 0x7f92940ab3e0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f928400b2c0 tx=0x7f928401d3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:49.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.398+0000 7f9290ff9640 1 -- 172.21.15.78:0/1991239455 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92840ba680 con 0x7f9294071610 2023-12-12T10:12:49.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.398+0000 7f9290ff9640 1 -- 172.21.15.78:0/1991239455 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92840ba800 con 0x7f9294071610 2023-12-12T10:12:49.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.398+0000 7f9299ad6640 1 -- 172.21.15.78:0/1991239455 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9294139fb0 con 0x7f9294071610 2023-12-12T10:12:49.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.398+0000 7f9290ff9640 1 -- 172.21.15.78:0/1991239455 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92840babb0 con 0x7f9294071610 2023-12-12T10:12:49.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.398+0000 7f9299ad6640 1 -- 172.21.15.78:0/1991239455 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f929413a570 con 0x7f9294071610 2023-12-12T10:12:49.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.402+0000 7f9299ad6640 1 -- 172.21.15.78:0/1991239455 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92940671f0 con 0x7f9294071610 2023-12-12T10:12:49.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.402+0000 7f9290ff9640 1 -- 172.21.15.78:0/1991239455 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f92840bad10 con 0x7f9294071610 2023-12-12T10:12:49.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.402+0000 7f9290ff9640 1 --2- 172.21.15.78:0/1991239455 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f9274066470 0x7f9274068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:49.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.402+0000 7f9290ff9640 1 -- 172.21.15.78:0/1991239455 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f928411f770 con 0x7f9294071610 2023-12-12T10:12:49.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.402+0000 7f928bfff640 1 --2- 172.21.15.78:0/1991239455 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f9274066470 0x7f9274068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:49.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.402+0000 7f928bfff640 1 --2- 172.21.15.78:0/1991239455 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f9274066470 0x7f9274068930 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f929415a070 tx=0x7f927c007d60 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:49.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.406+0000 7f9290ff9640 1 -- 172.21.15.78:0/1991239455 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f92840ec980 con 0x7f9294071610 2023-12-12T10:12:49.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.554+0000 7f9299ad6640 1 -- 172.21.15.78:0/1991239455 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f9294067530 con 0x7f9294071610 2023-12-12T10:12:49.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.554+0000 7f9290ff9640 1 -- 172.21.15.78:0/1991239455 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) v1 ==== 103+0+11 (secure 0 0 0) 0x7f92840effa0 con 0x7f9294071610 2023-12-12T10:12:49.559 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2023-12-12T10:12:49.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.558+0000 7f9299ad6640 1 -- 172.21.15.78:0/1991239455 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f9274066470 msgr2=0x7f9274068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:49.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.558+0000 7f9299ad6640 1 --2- 172.21.15.78:0/1991239455 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f9274066470 0x7f9274068930 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f929415a070 tx=0x7f927c007d60 comp rx=0 tx=0).stop 2023-12-12T10:12:49.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.558+0000 7f9299ad6640 1 -- 172.21.15.78:0/1991239455 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9294071610 msgr2=0x7f92940ab3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:49.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.558+0000 7f9299ad6640 1 --2- 172.21.15.78:0/1991239455 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9294071610 0x7f92940ab3e0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f928400b2c0 tx=0x7f928401d3c0 comp rx=0 tx=0).stop 2023-12-12T10:12:49.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.558+0000 7f9299ad6640 1 -- 172.21.15.78:0/1991239455 shutdown_connections 2023-12-12T10:12:49.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.558+0000 7f9299ad6640 1 --2- 172.21.15.78:0/1991239455 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f9274066470 0x7f9274068930 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:49.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.558+0000 7f9299ad6640 1 --2- 172.21.15.78:0/1991239455 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9294143770 0x7f9294139570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:49.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.558+0000 7f9299ad6640 1 --2- 172.21.15.78:0/1991239455 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f92940b1e20 0x7f9294139030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:49.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.558+0000 7f9299ad6640 1 --2- 172.21.15.78:0/1991239455 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9294071610 0x7f92940ab3e0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:49.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.558+0000 7f9299ad6640 1 -- 172.21.15.78:0/1991239455 >> 172.21.15.78:0/1991239455 conn(0x7f929406a710 msgr2=0x7f929415b920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:49.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.558+0000 7f9299ad6640 1 -- 172.21.15.78:0/1991239455 shutdown_connections 2023-12-12T10:12:49.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.558+0000 7f9299ad6640 1 -- 172.21.15.78:0/1991239455 wait complete. 2023-12-12T10:12:49.580 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T10:12:49.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.714+0000 7f7273a9a640 1 Processor -- start 2023-12-12T10:12:49.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.714+0000 7f7273a9a640 1 -- start start 2023-12-12T10:12:49.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.714+0000 7f7273a9a640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f726c0ade10 0x7f726c0ce5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:49.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.714+0000 7f7273a9a640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f726c0b47d0 0x7f726c1580a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:49.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.714+0000 7f7273a9a640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f726c0ae1f0 con 0x7f726c0cb7e0 2023-12-12T10:12:49.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.714+0000 7f7273a9a640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f726c15c410 con 0x7f726c0ade10 2023-12-12T10:12:49.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.714+0000 7f7273a9a640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f726c0ceb00 con 0x7f726c0b47d0 2023-12-12T10:12:49.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.714+0000 7f7271836640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f726c0ade10 0x7f726c0ce5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:49.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.714+0000 7f7271836640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f726c0ade10 0x7f726c0ce5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58696/0 (socket says 172.21.15.78:58696) 2023-12-12T10:12:49.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.714+0000 7f7271836640 1 -- 172.21.15.78:0/4023427988 learned_addr learned my addr 172.21.15.78:0/4023427988 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:49.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.714+0000 7f7272037640 1 --2- 172.21.15.78:0/4023427988 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f726c0b47d0 0x7f726c1580a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:49.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.718+0000 7f7271836640 1 -- 172.21.15.78:0/4023427988 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f726c0b47d0 msgr2=0x7f726c1580a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:49.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.718+0000 7f7271836640 1 --2- 172.21.15.78:0/4023427988 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f726c0b47d0 0x7f726c1580a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:49.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.718+0000 7f7271836640 1 -- 172.21.15.78:0/4023427988 >> v1:172.21.15.187:6789/0 conn(0x7f726c0cb7e0 legacy=0x7f726c0b40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:49.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.718+0000 7f7271836640 1 -- 172.21.15.78:0/4023427988 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f726c15b800 con 0x7f726c0ade10 2023-12-12T10:12:49.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.718+0000 7f7272037640 1 --2- 172.21.15.78:0/4023427988 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f726c0b47d0 0x7f726c1580a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T10:12:49.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.718+0000 7f7271836640 1 --2- 172.21.15.78:0/4023427988 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f726c0ade10 0x7f726c0ce5c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f7268009870 tx=0x7f726801c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e296622973b71568 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:49.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.718+0000 7f7270834640 1 -- 172.21.15.78:0/4023427988 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72680ab600 con 0x7f726c0ade10 2023-12-12T10:12:49.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.718+0000 7f7270834640 1 -- 172.21.15.78:0/4023427988 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72680a7050 con 0x7f726c0ade10 2023-12-12T10:12:49.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.718+0000 7f7270834640 1 -- 172.21.15.78:0/4023427988 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72680ab980 con 0x7f726c0ade10 2023-12-12T10:12:49.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.718+0000 7f7273a9a640 1 -- 172.21.15.78:0/4023427988 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f726c0ade10 msgr2=0x7f726c0ce5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:49.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.718+0000 7f7273a9a640 1 --2- 172.21.15.78:0/4023427988 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f726c0ade10 0x7f726c0ce5c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f7268009870 tx=0x7f726801c360 comp rx=0 tx=0).stop 2023-12-12T10:12:49.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.718+0000 7f7273a9a640 1 -- 172.21.15.78:0/4023427988 shutdown_connections 2023-12-12T10:12:49.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.718+0000 7f7273a9a640 1 --2- 172.21.15.78:0/4023427988 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f726c0b47d0 0x7f726c1580a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:49.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.718+0000 7f7273a9a640 1 --2- 172.21.15.78:0/4023427988 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f726c0ade10 0x7f726c0ce5c0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:49.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.718+0000 7f7273a9a640 1 -- 172.21.15.78:0/4023427988 >> 172.21.15.78:0/4023427988 conn(0x7f726c06c5d0 msgr2=0x7f726c06c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:49.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.722+0000 7f7273a9a640 1 -- 172.21.15.78:0/4023427988 shutdown_connections 2023-12-12T10:12:49.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.722+0000 7f7273a9a640 1 -- 172.21.15.78:0/4023427988 wait complete. 2023-12-12T10:12:49.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.722+0000 7f7273a9a640 1 Processor -- start 2023-12-12T10:12:49.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.722+0000 7f7273a9a640 1 -- start start 2023-12-12T10:12:49.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.722+0000 7f7273a9a640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f726c0ade10 0x7f726c1f6450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:49.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.722+0000 7f7273a9a640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f726c0b47d0 0x7f726c151e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:49.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.722+0000 7f7273a9a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f726c0cb7e0 0x7f726c150510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:49.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.722+0000 7f7273a9a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f726c150d60 con 0x7f726c0cb7e0 2023-12-12T10:12:49.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.722+0000 7f7273a9a640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f726c151040 con 0x7f726c0ade10 2023-12-12T10:12:49.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.722+0000 7f7273a9a640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f726c151320 con 0x7f726c0b47d0 2023-12-12T10:12:49.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.722+0000 7f7272037640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f726c0cb7e0 0x7f726c150510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:49.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.722+0000 7f7272037640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f726c0cb7e0 0x7f726c150510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58710/0 (socket says 172.21.15.78:58710) 2023-12-12T10:12:49.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.722+0000 7f7272037640 1 -- 172.21.15.78:0/1785470383 learned_addr learned my addr 172.21.15.78:0/1785470383 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:49.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.722+0000 7f7271035640 1 --2- 172.21.15.78:0/1785470383 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f726c0b47d0 0x7f726c151e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:49.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.722+0000 7f7271836640 1 --2- 172.21.15.78:0/1785470383 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f726c0ade10 0x7f726c1f6450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:49.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.722+0000 7f7272037640 1 -- 172.21.15.78:0/1785470383 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f726c0b47d0 msgr2=0x7f726c151e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:49.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.722+0000 7f7272037640 1 --2- 172.21.15.78:0/1785470383 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f726c0b47d0 0x7f726c151e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:49.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.722+0000 7f7272037640 1 -- 172.21.15.78:0/1785470383 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f726c0ade10 msgr2=0x7f726c1f6450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:49.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.722+0000 7f7272037640 1 --2- 172.21.15.78:0/1785470383 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f726c0ade10 0x7f726c1f6450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:49.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.722+0000 7f7272037640 1 -- 172.21.15.78:0/1785470383 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72680094d0 con 0x7f726c0cb7e0 2023-12-12T10:12:49.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.722+0000 7f7272037640 1 --2- 172.21.15.78:0/1785470383 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f726c0cb7e0 0x7f726c150510 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f7264007e30 tx=0x7f726400d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:49.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.722+0000 7f72627fc640 1 -- 172.21.15.78:0/1785470383 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7264003ba0 con 0x7f726c0cb7e0 2023-12-12T10:12:49.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.722+0000 7f72627fc640 1 -- 172.21.15.78:0/1785470383 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f726400f040 con 0x7f726c0cb7e0 2023-12-12T10:12:49.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.722+0000 7f72627fc640 1 -- 172.21.15.78:0/1785470383 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f726400de80 con 0x7f726c0cb7e0 2023-12-12T10:12:49.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.722+0000 7f7273a9a640 1 -- 172.21.15.78:0/1785470383 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f726c151600 con 0x7f726c0cb7e0 2023-12-12T10:12:49.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.726+0000 7f7273a9a640 1 -- 172.21.15.78:0/1785470383 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f726c150a50 con 0x7f726c0cb7e0 2023-12-12T10:12:49.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.726+0000 7f7273a9a640 1 -- 172.21.15.78:0/1785470383 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f726c0671f0 con 0x7f726c0cb7e0 2023-12-12T10:12:49.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.726+0000 7f72627fc640 1 -- 172.21.15.78:0/1785470383 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7264004030 con 0x7f726c0cb7e0 2023-12-12T10:12:49.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.726+0000 7f72627fc640 1 --2- 172.21.15.78:0/1785470383 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f7250066470 0x7f7250068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:49.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.726+0000 7f72627fc640 1 -- 172.21.15.78:0/1785470383 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7264084490 con 0x7f726c0cb7e0 2023-12-12T10:12:49.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.726+0000 7f7271836640 1 --2- 172.21.15.78:0/1785470383 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f7250066470 0x7f7250068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:49.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.726+0000 7f7271836640 1 --2- 172.21.15.78:0/1785470383 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f7250066470 0x7f7250068930 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f72680ad000 tx=0x7f7268008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:49.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.730+0000 7f72627fc640 1 -- 172.21.15.78:0/1785470383 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7264051630 con 0x7f726c0cb7e0 2023-12-12T10:12:49.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.886+0000 7f7273a9a640 1 -- 172.21.15.78:0/1785470383 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f726c15c8a0 con 0x7f726c0cb7e0 2023-12-12T10:12:49.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.886+0000 7f72627fc640 1 -- 172.21.15.78:0/1785470383 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+18310 (secure 0 0 0) 0x7f726c15c8a0 con 0x7f726c0cb7e0 2023-12-12T10:12:49.890 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:12:49.891 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":24,"fsid":"fc81937c-bd26-483c-952b-d1324fcb0c9e","created":"2023-12-12T10:11:44.020214+0000","modified":"2023-12-12T10:12:14.355146+0000","last_up_change":"2023-12-12T10:11:56.278318+0000","last_in_change":"2023-12-12T10:11:46.553610+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T10:11:57.053584+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-12T10:12:07.454450+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-12T10:12:08.182909+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-12T10:12:11.977952+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"22dfdedf-5f6c-4b20-9f6c-30517a1db70a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6809","nonce":3345683600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6811","nonce":3345683600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6815","nonce":3345683600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6813","nonce":3345683600}]},"public_addr":"172.21.15.78:6809/3345683600","cluster_addr":"172.21.15.78:6811/3345683600","heartbeat_back_addr":"172.21.15.78:6815/3345683600","heartbeat_front_addr":"172.21.15.78:6813/3345683600","state":["exists","up"]},{"osd":1,"uuid":"be34a7f3-a69a-462e-9ddf-5e537448dba2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6801","nonce":962652768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6803","nonce":962652768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6807","nonce":962652768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6805","nonce":962652768}]},"public_addr":"172.21.15.78:6801/962652768","cluster_addr":"172.21.15.78:6803/962652768","heartbeat_back_addr":"172.21.15.78:6807/962652768","heartbeat_front_addr":"172.21.15.78:6805/962652768","state":["exists","up"]},{"osd":2,"uuid":"55b381de-5f56-4b14-80f7-e6e41e084a13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6818","nonce":2910206054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6822","nonce":2910206054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6829","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6831","nonce":2910206054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6826","nonce":2910206054}]},"public_addr":"172.21.15.78:6818/2910206054","cluster_addr":"172.21.15.78:6822/2910206054","heartbeat_back_addr":"172.21.15.78:6831/2910206054","heartbeat_front_addr":"172.21.15.78:6826/2910206054","state":["exists","up"]},{"osd":3,"uuid":"d7682de1-25cb-4cec-869f-8851c28b0e6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6819","nonce":3750796703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6821","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6823","nonce":3750796703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6830","nonce":3750796703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6825","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6827","nonce":3750796703}]},"public_addr":"172.21.15.78:6819/3750796703","cluster_addr":"172.21.15.78:6823/3750796703","heartbeat_back_addr":"172.21.15.78:6830/3750796703","heartbeat_front_addr":"172.21.15.78:6827/3750796703","state":["exists","up"]},{"osd":4,"uuid":"8279815a-d6c7-4199-871e-d28971b9dc07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6809","nonce":2944277204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6811","nonce":2944277204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6815","nonce":2944277204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6813","nonce":2944277204}]},"public_addr":"172.21.15.187:6809/2944277204","cluster_addr":"172.21.15.187:6811/2944277204","heartbeat_back_addr":"172.21.15.187:6815/2944277204","heartbeat_front_addr":"172.21.15.187:6813/2944277204","state":["exists","up"]},{"osd":5,"uuid":"0a714c65-f8ce-4340-968f-11a799677ef3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6801","nonce":185858620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6803","nonce":185858620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6807","nonce":185858620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6805","nonce":185858620}]},"public_addr":"172.21.15.187:6801/185858620","cluster_addr":"172.21.15.187:6803/185858620","heartbeat_back_addr":"172.21.15.187:6807/185858620","heartbeat_front_addr":"172.21.15.187:6805/185858620","state":["exists","up"]},{"osd":6,"uuid":"d0bba9ab-f7ee-449e-8999-1c0cf7e6d53c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6817","nonce":4213392126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6819","nonce":4213392126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6824","nonce":4213392126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6821","nonce":4213392126}]},"public_addr":"172.21.15.187:6817/4213392126","cluster_addr":"172.21.15.187:6819/4213392126","heartbeat_back_addr":"172.21.15.187:6824/4213392126","heartbeat_front_addr":"172.21.15.187:6821/4213392126","state":["exists","up"]},{"osd":7,"uuid":"efe5e0d9-2f87-4889-a27a-e2a95a632302","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6823","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6825","nonce":85774004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6827","nonce":85774004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6831","nonce":85774004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6829","nonce":85774004}]},"public_addr":"172.21.15.187:6825/85774004","cluster_addr":"172.21.15.187:6827/85774004","heartbeat_back_addr":"172.21.15.187:6831/85774004","heartbeat_front_addr":"172.21.15.187:6829/85774004","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.214447+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.448899+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.293107+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.564184+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.175026+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.097717+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.261141+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.287681+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T10:12:49.892 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.890+0000 7f7273a9a640 1 -- 172.21.15.78:0/1785470383 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f7250066470 msgr2=0x7f7250068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:49.892 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.890+0000 7f7273a9a640 1 --2- 172.21.15.78:0/1785470383 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f7250066470 0x7f7250068930 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f72680ad000 tx=0x7f7268008040 comp rx=0 tx=0).stop 2023-12-12T10:12:49.892 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.890+0000 7f7273a9a640 1 -- 172.21.15.78:0/1785470383 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f726c0cb7e0 msgr2=0x7f726c150510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:49.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.890+0000 7f7273a9a640 1 --2- 172.21.15.78:0/1785470383 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f726c0cb7e0 0x7f726c150510 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f7264007e30 tx=0x7f726400d4a0 comp rx=0 tx=0).stop 2023-12-12T10:12:49.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.890+0000 7f7273a9a640 1 -- 172.21.15.78:0/1785470383 shutdown_connections 2023-12-12T10:12:49.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.890+0000 7f7273a9a640 1 --2- 172.21.15.78:0/1785470383 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f7250066470 0x7f7250068930 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:49.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.890+0000 7f7273a9a640 1 --2- 172.21.15.78:0/1785470383 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f726c0cb7e0 0x7f726c150510 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:49.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.890+0000 7f7273a9a640 1 --2- 172.21.15.78:0/1785470383 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f726c0b47d0 0x7f726c151e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:49.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.890+0000 7f7273a9a640 1 --2- 172.21.15.78:0/1785470383 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f726c0ade10 0x7f726c1f6450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:49.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.890+0000 7f7273a9a640 1 -- 172.21.15.78:0/1785470383 >> 172.21.15.78:0/1785470383 conn(0x7f726c06c5d0 msgr2=0x7f726c0ac880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:49.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.890+0000 7f7273a9a640 1 -- 172.21.15.78:0/1785470383 shutdown_connections 2023-12-12T10:12:49.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:49.890+0000 7f7273a9a640 1 -- 172.21.15.78:0/1785470383 wait complete. 2023-12-12T10:12:49.912 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-12T10:11:57.053584+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-12T10:12:07.454450+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-12T10:12:08.182909+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-12T10:12:11.977952+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-12T10:12:49.912 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-12T10:12:50.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.058+0000 7fcde749c640 1 Processor -- start 2023-12-12T10:12:50.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.058+0000 7fcde749c640 1 -- start start 2023-12-12T10:12:50.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.058+0000 7fcde749c640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcde00cb4b0 0x7fcde015f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:50.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.058+0000 7fcde749c640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fcde015baa0 0x7fcde006cc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:50.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.058+0000 7fcde749c640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcde00cea30 con 0x7fcde006c850 2023-12-12T10:12:50.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.058+0000 7fcde749c640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcde006d1d0 con 0x7fcde015baa0 2023-12-12T10:12:50.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.058+0000 7fcde749c640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcde015bfc0 con 0x7fcde00cb4b0 2023-12-12T10:12:50.063 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.058+0000 7fcde5238640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcde00cb4b0 0x7fcde015f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:50.063 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.058+0000 7fcde5238640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcde00cb4b0 0x7fcde015f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.78:59196/0 (socket says 172.21.15.78:59196) 2023-12-12T10:12:50.063 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.058+0000 7fcde5238640 1 -- 172.21.15.78:0/344438793 learned_addr learned my addr 172.21.15.78:0/344438793 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:50.063 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.058+0000 7fcde5a39640 1 --2- 172.21.15.78:0/344438793 >> v2:172.21.15.187:3300/0 conn(0x7fcde015baa0 0x7fcde006cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:50.063 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.058+0000 7fcde5238640 1 -- 172.21.15.78:0/344438793 >> v2:172.21.15.187:3300/0 conn(0x7fcde015baa0 msgr2=0x7fcde006cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:50.063 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.058+0000 7fcde5238640 1 --2- 172.21.15.78:0/344438793 >> v2:172.21.15.187:3300/0 conn(0x7fcde015baa0 0x7fcde006cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:50.063 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.058+0000 7fcde5238640 1 -- 172.21.15.78:0/344438793 >> v1:172.21.15.187:6789/0 conn(0x7fcde006c850 legacy=0x7fcde015b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:50.063 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.058+0000 7fcdd7fff640 1 -- 172.21.15.78:0/344438793 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 696446567 0 0) 0x7fcde00cea30 con 0x7fcde006c850 2023-12-12T10:12:50.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.058+0000 7fcde5238640 1 -- 172.21.15.78:0/344438793 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcde015c2a0 con 0x7fcde00cb4b0 2023-12-12T10:12:50.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.062+0000 7fcde5238640 1 --2- 172.21.15.78:0/344438793 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcde00cb4b0 0x7fcde015f500 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fcddc009870 tx=0x7fcddc01c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=840b3a6c6a267a34 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:50.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.062+0000 7fcdd7fff640 1 -- 172.21.15.78:0/344438793 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcddc0ab680 con 0x7fcde00cb4b0 2023-12-12T10:12:50.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.062+0000 7fcdd7fff640 1 -- 172.21.15.78:0/344438793 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcddc0ab7e0 con 0x7fcde00cb4b0 2023-12-12T10:12:50.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.062+0000 7fcdd7fff640 1 -- 172.21.15.78:0/344438793 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcddc0abb70 con 0x7fcde00cb4b0 2023-12-12T10:12:50.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.062+0000 7fcde749c640 1 -- 172.21.15.78:0/344438793 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcde00cb4b0 msgr2=0x7fcde015f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:50.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.062+0000 7fcde749c640 1 --2- 172.21.15.78:0/344438793 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcde00cb4b0 0x7fcde015f500 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fcddc009870 tx=0x7fcddc01c480 comp rx=0 tx=0).stop 2023-12-12T10:12:50.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.062+0000 7fcde749c640 1 -- 172.21.15.78:0/344438793 shutdown_connections 2023-12-12T10:12:50.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.062+0000 7fcde749c640 1 --2- 172.21.15.78:0/344438793 >> v2:172.21.15.187:3300/0 conn(0x7fcde015baa0 0x7fcde006cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:50.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.066+0000 7fcde749c640 1 --2- 172.21.15.78:0/344438793 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcde00cb4b0 0x7fcde015f500 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:50.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.066+0000 7fcde749c640 1 -- 172.21.15.78:0/344438793 >> 172.21.15.78:0/344438793 conn(0x7fcde006a710 msgr2=0x7fcde006ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:50.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.066+0000 7fcde749c640 1 -- 172.21.15.78:0/344438793 shutdown_connections 2023-12-12T10:12:50.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.066+0000 7fcde749c640 1 -- 172.21.15.78:0/344438793 wait complete. 2023-12-12T10:12:50.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.066+0000 7fcde749c640 1 Processor -- start 2023-12-12T10:12:50.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.066+0000 7fcde749c640 1 -- start start 2023-12-12T10:12:50.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.070+0000 7fcde749c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcde006c850 0x7fcde01524b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:50.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.070+0000 7fcde749c640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcde00cb4b0 0x7fcde015d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:50.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.070+0000 7fcde749c640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcde015baa0 0x7fcde015dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:50.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.070+0000 7fcde749c640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcde0153e70 con 0x7fcde006c850 2023-12-12T10:12:50.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.070+0000 7fcde749c640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcde014e700 con 0x7fcde015baa0 2023-12-12T10:12:50.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.070+0000 7fcde749c640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcde014e9e0 con 0x7fcde00cb4b0 2023-12-12T10:12:50.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.070+0000 7fcde5238640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcde006c850 0x7fcde01524b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:50.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.070+0000 7fcde5238640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcde006c850 0x7fcde01524b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58726/0 (socket says 172.21.15.78:58726) 2023-12-12T10:12:50.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.070+0000 7fcde5238640 1 -- 172.21.15.78:0/1251465095 learned_addr learned my addr 172.21.15.78:0/1251465095 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:50.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.070+0000 7fcde4a37640 1 --2- 172.21.15.78:0/1251465095 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcde00cb4b0 0x7fcde015d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:50.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.070+0000 7fcde5a39640 1 --2- 172.21.15.78:0/1251465095 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcde015baa0 0x7fcde015dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:50.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.070+0000 7fcde5238640 1 -- 172.21.15.78:0/1251465095 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcde00cb4b0 msgr2=0x7fcde015d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:50.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.070+0000 7fcde5238640 1 --2- 172.21.15.78:0/1251465095 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcde00cb4b0 0x7fcde015d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:50.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.070+0000 7fcde5238640 1 -- 172.21.15.78:0/1251465095 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcde015baa0 msgr2=0x7fcde015dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:50.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.070+0000 7fcde5238640 1 --2- 172.21.15.78:0/1251465095 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcde015baa0 0x7fcde015dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:50.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.070+0000 7fcde5238640 1 -- 172.21.15.78:0/1251465095 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcddc0094d0 con 0x7fcde006c850 2023-12-12T10:12:50.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.070+0000 7fcde5238640 1 --2- 172.21.15.78:0/1251465095 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcde006c850 0x7fcde01524b0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fcddc01a0b0 tx=0x7fcddc01acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:50.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.070+0000 7fcdd5ffb640 1 -- 172.21.15.78:0/1251465095 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcddc0abe20 con 0x7fcde006c850 2023-12-12T10:12:50.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.070+0000 7fcdd5ffb640 1 -- 172.21.15.78:0/1251465095 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcddc0b8070 con 0x7fcde006c850 2023-12-12T10:12:50.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.070+0000 7fcdd5ffb640 1 -- 172.21.15.78:0/1251465095 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcddc004240 con 0x7fcde006c850 2023-12-12T10:12:50.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.070+0000 7fcde749c640 1 -- 172.21.15.78:0/1251465095 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcde014ecc0 con 0x7fcde006c850 2023-12-12T10:12:50.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.070+0000 7fcde749c640 1 -- 172.21.15.78:0/1251465095 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcde014f280 con 0x7fcde006c850 2023-12-12T10:12:50.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.070+0000 7fcde749c640 1 -- 172.21.15.78:0/1251465095 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcde00671f0 con 0x7fcde006c850 2023-12-12T10:12:50.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.074+0000 7fcdd5ffb640 1 -- 172.21.15.78:0/1251465095 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fcddc0043a0 con 0x7fcde006c850 2023-12-12T10:12:50.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.074+0000 7fcdd5ffb640 1 --2- 172.21.15.78:0/1251465095 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fcdc4066470 0x7fcdc4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:50.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.074+0000 7fcdd5ffb640 1 -- 172.21.15.78:0/1251465095 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fcddc11e6e0 con 0x7fcde006c850 2023-12-12T10:12:50.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.074+0000 7fcde4a37640 1 --2- 172.21.15.78:0/1251465095 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fcdc4066470 0x7fcdc4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:50.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.074+0000 7fcde4a37640 1 --2- 172.21.15.78:0/1251465095 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fcdc4066470 0x7fcdc4068930 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fcde014e590 tx=0x7fcdd0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:50.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.078+0000 7fcdd5ffb640 1 -- 172.21.15.78:0/1251465095 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fcddc0eb830 con 0x7fcde006c850 2023-12-12T10:12:50.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.230+0000 7fcde749c640 1 -- 172.21.15.78:0/1251465095 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcde0066dd0 con 0x7fcde006c850 2023-12-12T10:12:50.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.234+0000 7fcdd5ffb640 1 -- 172.21.15.78:0/1251465095 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcddc0ba020 con 0x7fcde006c850 2023-12-12T10:12:50.236 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2023-12-12T10:12:50.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.234+0000 7fcde749c640 1 -- 172.21.15.78:0/1251465095 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fcdc4066470 msgr2=0x7fcdc4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:50.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.234+0000 7fcde749c640 1 --2- 172.21.15.78:0/1251465095 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fcdc4066470 0x7fcdc4068930 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fcde014e590 tx=0x7fcdd0009040 comp rx=0 tx=0).stop 2023-12-12T10:12:50.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.234+0000 7fcde749c640 1 -- 172.21.15.78:0/1251465095 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcde006c850 msgr2=0x7fcde01524b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:50.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.234+0000 7fcde749c640 1 --2- 172.21.15.78:0/1251465095 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcde006c850 0x7fcde01524b0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fcddc01a0b0 tx=0x7fcddc01acc0 comp rx=0 tx=0).stop 2023-12-12T10:12:50.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.234+0000 7fcde749c640 1 -- 172.21.15.78:0/1251465095 shutdown_connections 2023-12-12T10:12:50.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.234+0000 7fcde749c640 1 --2- 172.21.15.78:0/1251465095 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fcdc4066470 0x7fcdc4068930 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:50.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.234+0000 7fcde749c640 1 --2- 172.21.15.78:0/1251465095 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcde015baa0 0x7fcde015dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:50.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.234+0000 7fcde749c640 1 --2- 172.21.15.78:0/1251465095 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcde00cb4b0 0x7fcde015d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:50.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.234+0000 7fcde749c640 1 --2- 172.21.15.78:0/1251465095 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcde006c850 0x7fcde01524b0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:50.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.234+0000 7fcde749c640 1 -- 172.21.15.78:0/1251465095 >> 172.21.15.78:0/1251465095 conn(0x7fcde006a710 msgr2=0x7fcde0072e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:50.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.234+0000 7fcde749c640 1 -- 172.21.15.78:0/1251465095 shutdown_connections 2023-12-12T10:12:50.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.234+0000 7fcde749c640 1 -- 172.21.15.78:0/1251465095 wait complete. 2023-12-12T10:12:50.257 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-12T10:12:50.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.398+0000 7fd039ce3640 1 Processor -- start 2023-12-12T10:12:50.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.398+0000 7fd039ce3640 1 -- start start 2023-12-12T10:12:50.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.398+0000 7fd039ce3640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd0340d0be0 0x7fd0340d1040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:50.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.398+0000 7fd039ce3640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0340d04f0 con 0x7fd034160890 2023-12-12T10:12:50.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.398+0000 7fd039ce3640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0340cdc20 con 0x7fd0340d15d0 2023-12-12T10:12:50.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.398+0000 7fd039ce3640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0340cfc50 con 0x7fd0340d0be0 2023-12-12T10:12:50.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.398+0000 7fd0337fe640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fd034160890 0x7fd0340b5e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:41410/0 (socket says 172.21.15.78:41410) 2023-12-12T10:12:50.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.398+0000 7fd0337fe640 1 -- 172.21.15.78:0/847688063 learned_addr learned my addr 172.21.15.78:0/847688063 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-12-12T10:12:50.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.398+0000 7fd032ffd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd0340d0be0 0x7fd0340d1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:50.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.398+0000 7fd0327fc640 1 -- 172.21.15.78:0/847688063 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1919658053 0 0) 0x7fd024001120 con 0x7fd034160890 2023-12-12T10:12:50.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.398+0000 7fd0327fc640 1 -- 172.21.15.78:0/847688063 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd01c003530 con 0x7fd034160890 2023-12-12T10:12:50.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.398+0000 7fd032ffd640 1 -- 172.21.15.78:0/847688063 >> v1:172.21.15.187:6789/0 conn(0x7fd0340d15d0 legacy=0x7fd0340ce3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:50.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.398+0000 7fd032ffd640 1 -- 172.21.15.78:0/847688063 >> v1:172.21.15.78:6789/0 conn(0x7fd034160890 legacy=0x7fd0340b5e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:50.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.398+0000 7fd032ffd640 1 -- 172.21.15.78:0/847688063 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0340cff30 con 0x7fd0340d0be0 2023-12-12T10:12:50.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.402+0000 7fd032ffd640 1 --2- 172.21.15.78:0/847688063 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd0340d0be0 0x7fd0340d1040 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fd0280097c0 tx=0x7fd02801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a89dd35400c5cc6e server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:50.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.402+0000 7fd0327fc640 1 -- 172.21.15.78:0/847688063 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0280ab650 con 0x7fd0340d0be0 2023-12-12T10:12:50.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.402+0000 7fd0327fc640 1 -- 172.21.15.78:0/847688063 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0280ab7b0 con 0x7fd0340d0be0 2023-12-12T10:12:50.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.402+0000 7fd0327fc640 1 -- 172.21.15.78:0/847688063 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0280abb40 con 0x7fd0340d0be0 2023-12-12T10:12:50.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.406+0000 7fd039ce3640 1 -- 172.21.15.78:0/847688063 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd0340d0be0 msgr2=0x7fd0340d1040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:50.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.406+0000 7fd039ce3640 1 --2- 172.21.15.78:0/847688063 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd0340d0be0 0x7fd0340d1040 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fd0280097c0 tx=0x7fd02801c450 comp rx=0 tx=0).stop 2023-12-12T10:12:50.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.406+0000 7fd039ce3640 1 -- 172.21.15.78:0/847688063 shutdown_connections 2023-12-12T10:12:50.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.406+0000 7fd039ce3640 1 --2- 172.21.15.78:0/847688063 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd0340d0be0 0x7fd0340d1040 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:50.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.406+0000 7fd039ce3640 1 -- 172.21.15.78:0/847688063 >> 172.21.15.78:0/847688063 conn(0x7fd03409c2f0 msgr2=0x7fd0340d3010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:50.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.406+0000 7fd039ce3640 1 -- 172.21.15.78:0/847688063 shutdown_connections 2023-12-12T10:12:50.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.406+0000 7fd039ce3640 1 -- 172.21.15.78:0/847688063 wait complete. 2023-12-12T10:12:50.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.406+0000 7fd039ce3640 1 Processor -- start 2023-12-12T10:12:50.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.406+0000 7fd039ce3640 1 -- start start 2023-12-12T10:12:50.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.406+0000 7fd039ce3640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd0340d0be0 0x7fd03414e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:50.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.406+0000 7fd039ce3640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd0340d15d0 0x7fd0341f6ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:50.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.406+0000 7fd039ce3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd034160890 0x7fd0340cbbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:50.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.406+0000 7fd039ce3640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd03414e870 con 0x7fd034160890 2023-12-12T10:12:50.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.406+0000 7fd039ce3640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd034157700 con 0x7fd0340d0be0 2023-12-12T10:12:50.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.406+0000 7fd039ce3640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd034156cc0 con 0x7fd0340d15d0 2023-12-12T10:12:50.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.406+0000 7fd033fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd034160890 0x7fd0340cbbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:50.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.406+0000 7fd033fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd034160890 0x7fd0340cbbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58736/0 (socket says 172.21.15.78:58736) 2023-12-12T10:12:50.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.406+0000 7fd033fff640 1 -- 172.21.15.78:0/2595004860 learned_addr learned my addr 172.21.15.78:0/2595004860 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:50.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.406+0000 7fd0337fe640 1 --2- 172.21.15.78:0/2595004860 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd0340d0be0 0x7fd03414e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:50.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.406+0000 7fd032ffd640 1 --2- 172.21.15.78:0/2595004860 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd0340d15d0 0x7fd0341f6ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:50.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.406+0000 7fd033fff640 1 -- 172.21.15.78:0/2595004860 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd0340d15d0 msgr2=0x7fd0341f6ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:50.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.406+0000 7fd033fff640 1 --2- 172.21.15.78:0/2595004860 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd0340d15d0 0x7fd0341f6ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:50.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.406+0000 7fd033fff640 1 -- 172.21.15.78:0/2595004860 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd0340d0be0 msgr2=0x7fd03414e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:50.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.406+0000 7fd033fff640 1 --2- 172.21.15.78:0/2595004860 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd0340d0be0 0x7fd03414e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:50.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.406+0000 7fd033fff640 1 -- 172.21.15.78:0/2595004860 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd028009420 con 0x7fd034160890 2023-12-12T10:12:50.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.410+0000 7fd033fff640 1 --2- 172.21.15.78:0/2595004860 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd034160890 0x7fd0340cbbe0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fd02c00c730 tx=0x7fd02c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:50.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.410+0000 7fd01bfff640 1 -- 172.21.15.78:0/2595004860 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd02c003b80 con 0x7fd034160890 2023-12-12T10:12:50.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.410+0000 7fd01bfff640 1 -- 172.21.15.78:0/2595004860 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd02c003ce0 con 0x7fd034160890 2023-12-12T10:12:50.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.410+0000 7fd039ce3640 1 -- 172.21.15.78:0/2595004860 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0341579c0 con 0x7fd034160890 2023-12-12T10:12:50.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.410+0000 7fd01bfff640 1 -- 172.21.15.78:0/2595004860 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd02c00aa30 con 0x7fd034160890 2023-12-12T10:12:50.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.410+0000 7fd039ce3640 1 -- 172.21.15.78:0/2595004860 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd034157f80 con 0x7fd034160890 2023-12-12T10:12:50.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.410+0000 7fd039ce3640 1 -- 172.21.15.78:0/2595004860 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd034158170 con 0x7fd034160890 2023-12-12T10:12:50.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.410+0000 7fd01bfff640 1 -- 172.21.15.78:0/2595004860 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd02c00ab90 con 0x7fd034160890 2023-12-12T10:12:50.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.410+0000 7fd01bfff640 1 --2- 172.21.15.78:0/2595004860 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fd0200664a0 0x7fd020068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:50.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.410+0000 7fd01bfff640 1 -- 172.21.15.78:0/2595004860 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fd02c083ff0 con 0x7fd034160890 2023-12-12T10:12:50.415 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.410+0000 7fd0337fe640 1 --2- 172.21.15.78:0/2595004860 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fd0200664a0 0x7fd020068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:50.415 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.414+0000 7fd0337fe640 1 --2- 172.21.15.78:0/2595004860 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fd0200664a0 0x7fd020068960 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd024001280 tx=0x7fd024007bc0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:50.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.418+0000 7fd01bfff640 1 -- 172.21.15.78:0/2595004860 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd02c050fb0 con 0x7fd034160890 2023-12-12T10:12:50.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.570+0000 7fd039ce3640 1 -- 172.21.15.78:0/2595004860 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd034067530 con 0x7fd034160890 2023-12-12T10:12:50.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.570+0000 7fd01bfff640 1 -- 172.21.15.78:0/2595004860 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd02c0545d0 con 0x7fd034160890 2023-12-12T10:12:50.575 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2023-12-12T10:12:50.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.574+0000 7fd039ce3640 1 -- 172.21.15.78:0/2595004860 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fd0200664a0 msgr2=0x7fd020068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:50.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.574+0000 7fd039ce3640 1 --2- 172.21.15.78:0/2595004860 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fd0200664a0 0x7fd020068960 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd024001280 tx=0x7fd024007bc0 comp rx=0 tx=0).stop 2023-12-12T10:12:50.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.574+0000 7fd039ce3640 1 -- 172.21.15.78:0/2595004860 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd034160890 msgr2=0x7fd0340cbbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:50.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.574+0000 7fd039ce3640 1 --2- 172.21.15.78:0/2595004860 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd034160890 0x7fd0340cbbe0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fd02c00c730 tx=0x7fd02c00cbf0 comp rx=0 tx=0).stop 2023-12-12T10:12:50.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.574+0000 7fd039ce3640 1 -- 172.21.15.78:0/2595004860 shutdown_connections 2023-12-12T10:12:50.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.574+0000 7fd039ce3640 1 --2- 172.21.15.78:0/2595004860 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fd0200664a0 0x7fd020068960 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:50.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.574+0000 7fd039ce3640 1 --2- 172.21.15.78:0/2595004860 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd034160890 0x7fd0340cbbe0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:50.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.574+0000 7fd039ce3640 1 --2- 172.21.15.78:0/2595004860 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd0340d15d0 0x7fd0341f6ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:50.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.574+0000 7fd039ce3640 1 --2- 172.21.15.78:0/2595004860 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd0340d0be0 0x7fd03414e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:50.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.574+0000 7fd039ce3640 1 -- 172.21.15.78:0/2595004860 >> 172.21.15.78:0/2595004860 conn(0x7fd03409c2f0 msgr2=0x7fd03415f860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:50.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.574+0000 7fd039ce3640 1 -- 172.21.15.78:0/2595004860 shutdown_connections 2023-12-12T10:12:50.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.574+0000 7fd039ce3640 1 -- 172.21.15.78:0/2595004860 wait complete. 2023-12-12T10:12:50.597 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-12T10:12:50.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.734+0000 7fa4a4b0f640 1 Processor -- start 2023-12-12T10:12:50.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.734+0000 7fa4a4b0f640 1 -- start start 2023-12-12T10:12:50.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.738+0000 7fa4a4b0f640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa4a0160890 0x7fa4a00b5e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:50.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.738+0000 7fa4a4b0f640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa4a00d0be0 0x7fa4a00d1040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:50.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.738+0000 7fa4a4b0f640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fa4a00d15d0 0x7fa4a00d1a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:50.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.738+0000 7fa4a4b0f640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4a00d1fc0 con 0x7fa4a0160890 2023-12-12T10:12:50.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.738+0000 7fa4a4b0f640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4a00d04f0 con 0x7fa4a00d15d0 2023-12-12T10:12:50.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.738+0000 7fa4a4b0f640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a00b63a0 con 0x7fa4a00d0be0 2023-12-12T10:12:50.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.738+0000 7fa49e59c640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa4a0160890 0x7fa4a00b5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:50.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.738+0000 7fa49e59c640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa4a0160890 0x7fa4a00b5e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58750/0 (socket says 172.21.15.78:58750) 2023-12-12T10:12:50.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.738+0000 7fa49e59c640 1 -- 172.21.15.78:0/1968061238 learned_addr learned my addr 172.21.15.78:0/1968061238 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:50.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.738+0000 7fa49dd9b640 1 --2- 172.21.15.78:0/1968061238 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa4a00d0be0 0x7fa4a00d1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:50.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.738+0000 7fa49ed9d640 1 --2- 172.21.15.78:0/1968061238 >> v2:172.21.15.187:3300/0 conn(0x7fa4a00d15d0 0x7fa4a00d1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:50.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.738+0000 7fa49e59c640 1 -- 172.21.15.78:0/1968061238 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa4a00d0be0 msgr2=0x7fa4a00d1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:50.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.738+0000 7fa49e59c640 1 --2- 172.21.15.78:0/1968061238 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa4a00d0be0 0x7fa4a00d1040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:50.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.738+0000 7fa49e59c640 1 -- 172.21.15.78:0/1968061238 >> v2:172.21.15.187:3300/0 conn(0x7fa4a00d15d0 msgr2=0x7fa4a00d1a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:50.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.738+0000 7fa49e59c640 1 --2- 172.21.15.78:0/1968061238 >> v2:172.21.15.187:3300/0 conn(0x7fa4a00d15d0 0x7fa4a00d1a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:50.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.738+0000 7fa49e59c640 1 -- 172.21.15.78:0/1968061238 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4a00cdc20 con 0x7fa4a0160890 2023-12-12T10:12:50.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.738+0000 7fa49ed9d640 1 --2- 172.21.15.78:0/1968061238 >> v2:172.21.15.187:3300/0 conn(0x7fa4a00d15d0 0x7fa4a00d1a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T10:12:50.745 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.742+0000 7fa49e59c640 1 --2- 172.21.15.78:0/1968061238 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa4a0160890 0x7fa4a00b5e60 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fa4a00a0f30 tx=0x7fa49001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72d958d56b4aac44 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:50.746 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.742+0000 7fa49d59a640 1 -- 172.21.15.78:0/1968061238 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4900aa5f0 con 0x7fa4a0160890 2023-12-12T10:12:50.746 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.742+0000 7fa49d59a640 1 -- 172.21.15.78:0/1968061238 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4900aa750 con 0x7fa4a0160890 2023-12-12T10:12:50.746 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.742+0000 7fa49d59a640 1 -- 172.21.15.78:0/1968061238 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4900aaae0 con 0x7fa4a0160890 2023-12-12T10:12:50.746 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.742+0000 7fa4a4b0f640 1 -- 172.21.15.78:0/1968061238 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa4a0160890 msgr2=0x7fa4a00b5e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:50.746 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.742+0000 7fa4a4b0f640 1 --2- 172.21.15.78:0/1968061238 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa4a0160890 0x7fa4a00b5e60 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fa4a00a0f30 tx=0x7fa49001c4d0 comp rx=0 tx=0).stop 2023-12-12T10:12:50.746 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.742+0000 7fa4a4b0f640 1 -- 172.21.15.78:0/1968061238 shutdown_connections 2023-12-12T10:12:50.746 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.742+0000 7fa4a4b0f640 1 --2- 172.21.15.78:0/1968061238 >> v2:172.21.15.187:3300/0 conn(0x7fa4a00d15d0 0x7fa4a00d1a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:50.746 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.742+0000 7fa4a4b0f640 1 --2- 172.21.15.78:0/1968061238 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa4a00d0be0 0x7fa4a00d1040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:50.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.742+0000 7fa4a4b0f640 1 --2- 172.21.15.78:0/1968061238 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa4a0160890 0x7fa4a00b5e60 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:50.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.742+0000 7fa4a4b0f640 1 -- 172.21.15.78:0/1968061238 >> 172.21.15.78:0/1968061238 conn(0x7fa4a009c2f0 msgr2=0x7fa4a00d3010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:50.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.742+0000 7fa4a4b0f640 1 -- 172.21.15.78:0/1968061238 shutdown_connections 2023-12-12T10:12:50.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.742+0000 7fa4a4b0f640 1 -- 172.21.15.78:0/1968061238 wait complete. 2023-12-12T10:12:50.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.742+0000 7fa4a4b0f640 1 Processor -- start 2023-12-12T10:12:50.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.742+0000 7fa4a4b0f640 1 -- start start 2023-12-12T10:12:50.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.746+0000 7fa4a4b0f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa4a00d0be0 0x7fa4a0151470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:50.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.746+0000 7fa4a4b0f640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa4a00d15d0 0x7fa4a01519b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:50.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.746+0000 7fa4a4b0f640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa4a0160890 0x7fa4a0151ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:50.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.746+0000 7fa4a4b0f640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a0152430 con 0x7fa4a00d0be0 2023-12-12T10:12:50.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.746+0000 7fa4a4b0f640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a014ff90 con 0x7fa4a0160890 2023-12-12T10:12:50.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.746+0000 7fa4a4b0f640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a0152660 con 0x7fa4a00d15d0 2023-12-12T10:12:50.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.746+0000 7fa49e59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa4a00d0be0 0x7fa4a0151470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:50.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.746+0000 7fa49e59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa4a00d0be0 0x7fa4a0151470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58764/0 (socket says 172.21.15.78:58764) 2023-12-12T10:12:50.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.746+0000 7fa49e59c640 1 -- 172.21.15.78:0/3942189663 learned_addr learned my addr 172.21.15.78:0/3942189663 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:50.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.746+0000 7fa49e59c640 1 -- 172.21.15.78:0/3942189663 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa4a00d15d0 msgr2=0x7fa4a01519b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:50.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.746+0000 7fa49e59c640 1 --2- 172.21.15.78:0/3942189663 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa4a00d15d0 0x7fa4a01519b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:50.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.746+0000 7fa49ed9d640 1 --2- 172.21.15.78:0/3942189663 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa4a0160890 0x7fa4a0151ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:50.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.746+0000 7fa49e59c640 1 -- 172.21.15.78:0/3942189663 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa4a0160890 msgr2=0x7fa4a0151ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:50.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.746+0000 7fa49e59c640 1 --2- 172.21.15.78:0/3942189663 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa4a0160890 0x7fa4a0151ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:50.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.746+0000 7fa49e59c640 1 -- 172.21.15.78:0/3942189663 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4900094d0 con 0x7fa4a00d0be0 2023-12-12T10:12:50.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.746+0000 7fa49ed9d640 1 --2- 172.21.15.78:0/3942189663 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa4a0160890 0x7fa4a0151ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T10:12:50.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.746+0000 7fa49e59c640 1 --2- 172.21.15.78:0/3942189663 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa4a00d0be0 0x7fa4a0151470 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fa49001ab80 tx=0x7fa49001ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:50.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.746+0000 7fa48effd640 1 -- 172.21.15.78:0/3942189663 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4900b3800 con 0x7fa4a00d0be0 2023-12-12T10:12:50.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.746+0000 7fa48effd640 1 -- 172.21.15.78:0/3942189663 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4900b3960 con 0x7fa4a00d0be0 2023-12-12T10:12:50.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.746+0000 7fa48effd640 1 -- 172.21.15.78:0/3942189663 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4900b3d10 con 0x7fa4a00d0be0 2023-12-12T10:12:50.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.746+0000 7fa4a4b0f640 1 -- 172.21.15.78:0/3942189663 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4a014d570 con 0x7fa4a00d0be0 2023-12-12T10:12:50.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.746+0000 7fa4a4b0f640 1 -- 172.21.15.78:0/3942189663 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4a014db30 con 0x7fa4a00d0be0 2023-12-12T10:12:50.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.746+0000 7fa4a4b0f640 1 -- 172.21.15.78:0/3942189663 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4a0067530 con 0x7fa4a00d0be0 2023-12-12T10:12:50.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.750+0000 7fa48effd640 1 -- 172.21.15.78:0/3942189663 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa4900b2380 con 0x7fa4a00d0be0 2023-12-12T10:12:50.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.750+0000 7fa48effd640 1 --2- 172.21.15.78:0/3942189663 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fa480066470 0x7fa480068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:50.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.750+0000 7fa48effd640 1 -- 172.21.15.78:0/3942189663 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa4900a7070 con 0x7fa4a00d0be0 2023-12-12T10:12:50.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.750+0000 7fa49dd9b640 1 --2- 172.21.15.78:0/3942189663 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fa480066470 0x7fa480068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:50.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.750+0000 7fa49dd9b640 1 --2- 172.21.15.78:0/3942189663 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fa480066470 0x7fa480068930 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa4a00c63a0 tx=0x7fa494009480 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:50.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.754+0000 7fa48effd640 1 -- 172.21.15.78:0/3942189663 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa4900eb8f0 con 0x7fa4a00d0be0 2023-12-12T10:12:50.906 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.902+0000 7fa4a4b0f640 1 -- 172.21.15.78:0/3942189663 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa4a00d0690 con 0x7fa4a00d0be0 2023-12-12T10:12:50.906 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.902+0000 7fa48effd640 1 -- 172.21.15.78:0/3942189663 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa4900eef10 con 0x7fa4a00d0be0 2023-12-12T10:12:50.907 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2023-12-12T10:12:50.908 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.906+0000 7fa4a4b0f640 1 -- 172.21.15.78:0/3942189663 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fa480066470 msgr2=0x7fa480068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:50.909 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.906+0000 7fa4a4b0f640 1 --2- 172.21.15.78:0/3942189663 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fa480066470 0x7fa480068930 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa4a00c63a0 tx=0x7fa494009480 comp rx=0 tx=0).stop 2023-12-12T10:12:50.909 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.906+0000 7fa4a4b0f640 1 -- 172.21.15.78:0/3942189663 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa4a00d0be0 msgr2=0x7fa4a0151470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:50.909 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.906+0000 7fa4a4b0f640 1 --2- 172.21.15.78:0/3942189663 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa4a00d0be0 0x7fa4a0151470 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fa49001ab80 tx=0x7fa49001ad10 comp rx=0 tx=0).stop 2023-12-12T10:12:50.909 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.906+0000 7fa4a4b0f640 1 -- 172.21.15.78:0/3942189663 shutdown_connections 2023-12-12T10:12:50.909 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.906+0000 7fa4a4b0f640 1 --2- 172.21.15.78:0/3942189663 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fa480066470 0x7fa480068930 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:50.909 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.906+0000 7fa4a4b0f640 1 --2- 172.21.15.78:0/3942189663 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa4a0160890 0x7fa4a0151ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:50.909 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.906+0000 7fa4a4b0f640 1 --2- 172.21.15.78:0/3942189663 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa4a00d15d0 0x7fa4a01519b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:50.909 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.906+0000 7fa4a4b0f640 1 --2- 172.21.15.78:0/3942189663 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa4a00d0be0 0x7fa4a0151470 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:50.909 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.906+0000 7fa4a4b0f640 1 -- 172.21.15.78:0/3942189663 >> 172.21.15.78:0/3942189663 conn(0x7fa4a009c2f0 msgr2=0x7fa4a006c890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:50.909 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.906+0000 7fa4a4b0f640 1 -- 172.21.15.78:0/3942189663 shutdown_connections 2023-12-12T10:12:50.909 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:50.906+0000 7fa4a4b0f640 1 -- 172.21.15.78:0/3942189663 wait complete. 2023-12-12T10:12:50.931 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-12T10:12:51.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.070+0000 7fb338757640 1 Processor -- start 2023-12-12T10:12:51.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.070+0000 7fb338757640 1 -- start start 2023-12-12T10:12:51.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.070+0000 7fb338757640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb330143770 0x7fb3300cdf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:51.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.070+0000 7fb338757640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb330070a70 con 0x7fb330071610 2023-12-12T10:12:51.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.070+0000 7fb338757640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb330070440 con 0x7fb3300b1e20 2023-12-12T10:12:51.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.070+0000 7fb338757640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb330143b50 con 0x7fb330143770 2023-12-12T10:12:51.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.074+0000 7fb3364f3640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb330143770 0x7fb3300cdf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:51.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.074+0000 7fb336cf4640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fb330071610 0x7fb33015d910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:41424/0 (socket says 172.21.15.78:41424) 2023-12-12T10:12:51.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.074+0000 7fb336cf4640 1 -- 172.21.15.78:0/1566179555 learned_addr learned my addr 172.21.15.78:0/1566179555 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-12-12T10:12:51.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.074+0000 7fb3364f3640 1 -- 172.21.15.78:0/1566179555 >> v1:172.21.15.187:6789/0 conn(0x7fb3300b1e20 legacy=0x7fb330070f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:51.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.074+0000 7fb3364f3640 1 -- 172.21.15.78:0/1566179555 >> v1:172.21.15.78:6789/0 conn(0x7fb330071610 legacy=0x7fb33015d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:51.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.074+0000 7fb3354f1640 1 -- 172.21.15.78:0/1566179555 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 608664942 0 0) 0x7fb330070a70 con 0x7fb330071610 2023-12-12T10:12:51.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.074+0000 7fb3364f3640 1 -- 172.21.15.78:0/1566179555 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3300ce620 con 0x7fb330143770 2023-12-12T10:12:51.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.074+0000 7fb3364f3640 1 --2- 172.21.15.78:0/1566179555 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb330143770 0x7fb3300cdf60 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fb32c009740 tx=0x7fb32c01c220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecac43e6908e5908 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:51.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.074+0000 7fb3354f1640 1 -- 172.21.15.78:0/1566179555 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb32c0ab600 con 0x7fb330143770 2023-12-12T10:12:51.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.074+0000 7fb3354f1640 1 -- 172.21.15.78:0/1566179555 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb32c0a7050 con 0x7fb330143770 2023-12-12T10:12:51.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.074+0000 7fb3354f1640 1 -- 172.21.15.78:0/1566179555 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb32c0ab980 con 0x7fb330143770 2023-12-12T10:12:51.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.078+0000 7fb338757640 1 -- 172.21.15.78:0/1566179555 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb330143770 msgr2=0x7fb3300cdf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:51.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.078+0000 7fb338757640 1 --2- 172.21.15.78:0/1566179555 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb330143770 0x7fb3300cdf60 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fb32c009740 tx=0x7fb32c01c220 comp rx=0 tx=0).stop 2023-12-12T10:12:51.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.078+0000 7fb338757640 1 -- 172.21.15.78:0/1566179555 shutdown_connections 2023-12-12T10:12:51.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.078+0000 7fb338757640 1 --2- 172.21.15.78:0/1566179555 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb330143770 0x7fb3300cdf60 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:51.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.078+0000 7fb338757640 1 -- 172.21.15.78:0/1566179555 >> 172.21.15.78:0/1566179555 conn(0x7fb33006a710 msgr2=0x7fb33006ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:51.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.078+0000 7fb338757640 1 -- 172.21.15.78:0/1566179555 shutdown_connections 2023-12-12T10:12:51.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.078+0000 7fb338757640 1 -- 172.21.15.78:0/1566179555 wait complete. 2023-12-12T10:12:51.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.078+0000 7fb338757640 1 Processor -- start 2023-12-12T10:12:51.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.078+0000 7fb338757640 1 -- start start 2023-12-12T10:12:51.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.078+0000 7fb338757640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb330071610 0x7fb3301516b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:51.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.078+0000 7fb338757640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb3300b1e20 0x7fb330126bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:51.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.078+0000 7fb338757640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb330143770 0x7fb330152380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:51.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.078+0000 7fb338757640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb330168270 con 0x7fb3300b1e20 2023-12-12T10:12:51.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.078+0000 7fb338757640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb330168510 con 0x7fb330071610 2023-12-12T10:12:51.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.078+0000 7fb338757640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3301687f0 con 0x7fb330143770 2023-12-12T10:12:51.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.078+0000 7fb335cf2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb3300b1e20 0x7fb330126bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:51.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.078+0000 7fb335cf2640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb3300b1e20 0x7fb330126bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58792/0 (socket says 172.21.15.78:58792) 2023-12-12T10:12:51.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.078+0000 7fb335cf2640 1 -- 172.21.15.78:0/3682924894 learned_addr learned my addr 172.21.15.78:0/3682924894 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:51.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.078+0000 7fb336cf4640 1 --2- 172.21.15.78:0/3682924894 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb330143770 0x7fb330152380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:51.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.078+0000 7fb3364f3640 1 --2- 172.21.15.78:0/3682924894 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb330071610 0x7fb3301516b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:51.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.078+0000 7fb335cf2640 1 -- 172.21.15.78:0/3682924894 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb330143770 msgr2=0x7fb330152380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:51.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.078+0000 7fb335cf2640 1 --2- 172.21.15.78:0/3682924894 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb330143770 0x7fb330152380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:51.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.078+0000 7fb335cf2640 1 -- 172.21.15.78:0/3682924894 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb330071610 msgr2=0x7fb3301516b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:51.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.078+0000 7fb335cf2640 1 --2- 172.21.15.78:0/3682924894 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb330071610 0x7fb3301516b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:51.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.078+0000 7fb335cf2640 1 -- 172.21.15.78:0/3682924894 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb32c009420 con 0x7fb3300b1e20 2023-12-12T10:12:51.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.078+0000 7fb335cf2640 1 --2- 172.21.15.78:0/3682924894 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb3300b1e20 0x7fb330126bf0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fb32000c750 tx=0x7fb32000cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:51.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.082+0000 7fb326ffd640 1 -- 172.21.15.78:0/3682924894 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb320005270 con 0x7fb3300b1e20 2023-12-12T10:12:51.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.082+0000 7fb326ffd640 1 -- 172.21.15.78:0/3682924894 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3200053d0 con 0x7fb3300b1e20 2023-12-12T10:12:51.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.082+0000 7fb338757640 1 -- 172.21.15.78:0/3682924894 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb330168ad0 con 0x7fb3300b1e20 2023-12-12T10:12:51.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.082+0000 7fb326ffd640 1 -- 172.21.15.78:0/3682924894 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb32000a880 con 0x7fb3300b1e20 2023-12-12T10:12:51.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.082+0000 7fb338757640 1 -- 172.21.15.78:0/3682924894 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb330151bf0 con 0x7fb3300b1e20 2023-12-12T10:12:51.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.082+0000 7fb338757640 1 -- 172.21.15.78:0/3682924894 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3300671f0 con 0x7fb3300b1e20 2023-12-12T10:12:51.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.082+0000 7fb326ffd640 1 -- 172.21.15.78:0/3682924894 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb32000a9e0 con 0x7fb3300b1e20 2023-12-12T10:12:51.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.082+0000 7fb326ffd640 1 --2- 172.21.15.78:0/3682924894 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fb314066470 0x7fb314068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:51.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.082+0000 7fb326ffd640 1 -- 172.21.15.78:0/3682924894 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fb320083950 con 0x7fb3300b1e20 2023-12-12T10:12:51.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.082+0000 7fb3364f3640 1 --2- 172.21.15.78:0/3682924894 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fb314066470 0x7fb314068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:51.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.082+0000 7fb3364f3640 1 --2- 172.21.15.78:0/3682924894 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fb314066470 0x7fb314068930 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb32c0ad000 tx=0x7fb32c0a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:51.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.086+0000 7fb326ffd640 1 -- 172.21.15.78:0/3682924894 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb320050a00 con 0x7fb3300b1e20 2023-12-12T10:12:51.242 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.238+0000 7fb338757640 1 -- 172.21.15.78:0/3682924894 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fb330067530 con 0x7fb3300b1e20 2023-12-12T10:12:51.243 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.238+0000 7fb326ffd640 1 -- 172.21.15.78:0/3682924894 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7fb320017020 con 0x7fb3300b1e20 2023-12-12T10:12:51.243 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2023-12-12T10:12:51.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.242+0000 7fb338757640 1 -- 172.21.15.78:0/3682924894 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fb314066470 msgr2=0x7fb314068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:51.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.242+0000 7fb338757640 1 --2- 172.21.15.78:0/3682924894 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fb314066470 0x7fb314068930 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb32c0ad000 tx=0x7fb32c0a6000 comp rx=0 tx=0).stop 2023-12-12T10:12:51.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.242+0000 7fb338757640 1 -- 172.21.15.78:0/3682924894 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb3300b1e20 msgr2=0x7fb330126bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:51.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.242+0000 7fb338757640 1 --2- 172.21.15.78:0/3682924894 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb3300b1e20 0x7fb330126bf0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fb32000c750 tx=0x7fb32000cc10 comp rx=0 tx=0).stop 2023-12-12T10:12:51.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.242+0000 7fb338757640 1 -- 172.21.15.78:0/3682924894 shutdown_connections 2023-12-12T10:12:51.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.242+0000 7fb338757640 1 --2- 172.21.15.78:0/3682924894 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fb314066470 0x7fb314068930 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:51.245 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.242+0000 7fb338757640 1 --2- 172.21.15.78:0/3682924894 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb330143770 0x7fb330152380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:51.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.242+0000 7fb338757640 1 --2- 172.21.15.78:0/3682924894 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb3300b1e20 0x7fb330126bf0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:51.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.242+0000 7fb338757640 1 --2- 172.21.15.78:0/3682924894 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb330071610 0x7fb3301516b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:51.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.242+0000 7fb338757640 1 -- 172.21.15.78:0/3682924894 >> 172.21.15.78:0/3682924894 conn(0x7fb33006a710 msgr2=0x7fb33015c470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:51.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.242+0000 7fb338757640 1 -- 172.21.15.78:0/3682924894 shutdown_connections 2023-12-12T10:12:51.246 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.242+0000 7fb338757640 1 -- 172.21.15.78:0/3682924894 wait complete. 2023-12-12T10:12:51.264 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T10:12:51.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.406+0000 7fc7d9e17640 1 Processor -- start 2023-12-12T10:12:51.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.406+0000 7fc7d9e17640 1 -- start start 2023-12-12T10:12:51.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.406+0000 7fc7d9e17640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc7d413ceb0 0x7fc7d413d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:51.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.406+0000 7fc7d9e17640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc7d4071bf0 0x7fc7d4072030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:51.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.406+0000 7fc7d9e17640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fc7d413f550 0x7fc7d413f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:51.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.406+0000 7fc7d9e17640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7d413ff20 con 0x7fc7d413ceb0 2023-12-12T10:12:51.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.406+0000 7fc7d9e17640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7d40705a0 con 0x7fc7d413f550 2023-12-12T10:12:51.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.406+0000 7fc7d9e17640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7d4140410 con 0x7fc7d4071bf0 2023-12-12T10:12:51.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.406+0000 7fc7d37fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc7d413ceb0 0x7fc7d413d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:51.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.406+0000 7fc7d37fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc7d413ceb0 0x7fc7d413d4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58800/0 (socket says 172.21.15.78:58800) 2023-12-12T10:12:51.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.406+0000 7fc7d37fe640 1 -- 172.21.15.78:0/341357767 learned_addr learned my addr 172.21.15.78:0/341357767 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:51.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.406+0000 7fc7d3fff640 1 --2- 172.21.15.78:0/341357767 >> v2:172.21.15.187:3300/0 conn(0x7fc7d413f550 0x7fc7d413f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:51.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.406+0000 7fc7d2ffd640 1 --2- 172.21.15.78:0/341357767 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc7d4071bf0 0x7fc7d4072030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:51.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.406+0000 7fc7d37fe640 1 -- 172.21.15.78:0/341357767 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc7d4071bf0 msgr2=0x7fc7d4072030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:51.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.406+0000 7fc7d37fe640 1 --2- 172.21.15.78:0/341357767 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc7d4071bf0 0x7fc7d4072030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:51.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.406+0000 7fc7d37fe640 1 -- 172.21.15.78:0/341357767 >> v2:172.21.15.187:3300/0 conn(0x7fc7d413f550 msgr2=0x7fc7d413f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:51.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.406+0000 7fc7d37fe640 1 --2- 172.21.15.78:0/341357767 >> v2:172.21.15.187:3300/0 conn(0x7fc7d413f550 0x7fc7d413f9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:51.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.406+0000 7fc7d37fe640 1 -- 172.21.15.78:0/341357767 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7d40cdc90 con 0x7fc7d413ceb0 2023-12-12T10:12:51.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.406+0000 7fc7d3fff640 1 --2- 172.21.15.78:0/341357767 >> v2:172.21.15.187:3300/0 conn(0x7fc7d413f550 0x7fc7d413f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T10:12:51.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.410+0000 7fc7d37fe640 1 --2- 172.21.15.78:0/341357767 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc7d413ceb0 0x7fc7d413d4c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fc7d4074080 tx=0x7fc7c401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37ec2cf405469731 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:51.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.410+0000 7fc7d27fc640 1 -- 172.21.15.78:0/341357767 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7c40a4ea0 con 0x7fc7d413ceb0 2023-12-12T10:12:51.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.410+0000 7fc7d27fc640 1 -- 172.21.15.78:0/341357767 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7c40ac440 con 0x7fc7d413ceb0 2023-12-12T10:12:51.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.410+0000 7fc7d27fc640 1 -- 172.21.15.78:0/341357767 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7c40ac7d0 con 0x7fc7d413ceb0 2023-12-12T10:12:51.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.410+0000 7fc7d9e17640 1 -- 172.21.15.78:0/341357767 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc7d413ceb0 msgr2=0x7fc7d413d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:51.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.410+0000 7fc7d9e17640 1 --2- 172.21.15.78:0/341357767 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc7d413ceb0 0x7fc7d413d4c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fc7d4074080 tx=0x7fc7c401c500 comp rx=0 tx=0).stop 2023-12-12T10:12:51.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.410+0000 7fc7d9e17640 1 -- 172.21.15.78:0/341357767 shutdown_connections 2023-12-12T10:12:51.415 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.410+0000 7fc7d9e17640 1 --2- 172.21.15.78:0/341357767 >> v2:172.21.15.187:3300/0 conn(0x7fc7d413f550 0x7fc7d413f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:51.415 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.410+0000 7fc7d9e17640 1 --2- 172.21.15.78:0/341357767 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc7d4071bf0 0x7fc7d4072030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:51.415 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.410+0000 7fc7d9e17640 1 --2- 172.21.15.78:0/341357767 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc7d413ceb0 0x7fc7d413d4c0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:51.415 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.410+0000 7fc7d9e17640 1 -- 172.21.15.78:0/341357767 >> 172.21.15.78:0/341357767 conn(0x7fc7d406c5d0 msgr2=0x7fc7d406c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:51.415 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.410+0000 7fc7d9e17640 1 -- 172.21.15.78:0/341357767 shutdown_connections 2023-12-12T10:12:51.415 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.410+0000 7fc7d9e17640 1 -- 172.21.15.78:0/341357767 wait complete. 2023-12-12T10:12:51.416 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.414+0000 7fc7d9e17640 1 Processor -- start 2023-12-12T10:12:51.416 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.414+0000 7fc7d9e17640 1 -- start start 2023-12-12T10:12:51.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.414+0000 7fc7d9e17640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc7d4071bf0 0x7fc7d413af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:51.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.414+0000 7fc7d9e17640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc7d413ceb0 0x7fc7d4138e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:51.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.414+0000 7fc7d9e17640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc7d413f550 0x7fc7d4139370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:51.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.414+0000 7fc7d9e17640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7d412a1d0 con 0x7fc7d413f550 2023-12-12T10:12:51.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.414+0000 7fc7d9e17640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7d40b3d30 con 0x7fc7d413ceb0 2023-12-12T10:12:51.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.414+0000 7fc7d9e17640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7d40b4010 con 0x7fc7d4071bf0 2023-12-12T10:12:51.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.414+0000 7fc7d3fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc7d413f550 0x7fc7d4139370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:51.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.414+0000 7fc7d3fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc7d413f550 0x7fc7d4139370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58804/0 (socket says 172.21.15.78:58804) 2023-12-12T10:12:51.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.414+0000 7fc7d3fff640 1 -- 172.21.15.78:0/14176486 learned_addr learned my addr 172.21.15.78:0/14176486 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:51.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.414+0000 7fc7d2ffd640 1 --2- 172.21.15.78:0/14176486 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc7d413ceb0 0x7fc7d4138e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:51.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.414+0000 7fc7d37fe640 1 --2- 172.21.15.78:0/14176486 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc7d4071bf0 0x7fc7d413af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:51.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.414+0000 7fc7d3fff640 1 -- 172.21.15.78:0/14176486 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc7d4071bf0 msgr2=0x7fc7d413af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:51.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.414+0000 7fc7d3fff640 1 --2- 172.21.15.78:0/14176486 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc7d4071bf0 0x7fc7d413af20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:51.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.414+0000 7fc7d3fff640 1 -- 172.21.15.78:0/14176486 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc7d413ceb0 msgr2=0x7fc7d4138e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:51.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.414+0000 7fc7d3fff640 1 --2- 172.21.15.78:0/14176486 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc7d413ceb0 0x7fc7d4138e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:51.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.414+0000 7fc7d3fff640 1 -- 172.21.15.78:0/14176486 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7c40094d0 con 0x7fc7d413f550 2023-12-12T10:12:51.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.414+0000 7fc7d3fff640 1 --2- 172.21.15.78:0/14176486 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc7d413f550 0x7fc7d4139370 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fc7cc009ed0 tx=0x7fc7cc0085d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:51.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.414+0000 7fc7bbfff640 1 -- 172.21.15.78:0/14176486 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7cc010070 con 0x7fc7d413f550 2023-12-12T10:12:51.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.414+0000 7fc7bbfff640 1 -- 172.21.15.78:0/14176486 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7cc008da0 con 0x7fc7d413f550 2023-12-12T10:12:51.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.414+0000 7fc7d9e17640 1 -- 172.21.15.78:0/14176486 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7d40b42f0 con 0x7fc7d413f550 2023-12-12T10:12:51.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.414+0000 7fc7bbfff640 1 -- 172.21.15.78:0/14176486 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7cc0039a0 con 0x7fc7d413f550 2023-12-12T10:12:51.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.414+0000 7fc7d9e17640 1 -- 172.21.15.78:0/14176486 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7d413b460 con 0x7fc7d413f550 2023-12-12T10:12:51.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.418+0000 7fc7d9e17640 1 -- 172.21.15.78:0/14176486 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7d40671f0 con 0x7fc7d413f550 2023-12-12T10:12:51.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.418+0000 7fc7bbfff640 1 -- 172.21.15.78:0/14176486 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc7cc014070 con 0x7fc7d413f550 2023-12-12T10:12:51.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.418+0000 7fc7bbfff640 1 --2- 172.21.15.78:0/14176486 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fc7c0066470 0x7fc7c0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:51.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.418+0000 7fc7bbfff640 1 -- 172.21.15.78:0/14176486 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fc7cc083a70 con 0x7fc7d413f550 2023-12-12T10:12:51.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.418+0000 7fc7d37fe640 1 --2- 172.21.15.78:0/14176486 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fc7c0066470 0x7fc7c0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:51.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.418+0000 7fc7d37fe640 1 --2- 172.21.15.78:0/14176486 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fc7c0066470 0x7fc7c0068930 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc7c40ae000 tx=0x7fc7c4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:51.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.422+0000 7fc7bbfff640 1 -- 172.21.15.78:0/14176486 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc7cc050be0 con 0x7fc7d413f550 2023-12-12T10:12:51.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.574+0000 7fc7d9e17640 1 -- 172.21.15.78:0/14176486 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc7d4067530 con 0x7fc7d413f550 2023-12-12T10:12:51.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.574+0000 7fc7bbfff640 1 -- 172.21.15.78:0/14176486 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18701 (secure 0 0 0) 0x7fc7cc054200 con 0x7fc7d413f550 2023-12-12T10:12:51.577 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:12:51.577 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":26,"fsid":"fc81937c-bd26-483c-952b-d1324fcb0c9e","created":"2023-12-12T10:11:44.020214+0000","modified":"2023-12-12T10:12:50.919344+0000","last_up_change":"2023-12-12T10:11:56.278318+0000","last_in_change":"2023-12-12T10:11:46.553610+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T10:11:57.053584+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-12T10:12:07.454450+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-12T10:12:08.182909+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-12T10:12:11.977952+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"22dfdedf-5f6c-4b20-9f6c-30517a1db70a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6809","nonce":3345683600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6811","nonce":3345683600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6815","nonce":3345683600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6813","nonce":3345683600}]},"public_addr":"172.21.15.78:6809/3345683600","cluster_addr":"172.21.15.78:6811/3345683600","heartbeat_back_addr":"172.21.15.78:6815/3345683600","heartbeat_front_addr":"172.21.15.78:6813/3345683600","state":["exists","up"]},{"osd":1,"uuid":"be34a7f3-a69a-462e-9ddf-5e537448dba2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6801","nonce":962652768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6803","nonce":962652768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6807","nonce":962652768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6805","nonce":962652768}]},"public_addr":"172.21.15.78:6801/962652768","cluster_addr":"172.21.15.78:6803/962652768","heartbeat_back_addr":"172.21.15.78:6807/962652768","heartbeat_front_addr":"172.21.15.78:6805/962652768","state":["exists","up"]},{"osd":2,"uuid":"55b381de-5f56-4b14-80f7-e6e41e084a13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6818","nonce":2910206054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6822","nonce":2910206054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6829","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6831","nonce":2910206054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6826","nonce":2910206054}]},"public_addr":"172.21.15.78:6818/2910206054","cluster_addr":"172.21.15.78:6822/2910206054","heartbeat_back_addr":"172.21.15.78:6831/2910206054","heartbeat_front_addr":"172.21.15.78:6826/2910206054","state":["exists","up"]},{"osd":3,"uuid":"d7682de1-25cb-4cec-869f-8851c28b0e6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6819","nonce":3750796703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6821","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6823","nonce":3750796703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6830","nonce":3750796703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6825","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6827","nonce":3750796703}]},"public_addr":"172.21.15.78:6819/3750796703","cluster_addr":"172.21.15.78:6823/3750796703","heartbeat_back_addr":"172.21.15.78:6830/3750796703","heartbeat_front_addr":"172.21.15.78:6827/3750796703","state":["exists","up"]},{"osd":4,"uuid":"8279815a-d6c7-4199-871e-d28971b9dc07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6809","nonce":2944277204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6811","nonce":2944277204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6815","nonce":2944277204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6813","nonce":2944277204}]},"public_addr":"172.21.15.187:6809/2944277204","cluster_addr":"172.21.15.187:6811/2944277204","heartbeat_back_addr":"172.21.15.187:6815/2944277204","heartbeat_front_addr":"172.21.15.187:6813/2944277204","state":["exists","up"]},{"osd":5,"uuid":"0a714c65-f8ce-4340-968f-11a799677ef3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6801","nonce":185858620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6803","nonce":185858620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6807","nonce":185858620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6805","nonce":185858620}]},"public_addr":"172.21.15.187:6801/185858620","cluster_addr":"172.21.15.187:6803/185858620","heartbeat_back_addr":"172.21.15.187:6807/185858620","heartbeat_front_addr":"172.21.15.187:6805/185858620","state":["exists","up"]},{"osd":6,"uuid":"d0bba9ab-f7ee-449e-8999-1c0cf7e6d53c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6817","nonce":4213392126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6819","nonce":4213392126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6824","nonce":4213392126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6821","nonce":4213392126}]},"public_addr":"172.21.15.187:6817/4213392126","cluster_addr":"172.21.15.187:6819/4213392126","heartbeat_back_addr":"172.21.15.187:6824/4213392126","heartbeat_front_addr":"172.21.15.187:6821/4213392126","state":["exists","up"]},{"osd":7,"uuid":"efe5e0d9-2f87-4889-a27a-e2a95a632302","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6823","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6825","nonce":85774004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6827","nonce":85774004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6831","nonce":85774004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6829","nonce":85774004}]},"public_addr":"172.21.15.187:6825/85774004","cluster_addr":"172.21.15.187:6827/85774004","heartbeat_back_addr":"172.21.15.187:6831/85774004","heartbeat_front_addr":"172.21.15.187:6829/85774004","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.214447+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.448899+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.293107+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.564184+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.175026+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.097717+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.261141+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.287681+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.18","mappings":[{"from":3,"to":2}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.13","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T10:12:51.579 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.574+0000 7fc7d9e17640 1 -- 172.21.15.78:0/14176486 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fc7c0066470 msgr2=0x7fc7c0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:51.579 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.574+0000 7fc7d9e17640 1 --2- 172.21.15.78:0/14176486 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fc7c0066470 0x7fc7c0068930 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc7c40ae000 tx=0x7fc7c4008040 comp rx=0 tx=0).stop 2023-12-12T10:12:51.579 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.574+0000 7fc7d9e17640 1 -- 172.21.15.78:0/14176486 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc7d413f550 msgr2=0x7fc7d4139370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:51.579 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.574+0000 7fc7d9e17640 1 --2- 172.21.15.78:0/14176486 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc7d413f550 0x7fc7d4139370 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fc7cc009ed0 tx=0x7fc7cc0085d0 comp rx=0 tx=0).stop 2023-12-12T10:12:51.579 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.574+0000 7fc7d9e17640 1 -- 172.21.15.78:0/14176486 shutdown_connections 2023-12-12T10:12:51.579 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.574+0000 7fc7d9e17640 1 --2- 172.21.15.78:0/14176486 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fc7c0066470 0x7fc7c0068930 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:51.579 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.574+0000 7fc7d9e17640 1 --2- 172.21.15.78:0/14176486 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc7d413f550 0x7fc7d4139370 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:51.579 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.574+0000 7fc7d9e17640 1 --2- 172.21.15.78:0/14176486 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc7d413ceb0 0x7fc7d4138e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:51.579 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.574+0000 7fc7d9e17640 1 --2- 172.21.15.78:0/14176486 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc7d4071bf0 0x7fc7d413af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:51.579 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.574+0000 7fc7d9e17640 1 -- 172.21.15.78:0/14176486 >> 172.21.15.78:0/14176486 conn(0x7fc7d406c5d0 msgr2=0x7fc7d4142650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:51.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.574+0000 7fc7d9e17640 1 -- 172.21.15.78:0/14176486 shutdown_connections 2023-12-12T10:12:51.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.574+0000 7fc7d9e17640 1 -- 172.21.15.78:0/14176486 wait complete. 2023-12-12T10:12:51.598 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-12T10:11:57.053584+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-12T10:12:07.454450+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-12T10:12:08.182909+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-12T10:12:11.977952+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-12T10:12:51.599 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-12T10:12:51.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.734+0000 7f50ca92b640 1 Processor -- start 2023-12-12T10:12:51.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.734+0000 7f50ca92b640 1 -- start start 2023-12-12T10:12:51.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.738+0000 7f50ca92b640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f50c40b3b30 0x7f50c4161890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:51.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.738+0000 7f50ca92b640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50c4162830 con 0x7f50c414acb0 2023-12-12T10:12:51.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.738+0000 7f50ca92b640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50c4162270 con 0x7f50c4161dd0 2023-12-12T10:12:51.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.738+0000 7f50ca92b640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50c4162550 con 0x7f50c40b3b30 2023-12-12T10:12:51.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.738+0000 7f50c9929640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f50c414acb0 0x7f50c41657b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:41436/0 (socket says 172.21.15.78:41436) 2023-12-12T10:12:51.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.738+0000 7f50c9929640 1 -- 172.21.15.78:0/1237480576 learned_addr learned my addr 172.21.15.78:0/1237480576 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-12-12T10:12:51.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.738+0000 7f50c9128640 1 --2- 172.21.15.78:0/1237480576 >> v2:172.21.15.187:3300/0 conn(0x7f50c40b3b30 0x7f50c4161890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:51.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.738+0000 7f50c8927640 1 -- 172.21.15.78:0/1237480576 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3435520890 0 0) 0x7f50c4162830 con 0x7f50c414acb0 2023-12-12T10:12:51.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.738+0000 7f50c8927640 1 -- 172.21.15.78:0/1237480576 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f50b0003530 con 0x7f50c414acb0 2023-12-12T10:12:51.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.738+0000 7f50c8927640 1 -- 172.21.15.78:0/1237480576 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4201184536 0 0) 0x7f50b0003530 con 0x7f50c414acb0 2023-12-12T10:12:51.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.738+0000 7f50c8927640 1 -- 172.21.15.78:0/1237480576 >> v2:172.21.15.187:3300/0 conn(0x7f50c40b3b30 msgr2=0x7f50c4161890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:51.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.738+0000 7f50c8927640 1 --2- 172.21.15.78:0/1237480576 >> v2:172.21.15.187:3300/0 conn(0x7f50c40b3b30 0x7f50c4161890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:51.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.738+0000 7f50c8927640 1 -- 172.21.15.78:0/1237480576 >> v1:172.21.15.187:6789/0 conn(0x7f50c4161dd0 legacy=0x7f50c40cec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:51.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.738+0000 7f50c8927640 1 -- 172.21.15.78:0/1237480576 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50c4164fb0 con 0x7f50c414acb0 2023-12-12T10:12:51.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.738+0000 7f50c8927640 1 -- 172.21.15.78:0/1237480576 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 465499599 0 0) 0x7f50c0001680 con 0x7f50c414acb0 2023-12-12T10:12:51.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.738+0000 7f50c8927640 1 -- 172.21.15.78:0/1237480576 >> v1:172.21.15.78:6789/0 conn(0x7f50c414acb0 legacy=0x7f50c41657b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:51.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.738+0000 7f50c8927640 1 --2- 172.21.15.78:0/1237480576 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50b0003980 0x7f50b0003d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:51.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.738+0000 7f50c8927640 1 --2- 172.21.15.78:0/1237480576 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f50b00047d0 0x7f50b0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:51.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.738+0000 7f50c8927640 1 --2- 172.21.15.78:0/1237480576 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f50b0005190 0x7f50b000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:51.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.738+0000 7f50c8927640 1 -- 172.21.15.78:0/1237480576 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50c4162550 con 0x7f50b0003980 2023-12-12T10:12:51.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.738+0000 7f50c8927640 1 -- 172.21.15.78:0/1237480576 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50b000c0e0 con 0x7f50b0005190 2023-12-12T10:12:51.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.738+0000 7f50c8927640 1 -- 172.21.15.78:0/1237480576 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50b000c2a0 con 0x7f50b00047d0 2023-12-12T10:12:51.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.738+0000 7f50c9929640 1 --2- 172.21.15.78:0/1237480576 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50b0003980 0x7f50b0003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:51.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.738+0000 7f50c9128640 1 --2- 172.21.15.78:0/1237480576 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f50b00047d0 0x7f50b0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:51.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.738+0000 7f50ca12a640 1 --2- 172.21.15.78:0/1237480576 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f50b0005190 0x7f50b000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:51.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.738+0000 7f50c9929640 1 -- 172.21.15.78:0/1237480576 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f50b00047d0 msgr2=0x7f50b0004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:51.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.738+0000 7f50c9929640 1 --2- 172.21.15.78:0/1237480576 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f50b00047d0 0x7f50b0004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:51.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.738+0000 7f50c9929640 1 -- 172.21.15.78:0/1237480576 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f50b0005190 msgr2=0x7f50b000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:51.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.738+0000 7f50c9929640 1 --2- 172.21.15.78:0/1237480576 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f50b0005190 0x7f50b000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:51.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.738+0000 7f50c9929640 1 -- 172.21.15.78:0/1237480576 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50b0003530 con 0x7f50b0003980 2023-12-12T10:12:51.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.738+0000 7f50ca12a640 1 -- 172.21.15.78:0/1237480576 reap_dead start 2023-12-12T10:12:51.745 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.742+0000 7f50c9929640 1 --2- 172.21.15.78:0/1237480576 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50b0003980 0x7f50b0003d60 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f50c000c1c0 tx=0x7f50c001cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3185f281dbd155ad server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:51.745 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.742+0000 7f50c8927640 1 -- 172.21.15.78:0/1237480576 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50c0005ae0 con 0x7f50b0003980 2023-12-12T10:12:51.745 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.742+0000 7f50c8927640 1 -- 172.21.15.78:0/1237480576 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50c0005c40 con 0x7f50b0003980 2023-12-12T10:12:51.745 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.742+0000 7f50c8927640 1 -- 172.21.15.78:0/1237480576 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50c00a57d0 con 0x7f50b0003980 2023-12-12T10:12:51.745 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.742+0000 7f50ca92b640 1 -- 172.21.15.78:0/1237480576 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50b0003980 msgr2=0x7f50b0003d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:51.745 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.742+0000 7f50ca92b640 1 --2- 172.21.15.78:0/1237480576 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50b0003980 0x7f50b0003d60 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f50c000c1c0 tx=0x7f50c001cc10 comp rx=0 tx=0).stop 2023-12-12T10:12:51.746 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.742+0000 7f50ca92b640 1 -- 172.21.15.78:0/1237480576 shutdown_connections 2023-12-12T10:12:51.746 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.742+0000 7f50ca92b640 1 --2- 172.21.15.78:0/1237480576 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50b0003980 0x7f50b0003d60 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:51.746 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.742+0000 7f50ca92b640 1 -- 172.21.15.78:0/1237480576 >> 172.21.15.78:0/1237480576 conn(0x7f50c406a710 msgr2=0x7f50c406ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:51.746 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.742+0000 7f50ca92b640 1 -- 172.21.15.78:0/1237480576 shutdown_connections 2023-12-12T10:12:51.746 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.742+0000 7f50ca92b640 1 -- 172.21.15.78:0/1237480576 wait complete. 2023-12-12T10:12:51.746 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.742+0000 7f50ca92b640 1 Processor -- start 2023-12-12T10:12:51.746 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.742+0000 7f50ca92b640 1 -- start start 2023-12-12T10:12:51.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.746+0000 7f50ca92b640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f50b0003980 0x7f50c415ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:51.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.746+0000 7f50ca92b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50c4145dc0 0x7f50c4146c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:51.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.746+0000 7f50ca92b640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f50c41fa550 0x7f50c41faa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:51.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.746+0000 7f50ca92b640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50c41475c0 con 0x7f50c4145dc0 2023-12-12T10:12:51.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.746+0000 7f50ca92b640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50c4141010 con 0x7f50c41fa550 2023-12-12T10:12:51.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.746+0000 7f50ca92b640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50c41412f0 con 0x7f50b0003980 2023-12-12T10:12:51.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.746+0000 7f50c9128640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50c4145dc0 0x7f50c4146c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:51.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.746+0000 7f50c9128640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50c4145dc0 0x7f50c4146c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58818/0 (socket says 172.21.15.78:58818) 2023-12-12T10:12:51.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.746+0000 7f50c9128640 1 -- 172.21.15.78:0/1632304022 learned_addr learned my addr 172.21.15.78:0/1632304022 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:51.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.746+0000 7f50c9929640 1 --2- 172.21.15.78:0/1632304022 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f50b0003980 0x7f50c415ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:51.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.746+0000 7f50ca12a640 1 --2- 172.21.15.78:0/1632304022 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f50c41fa550 0x7f50c41faa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:51.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.746+0000 7f50c9128640 1 -- 172.21.15.78:0/1632304022 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f50b0003980 msgr2=0x7f50c415ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:51.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.746+0000 7f50c9128640 1 --2- 172.21.15.78:0/1632304022 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f50b0003980 0x7f50c415ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:51.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.746+0000 7f50c9128640 1 -- 172.21.15.78:0/1632304022 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f50c41fa550 msgr2=0x7f50c41faa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:51.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.746+0000 7f50c9128640 1 --2- 172.21.15.78:0/1632304022 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f50c41fa550 0x7f50c41faa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:51.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.746+0000 7f50c9128640 1 -- 172.21.15.78:0/1632304022 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50c41415d0 con 0x7f50c4145dc0 2023-12-12T10:12:51.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.746+0000 7f50c9128640 1 --2- 172.21.15.78:0/1632304022 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50c4145dc0 0x7f50c4146c20 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f50b4011900 tx=0x7f50b4011dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:51.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.746+0000 7f50ba7fc640 1 -- 172.21.15.78:0/1632304022 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b40095b0 con 0x7f50c4145dc0 2023-12-12T10:12:51.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.746+0000 7f50ba7fc640 1 -- 172.21.15.78:0/1632304022 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50b4004240 con 0x7f50c4145dc0 2023-12-12T10:12:51.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.746+0000 7f50ca92b640 1 -- 172.21.15.78:0/1632304022 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50c41418b0 con 0x7f50c4145dc0 2023-12-12T10:12:51.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.746+0000 7f50ba7fc640 1 -- 172.21.15.78:0/1632304022 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b400f8e0 con 0x7f50c4145dc0 2023-12-12T10:12:51.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.746+0000 7f50ca92b640 1 -- 172.21.15.78:0/1632304022 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50c4147160 con 0x7f50c4145dc0 2023-12-12T10:12:51.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.746+0000 7f50ca92b640 1 -- 172.21.15.78:0/1632304022 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50c40671f0 con 0x7f50c4145dc0 2023-12-12T10:12:51.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.746+0000 7f50ba7fc640 1 -- 172.21.15.78:0/1632304022 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f50b400fa40 con 0x7f50c4145dc0 2023-12-12T10:12:51.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.750+0000 7f50ba7fc640 1 --2- 172.21.15.78:0/1632304022 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f50a8066470 0x7f50a8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:51.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.750+0000 7f50ba7fc640 1 -- 172.21.15.78:0/1632304022 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f50b4084820 con 0x7f50c4145dc0 2023-12-12T10:12:51.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.750+0000 7f50c9929640 1 --2- 172.21.15.78:0/1632304022 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f50a8066470 0x7f50a8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:51.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.750+0000 7f50c9929640 1 --2- 172.21.15.78:0/1632304022 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f50a8066470 0x7f50a8068930 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f50c00ab000 tx=0x7f50c00a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:51.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.754+0000 7f50ba7fc640 1 -- 172.21.15.78:0/1632304022 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f50b40518f0 con 0x7f50c4145dc0 2023-12-12T10:12:51.906 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.902+0000 7f50ca92b640 1 -- 172.21.15.78:0/1632304022 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f50c40745a0 con 0x7f50c4145dc0 2023-12-12T10:12:51.906 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.902+0000 7f50ba7fc640 1 -- 172.21.15.78:0/1632304022 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f50b400fcf0 con 0x7f50c4145dc0 2023-12-12T10:12:51.906 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2023-12-12T10:12:51.908 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.906+0000 7f50ca92b640 1 -- 172.21.15.78:0/1632304022 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f50a8066470 msgr2=0x7f50a8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:51.908 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.906+0000 7f50ca92b640 1 --2- 172.21.15.78:0/1632304022 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f50a8066470 0x7f50a8068930 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f50c00ab000 tx=0x7f50c00a7070 comp rx=0 tx=0).stop 2023-12-12T10:12:51.908 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.906+0000 7f50ca92b640 1 -- 172.21.15.78:0/1632304022 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50c4145dc0 msgr2=0x7f50c4146c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:51.908 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.906+0000 7f50ca92b640 1 --2- 172.21.15.78:0/1632304022 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50c4145dc0 0x7f50c4146c20 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f50b4011900 tx=0x7f50b4011dc0 comp rx=0 tx=0).stop 2023-12-12T10:12:51.908 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.906+0000 7f50ca92b640 1 -- 172.21.15.78:0/1632304022 shutdown_connections 2023-12-12T10:12:51.908 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.906+0000 7f50ca92b640 1 --2- 172.21.15.78:0/1632304022 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f50a8066470 0x7f50a8068930 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:51.909 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.906+0000 7f50ca92b640 1 --2- 172.21.15.78:0/1632304022 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f50c41fa550 0x7f50c41faa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:51.909 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.906+0000 7f50ca92b640 1 --2- 172.21.15.78:0/1632304022 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f50c4145dc0 0x7f50c4146c20 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:51.909 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.906+0000 7f50ca92b640 1 --2- 172.21.15.78:0/1632304022 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f50b0003980 0x7f50c415ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:51.909 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.906+0000 7f50ca92b640 1 -- 172.21.15.78:0/1632304022 >> 172.21.15.78:0/1632304022 conn(0x7f50c406a710 msgr2=0x7f50c406aaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:51.909 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.906+0000 7f50ca92b640 1 -- 172.21.15.78:0/1632304022 shutdown_connections 2023-12-12T10:12:51.909 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:51.906+0000 7f50ca92b640 1 -- 172.21.15.78:0/1632304022 wait complete. 2023-12-12T10:12:51.927 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-12T10:12:52.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.066+0000 7f06a132a640 1 Processor -- start 2023-12-12T10:12:52.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.066+0000 7f06a132a640 1 -- start start 2023-12-12T10:12:52.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.066+0000 7f06a132a640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f069c143770 0x7f069c0cdf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:52.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.066+0000 7f06a132a640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f069c071610 0x7f069c15d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:52.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.066+0000 7f06a132a640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f069c070a70 con 0x7f069c0b1e20 2023-12-12T10:12:52.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.066+0000 7f06a132a640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f069c070440 con 0x7f069c143770 2023-12-12T10:12:52.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.066+0000 7f06a132a640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f069c143b50 con 0x7f069c071610 2023-12-12T10:12:52.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.066+0000 7f069affd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f069c143770 0x7f069c0cdf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:52.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.066+0000 7f069affd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f069c143770 0x7f069c0cdf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58820/0 (socket says 172.21.15.78:58820) 2023-12-12T10:12:52.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.066+0000 7f069affd640 1 -- 172.21.15.78:0/2120411746 learned_addr learned my addr 172.21.15.78:0/2120411746 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:52.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.066+0000 7f069b7fe640 1 --2- 172.21.15.78:0/2120411746 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f069c071610 0x7f069c15d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:52.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.066+0000 7f069affd640 1 -- 172.21.15.78:0/2120411746 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f069c071610 msgr2=0x7f069c15d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:52.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.066+0000 7f069affd640 1 --2- 172.21.15.78:0/2120411746 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f069c071610 0x7f069c15d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:52.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.066+0000 7f069affd640 1 -- 172.21.15.78:0/2120411746 >> v1:172.21.15.187:6789/0 conn(0x7f069c0b1e20 legacy=0x7f069c070f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:52.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.066+0000 7f069affd640 1 -- 172.21.15.78:0/2120411746 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f069c0ce620 con 0x7f069c143770 2023-12-12T10:12:52.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.070+0000 7f069affd640 1 --2- 172.21.15.78:0/2120411746 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f069c143770 0x7f069c0cdf60 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f068c009870 tx=0x7f068c01c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90697ce4b9696739 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:52.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.070+0000 7f069a7fc640 1 -- 172.21.15.78:0/2120411746 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f068c0ac620 con 0x7f069c143770 2023-12-12T10:12:52.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.070+0000 7f069a7fc640 1 -- 172.21.15.78:0/2120411746 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f068c0ac780 con 0x7f069c143770 2023-12-12T10:12:52.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.070+0000 7f069a7fc640 1 -- 172.21.15.78:0/2120411746 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f068c0acb10 con 0x7f069c143770 2023-12-12T10:12:52.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.070+0000 7f06a132a640 1 -- 172.21.15.78:0/2120411746 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f069c143770 msgr2=0x7f069c0cdf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:52.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.070+0000 7f06a132a640 1 --2- 172.21.15.78:0/2120411746 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f069c143770 0x7f069c0cdf60 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f068c009870 tx=0x7f068c01c4b0 comp rx=0 tx=0).stop 2023-12-12T10:12:52.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.070+0000 7f06a132a640 1 -- 172.21.15.78:0/2120411746 shutdown_connections 2023-12-12T10:12:52.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.070+0000 7f06a132a640 1 --2- 172.21.15.78:0/2120411746 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f069c071610 0x7f069c15d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:52.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.070+0000 7f06a132a640 1 --2- 172.21.15.78:0/2120411746 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f069c143770 0x7f069c0cdf60 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:52.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.070+0000 7f06a132a640 1 -- 172.21.15.78:0/2120411746 >> 172.21.15.78:0/2120411746 conn(0x7f069c06a710 msgr2=0x7f069c06ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:52.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.070+0000 7f06a132a640 1 -- 172.21.15.78:0/2120411746 shutdown_connections 2023-12-12T10:12:52.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.070+0000 7f06a132a640 1 -- 172.21.15.78:0/2120411746 wait complete. 2023-12-12T10:12:52.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.074+0000 7f06a132a640 1 Processor -- start 2023-12-12T10:12:52.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.074+0000 7f06a132a640 1 -- start start 2023-12-12T10:12:52.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.074+0000 7f06a132a640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f069c071610 0x7f069c15a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:52.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.074+0000 7f06a132a640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f069c0b1e20 0x7f069c15bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:52.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.074+0000 7f06a132a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f069c143770 0x7f069c0cdbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:52.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.074+0000 7f06a132a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f069c166800 con 0x7f069c143770 2023-12-12T10:12:52.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.074+0000 7f06a132a640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f069c166a50 con 0x7f069c071610 2023-12-12T10:12:52.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.074+0000 7f06a132a640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f069c166d30 con 0x7f069c0b1e20 2023-12-12T10:12:52.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.074+0000 7f069b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f069c143770 0x7f069c0cdbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:52.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.074+0000 7f069b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f069c143770 0x7f069c0cdbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58836/0 (socket says 172.21.15.78:58836) 2023-12-12T10:12:52.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.074+0000 7f069affd640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f069c071610 0x7f069c15a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:52.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.074+0000 7f069b7fe640 1 -- 172.21.15.78:0/2552033329 learned_addr learned my addr 172.21.15.78:0/2552033329 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:52.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.074+0000 7f06927fc640 1 --2- 172.21.15.78:0/2552033329 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f069c0b1e20 0x7f069c15bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:52.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.074+0000 7f069b7fe640 1 -- 172.21.15.78:0/2552033329 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f069c0b1e20 msgr2=0x7f069c15bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:52.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.074+0000 7f069b7fe640 1 --2- 172.21.15.78:0/2552033329 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f069c0b1e20 0x7f069c15bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:52.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.074+0000 7f069b7fe640 1 -- 172.21.15.78:0/2552033329 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f069c071610 msgr2=0x7f069c15a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:52.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.074+0000 7f069b7fe640 1 --2- 172.21.15.78:0/2552033329 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f069c071610 0x7f069c15a2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:52.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.074+0000 7f069b7fe640 1 -- 172.21.15.78:0/2552033329 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f068c0094d0 con 0x7f069c143770 2023-12-12T10:12:52.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.074+0000 7f069b7fe640 1 --2- 172.21.15.78:0/2552033329 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f069c143770 0x7f069c0cdbc0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f0694007e40 tx=0x7f069400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:52.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.074+0000 7f0693fff640 1 -- 172.21.15.78:0/2552033329 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0694014620 con 0x7f069c143770 2023-12-12T10:12:52.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.074+0000 7f0693fff640 1 -- 172.21.15.78:0/2552033329 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f069400ee90 con 0x7f069c143770 2023-12-12T10:12:52.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.074+0000 7f06a132a640 1 -- 172.21.15.78:0/2552033329 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f069c167010 con 0x7f069c143770 2023-12-12T10:12:52.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.074+0000 7f0693fff640 1 -- 172.21.15.78:0/2552033329 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06940149e0 con 0x7f069c143770 2023-12-12T10:12:52.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.074+0000 7f06a132a640 1 -- 172.21.15.78:0/2552033329 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f069c15c0e0 con 0x7f069c143770 2023-12-12T10:12:52.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.078+0000 7f06a132a640 1 -- 172.21.15.78:0/2552033329 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f069c0671f0 con 0x7f069c143770 2023-12-12T10:12:52.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.078+0000 7f0693fff640 1 -- 172.21.15.78:0/2552033329 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f0694014b40 con 0x7f069c143770 2023-12-12T10:12:52.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.078+0000 7f0693fff640 1 --2- 172.21.15.78:0/2552033329 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f067c066470 0x7f067c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:52.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.078+0000 7f0693fff640 1 -- 172.21.15.78:0/2552033329 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f0694084a60 con 0x7f069c143770 2023-12-12T10:12:52.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.078+0000 7f069affd640 1 --2- 172.21.15.78:0/2552033329 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f067c066470 0x7f067c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:52.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.078+0000 7f069affd640 1 --2- 172.21.15.78:0/2552033329 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f067c066470 0x7f067c068930 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f068c0ae000 tx=0x7f068c0a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:52.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.082+0000 7f0693fff640 1 -- 172.21.15.78:0/2552033329 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0694051bd0 con 0x7f069c143770 2023-12-12T10:12:52.234 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.230+0000 7f06a132a640 1 -- 172.21.15.78:0/2552033329 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f069c067530 con 0x7f069c143770 2023-12-12T10:12:52.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.234+0000 7f0693fff640 1 -- 172.21.15.78:0/2552033329 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f06940551f0 con 0x7f069c143770 2023-12-12T10:12:52.235 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2023-12-12T10:12:52.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.234+0000 7f06a132a640 1 -- 172.21.15.78:0/2552033329 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f067c066470 msgr2=0x7f067c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:52.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.234+0000 7f06a132a640 1 --2- 172.21.15.78:0/2552033329 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f067c066470 0x7f067c068930 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f068c0ae000 tx=0x7f068c0a7000 comp rx=0 tx=0).stop 2023-12-12T10:12:52.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.234+0000 7f06a132a640 1 -- 172.21.15.78:0/2552033329 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f069c143770 msgr2=0x7f069c0cdbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:52.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.234+0000 7f06a132a640 1 --2- 172.21.15.78:0/2552033329 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f069c143770 0x7f069c0cdbc0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f0694007e40 tx=0x7f069400e4b0 comp rx=0 tx=0).stop 2023-12-12T10:12:52.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.234+0000 7f06a132a640 1 -- 172.21.15.78:0/2552033329 shutdown_connections 2023-12-12T10:12:52.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.234+0000 7f06a132a640 1 --2- 172.21.15.78:0/2552033329 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f067c066470 0x7f067c068930 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:52.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.234+0000 7f06a132a640 1 --2- 172.21.15.78:0/2552033329 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f069c143770 0x7f069c0cdbc0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:52.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.234+0000 7f06a132a640 1 --2- 172.21.15.78:0/2552033329 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f069c0b1e20 0x7f069c15bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:52.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.234+0000 7f06a132a640 1 --2- 172.21.15.78:0/2552033329 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f069c071610 0x7f069c15a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:52.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.234+0000 7f06a132a640 1 -- 172.21.15.78:0/2552033329 >> 172.21.15.78:0/2552033329 conn(0x7f069c06a710 msgr2=0x7f069c139a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:52.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.234+0000 7f06a132a640 1 -- 172.21.15.78:0/2552033329 shutdown_connections 2023-12-12T10:12:52.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.234+0000 7f06a132a640 1 -- 172.21.15.78:0/2552033329 wait complete. 2023-12-12T10:12:52.256 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-12T10:12:52.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.394+0000 7fe54fe5a640 1 Processor -- start 2023-12-12T10:12:52.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.394+0000 7fe54fe5a640 1 -- start start 2023-12-12T10:12:52.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.394+0000 7fe54fe5a640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe5481656b0 0x7fe5480b2c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:52.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.394+0000 7fe54fe5a640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe5480b31b0 0x7fe54806cc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:52.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.394+0000 7fe54fe5a640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5480b39a0 con 0x7fe548071d40 2023-12-12T10:12:52.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.394+0000 7fe54fe5a640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe548072120 con 0x7fe5480b31b0 2023-12-12T10:12:52.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.394+0000 7fe54fe5a640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5480b3c80 con 0x7fe5481656b0 2023-12-12T10:12:52.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.394+0000 7fe54e3f7640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe5480b31b0 0x7fe54806cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:52.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.394+0000 7fe54dbf6640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fe548071d40 0x7fe548164fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:41442/0 (socket says 172.21.15.78:41442) 2023-12-12T10:12:52.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.394+0000 7fe54dbf6640 1 -- 172.21.15.78:0/3071293190 learned_addr learned my addr 172.21.15.78:0/3071293190 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-12-12T10:12:52.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.394+0000 7fe54e3f7640 1 -- 172.21.15.78:0/3071293190 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe5481656b0 msgr2=0x7fe5480b2c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:52.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.394+0000 7fe54e3f7640 1 --2- 172.21.15.78:0/3071293190 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe5481656b0 0x7fe5480b2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:52.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.394+0000 7fe54e3f7640 1 -- 172.21.15.78:0/3071293190 >> v1:172.21.15.78:6789/0 conn(0x7fe548071d40 legacy=0x7fe548164fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:52.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.394+0000 7fe54e3f7640 1 -- 172.21.15.78:0/3071293190 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5480b3f60 con 0x7fe5480b31b0 2023-12-12T10:12:52.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.398+0000 7fe54e3f7640 1 --2- 172.21.15.78:0/3071293190 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe5480b31b0 0x7fe54806cc80 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fe540009d90 tx=0x7fe54001c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2888fdc651765a1c server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:52.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.398+0000 7fe54cbf4640 1 -- 172.21.15.78:0/3071293190 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5400a57b0 con 0x7fe5480b31b0 2023-12-12T10:12:52.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.398+0000 7fe54cbf4640 1 -- 172.21.15.78:0/3071293190 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5400a5910 con 0x7fe5480b31b0 2023-12-12T10:12:52.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.398+0000 7fe54cbf4640 1 -- 172.21.15.78:0/3071293190 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5400a5ca0 con 0x7fe5480b31b0 2023-12-12T10:12:52.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.398+0000 7fe54fe5a640 1 -- 172.21.15.78:0/3071293190 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe5480b31b0 msgr2=0x7fe54806cc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:52.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.398+0000 7fe54fe5a640 1 --2- 172.21.15.78:0/3071293190 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe5480b31b0 0x7fe54806cc80 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fe540009d90 tx=0x7fe54001c7b0 comp rx=0 tx=0).stop 2023-12-12T10:12:52.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.398+0000 7fe54fe5a640 1 -- 172.21.15.78:0/3071293190 shutdown_connections 2023-12-12T10:12:52.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.398+0000 7fe54fe5a640 1 --2- 172.21.15.78:0/3071293190 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe5480b31b0 0x7fe54806cc80 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:52.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.398+0000 7fe54fe5a640 1 --2- 172.21.15.78:0/3071293190 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe5481656b0 0x7fe5480b2c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:52.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.398+0000 7fe54fe5a640 1 -- 172.21.15.78:0/3071293190 >> 172.21.15.78:0/3071293190 conn(0x7fe54806a710 msgr2=0x7fe54806ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:52.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.398+0000 7fe54fe5a640 1 -- 172.21.15.78:0/3071293190 shutdown_connections 2023-12-12T10:12:52.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.398+0000 7fe54fe5a640 1 -- 172.21.15.78:0/3071293190 wait complete. 2023-12-12T10:12:52.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.402+0000 7fe54fe5a640 1 Processor -- start 2023-12-12T10:12:52.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.402+0000 7fe54fe5a640 1 -- start start 2023-12-12T10:12:52.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.402+0000 7fe54fe5a640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe548071d40 0x7fe54813d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:52.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.402+0000 7fe54fe5a640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe5480b31b0 0x7fe548154c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:52.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.402+0000 7fe54fe5a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe5481656b0 0x7fe5480ccec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:52.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.402+0000 7fe54fe5a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5480cca30 con 0x7fe5481656b0 2023-12-12T10:12:52.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.402+0000 7fe54fe5a640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe54813cd70 con 0x7fe5480b31b0 2023-12-12T10:12:52.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.402+0000 7fe54fe5a640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe54813d050 con 0x7fe548071d40 2023-12-12T10:12:52.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.402+0000 7fe54e3f7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe5481656b0 0x7fe5480ccec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:52.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.402+0000 7fe54e3f7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe5481656b0 0x7fe5480ccec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58864/0 (socket says 172.21.15.78:58864) 2023-12-12T10:12:52.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.402+0000 7fe54e3f7640 1 -- 172.21.15.78:0/254574398 learned_addr learned my addr 172.21.15.78:0/254574398 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:52.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.402+0000 7fe54dbf6640 1 --2- 172.21.15.78:0/254574398 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe548071d40 0x7fe54813d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:52.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.402+0000 7fe54d3f5640 1 --2- 172.21.15.78:0/254574398 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe5480b31b0 0x7fe548154c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:52.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.402+0000 7fe54e3f7640 1 -- 172.21.15.78:0/254574398 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe548071d40 msgr2=0x7fe54813d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:52.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.402+0000 7fe54e3f7640 1 --2- 172.21.15.78:0/254574398 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe548071d40 0x7fe54813d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:52.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.402+0000 7fe54e3f7640 1 -- 172.21.15.78:0/254574398 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe5480b31b0 msgr2=0x7fe548154c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:52.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.402+0000 7fe54e3f7640 1 --2- 172.21.15.78:0/254574398 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe5480b31b0 0x7fe548154c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:52.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.402+0000 7fe54e3f7640 1 -- 172.21.15.78:0/254574398 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe540009a70 con 0x7fe5481656b0 2023-12-12T10:12:52.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.402+0000 7fe54e3f7640 1 --2- 172.21.15.78:0/254574398 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe5481656b0 0x7fe5480ccec0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fe5400b0040 tx=0x7fe540019550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:52.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.402+0000 7fe53e7fc640 1 -- 172.21.15.78:0/254574398 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5400ad850 con 0x7fe5481656b0 2023-12-12T10:12:52.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.402+0000 7fe53e7fc640 1 -- 172.21.15.78:0/254574398 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5400ad9b0 con 0x7fe5481656b0 2023-12-12T10:12:52.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.402+0000 7fe54fe5a640 1 -- 172.21.15.78:0/254574398 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5480cc3e0 con 0x7fe5481656b0 2023-12-12T10:12:52.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.402+0000 7fe53e7fc640 1 -- 172.21.15.78:0/254574398 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5400add60 con 0x7fe5481656b0 2023-12-12T10:12:52.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.402+0000 7fe54fe5a640 1 -- 172.21.15.78:0/254574398 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe54813c920 con 0x7fe5481656b0 2023-12-12T10:12:52.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.402+0000 7fe54fe5a640 1 -- 172.21.15.78:0/254574398 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5480671f0 con 0x7fe5481656b0 2023-12-12T10:12:52.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.406+0000 7fe53e7fc640 1 -- 172.21.15.78:0/254574398 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe5400b4050 con 0x7fe5481656b0 2023-12-12T10:12:52.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.406+0000 7fe53e7fc640 1 --2- 172.21.15.78:0/254574398 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fe52c066470 0x7fe52c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:52.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.406+0000 7fe53e7fc640 1 -- 172.21.15.78:0/254574398 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fe54011ef30 con 0x7fe5481656b0 2023-12-12T10:12:52.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.406+0000 7fe54dbf6640 1 --2- 172.21.15.78:0/254574398 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fe52c066470 0x7fe52c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:52.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.406+0000 7fe54dbf6640 1 --2- 172.21.15.78:0/254574398 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fe52c066470 0x7fe52c068930 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe544000f70 tx=0x7fe544007e10 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:52.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.410+0000 7fe53e7fc640 1 -- 172.21.15.78:0/254574398 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe5400ec0a0 con 0x7fe5481656b0 2023-12-12T10:12:52.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.558+0000 7fe54fe5a640 1 -- 172.21.15.78:0/254574398 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe5480671f0 con 0x7fe5481656b0 2023-12-12T10:12:52.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.558+0000 7fe53e7fc640 1 -- 172.21.15.78:0/254574398 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe5400b20a0 con 0x7fe5481656b0 2023-12-12T10:12:52.563 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2023-12-12T10:12:52.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.562+0000 7fe54fe5a640 1 -- 172.21.15.78:0/254574398 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fe52c066470 msgr2=0x7fe52c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:52.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.562+0000 7fe54fe5a640 1 --2- 172.21.15.78:0/254574398 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fe52c066470 0x7fe52c068930 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe544000f70 tx=0x7fe544007e10 comp rx=0 tx=0).stop 2023-12-12T10:12:52.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.562+0000 7fe54fe5a640 1 -- 172.21.15.78:0/254574398 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe5481656b0 msgr2=0x7fe5480ccec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:52.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.562+0000 7fe54fe5a640 1 --2- 172.21.15.78:0/254574398 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe5481656b0 0x7fe5480ccec0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fe5400b0040 tx=0x7fe540019550 comp rx=0 tx=0).stop 2023-12-12T10:12:52.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.562+0000 7fe54fe5a640 1 -- 172.21.15.78:0/254574398 shutdown_connections 2023-12-12T10:12:52.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.562+0000 7fe54fe5a640 1 --2- 172.21.15.78:0/254574398 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fe52c066470 0x7fe52c068930 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:52.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.562+0000 7fe54fe5a640 1 --2- 172.21.15.78:0/254574398 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe5481656b0 0x7fe5480ccec0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:52.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.562+0000 7fe54fe5a640 1 --2- 172.21.15.78:0/254574398 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe5480b31b0 0x7fe548154c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:52.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.562+0000 7fe54fe5a640 1 --2- 172.21.15.78:0/254574398 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe548071d40 0x7fe54813d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:52.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.562+0000 7fe54fe5a640 1 -- 172.21.15.78:0/254574398 >> 172.21.15.78:0/254574398 conn(0x7fe54806a710 msgr2=0x7fe5480ce130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:52.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.562+0000 7fe54fe5a640 1 -- 172.21.15.78:0/254574398 shutdown_connections 2023-12-12T10:12:52.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.562+0000 7fe54fe5a640 1 -- 172.21.15.78:0/254574398 wait complete. 2023-12-12T10:12:52.584 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-12T10:12:52.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.722+0000 7fb629edd640 1 Processor -- start 2023-12-12T10:12:52.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.722+0000 7fb629edd640 1 -- start start 2023-12-12T10:12:52.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.722+0000 7fb629edd640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fb6240cfa70 0x7fb6240cfe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:52.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.722+0000 7fb629edd640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb6240ceee0 0x7fb6240d1790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:52.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.722+0000 7fb629edd640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6240d3e20 con 0x7fb6240cf2c0 2023-12-12T10:12:52.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.722+0000 7fb629edd640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6240ceac0 con 0x7fb6240cfa70 2023-12-12T10:12:52.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.722+0000 7fb629edd640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6240ce140 con 0x7fb6240ceee0 2023-12-12T10:12:52.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.722+0000 7fb623fff640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fb6240cf2c0 0x7fb6240b5e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:41444/0 (socket says 172.21.15.78:41444) 2023-12-12T10:12:52.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.722+0000 7fb623fff640 1 -- 172.21.15.78:0/3999235730 learned_addr learned my addr 172.21.15.78:0/3999235730 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-12-12T10:12:52.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.722+0000 7fb61affd640 1 --2- 172.21.15.78:0/3999235730 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb6240ceee0 0x7fb6240d1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:52.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.722+0000 7fb6237fe640 1 --2- 172.21.15.78:0/3999235730 >> v2:172.21.15.187:3300/0 conn(0x7fb6240cfa70 0x7fb6240cfe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:52.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.722+0000 7fb622ffd640 1 -- 172.21.15.78:0/3999235730 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 620678663 0 0) 0x7fb6240d3e20 con 0x7fb6240cf2c0 2023-12-12T10:12:52.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.722+0000 7fb622ffd640 1 -- 172.21.15.78:0/3999235730 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb610003530 con 0x7fb6240cf2c0 2023-12-12T10:12:52.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.722+0000 7fb61affd640 1 -- 172.21.15.78:0/3999235730 >> v2:172.21.15.187:3300/0 conn(0x7fb6240cfa70 msgr2=0x7fb6240cfe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:52.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.722+0000 7fb61affd640 1 --2- 172.21.15.78:0/3999235730 >> v2:172.21.15.187:3300/0 conn(0x7fb6240cfa70 0x7fb6240cfe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:52.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.722+0000 7fb61affd640 1 -- 172.21.15.78:0/3999235730 >> v1:172.21.15.78:6789/0 conn(0x7fb6240cf2c0 legacy=0x7fb6240b5e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:52.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.722+0000 7fb61affd640 1 -- 172.21.15.78:0/3999235730 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6240ce400 con 0x7fb6240ceee0 2023-12-12T10:12:52.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.726+0000 7fb61affd640 1 --2- 172.21.15.78:0/3999235730 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb6240ceee0 0x7fb6240d1790 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb6140097c0 tx=0x7fb61401c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9ea51106536fada7 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:52.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.726+0000 7fb622ffd640 1 -- 172.21.15.78:0/3999235730 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6140ab600 con 0x7fb6240ceee0 2023-12-12T10:12:52.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.726+0000 7fb622ffd640 1 -- 172.21.15.78:0/3999235730 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6140a7050 con 0x7fb6240ceee0 2023-12-12T10:12:52.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.726+0000 7fb622ffd640 1 -- 172.21.15.78:0/3999235730 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6140ab980 con 0x7fb6240ceee0 2023-12-12T10:12:52.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.726+0000 7fb629edd640 1 -- 172.21.15.78:0/3999235730 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb6240ceee0 msgr2=0x7fb6240d1790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:52.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.726+0000 7fb629edd640 1 --2- 172.21.15.78:0/3999235730 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb6240ceee0 0x7fb6240d1790 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb6140097c0 tx=0x7fb61401c3f0 comp rx=0 tx=0).stop 2023-12-12T10:12:52.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.726+0000 7fb629edd640 1 -- 172.21.15.78:0/3999235730 shutdown_connections 2023-12-12T10:12:52.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.726+0000 7fb629edd640 1 --2- 172.21.15.78:0/3999235730 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb6240ceee0 0x7fb6240d1790 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:52.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.726+0000 7fb629edd640 1 --2- 172.21.15.78:0/3999235730 >> v2:172.21.15.187:3300/0 conn(0x7fb6240cfa70 0x7fb6240cfe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:52.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.726+0000 7fb629edd640 1 -- 172.21.15.78:0/3999235730 >> 172.21.15.78:0/3999235730 conn(0x7fb6240d3020 msgr2=0x7fb6240d3430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:52.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.726+0000 7fb629edd640 1 -- 172.21.15.78:0/3999235730 shutdown_connections 2023-12-12T10:12:52.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.726+0000 7fb629edd640 1 -- 172.21.15.78:0/3999235730 wait complete. 2023-12-12T10:12:52.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.730+0000 7fb629edd640 1 Processor -- start 2023-12-12T10:12:52.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.730+0000 7fb629edd640 1 -- start start 2023-12-12T10:12:52.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.730+0000 7fb629edd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb6240ceee0 0x7fb624153bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:52.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.730+0000 7fb629edd640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb6240cf2c0 0x7fb6240cab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:52.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.730+0000 7fb629edd640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb6240cfa70 0x7fb6240cb040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:52.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.730+0000 7fb629edd640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6241550c0 con 0x7fb6240ceee0 2023-12-12T10:12:52.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.730+0000 7fb629edd640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb624155ac0 con 0x7fb6240cf2c0 2023-12-12T10:12:52.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.730+0000 7fb629edd640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb624154130 con 0x7fb6240cfa70 2023-12-12T10:12:52.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.730+0000 7fb6237fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb6240ceee0 0x7fb624153bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:52.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.730+0000 7fb6237fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb6240ceee0 0x7fb624153bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58874/0 (socket says 172.21.15.78:58874) 2023-12-12T10:12:52.735 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.730+0000 7fb6237fe640 1 -- 172.21.15.78:0/4271088078 learned_addr learned my addr 172.21.15.78:0/4271088078 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:52.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.730+0000 7fb623fff640 1 --2- 172.21.15.78:0/4271088078 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb6240cfa70 0x7fb6240cb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:52.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.730+0000 7fb61affd640 1 --2- 172.21.15.78:0/4271088078 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb6240cf2c0 0x7fb6240cab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:52.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.730+0000 7fb6237fe640 1 -- 172.21.15.78:0/4271088078 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb6240cfa70 msgr2=0x7fb6240cb040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:52.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.730+0000 7fb6237fe640 1 --2- 172.21.15.78:0/4271088078 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb6240cfa70 0x7fb6240cb040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:52.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.730+0000 7fb6237fe640 1 -- 172.21.15.78:0/4271088078 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb6240cf2c0 msgr2=0x7fb6240cab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:52.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.730+0000 7fb6237fe640 1 --2- 172.21.15.78:0/4271088078 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb6240cf2c0 0x7fb6240cab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:52.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.730+0000 7fb6237fe640 1 -- 172.21.15.78:0/4271088078 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb614009420 con 0x7fb6240ceee0 2023-12-12T10:12:52.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.730+0000 7fb623fff640 1 --2- 172.21.15.78:0/4271088078 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb6240cfa70 0x7fb6240cb040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T10:12:52.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.730+0000 7fb6237fe640 1 --2- 172.21.15.78:0/4271088078 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb6240ceee0 0x7fb624153bf0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fb60c00e8a0 tx=0x7fb60c00ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:52.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.730+0000 7fb620ff9640 1 -- 172.21.15.78:0/4271088078 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb60c0095d0 con 0x7fb6240ceee0 2023-12-12T10:12:52.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.730+0000 7fb620ff9640 1 -- 172.21.15.78:0/4271088078 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb60c00c940 con 0x7fb6240ceee0 2023-12-12T10:12:52.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.730+0000 7fb620ff9640 1 -- 172.21.15.78:0/4271088078 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb60c00ccb0 con 0x7fb6240ceee0 2023-12-12T10:12:52.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.730+0000 7fb629edd640 1 -- 172.21.15.78:0/4271088078 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb624154440 con 0x7fb6240ceee0 2023-12-12T10:12:52.737 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.734+0000 7fb629edd640 1 -- 172.21.15.78:0/4271088078 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb624154a00 con 0x7fb6240ceee0 2023-12-12T10:12:52.737 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.734+0000 7fb629edd640 1 -- 172.21.15.78:0/4271088078 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb624155330 con 0x7fb6240ceee0 2023-12-12T10:12:52.737 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.734+0000 7fb620ff9640 1 -- 172.21.15.78:0/4271088078 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb60c013470 con 0x7fb6240ceee0 2023-12-12T10:12:52.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.734+0000 7fb620ff9640 1 --2- 172.21.15.78:0/4271088078 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fb6040664a0 0x7fb604068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:52.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.734+0000 7fb620ff9640 1 -- 172.21.15.78:0/4271088078 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fb60c0846e0 con 0x7fb6240ceee0 2023-12-12T10:12:52.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.734+0000 7fb61affd640 1 --2- 172.21.15.78:0/4271088078 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fb6040664a0 0x7fb604068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:52.739 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.738+0000 7fb61affd640 1 --2- 172.21.15.78:0/4271088078 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fb6040664a0 0x7fb604068960 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fb6140ad000 tx=0x7fb614008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:52.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.738+0000 7fb620ff9640 1 -- 172.21.15.78:0/4271088078 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb60c051830 con 0x7fb6240ceee0 2023-12-12T10:12:52.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.890+0000 7fb629edd640 1 -- 172.21.15.78:0/4271088078 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fb624067530 con 0x7fb6240ceee0 2023-12-12T10:12:52.892 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.890+0000 7fb620ff9640 1 -- 172.21.15.78:0/4271088078 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7fb60c017020 con 0x7fb6240ceee0 2023-12-12T10:12:52.892 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2023-12-12T10:12:52.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.890+0000 7fb629edd640 1 -- 172.21.15.78:0/4271088078 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fb6040664a0 msgr2=0x7fb604068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:52.894 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.890+0000 7fb629edd640 1 --2- 172.21.15.78:0/4271088078 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fb6040664a0 0x7fb604068960 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fb6140ad000 tx=0x7fb614008040 comp rx=0 tx=0).stop 2023-12-12T10:12:52.894 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.890+0000 7fb629edd640 1 -- 172.21.15.78:0/4271088078 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb6240ceee0 msgr2=0x7fb624153bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:52.894 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.890+0000 7fb629edd640 1 --2- 172.21.15.78:0/4271088078 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb6240ceee0 0x7fb624153bf0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fb60c00e8a0 tx=0x7fb60c00ed60 comp rx=0 tx=0).stop 2023-12-12T10:12:52.894 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.890+0000 7fb629edd640 1 -- 172.21.15.78:0/4271088078 shutdown_connections 2023-12-12T10:12:52.894 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.890+0000 7fb629edd640 1 --2- 172.21.15.78:0/4271088078 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fb6040664a0 0x7fb604068960 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:52.894 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.890+0000 7fb629edd640 1 --2- 172.21.15.78:0/4271088078 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb6240cfa70 0x7fb6240cb040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:52.894 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.890+0000 7fb629edd640 1 --2- 172.21.15.78:0/4271088078 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb6240cf2c0 0x7fb6240cab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:52.894 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.890+0000 7fb629edd640 1 --2- 172.21.15.78:0/4271088078 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb6240ceee0 0x7fb624153bf0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:52.894 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.890+0000 7fb629edd640 1 -- 172.21.15.78:0/4271088078 >> 172.21.15.78:0/4271088078 conn(0x7fb6240d3020 msgr2=0x7fb6240d0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:52.894 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.890+0000 7fb629edd640 1 -- 172.21.15.78:0/4271088078 shutdown_connections 2023-12-12T10:12:52.894 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:52.890+0000 7fb629edd640 1 -- 172.21.15.78:0/4271088078 wait complete. 2023-12-12T10:12:52.913 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T10:12:53.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.050+0000 7fec51832640 1 Processor -- start 2023-12-12T10:12:53.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.050+0000 7fec51832640 1 -- start start 2023-12-12T10:12:53.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.050+0000 7fec51832640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fec4c15d180 0x7fec4c0d1c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:53.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.050+0000 7fec51832640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fec4c15d560 0x7fec4c0b6d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:53.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.050+0000 7fec51832640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec4c161da0 con 0x7fec4c06a540 2023-12-12T10:12:53.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.050+0000 7fec51832640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec4c1618b0 con 0x7fec4c15d180 2023-12-12T10:12:53.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.050+0000 7fec51832640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec4c0d11b0 con 0x7fec4c15d560 2023-12-12T10:12:53.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.050+0000 7fec4bfff640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fec4c06a540 0x7fec4c0d31c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:41460/0 (socket says 172.21.15.78:41460) 2023-12-12T10:12:53.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.050+0000 7fec4affd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fec4c15d180 0x7fec4c0d1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:53.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.050+0000 7fec4bfff640 1 -- 172.21.15.78:0/396607134 learned_addr learned my addr 172.21.15.78:0/396607134 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-12-12T10:12:53.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.050+0000 7fec4a7fc640 1 --2- 172.21.15.78:0/396607134 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fec4c15d560 0x7fec4c0b6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:53.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.050+0000 7fec4affd640 1 -- 172.21.15.78:0/396607134 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fec4c15d560 msgr2=0x7fec4c0b6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:53.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.050+0000 7fec4affd640 1 --2- 172.21.15.78:0/396607134 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fec4c15d560 0x7fec4c0b6d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:53.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.050+0000 7fec4affd640 1 -- 172.21.15.78:0/396607134 >> v1:172.21.15.78:6789/0 conn(0x7fec4c06a540 legacy=0x7fec4c0d31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:53.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.050+0000 7fec4affd640 1 -- 172.21.15.78:0/396607134 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec4c161ac0 con 0x7fec4c15d180 2023-12-12T10:12:53.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.054+0000 7fec4affd640 1 --2- 172.21.15.78:0/396607134 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec4c15d180 0x7fec4c0d1c50 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fec3c0097c0 tx=0x7fec3c01c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f121670fcb81a40 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:53.057 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.054+0000 7fec49ffb640 1 -- 172.21.15.78:0/396607134 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec3c0ab600 con 0x7fec4c15d180 2023-12-12T10:12:53.057 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.054+0000 7fec49ffb640 1 -- 172.21.15.78:0/396607134 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec3c0a7050 con 0x7fec4c15d180 2023-12-12T10:12:53.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.054+0000 7fec49ffb640 1 -- 172.21.15.78:0/396607134 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec3c0ab980 con 0x7fec4c15d180 2023-12-12T10:12:53.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.054+0000 7fec51832640 1 -- 172.21.15.78:0/396607134 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec4c15d180 msgr2=0x7fec4c0d1c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:53.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.054+0000 7fec51832640 1 --2- 172.21.15.78:0/396607134 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec4c15d180 0x7fec4c0d1c50 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fec3c0097c0 tx=0x7fec3c01c330 comp rx=0 tx=0).stop 2023-12-12T10:12:53.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.054+0000 7fec51832640 1 -- 172.21.15.78:0/396607134 shutdown_connections 2023-12-12T10:12:53.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.054+0000 7fec51832640 1 --2- 172.21.15.78:0/396607134 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fec4c15d560 0x7fec4c0b6d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:53.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.054+0000 7fec51832640 1 --2- 172.21.15.78:0/396607134 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec4c15d180 0x7fec4c0d1c50 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:53.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.054+0000 7fec51832640 1 -- 172.21.15.78:0/396607134 >> 172.21.15.78:0/396607134 conn(0x7fec4c09de20 msgr2=0x7fec4c0b6250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:53.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.054+0000 7fec51832640 1 -- 172.21.15.78:0/396607134 shutdown_connections 2023-12-12T10:12:53.059 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.054+0000 7fec51832640 1 -- 172.21.15.78:0/396607134 wait complete. 2023-12-12T10:12:53.059 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.054+0000 7fec51832640 1 Processor -- start 2023-12-12T10:12:53.059 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.058+0000 7fec51832640 1 -- start start 2023-12-12T10:12:53.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.058+0000 7fec51832640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec4c06a540 0x7fec4c1f6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:53.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.058+0000 7fec51832640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fec4c15d180 0x7fec4c14f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:53.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.058+0000 7fec51832640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fec4c15d560 0x7fec4c0b3e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:53.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.058+0000 7fec51832640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec4c1f5cc0 con 0x7fec4c06a540 2023-12-12T10:12:53.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.058+0000 7fec51832640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec4c1f6ae0 con 0x7fec4c15d560 2023-12-12T10:12:53.063 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.058+0000 7fec51832640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec4c1f5ed0 con 0x7fec4c15d180 2023-12-12T10:12:53.063 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.058+0000 7fec4affd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec4c06a540 0x7fec4c1f6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:53.063 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.058+0000 7fec4affd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec4c06a540 0x7fec4c1f6dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58890/0 (socket says 172.21.15.78:58890) 2023-12-12T10:12:53.063 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.058+0000 7fec4affd640 1 -- 172.21.15.78:0/1106627098 learned_addr learned my addr 172.21.15.78:0/1106627098 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:53.063 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.058+0000 7fec4a7fc640 1 --2- 172.21.15.78:0/1106627098 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fec4c15d180 0x7fec4c14f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:53.063 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.058+0000 7fec4bfff640 1 --2- 172.21.15.78:0/1106627098 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fec4c15d560 0x7fec4c0b3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:53.063 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.058+0000 7fec4affd640 1 -- 172.21.15.78:0/1106627098 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fec4c15d180 msgr2=0x7fec4c14f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:53.063 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.058+0000 7fec4affd640 1 --2- 172.21.15.78:0/1106627098 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fec4c15d180 0x7fec4c14f7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:53.063 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.058+0000 7fec4affd640 1 -- 172.21.15.78:0/1106627098 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fec4c15d560 msgr2=0x7fec4c0b3e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:53.063 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.058+0000 7fec4affd640 1 --2- 172.21.15.78:0/1106627098 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fec4c15d560 0x7fec4c0b3e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:53.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.058+0000 7fec4affd640 1 -- 172.21.15.78:0/1106627098 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec3c009420 con 0x7fec4c06a540 2023-12-12T10:12:53.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.058+0000 7fec4affd640 1 --2- 172.21.15.78:0/1106627098 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec4c06a540 0x7fec4c1f6dd0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fec3c0ae040 tx=0x7fec3c01ab70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:53.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.058+0000 7fec33fff640 1 -- 172.21.15.78:0/1106627098 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec3c0b7650 con 0x7fec4c06a540 2023-12-12T10:12:53.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.058+0000 7fec33fff640 1 -- 172.21.15.78:0/1106627098 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec3c0abe90 con 0x7fec4c06a540 2023-12-12T10:12:53.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.058+0000 7fec51832640 1 -- 172.21.15.78:0/1106627098 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec4c1f61b0 con 0x7fec4c06a540 2023-12-12T10:12:53.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.058+0000 7fec33fff640 1 -- 172.21.15.78:0/1106627098 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec3c0b7a10 con 0x7fec4c06a540 2023-12-12T10:12:53.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.058+0000 7fec51832640 1 -- 172.21.15.78:0/1106627098 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec4c1f6770 con 0x7fec4c06a540 2023-12-12T10:12:53.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.058+0000 7fec51832640 1 -- 172.21.15.78:0/1106627098 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec4c0671f0 con 0x7fec4c06a540 2023-12-12T10:12:53.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.062+0000 7fec33fff640 1 -- 172.21.15.78:0/1106627098 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fec3c0b7b70 con 0x7fec4c06a540 2023-12-12T10:12:53.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.062+0000 7fec33fff640 1 --2- 172.21.15.78:0/1106627098 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fec38066470 0x7fec38068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:53.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.062+0000 7fec33fff640 1 -- 172.21.15.78:0/1106627098 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fec3c11ead0 con 0x7fec4c06a540 2023-12-12T10:12:53.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.062+0000 7fec4a7fc640 1 --2- 172.21.15.78:0/1106627098 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fec38066470 0x7fec38068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:53.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.062+0000 7fec4a7fc640 1 --2- 172.21.15.78:0/1106627098 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fec38066470 0x7fec38068930 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fec4c0b3c30 tx=0x7fec40008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:53.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.066+0000 7fec33fff640 1 -- 172.21.15.78:0/1106627098 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fec3c0ebce0 con 0x7fec4c06a540 2023-12-12T10:12:53.221 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.218+0000 7fec51832640 1 -- 172.21.15.78:0/1106627098 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fec4c067530 con 0x7fec4c06a540 2023-12-12T10:12:53.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.218+0000 7fec33fff640 1 -- 172.21.15.78:0/1106627098 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18701 (secure 0 0 0) 0x7fec3c0bb090 con 0x7fec4c06a540 2023-12-12T10:12:53.223 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:12:53.223 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":26,"fsid":"fc81937c-bd26-483c-952b-d1324fcb0c9e","created":"2023-12-12T10:11:44.020214+0000","modified":"2023-12-12T10:12:50.919344+0000","last_up_change":"2023-12-12T10:11:56.278318+0000","last_in_change":"2023-12-12T10:11:46.553610+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T10:11:57.053584+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-12T10:12:07.454450+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-12T10:12:08.182909+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-12T10:12:11.977952+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"22dfdedf-5f6c-4b20-9f6c-30517a1db70a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6809","nonce":3345683600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6811","nonce":3345683600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6815","nonce":3345683600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6813","nonce":3345683600}]},"public_addr":"172.21.15.78:6809/3345683600","cluster_addr":"172.21.15.78:6811/3345683600","heartbeat_back_addr":"172.21.15.78:6815/3345683600","heartbeat_front_addr":"172.21.15.78:6813/3345683600","state":["exists","up"]},{"osd":1,"uuid":"be34a7f3-a69a-462e-9ddf-5e537448dba2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6801","nonce":962652768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6803","nonce":962652768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6807","nonce":962652768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6805","nonce":962652768}]},"public_addr":"172.21.15.78:6801/962652768","cluster_addr":"172.21.15.78:6803/962652768","heartbeat_back_addr":"172.21.15.78:6807/962652768","heartbeat_front_addr":"172.21.15.78:6805/962652768","state":["exists","up"]},{"osd":2,"uuid":"55b381de-5f56-4b14-80f7-e6e41e084a13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6818","nonce":2910206054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6822","nonce":2910206054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6829","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6831","nonce":2910206054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6826","nonce":2910206054}]},"public_addr":"172.21.15.78:6818/2910206054","cluster_addr":"172.21.15.78:6822/2910206054","heartbeat_back_addr":"172.21.15.78:6831/2910206054","heartbeat_front_addr":"172.21.15.78:6826/2910206054","state":["exists","up"]},{"osd":3,"uuid":"d7682de1-25cb-4cec-869f-8851c28b0e6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6819","nonce":3750796703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6821","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6823","nonce":3750796703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6830","nonce":3750796703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6825","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6827","nonce":3750796703}]},"public_addr":"172.21.15.78:6819/3750796703","cluster_addr":"172.21.15.78:6823/3750796703","heartbeat_back_addr":"172.21.15.78:6830/3750796703","heartbeat_front_addr":"172.21.15.78:6827/3750796703","state":["exists","up"]},{"osd":4,"uuid":"8279815a-d6c7-4199-871e-d28971b9dc07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6809","nonce":2944277204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6811","nonce":2944277204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6815","nonce":2944277204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6813","nonce":2944277204}]},"public_addr":"172.21.15.187:6809/2944277204","cluster_addr":"172.21.15.187:6811/2944277204","heartbeat_back_addr":"172.21.15.187:6815/2944277204","heartbeat_front_addr":"172.21.15.187:6813/2944277204","state":["exists","up"]},{"osd":5,"uuid":"0a714c65-f8ce-4340-968f-11a799677ef3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6801","nonce":185858620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6803","nonce":185858620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6807","nonce":185858620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6805","nonce":185858620}]},"public_addr":"172.21.15.187:6801/185858620","cluster_addr":"172.21.15.187:6803/185858620","heartbeat_back_addr":"172.21.15.187:6807/185858620","heartbeat_front_addr":"172.21.15.187:6805/185858620","state":["exists","up"]},{"osd":6,"uuid":"d0bba9ab-f7ee-449e-8999-1c0cf7e6d53c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6817","nonce":4213392126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6819","nonce":4213392126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6824","nonce":4213392126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6821","nonce":4213392126}]},"public_addr":"172.21.15.187:6817/4213392126","cluster_addr":"172.21.15.187:6819/4213392126","heartbeat_back_addr":"172.21.15.187:6824/4213392126","heartbeat_front_addr":"172.21.15.187:6821/4213392126","state":["exists","up"]},{"osd":7,"uuid":"efe5e0d9-2f87-4889-a27a-e2a95a632302","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6823","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6825","nonce":85774004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6827","nonce":85774004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6831","nonce":85774004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6829","nonce":85774004}]},"public_addr":"172.21.15.187:6825/85774004","cluster_addr":"172.21.15.187:6827/85774004","heartbeat_back_addr":"172.21.15.187:6831/85774004","heartbeat_front_addr":"172.21.15.187:6829/85774004","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.214447+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.448899+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.293107+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.564184+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.175026+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.097717+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.261141+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.287681+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.18","mappings":[{"from":3,"to":2}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.13","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T10:12:53.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.222+0000 7fec51832640 1 -- 172.21.15.78:0/1106627098 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fec38066470 msgr2=0x7fec38068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:53.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.222+0000 7fec51832640 1 --2- 172.21.15.78:0/1106627098 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fec38066470 0x7fec38068930 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fec4c0b3c30 tx=0x7fec40008040 comp rx=0 tx=0).stop 2023-12-12T10:12:53.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.222+0000 7fec51832640 1 -- 172.21.15.78:0/1106627098 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec4c06a540 msgr2=0x7fec4c1f6dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:53.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.222+0000 7fec51832640 1 --2- 172.21.15.78:0/1106627098 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec4c06a540 0x7fec4c1f6dd0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fec3c0ae040 tx=0x7fec3c01ab70 comp rx=0 tx=0).stop 2023-12-12T10:12:53.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.222+0000 7fec51832640 1 -- 172.21.15.78:0/1106627098 shutdown_connections 2023-12-12T10:12:53.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.222+0000 7fec51832640 1 --2- 172.21.15.78:0/1106627098 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fec38066470 0x7fec38068930 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:53.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.222+0000 7fec51832640 1 --2- 172.21.15.78:0/1106627098 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fec4c15d560 0x7fec4c0b3e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:53.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.222+0000 7fec51832640 1 --2- 172.21.15.78:0/1106627098 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fec4c15d180 0x7fec4c14f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:53.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.222+0000 7fec51832640 1 --2- 172.21.15.78:0/1106627098 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fec4c06a540 0x7fec4c1f6dd0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:53.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.222+0000 7fec51832640 1 -- 172.21.15.78:0/1106627098 >> 172.21.15.78:0/1106627098 conn(0x7fec4c09de20 msgr2=0x7fec4c06ecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:53.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.222+0000 7fec51832640 1 -- 172.21.15.78:0/1106627098 shutdown_connections 2023-12-12T10:12:53.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.222+0000 7fec51832640 1 -- 172.21.15.78:0/1106627098 wait complete. 2023-12-12T10:12:53.244 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-12T10:11:57.053584+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-12T10:12:07.454450+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-12T10:12:08.182909+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-12T10:12:11.977952+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-12T10:12:53.244 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-12T10:12:53.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.382+0000 7f99c0cfe640 1 Processor -- start 2023-12-12T10:12:53.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.382+0000 7f99c0cfe640 1 -- start start 2023-12-12T10:12:53.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.382+0000 7f99c0cfe640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f99bc1656b0 0x7f99bc0b2c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:53.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.382+0000 7f99c0cfe640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f99bc0b31b0 0x7f99bc06cc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:53.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.382+0000 7f99c0cfe640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99bc0b39a0 con 0x7f99bc071d40 2023-12-12T10:12:53.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.382+0000 7f99c0cfe640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99bc072120 con 0x7f99bc0b31b0 2023-12-12T10:12:53.387 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.382+0000 7f99c0cfe640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99bc0b3c80 con 0x7f99bc1656b0 2023-12-12T10:12:53.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.382+0000 7f99bad9d640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f99bc0b31b0 0x7f99bc06cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:53.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.382+0000 7f99b9d9b640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f99bc1656b0 0x7f99bc0b2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:53.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.382+0000 7f99ba59c640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f99bc071d40 0x7f99bc164fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.78:57744/0 (socket says 172.21.15.78:57744) 2023-12-12T10:12:53.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.382+0000 7f99ba59c640 1 -- 172.21.15.78:0/832268379 learned_addr learned my addr 172.21.15.78:0/832268379 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-12-12T10:12:53.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.386+0000 7f99b959a640 1 -- 172.21.15.78:0/832268379 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2961124488 0 0) 0x7f99bc0b39a0 con 0x7f99bc071d40 2023-12-12T10:12:53.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.386+0000 7f99b959a640 1 -- 172.21.15.78:0/832268379 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f99a4003530 con 0x7f99bc071d40 2023-12-12T10:12:53.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.386+0000 7f99bad9d640 1 -- 172.21.15.78:0/832268379 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f99bc1656b0 msgr2=0x7f99bc0b2c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:53.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.386+0000 7f99bad9d640 1 --2- 172.21.15.78:0/832268379 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f99bc1656b0 0x7f99bc0b2c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:53.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.386+0000 7f99bad9d640 1 -- 172.21.15.78:0/832268379 >> v1:172.21.15.187:6789/0 conn(0x7f99bc071d40 legacy=0x7f99bc164fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:53.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.386+0000 7f99bad9d640 1 -- 172.21.15.78:0/832268379 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99bc0b3f60 con 0x7f99bc0b31b0 2023-12-12T10:12:53.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.386+0000 7f99b9d9b640 1 --2- 172.21.15.78:0/832268379 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f99bc1656b0 0x7f99bc0b2c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-12T10:12:53.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.386+0000 7f99bad9d640 1 --2- 172.21.15.78:0/832268379 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f99bc0b31b0 0x7f99bc06cc80 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f99b4009d90 tx=0x7f99b401c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=de6d8291d57be8d9 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:53.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.386+0000 7f99b959a640 1 -- 172.21.15.78:0/832268379 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b40a59e0 con 0x7f99bc0b31b0 2023-12-12T10:12:53.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.386+0000 7f99b959a640 1 -- 172.21.15.78:0/832268379 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99b40a5b40 con 0x7f99bc0b31b0 2023-12-12T10:12:53.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.386+0000 7f99b959a640 1 -- 172.21.15.78:0/832268379 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b40ad440 con 0x7f99bc0b31b0 2023-12-12T10:12:53.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.390+0000 7f99c0cfe640 1 -- 172.21.15.78:0/832268379 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f99bc0b31b0 msgr2=0x7f99bc06cc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:53.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.390+0000 7f99c0cfe640 1 --2- 172.21.15.78:0/832268379 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f99bc0b31b0 0x7f99bc06cc80 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f99b4009d90 tx=0x7f99b401c920 comp rx=0 tx=0).stop 2023-12-12T10:12:53.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.390+0000 7f99c0cfe640 1 -- 172.21.15.78:0/832268379 shutdown_connections 2023-12-12T10:12:53.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.390+0000 7f99c0cfe640 1 --2- 172.21.15.78:0/832268379 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f99bc0b31b0 0x7f99bc06cc80 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:53.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.390+0000 7f99c0cfe640 1 --2- 172.21.15.78:0/832268379 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f99bc1656b0 0x7f99bc0b2c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:53.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.390+0000 7f99c0cfe640 1 -- 172.21.15.78:0/832268379 >> 172.21.15.78:0/832268379 conn(0x7f99bc06a710 msgr2=0x7f99bc06ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:53.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.390+0000 7f99c0cfe640 1 -- 172.21.15.78:0/832268379 shutdown_connections 2023-12-12T10:12:53.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.390+0000 7f99c0cfe640 1 -- 172.21.15.78:0/832268379 wait complete. 2023-12-12T10:12:53.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.390+0000 7f99c0cfe640 1 Processor -- start 2023-12-12T10:12:53.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.390+0000 7f99c0cfe640 1 -- start start 2023-12-12T10:12:53.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.390+0000 7f99c0cfe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f99bc071d40 0x7f99bc162080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:53.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.390+0000 7f99c0cfe640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f99bc0b31b0 0x7f99bc156a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:53.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.390+0000 7f99c0cfe640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f99bc1656b0 0x7f99bc155350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:53.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.390+0000 7f99c0cfe640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99bc156600 con 0x7f99bc071d40 2023-12-12T10:12:53.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.390+0000 7f99c0cfe640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99bc166650 con 0x7f99bc0b31b0 2023-12-12T10:12:53.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.390+0000 7f99c0cfe640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99bc155cd0 con 0x7f99bc1656b0 2023-12-12T10:12:53.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.390+0000 7f99ba59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f99bc071d40 0x7f99bc162080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:53.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.390+0000 7f99ba59c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f99bc071d40 0x7f99bc162080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58906/0 (socket says 172.21.15.78:58906) 2023-12-12T10:12:53.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.390+0000 7f99ba59c640 1 -- 172.21.15.78:0/1584116784 learned_addr learned my addr 172.21.15.78:0/1584116784 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:53.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.394+0000 7f99b9d9b640 1 --2- 172.21.15.78:0/1584116784 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f99bc0b31b0 0x7f99bc156a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:53.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.394+0000 7f99bad9d640 1 --2- 172.21.15.78:0/1584116784 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f99bc1656b0 0x7f99bc155350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:53.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.394+0000 7f99ba59c640 1 -- 172.21.15.78:0/1584116784 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f99bc1656b0 msgr2=0x7f99bc155350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:53.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.394+0000 7f99ba59c640 1 --2- 172.21.15.78:0/1584116784 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f99bc1656b0 0x7f99bc155350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:53.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.394+0000 7f99ba59c640 1 -- 172.21.15.78:0/1584116784 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f99bc0b31b0 msgr2=0x7f99bc156a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:53.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.394+0000 7f99ba59c640 1 --2- 172.21.15.78:0/1584116784 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f99bc0b31b0 0x7f99bc156a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:53.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.394+0000 7f99ba59c640 1 -- 172.21.15.78:0/1584116784 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99b0009420 con 0x7f99bc071d40 2023-12-12T10:12:53.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.394+0000 7f99ba59c640 1 --2- 172.21.15.78:0/1584116784 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f99bc071d40 0x7f99bc162080 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f99ac00c4d0 tx=0x7f99ac00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:53.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.394+0000 7f99aaffd640 1 -- 172.21.15.78:0/1584116784 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99ac005cf0 con 0x7f99bc071d40 2023-12-12T10:12:53.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.394+0000 7f99aaffd640 1 -- 172.21.15.78:0/1584116784 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99ac005e50 con 0x7f99bc071d40 2023-12-12T10:12:53.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.394+0000 7f99aaffd640 1 -- 172.21.15.78:0/1584116784 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99ac007270 con 0x7f99bc071d40 2023-12-12T10:12:53.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.394+0000 7f99c0cfe640 1 -- 172.21.15.78:0/1584116784 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99b4009a70 con 0x7f99bc071d40 2023-12-12T10:12:53.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.394+0000 7f99c0cfe640 1 -- 172.21.15.78:0/1584116784 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99bc156290 con 0x7f99bc071d40 2023-12-12T10:12:53.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.394+0000 7f99c0cfe640 1 -- 172.21.15.78:0/1584116784 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99bc0671f0 con 0x7f99bc071d40 2023-12-12T10:12:53.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.394+0000 7f99aaffd640 1 -- 172.21.15.78:0/1584116784 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f99ac0073d0 con 0x7f99bc071d40 2023-12-12T10:12:53.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.394+0000 7f99aaffd640 1 --2- 172.21.15.78:0/1584116784 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f999c0664a0 0x7f999c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:53.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.398+0000 7f99aaffd640 1 -- 172.21.15.78:0/1584116784 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f99ac0836c0 con 0x7f99bc071d40 2023-12-12T10:12:53.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.398+0000 7f99b9d9b640 1 --2- 172.21.15.78:0/1584116784 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f999c0664a0 0x7f999c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:53.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.398+0000 7f99b9d9b640 1 --2- 172.21.15.78:0/1584116784 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f999c0664a0 0x7f999c068960 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f99bc0cde50 tx=0x7f99b0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:53.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.398+0000 7f99aaffd640 1 -- 172.21.15.78:0/1584116784 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f99ac050820 con 0x7f99bc071d40 2023-12-12T10:12:53.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.550+0000 7f99c0cfe640 1 -- 172.21.15.78:0/1584116784 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f99bc067530 con 0x7f99bc071d40 2023-12-12T10:12:53.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.550+0000 7f99aaffd640 1 -- 172.21.15.78:0/1584116784 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f99ac053e40 con 0x7f99bc071d40 2023-12-12T10:12:53.553 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2023-12-12T10:12:53.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.550+0000 7f99c0cfe640 1 -- 172.21.15.78:0/1584116784 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f999c0664a0 msgr2=0x7f999c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:53.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.550+0000 7f99c0cfe640 1 --2- 172.21.15.78:0/1584116784 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f999c0664a0 0x7f999c068960 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f99bc0cde50 tx=0x7f99b0008040 comp rx=0 tx=0).stop 2023-12-12T10:12:53.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.550+0000 7f99c0cfe640 1 -- 172.21.15.78:0/1584116784 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f99bc071d40 msgr2=0x7f99bc162080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:53.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.550+0000 7f99c0cfe640 1 --2- 172.21.15.78:0/1584116784 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f99bc071d40 0x7f99bc162080 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f99ac00c4d0 tx=0x7f99ac00c990 comp rx=0 tx=0).stop 2023-12-12T10:12:53.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.550+0000 7f99c0cfe640 1 -- 172.21.15.78:0/1584116784 shutdown_connections 2023-12-12T10:12:53.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.550+0000 7f99c0cfe640 1 --2- 172.21.15.78:0/1584116784 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f999c0664a0 0x7f999c068960 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:53.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.550+0000 7f99c0cfe640 1 --2- 172.21.15.78:0/1584116784 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f99bc1656b0 0x7f99bc155350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:53.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.550+0000 7f99c0cfe640 1 --2- 172.21.15.78:0/1584116784 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f99bc0b31b0 0x7f99bc156a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:53.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.550+0000 7f99c0cfe640 1 --2- 172.21.15.78:0/1584116784 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f99bc071d40 0x7f99bc162080 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:53.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.550+0000 7f99c0cfe640 1 -- 172.21.15.78:0/1584116784 >> 172.21.15.78:0/1584116784 conn(0x7f99bc06a710 msgr2=0x7f99bc1643f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:53.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.550+0000 7f99c0cfe640 1 -- 172.21.15.78:0/1584116784 shutdown_connections 2023-12-12T10:12:53.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.550+0000 7f99c0cfe640 1 -- 172.21.15.78:0/1584116784 wait complete. 2023-12-12T10:12:53.573 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-12T10:12:53.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.709+0000 7fc1801b8640 1 Processor -- start 2023-12-12T10:12:53.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.709+0000 7fc1801b8640 1 -- start start 2023-12-12T10:12:53.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.713+0000 7fc1801b8640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fc178071d40 0x7fc178164fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:53.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.713+0000 7fc1801b8640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc1780b3380 0x7fc17806cc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:53.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.713+0000 7fc1801b8640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc178165940 con 0x7fc1781654e0 2023-12-12T10:12:53.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.713+0000 7fc1801b8640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc178072120 con 0x7fc1780b3380 2023-12-12T10:12:53.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.713+0000 7fc1801b8640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1780b39a0 con 0x7fc178071d40 2023-12-12T10:12:53.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.713+0000 7fc17e755640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc1780b3380 0x7fc17806cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:53.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.713+0000 7fc17d753640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fc1781654e0 0x7fc1780b2c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:41464/0 (socket says 172.21.15.78:41464) 2023-12-12T10:12:53.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.713+0000 7fc17d753640 1 -- 172.21.15.78:0/3800312486 learned_addr learned my addr 172.21.15.78:0/3800312486 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-12-12T10:12:53.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.713+0000 7fc17df54640 1 --2- 172.21.15.78:0/3800312486 >> v2:172.21.15.187:3300/0 conn(0x7fc178071d40 0x7fc178164fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:53.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.713+0000 7fc17e755640 1 -- 172.21.15.78:0/3800312486 >> v2:172.21.15.187:3300/0 conn(0x7fc178071d40 msgr2=0x7fc178164fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:53.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.713+0000 7fc17e755640 1 --2- 172.21.15.78:0/3800312486 >> v2:172.21.15.187:3300/0 conn(0x7fc178071d40 0x7fc178164fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:53.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.713+0000 7fc17e755640 1 -- 172.21.15.78:0/3800312486 >> v1:172.21.15.78:6789/0 conn(0x7fc1781654e0 legacy=0x7fc1780b2c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:53.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.713+0000 7fc17e755640 1 -- 172.21.15.78:0/3800312486 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1780b3c80 con 0x7fc1780b3380 2023-12-12T10:12:53.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.713+0000 7fc17df54640 1 --2- 172.21.15.78:0/3800312486 >> v2:172.21.15.187:3300/0 conn(0x7fc178071d40 0x7fc178164fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T10:12:53.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.713+0000 7fc17e755640 1 --2- 172.21.15.78:0/3800312486 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc1780b3380 0x7fc17806cc80 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fc17806e4c0 tx=0x7fc17001c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13a0014d8ceb5eaf server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:53.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.713+0000 7fc17cf52640 1 -- 172.21.15.78:0/3800312486 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1700a59a0 con 0x7fc1780b3380 2023-12-12T10:12:53.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.713+0000 7fc17cf52640 1 -- 172.21.15.78:0/3800312486 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1700a5b00 con 0x7fc1780b3380 2023-12-12T10:12:53.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.713+0000 7fc17cf52640 1 -- 172.21.15.78:0/3800312486 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1700a5e90 con 0x7fc1780b3380 2023-12-12T10:12:53.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.717+0000 7fc1801b8640 1 -- 172.21.15.78:0/3800312486 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc1780b3380 msgr2=0x7fc17806cc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:53.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.717+0000 7fc1801b8640 1 --2- 172.21.15.78:0/3800312486 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc1780b3380 0x7fc17806cc80 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fc17806e4c0 tx=0x7fc17001c8e0 comp rx=0 tx=0).stop 2023-12-12T10:12:53.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.717+0000 7fc1801b8640 1 -- 172.21.15.78:0/3800312486 shutdown_connections 2023-12-12T10:12:53.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.717+0000 7fc1801b8640 1 --2- 172.21.15.78:0/3800312486 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc1780b3380 0x7fc17806cc80 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:53.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.717+0000 7fc1801b8640 1 --2- 172.21.15.78:0/3800312486 >> v2:172.21.15.187:3300/0 conn(0x7fc178071d40 0x7fc178164fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:53.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.717+0000 7fc1801b8640 1 -- 172.21.15.78:0/3800312486 >> 172.21.15.78:0/3800312486 conn(0x7fc17806a710 msgr2=0x7fc17806ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:53.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.717+0000 7fc1801b8640 1 -- 172.21.15.78:0/3800312486 shutdown_connections 2023-12-12T10:12:53.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.717+0000 7fc1801b8640 1 -- 172.21.15.78:0/3800312486 wait complete. 2023-12-12T10:12:53.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.717+0000 7fc1801b8640 1 Processor -- start 2023-12-12T10:12:53.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.717+0000 7fc1801b8640 1 -- start start 2023-12-12T10:12:53.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.717+0000 7fc1801b8640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc178071d40 0x7fc1781557e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:53.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.717+0000 7fc1801b8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc1780b3380 0x7fc1780aef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:53.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.717+0000 7fc1801b8640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc1781654e0 0x7fc1780af480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:53.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.717+0000 7fc1801b8640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1780cd030 con 0x7fc1780b3380 2023-12-12T10:12:53.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.717+0000 7fc1801b8640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1780cd310 con 0x7fc178071d40 2023-12-12T10:12:53.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.717+0000 7fc1801b8640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1780cd5f0 con 0x7fc1781654e0 2023-12-12T10:12:53.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.717+0000 7fc17d753640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc1780b3380 0x7fc1780aef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:53.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.717+0000 7fc17d753640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc1780b3380 0x7fc1780aef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58924/0 (socket says 172.21.15.78:58924) 2023-12-12T10:12:53.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.717+0000 7fc17d753640 1 -- 172.21.15.78:0/4017708495 learned_addr learned my addr 172.21.15.78:0/4017708495 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:53.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.717+0000 7fc17df54640 1 --2- 172.21.15.78:0/4017708495 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc178071d40 0x7fc1781557e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:53.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.717+0000 7fc17e755640 1 --2- 172.21.15.78:0/4017708495 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc1781654e0 0x7fc1780af480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:53.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.721+0000 7fc17d753640 1 -- 172.21.15.78:0/4017708495 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc1781654e0 msgr2=0x7fc1780af480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:53.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.721+0000 7fc17d753640 1 --2- 172.21.15.78:0/4017708495 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc1781654e0 0x7fc1780af480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:53.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.721+0000 7fc17d753640 1 -- 172.21.15.78:0/4017708495 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc178071d40 msgr2=0x7fc1781557e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:53.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.721+0000 7fc17d753640 1 --2- 172.21.15.78:0/4017708495 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc178071d40 0x7fc1781557e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:53.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.721+0000 7fc17d753640 1 -- 172.21.15.78:0/4017708495 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc170009a70 con 0x7fc1780b3380 2023-12-12T10:12:53.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.721+0000 7fc17e755640 1 --2- 172.21.15.78:0/4017708495 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc1781654e0 0x7fc1780af480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T10:12:53.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.721+0000 7fc17d753640 1 --2- 172.21.15.78:0/4017708495 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc1780b3380 0x7fc1780aef40 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fc16800c400 tx=0x7fc16800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:53.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.721+0000 7fc16e7fc640 1 -- 172.21.15.78:0/4017708495 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc168005cf0 con 0x7fc1780b3380 2023-12-12T10:12:53.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.721+0000 7fc16e7fc640 1 -- 172.21.15.78:0/4017708495 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc168005e50 con 0x7fc1780b3380 2023-12-12T10:12:53.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.721+0000 7fc16e7fc640 1 -- 172.21.15.78:0/4017708495 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1680072d0 con 0x7fc1780b3380 2023-12-12T10:12:53.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.721+0000 7fc1801b8640 1 -- 172.21.15.78:0/4017708495 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc17813fc30 con 0x7fc1780b3380 2023-12-12T10:12:53.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.721+0000 7fc1801b8640 1 -- 172.21.15.78:0/4017708495 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc178155d20 con 0x7fc1780b3380 2023-12-12T10:12:53.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.721+0000 7fc1801b8640 1 -- 172.21.15.78:0/4017708495 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1780671f0 con 0x7fc1780b3380 2023-12-12T10:12:53.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.721+0000 7fc16e7fc640 1 -- 172.21.15.78:0/4017708495 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc168007430 con 0x7fc1780b3380 2023-12-12T10:12:53.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.721+0000 7fc16e7fc640 1 --2- 172.21.15.78:0/4017708495 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fc15c066470 0x7fc15c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:53.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.721+0000 7fc16e7fc640 1 -- 172.21.15.78:0/4017708495 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fc168083770 con 0x7fc1780b3380 2023-12-12T10:12:53.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.721+0000 7fc17df54640 1 --2- 172.21.15.78:0/4017708495 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fc15c066470 0x7fc15c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:53.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.725+0000 7fc17df54640 1 --2- 172.21.15.78:0/4017708495 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fc15c066470 0x7fc15c068930 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc1740098b0 tx=0x7fc174008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:53.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.725+0000 7fc16e7fc640 1 -- 172.21.15.78:0/4017708495 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc168050840 con 0x7fc1780b3380 2023-12-12T10:12:53.881 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.877+0000 7fc1801b8640 1 -- 172.21.15.78:0/4017708495 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc178067530 con 0x7fc1780b3380 2023-12-12T10:12:53.881 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.877+0000 7fc16e7fc640 1 -- 172.21.15.78:0/4017708495 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc168053e60 con 0x7fc1780b3380 2023-12-12T10:12:53.883 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2023-12-12T10:12:53.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.877+0000 7fc1801b8640 1 -- 172.21.15.78:0/4017708495 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fc15c066470 msgr2=0x7fc15c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:53.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.877+0000 7fc1801b8640 1 --2- 172.21.15.78:0/4017708495 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fc15c066470 0x7fc15c068930 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc1740098b0 tx=0x7fc174008040 comp rx=0 tx=0).stop 2023-12-12T10:12:53.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.877+0000 7fc1801b8640 1 -- 172.21.15.78:0/4017708495 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc1780b3380 msgr2=0x7fc1780aef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:53.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.877+0000 7fc1801b8640 1 --2- 172.21.15.78:0/4017708495 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc1780b3380 0x7fc1780aef40 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fc16800c400 tx=0x7fc16800c8c0 comp rx=0 tx=0).stop 2023-12-12T10:12:53.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.877+0000 7fc1801b8640 1 -- 172.21.15.78:0/4017708495 shutdown_connections 2023-12-12T10:12:53.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.877+0000 7fc1801b8640 1 --2- 172.21.15.78:0/4017708495 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fc15c066470 0x7fc15c068930 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:53.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.877+0000 7fc1801b8640 1 --2- 172.21.15.78:0/4017708495 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc1781654e0 0x7fc1780af480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:53.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.877+0000 7fc1801b8640 1 --2- 172.21.15.78:0/4017708495 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc1780b3380 0x7fc1780aef40 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:53.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.877+0000 7fc1801b8640 1 --2- 172.21.15.78:0/4017708495 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc178071d40 0x7fc1781557e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:53.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.877+0000 7fc1801b8640 1 -- 172.21.15.78:0/4017708495 >> 172.21.15.78:0/4017708495 conn(0x7fc17806a710 msgr2=0x7fc1780b0020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:53.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.877+0000 7fc1801b8640 1 -- 172.21.15.78:0/4017708495 shutdown_connections 2023-12-12T10:12:53.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:53.877+0000 7fc1801b8640 1 -- 172.21.15.78:0/4017708495 wait complete. 2023-12-12T10:12:53.901 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-12T10:12:54.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.041+0000 7f892d632640 1 Processor -- start 2023-12-12T10:12:54.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.041+0000 7f892d632640 1 -- start start 2023-12-12T10:12:54.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.045+0000 7f892d632640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f892815d510 0x7f89280d0060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:54.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.045+0000 7f892d632640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f89280d1630 0x7f89280d1a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:54.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.045+0000 7f892d632640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89280d1fd0 con 0x7f89280b0670 2023-12-12T10:12:54.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.045+0000 7f892d632640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f892815d8f0 con 0x7f892815d510 2023-12-12T10:12:54.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.045+0000 7f892d632640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89280d3b70 con 0x7f89280d1630 2023-12-12T10:12:54.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.045+0000 7f8926ffd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f892815d510 0x7f89280d0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:54.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.045+0000 7f89277fe640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f89280b0670 0x7f89280b0ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:41472/0 (socket says 172.21.15.78:41472) 2023-12-12T10:12:54.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.045+0000 7f89277fe640 1 -- 172.21.15.78:0/277978606 learned_addr learned my addr 172.21.15.78:0/277978606 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-12-12T10:12:54.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.045+0000 7f891ffff640 1 --2- 172.21.15.78:0/277978606 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f89280d1630 0x7f89280d1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:54.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.045+0000 7f8926ffd640 1 -- 172.21.15.78:0/277978606 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f89280d1630 msgr2=0x7f89280d1a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:54.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.045+0000 7f8926ffd640 1 --2- 172.21.15.78:0/277978606 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f89280d1630 0x7f89280d1a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:54.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.045+0000 7f8926ffd640 1 -- 172.21.15.78:0/277978606 >> v1:172.21.15.78:6789/0 conn(0x7f89280b0670 legacy=0x7f89280b0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:54.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.045+0000 7f8926ffd640 1 -- 172.21.15.78:0/277978606 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89280afc20 con 0x7f892815d510 2023-12-12T10:12:54.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.045+0000 7f89267fc640 1 -- 172.21.15.78:0/277978606 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1222377739 0 0) 0x7f89280d1fd0 con 0x7f89280b0670 2023-12-12T10:12:54.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.045+0000 7f8926ffd640 1 --2- 172.21.15.78:0/277978606 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f892815d510 0x7f89280d0060 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f89180097c0 tx=0x7f891801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f9e284f3258c7fa server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:54.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.049+0000 7f89267fc640 1 -- 172.21.15.78:0/277978606 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89180ad660 con 0x7f892815d510 2023-12-12T10:12:54.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.049+0000 7f89267fc640 1 -- 172.21.15.78:0/277978606 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89180ad7c0 con 0x7f892815d510 2023-12-12T10:12:54.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.049+0000 7f89267fc640 1 -- 172.21.15.78:0/277978606 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89180adb50 con 0x7f892815d510 2023-12-12T10:12:54.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.049+0000 7f892d632640 1 -- 172.21.15.78:0/277978606 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f892815d510 msgr2=0x7f89280d0060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:54.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.049+0000 7f892d632640 1 --2- 172.21.15.78:0/277978606 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f892815d510 0x7f89280d0060 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f89180097c0 tx=0x7f891801c450 comp rx=0 tx=0).stop 2023-12-12T10:12:54.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.049+0000 7f892d632640 1 -- 172.21.15.78:0/277978606 shutdown_connections 2023-12-12T10:12:54.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.049+0000 7f892d632640 1 --2- 172.21.15.78:0/277978606 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f89280d1630 0x7f89280d1a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:54.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.049+0000 7f892d632640 1 --2- 172.21.15.78:0/277978606 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f892815d510 0x7f89280d0060 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:54.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.049+0000 7f892d632640 1 -- 172.21.15.78:0/277978606 >> 172.21.15.78:0/277978606 conn(0x7f89280d3050 msgr2=0x7f89280d3460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:54.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.049+0000 7f892d632640 1 -- 172.21.15.78:0/277978606 shutdown_connections 2023-12-12T10:12:54.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.049+0000 7f892d632640 1 -- 172.21.15.78:0/277978606 wait complete. 2023-12-12T10:12:54.057 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.049+0000 7f892d632640 1 Processor -- start 2023-12-12T10:12:54.057 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.049+0000 7f892d632640 1 -- start start 2023-12-12T10:12:54.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.049+0000 7f892d632640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f89280b0670 0x7f89280b5f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:54.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.049+0000 7f892d632640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f89280d1630 0x7f8928154f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:54.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.049+0000 7f892d632640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f892815d510 0x7f8928155680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:54.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.049+0000 7f892d632640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89280b8310 con 0x7f892815d510 2023-12-12T10:12:54.059 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.049+0000 7f892d632640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8928155460 con 0x7f89280d1630 2023-12-12T10:12:54.059 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.049+0000 7f892d632640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89280b8580 con 0x7f89280b0670 2023-12-12T10:12:54.059 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.049+0000 7f89277fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f892815d510 0x7f8928155680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:54.059 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.049+0000 7f89277fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f892815d510 0x7f8928155680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58936/0 (socket says 172.21.15.78:58936) 2023-12-12T10:12:54.059 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.049+0000 7f89277fe640 1 -- 172.21.15.78:0/1227247576 learned_addr learned my addr 172.21.15.78:0/1227247576 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:54.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.049+0000 7f8926ffd640 1 --2- 172.21.15.78:0/1227247576 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f89280b0670 0x7f89280b5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:54.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.049+0000 7f891ffff640 1 --2- 172.21.15.78:0/1227247576 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f89280d1630 0x7f8928154f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:54.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.053+0000 7f89277fe640 1 -- 172.21.15.78:0/1227247576 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f89280b0670 msgr2=0x7f89280b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:54.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.053+0000 7f89277fe640 1 --2- 172.21.15.78:0/1227247576 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f89280b0670 0x7f89280b5f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:54.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.053+0000 7f89277fe640 1 -- 172.21.15.78:0/1227247576 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f89280d1630 msgr2=0x7f8928154f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:54.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.053+0000 7f89277fe640 1 --2- 172.21.15.78:0/1227247576 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f89280d1630 0x7f8928154f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:54.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.053+0000 7f89277fe640 1 -- 172.21.15.78:0/1227247576 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8918009420 con 0x7f892815d510 2023-12-12T10:12:54.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.053+0000 7f89277fe640 1 --2- 172.21.15.78:0/1227247576 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f892815d510 0x7f8928155680 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f892000c780 tx=0x7f892000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:54.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.053+0000 7f891f7fe640 1 -- 172.21.15.78:0/1227247576 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f892000ce90 con 0x7f892815d510 2023-12-12T10:12:54.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.053+0000 7f891f7fe640 1 -- 172.21.15.78:0/1227247576 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f892000a640 con 0x7f892815d510 2023-12-12T10:12:54.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.053+0000 7f892d632640 1 -- 172.21.15.78:0/1227247576 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89280b8860 con 0x7f892815d510 2023-12-12T10:12:54.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.053+0000 7f891f7fe640 1 -- 172.21.15.78:0/1227247576 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f892000a9d0 con 0x7f892815d510 2023-12-12T10:12:54.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.053+0000 7f892d632640 1 -- 172.21.15.78:0/1227247576 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89280b8e20 con 0x7f892815d510 2023-12-12T10:12:54.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.053+0000 7f892d632640 1 -- 172.21.15.78:0/1227247576 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89280671f0 con 0x7f892815d510 2023-12-12T10:12:54.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.053+0000 7f891f7fe640 1 -- 172.21.15.78:0/1227247576 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f892000ab30 con 0x7f892815d510 2023-12-12T10:12:54.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.053+0000 7f891f7fe640 1 --2- 172.21.15.78:0/1227247576 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f8908066470 0x7f8908068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:54.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.053+0000 7f891f7fe640 1 -- 172.21.15.78:0/1227247576 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f8920083640 con 0x7f892815d510 2023-12-12T10:12:54.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.053+0000 7f8926ffd640 1 --2- 172.21.15.78:0/1227247576 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f8908066470 0x7f8908068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:54.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.057+0000 7f8926ffd640 1 --2- 172.21.15.78:0/1227247576 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f8908066470 0x7f8908068930 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f89180af000 tx=0x7f89180a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:54.063 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.057+0000 7f891f7fe640 1 -- 172.21.15.78:0/1227247576 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8920050840 con 0x7f892815d510 2023-12-12T10:12:54.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.213+0000 7f892d632640 1 -- 172.21.15.78:0/1227247576 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8928067530 con 0x7f892815d510 2023-12-12T10:12:54.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.213+0000 7f891f7fe640 1 -- 172.21.15.78:0/1227247576 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f89200180a0 con 0x7f892815d510 2023-12-12T10:12:54.217 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2023-12-12T10:12:54.219 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.213+0000 7f892d632640 1 -- 172.21.15.78:0/1227247576 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f8908066470 msgr2=0x7f8908068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:54.219 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.213+0000 7f892d632640 1 --2- 172.21.15.78:0/1227247576 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f8908066470 0x7f8908068930 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f89180af000 tx=0x7f89180a7000 comp rx=0 tx=0).stop 2023-12-12T10:12:54.219 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.213+0000 7f892d632640 1 -- 172.21.15.78:0/1227247576 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f892815d510 msgr2=0x7f8928155680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:54.219 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.213+0000 7f892d632640 1 --2- 172.21.15.78:0/1227247576 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f892815d510 0x7f8928155680 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f892000c780 tx=0x7f892000cc40 comp rx=0 tx=0).stop 2023-12-12T10:12:54.219 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.213+0000 7f892d632640 1 -- 172.21.15.78:0/1227247576 shutdown_connections 2023-12-12T10:12:54.219 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.213+0000 7f892d632640 1 --2- 172.21.15.78:0/1227247576 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f8908066470 0x7f8908068930 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:54.219 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.213+0000 7f892d632640 1 --2- 172.21.15.78:0/1227247576 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f892815d510 0x7f8928155680 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:54.219 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.213+0000 7f892d632640 1 --2- 172.21.15.78:0/1227247576 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f89280d1630 0x7f8928154f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:54.219 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.213+0000 7f892d632640 1 --2- 172.21.15.78:0/1227247576 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f89280b0670 0x7f89280b5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:54.219 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.213+0000 7f892d632640 1 -- 172.21.15.78:0/1227247576 >> 172.21.15.78:0/1227247576 conn(0x7f89280d3050 msgr2=0x7f89280cf350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:54.220 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.213+0000 7f892d632640 1 -- 172.21.15.78:0/1227247576 shutdown_connections 2023-12-12T10:12:54.220 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.213+0000 7f892d632640 1 -- 172.21.15.78:0/1227247576 wait complete. 2023-12-12T10:12:54.238 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-12T10:12:54.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.373+0000 7f8656c5a640 1 Processor -- start 2023-12-12T10:12:54.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.373+0000 7f8656c5a640 1 -- start start 2023-12-12T10:12:54.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.377+0000 7f8656c5a640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f86500cdf60 0x7f8650070f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:54.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.377+0000 7f8656c5a640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8650070a70 con 0x7f8650143770 2023-12-12T10:12:54.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.377+0000 7f8656c5a640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86500ce3c0 con 0x7f8650071440 2023-12-12T10:12:54.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.377+0000 7f8656c5a640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8650070440 con 0x7f86500cdf60 2023-12-12T10:12:54.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.377+0000 7f8647fff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f86500cdf60 0x7f8650070f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:54.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.377+0000 7f86549f6640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f8650143770 0x7f86500b1e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:41474/0 (socket says 172.21.15.78:41474) 2023-12-12T10:12:54.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.377+0000 7f86549f6640 1 -- 172.21.15.78:0/1874949784 learned_addr learned my addr 172.21.15.78:0/1874949784 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-12-12T10:12:54.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.377+0000 7f8647fff640 1 -- 172.21.15.78:0/1874949784 >> v1:172.21.15.187:6789/0 conn(0x7f8650071440 legacy=0x7f865015d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:54.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.377+0000 7f8647fff640 1 -- 172.21.15.78:0/1874949784 >> v1:172.21.15.78:6789/0 conn(0x7f8650143770 legacy=0x7f86500b1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:54.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.377+0000 7f8647fff640 1 -- 172.21.15.78:0/1874949784 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86500b2530 con 0x7f86500cdf60 2023-12-12T10:12:54.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.377+0000 7f86477fe640 1 -- 172.21.15.78:0/1874949784 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2470731992 0 0) 0x7f8650070a70 con 0x7f8650143770 2023-12-12T10:12:54.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.381+0000 7f8647fff640 1 --2- 172.21.15.78:0/1874949784 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f86500cdf60 0x7f8650070f00 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f86400097c0 tx=0x7f864001c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f4fdf9cac84bea0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:54.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.381+0000 7f86477fe640 1 -- 172.21.15.78:0/1874949784 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86400ac410 con 0x7f86500cdf60 2023-12-12T10:12:54.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.381+0000 7f86477fe640 1 -- 172.21.15.78:0/1874949784 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86400ac570 con 0x7f86500cdf60 2023-12-12T10:12:54.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.381+0000 7f86477fe640 1 -- 172.21.15.78:0/1874949784 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86400ac900 con 0x7f86500cdf60 2023-12-12T10:12:54.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.381+0000 7f8656c5a640 1 -- 172.21.15.78:0/1874949784 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f86500cdf60 msgr2=0x7f8650070f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:54.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.381+0000 7f8656c5a640 1 --2- 172.21.15.78:0/1874949784 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f86500cdf60 0x7f8650070f00 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f86400097c0 tx=0x7f864001c3b0 comp rx=0 tx=0).stop 2023-12-12T10:12:54.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.381+0000 7f8656c5a640 1 -- 172.21.15.78:0/1874949784 shutdown_connections 2023-12-12T10:12:54.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.381+0000 7f8656c5a640 1 --2- 172.21.15.78:0/1874949784 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f86500cdf60 0x7f8650070f00 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:54.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.381+0000 7f8656c5a640 1 -- 172.21.15.78:0/1874949784 >> 172.21.15.78:0/1874949784 conn(0x7f865006a710 msgr2=0x7f865006ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:54.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.381+0000 7f8656c5a640 1 -- 172.21.15.78:0/1874949784 shutdown_connections 2023-12-12T10:12:54.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.381+0000 7f8656c5a640 1 -- 172.21.15.78:0/1874949784 wait complete. 2023-12-12T10:12:54.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.381+0000 7f8656c5a640 1 Processor -- start 2023-12-12T10:12:54.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.381+0000 7f8656c5a640 1 -- start start 2023-12-12T10:12:54.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.385+0000 7f8656c5a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8650071440 0x7f8650139b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:54.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.385+0000 7f8656c5a640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f86500cdf60 0x7f8650151030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:54.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.385+0000 7f8656c5a640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8650143770 0x7f8650136610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:54.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.385+0000 7f8656c5a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86500aeaa0 con 0x7f8650071440 2023-12-12T10:12:54.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.385+0000 7f8656c5a640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86500aed80 con 0x7f86500cdf60 2023-12-12T10:12:54.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.385+0000 7f8656c5a640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86500af060 con 0x7f8650143770 2023-12-12T10:12:54.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.385+0000 7f86549f6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8650071440 0x7f8650139b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:54.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.385+0000 7f86549f6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8650071440 0x7f8650139b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58958/0 (socket says 172.21.15.78:58958) 2023-12-12T10:12:54.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.385+0000 7f86549f6640 1 -- 172.21.15.78:0/2683242331 learned_addr learned my addr 172.21.15.78:0/2683242331 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:54.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.385+0000 7f8647fff640 1 --2- 172.21.15.78:0/2683242331 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f86500cdf60 0x7f8650151030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:54.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.385+0000 7f86549f6640 1 -- 172.21.15.78:0/2683242331 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8650143770 msgr2=0x7f8650136610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:54.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.385+0000 7f86551f7640 1 --2- 172.21.15.78:0/2683242331 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8650143770 0x7f8650136610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:54.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.385+0000 7f86549f6640 1 --2- 172.21.15.78:0/2683242331 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8650143770 0x7f8650136610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:54.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.385+0000 7f86549f6640 1 -- 172.21.15.78:0/2683242331 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f86500cdf60 msgr2=0x7f8650151030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:54.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.385+0000 7f86549f6640 1 --2- 172.21.15.78:0/2683242331 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f86500cdf60 0x7f8650151030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:54.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.385+0000 7f86549f6640 1 -- 172.21.15.78:0/2683242331 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8640009420 con 0x7f8650071440 2023-12-12T10:12:54.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.385+0000 7f8647fff640 1 --2- 172.21.15.78:0/2683242331 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f86500cdf60 0x7f8650151030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T10:12:54.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.385+0000 7f86551f7640 1 --2- 172.21.15.78:0/2683242331 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8650143770 0x7f8650136610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T10:12:54.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.385+0000 7f86549f6640 1 --2- 172.21.15.78:0/2683242331 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8650071440 0x7f8650139b90 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f864c00c480 tx=0x7f864c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:54.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.385+0000 7f86457fa640 1 -- 172.21.15.78:0/2683242331 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f864c0074e0 con 0x7f8650071440 2023-12-12T10:12:54.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.385+0000 7f86457fa640 1 -- 172.21.15.78:0/2683242331 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f864c007660 con 0x7f8650071440 2023-12-12T10:12:54.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.385+0000 7f8656c5a640 1 -- 172.21.15.78:0/2683242331 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86500af340 con 0x7f8650071440 2023-12-12T10:12:54.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.385+0000 7f86457fa640 1 -- 172.21.15.78:0/2683242331 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f864c004a30 con 0x7f8650071440 2023-12-12T10:12:54.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.385+0000 7f8656c5a640 1 -- 172.21.15.78:0/2683242331 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f865013a0d0 con 0x7f8650071440 2023-12-12T10:12:54.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.385+0000 7f8656c5a640 1 -- 172.21.15.78:0/2683242331 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86500671f0 con 0x7f8650071440 2023-12-12T10:12:54.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.385+0000 7f86457fa640 1 -- 172.21.15.78:0/2683242331 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f864c004b90 con 0x7f8650071440 2023-12-12T10:12:54.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.389+0000 7f86457fa640 1 --2- 172.21.15.78:0/2683242331 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f863c066470 0x7f863c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:54.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.389+0000 7f86457fa640 1 -- 172.21.15.78:0/2683242331 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f864c0837d0 con 0x7f8650071440 2023-12-12T10:12:54.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.389+0000 7f8647fff640 1 --2- 172.21.15.78:0/2683242331 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f863c066470 0x7f863c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:54.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.389+0000 7f8647fff640 1 --2- 172.21.15.78:0/2683242331 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f863c066470 0x7f863c068930 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f86400ae000 tx=0x7f8640008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:54.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.393+0000 7f86457fa640 1 -- 172.21.15.78:0/2683242331 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f864c054310 con 0x7f8650071440 2023-12-12T10:12:54.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.541+0000 7f8656c5a640 1 -- 172.21.15.78:0/2683242331 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f8650067530 con 0x7f8650071440 2023-12-12T10:12:54.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.541+0000 7f86457fa640 1 -- 172.21.15.78:0/2683242331 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f864c053ea0 con 0x7f8650071440 2023-12-12T10:12:54.546 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2023-12-12T10:12:54.548 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.545+0000 7f8656c5a640 1 -- 172.21.15.78:0/2683242331 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f863c066470 msgr2=0x7f863c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:54.548 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.545+0000 7f8656c5a640 1 --2- 172.21.15.78:0/2683242331 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f863c066470 0x7f863c068930 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f86400ae000 tx=0x7f8640008040 comp rx=0 tx=0).stop 2023-12-12T10:12:54.548 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.545+0000 7f8656c5a640 1 -- 172.21.15.78:0/2683242331 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8650071440 msgr2=0x7f8650139b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:54.548 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.545+0000 7f8656c5a640 1 --2- 172.21.15.78:0/2683242331 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8650071440 0x7f8650139b90 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f864c00c480 tx=0x7f864c00c940 comp rx=0 tx=0).stop 2023-12-12T10:12:54.548 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.545+0000 7f8656c5a640 1 -- 172.21.15.78:0/2683242331 shutdown_connections 2023-12-12T10:12:54.548 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.545+0000 7f8656c5a640 1 --2- 172.21.15.78:0/2683242331 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f863c066470 0x7f863c068930 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:54.548 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.545+0000 7f8656c5a640 1 --2- 172.21.15.78:0/2683242331 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8650143770 0x7f8650136610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:54.549 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.545+0000 7f8656c5a640 1 --2- 172.21.15.78:0/2683242331 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f86500cdf60 0x7f8650151030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:54.549 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.545+0000 7f8656c5a640 1 --2- 172.21.15.78:0/2683242331 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8650071440 0x7f8650139b90 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:54.549 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.545+0000 7f8656c5a640 1 -- 172.21.15.78:0/2683242331 >> 172.21.15.78:0/2683242331 conn(0x7f865006a710 msgr2=0x7f8650071d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:54.549 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.545+0000 7f8656c5a640 1 -- 172.21.15.78:0/2683242331 shutdown_connections 2023-12-12T10:12:54.549 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.545+0000 7f8656c5a640 1 -- 172.21.15.78:0/2683242331 wait complete. 2023-12-12T10:12:54.624 INFO:tasks.cephfs_test_runner:Starting test: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-12-12T10:12:54.625 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T10:12:54.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.761+0000 7fda4ae9a640 1 Processor -- start 2023-12-12T10:12:54.764 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.761+0000 7fda4ae9a640 1 -- start start 2023-12-12T10:12:54.765 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.761+0000 7fda4ae9a640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fda4413c860 0x7fda440b4270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:54.765 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.761+0000 7fda4ae9a640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fda440b47b0 0x7fda44070bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:54.765 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.761+0000 7fda4ae9a640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda440718f0 con 0x7fda44071100 2023-12-12T10:12:54.765 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.761+0000 7fda4ae9a640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda440b4c30 con 0x7fda4413c860 2023-12-12T10:12:54.765 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.761+0000 7fda4ae9a640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda44071bd0 con 0x7fda440b47b0 2023-12-12T10:12:54.765 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.761+0000 7fda48c36640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fda4413c860 0x7fda440b4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:54.765 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.761+0000 7fda48c36640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fda4413c860 0x7fda440b4270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58960/0 (socket says 172.21.15.78:58960) 2023-12-12T10:12:54.765 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.761+0000 7fda48c36640 1 -- 172.21.15.78:0/942829225 learned_addr learned my addr 172.21.15.78:0/942829225 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:54.766 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.761+0000 7fda43fff640 1 --2- 172.21.15.78:0/942829225 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fda440b47b0 0x7fda44070bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:54.766 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.761+0000 7fda48c36640 1 -- 172.21.15.78:0/942829225 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fda440b47b0 msgr2=0x7fda44070bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:54.766 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.761+0000 7fda48c36640 1 --2- 172.21.15.78:0/942829225 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fda440b47b0 0x7fda44070bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:54.766 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.761+0000 7fda48c36640 1 -- 172.21.15.78:0/942829225 >> v1:172.21.15.187:6789/0 conn(0x7fda44071100 legacy=0x7fda4415d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:54.766 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.761+0000 7fda48c36640 1 -- 172.21.15.78:0/942829225 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda44071eb0 con 0x7fda4413c860 2023-12-12T10:12:54.769 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.765+0000 7fda48c36640 1 --2- 172.21.15.78:0/942829225 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda4413c860 0x7fda440b4270 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fda38009870 tx=0x7fda3801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8324ef67cf317c7b server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:54.769 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.765+0000 7fda437fe640 1 -- 172.21.15.78:0/942829225 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda380aa5f0 con 0x7fda4413c860 2023-12-12T10:12:54.769 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.765+0000 7fda437fe640 1 -- 172.21.15.78:0/942829225 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda380aa750 con 0x7fda4413c860 2023-12-12T10:12:54.769 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.765+0000 7fda437fe640 1 -- 172.21.15.78:0/942829225 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda380aaae0 con 0x7fda4413c860 2023-12-12T10:12:54.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.765+0000 7fda4ae9a640 1 -- 172.21.15.78:0/942829225 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda4413c860 msgr2=0x7fda440b4270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:54.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.765+0000 7fda4ae9a640 1 --2- 172.21.15.78:0/942829225 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda4413c860 0x7fda440b4270 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fda38009870 tx=0x7fda3801c4d0 comp rx=0 tx=0).stop 2023-12-12T10:12:54.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.765+0000 7fda4ae9a640 1 -- 172.21.15.78:0/942829225 shutdown_connections 2023-12-12T10:12:54.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.765+0000 7fda4ae9a640 1 --2- 172.21.15.78:0/942829225 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fda440b47b0 0x7fda44070bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:54.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.765+0000 7fda4ae9a640 1 --2- 172.21.15.78:0/942829225 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda4413c860 0x7fda440b4270 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:54.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.765+0000 7fda4ae9a640 1 -- 172.21.15.78:0/942829225 >> 172.21.15.78:0/942829225 conn(0x7fda4406c5d0 msgr2=0x7fda4406c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:54.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.765+0000 7fda4ae9a640 1 -- 172.21.15.78:0/942829225 shutdown_connections 2023-12-12T10:12:54.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.765+0000 7fda4ae9a640 1 -- 172.21.15.78:0/942829225 wait complete. 2023-12-12T10:12:54.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.769+0000 7fda4ae9a640 1 Processor -- start 2023-12-12T10:12:54.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.769+0000 7fda4ae9a640 1 -- start start 2023-12-12T10:12:54.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.769+0000 7fda4ae9a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda44071100 0x7fda44152170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:54.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.769+0000 7fda4ae9a640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fda440b47b0 0x7fda440b19f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:54.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.769+0000 7fda4ae9a640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fda4413c860 0x7fda441f5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:54.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.769+0000 7fda4ae9a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda440ad750 con 0x7fda44071100 2023-12-12T10:12:54.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.769+0000 7fda4ae9a640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda440ad2c0 con 0x7fda4413c860 2023-12-12T10:12:54.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.769+0000 7fda4ae9a640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda44152750 con 0x7fda440b47b0 2023-12-12T10:12:54.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.769+0000 7fda48c36640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda44071100 0x7fda44152170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:54.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.769+0000 7fda48c36640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda44071100 0x7fda44152170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58972/0 (socket says 172.21.15.78:58972) 2023-12-12T10:12:54.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.769+0000 7fda48c36640 1 -- 172.21.15.78:0/4288393084 learned_addr learned my addr 172.21.15.78:0/4288393084 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:54.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.769+0000 7fda49437640 1 --2- 172.21.15.78:0/4288393084 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fda4413c860 0x7fda441f5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:54.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.769+0000 7fda43fff640 1 --2- 172.21.15.78:0/4288393084 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fda440b47b0 0x7fda440b19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:54.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.769+0000 7fda48c36640 1 -- 172.21.15.78:0/4288393084 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fda440b47b0 msgr2=0x7fda440b19f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:54.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.769+0000 7fda48c36640 1 --2- 172.21.15.78:0/4288393084 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fda440b47b0 0x7fda440b19f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:54.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.769+0000 7fda48c36640 1 -- 172.21.15.78:0/4288393084 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fda4413c860 msgr2=0x7fda441f5b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:54.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.769+0000 7fda48c36640 1 --2- 172.21.15.78:0/4288393084 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fda4413c860 0x7fda441f5b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:54.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.769+0000 7fda48c36640 1 -- 172.21.15.78:0/4288393084 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda380094d0 con 0x7fda44071100 2023-12-12T10:12:54.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.769+0000 7fda49437640 1 --2- 172.21.15.78:0/4288393084 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fda4413c860 0x7fda441f5b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T10:12:54.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.769+0000 7fda43fff640 1 --2- 172.21.15.78:0/4288393084 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fda440b47b0 0x7fda440b19f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T10:12:54.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.769+0000 7fda48c36640 1 --2- 172.21.15.78:0/4288393084 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda44071100 0x7fda44152170 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fda380ac040 tx=0x7fda3801ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:54.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.769+0000 7fda417fa640 1 -- 172.21.15.78:0/4288393084 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda380b3800 con 0x7fda44071100 2023-12-12T10:12:54.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.769+0000 7fda417fa640 1 -- 172.21.15.78:0/4288393084 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda380b3980 con 0x7fda44071100 2023-12-12T10:12:54.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.769+0000 7fda417fa640 1 -- 172.21.15.78:0/4288393084 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda380b3d30 con 0x7fda44071100 2023-12-12T10:12:54.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.769+0000 7fda4ae9a640 1 -- 172.21.15.78:0/4288393084 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda440b1f30 con 0x7fda44071100 2023-12-12T10:12:54.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.769+0000 7fda4ae9a640 1 -- 172.21.15.78:0/4288393084 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda440acc70 con 0x7fda44071100 2023-12-12T10:12:54.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.769+0000 7fda4ae9a640 1 -- 172.21.15.78:0/4288393084 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda440671f0 con 0x7fda44071100 2023-12-12T10:12:54.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.773+0000 7fda417fa640 1 -- 172.21.15.78:0/4288393084 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fda380c73e0 con 0x7fda44071100 2023-12-12T10:12:54.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.773+0000 7fda417fa640 1 --2- 172.21.15.78:0/4288393084 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fda28066470 0x7fda28068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:54.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.773+0000 7fda417fa640 1 -- 172.21.15.78:0/4288393084 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fda380a7070 con 0x7fda44071100 2023-12-12T10:12:54.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.773+0000 7fda43fff640 1 --2- 172.21.15.78:0/4288393084 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fda28066470 0x7fda28068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:54.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.773+0000 7fda43fff640 1 --2- 172.21.15.78:0/4288393084 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fda28066470 0x7fda28068930 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fda30006fd0 tx=0x7fda30008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:54.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.777+0000 7fda417fa640 1 -- 172.21.15.78:0/4288393084 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fda380ebe80 con 0x7fda44071100 2023-12-12T10:12:54.930 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.925+0000 7fda4ae9a640 1 -- 172.21.15.78:0/4288393084 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fda44067530 con 0x7fda44071100 2023-12-12T10:12:54.931 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.929+0000 7fda417fa640 1 -- 172.21.15.78:0/4288393084 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18701 (secure 0 0 0) 0x7fda380ef4a0 con 0x7fda44071100 2023-12-12T10:12:54.931 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:12:54.931 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":26,"fsid":"fc81937c-bd26-483c-952b-d1324fcb0c9e","created":"2023-12-12T10:11:44.020214+0000","modified":"2023-12-12T10:12:50.919344+0000","last_up_change":"2023-12-12T10:11:56.278318+0000","last_in_change":"2023-12-12T10:11:46.553610+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T10:11:57.053584+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-12T10:12:07.454450+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-12T10:12:08.182909+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-12T10:12:11.977952+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"22dfdedf-5f6c-4b20-9f6c-30517a1db70a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6809","nonce":3345683600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6811","nonce":3345683600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6815","nonce":3345683600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6813","nonce":3345683600}]},"public_addr":"172.21.15.78:6809/3345683600","cluster_addr":"172.21.15.78:6811/3345683600","heartbeat_back_addr":"172.21.15.78:6815/3345683600","heartbeat_front_addr":"172.21.15.78:6813/3345683600","state":["exists","up"]},{"osd":1,"uuid":"be34a7f3-a69a-462e-9ddf-5e537448dba2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6801","nonce":962652768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6803","nonce":962652768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6807","nonce":962652768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6805","nonce":962652768}]},"public_addr":"172.21.15.78:6801/962652768","cluster_addr":"172.21.15.78:6803/962652768","heartbeat_back_addr":"172.21.15.78:6807/962652768","heartbeat_front_addr":"172.21.15.78:6805/962652768","state":["exists","up"]},{"osd":2,"uuid":"55b381de-5f56-4b14-80f7-e6e41e084a13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6818","nonce":2910206054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6822","nonce":2910206054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6829","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6831","nonce":2910206054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6826","nonce":2910206054}]},"public_addr":"172.21.15.78:6818/2910206054","cluster_addr":"172.21.15.78:6822/2910206054","heartbeat_back_addr":"172.21.15.78:6831/2910206054","heartbeat_front_addr":"172.21.15.78:6826/2910206054","state":["exists","up"]},{"osd":3,"uuid":"d7682de1-25cb-4cec-869f-8851c28b0e6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6819","nonce":3750796703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6821","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6823","nonce":3750796703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6830","nonce":3750796703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6825","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6827","nonce":3750796703}]},"public_addr":"172.21.15.78:6819/3750796703","cluster_addr":"172.21.15.78:6823/3750796703","heartbeat_back_addr":"172.21.15.78:6830/3750796703","heartbeat_front_addr":"172.21.15.78:6827/3750796703","state":["exists","up"]},{"osd":4,"uuid":"8279815a-d6c7-4199-871e-d28971b9dc07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6809","nonce":2944277204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6811","nonce":2944277204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6815","nonce":2944277204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6813","nonce":2944277204}]},"public_addr":"172.21.15.187:6809/2944277204","cluster_addr":"172.21.15.187:6811/2944277204","heartbeat_back_addr":"172.21.15.187:6815/2944277204","heartbeat_front_addr":"172.21.15.187:6813/2944277204","state":["exists","up"]},{"osd":5,"uuid":"0a714c65-f8ce-4340-968f-11a799677ef3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6801","nonce":185858620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6803","nonce":185858620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6807","nonce":185858620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6805","nonce":185858620}]},"public_addr":"172.21.15.187:6801/185858620","cluster_addr":"172.21.15.187:6803/185858620","heartbeat_back_addr":"172.21.15.187:6807/185858620","heartbeat_front_addr":"172.21.15.187:6805/185858620","state":["exists","up"]},{"osd":6,"uuid":"d0bba9ab-f7ee-449e-8999-1c0cf7e6d53c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6817","nonce":4213392126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6819","nonce":4213392126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6824","nonce":4213392126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6821","nonce":4213392126}]},"public_addr":"172.21.15.187:6817/4213392126","cluster_addr":"172.21.15.187:6819/4213392126","heartbeat_back_addr":"172.21.15.187:6824/4213392126","heartbeat_front_addr":"172.21.15.187:6821/4213392126","state":["exists","up"]},{"osd":7,"uuid":"efe5e0d9-2f87-4889-a27a-e2a95a632302","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6823","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6825","nonce":85774004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6827","nonce":85774004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6831","nonce":85774004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6829","nonce":85774004}]},"public_addr":"172.21.15.187:6825/85774004","cluster_addr":"172.21.15.187:6827/85774004","heartbeat_back_addr":"172.21.15.187:6831/85774004","heartbeat_front_addr":"172.21.15.187:6829/85774004","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.214447+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.448899+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.293107+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.564184+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.175026+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.097717+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.261141+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.287681+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.18","mappings":[{"from":3,"to":2}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.13","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T10:12:54.933 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.929+0000 7fda4ae9a640 1 -- 172.21.15.78:0/4288393084 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fda28066470 msgr2=0x7fda28068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:54.933 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.929+0000 7fda4ae9a640 1 --2- 172.21.15.78:0/4288393084 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fda28066470 0x7fda28068930 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fda30006fd0 tx=0x7fda30008040 comp rx=0 tx=0).stop 2023-12-12T10:12:54.933 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.929+0000 7fda4ae9a640 1 -- 172.21.15.78:0/4288393084 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda44071100 msgr2=0x7fda44152170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:54.933 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.929+0000 7fda4ae9a640 1 --2- 172.21.15.78:0/4288393084 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda44071100 0x7fda44152170 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fda380ac040 tx=0x7fda3801ad10 comp rx=0 tx=0).stop 2023-12-12T10:12:54.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.929+0000 7fda4ae9a640 1 -- 172.21.15.78:0/4288393084 shutdown_connections 2023-12-12T10:12:54.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.929+0000 7fda4ae9a640 1 --2- 172.21.15.78:0/4288393084 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fda28066470 0x7fda28068930 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:54.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.929+0000 7fda4ae9a640 1 --2- 172.21.15.78:0/4288393084 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fda4413c860 0x7fda441f5b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:54.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.929+0000 7fda4ae9a640 1 --2- 172.21.15.78:0/4288393084 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fda440b47b0 0x7fda440b19f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:54.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.929+0000 7fda4ae9a640 1 --2- 172.21.15.78:0/4288393084 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fda44071100 0x7fda44152170 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:54.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.929+0000 7fda4ae9a640 1 -- 172.21.15.78:0/4288393084 >> 172.21.15.78:0/4288393084 conn(0x7fda4406c5d0 msgr2=0x7fda44072e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:54.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.929+0000 7fda4ae9a640 1 -- 172.21.15.78:0/4288393084 shutdown_connections 2023-12-12T10:12:54.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:54.929+0000 7fda4ae9a640 1 -- 172.21.15.78:0/4288393084 wait complete. 2023-12-12T10:12:54.952 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-12T10:11:57.053584+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-12T10:12:07.454450+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-12T10:12:08.182909+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-12T10:12:11.977952+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-12T10:12:54.953 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-12T10:12:55.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.093+0000 7f732d679640 1 Processor -- start 2023-12-12T10:12:55.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.093+0000 7f732d679640 1 -- start start 2023-12-12T10:12:55.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.093+0000 7f732d679640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f732815d510 0x7f73280d0060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:55.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.093+0000 7f732d679640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f73280cec70 0x7f73280d1a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:55.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.093+0000 7f732d679640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73280d1fd0 con 0x7f73280d1630 2023-12-12T10:12:55.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.093+0000 7f732d679640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f732815d8f0 con 0x7f73280cec70 2023-12-12T10:12:55.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.093+0000 7f732d679640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73280cf100 con 0x7f732815d510 2023-12-12T10:12:55.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.093+0000 7f73277fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f73280cec70 0x7f73280d1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:55.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.093+0000 7f73277fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f73280cec70 0x7f73280d1a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58982/0 (socket says 172.21.15.78:58982) 2023-12-12T10:12:55.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.093+0000 7f73277fe640 1 -- 172.21.15.78:0/2269877615 learned_addr learned my addr 172.21.15.78:0/2269877615 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:55.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.093+0000 7f7326ffd640 1 --2- 172.21.15.78:0/2269877615 >> v2:172.21.15.187:3300/0 conn(0x7f732815d510 0x7f73280d0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:55.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.093+0000 7f73277fe640 1 -- 172.21.15.78:0/2269877615 >> v2:172.21.15.187:3300/0 conn(0x7f732815d510 msgr2=0x7f73280d0060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:55.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.093+0000 7f73277fe640 1 --2- 172.21.15.78:0/2269877615 >> v2:172.21.15.187:3300/0 conn(0x7f732815d510 0x7f73280d0060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:55.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.093+0000 7f73277fe640 1 -- 172.21.15.78:0/2269877615 >> v1:172.21.15.187:6789/0 conn(0x7f73280d1630 legacy=0x7f73280b0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:55.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.093+0000 7f73277fe640 1 -- 172.21.15.78:0/2269877615 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73280d3b70 con 0x7f73280cec70 2023-12-12T10:12:55.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.097+0000 7f73277fe640 1 --2- 172.21.15.78:0/2269877615 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73280cec70 0x7f73280d1a90 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f73280b5c10 tx=0x7f732001c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19d9fd5f05ab36a1 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:55.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.097+0000 7f73267fc640 1 -- 172.21.15.78:0/2269877615 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73200a5780 con 0x7f73280cec70 2023-12-12T10:12:55.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.097+0000 7f73267fc640 1 -- 172.21.15.78:0/2269877615 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73200a58e0 con 0x7f73280cec70 2023-12-12T10:12:55.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.097+0000 7f73267fc640 1 -- 172.21.15.78:0/2269877615 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73200a5c70 con 0x7f73280cec70 2023-12-12T10:12:55.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.097+0000 7f732d679640 1 -- 172.21.15.78:0/2269877615 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73280cec70 msgr2=0x7f73280d1a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:55.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.097+0000 7f732d679640 1 --2- 172.21.15.78:0/2269877615 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73280cec70 0x7f73280d1a90 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f73280b5c10 tx=0x7f732001c9d0 comp rx=0 tx=0).stop 2023-12-12T10:12:55.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.097+0000 7f732d679640 1 -- 172.21.15.78:0/2269877615 shutdown_connections 2023-12-12T10:12:55.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.097+0000 7f732d679640 1 --2- 172.21.15.78:0/2269877615 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73280cec70 0x7f73280d1a90 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:55.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.097+0000 7f732d679640 1 --2- 172.21.15.78:0/2269877615 >> v2:172.21.15.187:3300/0 conn(0x7f732815d510 0x7f73280d0060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:55.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.097+0000 7f732d679640 1 -- 172.21.15.78:0/2269877615 >> 172.21.15.78:0/2269877615 conn(0x7f73280d3050 msgr2=0x7f73280d3460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:55.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.097+0000 7f732d679640 1 -- 172.21.15.78:0/2269877615 shutdown_connections 2023-12-12T10:12:55.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.097+0000 7f732d679640 1 -- 172.21.15.78:0/2269877615 wait complete. 2023-12-12T10:12:55.103 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.101+0000 7f732d679640 1 Processor -- start 2023-12-12T10:12:55.103 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.101+0000 7f732d679640 1 -- start start 2023-12-12T10:12:55.105 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.101+0000 7f732d679640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73280cec70 0x7f73281557b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:55.105 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.101+0000 7f732d679640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f73280d1630 0x7f73280ccde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:55.105 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.101+0000 7f732d679640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f732815d510 0x7f732815fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:55.105 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.101+0000 7f732d679640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73280b6ed0 con 0x7f73280cec70 2023-12-12T10:12:55.105 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.101+0000 7f732d679640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7328157780 con 0x7f732815d510 2023-12-12T10:12:55.106 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.101+0000 7f732d679640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7328157a60 con 0x7f73280d1630 2023-12-12T10:12:55.106 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.101+0000 7f7326ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73280cec70 0x7f73281557b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:55.106 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.101+0000 7f7326ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73280cec70 0x7f73281557b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58990/0 (socket says 172.21.15.78:58990) 2023-12-12T10:12:55.106 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.101+0000 7f7326ffd640 1 -- 172.21.15.78:0/2869320186 learned_addr learned my addr 172.21.15.78:0/2869320186 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:55.106 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.101+0000 7f73277fe640 1 --2- 172.21.15.78:0/2869320186 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f732815d510 0x7f732815fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:55.106 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.101+0000 7f7326ffd640 1 -- 172.21.15.78:0/2869320186 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f73280d1630 msgr2=0x7f73280ccde0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-12-12T10:12:55.106 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.101+0000 7f7326ffd640 1 --2- 172.21.15.78:0/2869320186 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f73280d1630 0x7f73280ccde0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:55.106 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.101+0000 7f7326ffd640 1 -- 172.21.15.78:0/2869320186 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f732815d510 msgr2=0x7f732815fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:55.106 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.101+0000 7f7326ffd640 1 --2- 172.21.15.78:0/2869320186 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f732815d510 0x7f732815fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:55.106 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.101+0000 7f7326ffd640 1 -- 172.21.15.78:0/2869320186 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7320009b30 con 0x7f73280cec70 2023-12-12T10:12:55.106 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.101+0000 7f73277fe640 1 --2- 172.21.15.78:0/2869320186 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f732815d510 0x7f732815fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T10:12:55.106 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.101+0000 7f7326ffd640 1 --2- 172.21.15.78:0/2869320186 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73280cec70 0x7f73281557b0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f731800e870 tx=0x7f731800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:55.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.101+0000 7f731f7fe640 1 -- 172.21.15.78:0/2869320186 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7318009510 con 0x7f73280cec70 2023-12-12T10:12:55.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.101+0000 7f731f7fe640 1 -- 172.21.15.78:0/2869320186 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f731800eec0 con 0x7f73280cec70 2023-12-12T10:12:55.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.101+0000 7f732d679640 1 -- 172.21.15.78:0/2869320186 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7328157d40 con 0x7f73280cec70 2023-12-12T10:12:55.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.101+0000 7f731f7fe640 1 -- 172.21.15.78:0/2869320186 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f731800cb40 con 0x7f73280cec70 2023-12-12T10:12:55.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.105+0000 7f732d679640 1 -- 172.21.15.78:0/2869320186 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73281561b0 con 0x7f73280cec70 2023-12-12T10:12:55.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.105+0000 7f732d679640 1 -- 172.21.15.78:0/2869320186 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73280671f0 con 0x7f73280cec70 2023-12-12T10:12:55.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.105+0000 7f731f7fe640 1 -- 172.21.15.78:0/2869320186 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f731800cca0 con 0x7f73280cec70 2023-12-12T10:12:55.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.105+0000 7f731f7fe640 1 --2- 172.21.15.78:0/2869320186 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f7308066470 0x7f7308068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:55.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.105+0000 7f731f7fe640 1 -- 172.21.15.78:0/2869320186 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f7318084330 con 0x7f73280cec70 2023-12-12T10:12:55.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.105+0000 7f731ffff640 1 --2- 172.21.15.78:0/2869320186 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f7308066470 0x7f7308068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:55.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.105+0000 7f731ffff640 1 --2- 172.21.15.78:0/2869320186 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f7308066470 0x7f7308068930 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f7310000f70 tx=0x7f73100079c0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:55.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.109+0000 7f731f7fe640 1 -- 172.21.15.78:0/2869320186 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7318051480 con 0x7f73280cec70 2023-12-12T10:12:55.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.265+0000 7f732d679640 1 -- 172.21.15.78:0/2869320186 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7328067530 con 0x7f73280cec70 2023-12-12T10:12:55.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.265+0000 7f731f7fe640 1 -- 172.21.15.78:0/2869320186 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7318054aa0 con 0x7f73280cec70 2023-12-12T10:12:55.268 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2023-12-12T10:12:55.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.265+0000 7f732d679640 1 -- 172.21.15.78:0/2869320186 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f7308066470 msgr2=0x7f7308068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:55.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.265+0000 7f732d679640 1 --2- 172.21.15.78:0/2869320186 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f7308066470 0x7f7308068930 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f7310000f70 tx=0x7f73100079c0 comp rx=0 tx=0).stop 2023-12-12T10:12:55.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.265+0000 7f732d679640 1 -- 172.21.15.78:0/2869320186 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73280cec70 msgr2=0x7f73281557b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:55.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.265+0000 7f732d679640 1 --2- 172.21.15.78:0/2869320186 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73280cec70 0x7f73281557b0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f731800e870 tx=0x7f731800ec70 comp rx=0 tx=0).stop 2023-12-12T10:12:55.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.265+0000 7f732d679640 1 -- 172.21.15.78:0/2869320186 shutdown_connections 2023-12-12T10:12:55.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.265+0000 7f732d679640 1 --2- 172.21.15.78:0/2869320186 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f7308066470 0x7f7308068930 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:55.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.265+0000 7f732d679640 1 --2- 172.21.15.78:0/2869320186 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f732815d510 0x7f732815fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:55.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.265+0000 7f732d679640 1 --2- 172.21.15.78:0/2869320186 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f73280d1630 0x7f73280ccde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:55.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.265+0000 7f732d679640 1 --2- 172.21.15.78:0/2869320186 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73280cec70 0x7f73281557b0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:55.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.265+0000 7f732d679640 1 -- 172.21.15.78:0/2869320186 >> 172.21.15.78:0/2869320186 conn(0x7f73280d3050 msgr2=0x7f732815c830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:55.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.265+0000 7f732d679640 1 -- 172.21.15.78:0/2869320186 shutdown_connections 2023-12-12T10:12:55.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.265+0000 7f732d679640 1 -- 172.21.15.78:0/2869320186 wait complete. 2023-12-12T10:12:55.289 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-12T10:12:55.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.425+0000 7fbd0e72a640 1 Processor -- start 2023-12-12T10:12:55.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.425+0000 7fbd0e72a640 1 -- start start 2023-12-12T10:12:55.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.425+0000 7fbd0e72a640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbd0806cf60 0x7fbd0815f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:55.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.425+0000 7fbd0e72a640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fbd0815b390 0x7fbd0815b840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:55.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.425+0000 7fbd0e72a640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd080cea30 con 0x7fbd080cb4b0 2023-12-12T10:12:55.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.425+0000 7fbd0e72a640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd0815bd80 con 0x7fbd0815b390 2023-12-12T10:12:55.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.425+0000 7fbd0e72a640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd0815bfc0 con 0x7fbd0806cf60 2023-12-12T10:12:55.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.425+0000 7fbd07fff640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fbd080cb4b0 0x7fbd0806c850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:41488/0 (socket says 172.21.15.78:41488) 2023-12-12T10:12:55.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.425+0000 7fbd0ccc7640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fbd0815b390 0x7fbd0815b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:55.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.425+0000 7fbd07fff640 1 -- 172.21.15.78:0/1193657930 learned_addr learned my addr 172.21.15.78:0/1193657930 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-12-12T10:12:55.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.425+0000 7fbd077fe640 1 --2- 172.21.15.78:0/1193657930 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbd0806cf60 0x7fbd0815f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:55.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.429+0000 7fbd0ccc7640 1 -- 172.21.15.78:0/1193657930 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbd0806cf60 msgr2=0x7fbd0815f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:55.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.429+0000 7fbd0ccc7640 1 --2- 172.21.15.78:0/1193657930 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbd0806cf60 0x7fbd0815f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:55.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.429+0000 7fbd0ccc7640 1 -- 172.21.15.78:0/1193657930 >> v1:172.21.15.78:6789/0 conn(0x7fbd080cb4b0 legacy=0x7fbd0806c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:55.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.429+0000 7fbd0ccc7640 1 -- 172.21.15.78:0/1193657930 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd0815c2a0 con 0x7fbd0815b390 2023-12-12T10:12:55.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.429+0000 7fbd077fe640 1 --2- 172.21.15.78:0/1193657930 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbd0806cf60 0x7fbd0815f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T10:12:55.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.429+0000 7fbd0ccc7640 1 --2- 172.21.15.78:0/1193657930 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbd0815b390 0x7fbd0815b840 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fbd00009d90 tx=0x7fbd0001c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4961765d15bf1fc0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:55.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.429+0000 7fbd06ffd640 1 -- 172.21.15.78:0/1193657930 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd000a5950 con 0x7fbd0815b390 2023-12-12T10:12:55.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.429+0000 7fbd06ffd640 1 -- 172.21.15.78:0/1193657930 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd000a5ab0 con 0x7fbd0815b390 2023-12-12T10:12:55.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.429+0000 7fbd06ffd640 1 -- 172.21.15.78:0/1193657930 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd000a5e40 con 0x7fbd0815b390 2023-12-12T10:12:55.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.429+0000 7fbd0e72a640 1 -- 172.21.15.78:0/1193657930 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbd0815b390 msgr2=0x7fbd0815b840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:55.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.429+0000 7fbd0e72a640 1 --2- 172.21.15.78:0/1193657930 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbd0815b390 0x7fbd0815b840 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fbd00009d90 tx=0x7fbd0001c890 comp rx=0 tx=0).stop 2023-12-12T10:12:55.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.429+0000 7fbd0e72a640 1 -- 172.21.15.78:0/1193657930 shutdown_connections 2023-12-12T10:12:55.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.429+0000 7fbd0e72a640 1 --2- 172.21.15.78:0/1193657930 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbd0815b390 0x7fbd0815b840 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:55.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.429+0000 7fbd0e72a640 1 --2- 172.21.15.78:0/1193657930 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbd0806cf60 0x7fbd0815f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:55.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.429+0000 7fbd0e72a640 1 -- 172.21.15.78:0/1193657930 >> 172.21.15.78:0/1193657930 conn(0x7fbd0806a710 msgr2=0x7fbd0806ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:55.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.429+0000 7fbd0e72a640 1 -- 172.21.15.78:0/1193657930 shutdown_connections 2023-12-12T10:12:55.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.429+0000 7fbd0e72a640 1 -- 172.21.15.78:0/1193657930 wait complete. 2023-12-12T10:12:55.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.433+0000 7fbd0e72a640 1 Processor -- start 2023-12-12T10:12:55.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.433+0000 7fbd0e72a640 1 -- start start 2023-12-12T10:12:55.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.433+0000 7fbd0e72a640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbd0806cf60 0x7fbd0815dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:55.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.433+0000 7fbd0e72a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbd080cb4b0 0x7fbd0813efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:55.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.433+0000 7fbd0e72a640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbd0815b390 0x7fbd08165420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:55.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.433+0000 7fbd0e72a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd08164380 con 0x7fbd080cb4b0 2023-12-12T10:12:55.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.433+0000 7fbd0e72a640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd08164660 con 0x7fbd0806cf60 2023-12-12T10:12:55.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.433+0000 7fbd0e72a640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd08164940 con 0x7fbd0815b390 2023-12-12T10:12:55.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.433+0000 7fbd077fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbd080cb4b0 0x7fbd0813efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:55.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.433+0000 7fbd077fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbd080cb4b0 0x7fbd0813efb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:58998/0 (socket says 172.21.15.78:58998) 2023-12-12T10:12:55.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.433+0000 7fbd077fe640 1 -- 172.21.15.78:0/2540315868 learned_addr learned my addr 172.21.15.78:0/2540315868 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:55.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.433+0000 7fbd0ccc7640 1 --2- 172.21.15.78:0/2540315868 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbd0815b390 0x7fbd08165420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:55.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.433+0000 7fbd07fff640 1 --2- 172.21.15.78:0/2540315868 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbd0806cf60 0x7fbd0815dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:55.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.433+0000 7fbd077fe640 1 -- 172.21.15.78:0/2540315868 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbd0815b390 msgr2=0x7fbd08165420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:55.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.433+0000 7fbd077fe640 1 --2- 172.21.15.78:0/2540315868 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbd0815b390 0x7fbd08165420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:55.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.433+0000 7fbd077fe640 1 -- 172.21.15.78:0/2540315868 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbd0806cf60 msgr2=0x7fbd0815dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:55.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.433+0000 7fbd077fe640 1 --2- 172.21.15.78:0/2540315868 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbd0806cf60 0x7fbd0815dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:55.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.433+0000 7fbd077fe640 1 -- 172.21.15.78:0/2540315868 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd00009a70 con 0x7fbd080cb4b0 2023-12-12T10:12:55.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.433+0000 7fbd07fff640 1 --2- 172.21.15.78:0/2540315868 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbd0806cf60 0x7fbd0815dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T10:12:55.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.433+0000 7fbd077fe640 1 --2- 172.21.15.78:0/2540315868 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbd080cb4b0 0x7fbd0813efb0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fbcfc00e810 tx=0x7fbcfc00ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:55.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.433+0000 7fbd04ff9640 1 -- 172.21.15.78:0/2540315868 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcfc00c8d0 con 0x7fbd080cb4b0 2023-12-12T10:12:55.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.433+0000 7fbd04ff9640 1 -- 172.21.15.78:0/2540315868 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcfc00ca30 con 0x7fbd080cb4b0 2023-12-12T10:12:55.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.433+0000 7fbd04ff9640 1 -- 172.21.15.78:0/2540315868 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcfc00cde0 con 0x7fbd080cb4b0 2023-12-12T10:12:55.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.433+0000 7fbd0e72a640 1 -- 172.21.15.78:0/2540315868 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd08164c20 con 0x7fbd080cb4b0 2023-12-12T10:12:55.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.437+0000 7fbd0e72a640 1 -- 172.21.15.78:0/2540315868 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd0815e3e0 con 0x7fbd080cb4b0 2023-12-12T10:12:55.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.437+0000 7fbd0e72a640 1 -- 172.21.15.78:0/2540315868 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd080671f0 con 0x7fbd080cb4b0 2023-12-12T10:12:55.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.437+0000 7fbd04ff9640 1 -- 172.21.15.78:0/2540315868 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fbcfc013410 con 0x7fbd080cb4b0 2023-12-12T10:12:55.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.437+0000 7fbd04ff9640 1 --2- 172.21.15.78:0/2540315868 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fbcf4066470 0x7fbcf4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:55.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.437+0000 7fbd04ff9640 1 -- 172.21.15.78:0/2540315868 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fbcfc083ff0 con 0x7fbd080cb4b0 2023-12-12T10:12:55.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.437+0000 7fbd07fff640 1 --2- 172.21.15.78:0/2540315868 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fbcf4066470 0x7fbcf4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:55.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.437+0000 7fbd07fff640 1 --2- 172.21.15.78:0/2540315868 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fbcf4066470 0x7fbcf4068930 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fbcf8007fd0 tx=0x7fbcf8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:55.446 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.441+0000 7fbd04ff9640 1 -- 172.21.15.78:0/2540315868 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fbcfc051100 con 0x7fbd080cb4b0 2023-12-12T10:12:55.595 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.589+0000 7fbd0e72a640 1 -- 172.21.15.78:0/2540315868 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbd08067530 con 0x7fbd080cb4b0 2023-12-12T10:12:55.595 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.593+0000 7fbd04ff9640 1 -- 172.21.15.78:0/2540315868 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbcfc054720 con 0x7fbd080cb4b0 2023-12-12T10:12:55.596 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2023-12-12T10:12:55.598 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.593+0000 7fbd0e72a640 1 -- 172.21.15.78:0/2540315868 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fbcf4066470 msgr2=0x7fbcf4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:55.598 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.593+0000 7fbd0e72a640 1 --2- 172.21.15.78:0/2540315868 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fbcf4066470 0x7fbcf4068930 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fbcf8007fd0 tx=0x7fbcf8009040 comp rx=0 tx=0).stop 2023-12-12T10:12:55.598 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.593+0000 7fbd0e72a640 1 -- 172.21.15.78:0/2540315868 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbd080cb4b0 msgr2=0x7fbd0813efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:55.598 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.593+0000 7fbd0e72a640 1 --2- 172.21.15.78:0/2540315868 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbd080cb4b0 0x7fbd0813efb0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fbcfc00e810 tx=0x7fbcfc00ecd0 comp rx=0 tx=0).stop 2023-12-12T10:12:55.598 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.593+0000 7fbd0e72a640 1 -- 172.21.15.78:0/2540315868 shutdown_connections 2023-12-12T10:12:55.598 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.593+0000 7fbd0e72a640 1 --2- 172.21.15.78:0/2540315868 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fbcf4066470 0x7fbcf4068930 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:55.598 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.593+0000 7fbd0e72a640 1 --2- 172.21.15.78:0/2540315868 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbd0815b390 0x7fbd08165420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:55.598 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.593+0000 7fbd0e72a640 1 --2- 172.21.15.78:0/2540315868 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbd080cb4b0 0x7fbd0813efb0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:55.598 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.593+0000 7fbd0e72a640 1 --2- 172.21.15.78:0/2540315868 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbd0806cf60 0x7fbd0815dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:55.598 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.593+0000 7fbd0e72a640 1 -- 172.21.15.78:0/2540315868 >> 172.21.15.78:0/2540315868 conn(0x7fbd0806a710 msgr2=0x7fbd0806aaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:55.599 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.593+0000 7fbd0e72a640 1 -- 172.21.15.78:0/2540315868 shutdown_connections 2023-12-12T10:12:55.599 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.593+0000 7fbd0e72a640 1 -- 172.21.15.78:0/2540315868 wait complete. 2023-12-12T10:12:55.616 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-12T10:12:55.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.753+0000 7fa3d9c17640 1 Processor -- start 2023-12-12T10:12:55.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.753+0000 7fa3d9c17640 1 -- start start 2023-12-12T10:12:55.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.753+0000 7fa3d9c17640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa3d40b2b50 0x7fa3d406cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:55.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.753+0000 7fa3d9c17640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3d40b1e20 con 0x7fa3d4153ab0 2023-12-12T10:12:55.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.753+0000 7fa3d9c17640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3d40cea00 con 0x7fa3d40ce490 2023-12-12T10:12:55.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.753+0000 7fa3d9c17640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3d40b2070 con 0x7fa3d40b2b50 2023-12-12T10:12:55.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.753+0000 7fa3cbfff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa3d40b2b50 0x7fa3d406cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:55.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.753+0000 7fa3d37fe640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fa3d4153ab0 0x7fa3d415a560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:41500/0 (socket says 172.21.15.78:41500) 2023-12-12T10:12:55.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.753+0000 7fa3d37fe640 1 -- 172.21.15.78:0/2517449125 learned_addr learned my addr 172.21.15.78:0/2517449125 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-12-12T10:12:55.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.753+0000 7fa3cbfff640 1 -- 172.21.15.78:0/2517449125 >> v1:172.21.15.187:6789/0 conn(0x7fa3d40ce490 legacy=0x7fa3d40ccc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:55.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.753+0000 7fa3cbfff640 1 -- 172.21.15.78:0/2517449125 >> v1:172.21.15.78:6789/0 conn(0x7fa3d4153ab0 legacy=0x7fa3d415a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:55.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.753+0000 7fa3cbfff640 1 -- 172.21.15.78:0/2517449125 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3d40b2350 con 0x7fa3d40b2b50 2023-12-12T10:12:55.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.753+0000 7fa3d2ffd640 1 -- 172.21.15.78:0/2517449125 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1043436962 0 0) 0x7fa3d40b1e20 con 0x7fa3d4153ab0 2023-12-12T10:12:55.761 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.757+0000 7fa3cbfff640 1 --2- 172.21.15.78:0/2517449125 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3d40b2b50 0x7fa3d406cff0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fa3bc0097c0 tx=0x7fa3bc01c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40e1a2b0b77aa1ab server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:55.761 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.757+0000 7fa3d2ffd640 1 -- 172.21.15.78:0/2517449125 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3bc0a4ea0 con 0x7fa3d40b2b50 2023-12-12T10:12:55.761 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.757+0000 7fa3d2ffd640 1 -- 172.21.15.78:0/2517449125 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3bc0a7050 con 0x7fa3d40b2b50 2023-12-12T10:12:55.762 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.757+0000 7fa3d2ffd640 1 -- 172.21.15.78:0/2517449125 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3bc0ab820 con 0x7fa3d40b2b50 2023-12-12T10:12:55.762 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.757+0000 7fa3d9c17640 1 -- 172.21.15.78:0/2517449125 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3d40b2b50 msgr2=0x7fa3d406cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:55.762 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.757+0000 7fa3d9c17640 1 --2- 172.21.15.78:0/2517449125 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3d40b2b50 0x7fa3d406cff0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fa3bc0097c0 tx=0x7fa3bc01c380 comp rx=0 tx=0).stop 2023-12-12T10:12:55.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.757+0000 7fa3d9c17640 1 -- 172.21.15.78:0/2517449125 shutdown_connections 2023-12-12T10:12:55.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.757+0000 7fa3d9c17640 1 --2- 172.21.15.78:0/2517449125 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3d40b2b50 0x7fa3d406cff0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:55.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.757+0000 7fa3d9c17640 1 -- 172.21.15.78:0/2517449125 >> 172.21.15.78:0/2517449125 conn(0x7fa3d406a710 msgr2=0x7fa3d406ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:55.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.757+0000 7fa3d9c17640 1 -- 172.21.15.78:0/2517449125 shutdown_connections 2023-12-12T10:12:55.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.757+0000 7fa3d9c17640 1 -- 172.21.15.78:0/2517449125 wait complete. 2023-12-12T10:12:55.764 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.761+0000 7fa3d9c17640 1 Processor -- start 2023-12-12T10:12:55.764 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.761+0000 7fa3d9c17640 1 -- start start 2023-12-12T10:12:55.766 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.761+0000 7fa3d9c17640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3d40b2b50 0x7fa3d41f5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:55.766 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.761+0000 7fa3d9c17640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa3d40ce490 0x7fa3d415ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:55.766 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.761+0000 7fa3d9c17640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa3d4153ab0 0x7fa3d41470b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:55.766 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.761+0000 7fa3d9c17640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3d41f9020 con 0x7fa3d40b2b50 2023-12-12T10:12:55.767 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.761+0000 7fa3d9c17640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3d4148db0 con 0x7fa3d4153ab0 2023-12-12T10:12:55.767 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.761+0000 7fa3d9c17640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3d4158a50 con 0x7fa3d40ce490 2023-12-12T10:12:55.767 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.761+0000 7fa3d37fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3d40b2b50 0x7fa3d41f5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:55.767 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.761+0000 7fa3d37fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3d40b2b50 0x7fa3d41f5cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59012/0 (socket says 172.21.15.78:59012) 2023-12-12T10:12:55.767 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.761+0000 7fa3d37fe640 1 -- 172.21.15.78:0/3847202052 learned_addr learned my addr 172.21.15.78:0/3847202052 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:55.767 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.761+0000 7fa3d3fff640 1 --2- 172.21.15.78:0/3847202052 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa3d4153ab0 0x7fa3d41470b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:55.767 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.761+0000 7fa3cbfff640 1 --2- 172.21.15.78:0/3847202052 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa3d40ce490 0x7fa3d415ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:55.767 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.761+0000 7fa3d37fe640 1 -- 172.21.15.78:0/3847202052 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa3d40ce490 msgr2=0x7fa3d415ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:55.767 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.761+0000 7fa3d37fe640 1 --2- 172.21.15.78:0/3847202052 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa3d40ce490 0x7fa3d415ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:55.767 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.761+0000 7fa3d37fe640 1 -- 172.21.15.78:0/3847202052 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa3d4153ab0 msgr2=0x7fa3d41470b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:55.767 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.761+0000 7fa3d37fe640 1 --2- 172.21.15.78:0/3847202052 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa3d4153ab0 0x7fa3d41470b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:55.767 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.761+0000 7fa3d37fe640 1 -- 172.21.15.78:0/3847202052 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3bc009420 con 0x7fa3d40b2b50 2023-12-12T10:12:55.767 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.761+0000 7fa3d3fff640 1 --2- 172.21.15.78:0/3847202052 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa3d4153ab0 0x7fa3d41470b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T10:12:55.767 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.761+0000 7fa3d37fe640 1 --2- 172.21.15.78:0/3847202052 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3d40b2b50 0x7fa3d41f5cd0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fa3c400c4b0 tx=0x7fa3c400c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:55.768 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.761+0000 7fa3d0ff9640 1 -- 172.21.15.78:0/3847202052 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3c40074e0 con 0x7fa3d40b2b50 2023-12-12T10:12:55.768 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.761+0000 7fa3d0ff9640 1 -- 172.21.15.78:0/3847202052 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3c4007660 con 0x7fa3d40b2b50 2023-12-12T10:12:55.768 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.761+0000 7fa3d9c17640 1 -- 172.21.15.78:0/3847202052 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3d415bb40 con 0x7fa3d40b2b50 2023-12-12T10:12:55.768 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.761+0000 7fa3d0ff9640 1 -- 172.21.15.78:0/3847202052 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3c4004a30 con 0x7fa3d40b2b50 2023-12-12T10:12:55.768 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.761+0000 7fa3d9c17640 1 -- 172.21.15.78:0/3847202052 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3d415c100 con 0x7fa3d40b2b50 2023-12-12T10:12:55.768 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.765+0000 7fa3d9c17640 1 -- 172.21.15.78:0/3847202052 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3d40671f0 con 0x7fa3d40b2b50 2023-12-12T10:12:55.768 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.765+0000 7fa3d0ff9640 1 -- 172.21.15.78:0/3847202052 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa3c4004b90 con 0x7fa3d40b2b50 2023-12-12T10:12:55.769 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.765+0000 7fa3d0ff9640 1 --2- 172.21.15.78:0/3847202052 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fa3b4066470 0x7fa3b4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:55.769 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.765+0000 7fa3d0ff9640 1 -- 172.21.15.78:0/3847202052 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa3c40837d0 con 0x7fa3d40b2b50 2023-12-12T10:12:55.769 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.765+0000 7fa3cbfff640 1 --2- 172.21.15.78:0/3847202052 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fa3b4066470 0x7fa3b4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:55.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.765+0000 7fa3cbfff640 1 --2- 172.21.15.78:0/3847202052 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fa3b4066470 0x7fa3b4068930 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fa3bc0ad000 tx=0x7fa3bc0a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:55.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.769+0000 7fa3d0ff9640 1 -- 172.21.15.78:0/3847202052 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa3c4054280 con 0x7fa3d40b2b50 2023-12-12T10:12:55.922 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.917+0000 7fa3d9c17640 1 -- 172.21.15.78:0/3847202052 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa3d4148b80 con 0x7fa3d40b2b50 2023-12-12T10:12:55.922 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.917+0000 7fa3d0ff9640 1 -- 172.21.15.78:0/3847202052 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa3c4018020 con 0x7fa3d40b2b50 2023-12-12T10:12:55.922 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2023-12-12T10:12:55.924 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.921+0000 7fa3d9c17640 1 -- 172.21.15.78:0/3847202052 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fa3b4066470 msgr2=0x7fa3b4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:55.924 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.921+0000 7fa3d9c17640 1 --2- 172.21.15.78:0/3847202052 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fa3b4066470 0x7fa3b4068930 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fa3bc0ad000 tx=0x7fa3bc0a6000 comp rx=0 tx=0).stop 2023-12-12T10:12:55.924 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.921+0000 7fa3d9c17640 1 -- 172.21.15.78:0/3847202052 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3d40b2b50 msgr2=0x7fa3d41f5cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:55.924 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.921+0000 7fa3d9c17640 1 --2- 172.21.15.78:0/3847202052 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3d40b2b50 0x7fa3d41f5cd0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fa3c400c4b0 tx=0x7fa3c400c970 comp rx=0 tx=0).stop 2023-12-12T10:12:55.924 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.921+0000 7fa3d9c17640 1 -- 172.21.15.78:0/3847202052 shutdown_connections 2023-12-12T10:12:55.925 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.921+0000 7fa3d9c17640 1 --2- 172.21.15.78:0/3847202052 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fa3b4066470 0x7fa3b4068930 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:55.925 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.921+0000 7fa3d9c17640 1 --2- 172.21.15.78:0/3847202052 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa3d4153ab0 0x7fa3d41470b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:55.925 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.921+0000 7fa3d9c17640 1 --2- 172.21.15.78:0/3847202052 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa3d40ce490 0x7fa3d415ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:55.925 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.921+0000 7fa3d9c17640 1 --2- 172.21.15.78:0/3847202052 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa3d40b2b50 0x7fa3d41f5cd0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:55.925 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.921+0000 7fa3d9c17640 1 -- 172.21.15.78:0/3847202052 >> 172.21.15.78:0/3847202052 conn(0x7fa3d406a710 msgr2=0x7fa3d40b0c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:55.925 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.921+0000 7fa3d9c17640 1 -- 172.21.15.78:0/3847202052 shutdown_connections 2023-12-12T10:12:55.925 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:55.921+0000 7fa3d9c17640 1 -- 172.21.15.78:0/3847202052 wait complete. 2023-12-12T10:12:55.943 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-12T10:12:56.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:56.081+0000 7fe55149c640 1 Processor -- start 2023-12-12T10:12:56.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:56.081+0000 7fe55149c640 1 -- start start 2023-12-12T10:12:56.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:56.081+0000 7fe55149c640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fe54c15d510 0x7fe54c0d0060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:56.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:56.081+0000 7fe55149c640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe54c0d1630 0x7fe54c0d1a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:56.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:56.081+0000 7fe55149c640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe54c0b0670 0x7fe54c0b0b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:56.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:56.081+0000 7fe55149c640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe54c15d8f0 con 0x7fe54c0d1630 2023-12-12T10:12:56.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:56.081+0000 7fe55149c640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe54c0d1fd0 con 0x7fe54c15d510 2023-12-12T10:12:56.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:56.081+0000 7fe55149c640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe54c0d3b70 con 0x7fe54c0b0670 2023-12-12T10:12:56.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:56.081+0000 7fe5427fc640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe54c0d1630 0x7fe54c0d1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:56.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:56.081+0000 7fe5427fc640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe54c0d1630 0x7fe54c0d1a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59014/0 (socket says 172.21.15.78:59014) 2023-12-12T10:12:56.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:56.081+0000 7fe5427fc640 1 -- 172.21.15.78:0/100756758 learned_addr learned my addr 172.21.15.78:0/100756758 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:56.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:56.081+0000 7fe54b7fe640 1 --2- 172.21.15.78:0/100756758 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe54c0b0670 0x7fe54c0b0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:56.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:56.081+0000 7fe54affd640 1 --2- 172.21.15.78:0/100756758 >> v2:172.21.15.187:3300/0 conn(0x7fe54c15d510 0x7fe54c0d0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:56.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:56.081+0000 7fe5427fc640 1 -- 172.21.15.78:0/100756758 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe54c0b0670 msgr2=0x7fe54c0b0b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:56.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:56.081+0000 7fe5427fc640 1 --2- 172.21.15.78:0/100756758 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe54c0b0670 0x7fe54c0b0b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:56.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:56.081+0000 7fe5427fc640 1 -- 172.21.15.78:0/100756758 >> v2:172.21.15.187:3300/0 conn(0x7fe54c15d510 msgr2=0x7fe54c0d0060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:56.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:56.081+0000 7fe5427fc640 1 --2- 172.21.15.78:0/100756758 >> v2:172.21.15.187:3300/0 conn(0x7fe54c15d510 0x7fe54c0d0060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:56.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:56.081+0000 7fe5427fc640 1 -- 172.21.15.78:0/100756758 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe54c0afc20 con 0x7fe54c0d1630 2023-12-12T10:12:56.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:56.085+0000 7fe5427fc640 1 --2- 172.21.15.78:0/100756758 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe54c0d1630 0x7fe54c0d1a90 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fe54c0b5c10 tx=0x7fe53401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b5858349cacfc06 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:56.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:56.085+0000 7fe54a7fc640 1 -- 172.21.15.78:0/100756758 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5340aa5f0 con 0x7fe54c0d1630 2023-12-12T10:12:56.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:56.085+0000 7fe54a7fc640 1 -- 172.21.15.78:0/100756758 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5340aa750 con 0x7fe54c0d1630 2023-12-12T10:12:56.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:56.085+0000 7fe54a7fc640 1 -- 172.21.15.78:0/100756758 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5340aaae0 con 0x7fe54c0d1630 2023-12-12T10:12:56.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:56.085+0000 7fe55149c640 1 -- 172.21.15.78:0/100756758 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe54c0d1630 msgr2=0x7fe54c0d1a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:56.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:56.085+0000 7fe55149c640 1 --2- 172.21.15.78:0/100756758 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe54c0d1630 0x7fe54c0d1a90 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fe54c0b5c10 tx=0x7fe53401c4d0 comp rx=0 tx=0).stop 2023-12-12T10:12:56.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:56.085+0000 7fe55149c640 1 -- 172.21.15.78:0/100756758 shutdown_connections 2023-12-12T10:12:56.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:56.085+0000 7fe55149c640 1 --2- 172.21.15.78:0/100756758 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe54c0b0670 0x7fe54c0b0b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:56.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:56.085+0000 7fe55149c640 1 --2- 172.21.15.78:0/100756758 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe54c0d1630 0x7fe54c0d1a90 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:56.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:56.085+0000 7fe55149c640 1 --2- 172.21.15.78:0/100756758 >> v2:172.21.15.187:3300/0 conn(0x7fe54c15d510 0x7fe54c0d0060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:56.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:56.085+0000 7fe55149c640 1 -- 172.21.15.78:0/100756758 >> 172.21.15.78:0/100756758 conn(0x7fe54c0d3050 msgr2=0x7fe54c0d3460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:56.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:56.085+0000 7fe55149c640 1 -- 172.21.15.78:0/100756758 shutdown_connections 2023-12-12T10:12:56.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:56.085+0000 7fe55149c640 1 -- 172.21.15.78:0/100756758 wait complete. 2023-12-12T10:12:56.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:56.089+0000 7fe55149c640 1 Processor -- start 2023-12-12T10:12:56.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:56.089+0000 7fe55149c640 1 -- start start 2023-12-12T10:12:56.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:56.089+0000 7fe55149c640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe54c0b0670 0x7fe54c154680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:56.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:56.089+0000 7fe55149c640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe54c0d1630 0x7fe54c158f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:56.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:56.089+0000 7fe55149c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe54c15d510 0x7fe54c159440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:56.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:56.089+0000 7fe55149c640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe54c154bc0 con 0x7fe54c15d510 2023-12-12T10:12:56.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:56.089+0000 7fe55149c640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe54c155ac0 con 0x7fe54c0d1630 2023-12-12T10:12:56.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:56.089+0000 7fe55149c640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe54c155da0 con 0x7fe54c0b0670 2023-12-12T10:12:56.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:56.089+0000 7fe54b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe54c15d510 0x7fe54c159440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:56.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:56.089+0000 7fe54affd640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe54c0b0670 0x7fe54c154680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:56.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:56.089+0000 7fe54b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe54c15d510 0x7fe54c159440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59028/0 (socket says 172.21.15.78:59028) 2023-12-12T10:12:56.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:56.089+0000 7fe54b7fe640 1 -- 172.21.15.78:0/2320799222 learned_addr learned my addr 172.21.15.78:0/2320799222 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:56.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:56.089+0000 7fe5427fc640 1 --2- 172.21.15.78:0/2320799222 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe54c0d1630 0x7fe54c158f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:56.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:56.089+0000 7fe54b7fe640 1 -- 172.21.15.78:0/2320799222 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe54c0b0670 msgr2=0x7fe54c154680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:56.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:56.089+0000 7fe54b7fe640 1 --2- 172.21.15.78:0/2320799222 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe54c0b0670 0x7fe54c154680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:56.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:56.089+0000 7fe54b7fe640 1 -- 172.21.15.78:0/2320799222 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe54c0d1630 msgr2=0x7fe54c158f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:56.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:56.089+0000 7fe54b7fe640 1 --2- 172.21.15.78:0/2320799222 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe54c0d1630 0x7fe54c158f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:56.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:56.089+0000 7fe54b7fe640 1 -- 172.21.15.78:0/2320799222 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5340094d0 con 0x7fe54c15d510 2023-12-12T10:12:56.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:56.089+0000 7fe54b7fe640 1 --2- 172.21.15.78:0/2320799222 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe54c15d510 0x7fe54c159440 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fe54400eed0 tx=0x7fe54400b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:56.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:56.089+0000 7fe543fff640 1 -- 172.21.15.78:0/2320799222 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe544010040 con 0x7fe54c15d510 2023-12-12T10:12:56.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:56.089+0000 7fe543fff640 1 -- 172.21.15.78:0/2320799222 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe544014400 con 0x7fe54c15d510 2023-12-12T10:12:56.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:56.089+0000 7fe55149c640 1 -- 172.21.15.78:0/2320799222 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe54c156080 con 0x7fe54c15d510 2023-12-12T10:12:56.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:56.089+0000 7fe543fff640 1 -- 172.21.15.78:0/2320799222 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe544009ea0 con 0x7fe54c15d510 2023-12-12T10:12:56.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:56.089+0000 7fe55149c640 1 -- 172.21.15.78:0/2320799222 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe54c156640 con 0x7fe54c15d510 2023-12-12T10:12:56.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:56.089+0000 7fe55149c640 1 -- 172.21.15.78:0/2320799222 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe54c0671f0 con 0x7fe54c15d510 2023-12-12T10:12:56.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:56.093+0000 7fe543fff640 1 -- 172.21.15.78:0/2320799222 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe5440147b0 con 0x7fe54c15d510 2023-12-12T10:12:56.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:56.093+0000 7fe543fff640 1 --2- 172.21.15.78:0/2320799222 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fe52c066470 0x7fe52c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:56.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:56.093+0000 7fe543fff640 1 -- 172.21.15.78:0/2320799222 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fe544084810 con 0x7fe54c15d510 2023-12-12T10:12:56.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:56.093+0000 7fe54affd640 1 --2- 172.21.15.78:0/2320799222 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fe52c066470 0x7fe52c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:56.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:56.093+0000 7fe54affd640 1 --2- 172.21.15.78:0/2320799222 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fe52c066470 0x7fe52c068930 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe53c0079c0 tx=0x7fe53c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:56.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:56.097+0000 7fe543fff640 1 -- 172.21.15.78:0/2320799222 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe544051970 con 0x7fe54c15d510 2023-12-12T10:12:56.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:56.253+0000 7fe55149c640 1 -- 172.21.15.78:0/2320799222 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fe54c156830 con 0x7fe54c15d510 2023-12-12T10:12:56.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:56.253+0000 7fe543fff640 1 -- 172.21.15.78:0/2320799222 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7fe544018020 con 0x7fe54c15d510 2023-12-12T10:12:56.256 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2023-12-12T10:12:56.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:56.253+0000 7fe55149c640 1 -- 172.21.15.78:0/2320799222 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fe52c066470 msgr2=0x7fe52c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:56.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:56.253+0000 7fe55149c640 1 --2- 172.21.15.78:0/2320799222 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fe52c066470 0x7fe52c068930 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe53c0079c0 tx=0x7fe53c008040 comp rx=0 tx=0).stop 2023-12-12T10:12:56.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:56.253+0000 7fe55149c640 1 -- 172.21.15.78:0/2320799222 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe54c15d510 msgr2=0x7fe54c159440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:56.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:56.253+0000 7fe55149c640 1 --2- 172.21.15.78:0/2320799222 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe54c15d510 0x7fe54c159440 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fe54400eed0 tx=0x7fe54400b480 comp rx=0 tx=0).stop 2023-12-12T10:12:56.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:56.253+0000 7fe55149c640 1 -- 172.21.15.78:0/2320799222 shutdown_connections 2023-12-12T10:12:56.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:56.253+0000 7fe55149c640 1 --2- 172.21.15.78:0/2320799222 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fe52c066470 0x7fe52c068930 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:56.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:56.253+0000 7fe55149c640 1 --2- 172.21.15.78:0/2320799222 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe54c15d510 0x7fe54c159440 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:56.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:56.253+0000 7fe55149c640 1 --2- 172.21.15.78:0/2320799222 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe54c0d1630 0x7fe54c158f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:56.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:56.253+0000 7fe55149c640 1 --2- 172.21.15.78:0/2320799222 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe54c0b0670 0x7fe54c154680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:56.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:56.253+0000 7fe55149c640 1 -- 172.21.15.78:0/2320799222 >> 172.21.15.78:0/2320799222 conn(0x7fe54c0d3050 msgr2=0x7fe54c0b26c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:56.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:56.253+0000 7fe55149c640 1 -- 172.21.15.78:0/2320799222 shutdown_connections 2023-12-12T10:12:56.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:56.253+0000 7fe55149c640 1 -- 172.21.15.78:0/2320799222 wait complete. 2023-12-12T10:12:56.276 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic' 2023-12-12T10:12:56.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:56.409+0000 7fa21d417640 1 Processor -- start 2023-12-12T10:12:56.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:56.409+0000 7fa21d417640 1 -- start start 2023-12-12T10:12:56.416 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:56.413+0000 7fa21d417640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa21813ceb0 0x7fa21813d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:56.416 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:56.413+0000 7fa21d417640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fa21813fc60 0x7fa218072030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:56.416 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:56.413+0000 7fa21d417640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2180705a0 con 0x7fa218071bf0 2023-12-12T10:12:56.416 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:56.413+0000 7fa21d417640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa218140410 con 0x7fa21813ceb0 2023-12-12T10:12:56.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:56.413+0000 7fa21d417640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2180cdc90 con 0x7fa21813fc60 2023-12-12T10:12:56.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:56.413+0000 7fa216ffd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa21813ceb0 0x7fa21813d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:56.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:56.413+0000 7fa20e7fc640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fa218071bf0 0x7fa21813f550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:41512/0 (socket says 172.21.15.78:41512) 2023-12-12T10:12:56.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:56.413+0000 7fa20e7fc640 1 -- 172.21.15.78:0/3583738891 learned_addr learned my addr 172.21.15.78:0/3583738891 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-12-12T10:12:56.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:56.413+0000 7fa2177fe640 1 --2- 172.21.15.78:0/3583738891 >> v2:172.21.15.187:3300/0 conn(0x7fa21813fc60 0x7fa218072030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:56.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:56.413+0000 7fa216ffd640 1 -- 172.21.15.78:0/3583738891 >> v2:172.21.15.187:3300/0 conn(0x7fa21813fc60 msgr2=0x7fa218072030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:56.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:56.413+0000 7fa216ffd640 1 --2- 172.21.15.78:0/3583738891 >> v2:172.21.15.187:3300/0 conn(0x7fa21813fc60 0x7fa218072030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:56.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:56.413+0000 7fa216ffd640 1 -- 172.21.15.78:0/3583738891 >> v1:172.21.15.78:6789/0 conn(0x7fa218071bf0 legacy=0x7fa21813f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:56.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:56.413+0000 7fa216ffd640 1 -- 172.21.15.78:0/3583738891 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa218072570 con 0x7fa21813ceb0 2023-12-12T10:12:56.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:56.413+0000 7fa2167fc640 1 -- 172.21.15.78:0/3583738891 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2038152152 0 0) 0x7fa2180705a0 con 0x7fa218071bf0 2023-12-12T10:12:56.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:56.417+0000 7fa216ffd640 1 --2- 172.21.15.78:0/3583738891 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa21813ceb0 0x7fa21813d4c0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fa218072d70 tx=0x7fa20801c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbe0529b3920936b server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:56.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:56.417+0000 7fa2167fc640 1 -- 172.21.15.78:0/3583738891 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2080a9400 con 0x7fa21813ceb0 2023-12-12T10:12:56.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:56.417+0000 7fa2167fc640 1 -- 172.21.15.78:0/3583738891 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2080a9560 con 0x7fa21813ceb0 2023-12-12T10:12:56.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:56.417+0000 7fa2167fc640 1 -- 172.21.15.78:0/3583738891 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2080a98f0 con 0x7fa21813ceb0 2023-12-12T10:12:56.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:56.417+0000 7fa21d417640 1 -- 172.21.15.78:0/3583738891 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa21813ceb0 msgr2=0x7fa21813d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:56.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:56.417+0000 7fa21d417640 1 --2- 172.21.15.78:0/3583738891 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa21813ceb0 0x7fa21813d4c0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fa218072d70 tx=0x7fa20801c910 comp rx=0 tx=0).stop 2023-12-12T10:12:56.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:56.417+0000 7fa21d417640 1 -- 172.21.15.78:0/3583738891 shutdown_connections 2023-12-12T10:12:56.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:56.417+0000 7fa21d417640 1 --2- 172.21.15.78:0/3583738891 >> v2:172.21.15.187:3300/0 conn(0x7fa21813fc60 0x7fa218072030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:56.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:56.417+0000 7fa21d417640 1 --2- 172.21.15.78:0/3583738891 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa21813ceb0 0x7fa21813d4c0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:56.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:56.417+0000 7fa21d417640 1 -- 172.21.15.78:0/3583738891 >> 172.21.15.78:0/3583738891 conn(0x7fa21806c5d0 msgr2=0x7fa21806c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:56.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:56.417+0000 7fa21d417640 1 -- 172.21.15.78:0/3583738891 shutdown_connections 2023-12-12T10:12:56.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:56.417+0000 7fa21d417640 1 -- 172.21.15.78:0/3583738891 wait complete. 2023-12-12T10:12:56.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:56.417+0000 7fa21d417640 1 Processor -- start 2023-12-12T10:12:56.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:56.417+0000 7fa21d417640 1 -- start start 2023-12-12T10:12:56.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:56.417+0000 7fa21d417640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa218071bf0 0x7fa21813b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:56.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:56.417+0000 7fa21d417640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa21813ceb0 0x7fa218133920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:56.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:56.417+0000 7fa21d417640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa21813fc60 0x7fa218138910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:56.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:56.417+0000 7fa21d417640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa21813bfc0 con 0x7fa21813ceb0 2023-12-12T10:12:56.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:56.417+0000 7fa21d417640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa218165d80 con 0x7fa21813fc60 2023-12-12T10:12:56.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:56.417+0000 7fa21d417640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa21813c230 con 0x7fa218071bf0 2023-12-12T10:12:56.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:56.421+0000 7fa20e7fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa21813ceb0 0x7fa218133920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:56.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:56.421+0000 7fa20e7fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa21813ceb0 0x7fa218133920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59034/0 (socket says 172.21.15.78:59034) 2023-12-12T10:12:56.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:56.421+0000 7fa20e7fc640 1 -- 172.21.15.78:0/279409310 learned_addr learned my addr 172.21.15.78:0/279409310 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:56.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:56.421+0000 7fa216ffd640 1 --2- 172.21.15.78:0/279409310 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa218071bf0 0x7fa21813b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:56.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:56.421+0000 7fa2177fe640 1 --2- 172.21.15.78:0/279409310 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa21813fc60 0x7fa218138910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:56.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:56.421+0000 7fa20e7fc640 1 -- 172.21.15.78:0/279409310 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa218071bf0 msgr2=0x7fa21813b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:56.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:56.421+0000 7fa20e7fc640 1 --2- 172.21.15.78:0/279409310 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa218071bf0 0x7fa21813b670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:56.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:56.421+0000 7fa20e7fc640 1 -- 172.21.15.78:0/279409310 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa21813fc60 msgr2=0x7fa218138910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:56.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:56.421+0000 7fa20e7fc640 1 --2- 172.21.15.78:0/279409310 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa21813fc60 0x7fa218138910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:56.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:56.421+0000 7fa20e7fc640 1 -- 172.21.15.78:0/279409310 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa208009a70 con 0x7fa21813ceb0 2023-12-12T10:12:56.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:56.421+0000 7fa2177fe640 1 --2- 172.21.15.78:0/279409310 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa21813fc60 0x7fa218138910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T10:12:56.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:56.421+0000 7fa20e7fc640 1 --2- 172.21.15.78:0/279409310 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa21813ceb0 0x7fa218133920 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fa2000011f0 tx=0x7fa20000c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:56.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:56.421+0000 7fa20ffff640 1 -- 172.21.15.78:0/279409310 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2000074e0 con 0x7fa21813ceb0 2023-12-12T10:12:56.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:56.421+0000 7fa20ffff640 1 -- 172.21.15.78:0/279409310 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa200007640 con 0x7fa21813ceb0 2023-12-12T10:12:56.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:56.421+0000 7fa21d417640 1 -- 172.21.15.78:0/279409310 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa21813c510 con 0x7fa21813ceb0 2023-12-12T10:12:56.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:56.421+0000 7fa20ffff640 1 -- 172.21.15.78:0/279409310 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa200004a10 con 0x7fa21813ceb0 2023-12-12T10:12:56.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:56.421+0000 7fa21d417640 1 -- 172.21.15.78:0/279409310 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2181f9a50 con 0x7fa21813ceb0 2023-12-12T10:12:56.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:56.421+0000 7fa21d417640 1 -- 172.21.15.78:0/279409310 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2180671f0 con 0x7fa21813ceb0 2023-12-12T10:12:56.427 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:56.421+0000 7fa20ffff640 1 -- 172.21.15.78:0/279409310 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa200004b70 con 0x7fa21813ceb0 2023-12-12T10:12:56.427 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:56.421+0000 7fa20ffff640 1 --2- 172.21.15.78:0/279409310 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fa1f8066470 0x7fa1f8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:56.427 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:56.421+0000 7fa20ffff640 1 -- 172.21.15.78:0/279409310 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa2000836b0 con 0x7fa21813ceb0 2023-12-12T10:12:56.427 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:56.425+0000 7fa216ffd640 1 --2- 172.21.15.78:0/279409310 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fa1f8066470 0x7fa1f8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:56.428 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:56.425+0000 7fa216ffd640 1 --2- 172.21.15.78:0/279409310 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fa1f8066470 0x7fa1f8068930 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fa2080af000 tx=0x7fa2080a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:56.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:56.425+0000 7fa20ffff640 1 -- 172.21.15.78:0/279409310 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa200050820 con 0x7fa21813ceb0 2023-12-12T10:12:56.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:56.629+0000 7fa21d417640 1 -- 172.21.15.78:0/279409310 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]} v 0) v1 -- 0x7fa218165f40 con 0x7fa21813ceb0 2023-12-12T10:12:57.123 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:57.117+0000 7fa20ffff640 1 -- 172.21.15.78:0/279409310 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]}]=0 v69) v1 ==== 147+0+0 (secure 0 0 0) 0x7fa200053e40 con 0x7fa21813ceb0 2023-12-12T10:12:57.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:57.121+0000 7fa21d417640 1 -- 172.21.15.78:0/279409310 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fa1f8066470 msgr2=0x7fa1f8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:57.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:57.121+0000 7fa21d417640 1 --2- 172.21.15.78:0/279409310 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fa1f8066470 0x7fa1f8068930 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fa2080af000 tx=0x7fa2080a7000 comp rx=0 tx=0).stop 2023-12-12T10:12:57.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:57.121+0000 7fa21d417640 1 -- 172.21.15.78:0/279409310 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa21813ceb0 msgr2=0x7fa218133920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:57.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:57.121+0000 7fa21d417640 1 --2- 172.21.15.78:0/279409310 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa21813ceb0 0x7fa218133920 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fa2000011f0 tx=0x7fa20000c9b0 comp rx=0 tx=0).stop 2023-12-12T10:12:57.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:57.121+0000 7fa21d417640 1 -- 172.21.15.78:0/279409310 shutdown_connections 2023-12-12T10:12:57.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:57.121+0000 7fa21d417640 1 --2- 172.21.15.78:0/279409310 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fa1f8066470 0x7fa1f8068930 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:57.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:57.121+0000 7fa21d417640 1 --2- 172.21.15.78:0/279409310 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa21813fc60 0x7fa218138910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:57.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:57.121+0000 7fa21d417640 1 --2- 172.21.15.78:0/279409310 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa21813ceb0 0x7fa218133920 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:57.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:57.121+0000 7fa21d417640 1 --2- 172.21.15.78:0/279409310 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa218071bf0 0x7fa21813b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:57.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:57.121+0000 7fa21d417640 1 -- 172.21.15.78:0/279409310 >> 172.21.15.78:0/279409310 conn(0x7fa21806c5d0 msgr2=0x7fa2180afac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:57.126 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:57.121+0000 7fa21d417640 1 -- 172.21.15.78:0/279409310 shutdown_connections 2023-12-12T10:12:57.126 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:57.121+0000 7fa21d417640 1 -- 172.21.15.78:0/279409310 wait complete. 2023-12-12T10:12:57.145 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-12-12T10:12:57.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:57.281+0000 7fbe81c68640 1 Processor -- start 2023-12-12T10:12:57.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:57.281+0000 7fbe81c68640 1 -- start start 2023-12-12T10:12:57.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:57.281+0000 7fbe81c68640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fbe7c0cdf60 0x7fbe7c070f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:57.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:57.281+0000 7fbe81c68640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe7c070a70 con 0x7fbe7c071440 2023-12-12T10:12:57.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:57.281+0000 7fbe81c68640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe7c0ce3c0 con 0x7fbe7c143770 2023-12-12T10:12:57.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:57.281+0000 7fbe81c68640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe7c070440 con 0x7fbe7c0cdf60 2023-12-12T10:12:57.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:57.285+0000 7fbe7affd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fbe7c0cdf60 0x7fbe7c070f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:57.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:57.285+0000 7fbe7bfff640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fbe7c071440 0x7fbe7c15d910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:41526/0 (socket says 172.21.15.78:41526) 2023-12-12T10:12:57.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:57.285+0000 7fbe7bfff640 1 -- 172.21.15.78:0/1809172992 learned_addr learned my addr 172.21.15.78:0/1809172992 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-12-12T10:12:57.288 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:57.285+0000 7fbe7affd640 1 -- 172.21.15.78:0/1809172992 >> v1:172.21.15.187:6789/0 conn(0x7fbe7c143770 legacy=0x7fbe7c0b1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:57.288 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:57.285+0000 7fbe7affd640 1 -- 172.21.15.78:0/1809172992 >> v1:172.21.15.78:6789/0 conn(0x7fbe7c071440 legacy=0x7fbe7c15d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:57.288 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:57.285+0000 7fbe7affd640 1 -- 172.21.15.78:0/1809172992 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe7c0b2530 con 0x7fbe7c0cdf60 2023-12-12T10:12:57.290 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:57.285+0000 7fbe7affd640 1 --2- 172.21.15.78:0/1809172992 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbe7c0cdf60 0x7fbe7c070f00 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fbe700097c0 tx=0x7fbe7001c280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f899211ab83833f1 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:57.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:57.285+0000 7fbe7a7fc640 1 -- 172.21.15.78:0/1809172992 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe700ab600 con 0x7fbe7c0cdf60 2023-12-12T10:12:57.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:57.285+0000 7fbe7a7fc640 1 -- 172.21.15.78:0/1809172992 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe700a7050 con 0x7fbe7c0cdf60 2023-12-12T10:12:57.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:57.285+0000 7fbe7a7fc640 1 -- 172.21.15.78:0/1809172992 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe700ab980 con 0x7fbe7c0cdf60 2023-12-12T10:12:57.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:57.289+0000 7fbe81c68640 1 -- 172.21.15.78:0/1809172992 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbe7c0cdf60 msgr2=0x7fbe7c070f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:57.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:57.289+0000 7fbe81c68640 1 --2- 172.21.15.78:0/1809172992 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbe7c0cdf60 0x7fbe7c070f00 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fbe700097c0 tx=0x7fbe7001c280 comp rx=0 tx=0).stop 2023-12-12T10:12:57.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:57.289+0000 7fbe81c68640 1 -- 172.21.15.78:0/1809172992 shutdown_connections 2023-12-12T10:12:57.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:57.289+0000 7fbe81c68640 1 --2- 172.21.15.78:0/1809172992 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbe7c0cdf60 0x7fbe7c070f00 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:57.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:57.289+0000 7fbe81c68640 1 -- 172.21.15.78:0/1809172992 >> 172.21.15.78:0/1809172992 conn(0x7fbe7c06a710 msgr2=0x7fbe7c06ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:57.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:57.289+0000 7fbe81c68640 1 -- 172.21.15.78:0/1809172992 shutdown_connections 2023-12-12T10:12:57.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:57.289+0000 7fbe81c68640 1 -- 172.21.15.78:0/1809172992 wait complete. 2023-12-12T10:12:57.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:57.289+0000 7fbe81c68640 1 Processor -- start 2023-12-12T10:12:57.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:57.289+0000 7fbe81c68640 1 -- start start 2023-12-12T10:12:57.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:57.289+0000 7fbe81c68640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbe7c071440 0x7fbe7c0af540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:57.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:57.289+0000 7fbe81c68640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbe7c0cdf60 0x7fbe7c1e6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:57.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:57.289+0000 7fbe81c68640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbe7c143770 0x7fbe7c159300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:57.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:57.289+0000 7fbe81c68640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe7c0ae780 con 0x7fbe7c143770 2023-12-12T10:12:57.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:57.289+0000 7fbe81c68640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe7c0aea60 con 0x7fbe7c0cdf60 2023-12-12T10:12:57.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:57.289+0000 7fbe81c68640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe7c0aed40 con 0x7fbe7c071440 2023-12-12T10:12:57.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:57.289+0000 7fbe7bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbe7c143770 0x7fbe7c159300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:57.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:57.289+0000 7fbe7bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbe7c143770 0x7fbe7c159300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59040/0 (socket says 172.21.15.78:59040) 2023-12-12T10:12:57.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:57.289+0000 7fbe7bfff640 1 -- 172.21.15.78:0/2036325087 learned_addr learned my addr 172.21.15.78:0/2036325087 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:57.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:57.289+0000 7fbe7affd640 1 --2- 172.21.15.78:0/2036325087 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbe7c0cdf60 0x7fbe7c1e6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:57.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:57.289+0000 7fbe7b7fe640 1 --2- 172.21.15.78:0/2036325087 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbe7c071440 0x7fbe7c0af540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:57.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:57.293+0000 7fbe7bfff640 1 -- 172.21.15.78:0/2036325087 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbe7c071440 msgr2=0x7fbe7c0af540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:57.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:57.293+0000 7fbe7bfff640 1 --2- 172.21.15.78:0/2036325087 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbe7c071440 0x7fbe7c0af540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:57.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:57.293+0000 7fbe7bfff640 1 -- 172.21.15.78:0/2036325087 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbe7c0cdf60 msgr2=0x7fbe7c1e6bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:57.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:57.293+0000 7fbe7bfff640 1 --2- 172.21.15.78:0/2036325087 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbe7c0cdf60 0x7fbe7c1e6bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:57.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:57.293+0000 7fbe7bfff640 1 -- 172.21.15.78:0/2036325087 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe70009420 con 0x7fbe7c143770 2023-12-12T10:12:57.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:57.293+0000 7fbe7bfff640 1 --2- 172.21.15.78:0/2036325087 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbe7c143770 0x7fbe7c159300 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fbe7400e780 tx=0x7fbe7400ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:57.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:57.293+0000 7fbe63fff640 1 -- 172.21.15.78:0/2036325087 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe7400f930 con 0x7fbe7c143770 2023-12-12T10:12:57.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:57.293+0000 7fbe63fff640 1 -- 172.21.15.78:0/2036325087 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe7400fa90 con 0x7fbe7c143770 2023-12-12T10:12:57.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:57.293+0000 7fbe81c68640 1 -- 172.21.15.78:0/2036325087 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe7c0af020 con 0x7fbe7c143770 2023-12-12T10:12:57.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:57.293+0000 7fbe63fff640 1 -- 172.21.15.78:0/2036325087 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe7400fe60 con 0x7fbe7c143770 2023-12-12T10:12:57.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:57.293+0000 7fbe81c68640 1 -- 172.21.15.78:0/2036325087 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe7c1e70f0 con 0x7fbe7c143770 2023-12-12T10:12:57.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:57.293+0000 7fbe81c68640 1 -- 172.21.15.78:0/2036325087 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe7c0671f0 con 0x7fbe7c143770 2023-12-12T10:12:57.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:57.293+0000 7fbe63fff640 1 -- 172.21.15.78:0/2036325087 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fbe74015070 con 0x7fbe7c143770 2023-12-12T10:12:57.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:57.293+0000 7fbe63fff640 1 --2- 172.21.15.78:0/2036325087 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fbe68066470 0x7fbe68068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:57.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:57.293+0000 7fbe63fff640 1 -- 172.21.15.78:0/2036325087 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fbe740869c0 con 0x7fbe7c143770 2023-12-12T10:12:57.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:57.293+0000 7fbe7b7fe640 1 --2- 172.21.15.78:0/2036325087 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fbe68066470 0x7fbe68068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:57.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:57.297+0000 7fbe7b7fe640 1 --2- 172.21.15.78:0/2036325087 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fbe68066470 0x7fbe68068930 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fbe6c007fd0 tx=0x7fbe6c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:57.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:57.297+0000 7fbe63fff640 1 -- 172.21.15.78:0/2036325087 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fbe74053bc0 con 0x7fbe7c143770 2023-12-12T10:12:57.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:57.449+0000 7fbe81c68640 1 -- 172.21.15.78:0/2036325087 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fbe7c1e7340 con 0x7fbe7c143770 2023-12-12T10:12:57.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:57.453+0000 7fbe63fff640 1 -- 172.21.15.78:0/2036325087 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7fbe7c1e7340 con 0x7fbe7c143770 2023-12-12T10:12:57.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:57.457+0000 7fbe81c68640 1 -- 172.21.15.78:0/2036325087 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fbe68066470 msgr2=0x7fbe68068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:57.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:57.457+0000 7fbe81c68640 1 --2- 172.21.15.78:0/2036325087 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fbe68066470 0x7fbe68068930 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fbe6c007fd0 tx=0x7fbe6c009040 comp rx=0 tx=0).stop 2023-12-12T10:12:57.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:57.457+0000 7fbe81c68640 1 -- 172.21.15.78:0/2036325087 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbe7c143770 msgr2=0x7fbe7c159300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:57.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:57.457+0000 7fbe81c68640 1 --2- 172.21.15.78:0/2036325087 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbe7c143770 0x7fbe7c159300 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fbe7400e780 tx=0x7fbe7400ec40 comp rx=0 tx=0).stop 2023-12-12T10:12:57.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:57.457+0000 7fbe81c68640 1 -- 172.21.15.78:0/2036325087 shutdown_connections 2023-12-12T10:12:57.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:57.457+0000 7fbe81c68640 1 --2- 172.21.15.78:0/2036325087 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fbe68066470 0x7fbe68068930 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:57.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:57.457+0000 7fbe81c68640 1 --2- 172.21.15.78:0/2036325087 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbe7c143770 0x7fbe7c159300 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:57.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:57.457+0000 7fbe81c68640 1 --2- 172.21.15.78:0/2036325087 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbe7c0cdf60 0x7fbe7c1e6bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:57.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:57.457+0000 7fbe81c68640 1 --2- 172.21.15.78:0/2036325087 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbe7c071440 0x7fbe7c0af540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:57.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:57.457+0000 7fbe81c68640 1 -- 172.21.15.78:0/2036325087 >> 172.21.15.78:0/2036325087 conn(0x7fbe7c06a710 msgr2=0x7fbe7c15cd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:57.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:57.457+0000 7fbe81c68640 1 -- 172.21.15.78:0/2036325087 shutdown_connections 2023-12-12T10:12:57.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:57.457+0000 7fbe81c68640 1 -- 172.21.15.78:0/2036325087 wait complete. 2023-12-12T10:12:57.483 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-12T10:12:57.483 DEBUG:teuthology.orchestra.run.smithi078:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-12T10:12:57.574 DEBUG:teuthology.orchestra.run.smithi187:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-12T10:12:57.676 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-12T10:12:57.676 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-12-12T10:12:57.676 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-12T10:12:57.687 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-12-12T10:12:57.687 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-12T10:12:57.740 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T10:12:57.925 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:57.921+0000 7f5cf3a79640 1 Processor -- start 2023-12-12T10:12:57.926 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:57.921+0000 7f5cf3a79640 1 -- start start 2023-12-12T10:12:57.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:57.921+0000 7f5cf3a79640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f5cec0b3880 0x7f5cec0b3c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:57.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:57.921+0000 7f5cf3a79640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f5cec1621a0 0x7f5cec162620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:57.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:57.921+0000 7f5cf3a79640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cec0b41a0 con 0x7f5cec165070 2023-12-12T10:12:57.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:57.921+0000 7f5cf3a79640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cec0b20e0 con 0x7f5cec1621a0 2023-12-12T10:12:57.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:57.921+0000 7f5cf3a79640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cec0b23c0 con 0x7f5cec0b3880 2023-12-12T10:12:57.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:57.925+0000 7f5cf1014640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f5cec1621a0 0x7f5cec162620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:57.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:57.925+0000 7f5cf1014640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f5cec1621a0 0x7f5cec162620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59046/0 (socket says 172.21.15.78:59046) 2023-12-12T10:12:57.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:57.925+0000 7f5cf1014640 1 -- 172.21.15.78:0/2626910502 learned_addr learned my addr 172.21.15.78:0/2626910502 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:57.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:57.925+0000 7f5cf1815640 1 --2- 172.21.15.78:0/2626910502 >> v2:172.21.15.187:3300/0 conn(0x7f5cec0b3880 0x7f5cec0b3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:57.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:57.925+0000 7f5cf1014640 1 -- 172.21.15.78:0/2626910502 >> v2:172.21.15.187:3300/0 conn(0x7f5cec0b3880 msgr2=0x7f5cec0b3c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:57.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:57.925+0000 7f5cf1014640 1 --2- 172.21.15.78:0/2626910502 >> v2:172.21.15.187:3300/0 conn(0x7f5cec0b3880 0x7f5cec0b3c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:57.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:57.925+0000 7f5cf1014640 1 -- 172.21.15.78:0/2626910502 >> v1:172.21.15.187:6789/0 conn(0x7f5cec165070 legacy=0x7f5cec1654a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:57.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:57.925+0000 7f5cf1014640 1 -- 172.21.15.78:0/2626910502 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cec0b26a0 con 0x7f5cec1621a0 2023-12-12T10:12:57.930 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:57.925+0000 7f5cf1014640 1 --2- 172.21.15.78:0/2626910502 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5cec1621a0 0x7f5cec162620 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f5cec06e4d0 tx=0x7f5cdc01c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bf5aa5f8b33e580 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:57.931 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:57.925+0000 7f5cf0813640 1 -- 172.21.15.78:0/2626910502 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cdc0ac410 con 0x7f5cec1621a0 2023-12-12T10:12:57.931 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:57.925+0000 7f5cf0813640 1 -- 172.21.15.78:0/2626910502 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cdc0ac570 con 0x7f5cec1621a0 2023-12-12T10:12:57.931 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:57.925+0000 7f5cf0813640 1 -- 172.21.15.78:0/2626910502 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cdc0ac900 con 0x7f5cec1621a0 2023-12-12T10:12:57.932 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:57.929+0000 7f5cf3a79640 1 -- 172.21.15.78:0/2626910502 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5cec1621a0 msgr2=0x7f5cec162620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:57.932 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:57.929+0000 7f5cf3a79640 1 --2- 172.21.15.78:0/2626910502 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5cec1621a0 0x7f5cec162620 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f5cec06e4d0 tx=0x7f5cdc01c4c0 comp rx=0 tx=0).stop 2023-12-12T10:12:57.932 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:57.929+0000 7f5cf3a79640 1 -- 172.21.15.78:0/2626910502 shutdown_connections 2023-12-12T10:12:57.932 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:57.929+0000 7f5cf3a79640 1 --2- 172.21.15.78:0/2626910502 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5cec1621a0 0x7f5cec162620 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:57.932 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:57.929+0000 7f5cf3a79640 1 --2- 172.21.15.78:0/2626910502 >> v2:172.21.15.187:3300/0 conn(0x7f5cec0b3880 0x7f5cec0b3c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:57.932 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:57.929+0000 7f5cf3a79640 1 -- 172.21.15.78:0/2626910502 >> 172.21.15.78:0/2626910502 conn(0x7f5cec06c5d0 msgr2=0x7f5cec06c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:57.932 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:57.929+0000 7f5cf3a79640 1 -- 172.21.15.78:0/2626910502 shutdown_connections 2023-12-12T10:12:57.932 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:57.929+0000 7f5cf3a79640 1 -- 172.21.15.78:0/2626910502 wait complete. 2023-12-12T10:12:57.933 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:57.929+0000 7f5cf3a79640 1 Processor -- start 2023-12-12T10:12:57.933 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:57.929+0000 7f5cf3a79640 1 -- start start 2023-12-12T10:12:57.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:57.929+0000 7f5cf3a79640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5cec0b3880 0x7f5cec154070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:57.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:57.929+0000 7f5cf3a79640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5cec1621a0 0x7f5cec1501b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:57.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:57.929+0000 7f5cf3a79640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5cec165070 0x7f5cec153080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:57.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:57.929+0000 7f5cf3a79640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cec15b170 con 0x7f5cec165070 2023-12-12T10:12:57.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:57.929+0000 7f5cf3a79640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cec1545b0 con 0x7f5cec1621a0 2023-12-12T10:12:57.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:57.929+0000 7f5cf3a79640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cec159590 con 0x7f5cec0b3880 2023-12-12T10:12:57.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:57.929+0000 7f5cf2016640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5cec165070 0x7f5cec153080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:57.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:57.929+0000 7f5cf2016640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5cec165070 0x7f5cec153080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59052/0 (socket says 172.21.15.78:59052) 2023-12-12T10:12:57.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:57.929+0000 7f5cf2016640 1 -- 172.21.15.78:0/1519547713 learned_addr learned my addr 172.21.15.78:0/1519547713 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:57.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:57.929+0000 7f5cf1815640 1 --2- 172.21.15.78:0/1519547713 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5cec0b3880 0x7f5cec154070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:57.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:57.929+0000 7f5cf1014640 1 --2- 172.21.15.78:0/1519547713 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5cec1621a0 0x7f5cec1501b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:57.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:57.933+0000 7f5cf2016640 1 -- 172.21.15.78:0/1519547713 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5cec0b3880 msgr2=0x7f5cec154070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:57.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:57.933+0000 7f5cf2016640 1 --2- 172.21.15.78:0/1519547713 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5cec0b3880 0x7f5cec154070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:57.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:57.933+0000 7f5cf2016640 1 -- 172.21.15.78:0/1519547713 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5cec1621a0 msgr2=0x7f5cec1501b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:57.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:57.933+0000 7f5cf2016640 1 --2- 172.21.15.78:0/1519547713 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5cec1621a0 0x7f5cec1501b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:57.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:57.933+0000 7f5cf2016640 1 -- 172.21.15.78:0/1519547713 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cdc0094d0 con 0x7f5cec165070 2023-12-12T10:12:57.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:57.933+0000 7f5cf2016640 1 --2- 172.21.15.78:0/1519547713 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5cec165070 0x7f5cec153080 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f5ce400b970 tx=0x7f5ce400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:57.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:57.933+0000 7f5ce27fc640 1 -- 172.21.15.78:0/1519547713 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ce400cb40 con 0x7f5cec165070 2023-12-12T10:12:57.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:57.933+0000 7f5ce27fc640 1 -- 172.21.15.78:0/1519547713 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ce400cca0 con 0x7f5cec165070 2023-12-12T10:12:57.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:57.933+0000 7f5cf3a79640 1 -- 172.21.15.78:0/1519547713 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cec15abb0 con 0x7f5cec165070 2023-12-12T10:12:57.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:57.933+0000 7f5ce27fc640 1 -- 172.21.15.78:0/1519547713 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ce4014680 con 0x7f5cec165070 2023-12-12T10:12:57.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:57.933+0000 7f5cf3a79640 1 -- 172.21.15.78:0/1519547713 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cec152880 con 0x7f5cec165070 2023-12-12T10:12:57.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:57.933+0000 7f5cf3a79640 1 -- 172.21.15.78:0/1519547713 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cec0671f0 con 0x7f5cec165070 2023-12-12T10:12:57.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:57.933+0000 7f5ce27fc640 1 -- 172.21.15.78:0/1519547713 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5ce401d3b0 con 0x7f5cec165070 2023-12-12T10:12:57.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:57.933+0000 7f5ce27fc640 1 --2- 172.21.15.78:0/1519547713 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f5cd0066470 0x7f5cd0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:57.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:57.933+0000 7f5ce27fc640 1 -- 172.21.15.78:0/1519547713 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f5ce4083ff0 con 0x7f5cec165070 2023-12-12T10:12:57.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:57.933+0000 7f5cf1815640 1 --2- 172.21.15.78:0/1519547713 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f5cd0066470 0x7f5cd0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:57.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:57.937+0000 7f5cf1815640 1 --2- 172.21.15.78:0/1519547713 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f5cd0066470 0x7f5cd0068930 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5ce8007a60 tx=0x7f5ce8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:57.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:57.937+0000 7f5ce27fc640 1 -- 172.21.15.78:0/1519547713 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5ce4051120 con 0x7f5cec165070 2023-12-12T10:12:58.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.089+0000 7f5cf3a79640 1 -- 172.21.15.78:0/1519547713 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5cec1526e0 con 0x7f5cec165070 2023-12-12T10:12:58.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.089+0000 7f5ce27fc640 1 -- 172.21.15.78:0/1519547713 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18701 (secure 0 0 0) 0x7f5cec1526e0 con 0x7f5cec165070 2023-12-12T10:12:58.098 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:12:58.098 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":26,"fsid":"fc81937c-bd26-483c-952b-d1324fcb0c9e","created":"2023-12-12T10:11:44.020214+0000","modified":"2023-12-12T10:12:50.919344+0000","last_up_change":"2023-12-12T10:11:56.278318+0000","last_in_change":"2023-12-12T10:11:46.553610+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T10:11:57.053584+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-12T10:12:07.454450+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-12T10:12:08.182909+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-12T10:12:11.977952+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"22dfdedf-5f6c-4b20-9f6c-30517a1db70a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6809","nonce":3345683600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6811","nonce":3345683600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6815","nonce":3345683600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6813","nonce":3345683600}]},"public_addr":"172.21.15.78:6809/3345683600","cluster_addr":"172.21.15.78:6811/3345683600","heartbeat_back_addr":"172.21.15.78:6815/3345683600","heartbeat_front_addr":"172.21.15.78:6813/3345683600","state":["exists","up"]},{"osd":1,"uuid":"be34a7f3-a69a-462e-9ddf-5e537448dba2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6801","nonce":962652768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6803","nonce":962652768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6807","nonce":962652768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6805","nonce":962652768}]},"public_addr":"172.21.15.78:6801/962652768","cluster_addr":"172.21.15.78:6803/962652768","heartbeat_back_addr":"172.21.15.78:6807/962652768","heartbeat_front_addr":"172.21.15.78:6805/962652768","state":["exists","up"]},{"osd":2,"uuid":"55b381de-5f56-4b14-80f7-e6e41e084a13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6818","nonce":2910206054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6822","nonce":2910206054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6829","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6831","nonce":2910206054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6826","nonce":2910206054}]},"public_addr":"172.21.15.78:6818/2910206054","cluster_addr":"172.21.15.78:6822/2910206054","heartbeat_back_addr":"172.21.15.78:6831/2910206054","heartbeat_front_addr":"172.21.15.78:6826/2910206054","state":["exists","up"]},{"osd":3,"uuid":"d7682de1-25cb-4cec-869f-8851c28b0e6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6819","nonce":3750796703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6821","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6823","nonce":3750796703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6830","nonce":3750796703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6825","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6827","nonce":3750796703}]},"public_addr":"172.21.15.78:6819/3750796703","cluster_addr":"172.21.15.78:6823/3750796703","heartbeat_back_addr":"172.21.15.78:6830/3750796703","heartbeat_front_addr":"172.21.15.78:6827/3750796703","state":["exists","up"]},{"osd":4,"uuid":"8279815a-d6c7-4199-871e-d28971b9dc07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6809","nonce":2944277204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6811","nonce":2944277204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6815","nonce":2944277204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6813","nonce":2944277204}]},"public_addr":"172.21.15.187:6809/2944277204","cluster_addr":"172.21.15.187:6811/2944277204","heartbeat_back_addr":"172.21.15.187:6815/2944277204","heartbeat_front_addr":"172.21.15.187:6813/2944277204","state":["exists","up"]},{"osd":5,"uuid":"0a714c65-f8ce-4340-968f-11a799677ef3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6801","nonce":185858620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6803","nonce":185858620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6807","nonce":185858620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6805","nonce":185858620}]},"public_addr":"172.21.15.187:6801/185858620","cluster_addr":"172.21.15.187:6803/185858620","heartbeat_back_addr":"172.21.15.187:6807/185858620","heartbeat_front_addr":"172.21.15.187:6805/185858620","state":["exists","up"]},{"osd":6,"uuid":"d0bba9ab-f7ee-449e-8999-1c0cf7e6d53c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6817","nonce":4213392126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6819","nonce":4213392126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6824","nonce":4213392126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6821","nonce":4213392126}]},"public_addr":"172.21.15.187:6817/4213392126","cluster_addr":"172.21.15.187:6819/4213392126","heartbeat_back_addr":"172.21.15.187:6824/4213392126","heartbeat_front_addr":"172.21.15.187:6821/4213392126","state":["exists","up"]},{"osd":7,"uuid":"efe5e0d9-2f87-4889-a27a-e2a95a632302","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6823","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6825","nonce":85774004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6827","nonce":85774004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6831","nonce":85774004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6829","nonce":85774004}]},"public_addr":"172.21.15.187:6825/85774004","cluster_addr":"172.21.15.187:6827/85774004","heartbeat_back_addr":"172.21.15.187:6831/85774004","heartbeat_front_addr":"172.21.15.187:6829/85774004","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.214447+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.448899+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.293107+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.564184+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.175026+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.097717+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.261141+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.287681+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.18","mappings":[{"from":3,"to":2}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.13","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T10:12:58.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.093+0000 7f5cf3a79640 1 -- 172.21.15.78:0/1519547713 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f5cd0066470 msgr2=0x7f5cd0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:58.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.093+0000 7f5cf3a79640 1 --2- 172.21.15.78:0/1519547713 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f5cd0066470 0x7f5cd0068930 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5ce8007a60 tx=0x7f5ce8008040 comp rx=0 tx=0).stop 2023-12-12T10:12:58.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.093+0000 7f5cf3a79640 1 -- 172.21.15.78:0/1519547713 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5cec165070 msgr2=0x7f5cec153080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:58.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.093+0000 7f5cf3a79640 1 --2- 172.21.15.78:0/1519547713 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5cec165070 0x7f5cec153080 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f5ce400b970 tx=0x7f5ce400be30 comp rx=0 tx=0).stop 2023-12-12T10:12:58.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.093+0000 7f5cf3a79640 1 -- 172.21.15.78:0/1519547713 shutdown_connections 2023-12-12T10:12:58.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.093+0000 7f5cf3a79640 1 --2- 172.21.15.78:0/1519547713 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f5cd0066470 0x7f5cd0068930 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:58.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.093+0000 7f5cf3a79640 1 --2- 172.21.15.78:0/1519547713 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5cec165070 0x7f5cec153080 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:58.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.093+0000 7f5cf3a79640 1 --2- 172.21.15.78:0/1519547713 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5cec1621a0 0x7f5cec1501b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:58.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.093+0000 7f5cf3a79640 1 --2- 172.21.15.78:0/1519547713 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5cec0b3880 0x7f5cec154070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:58.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.093+0000 7f5cf3a79640 1 -- 172.21.15.78:0/1519547713 >> 172.21.15.78:0/1519547713 conn(0x7f5cec06c5d0 msgr2=0x7f5cec072190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:58.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.093+0000 7f5cf3a79640 1 -- 172.21.15.78:0/1519547713 shutdown_connections 2023-12-12T10:12:58.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.093+0000 7f5cf3a79640 1 -- 172.21.15.78:0/1519547713 wait complete. 2023-12-12T10:12:58.116 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-12T10:11:57.053584+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-12T10:12:07.454450+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-12T10:12:08.182909+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-12T10:12:11.977952+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-12T10:12:58.117 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-12T10:12:58.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.253+0000 7f175a017640 1 Processor -- start 2023-12-12T10:12:58.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.253+0000 7f175a017640 1 -- start start 2023-12-12T10:12:58.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.253+0000 7f175a017640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f175406cf60 0x7f175415f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:58.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.253+0000 7f175a017640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f175415b390 0x7f175415b810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:58.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.257+0000 7f175a017640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17540cea30 con 0x7f17540cb4b0 2023-12-12T10:12:58.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.257+0000 7f175a017640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f175415bd50 con 0x7f175406cf60 2023-12-12T10:12:58.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.257+0000 7f175a017640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f175415bfc0 con 0x7f175415b390 2023-12-12T10:12:58.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.257+0000 7f17537fe640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f17540cb4b0 0x7f175406c850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:41536/0 (socket says 172.21.15.78:41536) 2023-12-12T10:12:58.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.257+0000 7f17537fe640 1 -- 172.21.15.78:0/3758291784 learned_addr learned my addr 172.21.15.78:0/3758291784 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-12-12T10:12:58.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.257+0000 7f1753fff640 1 --2- 172.21.15.78:0/3758291784 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f175415b390 0x7f175415b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:58.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.257+0000 7f1752ffd640 1 -- 172.21.15.78:0/3758291784 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 707335590 0 0) 0x7f17540cea30 con 0x7f17540cb4b0 2023-12-12T10:12:58.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.257+0000 7f174bfff640 1 --2- 172.21.15.78:0/3758291784 >> v2:172.21.15.187:3300/0 conn(0x7f175406cf60 0x7f175415f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:58.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.257+0000 7f1752ffd640 1 -- 172.21.15.78:0/3758291784 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1740003530 con 0x7f17540cb4b0 2023-12-12T10:12:58.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.257+0000 7f1752ffd640 1 -- 172.21.15.78:0/3758291784 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 419372742 0 0) 0x7f1740003530 con 0x7f17540cb4b0 2023-12-12T10:12:58.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.257+0000 7f1752ffd640 1 -- 172.21.15.78:0/3758291784 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f175415b390 msgr2=0x7f175415b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:58.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.257+0000 7f1752ffd640 1 --2- 172.21.15.78:0/3758291784 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f175415b390 0x7f175415b810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:58.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.257+0000 7f1752ffd640 1 -- 172.21.15.78:0/3758291784 >> v2:172.21.15.187:3300/0 conn(0x7f175406cf60 msgr2=0x7f175415f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:58.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.257+0000 7f1752ffd640 1 --2- 172.21.15.78:0/3758291784 >> v2:172.21.15.187:3300/0 conn(0x7f175406cf60 0x7f175415f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:58.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.257+0000 7f1752ffd640 1 -- 172.21.15.78:0/3758291784 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f175415c2a0 con 0x7f17540cb4b0 2023-12-12T10:12:58.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.257+0000 7f1752ffd640 1 -- 172.21.15.78:0/3758291784 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 465499599 0 0) 0x7f1744001680 con 0x7f17540cb4b0 2023-12-12T10:12:58.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.257+0000 7f1752ffd640 1 -- 172.21.15.78:0/3758291784 >> v1:172.21.15.78:6789/0 conn(0x7f17540cb4b0 legacy=0x7f175406c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:58.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.257+0000 7f1752ffd640 1 --2- 172.21.15.78:0/3758291784 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f175415b390 0x7f1740003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:58.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.257+0000 7f1752ffd640 1 --2- 172.21.15.78:0/3758291784 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1740003f50 0x7f17400047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:58.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.257+0000 7f1752ffd640 1 --2- 172.21.15.78:0/3758291784 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1740004d10 0x7f1740005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:58.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.257+0000 7f1752ffd640 1 -- 172.21.15.78:0/3758291784 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f175415bd50 con 0x7f1740004d10 2023-12-12T10:12:58.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.257+0000 7f1752ffd640 1 -- 172.21.15.78:0/3758291784 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f175415bfc0 con 0x7f1740003f50 2023-12-12T10:12:58.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.257+0000 7f1752ffd640 1 -- 172.21.15.78:0/3758291784 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f174000ba40 con 0x7f175415b390 2023-12-12T10:12:58.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.257+0000 7f1753fff640 1 --2- 172.21.15.78:0/3758291784 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1740004d10 0x7f1740005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:58.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.257+0000 7f17537fe640 1 --2- 172.21.15.78:0/3758291784 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f175415b390 0x7f1740003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:58.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.257+0000 7f174bfff640 1 --2- 172.21.15.78:0/3758291784 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1740003f50 0x7f17400047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:58.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.257+0000 7f1753fff640 1 -- 172.21.15.78:0/3758291784 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f175415b390 msgr2=0x7f1740003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:58.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.257+0000 7f1753fff640 1 --2- 172.21.15.78:0/3758291784 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f175415b390 0x7f1740003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:58.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.257+0000 7f1753fff640 1 -- 172.21.15.78:0/3758291784 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1740003f50 msgr2=0x7f17400047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:58.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.257+0000 7f1753fff640 1 --2- 172.21.15.78:0/3758291784 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1740003f50 0x7f17400047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:58.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.257+0000 7f1753fff640 1 -- 172.21.15.78:0/3758291784 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1740003530 con 0x7f1740004d10 2023-12-12T10:12:58.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.261+0000 7f1753fff640 1 --2- 172.21.15.78:0/3758291784 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1740004d10 0x7f1740005190 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f174c009fc0 tx=0x7f174c01cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8510dd5e18296b35 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:58.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.261+0000 7f1752ffd640 1 -- 172.21.15.78:0/3758291784 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f174c0a5b60 con 0x7f1740004d10 2023-12-12T10:12:58.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.261+0000 7f1752ffd640 1 -- 172.21.15.78:0/3758291784 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f174c00f040 con 0x7f1740004d10 2023-12-12T10:12:58.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.261+0000 7f1752ffd640 1 -- 172.21.15.78:0/3758291784 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f174c0ad440 con 0x7f1740004d10 2023-12-12T10:12:58.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.261+0000 7f175a017640 1 -- 172.21.15.78:0/3758291784 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1740004d10 msgr2=0x7f1740005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:58.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.261+0000 7f175a017640 1 --2- 172.21.15.78:0/3758291784 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1740004d10 0x7f1740005190 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f174c009fc0 tx=0x7f174c01cc60 comp rx=0 tx=0).stop 2023-12-12T10:12:58.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.261+0000 7f1753fff640 1 -- 172.21.15.78:0/3758291784 reap_dead start 2023-12-12T10:12:58.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.261+0000 7f175a017640 1 -- 172.21.15.78:0/3758291784 shutdown_connections 2023-12-12T10:12:58.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.261+0000 7f175a017640 1 -- 172.21.15.78:0/3758291784 >> 172.21.15.78:0/3758291784 conn(0x7f175406a710 msgr2=0x7f175406ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:58.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.261+0000 7f175a017640 1 -- 172.21.15.78:0/3758291784 shutdown_connections 2023-12-12T10:12:58.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.261+0000 7f175a017640 1 -- 172.21.15.78:0/3758291784 wait complete. 2023-12-12T10:12:58.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.261+0000 7f175a017640 1 Processor -- start 2023-12-12T10:12:58.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.261+0000 7f175a017640 1 -- start start 2023-12-12T10:12:58.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.265+0000 7f175a017640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1740004d10 0x7f17541447c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:58.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.265+0000 7f175a017640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f17540b18f0 0x7f17540b1040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:58.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.265+0000 7f175a017640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1754146e10 0x7f17541472c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:58.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.265+0000 7f175a017640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17541ee650 con 0x7f1754146e10 2023-12-12T10:12:58.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.265+0000 7f175a017640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1754144d00 con 0x7f17540b18f0 2023-12-12T10:12:58.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.265+0000 7f175a017640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17540b1df0 con 0x7f1740004d10 2023-12-12T10:12:58.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.265+0000 7f1753fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1754146e10 0x7f17541472c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:58.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.265+0000 7f17537fe640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1740004d10 0x7f17541447c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:58.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.265+0000 7f17537fe640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1740004d10 0x7f17541447c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.78:59546/0 (socket says 172.21.15.78:59546) 2023-12-12T10:12:58.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.265+0000 7f1753fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1754146e10 0x7f17541472c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59076/0 (socket says 172.21.15.78:59076) 2023-12-12T10:12:58.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.265+0000 7f17537fe640 1 -- 172.21.15.78:0/2186538626 learned_addr learned my addr 172.21.15.78:0/2186538626 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:58.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.265+0000 7f174bfff640 1 --2- 172.21.15.78:0/2186538626 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f17540b18f0 0x7f17540b1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:58.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.265+0000 7f1753fff640 1 -- 172.21.15.78:0/2186538626 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1740004d10 msgr2=0x7f17541447c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:58.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.265+0000 7f1753fff640 1 --2- 172.21.15.78:0/2186538626 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1740004d10 0x7f17541447c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:58.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.265+0000 7f1753fff640 1 -- 172.21.15.78:0/2186538626 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f17540b18f0 msgr2=0x7f17540b1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:58.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.265+0000 7f1753fff640 1 --2- 172.21.15.78:0/2186538626 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f17540b18f0 0x7f17540b1040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:58.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.265+0000 7f1753fff640 1 -- 172.21.15.78:0/2186538626 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17540b20d0 con 0x7f1754146e10 2023-12-12T10:12:58.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.265+0000 7f1753fff640 1 --2- 172.21.15.78:0/2186538626 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1754146e10 0x7f17541472c0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f174c0ac000 tx=0x7f174c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:58.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.265+0000 7f1750ff9640 1 -- 172.21.15.78:0/2186538626 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f174c0ba070 con 0x7f1754146e10 2023-12-12T10:12:58.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.265+0000 7f1750ff9640 1 -- 172.21.15.78:0/2186538626 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f174c0039a0 con 0x7f1754146e10 2023-12-12T10:12:58.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.265+0000 7f1750ff9640 1 -- 172.21.15.78:0/2186538626 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f174c003b10 con 0x7f1754146e10 2023-12-12T10:12:58.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.265+0000 7f175a017640 1 -- 172.21.15.78:0/2186538626 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17540b23b0 con 0x7f1754146e10 2023-12-12T10:12:58.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.265+0000 7f175a017640 1 -- 172.21.15.78:0/2186538626 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17540b1580 con 0x7f1754146e10 2023-12-12T10:12:58.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.265+0000 7f175a017640 1 -- 172.21.15.78:0/2186538626 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17540671f0 con 0x7f1754146e10 2023-12-12T10:12:58.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.265+0000 7f1750ff9640 1 -- 172.21.15.78:0/2186538626 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f174c0b4040 con 0x7f1754146e10 2023-12-12T10:12:58.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.269+0000 7f1750ff9640 1 --2- 172.21.15.78:0/2186538626 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f17340664a0 0x7f1734068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:58.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.269+0000 7f1750ff9640 1 -- 172.21.15.78:0/2186538626 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f174c11e180 con 0x7f1754146e10 2023-12-12T10:12:58.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.269+0000 7f17537fe640 1 --2- 172.21.15.78:0/2186538626 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f17340664a0 0x7f1734068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:58.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.269+0000 7f17537fe640 1 --2- 172.21.15.78:0/2186538626 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f17340664a0 0x7f1734068960 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f1744000fc0 tx=0x7f1744001e10 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:58.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.273+0000 7f1750ff9640 1 -- 172.21.15.78:0/2186538626 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f174c0eb2f0 con 0x7f1754146e10 2023-12-12T10:12:58.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.421+0000 7f175a017640 1 -- 172.21.15.78:0/2186538626 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f17541ee790 con 0x7f1754146e10 2023-12-12T10:12:58.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.421+0000 7f1750ff9640 1 -- 172.21.15.78:0/2186538626 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f17541ee790 con 0x7f1754146e10 2023-12-12T10:12:58.426 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2023-12-12T10:12:58.428 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.425+0000 7f175a017640 1 -- 172.21.15.78:0/2186538626 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f17340664a0 msgr2=0x7f1734068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:58.428 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.425+0000 7f175a017640 1 --2- 172.21.15.78:0/2186538626 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f17340664a0 0x7f1734068960 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f1744000fc0 tx=0x7f1744001e10 comp rx=0 tx=0).stop 2023-12-12T10:12:58.428 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.425+0000 7f175a017640 1 -- 172.21.15.78:0/2186538626 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1754146e10 msgr2=0x7f17541472c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:58.428 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.425+0000 7f175a017640 1 --2- 172.21.15.78:0/2186538626 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1754146e10 0x7f17541472c0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f174c0ac000 tx=0x7f174c009750 comp rx=0 tx=0).stop 2023-12-12T10:12:58.428 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.425+0000 7f175a017640 1 -- 172.21.15.78:0/2186538626 shutdown_connections 2023-12-12T10:12:58.428 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.425+0000 7f175a017640 1 --2- 172.21.15.78:0/2186538626 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f17340664a0 0x7f1734068960 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:58.428 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.425+0000 7f175a017640 1 --2- 172.21.15.78:0/2186538626 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1754146e10 0x7f17541472c0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:58.428 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.425+0000 7f175a017640 1 --2- 172.21.15.78:0/2186538626 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f17540b18f0 0x7f17540b1040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:58.428 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.425+0000 7f175a017640 1 --2- 172.21.15.78:0/2186538626 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1740004d10 0x7f17541447c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:58.428 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.425+0000 7f175a017640 1 -- 172.21.15.78:0/2186538626 >> 172.21.15.78:0/2186538626 conn(0x7f175406a710 msgr2=0x7f175415df50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:58.428 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.425+0000 7f175a017640 1 -- 172.21.15.78:0/2186538626 shutdown_connections 2023-12-12T10:12:58.428 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.425+0000 7f175a017640 1 -- 172.21.15.78:0/2186538626 wait complete. 2023-12-12T10:12:58.447 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-12T10:12:58.586 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.581+0000 7f8ed566b640 1 Processor -- start 2023-12-12T10:12:58.586 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.581+0000 7f8ed566b640 1 -- start start 2023-12-12T10:12:58.588 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.585+0000 7f8ed566b640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8ed0071a20 0x7f8ed0071eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:58.588 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.585+0000 7f8ed566b640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f8ed015b390 0x7f8ed015b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:58.588 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.585+0000 7f8ed566b640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ed00b4100 con 0x7f8ed0144600 2023-12-12T10:12:58.588 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.585+0000 7f8ed566b640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ed00723f0 con 0x7f8ed0071a20 2023-12-12T10:12:58.588 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.585+0000 7f8ed566b640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ed00b3250 con 0x7f8ed015b390 2023-12-12T10:12:58.588 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.585+0000 7f8ec67fc640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8ed0071a20 0x7f8ed0071eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:58.588 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.585+0000 7f8ec67fc640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8ed0071a20 0x7f8ed0071eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59086/0 (socket says 172.21.15.78:59086) 2023-12-12T10:12:58.588 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.585+0000 7f8ec67fc640 1 -- 172.21.15.78:0/1699916843 learned_addr learned my addr 172.21.15.78:0/1699916843 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:58.589 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.585+0000 7f8ecf7fe640 1 --2- 172.21.15.78:0/1699916843 >> v2:172.21.15.187:3300/0 conn(0x7f8ed015b390 0x7f8ed015b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:58.589 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.585+0000 7f8ec67fc640 1 -- 172.21.15.78:0/1699916843 >> v2:172.21.15.187:3300/0 conn(0x7f8ed015b390 msgr2=0x7f8ed015b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:58.589 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.585+0000 7f8ec67fc640 1 --2- 172.21.15.78:0/1699916843 >> v2:172.21.15.187:3300/0 conn(0x7f8ed015b390 0x7f8ed015b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:58.589 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.585+0000 7f8ec67fc640 1 -- 172.21.15.78:0/1699916843 >> v1:172.21.15.187:6789/0 conn(0x7f8ed0144600 legacy=0x7f8ed0070b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:58.589 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.585+0000 7f8ec67fc640 1 -- 172.21.15.78:0/1699916843 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ed0071220 con 0x7f8ed0071a20 2023-12-12T10:12:58.591 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.589+0000 7f8ec67fc640 1 --2- 172.21.15.78:0/1699916843 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ed0071a20 0x7f8ed0071eb0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f8ed00b4070 tx=0x7f8eb801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b99d830cc19a5458 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:58.591 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.589+0000 7f8ece7fc640 1 -- 172.21.15.78:0/1699916843 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eb80aa5f0 con 0x7f8ed0071a20 2023-12-12T10:12:58.591 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.589+0000 7f8ece7fc640 1 -- 172.21.15.78:0/1699916843 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8eb80aa750 con 0x7f8ed0071a20 2023-12-12T10:12:58.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.589+0000 7f8ece7fc640 1 -- 172.21.15.78:0/1699916843 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eb80aaae0 con 0x7f8ed0071a20 2023-12-12T10:12:58.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.589+0000 7f8ed566b640 1 -- 172.21.15.78:0/1699916843 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ed0071a20 msgr2=0x7f8ed0071eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:58.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.589+0000 7f8ed566b640 1 --2- 172.21.15.78:0/1699916843 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ed0071a20 0x7f8ed0071eb0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f8ed00b4070 tx=0x7f8eb801c490 comp rx=0 tx=0).stop 2023-12-12T10:12:58.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.589+0000 7f8ed566b640 1 -- 172.21.15.78:0/1699916843 shutdown_connections 2023-12-12T10:12:58.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.589+0000 7f8ed566b640 1 --2- 172.21.15.78:0/1699916843 >> v2:172.21.15.187:3300/0 conn(0x7f8ed015b390 0x7f8ed015b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:58.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.589+0000 7f8ed566b640 1 --2- 172.21.15.78:0/1699916843 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ed0071a20 0x7f8ed0071eb0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:58.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.589+0000 7f8ed566b640 1 -- 172.21.15.78:0/1699916843 >> 172.21.15.78:0/1699916843 conn(0x7f8ed00b0750 msgr2=0x7f8ed00b0b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:58.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.589+0000 7f8ed566b640 1 -- 172.21.15.78:0/1699916843 shutdown_connections 2023-12-12T10:12:58.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.589+0000 7f8ed566b640 1 -- 172.21.15.78:0/1699916843 wait complete. 2023-12-12T10:12:58.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.589+0000 7f8ed566b640 1 Processor -- start 2023-12-12T10:12:58.594 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.589+0000 7f8ed566b640 1 -- start start 2023-12-12T10:12:58.596 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.589+0000 7f8ed566b640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8ed0071a20 0x7f8ed01588b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:58.596 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.593+0000 7f8ed566b640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8ed0144600 0x7f8ed01590c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:58.596 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.593+0000 7f8ed566b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ed015b390 0x7f8ed0160170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:58.596 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.593+0000 7f8ed566b640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed0159a30 con 0x7f8ed015b390 2023-12-12T10:12:58.596 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.593+0000 7f8ed566b640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed0159d10 con 0x7f8ed0144600 2023-12-12T10:12:58.596 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.593+0000 7f8ed566b640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed0159ff0 con 0x7f8ed0071a20 2023-12-12T10:12:58.596 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.593+0000 7f8ecf7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ed015b390 0x7f8ed0160170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:58.596 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.593+0000 7f8ecf7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ed015b390 0x7f8ed0160170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59094/0 (socket says 172.21.15.78:59094) 2023-12-12T10:12:58.596 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.593+0000 7f8ecf7fe640 1 -- 172.21.15.78:0/2035500578 learned_addr learned my addr 172.21.15.78:0/2035500578 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:58.596 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.593+0000 7f8ec67fc640 1 --2- 172.21.15.78:0/2035500578 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8ed0144600 0x7f8ed01590c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:58.596 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.593+0000 7f8eceffd640 1 --2- 172.21.15.78:0/2035500578 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8ed0071a20 0x7f8ed01588b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:58.596 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.593+0000 7f8ecf7fe640 1 -- 172.21.15.78:0/2035500578 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8ed0071a20 msgr2=0x7f8ed01588b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:58.596 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.593+0000 7f8ecf7fe640 1 --2- 172.21.15.78:0/2035500578 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8ed0071a20 0x7f8ed01588b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:58.596 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.593+0000 7f8ecf7fe640 1 -- 172.21.15.78:0/2035500578 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8ed0144600 msgr2=0x7f8ed01590c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:58.597 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.593+0000 7f8ecf7fe640 1 --2- 172.21.15.78:0/2035500578 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8ed0144600 0x7f8ed01590c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:58.597 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.593+0000 7f8ecf7fe640 1 -- 172.21.15.78:0/2035500578 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8eb80094d0 con 0x7f8ed015b390 2023-12-12T10:12:58.597 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.593+0000 7f8ecf7fe640 1 --2- 172.21.15.78:0/2035500578 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ed015b390 0x7f8ed0160170 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f8ec8007e60 tx=0x7f8ec800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:58.598 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.593+0000 7f8ec7fff640 1 -- 172.21.15.78:0/2035500578 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec8014420 con 0x7f8ed015b390 2023-12-12T10:12:58.598 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.593+0000 7f8ec7fff640 1 -- 172.21.15.78:0/2035500578 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ec80145a0 con 0x7f8ed015b390 2023-12-12T10:12:58.598 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.593+0000 7f8ec7fff640 1 -- 172.21.15.78:0/2035500578 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec8014950 con 0x7f8ed015b390 2023-12-12T10:12:58.598 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.593+0000 7f8ed566b640 1 -- 172.21.15.78:0/2035500578 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ed015a2d0 con 0x7f8ed015b390 2023-12-12T10:12:58.598 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.593+0000 7f8ed566b640 1 -- 172.21.15.78:0/2035500578 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ed0158df0 con 0x7f8ed015b390 2023-12-12T10:12:58.598 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.593+0000 7f8ed566b640 1 -- 172.21.15.78:0/2035500578 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ed00671f0 con 0x7f8ed015b390 2023-12-12T10:12:58.599 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.593+0000 7f8ec7fff640 1 -- 172.21.15.78:0/2035500578 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f8ec8014ab0 con 0x7f8ed015b390 2023-12-12T10:12:58.599 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.597+0000 7f8ec7fff640 1 --2- 172.21.15.78:0/2035500578 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f8eb00664a0 0x7f8eb0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:58.599 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.597+0000 7f8ec7fff640 1 -- 172.21.15.78:0/2035500578 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f8ec8084a50 con 0x7f8ed015b390 2023-12-12T10:12:58.600 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.597+0000 7f8eceffd640 1 --2- 172.21.15.78:0/2035500578 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f8eb00664a0 0x7f8eb0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:58.600 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.597+0000 7f8eceffd640 1 --2- 172.21.15.78:0/2035500578 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f8eb00664a0 0x7f8eb0068960 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f8ec0007fd0 tx=0x7f8ec0007e40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:58.603 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.597+0000 7f8ec7fff640 1 -- 172.21.15.78:0/2035500578 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8ec8051b30 con 0x7f8ed015b390 2023-12-12T10:12:58.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.749+0000 7f8ed566b640 1 -- 172.21.15.78:0/2035500578 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8ed00b4570 con 0x7f8ed015b390 2023-12-12T10:12:58.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.749+0000 7f8ec7fff640 1 -- 172.21.15.78:0/2035500578 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8ed00b4570 con 0x7f8ed015b390 2023-12-12T10:12:58.753 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2023-12-12T10:12:58.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.749+0000 7f8ed566b640 1 -- 172.21.15.78:0/2035500578 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f8eb00664a0 msgr2=0x7f8eb0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:58.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.749+0000 7f8ed566b640 1 --2- 172.21.15.78:0/2035500578 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f8eb00664a0 0x7f8eb0068960 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f8ec0007fd0 tx=0x7f8ec0007e40 comp rx=0 tx=0).stop 2023-12-12T10:12:58.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.749+0000 7f8ed566b640 1 -- 172.21.15.78:0/2035500578 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ed015b390 msgr2=0x7f8ed0160170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:58.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.749+0000 7f8ed566b640 1 --2- 172.21.15.78:0/2035500578 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ed015b390 0x7f8ed0160170 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f8ec8007e60 tx=0x7f8ec800e4b0 comp rx=0 tx=0).stop 2023-12-12T10:12:58.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.749+0000 7f8ed566b640 1 -- 172.21.15.78:0/2035500578 shutdown_connections 2023-12-12T10:12:58.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.749+0000 7f8ed566b640 1 --2- 172.21.15.78:0/2035500578 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f8eb00664a0 0x7f8eb0068960 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:58.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.749+0000 7f8ed566b640 1 --2- 172.21.15.78:0/2035500578 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ed015b390 0x7f8ed0160170 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:58.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.749+0000 7f8ed566b640 1 --2- 172.21.15.78:0/2035500578 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8ed0144600 0x7f8ed01590c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:58.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.749+0000 7f8ed566b640 1 --2- 172.21.15.78:0/2035500578 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8ed0071a20 0x7f8ed01588b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:58.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.749+0000 7f8ed566b640 1 -- 172.21.15.78:0/2035500578 >> 172.21.15.78:0/2035500578 conn(0x7f8ed00b0750 msgr2=0x7f8ed006ca60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:58.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.753+0000 7f8ed566b640 1 -- 172.21.15.78:0/2035500578 shutdown_connections 2023-12-12T10:12:58.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.753+0000 7f8ed566b640 1 -- 172.21.15.78:0/2035500578 wait complete. 2023-12-12T10:12:58.774 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-12T10:12:58.914 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.909+0000 7fcb1fb1d640 1 Processor -- start 2023-12-12T10:12:58.914 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.909+0000 7fcb1fb1d640 1 -- start start 2023-12-12T10:12:58.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.913+0000 7fcb1fb1d640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fcb1806cf60 0x7fcb1815f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:58.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.913+0000 7fcb1fb1d640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb180cea30 con 0x7fcb1815b390 2023-12-12T10:12:58.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.913+0000 7fcb1fb1d640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb1815bfc0 con 0x7fcb180cb4b0 2023-12-12T10:12:58.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.913+0000 7fcb1fb1d640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb1815c2a0 con 0x7fcb1806cf60 2023-12-12T10:12:58.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.913+0000 7fcb1e0ba640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fcb1815b390 0x7fcb180714e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:41548/0 (socket says 172.21.15.78:41548) 2023-12-12T10:12:58.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.913+0000 7fcb1e0ba640 1 -- 172.21.15.78:0/3722836089 learned_addr learned my addr 172.21.15.78:0/3722836089 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-12-12T10:12:58.916 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.913+0000 7fcb1d0b8640 1 --2- 172.21.15.78:0/3722836089 >> v2:172.21.15.187:3300/0 conn(0x7fcb1806cf60 0x7fcb1815f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:58.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.913+0000 7fcb1c8b7640 1 -- 172.21.15.78:0/3722836089 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 843043293 0 0) 0x7fcb180cea30 con 0x7fcb1815b390 2023-12-12T10:12:58.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.913+0000 7fcb1c8b7640 1 -- 172.21.15.78:0/3722836089 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb04003530 con 0x7fcb1815b390 2023-12-12T10:12:58.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.913+0000 7fcb1d0b8640 1 -- 172.21.15.78:0/3722836089 >> v1:172.21.15.187:6789/0 conn(0x7fcb180cb4b0 legacy=0x7fcb1806c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:58.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.913+0000 7fcb1d0b8640 1 -- 172.21.15.78:0/3722836089 >> v1:172.21.15.78:6789/0 conn(0x7fcb1815b390 legacy=0x7fcb180714e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:58.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.913+0000 7fcb1d0b8640 1 -- 172.21.15.78:0/3722836089 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb1815ea20 con 0x7fcb1806cf60 2023-12-12T10:12:58.920 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.917+0000 7fcb1d0b8640 1 --2- 172.21.15.78:0/3722836089 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcb1806cf60 0x7fcb1815f500 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fcb080097c0 tx=0x7fcb0801c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4fa48f033ac13828 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:58.920 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.917+0000 7fcb1c8b7640 1 -- 172.21.15.78:0/3722836089 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb080ac620 con 0x7fcb1806cf60 2023-12-12T10:12:58.920 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.917+0000 7fcb1c8b7640 1 -- 172.21.15.78:0/3722836089 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb080ac780 con 0x7fcb1806cf60 2023-12-12T10:12:58.920 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.917+0000 7fcb1c8b7640 1 -- 172.21.15.78:0/3722836089 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb080acb10 con 0x7fcb1806cf60 2023-12-12T10:12:58.921 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.917+0000 7fcb1fb1d640 1 -- 172.21.15.78:0/3722836089 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcb1806cf60 msgr2=0x7fcb1815f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:58.921 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.917+0000 7fcb1fb1d640 1 --2- 172.21.15.78:0/3722836089 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcb1806cf60 0x7fcb1815f500 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fcb080097c0 tx=0x7fcb0801c3c0 comp rx=0 tx=0).stop 2023-12-12T10:12:58.921 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.917+0000 7fcb1fb1d640 1 -- 172.21.15.78:0/3722836089 shutdown_connections 2023-12-12T10:12:58.921 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.917+0000 7fcb1fb1d640 1 --2- 172.21.15.78:0/3722836089 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcb1806cf60 0x7fcb1815f500 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:58.921 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.917+0000 7fcb1fb1d640 1 -- 172.21.15.78:0/3722836089 >> 172.21.15.78:0/3722836089 conn(0x7fcb1806a710 msgr2=0x7fcb1806ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:58.921 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.917+0000 7fcb1fb1d640 1 -- 172.21.15.78:0/3722836089 shutdown_connections 2023-12-12T10:12:58.921 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.917+0000 7fcb1fb1d640 1 -- 172.21.15.78:0/3722836089 wait complete. 2023-12-12T10:12:58.922 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.917+0000 7fcb1fb1d640 1 Processor -- start 2023-12-12T10:12:58.922 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.917+0000 7fcb1fb1d640 1 -- start start 2023-12-12T10:12:58.925 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.921+0000 7fcb1fb1d640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcb1806cf60 0x7fcb1815dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:58.925 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.921+0000 7fcb1fb1d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcb180cb4b0 0x7fcb18146fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:58.925 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.921+0000 7fcb1fb1d640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcb1815b390 0x7fcb18150780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:58.925 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.921+0000 7fcb1fb1d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb18149bd0 con 0x7fcb180cb4b0 2023-12-12T10:12:58.925 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.921+0000 7fcb1fb1d640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb1815e4c0 con 0x7fcb1815b390 2023-12-12T10:12:58.925 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.921+0000 7fcb1fb1d640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb18149230 con 0x7fcb1806cf60 2023-12-12T10:12:58.925 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.921+0000 7fcb1d0b8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcb180cb4b0 0x7fcb18146fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:58.925 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.921+0000 7fcb1d0b8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcb180cb4b0 0x7fcb18146fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:59106/0 (socket says 172.21.15.78:59106) 2023-12-12T10:12:58.925 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.921+0000 7fcb1d0b8640 1 -- 172.21.15.78:0/3142412439 learned_addr learned my addr 172.21.15.78:0/3142412439 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:58.925 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.921+0000 7fcb1e0ba640 1 --2- 172.21.15.78:0/3142412439 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcb1815b390 0x7fcb18150780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:58.926 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.921+0000 7fcb1d8b9640 1 --2- 172.21.15.78:0/3142412439 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcb1806cf60 0x7fcb1815dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:58.926 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.921+0000 7fcb1d0b8640 1 -- 172.21.15.78:0/3142412439 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcb1806cf60 msgr2=0x7fcb1815dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:58.926 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.921+0000 7fcb1d0b8640 1 --2- 172.21.15.78:0/3142412439 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcb1806cf60 0x7fcb1815dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:58.926 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.921+0000 7fcb1d0b8640 1 -- 172.21.15.78:0/3142412439 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcb1815b390 msgr2=0x7fcb18150780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:58.926 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.921+0000 7fcb1d0b8640 1 --2- 172.21.15.78:0/3142412439 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcb1815b390 0x7fcb18150780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:58.926 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.921+0000 7fcb1d0b8640 1 -- 172.21.15.78:0/3142412439 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb08009420 con 0x7fcb180cb4b0 2023-12-12T10:12:58.926 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.921+0000 7fcb1d0b8640 1 --2- 172.21.15.78:0/3142412439 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcb180cb4b0 0x7fcb18146fa0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fcb08018fd0 tx=0x7fcb08019160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:58.926 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.921+0000 7fcb0e7fc640 1 -- 172.21.15.78:0/3142412439 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb080b5410 con 0x7fcb180cb4b0 2023-12-12T10:12:58.926 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.921+0000 7fcb0e7fc640 1 -- 172.21.15.78:0/3142412439 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb080b5590 con 0x7fcb180cb4b0 2023-12-12T10:12:58.926 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.921+0000 7fcb1fb1d640 1 -- 172.21.15.78:0/3142412439 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb18149510 con 0x7fcb180cb4b0 2023-12-12T10:12:58.926 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.921+0000 7fcb0e7fc640 1 -- 172.21.15.78:0/3142412439 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb080b5940 con 0x7fcb180cb4b0 2023-12-12T10:12:58.926 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.921+0000 7fcb1fb1d640 1 -- 172.21.15.78:0/3142412439 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb181474e0 con 0x7fcb180cb4b0 2023-12-12T10:12:58.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.921+0000 7fcb1fb1d640 1 -- 172.21.15.78:0/3142412439 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb180671f0 con 0x7fcb180cb4b0 2023-12-12T10:12:58.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.925+0000 7fcb0e7fc640 1 -- 172.21.15.78:0/3142412439 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fcb080b3040 con 0x7fcb180cb4b0 2023-12-12T10:12:58.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.925+0000 7fcb0e7fc640 1 --2- 172.21.15.78:0/3142412439 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fcafc066470 0x7fcafc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:58.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.925+0000 7fcb0e7fc640 1 -- 172.21.15.78:0/3142412439 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fcb0811e3c0 con 0x7fcb180cb4b0 2023-12-12T10:12:58.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.925+0000 7fcb1d8b9640 1 --2- 172.21.15.78:0/3142412439 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fcafc066470 0x7fcafc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:58.929 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.925+0000 7fcb1d8b9640 1 --2- 172.21.15.78:0/3142412439 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fcafc066470 0x7fcafc068930 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fcb14007fd0 tx=0x7fcb14009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:58.932 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:58.929+0000 7fcb0e7fc640 1 -- 172.21.15.78:0/3142412439 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fcb080eb520 con 0x7fcb180cb4b0 2023-12-12T10:12:59.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.081+0000 7fcb1fb1d640 1 -- 172.21.15.78:0/3142412439 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fcb18149d10 con 0x7fcb180cb4b0 2023-12-12T10:12:59.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.081+0000 7fcb0e7fc640 1 -- 172.21.15.78:0/3142412439 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7fcb080eeb40 con 0x7fcb180cb4b0 2023-12-12T10:12:59.086 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2023-12-12T10:12:59.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.085+0000 7fcb1fb1d640 1 -- 172.21.15.78:0/3142412439 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fcafc066470 msgr2=0x7fcafc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:59.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.085+0000 7fcb1fb1d640 1 --2- 172.21.15.78:0/3142412439 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fcafc066470 0x7fcafc068930 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fcb14007fd0 tx=0x7fcb14009040 comp rx=0 tx=0).stop 2023-12-12T10:12:59.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.085+0000 7fcb1fb1d640 1 -- 172.21.15.78:0/3142412439 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcb180cb4b0 msgr2=0x7fcb18146fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:59.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.085+0000 7fcb1fb1d640 1 --2- 172.21.15.78:0/3142412439 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcb180cb4b0 0x7fcb18146fa0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fcb08018fd0 tx=0x7fcb08019160 comp rx=0 tx=0).stop 2023-12-12T10:12:59.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.085+0000 7fcb1fb1d640 1 -- 172.21.15.78:0/3142412439 shutdown_connections 2023-12-12T10:12:59.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.085+0000 7fcb1fb1d640 1 --2- 172.21.15.78:0/3142412439 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fcafc066470 0x7fcafc068930 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:59.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.085+0000 7fcb1fb1d640 1 --2- 172.21.15.78:0/3142412439 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcb1815b390 0x7fcb18150780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:59.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.085+0000 7fcb1fb1d640 1 --2- 172.21.15.78:0/3142412439 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcb180cb4b0 0x7fcb18146fa0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:59.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.085+0000 7fcb1fb1d640 1 --2- 172.21.15.78:0/3142412439 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcb1806cf60 0x7fcb1815dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:59.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.085+0000 7fcb1fb1d640 1 -- 172.21.15.78:0/3142412439 >> 172.21.15.78:0/3142412439 conn(0x7fcb1806a710 msgr2=0x7fcb1806c850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:59.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.085+0000 7fcb1fb1d640 1 -- 172.21.15.78:0/3142412439 shutdown_connections 2023-12-12T10:12:59.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.085+0000 7fcb1fb1d640 1 -- 172.21.15.78:0/3142412439 wait complete. 2023-12-12T10:12:59.106 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-12T10:12:59.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.245+0000 7f251af76640 1 Processor -- start 2023-12-12T10:12:59.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.245+0000 7f251af76640 1 -- start start 2023-12-12T10:12:59.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.245+0000 7f251af76640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f251415f320 0x7f25140cceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:59.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.245+0000 7f251af76640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f25140cec10 0x7f25140cf080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:59.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.245+0000 7f251af76640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25140cd3f0 con 0x7f25141444c0 2023-12-12T10:12:59.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.245+0000 7f251af76640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f251415b8b0 con 0x7f25140cec10 2023-12-12T10:12:59.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.245+0000 7f251af76640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25140cf5c0 con 0x7f251415f320 2023-12-12T10:12:59.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.249+0000 7f2519773640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f251415f320 0x7f25140cceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:59.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.249+0000 7f251a775640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f25140cec10 0x7f25140cf080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:59.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.249+0000 7f251a775640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f25140cec10 0x7f25140cf080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.78:50674/0 (socket says 172.21.15.78:50674) 2023-12-12T10:12:59.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.249+0000 7f2519f74640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f25141444c0 0x7f251415b1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.78:54870/0 (socket says 172.21.15.78:54870) 2023-12-12T10:12:59.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.249+0000 7f2519773640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f251415f320 0x7f25140cceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.78:40266/0 (socket says 172.21.15.78:40266) 2023-12-12T10:12:59.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.249+0000 7f251a775640 1 -- 172.21.15.78:0/1048398759 learned_addr learned my addr 172.21.15.78:0/1048398759 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:59.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.249+0000 7f2518f72640 1 -- 172.21.15.78:0/1048398759 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 400262275 0 0) 0x7f25140cd3f0 con 0x7f25141444c0 2023-12-12T10:12:59.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.249+0000 7f2518f72640 1 -- 172.21.15.78:0/1048398759 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2500003530 con 0x7f25141444c0 2023-12-12T10:12:59.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.249+0000 7f251a775640 1 -- 172.21.15.78:0/1048398759 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f251415f320 msgr2=0x7f25140cceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:59.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.249+0000 7f251a775640 1 --2- 172.21.15.78:0/1048398759 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f251415f320 0x7f25140cceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:59.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.249+0000 7f251a775640 1 -- 172.21.15.78:0/1048398759 >> v1:172.21.15.187:6789/0 conn(0x7f25141444c0 legacy=0x7f251415b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:59.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.249+0000 7f251a775640 1 -- 172.21.15.78:0/1048398759 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25140b1e60 con 0x7f25140cec10 2023-12-12T10:12:59.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.249+0000 7f2519773640 1 --2- 172.21.15.78:0/1048398759 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f251415f320 0x7f25140cceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-12T10:12:59.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.249+0000 7f251a775640 1 --2- 172.21.15.78:0/1048398759 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f25140cec10 0x7f25140cf080 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f250c009e50 tx=0x7f250c01ca10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3da9f2b74a54d218 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:59.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.253+0000 7f2518f72640 1 -- 172.21.15.78:0/1048398759 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f250c0a57d0 con 0x7f25140cec10 2023-12-12T10:12:59.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.253+0000 7f2518f72640 1 -- 172.21.15.78:0/1048398759 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f250c0a5930 con 0x7f25140cec10 2023-12-12T10:12:59.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.253+0000 7f2518f72640 1 -- 172.21.15.78:0/1048398759 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f250c0a5cc0 con 0x7f25140cec10 2023-12-12T10:12:59.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.253+0000 7f251af76640 1 -- 172.21.15.78:0/1048398759 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f25140cec10 msgr2=0x7f25140cf080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:59.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.253+0000 7f251af76640 1 --2- 172.21.15.78:0/1048398759 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f25140cec10 0x7f25140cf080 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f250c009e50 tx=0x7f250c01ca10 comp rx=0 tx=0).stop 2023-12-12T10:12:59.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.253+0000 7f251af76640 1 -- 172.21.15.78:0/1048398759 shutdown_connections 2023-12-12T10:12:59.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.253+0000 7f251af76640 1 --2- 172.21.15.78:0/1048398759 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f25140cec10 0x7f25140cf080 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:59.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.253+0000 7f251af76640 1 --2- 172.21.15.78:0/1048398759 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f251415f320 0x7f25140cceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:59.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.253+0000 7f251af76640 1 -- 172.21.15.78:0/1048398759 >> 172.21.15.78:0/1048398759 conn(0x7f251406a710 msgr2=0x7f251406ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:59.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.253+0000 7f251af76640 1 -- 172.21.15.78:0/1048398759 shutdown_connections 2023-12-12T10:12:59.257 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.253+0000 7f251af76640 1 -- 172.21.15.78:0/1048398759 wait complete. 2023-12-12T10:12:59.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.253+0000 7f251af76640 1 Processor -- start 2023-12-12T10:12:59.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.253+0000 7f251af76640 1 -- start start 2023-12-12T10:12:59.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.253+0000 7f251af76640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f25140cec10 0x7f2514155290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:59.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.253+0000 7f251af76640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f25141444c0 0x7f25141396f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:59.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.253+0000 7f251af76640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f251415f320 0x7f2514139c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:59.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.253+0000 7f251af76640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25141564f0 con 0x7f25140cec10 2023-12-12T10:12:59.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.253+0000 7f251af76640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2514155870 con 0x7f25141444c0 2023-12-12T10:12:59.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.253+0000 7f251af76640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2514155b50 con 0x7f251415f320 2023-12-12T10:12:59.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.257+0000 7f2519f74640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f25140cec10 0x7f2514155290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:59.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.257+0000 7f2519f74640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f25140cec10 0x7f2514155290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41708/0 (socket says 172.21.15.78:41708) 2023-12-12T10:12:59.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.257+0000 7f2519f74640 1 -- 172.21.15.78:0/2754405686 learned_addr learned my addr 172.21.15.78:0/2754405686 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:59.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.257+0000 7f251a775640 1 --2- 172.21.15.78:0/2754405686 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f251415f320 0x7f2514139c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:59.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.257+0000 7f2519773640 1 --2- 172.21.15.78:0/2754405686 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f25141444c0 0x7f25141396f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:59.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.257+0000 7f2519f74640 1 -- 172.21.15.78:0/2754405686 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f251415f320 msgr2=0x7f2514139c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:59.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.257+0000 7f2519f74640 1 --2- 172.21.15.78:0/2754405686 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f251415f320 0x7f2514139c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:59.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.257+0000 7f2519f74640 1 -- 172.21.15.78:0/2754405686 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f25141444c0 msgr2=0x7f25141396f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:59.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.257+0000 7f2519f74640 1 --2- 172.21.15.78:0/2754405686 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f25141444c0 0x7f25141396f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:59.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.257+0000 7f2519f74640 1 -- 172.21.15.78:0/2754405686 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2504009420 con 0x7f25140cec10 2023-12-12T10:12:59.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.257+0000 7f2519f74640 1 --2- 172.21.15.78:0/2754405686 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f25140cec10 0x7f2514155290 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f251000c4d0 tx=0x7f251000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:59.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.257+0000 7f250a7fc640 1 -- 172.21.15.78:0/2754405686 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2510007480 con 0x7f25140cec10 2023-12-12T10:12:59.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.257+0000 7f250a7fc640 1 -- 172.21.15.78:0/2754405686 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25100075e0 con 0x7f25140cec10 2023-12-12T10:12:59.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.257+0000 7f250a7fc640 1 -- 172.21.15.78:0/2754405686 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2510004a30 con 0x7f25140cec10 2023-12-12T10:12:59.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.257+0000 7f251af76640 1 -- 172.21.15.78:0/2754405686 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f250c009b30 con 0x7f25140cec10 2023-12-12T10:12:59.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.257+0000 7f251af76640 1 -- 172.21.15.78:0/2754405686 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2514156110 con 0x7f25140cec10 2023-12-12T10:12:59.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.257+0000 7f251af76640 1 -- 172.21.15.78:0/2754405686 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25140671f0 con 0x7f25140cec10 2023-12-12T10:12:59.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.257+0000 7f250a7fc640 1 -- 172.21.15.78:0/2754405686 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2510004b90 con 0x7f25140cec10 2023-12-12T10:12:59.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.261+0000 7f250a7fc640 1 --2- 172.21.15.78:0/2754405686 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f24f8066470 0x7f24f8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:59.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.261+0000 7f250a7fc640 1 -- 172.21.15.78:0/2754405686 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f2510083280 con 0x7f25140cec10 2023-12-12T10:12:59.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.261+0000 7f2519773640 1 --2- 172.21.15.78:0/2754405686 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f24f8066470 0x7f24f8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:59.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.261+0000 7f2519773640 1 --2- 172.21.15.78:0/2754405686 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f24f8066470 0x7f24f8068930 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f2514071170 tx=0x7f2504008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:59.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.265+0000 7f250a7fc640 1 -- 172.21.15.78:0/2754405686 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2510050480 con 0x7f25140cec10 2023-12-12T10:12:59.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.413+0000 7f251af76640 1 -- 172.21.15.78:0/2754405686 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f2514156630 con 0x7f25140cec10 2023-12-12T10:12:59.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.413+0000 7f250a7fc640 1 -- 172.21.15.78:0/2754405686 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f2514156630 con 0x7f25140cec10 2023-12-12T10:12:59.419 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2023-12-12T10:12:59.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.417+0000 7f251af76640 1 -- 172.21.15.78:0/2754405686 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f24f8066470 msgr2=0x7f24f8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:59.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.417+0000 7f251af76640 1 --2- 172.21.15.78:0/2754405686 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f24f8066470 0x7f24f8068930 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f2514071170 tx=0x7f2504008040 comp rx=0 tx=0).stop 2023-12-12T10:12:59.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.417+0000 7f251af76640 1 -- 172.21.15.78:0/2754405686 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f25140cec10 msgr2=0x7f2514155290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:59.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.417+0000 7f251af76640 1 --2- 172.21.15.78:0/2754405686 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f25140cec10 0x7f2514155290 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f251000c4d0 tx=0x7f251000c990 comp rx=0 tx=0).stop 2023-12-12T10:12:59.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.417+0000 7f251af76640 1 -- 172.21.15.78:0/2754405686 shutdown_connections 2023-12-12T10:12:59.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.417+0000 7f251af76640 1 --2- 172.21.15.78:0/2754405686 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f24f8066470 0x7f24f8068930 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:59.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.417+0000 7f251af76640 1 --2- 172.21.15.78:0/2754405686 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f251415f320 0x7f2514139c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:59.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.417+0000 7f251af76640 1 --2- 172.21.15.78:0/2754405686 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f25141444c0 0x7f25141396f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:59.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.417+0000 7f251af76640 1 --2- 172.21.15.78:0/2754405686 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f25140cec10 0x7f2514155290 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:59.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.417+0000 7f251af76640 1 -- 172.21.15.78:0/2754405686 >> 172.21.15.78:0/2754405686 conn(0x7f251406a710 msgr2=0x7f2514072e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:59.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.417+0000 7f251af76640 1 -- 172.21.15.78:0/2754405686 shutdown_connections 2023-12-12T10:12:59.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.417+0000 7f251af76640 1 -- 172.21.15.78:0/2754405686 wait complete. 2023-12-12T10:12:59.440 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-12T10:12:59.579 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.577+0000 7f1cc271d640 1 Processor -- start 2023-12-12T10:12:59.579 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.577+0000 7f1cc271d640 1 -- start start 2023-12-12T10:12:59.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.577+0000 7f1cc271d640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f1cbc0cdf60 0x7f1cbc070f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:59.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.577+0000 7f1cc271d640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cbc070a70 con 0x7f1cbc071440 2023-12-12T10:12:59.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.577+0000 7f1cc271d640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cbc0ce3c0 con 0x7f1cbc143770 2023-12-12T10:12:59.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.577+0000 7f1cc271d640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cbc070440 con 0x7f1cbc0cdf60 2023-12-12T10:12:59.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.577+0000 7f1cc0cba640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f1cbc071440 0x7f1cbc15d910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:35978/0 (socket says 172.21.15.78:35978) 2023-12-12T10:12:59.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.577+0000 7f1cc0cba640 1 -- 172.21.15.78:0/95585621 learned_addr learned my addr 172.21.15.78:0/95585621 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-12-12T10:12:59.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.577+0000 7f1cbb7fe640 1 --2- 172.21.15.78:0/95585621 >> v2:172.21.15.187:3300/0 conn(0x7f1cbc0cdf60 0x7f1cbc070f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:59.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.577+0000 7f1cbaffd640 1 -- 172.21.15.78:0/95585621 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3137377848 0 0) 0x7f1cbc070a70 con 0x7f1cbc071440 2023-12-12T10:12:59.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.577+0000 7f1cbaffd640 1 -- 172.21.15.78:0/95585621 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ca4003530 con 0x7f1cbc071440 2023-12-12T10:12:59.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.577+0000 7f1cbb7fe640 1 -- 172.21.15.78:0/95585621 >> v1:172.21.15.187:6789/0 conn(0x7f1cbc143770 legacy=0x7f1cbc0b1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:59.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.577+0000 7f1cbaffd640 1 -- 172.21.15.78:0/95585621 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4085173167 0 0) 0x7f1cbc0ce3c0 con 0x7f1cbc143770 2023-12-12T10:12:59.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.577+0000 7f1cbb7fe640 1 -- 172.21.15.78:0/95585621 >> v1:172.21.15.78:6789/0 conn(0x7f1cbc071440 legacy=0x7f1cbc15d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:59.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.577+0000 7f1cbb7fe640 1 -- 172.21.15.78:0/95585621 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cbc0b2530 con 0x7f1cbc0cdf60 2023-12-12T10:12:59.584 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.581+0000 7f1cbb7fe640 1 --2- 172.21.15.78:0/95585621 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1cbc0cdf60 0x7f1cbc070f00 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f1cb00097c0 tx=0x7f1cb001c230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e2b9e732ab0f66cc server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:59.586 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.581+0000 7f1cbaffd640 1 -- 172.21.15.78:0/95585621 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cb4001980 con 0x7f1cbc0cdf60 2023-12-12T10:12:59.586 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.581+0000 7f1cbaffd640 1 -- 172.21.15.78:0/95585621 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cb00a7050 con 0x7f1cbc0cdf60 2023-12-12T10:12:59.586 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.581+0000 7f1cbaffd640 1 -- 172.21.15.78:0/95585621 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cb00ab620 con 0x7f1cbc0cdf60 2023-12-12T10:12:59.586 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.581+0000 7f1cc271d640 1 -- 172.21.15.78:0/95585621 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1cbc0cdf60 msgr2=0x7f1cbc070f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:59.586 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.581+0000 7f1cc271d640 1 --2- 172.21.15.78:0/95585621 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1cbc0cdf60 0x7f1cbc070f00 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f1cb00097c0 tx=0x7f1cb001c230 comp rx=0 tx=0).stop 2023-12-12T10:12:59.586 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.581+0000 7f1cc271d640 1 -- 172.21.15.78:0/95585621 shutdown_connections 2023-12-12T10:12:59.586 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.581+0000 7f1cc271d640 1 --2- 172.21.15.78:0/95585621 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1cbc0cdf60 0x7f1cbc070f00 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:59.586 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.581+0000 7f1cc271d640 1 -- 172.21.15.78:0/95585621 >> 172.21.15.78:0/95585621 conn(0x7f1cbc06a710 msgr2=0x7f1cbc06ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:59.586 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.581+0000 7f1cc271d640 1 -- 172.21.15.78:0/95585621 shutdown_connections 2023-12-12T10:12:59.586 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.581+0000 7f1cc271d640 1 -- 172.21.15.78:0/95585621 wait complete. 2023-12-12T10:12:59.587 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.585+0000 7f1cc271d640 1 Processor -- start 2023-12-12T10:12:59.587 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.585+0000 7f1cc271d640 1 -- start start 2023-12-12T10:12:59.589 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.585+0000 7f1cc271d640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1cbc071440 0x7f1cbc158f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:59.589 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.585+0000 7f1cc271d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1cbc0cdf60 0x7f1cbc1f5e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:59.589 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.585+0000 7f1cc271d640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1cbc143770 0x7f1cbc13b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:59.590 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.585+0000 7f1cc271d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cbc0b0750 con 0x7f1cbc0cdf60 2023-12-12T10:12:59.590 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.585+0000 7f1cc271d640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cbc0afbd0 con 0x7f1cbc143770 2023-12-12T10:12:59.590 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.585+0000 7f1cc271d640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cbc0afeb0 con 0x7f1cbc071440 2023-12-12T10:12:59.590 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.585+0000 7f1cbb7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1cbc0cdf60 0x7f1cbc1f5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:59.590 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.585+0000 7f1cbb7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1cbc0cdf60 0x7f1cbc1f5e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41716/0 (socket says 172.21.15.78:41716) 2023-12-12T10:12:59.590 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.585+0000 7f1cbb7fe640 1 -- 172.21.15.78:0/852259202 learned_addr learned my addr 172.21.15.78:0/852259202 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:59.590 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.585+0000 7f1cbb7fe640 1 -- 172.21.15.78:0/852259202 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1cbc071440 msgr2=0x7f1cbc158f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:59.590 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.585+0000 7f1cbb7fe640 1 --2- 172.21.15.78:0/852259202 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1cbc071440 0x7f1cbc158f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:59.590 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.585+0000 7f1cbb7fe640 1 -- 172.21.15.78:0/852259202 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1cbc143770 msgr2=0x7f1cbc13b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:59.590 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.585+0000 7f1cbb7fe640 1 --2- 172.21.15.78:0/852259202 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1cbc143770 0x7f1cbc13b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:59.590 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.585+0000 7f1cbb7fe640 1 -- 172.21.15.78:0/852259202 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cb0009420 con 0x7f1cbc0cdf60 2023-12-12T10:12:59.590 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.585+0000 7f1cbb7fe640 1 --2- 172.21.15.78:0/852259202 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1cbc0cdf60 0x7f1cbc1f5e80 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f1cb00097c0 tx=0x7f1cb001aa70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:59.591 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.585+0000 7f1cb8ff9640 1 -- 172.21.15.78:0/852259202 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cb0004020 con 0x7f1cbc0cdf60 2023-12-12T10:12:59.591 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.585+0000 7f1cb8ff9640 1 -- 172.21.15.78:0/852259202 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cb0004180 con 0x7f1cbc0cdf60 2023-12-12T10:12:59.591 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.585+0000 7f1cc271d640 1 -- 172.21.15.78:0/852259202 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cbc0b0190 con 0x7f1cbc0cdf60 2023-12-12T10:12:59.591 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.585+0000 7f1cb8ff9640 1 -- 172.21.15.78:0/852259202 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cb0003620 con 0x7f1cbc0cdf60 2023-12-12T10:12:59.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.585+0000 7f1cc271d640 1 -- 172.21.15.78:0/852259202 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cbc159460 con 0x7f1cbc0cdf60 2023-12-12T10:12:59.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.585+0000 7f1cc271d640 1 -- 172.21.15.78:0/852259202 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cbc0671f0 con 0x7f1cbc0cdf60 2023-12-12T10:12:59.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.589+0000 7f1cb8ff9640 1 -- 172.21.15.78:0/852259202 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f1cb0003780 con 0x7f1cbc0cdf60 2023-12-12T10:12:59.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.589+0000 7f1cb8ff9640 1 --2- 172.21.15.78:0/852259202 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f1ca80664a0 0x7f1ca8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:59.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.589+0000 7f1cb8ff9640 1 -- 172.21.15.78:0/852259202 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f1cb011ea60 con 0x7f1cbc0cdf60 2023-12-12T10:12:59.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.589+0000 7f1cbbfff640 1 --2- 172.21.15.78:0/852259202 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f1ca80664a0 0x7f1ca8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:59.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.589+0000 7f1cbbfff640 1 --2- 172.21.15.78:0/852259202 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f1ca80664a0 0x7f1ca8068960 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f1cac007fd0 tx=0x7f1cac007940 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:59.596 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.593+0000 7f1cb8ff9640 1 -- 172.21.15.78:0/852259202 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1cb00ebbb0 con 0x7f1cbc0cdf60 2023-12-12T10:12:59.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.753+0000 7f1cc271d640 1 -- 172.21.15.78:0/852259202 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f1cbc067530 con 0x7f1cbc0cdf60 2023-12-12T10:12:59.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.753+0000 7f1cb8ff9640 1 -- 172.21.15.78:0/852259202 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f1cb00ef1d0 con 0x7f1cbc0cdf60 2023-12-12T10:12:59.758 INFO:teuthology.orchestra.run.smithi078.stderr:listed 0 entries 2023-12-12T10:12:59.760 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.757+0000 7f1cc271d640 1 -- 172.21.15.78:0/852259202 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f1ca80664a0 msgr2=0x7f1ca8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:59.760 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.757+0000 7f1cc271d640 1 --2- 172.21.15.78:0/852259202 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f1ca80664a0 0x7f1ca8068960 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f1cac007fd0 tx=0x7f1cac007940 comp rx=0 tx=0).stop 2023-12-12T10:12:59.760 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.757+0000 7f1cc271d640 1 -- 172.21.15.78:0/852259202 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1cbc0cdf60 msgr2=0x7f1cbc1f5e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:59.761 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.757+0000 7f1cc271d640 1 --2- 172.21.15.78:0/852259202 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1cbc0cdf60 0x7f1cbc1f5e80 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f1cb00097c0 tx=0x7f1cb001aa70 comp rx=0 tx=0).stop 2023-12-12T10:12:59.761 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.757+0000 7f1cc271d640 1 -- 172.21.15.78:0/852259202 shutdown_connections 2023-12-12T10:12:59.761 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.757+0000 7f1cc271d640 1 --2- 172.21.15.78:0/852259202 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f1ca80664a0 0x7f1ca8068960 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:59.761 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.757+0000 7f1cc271d640 1 --2- 172.21.15.78:0/852259202 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1cbc143770 0x7f1cbc13b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:59.761 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.757+0000 7f1cc271d640 1 --2- 172.21.15.78:0/852259202 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1cbc0cdf60 0x7f1cbc1f5e80 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:59.761 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.757+0000 7f1cc271d640 1 --2- 172.21.15.78:0/852259202 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1cbc071440 0x7f1cbc158f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:59.761 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.757+0000 7f1cc271d640 1 -- 172.21.15.78:0/852259202 >> 172.21.15.78:0/852259202 conn(0x7f1cbc06a710 msgr2=0x7f1cbc0b33d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:59.761 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.757+0000 7f1cc271d640 1 -- 172.21.15.78:0/852259202 shutdown_connections 2023-12-12T10:12:59.761 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.757+0000 7f1cc271d640 1 -- 172.21.15.78:0/852259202 wait complete. 2023-12-12T10:12:59.779 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-12-12T10:12:59.779 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-12T10:12:59.789 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T10:12:59.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.969+0000 7fecdfa9a640 1 Processor -- start 2023-12-12T10:12:59.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.969+0000 7fecdfa9a640 1 -- start start 2023-12-12T10:12:59.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.969+0000 7fecdfa9a640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fecd815d520 0x7fecd80ce6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:59.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.969+0000 7fecdfa9a640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fecd80d1bc0 0x7fecd80c7470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:59.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.969+0000 7fecdfa9a640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecd80c6fe0 con 0x7fecd80d0dd0 2023-12-12T10:12:59.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.969+0000 7fecdfa9a640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecd80cf2f0 con 0x7fecd80d1bc0 2023-12-12T10:12:59.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.969+0000 7fecdfa9a640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecd80d0940 con 0x7fecd815d520 2023-12-12T10:12:59.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.969+0000 7fecdd035640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fecd80d0dd0 0x7fecd80d14b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:35980/0 (socket says 172.21.15.78:35980) 2023-12-12T10:12:59.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.969+0000 7fecdd035640 1 -- 172.21.15.78:0/3980527413 learned_addr learned my addr 172.21.15.78:0/3980527413 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-12-12T10:12:59.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.969+0000 7fecdd836640 1 --2- 172.21.15.78:0/3980527413 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fecd815d520 0x7fecd80ce6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:59.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.969+0000 7fecde037640 1 --2- 172.21.15.78:0/3980527413 >> v2:172.21.15.187:3300/0 conn(0x7fecd80d1bc0 0x7fecd80c7470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:59.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.969+0000 7fecdc834640 1 -- 172.21.15.78:0/3980527413 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1551244382 0 0) 0x7fecd80c6fe0 con 0x7fecd80d0dd0 2023-12-12T10:12:59.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.969+0000 7fecdc834640 1 -- 172.21.15.78:0/3980527413 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fecc4003530 con 0x7fecd80d0dd0 2023-12-12T10:12:59.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.969+0000 7fecdd836640 1 -- 172.21.15.78:0/3980527413 >> v2:172.21.15.187:3300/0 conn(0x7fecd80d1bc0 msgr2=0x7fecd80c7470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:12:59.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.969+0000 7fecdd836640 1 --2- 172.21.15.78:0/3980527413 >> v2:172.21.15.187:3300/0 conn(0x7fecd80d1bc0 0x7fecd80c7470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:59.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.969+0000 7fecdd836640 1 -- 172.21.15.78:0/3980527413 >> v1:172.21.15.78:6789/0 conn(0x7fecd80d0dd0 legacy=0x7fecd80d14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:59.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.969+0000 7fecdd836640 1 -- 172.21.15.78:0/3980527413 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecd80ced30 con 0x7fecd815d520 2023-12-12T10:12:59.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.973+0000 7fecdd836640 1 --2- 172.21.15.78:0/3980527413 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fecd815d520 0x7fecd80ce6a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fecd40097c0 tx=0x7fecd401c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=626e98e18c3542e5 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:59.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.973+0000 7fecdc834640 1 -- 172.21.15.78:0/3980527413 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd40ac620 con 0x7fecd815d520 2023-12-12T10:12:59.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.973+0000 7fecdc834640 1 -- 172.21.15.78:0/3980527413 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecd40ac780 con 0x7fecd815d520 2023-12-12T10:12:59.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.973+0000 7fecdc834640 1 -- 172.21.15.78:0/3980527413 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd40acb10 con 0x7fecd815d520 2023-12-12T10:12:59.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.973+0000 7fecdfa9a640 1 -- 172.21.15.78:0/3980527413 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fecd815d520 msgr2=0x7fecd80ce6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:59.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.973+0000 7fecdfa9a640 1 --2- 172.21.15.78:0/3980527413 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fecd815d520 0x7fecd80ce6a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fecd40097c0 tx=0x7fecd401c3c0 comp rx=0 tx=0).stop 2023-12-12T10:12:59.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.973+0000 7fecdfa9a640 1 -- 172.21.15.78:0/3980527413 shutdown_connections 2023-12-12T10:12:59.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.973+0000 7fecdfa9a640 1 --2- 172.21.15.78:0/3980527413 >> v2:172.21.15.187:3300/0 conn(0x7fecd80d1bc0 0x7fecd80c7470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:59.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.973+0000 7fecdfa9a640 1 --2- 172.21.15.78:0/3980527413 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fecd815d520 0x7fecd80ce6a0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:59.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.973+0000 7fecdfa9a640 1 -- 172.21.15.78:0/3980527413 >> 172.21.15.78:0/3980527413 conn(0x7fecd80d2ff0 msgr2=0x7fecd80d3400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:12:59.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.973+0000 7fecdfa9a640 1 -- 172.21.15.78:0/3980527413 shutdown_connections 2023-12-12T10:12:59.981 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.973+0000 7fecdfa9a640 1 -- 172.21.15.78:0/3980527413 wait complete. 2023-12-12T10:12:59.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.977+0000 7fecdfa9a640 1 Processor -- start 2023-12-12T10:12:59.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.977+0000 7fecdfa9a640 1 -- start start 2023-12-12T10:12:59.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.977+0000 7fecdfa9a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fecd80d0dd0 0x7fecd815f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:59.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.977+0000 7fecdfa9a640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fecd80d1bc0 0x7fecd80cf760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:59.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.977+0000 7fecdfa9a640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fecd815d520 0x7fecd815db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:59.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.977+0000 7fecdfa9a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecd815e5b0 con 0x7fecd80d0dd0 2023-12-12T10:12:59.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.977+0000 7fecdfa9a640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecd815e890 con 0x7fecd80d1bc0 2023-12-12T10:12:59.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.977+0000 7fecdfa9a640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecd815eb70 con 0x7fecd815d520 2023-12-12T10:12:59.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.977+0000 7fecdd836640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fecd80d0dd0 0x7fecd815f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:59.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.977+0000 7fecdd836640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fecd80d0dd0 0x7fecd815f650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41722/0 (socket says 172.21.15.78:41722) 2023-12-12T10:12:59.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.977+0000 7fecdd836640 1 -- 172.21.15.78:0/3584401572 learned_addr learned my addr 172.21.15.78:0/3584401572 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:12:59.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.977+0000 7fecde037640 1 --2- 172.21.15.78:0/3584401572 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fecd815d520 0x7fecd815db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:59.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.977+0000 7fecdd035640 1 --2- 172.21.15.78:0/3584401572 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fecd80d1bc0 0x7fecd80cf760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:59.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.977+0000 7fecdd836640 1 -- 172.21.15.78:0/3584401572 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fecd815d520 msgr2=0x7fecd815db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:59.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.977+0000 7fecdd836640 1 --2- 172.21.15.78:0/3584401572 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fecd815d520 0x7fecd815db10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:59.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.977+0000 7fecdd836640 1 -- 172.21.15.78:0/3584401572 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fecd80d1bc0 msgr2=0x7fecd80cf760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:12:59.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.977+0000 7fecdd836640 1 --2- 172.21.15.78:0/3584401572 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fecd80d1bc0 0x7fecd80cf760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:12:59.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.977+0000 7fecdd836640 1 -- 172.21.15.78:0/3584401572 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecd4009420 con 0x7fecd80d0dd0 2023-12-12T10:12:59.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.977+0000 7fecde037640 1 --2- 172.21.15.78:0/3584401572 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fecd815d520 0x7fecd815db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T10:12:59.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.977+0000 7fecdd035640 1 --2- 172.21.15.78:0/3584401572 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fecd80d1bc0 0x7fecd80cf760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T10:12:59.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.977+0000 7fecdd836640 1 --2- 172.21.15.78:0/3584401572 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fecd80d0dd0 0x7fecd815f650 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fecd401aa70 tx=0x7fecd4019160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:59.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.977+0000 7fecce7fc640 1 -- 172.21.15.78:0/3584401572 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd40ac620 con 0x7fecd80d0dd0 2023-12-12T10:12:59.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.977+0000 7fecce7fc640 1 -- 172.21.15.78:0/3584401572 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecd40b6470 con 0x7fecd80d0dd0 2023-12-12T10:12:59.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.977+0000 7fecce7fc640 1 -- 172.21.15.78:0/3584401572 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd40b6840 con 0x7fecd80d0dd0 2023-12-12T10:12:59.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.977+0000 7fecdfa9a640 1 -- 172.21.15.78:0/3584401572 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecd815ee50 con 0x7fecd80d0dd0 2023-12-12T10:12:59.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.977+0000 7fecdfa9a640 1 -- 172.21.15.78:0/3584401572 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecd80cfca0 con 0x7fecd80d0dd0 2023-12-12T10:12:59.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.981+0000 7fecdfa9a640 1 -- 172.21.15.78:0/3584401572 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecd815efe0 con 0x7fecd80d0dd0 2023-12-12T10:12:59.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.981+0000 7fecce7fc640 1 -- 172.21.15.78:0/3584401572 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fecd40b3040 con 0x7fecd80d0dd0 2023-12-12T10:12:59.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.981+0000 7fecce7fc640 1 --2- 172.21.15.78:0/3584401572 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fecbc066470 0x7fecbc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:12:59.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.981+0000 7fecce7fc640 1 -- 172.21.15.78:0/3584401572 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fecd411e690 con 0x7fecd80d0dd0 2023-12-12T10:12:59.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.981+0000 7fecdd035640 1 --2- 172.21.15.78:0/3584401572 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fecbc066470 0x7fecbc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:12:59.986 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.981+0000 7fecdd035640 1 --2- 172.21.15.78:0/3584401572 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fecbc066470 0x7fecbc068930 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fecd815cf10 tx=0x7fecc8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:12:59.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:12:59.985+0000 7fecce7fc640 1 -- 172.21.15.78:0/3584401572 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fecd40eb860 con 0x7fecd80d0dd0 2023-12-12T10:13:00.141 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.137+0000 7fecdfa9a640 1 -- 172.21.15.78:0/3584401572 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fecd80671f0 con 0x7fecd80d0dd0 2023-12-12T10:13:00.143 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.137+0000 7fecce7fc640 1 -- 172.21.15.78:0/3584401572 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18701 (secure 0 0 0) 0x7fecd40eee80 con 0x7fecd80d0dd0 2023-12-12T10:13:00.143 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:13:00.143 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":26,"fsid":"fc81937c-bd26-483c-952b-d1324fcb0c9e","created":"2023-12-12T10:11:44.020214+0000","modified":"2023-12-12T10:12:50.919344+0000","last_up_change":"2023-12-12T10:11:56.278318+0000","last_in_change":"2023-12-12T10:11:46.553610+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T10:11:57.053584+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-12T10:12:07.454450+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-12T10:12:08.182909+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-12T10:12:11.977952+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"22dfdedf-5f6c-4b20-9f6c-30517a1db70a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6809","nonce":3345683600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6811","nonce":3345683600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6815","nonce":3345683600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6813","nonce":3345683600}]},"public_addr":"172.21.15.78:6809/3345683600","cluster_addr":"172.21.15.78:6811/3345683600","heartbeat_back_addr":"172.21.15.78:6815/3345683600","heartbeat_front_addr":"172.21.15.78:6813/3345683600","state":["exists","up"]},{"osd":1,"uuid":"be34a7f3-a69a-462e-9ddf-5e537448dba2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6801","nonce":962652768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6803","nonce":962652768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6807","nonce":962652768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6805","nonce":962652768}]},"public_addr":"172.21.15.78:6801/962652768","cluster_addr":"172.21.15.78:6803/962652768","heartbeat_back_addr":"172.21.15.78:6807/962652768","heartbeat_front_addr":"172.21.15.78:6805/962652768","state":["exists","up"]},{"osd":2,"uuid":"55b381de-5f56-4b14-80f7-e6e41e084a13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6818","nonce":2910206054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6822","nonce":2910206054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6829","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6831","nonce":2910206054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6826","nonce":2910206054}]},"public_addr":"172.21.15.78:6818/2910206054","cluster_addr":"172.21.15.78:6822/2910206054","heartbeat_back_addr":"172.21.15.78:6831/2910206054","heartbeat_front_addr":"172.21.15.78:6826/2910206054","state":["exists","up"]},{"osd":3,"uuid":"d7682de1-25cb-4cec-869f-8851c28b0e6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6819","nonce":3750796703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6821","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6823","nonce":3750796703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6830","nonce":3750796703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6825","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6827","nonce":3750796703}]},"public_addr":"172.21.15.78:6819/3750796703","cluster_addr":"172.21.15.78:6823/3750796703","heartbeat_back_addr":"172.21.15.78:6830/3750796703","heartbeat_front_addr":"172.21.15.78:6827/3750796703","state":["exists","up"]},{"osd":4,"uuid":"8279815a-d6c7-4199-871e-d28971b9dc07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6809","nonce":2944277204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6811","nonce":2944277204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6815","nonce":2944277204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6813","nonce":2944277204}]},"public_addr":"172.21.15.187:6809/2944277204","cluster_addr":"172.21.15.187:6811/2944277204","heartbeat_back_addr":"172.21.15.187:6815/2944277204","heartbeat_front_addr":"172.21.15.187:6813/2944277204","state":["exists","up"]},{"osd":5,"uuid":"0a714c65-f8ce-4340-968f-11a799677ef3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6801","nonce":185858620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6803","nonce":185858620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6807","nonce":185858620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6805","nonce":185858620}]},"public_addr":"172.21.15.187:6801/185858620","cluster_addr":"172.21.15.187:6803/185858620","heartbeat_back_addr":"172.21.15.187:6807/185858620","heartbeat_front_addr":"172.21.15.187:6805/185858620","state":["exists","up"]},{"osd":6,"uuid":"d0bba9ab-f7ee-449e-8999-1c0cf7e6d53c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6817","nonce":4213392126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6819","nonce":4213392126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6824","nonce":4213392126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6821","nonce":4213392126}]},"public_addr":"172.21.15.187:6817/4213392126","cluster_addr":"172.21.15.187:6819/4213392126","heartbeat_back_addr":"172.21.15.187:6824/4213392126","heartbeat_front_addr":"172.21.15.187:6821/4213392126","state":["exists","up"]},{"osd":7,"uuid":"efe5e0d9-2f87-4889-a27a-e2a95a632302","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6823","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6825","nonce":85774004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6827","nonce":85774004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6831","nonce":85774004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6829","nonce":85774004}]},"public_addr":"172.21.15.187:6825/85774004","cluster_addr":"172.21.15.187:6827/85774004","heartbeat_back_addr":"172.21.15.187:6831/85774004","heartbeat_front_addr":"172.21.15.187:6829/85774004","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.214447+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.448899+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.293107+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.564184+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.175026+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.097717+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.261141+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.287681+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.18","mappings":[{"from":3,"to":2}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.13","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T10:13:00.145 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.141+0000 7fecdfa9a640 1 -- 172.21.15.78:0/3584401572 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fecbc066470 msgr2=0x7fecbc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:00.145 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.141+0000 7fecdfa9a640 1 --2- 172.21.15.78:0/3584401572 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fecbc066470 0x7fecbc068930 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fecd815cf10 tx=0x7fecc8009040 comp rx=0 tx=0).stop 2023-12-12T10:13:00.145 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.141+0000 7fecdfa9a640 1 -- 172.21.15.78:0/3584401572 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fecd80d0dd0 msgr2=0x7fecd815f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:00.145 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.141+0000 7fecdfa9a640 1 --2- 172.21.15.78:0/3584401572 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fecd80d0dd0 0x7fecd815f650 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fecd401aa70 tx=0x7fecd4019160 comp rx=0 tx=0).stop 2023-12-12T10:13:00.145 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.141+0000 7fecdfa9a640 1 -- 172.21.15.78:0/3584401572 shutdown_connections 2023-12-12T10:13:00.145 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.141+0000 7fecdfa9a640 1 --2- 172.21.15.78:0/3584401572 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fecbc066470 0x7fecbc068930 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:00.145 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.141+0000 7fecdfa9a640 1 --2- 172.21.15.78:0/3584401572 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fecd815d520 0x7fecd815db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:00.145 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.141+0000 7fecdfa9a640 1 --2- 172.21.15.78:0/3584401572 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fecd80d1bc0 0x7fecd80cf760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:00.145 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.141+0000 7fecdfa9a640 1 --2- 172.21.15.78:0/3584401572 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fecd80d0dd0 0x7fecd815f650 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:00.146 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.141+0000 7fecdfa9a640 1 -- 172.21.15.78:0/3584401572 >> 172.21.15.78:0/3584401572 conn(0x7fecd80d2ff0 msgr2=0x7fecd806c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:00.146 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.141+0000 7fecdfa9a640 1 -- 172.21.15.78:0/3584401572 shutdown_connections 2023-12-12T10:13:00.146 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.141+0000 7fecdfa9a640 1 -- 172.21.15.78:0/3584401572 wait complete. 2023-12-12T10:13:00.164 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-12T10:11:57.053584+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-12T10:12:07.454450+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-12T10:12:08.182909+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-12T10:12:11.977952+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-12T10:13:00.165 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-12T10:13:00.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.301+0000 7ff935279640 1 Processor -- start 2023-12-12T10:13:00.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.301+0000 7ff935279640 1 -- start start 2023-12-12T10:13:00.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.301+0000 7ff935279640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7ff930144600 0x7ff930070b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:00.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.301+0000 7ff935279640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff930072130 0x7ff93015b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:00.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.301+0000 7ff935279640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9300b4100 con 0x7ff930071050 2023-12-12T10:13:00.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.301+0000 7ff935279640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9300b3250 con 0x7ff930144600 2023-12-12T10:13:00.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.301+0000 7ff935279640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9300b34f0 con 0x7ff930072130 2023-12-12T10:13:00.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.301+0000 7ff927fff640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7ff930071050 0x7ff930071a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:35988/0 (socket says 172.21.15.78:35988) 2023-12-12T10:13:00.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.301+0000 7ff927fff640 1 -- 172.21.15.78:0/830372565 learned_addr learned my addr 172.21.15.78:0/830372565 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-12-12T10:13:00.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.301+0000 7ff92f7fe640 1 --2- 172.21.15.78:0/830372565 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff930072130 0x7ff93015b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:00.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.301+0000 7ff92effd640 1 --2- 172.21.15.78:0/830372565 >> v2:172.21.15.187:3300/0 conn(0x7ff930144600 0x7ff930070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:00.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.305+0000 7ff92e7fc640 1 -- 172.21.15.78:0/830372565 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3876618121 0 0) 0x7ff9300b4100 con 0x7ff930071050 2023-12-12T10:13:00.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.305+0000 7ff92e7fc640 1 -- 172.21.15.78:0/830372565 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff91c003530 con 0x7ff930071050 2023-12-12T10:13:00.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.305+0000 7ff92e7fc640 1 -- 172.21.15.78:0/830372565 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3050136808 0 0) 0x7ff91c003530 con 0x7ff930071050 2023-12-12T10:13:00.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.305+0000 7ff92f7fe640 1 -- 172.21.15.78:0/830372565 >> v2:172.21.15.187:3300/0 conn(0x7ff930144600 msgr2=0x7ff930070b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:13:00.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.305+0000 7ff92f7fe640 1 --2- 172.21.15.78:0/830372565 >> v2:172.21.15.187:3300/0 conn(0x7ff930144600 0x7ff930070b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:00.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.305+0000 7ff92f7fe640 1 -- 172.21.15.78:0/830372565 >> v1:172.21.15.78:6789/0 conn(0x7ff930071050 legacy=0x7ff930071a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:00.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.305+0000 7ff92f7fe640 1 -- 172.21.15.78:0/830372565 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9300b37d0 con 0x7ff930072130 2023-12-12T10:13:00.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.305+0000 7ff92effd640 1 --2- 172.21.15.78:0/830372565 >> v2:172.21.15.187:3300/0 conn(0x7ff930144600 0x7ff930070b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-12T10:13:00.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.305+0000 7ff92f7fe640 1 --2- 172.21.15.78:0/830372565 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff930072130 0x7ff93015b390 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff928009d90 tx=0x7ff92801c840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d00471cae7872b8b server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:00.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.305+0000 7ff92e7fc640 1 -- 172.21.15.78:0/830372565 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff918001680 con 0x7ff930072130 2023-12-12T10:13:00.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.305+0000 7ff92e7fc640 1 -- 172.21.15.78:0/830372565 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9280a5640 con 0x7ff930072130 2023-12-12T10:13:00.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.305+0000 7ff92e7fc640 1 -- 172.21.15.78:0/830372565 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9280a59b0 con 0x7ff930072130 2023-12-12T10:13:00.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.309+0000 7ff935279640 1 -- 172.21.15.78:0/830372565 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff930072130 msgr2=0x7ff93015b390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:00.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.309+0000 7ff935279640 1 --2- 172.21.15.78:0/830372565 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff930072130 0x7ff93015b390 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff928009d90 tx=0x7ff92801c840 comp rx=0 tx=0).stop 2023-12-12T10:13:00.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.309+0000 7ff935279640 1 -- 172.21.15.78:0/830372565 shutdown_connections 2023-12-12T10:13:00.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.309+0000 7ff935279640 1 --2- 172.21.15.78:0/830372565 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff930072130 0x7ff93015b390 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:00.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.309+0000 7ff935279640 1 --2- 172.21.15.78:0/830372565 >> v2:172.21.15.187:3300/0 conn(0x7ff930144600 0x7ff930070b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:00.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.309+0000 7ff935279640 1 -- 172.21.15.78:0/830372565 >> 172.21.15.78:0/830372565 conn(0x7ff9300b0750 msgr2=0x7ff9300b0b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:00.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.309+0000 7ff935279640 1 -- 172.21.15.78:0/830372565 shutdown_connections 2023-12-12T10:13:00.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.309+0000 7ff935279640 1 -- 172.21.15.78:0/830372565 wait complete. 2023-12-12T10:13:00.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.309+0000 7ff935279640 1 Processor -- start 2023-12-12T10:13:00.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.309+0000 7ff935279640 1 -- start start 2023-12-12T10:13:00.315 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.309+0000 7ff935279640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff930071050 0x7ff9300ce270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:00.315 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.309+0000 7ff935279640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff930072130 0x7ff93013c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:00.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.309+0000 7ff935279640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff930144600 0x7ff9300cd3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:00.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.309+0000 7ff935279640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9300cd8f0 con 0x7ff930072130 2023-12-12T10:13:00.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.309+0000 7ff935279640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9301644f0 con 0x7ff930144600 2023-12-12T10:13:00.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.309+0000 7ff935279640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9301647d0 con 0x7ff930071050 2023-12-12T10:13:00.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.309+0000 7ff927fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff930072130 0x7ff93013c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:00.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.309+0000 7ff927fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff930072130 0x7ff93013c280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41724/0 (socket says 172.21.15.78:41724) 2023-12-12T10:13:00.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.309+0000 7ff927fff640 1 -- 172.21.15.78:0/4166690936 learned_addr learned my addr 172.21.15.78:0/4166690936 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:13:00.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.309+0000 7ff92effd640 1 --2- 172.21.15.78:0/4166690936 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff930071050 0x7ff9300ce270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:00.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.309+0000 7ff92f7fe640 1 --2- 172.21.15.78:0/4166690936 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff930144600 0x7ff9300cd3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:00.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.309+0000 7ff927fff640 1 -- 172.21.15.78:0/4166690936 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff930071050 msgr2=0x7ff9300ce270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:00.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.309+0000 7ff927fff640 1 --2- 172.21.15.78:0/4166690936 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff930071050 0x7ff9300ce270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:00.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.309+0000 7ff927fff640 1 -- 172.21.15.78:0/4166690936 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff930144600 msgr2=0x7ff9300cd3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:00.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.309+0000 7ff927fff640 1 --2- 172.21.15.78:0/4166690936 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff930144600 0x7ff9300cd3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:00.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.309+0000 7ff927fff640 1 -- 172.21.15.78:0/4166690936 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff920009420 con 0x7ff930072130 2023-12-12T10:13:00.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.313+0000 7ff927fff640 1 --2- 172.21.15.78:0/4166690936 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff930072130 0x7ff93013c280 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7ff9180017b0 tx=0x7ff91800cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:00.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.313+0000 7ff9277fe640 1 -- 172.21.15.78:0/4166690936 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff918005ae0 con 0x7ff930072130 2023-12-12T10:13:00.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.313+0000 7ff9277fe640 1 -- 172.21.15.78:0/4166690936 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff918005c40 con 0x7ff930072130 2023-12-12T10:13:00.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.313+0000 7ff9277fe640 1 -- 172.21.15.78:0/4166690936 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff918007290 con 0x7ff930072130 2023-12-12T10:13:00.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.313+0000 7ff935279640 1 -- 172.21.15.78:0/4166690936 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff928009a70 con 0x7ff930072130 2023-12-12T10:13:00.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.313+0000 7ff935279640 1 -- 172.21.15.78:0/4166690936 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9300cc8d0 con 0x7ff930072130 2023-12-12T10:13:00.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.313+0000 7ff935279640 1 -- 172.21.15.78:0/4166690936 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9300671f0 con 0x7ff930072130 2023-12-12T10:13:00.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.313+0000 7ff9277fe640 1 -- 172.21.15.78:0/4166690936 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff9180073f0 con 0x7ff930072130 2023-12-12T10:13:00.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.313+0000 7ff9277fe640 1 --2- 172.21.15.78:0/4166690936 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7ff910066470 0x7ff910068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:00.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.313+0000 7ff9277fe640 1 -- 172.21.15.78:0/4166690936 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7ff918083f30 con 0x7ff930072130 2023-12-12T10:13:00.318 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.313+0000 7ff92effd640 1 --2- 172.21.15.78:0/4166690936 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7ff910066470 0x7ff910068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:00.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.317+0000 7ff92effd640 1 --2- 172.21.15.78:0/4166690936 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7ff910066470 0x7ff910068930 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ff920009c50 tx=0x7ff920009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:00.322 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.317+0000 7ff9277fe640 1 -- 172.21.15.78:0/4166690936 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff918051000 con 0x7ff930072130 2023-12-12T10:13:00.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.469+0000 7ff935279640 1 -- 172.21.15.78:0/4166690936 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff930074610 con 0x7ff930072130 2023-12-12T10:13:00.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.469+0000 7ff9277fe640 1 -- 172.21.15.78:0/4166690936 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff918054620 con 0x7ff930072130 2023-12-12T10:13:00.472 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2023-12-12T10:13:00.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.469+0000 7ff935279640 1 -- 172.21.15.78:0/4166690936 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7ff910066470 msgr2=0x7ff910068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:00.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.469+0000 7ff935279640 1 --2- 172.21.15.78:0/4166690936 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7ff910066470 0x7ff910068930 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ff920009c50 tx=0x7ff920009190 comp rx=0 tx=0).stop 2023-12-12T10:13:00.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.469+0000 7ff935279640 1 -- 172.21.15.78:0/4166690936 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff930072130 msgr2=0x7ff93013c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:00.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.469+0000 7ff935279640 1 --2- 172.21.15.78:0/4166690936 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff930072130 0x7ff93013c280 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7ff9180017b0 tx=0x7ff91800cbe0 comp rx=0 tx=0).stop 2023-12-12T10:13:00.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.469+0000 7ff935279640 1 -- 172.21.15.78:0/4166690936 shutdown_connections 2023-12-12T10:13:00.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.469+0000 7ff935279640 1 --2- 172.21.15.78:0/4166690936 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7ff910066470 0x7ff910068930 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:00.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.469+0000 7ff935279640 1 --2- 172.21.15.78:0/4166690936 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff930144600 0x7ff9300cd3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:00.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.469+0000 7ff935279640 1 --2- 172.21.15.78:0/4166690936 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff930072130 0x7ff93013c280 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:00.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.469+0000 7ff935279640 1 --2- 172.21.15.78:0/4166690936 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff930071050 0x7ff9300ce270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:00.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.469+0000 7ff935279640 1 -- 172.21.15.78:0/4166690936 >> 172.21.15.78:0/4166690936 conn(0x7ff9300b0750 msgr2=0x7ff930141ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:00.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.469+0000 7ff935279640 1 -- 172.21.15.78:0/4166690936 shutdown_connections 2023-12-12T10:13:00.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.469+0000 7ff935279640 1 -- 172.21.15.78:0/4166690936 wait complete. 2023-12-12T10:13:00.493 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-12T10:13:00.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.629+0000 7f17744c9640 1 Processor -- start 2023-12-12T10:13:00.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.629+0000 7f17744c9640 1 -- start start 2023-12-12T10:13:00.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.629+0000 7f17744c9640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f176c06cf60 0x7f176c15f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:00.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.629+0000 7f17744c9640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f176c15b390 0x7f176c15b840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:00.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.629+0000 7f17744c9640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f176c0cea30 con 0x7f176c0cb4b0 2023-12-12T10:13:00.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.629+0000 7f17744c9640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f176c15bd80 con 0x7f176c15b390 2023-12-12T10:13:00.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.629+0000 7f17744c9640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f176c15bfc0 con 0x7f176c06cf60 2023-12-12T10:13:00.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.629+0000 7f1772a66640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f176c15b390 0x7f176c15b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:00.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.629+0000 7f1772a66640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f176c15b390 0x7f176c15b840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41732/0 (socket says 172.21.15.78:41732) 2023-12-12T10:13:00.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.629+0000 7f1772a66640 1 -- 172.21.15.78:0/1309273278 learned_addr learned my addr 172.21.15.78:0/1309273278 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:13:00.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.629+0000 7f1772265640 1 --1- 172.21.15.78:0/1309273278 >> v1:172.21.15.78:6789/0 conn(0x7f176c0cb4b0 0x7f176c06c850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:35996/0 (socket says 172.21.15.78:35996) 2023-12-12T10:13:00.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.633+0000 7f1771a64640 1 --2- 172.21.15.78:0/1309273278 >> v2:172.21.15.187:3300/0 conn(0x7f176c06cf60 0x7f176c15f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:00.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.633+0000 7f1772a66640 1 -- 172.21.15.78:0/1309273278 >> v2:172.21.15.187:3300/0 conn(0x7f176c06cf60 msgr2=0x7f176c15f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:13:00.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.633+0000 7f1772a66640 1 --2- 172.21.15.78:0/1309273278 >> v2:172.21.15.187:3300/0 conn(0x7f176c06cf60 0x7f176c15f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:00.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.633+0000 7f1772a66640 1 -- 172.21.15.78:0/1309273278 >> v1:172.21.15.78:6789/0 conn(0x7f176c0cb4b0 legacy=0x7f176c06c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:00.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.633+0000 7f1772a66640 1 -- 172.21.15.78:0/1309273278 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f176c15c2a0 con 0x7f176c15b390 2023-12-12T10:13:00.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.633+0000 7f1771263640 1 -- 172.21.15.78:0/1309273278 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 130300166 0 0) 0x7f176c0cea30 con 0x7f176c0cb4b0 2023-12-12T10:13:00.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.633+0000 7f1772a66640 1 --2- 172.21.15.78:0/1309273278 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f176c15b390 0x7f176c15b840 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f176c0b44f0 tx=0x7f176401c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4a107d87d93cabc server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:00.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.633+0000 7f1771263640 1 -- 172.21.15.78:0/1309273278 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17640a57d0 con 0x7f176c15b390 2023-12-12T10:13:00.639 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.633+0000 7f1771263640 1 -- 172.21.15.78:0/1309273278 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17640a5930 con 0x7f176c15b390 2023-12-12T10:13:00.639 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.633+0000 7f1771263640 1 -- 172.21.15.78:0/1309273278 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17640a5cc0 con 0x7f176c15b390 2023-12-12T10:13:00.639 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.633+0000 7f17744c9640 1 -- 172.21.15.78:0/1309273278 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f176c15b390 msgr2=0x7f176c15b840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:00.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.633+0000 7f17744c9640 1 --2- 172.21.15.78:0/1309273278 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f176c15b390 0x7f176c15b840 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f176c0b44f0 tx=0x7f176401c910 comp rx=0 tx=0).stop 2023-12-12T10:13:00.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.637+0000 7f17744c9640 1 -- 172.21.15.78:0/1309273278 shutdown_connections 2023-12-12T10:13:00.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.637+0000 7f17744c9640 1 --2- 172.21.15.78:0/1309273278 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f176c15b390 0x7f176c15b840 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:00.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.637+0000 7f17744c9640 1 --2- 172.21.15.78:0/1309273278 >> v2:172.21.15.187:3300/0 conn(0x7f176c06cf60 0x7f176c15f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:00.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.637+0000 7f17744c9640 1 -- 172.21.15.78:0/1309273278 >> 172.21.15.78:0/1309273278 conn(0x7f176c06a710 msgr2=0x7f176c06ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:00.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.637+0000 7f17744c9640 1 -- 172.21.15.78:0/1309273278 shutdown_connections 2023-12-12T10:13:00.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.637+0000 7f17744c9640 1 -- 172.21.15.78:0/1309273278 wait complete. 2023-12-12T10:13:00.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.637+0000 7f17744c9640 1 Processor -- start 2023-12-12T10:13:00.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.637+0000 7f17744c9640 1 -- start start 2023-12-12T10:13:00.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.637+0000 7f17744c9640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f176c06cf60 0x7f176c1485b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:00.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.637+0000 7f17744c9640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f176c0cb4b0 0x7f176c156d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:00.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.637+0000 7f17744c9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f176c15b390 0x7f176c157240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:00.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.637+0000 7f17744c9640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f176c148f20 con 0x7f176c15b390 2023-12-12T10:13:00.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.637+0000 7f17744c9640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f176c1491c0 con 0x7f176c06cf60 2023-12-12T10:13:00.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.637+0000 7f17744c9640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f176c1494a0 con 0x7f176c0cb4b0 2023-12-12T10:13:00.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.637+0000 7f1772a66640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f176c15b390 0x7f176c157240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:00.643 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.637+0000 7f1772a66640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f176c15b390 0x7f176c157240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41748/0 (socket says 172.21.15.78:41748) 2023-12-12T10:13:00.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.637+0000 7f1772a66640 1 -- 172.21.15.78:0/2731815156 learned_addr learned my addr 172.21.15.78:0/2731815156 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:13:00.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.637+0000 7f1772265640 1 --2- 172.21.15.78:0/2731815156 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f176c06cf60 0x7f176c1485b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:00.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.637+0000 7f1771a64640 1 --2- 172.21.15.78:0/2731815156 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f176c0cb4b0 0x7f176c156d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:00.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.637+0000 7f1772a66640 1 -- 172.21.15.78:0/2731815156 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f176c0cb4b0 msgr2=0x7f176c156d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:00.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.637+0000 7f1772a66640 1 --2- 172.21.15.78:0/2731815156 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f176c0cb4b0 0x7f176c156d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:00.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.637+0000 7f1772a66640 1 -- 172.21.15.78:0/2731815156 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f176c06cf60 msgr2=0x7f176c1485b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:00.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.637+0000 7f1772a66640 1 --2- 172.21.15.78:0/2731815156 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f176c06cf60 0x7f176c1485b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:00.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.637+0000 7f1772a66640 1 -- 172.21.15.78:0/2731815156 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1764009b30 con 0x7f176c15b390 2023-12-12T10:13:00.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.637+0000 7f1772a66640 1 --2- 172.21.15.78:0/2731815156 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f176c15b390 0x7f176c157240 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f17640af040 tx=0x7f17640196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:00.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.641+0000 7f1762ffd640 1 -- 172.21.15.78:0/2731815156 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17640b8670 con 0x7f176c15b390 2023-12-12T10:13:00.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.641+0000 7f1762ffd640 1 -- 172.21.15.78:0/2731815156 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17640b87f0 con 0x7f176c15b390 2023-12-12T10:13:00.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.641+0000 7f1762ffd640 1 -- 172.21.15.78:0/2731815156 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17640b8ba0 con 0x7f176c15b390 2023-12-12T10:13:00.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.641+0000 7f17744c9640 1 -- 172.21.15.78:0/2731815156 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f176c149780 con 0x7f176c15b390 2023-12-12T10:13:00.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.641+0000 7f17744c9640 1 -- 172.21.15.78:0/2731815156 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f176c14a5e0 con 0x7f176c15b390 2023-12-12T10:13:00.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.641+0000 7f17744c9640 1 -- 172.21.15.78:0/2731815156 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f176c0671f0 con 0x7f176c15b390 2023-12-12T10:13:00.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.641+0000 7f1762ffd640 1 -- 172.21.15.78:0/2731815156 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f17640b8d00 con 0x7f176c15b390 2023-12-12T10:13:00.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.641+0000 7f1762ffd640 1 --2- 172.21.15.78:0/2731815156 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f1750066470 0x7f1750068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:00.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.641+0000 7f1762ffd640 1 -- 172.21.15.78:0/2731815156 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f176411f6a0 con 0x7f176c15b390 2023-12-12T10:13:00.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.641+0000 7f1772265640 1 --2- 172.21.15.78:0/2731815156 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f1750066470 0x7f1750068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:00.647 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.641+0000 7f1772265640 1 --2- 172.21.15.78:0/2731815156 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f1750066470 0x7f1750068930 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f1768007fd0 tx=0x7f1768007d60 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:00.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.645+0000 7f1762ffd640 1 -- 172.21.15.78:0/2731815156 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f17640ec800 con 0x7f176c15b390 2023-12-12T10:13:00.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.797+0000 7f17744c9640 1 -- 172.21.15.78:0/2731815156 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f176c149ca0 con 0x7f176c15b390 2023-12-12T10:13:00.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.797+0000 7f1762ffd640 1 -- 172.21.15.78:0/2731815156 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f176c149ca0 con 0x7f176c15b390 2023-12-12T10:13:00.802 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2023-12-12T10:13:00.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.801+0000 7f17744c9640 1 -- 172.21.15.78:0/2731815156 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f1750066470 msgr2=0x7f1750068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:00.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.801+0000 7f17744c9640 1 --2- 172.21.15.78:0/2731815156 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f1750066470 0x7f1750068930 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f1768007fd0 tx=0x7f1768007d60 comp rx=0 tx=0).stop 2023-12-12T10:13:00.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.801+0000 7f17744c9640 1 -- 172.21.15.78:0/2731815156 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f176c15b390 msgr2=0x7f176c157240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:00.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.801+0000 7f17744c9640 1 --2- 172.21.15.78:0/2731815156 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f176c15b390 0x7f176c157240 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f17640af040 tx=0x7f17640196b0 comp rx=0 tx=0).stop 2023-12-12T10:13:00.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.801+0000 7f17744c9640 1 -- 172.21.15.78:0/2731815156 shutdown_connections 2023-12-12T10:13:00.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.801+0000 7f17744c9640 1 --2- 172.21.15.78:0/2731815156 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f1750066470 0x7f1750068930 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:00.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.801+0000 7f17744c9640 1 --2- 172.21.15.78:0/2731815156 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f176c15b390 0x7f176c157240 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:00.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.801+0000 7f17744c9640 1 --2- 172.21.15.78:0/2731815156 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f176c0cb4b0 0x7f176c156d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:00.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.801+0000 7f17744c9640 1 --2- 172.21.15.78:0/2731815156 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f176c06cf60 0x7f176c1485b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:00.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.801+0000 7f17744c9640 1 -- 172.21.15.78:0/2731815156 >> 172.21.15.78:0/2731815156 conn(0x7f176c06a710 msgr2=0x7f176c0ce630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:00.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.801+0000 7f17744c9640 1 -- 172.21.15.78:0/2731815156 shutdown_connections 2023-12-12T10:13:00.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.801+0000 7f17744c9640 1 -- 172.21.15.78:0/2731815156 wait complete. 2023-12-12T10:13:00.823 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-12T10:13:00.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.957+0000 7f42390d6640 1 Processor -- start 2023-12-12T10:13:00.963 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.957+0000 7f42390d6640 1 -- start start 2023-12-12T10:13:00.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.961+0000 7f42390d6640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f423406ba10 0x7f42340cc370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:00.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.961+0000 7f42390d6640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f42340cc8b0 0x7f423406d780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:00.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.961+0000 7f42390d6640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f423406b580 con 0x7f423415d080 2023-12-12T10:13:00.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.961+0000 7f42390d6640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42340ccd40 con 0x7f423406ba10 2023-12-12T10:13:00.964 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.961+0000 7f42390d6640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f423406af50 con 0x7f42340cc8b0 2023-12-12T10:13:00.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.961+0000 7f422a59c640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f423406ba10 0x7f42340cc370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:00.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.961+0000 7f423359e640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f42340cc8b0 0x7f423406d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:00.965 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.961+0000 7f423359e640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f42340cc8b0 0x7f423406d780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.78:40324/0 (socket says 172.21.15.78:40324) 2023-12-12T10:13:00.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.961+0000 7f423359e640 1 -- 172.21.15.78:0/2981900359 learned_addr learned my addr 172.21.15.78:0/2981900359 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:13:00.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.961+0000 7f422a59c640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f423406ba10 0x7f42340cc370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.78:50780/0 (socket says 172.21.15.78:50780) 2023-12-12T10:13:00.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.961+0000 7f423359e640 1 -- 172.21.15.78:0/2981900359 >> v2:172.21.15.187:3300/0 conn(0x7f423406ba10 msgr2=0x7f42340cc370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:13:00.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.961+0000 7f423359e640 1 --2- 172.21.15.78:0/2981900359 >> v2:172.21.15.187:3300/0 conn(0x7f423406ba10 0x7f42340cc370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:00.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.961+0000 7f423359e640 1 -- 172.21.15.78:0/2981900359 >> v1:172.21.15.187:6789/0 conn(0x7f423415d080 legacy=0x7f4234160da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:00.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.961+0000 7f423359e640 1 -- 172.21.15.78:0/2981900359 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f423406a900 con 0x7f42340cc8b0 2023-12-12T10:13:00.967 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.965+0000 7f423359e640 1 --2- 172.21.15.78:0/2981900359 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f42340cc8b0 0x7f423406d780 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f422c009870 tx=0x7f422c01c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f9f6d926127d0985 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:00.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.965+0000 7f423259c640 1 -- 172.21.15.78:0/2981900359 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f422c0aa670 con 0x7f42340cc8b0 2023-12-12T10:13:00.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.965+0000 7f423259c640 1 -- 172.21.15.78:0/2981900359 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f422c0aa7d0 con 0x7f42340cc8b0 2023-12-12T10:13:00.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.965+0000 7f423259c640 1 -- 172.21.15.78:0/2981900359 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f422c0aab60 con 0x7f42340cc8b0 2023-12-12T10:13:00.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.965+0000 7f42390d6640 1 -- 172.21.15.78:0/2981900359 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f42340cc8b0 msgr2=0x7f423406d780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:00.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.965+0000 7f42390d6640 1 --2- 172.21.15.78:0/2981900359 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f42340cc8b0 0x7f423406d780 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f422c009870 tx=0x7f422c01c510 comp rx=0 tx=0).stop 2023-12-12T10:13:00.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.965+0000 7f42390d6640 1 -- 172.21.15.78:0/2981900359 shutdown_connections 2023-12-12T10:13:00.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.965+0000 7f42390d6640 1 --2- 172.21.15.78:0/2981900359 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f42340cc8b0 0x7f423406d780 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:00.969 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.965+0000 7f42390d6640 1 --2- 172.21.15.78:0/2981900359 >> v2:172.21.15.187:3300/0 conn(0x7f423406ba10 0x7f42340cc370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:00.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.965+0000 7f42390d6640 1 -- 172.21.15.78:0/2981900359 >> 172.21.15.78:0/2981900359 conn(0x7f42340b1650 msgr2=0x7f42340b1a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:00.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.965+0000 7f42390d6640 1 -- 172.21.15.78:0/2981900359 shutdown_connections 2023-12-12T10:13:00.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.965+0000 7f42390d6640 1 -- 172.21.15.78:0/2981900359 wait complete. 2023-12-12T10:13:00.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.965+0000 7f42390d6640 1 Processor -- start 2023-12-12T10:13:00.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.965+0000 7f42390d6640 1 -- start start 2023-12-12T10:13:00.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.969+0000 7f42390d6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f423406ba10 0x7f42340b3230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:00.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.969+0000 7f42390d6640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f42340cc8b0 0x7f423415e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:00.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.969+0000 7f42390d6640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f423415d080 0x7f423415ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:00.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.969+0000 7f42390d6640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42340acf90 con 0x7f423406ba10 2023-12-12T10:13:00.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.969+0000 7f42390d6640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f423415e1f0 con 0x7f423415d080 2023-12-12T10:13:00.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.969+0000 7f42390d6640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42341555b0 con 0x7f42340cc8b0 2023-12-12T10:13:00.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.969+0000 7f4232d9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f423406ba10 0x7f42340b3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:00.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.969+0000 7f4232d9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f423406ba10 0x7f42340b3230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41758/0 (socket says 172.21.15.78:41758) 2023-12-12T10:13:00.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.969+0000 7f4232d9d640 1 -- 172.21.15.78:0/3158599848 learned_addr learned my addr 172.21.15.78:0/3158599848 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:13:00.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.969+0000 7f422a59c640 1 --2- 172.21.15.78:0/3158599848 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f42340cc8b0 0x7f423415e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:00.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.969+0000 7f423359e640 1 --2- 172.21.15.78:0/3158599848 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f423415d080 0x7f423415ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:00.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.969+0000 7f4232d9d640 1 -- 172.21.15.78:0/3158599848 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f42340cc8b0 msgr2=0x7f423415e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:00.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.969+0000 7f4232d9d640 1 --2- 172.21.15.78:0/3158599848 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f42340cc8b0 0x7f423415e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:00.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.969+0000 7f4232d9d640 1 -- 172.21.15.78:0/3158599848 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f423415d080 msgr2=0x7f423415ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:00.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.969+0000 7f4232d9d640 1 --2- 172.21.15.78:0/3158599848 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f423415d080 0x7f423415ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:00.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.969+0000 7f4232d9d640 1 -- 172.21.15.78:0/3158599848 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f422c0094d0 con 0x7f423406ba10 2023-12-12T10:13:00.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.969+0000 7f423359e640 1 --2- 172.21.15.78:0/3158599848 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f423415d080 0x7f423415ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T10:13:00.975 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.969+0000 7f4232d9d640 1 --2- 172.21.15.78:0/3158599848 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f423406ba10 0x7f42340b3230 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f422400c7f0 tx=0x7f422400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:00.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.969+0000 7f422bfff640 1 -- 172.21.15.78:0/3158599848 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4224003b80 con 0x7f423406ba10 2023-12-12T10:13:00.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.969+0000 7f422bfff640 1 -- 172.21.15.78:0/3158599848 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4224003ce0 con 0x7f423406ba10 2023-12-12T10:13:00.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.969+0000 7f42390d6640 1 -- 172.21.15.78:0/3158599848 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4234155870 con 0x7f423406ba10 2023-12-12T10:13:00.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.969+0000 7f422bfff640 1 -- 172.21.15.78:0/3158599848 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f422400aa90 con 0x7f423406ba10 2023-12-12T10:13:00.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.969+0000 7f42390d6640 1 -- 172.21.15.78:0/3158599848 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4234155e30 con 0x7f423406ba10 2023-12-12T10:13:00.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.969+0000 7f42390d6640 1 -- 172.21.15.78:0/3158599848 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f423415e360 con 0x7f423406ba10 2023-12-12T10:13:00.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.973+0000 7f422bfff640 1 -- 172.21.15.78:0/3158599848 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f422400abf0 con 0x7f423406ba10 2023-12-12T10:13:00.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.973+0000 7f422bfff640 1 --2- 172.21.15.78:0/3158599848 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f4214066470 0x7f4214068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:00.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.973+0000 7f422bfff640 1 -- 172.21.15.78:0/3158599848 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f4224084130 con 0x7f423406ba10 2023-12-12T10:13:00.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.973+0000 7f422a59c640 1 --2- 172.21.15.78:0/3158599848 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f4214066470 0x7f4214068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:00.978 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.973+0000 7f422a59c640 1 --2- 172.21.15.78:0/3158599848 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f4214066470 0x7f4214068930 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f42340cc7b0 tx=0x7f421c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:00.980 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:00.977+0000 7f422bfff640 1 -- 172.21.15.78:0/3158599848 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f42240511e0 con 0x7f423406ba10 2023-12-12T10:13:01.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.129+0000 7f42390d6640 1 -- 172.21.15.78:0/3158599848 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4234067530 con 0x7f423406ba10 2023-12-12T10:13:01.133 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.129+0000 7f422bfff640 1 -- 172.21.15.78:0/3158599848 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4224054800 con 0x7f423406ba10 2023-12-12T10:13:01.133 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2023-12-12T10:13:01.135 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.133+0000 7f42390d6640 1 -- 172.21.15.78:0/3158599848 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f4214066470 msgr2=0x7f4214068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:01.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.133+0000 7f42390d6640 1 --2- 172.21.15.78:0/3158599848 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f4214066470 0x7f4214068930 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f42340cc7b0 tx=0x7f421c008040 comp rx=0 tx=0).stop 2023-12-12T10:13:01.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.133+0000 7f42390d6640 1 -- 172.21.15.78:0/3158599848 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f423406ba10 msgr2=0x7f42340b3230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:01.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.133+0000 7f42390d6640 1 --2- 172.21.15.78:0/3158599848 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f423406ba10 0x7f42340b3230 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f422400c7f0 tx=0x7f422400ccb0 comp rx=0 tx=0).stop 2023-12-12T10:13:01.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.133+0000 7f42390d6640 1 -- 172.21.15.78:0/3158599848 shutdown_connections 2023-12-12T10:13:01.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.133+0000 7f42390d6640 1 --2- 172.21.15.78:0/3158599848 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f4214066470 0x7f4214068930 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:01.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.133+0000 7f42390d6640 1 --2- 172.21.15.78:0/3158599848 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f423415d080 0x7f423415ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:01.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.133+0000 7f42390d6640 1 --2- 172.21.15.78:0/3158599848 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f42340cc8b0 0x7f423415e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:01.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.133+0000 7f42390d6640 1 --2- 172.21.15.78:0/3158599848 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f423406ba10 0x7f42340b3230 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:01.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.133+0000 7f42390d6640 1 -- 172.21.15.78:0/3158599848 >> 172.21.15.78:0/3158599848 conn(0x7f42340b1650 msgr2=0x7f423415d670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:01.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.133+0000 7f42390d6640 1 -- 172.21.15.78:0/3158599848 shutdown_connections 2023-12-12T10:13:01.136 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.133+0000 7f42390d6640 1 -- 172.21.15.78:0/3158599848 wait complete. 2023-12-12T10:13:01.155 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-12T10:13:01.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.293+0000 7f44b1fe7640 1 Processor -- start 2023-12-12T10:13:01.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.293+0000 7f44b1fe7640 1 -- start start 2023-12-12T10:13:01.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.293+0000 7f44b1fe7640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f44ac06d9f0 0x7f44ac0b36e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:01.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.293+0000 7f44b1fe7640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44ac15d6d0 con 0x7f44ac06de70 2023-12-12T10:13:01.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.293+0000 7f44b1fe7640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44ac070ea0 con 0x7f44ac15d2f0 2023-12-12T10:13:01.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.293+0000 7f44b1fe7640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44ac070600 con 0x7f44ac06d9f0 2023-12-12T10:13:01.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.293+0000 7f44abfff640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f44ac06de70 0x7f44ac0abe90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:35998/0 (socket says 172.21.15.78:35998) 2023-12-12T10:13:01.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.293+0000 7f44abfff640 1 -- 172.21.15.78:0/3461097164 learned_addr learned my addr 172.21.15.78:0/3461097164 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-12-12T10:13:01.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.293+0000 7f44aaffd640 1 --2- 172.21.15.78:0/3461097164 >> v2:172.21.15.78:3300/0 conn(0x7f44ac06d9f0 0x7f44ac0b36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:01.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.293+0000 7f44aa7fc640 1 -- 172.21.15.78:0/3461097164 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1217452983 0 0) 0x7f44ac15d6d0 con 0x7f44ac06de70 2023-12-12T10:13:01.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.293+0000 7f44aa7fc640 1 -- 172.21.15.78:0/3461097164 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4494003530 con 0x7f44ac06de70 2023-12-12T10:13:01.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.293+0000 7f44aaffd640 1 -- 172.21.15.78:0/3461097164 >> v1:172.21.15.187:6789/0 conn(0x7f44ac15d2f0 legacy=0x7f44ac0722c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:01.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.293+0000 7f44aaffd640 1 -- 172.21.15.78:0/3461097164 >> v1:172.21.15.78:6789/0 conn(0x7f44ac06de70 legacy=0x7f44ac0abe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:01.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.293+0000 7f44aaffd640 1 -- 172.21.15.78:0/3461097164 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44ac0708e0 con 0x7f44ac06d9f0 2023-12-12T10:13:01.300 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.297+0000 7f44aaffd640 1 --2- 172.21.15.78:0/3461097164 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f44ac06d9f0 0x7f44ac0b36e0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f44a00097c0 tx=0x7f44a001c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c97562fbcd98ae55 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:01.300 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.297+0000 7f44aa7fc640 1 -- 172.21.15.78:0/3461097164 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a00ab600 con 0x7f44ac06d9f0 2023-12-12T10:13:01.300 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.297+0000 7f44aa7fc640 1 -- 172.21.15.78:0/3461097164 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44a00a7050 con 0x7f44ac06d9f0 2023-12-12T10:13:01.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.297+0000 7f44aa7fc640 1 -- 172.21.15.78:0/3461097164 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a00ab980 con 0x7f44ac06d9f0 2023-12-12T10:13:01.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.297+0000 7f44b1fe7640 1 -- 172.21.15.78:0/3461097164 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f44ac06d9f0 msgr2=0x7f44ac0b36e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:01.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.297+0000 7f44b1fe7640 1 --2- 172.21.15.78:0/3461097164 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f44ac06d9f0 0x7f44ac0b36e0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f44a00097c0 tx=0x7f44a001c3c0 comp rx=0 tx=0).stop 2023-12-12T10:13:01.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.297+0000 7f44b1fe7640 1 -- 172.21.15.78:0/3461097164 shutdown_connections 2023-12-12T10:13:01.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.297+0000 7f44b1fe7640 1 --2- 172.21.15.78:0/3461097164 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f44ac06d9f0 0x7f44ac0b36e0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:01.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.297+0000 7f44b1fe7640 1 -- 172.21.15.78:0/3461097164 >> 172.21.15.78:0/3461097164 conn(0x7f44ac0b0bb0 msgr2=0x7f44ac0b0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:01.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.297+0000 7f44b1fe7640 1 -- 172.21.15.78:0/3461097164 shutdown_connections 2023-12-12T10:13:01.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.297+0000 7f44b1fe7640 1 -- 172.21.15.78:0/3461097164 wait complete. 2023-12-12T10:13:01.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.297+0000 7f44b1fe7640 1 Processor -- start 2023-12-12T10:13:01.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.301+0000 7f44b1fe7640 1 -- start start 2023-12-12T10:13:01.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.301+0000 7f44b1fe7640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f44ac06d9f0 0x7f44ac139070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:01.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.301+0000 7f44b1fe7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f44ac06de70 0x7f44ac154c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:01.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.301+0000 7f44b1fe7640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f44ac15d2f0 0x7f44ac155190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:01.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.301+0000 7f44b1fe7640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44ac09be70 con 0x7f44ac06de70 2023-12-12T10:13:01.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.301+0000 7f44b1fe7640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44ac09b810 con 0x7f44ac15d2f0 2023-12-12T10:13:01.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.301+0000 7f44b1fe7640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44ac1502c0 con 0x7f44ac06d9f0 2023-12-12T10:13:01.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.301+0000 7f44aaffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f44ac06de70 0x7f44ac154c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:01.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.301+0000 7f44aaffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f44ac06de70 0x7f44ac154c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41784/0 (socket says 172.21.15.78:41784) 2023-12-12T10:13:01.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.301+0000 7f44aaffd640 1 -- 172.21.15.78:0/2617576034 learned_addr learned my addr 172.21.15.78:0/2617576034 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:13:01.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.301+0000 7f44ab7fe640 1 --2- 172.21.15.78:0/2617576034 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f44ac06d9f0 0x7f44ac139070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:01.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.301+0000 7f44abfff640 1 --2- 172.21.15.78:0/2617576034 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f44ac15d2f0 0x7f44ac155190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:01.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.301+0000 7f44aaffd640 1 -- 172.21.15.78:0/2617576034 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f44ac06d9f0 msgr2=0x7f44ac139070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:01.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.301+0000 7f44aaffd640 1 --2- 172.21.15.78:0/2617576034 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f44ac06d9f0 0x7f44ac139070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:01.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.301+0000 7f44aaffd640 1 -- 172.21.15.78:0/2617576034 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f44ac15d2f0 msgr2=0x7f44ac155190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:01.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.301+0000 7f44aaffd640 1 --2- 172.21.15.78:0/2617576034 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f44ac15d2f0 0x7f44ac155190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:01.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.301+0000 7f44aaffd640 1 -- 172.21.15.78:0/2617576034 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44a0009420 con 0x7f44ac06de70 2023-12-12T10:13:01.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.301+0000 7f44abfff640 1 --2- 172.21.15.78:0/2617576034 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f44ac15d2f0 0x7f44ac155190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T10:13:01.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.301+0000 7f44aaffd640 1 --2- 172.21.15.78:0/2617576034 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f44ac06de70 0x7f44ac154c50 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f44a00ae040 tx=0x7f44a0019160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:01.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.301+0000 7f4493fff640 1 -- 172.21.15.78:0/2617576034 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a00b4430 con 0x7f44ac06de70 2023-12-12T10:13:01.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.301+0000 7f4493fff640 1 -- 172.21.15.78:0/2617576034 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44a00b4590 con 0x7f44ac06de70 2023-12-12T10:13:01.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.301+0000 7f4493fff640 1 -- 172.21.15.78:0/2617576034 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44a00b4940 con 0x7f44ac06de70 2023-12-12T10:13:01.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.301+0000 7f44b1fe7640 1 -- 172.21.15.78:0/2617576034 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44ac139e30 con 0x7f44ac06de70 2023-12-12T10:13:01.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.301+0000 7f44b1fe7640 1 -- 172.21.15.78:0/2617576034 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44ac155aa0 con 0x7f44ac06de70 2023-12-12T10:13:01.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.301+0000 7f44b1fe7640 1 -- 172.21.15.78:0/2617576034 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44ac155c90 con 0x7f44ac06de70 2023-12-12T10:13:01.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.305+0000 7f4493fff640 1 -- 172.21.15.78:0/2617576034 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f44a00b2040 con 0x7f44ac06de70 2023-12-12T10:13:01.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.305+0000 7f4493fff640 1 --2- 172.21.15.78:0/2617576034 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f4498066470 0x7f4498068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:01.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.305+0000 7f4493fff640 1 -- 172.21.15.78:0/2617576034 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f44a011e090 con 0x7f44ac06de70 2023-12-12T10:13:01.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.305+0000 7f44ab7fe640 1 --2- 172.21.15.78:0/2617576034 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f4498066470 0x7f4498068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:01.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.305+0000 7f44ab7fe640 1 --2- 172.21.15.78:0/2617576034 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f4498066470 0x7f4498068930 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f449c007fd0 tx=0x7f449c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:01.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.309+0000 7f4493fff640 1 -- 172.21.15.78:0/2617576034 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f44a00eb140 con 0x7f44ac06de70 2023-12-12T10:13:01.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.457+0000 7f44b1fe7640 1 -- 172.21.15.78:0/2617576034 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f44ac067530 con 0x7f44ac06de70 2023-12-12T10:13:01.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.457+0000 7f4493fff640 1 -- 172.21.15.78:0/2617576034 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f44a00ee760 con 0x7f44ac06de70 2023-12-12T10:13:01.463 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2023-12-12T10:13:01.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.461+0000 7f44b1fe7640 1 -- 172.21.15.78:0/2617576034 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f4498066470 msgr2=0x7f4498068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:01.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.461+0000 7f44b1fe7640 1 --2- 172.21.15.78:0/2617576034 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f4498066470 0x7f4498068930 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f449c007fd0 tx=0x7f449c009040 comp rx=0 tx=0).stop 2023-12-12T10:13:01.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.461+0000 7f44b1fe7640 1 -- 172.21.15.78:0/2617576034 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f44ac06de70 msgr2=0x7f44ac154c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:01.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.461+0000 7f44b1fe7640 1 --2- 172.21.15.78:0/2617576034 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f44ac06de70 0x7f44ac154c50 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f44a00ae040 tx=0x7f44a0019160 comp rx=0 tx=0).stop 2023-12-12T10:13:01.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.461+0000 7f44b1fe7640 1 -- 172.21.15.78:0/2617576034 shutdown_connections 2023-12-12T10:13:01.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.461+0000 7f44b1fe7640 1 --2- 172.21.15.78:0/2617576034 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f4498066470 0x7f4498068930 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:01.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.461+0000 7f44b1fe7640 1 --2- 172.21.15.78:0/2617576034 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f44ac15d2f0 0x7f44ac155190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:01.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.461+0000 7f44b1fe7640 1 --2- 172.21.15.78:0/2617576034 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f44ac06de70 0x7f44ac154c50 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:01.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.461+0000 7f44b1fe7640 1 --2- 172.21.15.78:0/2617576034 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f44ac06d9f0 0x7f44ac139070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:01.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.461+0000 7f44b1fe7640 1 -- 172.21.15.78:0/2617576034 >> 172.21.15.78:0/2617576034 conn(0x7f44ac0b0bb0 msgr2=0x7f44ac0ad380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:01.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.461+0000 7f44b1fe7640 1 -- 172.21.15.78:0/2617576034 shutdown_connections 2023-12-12T10:13:01.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.461+0000 7f44b1fe7640 1 -- 172.21.15.78:0/2617576034 wait complete. 2023-12-12T10:13:01.484 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-12T10:13:01.622 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.617+0000 7f544e032640 1 Processor -- start 2023-12-12T10:13:01.622 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.617+0000 7f544e032640 1 -- start start 2023-12-12T10:13:01.623 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.617+0000 7f544e032640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5448143770 0x7f54480cdf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:01.623 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.617+0000 7f544e032640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f54480b1e20 0x7f5448070f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:01.623 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.617+0000 7f544e032640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5448070a70 con 0x7f54480b2280 2023-12-12T10:13:01.623 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.617+0000 7f544e032640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f544815e920 con 0x7f54480b1e20 2023-12-12T10:13:01.623 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.617+0000 7f544e032640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5448070440 con 0x7f5448143770 2023-12-12T10:13:01.623 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.621+0000 7f5447fff640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f54480b2280 0x7f544815a2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:36004/0 (socket says 172.21.15.78:36004) 2023-12-12T10:13:01.623 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.621+0000 7f5447fff640 1 -- 172.21.15.78:0/1735392238 learned_addr learned my addr 172.21.15.78:0/1735392238 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-12-12T10:13:01.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.621+0000 7f5446ffd640 1 --2- 172.21.15.78:0/1735392238 >> v2:172.21.15.187:3300/0 conn(0x7f54480b1e20 0x7f5448070f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:01.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.621+0000 7f54467fc640 1 -- 172.21.15.78:0/1735392238 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 859233257 0 0) 0x7f5448070a70 con 0x7f54480b2280 2023-12-12T10:13:01.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.621+0000 7f54467fc640 1 -- 172.21.15.78:0/1735392238 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5430005740 con 0x7f54480b2280 2023-12-12T10:13:01.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.621+0000 7f54477fe640 1 --2- 172.21.15.78:0/1735392238 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5448143770 0x7f54480cdf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:01.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.621+0000 7f54467fc640 1 -- 172.21.15.78:0/1735392238 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4189080317 0 0) 0x7f5430005740 con 0x7f54480b2280 2023-12-12T10:13:01.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.621+0000 7f54467fc640 1 -- 172.21.15.78:0/1735392238 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5448143770 msgr2=0x7f54480cdf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:13:01.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.621+0000 7f54467fc640 1 --2- 172.21.15.78:0/1735392238 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5448143770 0x7f54480cdf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:01.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.621+0000 7f54467fc640 1 -- 172.21.15.78:0/1735392238 >> v2:172.21.15.187:3300/0 conn(0x7f54480b1e20 msgr2=0x7f5448070f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:13:01.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.621+0000 7f54467fc640 1 --2- 172.21.15.78:0/1735392238 >> v2:172.21.15.187:3300/0 conn(0x7f54480b1e20 0x7f5448070f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:01.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.621+0000 7f54467fc640 1 -- 172.21.15.78:0/1735392238 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5448143b50 con 0x7f54480b2280 2023-12-12T10:13:01.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.621+0000 7f54467fc640 1 -- 172.21.15.78:0/1735392238 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 465499599 0 0) 0x7f5440001a00 con 0x7f54480b2280 2023-12-12T10:13:01.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.621+0000 7f54467fc640 1 -- 172.21.15.78:0/1735392238 >> v1:172.21.15.78:6789/0 conn(0x7f54480b2280 legacy=0x7f544815a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:01.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.621+0000 7f54467fc640 1 --2- 172.21.15.78:0/1735392238 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5430005b90 0x7f5430005fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:01.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.621+0000 7f54467fc640 1 --2- 172.21.15.78:0/1735392238 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f54300069e0 0x7f5430006e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:01.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.621+0000 7f54467fc640 1 --2- 172.21.15.78:0/1735392238 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5448143770 0x7f54300073a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:01.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.621+0000 7f54467fc640 1 -- 172.21.15.78:0/1735392238 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f544815e920 con 0x7f54300069e0 2023-12-12T10:13:01.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.621+0000 7f54467fc640 1 -- 172.21.15.78:0/1735392238 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5448070440 con 0x7f5430005b90 2023-12-12T10:13:01.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.621+0000 7f54467fc640 1 -- 172.21.15.78:0/1735392238 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f543000dc50 con 0x7f5448143770 2023-12-12T10:13:01.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.621+0000 7f5446ffd640 1 --2- 172.21.15.78:0/1735392238 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f54300069e0 0x7f5430006e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:01.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.621+0000 7f54477fe640 1 --2- 172.21.15.78:0/1735392238 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5430005b90 0x7f5430005fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:01.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.621+0000 7f5447fff640 1 --2- 172.21.15.78:0/1735392238 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5448143770 0x7f54300073a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:01.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.621+0000 7f5446ffd640 1 -- 172.21.15.78:0/1735392238 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5448143770 msgr2=0x7f54300073a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:13:01.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.621+0000 7f5446ffd640 1 --2- 172.21.15.78:0/1735392238 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5448143770 0x7f54300073a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:01.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.621+0000 7f5446ffd640 1 -- 172.21.15.78:0/1735392238 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5430005b90 msgr2=0x7f5430005fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:13:01.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.621+0000 7f5446ffd640 1 --2- 172.21.15.78:0/1735392238 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5430005b90 0x7f5430005fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:01.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.621+0000 7f5446ffd640 1 -- 172.21.15.78:0/1735392238 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5430005740 con 0x7f54300069e0 2023-12-12T10:13:01.627 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.621+0000 7f54477fe640 1 --2- 172.21.15.78:0/1735392238 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5430005b90 0x7f5430005fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T10:13:01.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.625+0000 7f5446ffd640 1 --2- 172.21.15.78:0/1735392238 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f54300069e0 0x7f5430006e60 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f543c009ab0 tx=0x7f543c01ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c377a3aeb95d43d server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:01.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.625+0000 7f54467fc640 1 -- 172.21.15.78:0/1735392238 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f543c0a5610 con 0x7f54300069e0 2023-12-12T10:13:01.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.625+0000 7f54467fc640 1 -- 172.21.15.78:0/1735392238 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f543c0a5770 con 0x7f54300069e0 2023-12-12T10:13:01.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.625+0000 7f54467fc640 1 -- 172.21.15.78:0/1735392238 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f543c0a5b20 con 0x7f54300069e0 2023-12-12T10:13:01.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.625+0000 7f544e032640 1 -- 172.21.15.78:0/1735392238 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f54300069e0 msgr2=0x7f5430006e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:01.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.625+0000 7f544e032640 1 --2- 172.21.15.78:0/1735392238 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f54300069e0 0x7f5430006e60 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f543c009ab0 tx=0x7f543c01ca20 comp rx=0 tx=0).stop 2023-12-12T10:13:01.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.625+0000 7f5447fff640 1 -- 172.21.15.78:0/1735392238 reap_dead start 2023-12-12T10:13:01.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.625+0000 7f544e032640 1 -- 172.21.15.78:0/1735392238 shutdown_connections 2023-12-12T10:13:01.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.625+0000 7f544e032640 1 -- 172.21.15.78:0/1735392238 >> 172.21.15.78:0/1735392238 conn(0x7f544806a710 msgr2=0x7f544806ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:01.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.625+0000 7f544e032640 1 -- 172.21.15.78:0/1735392238 shutdown_connections 2023-12-12T10:13:01.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.625+0000 7f544e032640 1 -- 172.21.15.78:0/1735392238 wait complete. 2023-12-12T10:13:01.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.625+0000 7f544e032640 1 Processor -- start 2023-12-12T10:13:01.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.625+0000 7f544e032640 1 -- start start 2023-12-12T10:13:01.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.629+0000 7f544e032640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f54300069e0 0x7f544813b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:01.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.629+0000 7f544e032640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5448156d50 0x7f54481e9b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:01.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.629+0000 7f544e032640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f54480afda0 0x7f54480b0250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:01.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.629+0000 7f544e032640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54480afa90 con 0x7f54300069e0 2023-12-12T10:13:01.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.629+0000 7f544e032640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54480b0790 con 0x7f5448156d50 2023-12-12T10:13:01.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.629+0000 7f544e032640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54481ea200 con 0x7f54480afda0 2023-12-12T10:13:01.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.629+0000 7f54477fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f54300069e0 0x7f544813b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:01.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.629+0000 7f54477fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f54300069e0 0x7f544813b470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41806/0 (socket says 172.21.15.78:41806) 2023-12-12T10:13:01.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.629+0000 7f54477fe640 1 -- 172.21.15.78:0/3998472429 learned_addr learned my addr 172.21.15.78:0/3998472429 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:13:01.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.629+0000 7f54477fe640 1 -- 172.21.15.78:0/3998472429 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f54480afda0 msgr2=0x7f54480b0250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:01.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.629+0000 7f54477fe640 1 --2- 172.21.15.78:0/3998472429 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f54480afda0 0x7f54480b0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:01.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.629+0000 7f54477fe640 1 -- 172.21.15.78:0/3998472429 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5448156d50 msgr2=0x7f54481e9b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:01.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.629+0000 7f54477fe640 1 --2- 172.21.15.78:0/3998472429 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5448156d50 0x7f54481e9b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:01.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.629+0000 7f54477fe640 1 -- 172.21.15.78:0/3998472429 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54480af0f0 con 0x7f54300069e0 2023-12-12T10:13:01.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.629+0000 7f54477fe640 1 --2- 172.21.15.78:0/3998472429 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f54300069e0 0x7f544813b470 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f543800f510 tx=0x7f543800f9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:01.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.629+0000 7f542ffff640 1 -- 172.21.15.78:0/3998472429 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5438014870 con 0x7f54300069e0 2023-12-12T10:13:01.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.629+0000 7f542ffff640 1 -- 172.21.15.78:0/3998472429 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54380149d0 con 0x7f54300069e0 2023-12-12T10:13:01.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.629+0000 7f542ffff640 1 -- 172.21.15.78:0/3998472429 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5438014d60 con 0x7f54300069e0 2023-12-12T10:13:01.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.629+0000 7f544e032640 1 -- 172.21.15.78:0/3998472429 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54480af3d0 con 0x7f54300069e0 2023-12-12T10:13:01.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.629+0000 7f544e032640 1 -- 172.21.15.78:0/3998472429 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f544813bc60 con 0x7f54300069e0 2023-12-12T10:13:01.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.629+0000 7f544e032640 1 -- 172.21.15.78:0/3998472429 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54480671f0 con 0x7f54300069e0 2023-12-12T10:13:01.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.629+0000 7f542ffff640 1 -- 172.21.15.78:0/3998472429 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f543801d400 con 0x7f54300069e0 2023-12-12T10:13:01.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.633+0000 7f542ffff640 1 --2- 172.21.15.78:0/3998472429 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f5434066470 0x7f5434068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:01.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.633+0000 7f542ffff640 1 -- 172.21.15.78:0/3998472429 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f5438084860 con 0x7f54300069e0 2023-12-12T10:13:01.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.633+0000 7f5446ffd640 1 --2- 172.21.15.78:0/3998472429 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f5434066470 0x7f5434068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:01.637 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.633+0000 7f5446ffd640 1 --2- 172.21.15.78:0/3998472429 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f5434066470 0x7f5434068930 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f543c0af000 tx=0x7f543c004740 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:01.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.637+0000 7f542ffff640 1 -- 172.21.15.78:0/3998472429 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5438051910 con 0x7f54300069e0 2023-12-12T10:13:01.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.797+0000 7f544e032640 1 -- 172.21.15.78:0/3998472429 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f5448067530 con 0x7f54300069e0 2023-12-12T10:13:01.802 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.797+0000 7f542ffff640 1 -- 172.21.15.78:0/3998472429 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f5438054f30 con 0x7f54300069e0 2023-12-12T10:13:01.802 INFO:teuthology.orchestra.run.smithi078.stderr:listed 0 entries 2023-12-12T10:13:01.803 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.801+0000 7f544e032640 1 -- 172.21.15.78:0/3998472429 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f5434066470 msgr2=0x7f5434068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:01.803 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.801+0000 7f544e032640 1 --2- 172.21.15.78:0/3998472429 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f5434066470 0x7f5434068930 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f543c0af000 tx=0x7f543c004740 comp rx=0 tx=0).stop 2023-12-12T10:13:01.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.801+0000 7f544e032640 1 -- 172.21.15.78:0/3998472429 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f54300069e0 msgr2=0x7f544813b470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:01.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.801+0000 7f544e032640 1 --2- 172.21.15.78:0/3998472429 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f54300069e0 0x7f544813b470 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f543800f510 tx=0x7f543800f9d0 comp rx=0 tx=0).stop 2023-12-12T10:13:01.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.801+0000 7f544e032640 1 -- 172.21.15.78:0/3998472429 shutdown_connections 2023-12-12T10:13:01.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.801+0000 7f544e032640 1 --2- 172.21.15.78:0/3998472429 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f5434066470 0x7f5434068930 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:01.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.801+0000 7f544e032640 1 --2- 172.21.15.78:0/3998472429 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f54480afda0 0x7f54480b0250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:01.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.801+0000 7f544e032640 1 --2- 172.21.15.78:0/3998472429 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5448156d50 0x7f54481e9b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:01.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.801+0000 7f544e032640 1 --2- 172.21.15.78:0/3998472429 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f54300069e0 0x7f544813b470 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:01.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.801+0000 7f544e032640 1 -- 172.21.15.78:0/3998472429 >> 172.21.15.78:0/3998472429 conn(0x7f544806a710 msgr2=0x7f5448159940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:01.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.801+0000 7f544e032640 1 -- 172.21.15.78:0/3998472429 shutdown_connections 2023-12-12T10:13:01.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:01.801+0000 7f544e032640 1 -- 172.21.15.78:0/3998472429 wait complete. 2023-12-12T10:13:01.822 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi078.front.sepia.ceph.com... 2023-12-12T10:13:01.823 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T10:13:01.823 DEBUG:teuthology.orchestra.run.smithi078:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-12-12T10:13:01.844 INFO:teuthology.orchestra.run:waiting for 300 2023-12-12T10:13:01.844 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi078.front.sepia.ceph.com 2023-12-12T10:13:01.844 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T10:13:01.844 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-12T10:13:01.896 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-12-12T10:13:01.896 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-12T10:13:01.906 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-12-12T10:13:01.906 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-12T10:13:01.962 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T10:13:02.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.097+0000 7fbcf612a640 1 Processor -- start 2023-12-12T10:13:02.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.097+0000 7fbcf612a640 1 -- start start 2023-12-12T10:13:02.103 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.101+0000 7fbcf612a640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fbcf00cb5d0 0x7fbcf00cba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:02.104 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.101+0000 7fbcf612a640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcf00cbf70 con 0x7fbcf0158d80 2023-12-12T10:13:02.104 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.101+0000 7fbcf612a640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcf006c1a0 con 0x7fbcf006c630 2023-12-12T10:13:02.104 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.101+0000 7fbcf612a640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcf00718f0 con 0x7fbcf00cb5d0 2023-12-12T10:13:02.104 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.101+0000 7fbcef7fe640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fbcf0158d80 0x7fbcf0070e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:36016/0 (socket says 172.21.15.78:36016) 2023-12-12T10:13:02.104 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.101+0000 7fbcef7fe640 1 -- 172.21.15.78:0/245164104 learned_addr learned my addr 172.21.15.78:0/245164104 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-12-12T10:13:02.104 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.101+0000 7fbceeffd640 1 --2- 172.21.15.78:0/245164104 >> v2:172.21.15.187:3300/0 conn(0x7fbcf00cb5d0 0x7fbcf00cba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:02.105 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.101+0000 7fbcee7fc640 1 -- 172.21.15.78:0/245164104 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2013413364 0 0) 0x7fbcf00cbf70 con 0x7fbcf0158d80 2023-12-12T10:13:02.105 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.101+0000 7fbcee7fc640 1 -- 172.21.15.78:0/245164104 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbcd8003530 con 0x7fbcf0158d80 2023-12-12T10:13:02.105 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.101+0000 7fbceeffd640 1 -- 172.21.15.78:0/245164104 >> v1:172.21.15.187:6789/0 conn(0x7fbcf006c630 legacy=0x7fbcf006caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:02.105 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.101+0000 7fbcee7fc640 1 -- 172.21.15.78:0/245164104 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2715841765 0 0) 0x7fbcd8003530 con 0x7fbcf0158d80 2023-12-12T10:13:02.105 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.101+0000 7fbceeffd640 1 -- 172.21.15.78:0/245164104 >> v1:172.21.15.78:6789/0 conn(0x7fbcf0158d80 legacy=0x7fbcf0070e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:02.105 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.101+0000 7fbceeffd640 1 -- 172.21.15.78:0/245164104 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcf0071bd0 con 0x7fbcf00cb5d0 2023-12-12T10:13:02.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.105+0000 7fbceeffd640 1 --2- 172.21.15.78:0/245164104 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbcf00cb5d0 0x7fbcf00cba30 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fbce40097c0 tx=0x7fbce401c2e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4f571e2a039f8e1f server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:02.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.105+0000 7fbcee7fc640 1 -- 172.21.15.78:0/245164104 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbce0001680 con 0x7fbcf00cb5d0 2023-12-12T10:13:02.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.105+0000 7fbcee7fc640 1 -- 172.21.15.78:0/245164104 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbce40a7050 con 0x7fbcf00cb5d0 2023-12-12T10:13:02.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.105+0000 7fbcee7fc640 1 -- 172.21.15.78:0/245164104 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbce40ab600 con 0x7fbcf00cb5d0 2023-12-12T10:13:02.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.105+0000 7fbcf612a640 1 -- 172.21.15.78:0/245164104 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbcf00cb5d0 msgr2=0x7fbcf00cba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:02.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.105+0000 7fbcf612a640 1 --2- 172.21.15.78:0/245164104 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbcf00cb5d0 0x7fbcf00cba30 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fbce40097c0 tx=0x7fbce401c2e0 comp rx=0 tx=0).stop 2023-12-12T10:13:02.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.105+0000 7fbcf612a640 1 -- 172.21.15.78:0/245164104 shutdown_connections 2023-12-12T10:13:02.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.105+0000 7fbcf612a640 1 --2- 172.21.15.78:0/245164104 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbcf00cb5d0 0x7fbcf00cba30 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:02.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.105+0000 7fbcf612a640 1 -- 172.21.15.78:0/245164104 >> 172.21.15.78:0/245164104 conn(0x7fbcf00b0960 msgr2=0x7fbcf00b0d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:02.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.105+0000 7fbcf612a640 1 -- 172.21.15.78:0/245164104 shutdown_connections 2023-12-12T10:13:02.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.105+0000 7fbcf612a640 1 -- 172.21.15.78:0/245164104 wait complete. 2023-12-12T10:13:02.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.105+0000 7fbcf612a640 1 Processor -- start 2023-12-12T10:13:02.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.105+0000 7fbcf612a640 1 -- start start 2023-12-12T10:13:02.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.105+0000 7fbcf612a640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbcf006c630 0x7fbcf0165bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:02.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.105+0000 7fbcf612a640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbcf00cb5d0 0x7fbcf01572b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:02.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.105+0000 7fbcf612a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbcf0158d80 0x7fbcf0164100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:02.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.105+0000 7fbcf612a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcf0164b50 con 0x7fbcf0158d80 2023-12-12T10:13:02.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.105+0000 7fbcf612a640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcf0164e30 con 0x7fbcf00cb5d0 2023-12-12T10:13:02.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.105+0000 7fbcf612a640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcf0165110 con 0x7fbcf006c630 2023-12-12T10:13:02.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.109+0000 7fbceffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbcf0158d80 0x7fbcf0164100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:02.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.109+0000 7fbceffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbcf0158d80 0x7fbcf0164100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41822/0 (socket says 172.21.15.78:41822) 2023-12-12T10:13:02.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.109+0000 7fbceffff640 1 -- 172.21.15.78:0/2132727723 learned_addr learned my addr 172.21.15.78:0/2132727723 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:13:02.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.109+0000 7fbcef7fe640 1 --2- 172.21.15.78:0/2132727723 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbcf006c630 0x7fbcf0165bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:02.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.109+0000 7fbceeffd640 1 --2- 172.21.15.78:0/2132727723 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbcf00cb5d0 0x7fbcf01572b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:02.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.109+0000 7fbceffff640 1 -- 172.21.15.78:0/2132727723 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbcf006c630 msgr2=0x7fbcf0165bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:02.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.109+0000 7fbceffff640 1 --2- 172.21.15.78:0/2132727723 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbcf006c630 0x7fbcf0165bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:02.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.109+0000 7fbceffff640 1 -- 172.21.15.78:0/2132727723 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbcf00cb5d0 msgr2=0x7fbcf01572b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:02.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.109+0000 7fbceffff640 1 --2- 172.21.15.78:0/2132727723 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbcf00cb5d0 0x7fbcf01572b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:02.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.109+0000 7fbceffff640 1 -- 172.21.15.78:0/2132727723 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbce4009420 con 0x7fbcf0158d80 2023-12-12T10:13:02.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.109+0000 7fbceffff640 1 --2- 172.21.15.78:0/2132727723 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbcf0158d80 0x7fbcf0164100 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fbce800c6c0 tx=0x7fbce800cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:02.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.109+0000 7fbcd7fff640 1 -- 172.21.15.78:0/2132727723 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbce8003b80 con 0x7fbcf0158d80 2023-12-12T10:13:02.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.109+0000 7fbcd7fff640 1 -- 172.21.15.78:0/2132727723 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbce8003ce0 con 0x7fbcf0158d80 2023-12-12T10:13:02.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.109+0000 7fbcd7fff640 1 -- 172.21.15.78:0/2132727723 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbce80052f0 con 0x7fbcf0158d80 2023-12-12T10:13:02.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.109+0000 7fbcf612a640 1 -- 172.21.15.78:0/2132727723 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcf01653f0 con 0x7fbcf0158d80 2023-12-12T10:13:02.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.109+0000 7fbcf612a640 1 -- 172.21.15.78:0/2132727723 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcf0157b10 con 0x7fbcf0158d80 2023-12-12T10:13:02.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.109+0000 7fbcf612a640 1 -- 172.21.15.78:0/2132727723 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcf00671f0 con 0x7fbcf0158d80 2023-12-12T10:13:02.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.109+0000 7fbcd7fff640 1 -- 172.21.15.78:0/2132727723 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fbce8005450 con 0x7fbcf0158d80 2023-12-12T10:13:02.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.109+0000 7fbcd7fff640 1 --2- 172.21.15.78:0/2132727723 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fbcdc066470 0x7fbcdc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:02.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.109+0000 7fbcd7fff640 1 -- 172.21.15.78:0/2132727723 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fbce8084090 con 0x7fbcf0158d80 2023-12-12T10:13:02.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.113+0000 7fbcef7fe640 1 --2- 172.21.15.78:0/2132727723 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fbcdc066470 0x7fbcdc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:02.116 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.113+0000 7fbcef7fe640 1 --2- 172.21.15.78:0/2132727723 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fbcdc066470 0x7fbcdc068930 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fbce0005890 tx=0x7fbce0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:02.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.113+0000 7fbcd7fff640 1 -- 172.21.15.78:0/2132727723 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fbce80510b0 con 0x7fbcf0158d80 2023-12-12T10:13:02.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.269+0000 7fbcf612a640 1 -- 172.21.15.78:0/2132727723 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbcf006fd70 con 0x7fbcf0158d80 2023-12-12T10:13:02.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.269+0000 7fbcd7fff640 1 -- 172.21.15.78:0/2132727723 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18701 (secure 0 0 0) 0x7fbce80546d0 con 0x7fbcf0158d80 2023-12-12T10:13:02.274 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:13:02.275 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":26,"fsid":"fc81937c-bd26-483c-952b-d1324fcb0c9e","created":"2023-12-12T10:11:44.020214+0000","modified":"2023-12-12T10:12:50.919344+0000","last_up_change":"2023-12-12T10:11:56.278318+0000","last_in_change":"2023-12-12T10:11:46.553610+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T10:11:57.053584+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-12T10:12:07.454450+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-12T10:12:08.182909+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-12T10:12:11.977952+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"22dfdedf-5f6c-4b20-9f6c-30517a1db70a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6809","nonce":3345683600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6811","nonce":3345683600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6815","nonce":3345683600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6813","nonce":3345683600}]},"public_addr":"172.21.15.78:6809/3345683600","cluster_addr":"172.21.15.78:6811/3345683600","heartbeat_back_addr":"172.21.15.78:6815/3345683600","heartbeat_front_addr":"172.21.15.78:6813/3345683600","state":["exists","up"]},{"osd":1,"uuid":"be34a7f3-a69a-462e-9ddf-5e537448dba2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6801","nonce":962652768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6803","nonce":962652768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6807","nonce":962652768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6805","nonce":962652768}]},"public_addr":"172.21.15.78:6801/962652768","cluster_addr":"172.21.15.78:6803/962652768","heartbeat_back_addr":"172.21.15.78:6807/962652768","heartbeat_front_addr":"172.21.15.78:6805/962652768","state":["exists","up"]},{"osd":2,"uuid":"55b381de-5f56-4b14-80f7-e6e41e084a13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6818","nonce":2910206054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6822","nonce":2910206054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6829","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6831","nonce":2910206054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6826","nonce":2910206054}]},"public_addr":"172.21.15.78:6818/2910206054","cluster_addr":"172.21.15.78:6822/2910206054","heartbeat_back_addr":"172.21.15.78:6831/2910206054","heartbeat_front_addr":"172.21.15.78:6826/2910206054","state":["exists","up"]},{"osd":3,"uuid":"d7682de1-25cb-4cec-869f-8851c28b0e6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6819","nonce":3750796703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6821","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6823","nonce":3750796703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6830","nonce":3750796703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6825","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6827","nonce":3750796703}]},"public_addr":"172.21.15.78:6819/3750796703","cluster_addr":"172.21.15.78:6823/3750796703","heartbeat_back_addr":"172.21.15.78:6830/3750796703","heartbeat_front_addr":"172.21.15.78:6827/3750796703","state":["exists","up"]},{"osd":4,"uuid":"8279815a-d6c7-4199-871e-d28971b9dc07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6809","nonce":2944277204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6811","nonce":2944277204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6815","nonce":2944277204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6813","nonce":2944277204}]},"public_addr":"172.21.15.187:6809/2944277204","cluster_addr":"172.21.15.187:6811/2944277204","heartbeat_back_addr":"172.21.15.187:6815/2944277204","heartbeat_front_addr":"172.21.15.187:6813/2944277204","state":["exists","up"]},{"osd":5,"uuid":"0a714c65-f8ce-4340-968f-11a799677ef3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6801","nonce":185858620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6803","nonce":185858620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6807","nonce":185858620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6805","nonce":185858620}]},"public_addr":"172.21.15.187:6801/185858620","cluster_addr":"172.21.15.187:6803/185858620","heartbeat_back_addr":"172.21.15.187:6807/185858620","heartbeat_front_addr":"172.21.15.187:6805/185858620","state":["exists","up"]},{"osd":6,"uuid":"d0bba9ab-f7ee-449e-8999-1c0cf7e6d53c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6817","nonce":4213392126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6819","nonce":4213392126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6824","nonce":4213392126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6821","nonce":4213392126}]},"public_addr":"172.21.15.187:6817/4213392126","cluster_addr":"172.21.15.187:6819/4213392126","heartbeat_back_addr":"172.21.15.187:6824/4213392126","heartbeat_front_addr":"172.21.15.187:6821/4213392126","state":["exists","up"]},{"osd":7,"uuid":"efe5e0d9-2f87-4889-a27a-e2a95a632302","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6823","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6825","nonce":85774004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6827","nonce":85774004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6831","nonce":85774004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6829","nonce":85774004}]},"public_addr":"172.21.15.187:6825/85774004","cluster_addr":"172.21.15.187:6827/85774004","heartbeat_back_addr":"172.21.15.187:6831/85774004","heartbeat_front_addr":"172.21.15.187:6829/85774004","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.214447+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.448899+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.293107+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.564184+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.175026+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.097717+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.261141+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.287681+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.18","mappings":[{"from":3,"to":2}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.13","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T10:13:02.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.273+0000 7fbcf612a640 1 -- 172.21.15.78:0/2132727723 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fbcdc066470 msgr2=0x7fbcdc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:02.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.273+0000 7fbcf612a640 1 --2- 172.21.15.78:0/2132727723 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fbcdc066470 0x7fbcdc068930 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fbce0005890 tx=0x7fbce0009040 comp rx=0 tx=0).stop 2023-12-12T10:13:02.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.273+0000 7fbcf612a640 1 -- 172.21.15.78:0/2132727723 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbcf0158d80 msgr2=0x7fbcf0164100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:02.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.273+0000 7fbcf612a640 1 --2- 172.21.15.78:0/2132727723 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbcf0158d80 0x7fbcf0164100 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fbce800c6c0 tx=0x7fbce800cb80 comp rx=0 tx=0).stop 2023-12-12T10:13:02.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.273+0000 7fbcf612a640 1 -- 172.21.15.78:0/2132727723 shutdown_connections 2023-12-12T10:13:02.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.273+0000 7fbcf612a640 1 --2- 172.21.15.78:0/2132727723 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fbcdc066470 0x7fbcdc068930 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:02.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.273+0000 7fbcf612a640 1 --2- 172.21.15.78:0/2132727723 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbcf0158d80 0x7fbcf0164100 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:02.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.273+0000 7fbcf612a640 1 --2- 172.21.15.78:0/2132727723 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbcf00cb5d0 0x7fbcf01572b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:02.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.273+0000 7fbcf612a640 1 --2- 172.21.15.78:0/2132727723 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbcf006c630 0x7fbcf0165bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:02.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.273+0000 7fbcf612a640 1 -- 172.21.15.78:0/2132727723 >> 172.21.15.78:0/2132727723 conn(0x7fbcf00b0960 msgr2=0x7fbcf00cd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:02.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.273+0000 7fbcf612a640 1 -- 172.21.15.78:0/2132727723 shutdown_connections 2023-12-12T10:13:02.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.273+0000 7fbcf612a640 1 -- 172.21.15.78:0/2132727723 wait complete. 2023-12-12T10:13:02.296 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-12T10:11:57.053584+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-12T10:12:07.454450+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-12T10:12:08.182909+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-12T10:12:11.977952+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-12T10:13:02.296 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-12T10:13:02.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.433+0000 7fa5b38c9640 1 Processor -- start 2023-12-12T10:13:02.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.433+0000 7fa5b38c9640 1 -- start start 2023-12-12T10:13:02.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.433+0000 7fa5b38c9640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fa5ac143770 0x7fa5ac0cdf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:02.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.433+0000 7fa5b38c9640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa5ac0b1e20 0x7fa5ac070f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:02.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.433+0000 7fa5b38c9640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa5ac0b2280 0x7fa5ac071440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:02.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.433+0000 7fa5b38c9640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5ac070a70 con 0x7fa5ac0b1e20 2023-12-12T10:13:02.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.433+0000 7fa5b38c9640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5ac070440 con 0x7fa5ac143770 2023-12-12T10:13:02.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.433+0000 7fa5b38c9640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5ac143b50 con 0x7fa5ac0b2280 2023-12-12T10:13:02.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.437+0000 7fa5b0e64640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa5ac0b1e20 0x7fa5ac070f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:02.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.437+0000 7fa5b0e64640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa5ac0b1e20 0x7fa5ac070f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41834/0 (socket says 172.21.15.78:41834) 2023-12-12T10:13:02.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.437+0000 7fa5b0e64640 1 -- 172.21.15.78:0/481254528 learned_addr learned my addr 172.21.15.78:0/481254528 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:13:02.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.437+0000 7fa5b1e66640 1 --2- 172.21.15.78:0/481254528 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa5ac0b2280 0x7fa5ac071440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:02.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.437+0000 7fa5b1665640 1 --2- 172.21.15.78:0/481254528 >> v2:172.21.15.187:3300/0 conn(0x7fa5ac143770 0x7fa5ac0cdf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:02.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.437+0000 7fa5b0e64640 1 -- 172.21.15.78:0/481254528 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa5ac0b2280 msgr2=0x7fa5ac071440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:13:02.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.437+0000 7fa5b0e64640 1 --2- 172.21.15.78:0/481254528 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa5ac0b2280 0x7fa5ac071440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:02.440 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.437+0000 7fa5b0e64640 1 -- 172.21.15.78:0/481254528 >> v2:172.21.15.187:3300/0 conn(0x7fa5ac143770 msgr2=0x7fa5ac0cdf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:13:02.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.437+0000 7fa5b0e64640 1 --2- 172.21.15.78:0/481254528 >> v2:172.21.15.187:3300/0 conn(0x7fa5ac143770 0x7fa5ac0cdf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:02.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.437+0000 7fa5b0e64640 1 -- 172.21.15.78:0/481254528 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5ac0ce620 con 0x7fa5ac0b1e20 2023-12-12T10:13:02.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.437+0000 7fa5b0e64640 1 --2- 172.21.15.78:0/481254528 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5ac0b1e20 0x7fa5ac070f00 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fa5ac06b500 tx=0x7fa59c01c320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=daac1225430cb25 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:02.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.437+0000 7fa5a3fff640 1 -- 172.21.15.78:0/481254528 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa59c0ab600 con 0x7fa5ac0b1e20 2023-12-12T10:13:02.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.437+0000 7fa5a3fff640 1 -- 172.21.15.78:0/481254528 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa59c0a7050 con 0x7fa5ac0b1e20 2023-12-12T10:13:02.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.437+0000 7fa5a3fff640 1 -- 172.21.15.78:0/481254528 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa59c0ab980 con 0x7fa5ac0b1e20 2023-12-12T10:13:02.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.441+0000 7fa5b38c9640 1 -- 172.21.15.78:0/481254528 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5ac0b1e20 msgr2=0x7fa5ac070f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:02.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.441+0000 7fa5b38c9640 1 --2- 172.21.15.78:0/481254528 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5ac0b1e20 0x7fa5ac070f00 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fa5ac06b500 tx=0x7fa59c01c320 comp rx=0 tx=0).stop 2023-12-12T10:13:02.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.441+0000 7fa5b38c9640 1 -- 172.21.15.78:0/481254528 shutdown_connections 2023-12-12T10:13:02.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.441+0000 7fa5b38c9640 1 --2- 172.21.15.78:0/481254528 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa5ac0b2280 0x7fa5ac071440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:02.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.441+0000 7fa5b38c9640 1 --2- 172.21.15.78:0/481254528 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5ac0b1e20 0x7fa5ac070f00 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:02.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.441+0000 7fa5b38c9640 1 --2- 172.21.15.78:0/481254528 >> v2:172.21.15.187:3300/0 conn(0x7fa5ac143770 0x7fa5ac0cdf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:02.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.441+0000 7fa5b38c9640 1 -- 172.21.15.78:0/481254528 >> 172.21.15.78:0/481254528 conn(0x7fa5ac06a710 msgr2=0x7fa5ac06ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:02.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.441+0000 7fa5b38c9640 1 -- 172.21.15.78:0/481254528 shutdown_connections 2023-12-12T10:13:02.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.441+0000 7fa5b38c9640 1 -- 172.21.15.78:0/481254528 wait complete. 2023-12-12T10:13:02.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.441+0000 7fa5b38c9640 1 Processor -- start 2023-12-12T10:13:02.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.441+0000 7fa5b38c9640 1 -- start start 2023-12-12T10:13:02.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.441+0000 7fa5b38c9640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa5ac0b1e20 0x7fa5ac1380d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:02.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.441+0000 7fa5b38c9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5ac0b2280 0x7fa5ac1f6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:02.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.441+0000 7fa5b38c9640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa5ac143770 0x7fa5ac0afc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:02.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.441+0000 7fa5b38c9640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5ac1373e0 con 0x7fa5ac0b2280 2023-12-12T10:13:02.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.441+0000 7fa5b38c9640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5ac137c40 con 0x7fa5ac0b1e20 2023-12-12T10:13:02.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.441+0000 7fa5b38c9640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5ac1f6840 con 0x7fa5ac143770 2023-12-12T10:13:02.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.441+0000 7fa5b0e64640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5ac0b2280 0x7fa5ac1f6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:02.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.441+0000 7fa5b0e64640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5ac0b2280 0x7fa5ac1f6300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41842/0 (socket says 172.21.15.78:41842) 2023-12-12T10:13:02.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.441+0000 7fa5b0e64640 1 -- 172.21.15.78:0/2429245143 learned_addr learned my addr 172.21.15.78:0/2429245143 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:13:02.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.441+0000 7fa5b1665640 1 --2- 172.21.15.78:0/2429245143 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa5ac0b1e20 0x7fa5ac1380d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:02.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.441+0000 7fa5b1e66640 1 --2- 172.21.15.78:0/2429245143 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa5ac143770 0x7fa5ac0afc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:02.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.445+0000 7fa5b0e64640 1 -- 172.21.15.78:0/2429245143 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa5ac143770 msgr2=0x7fa5ac0afc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:02.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.445+0000 7fa5b0e64640 1 --2- 172.21.15.78:0/2429245143 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa5ac143770 0x7fa5ac0afc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:02.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.445+0000 7fa5b0e64640 1 -- 172.21.15.78:0/2429245143 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa5ac0b1e20 msgr2=0x7fa5ac1380d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:02.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.445+0000 7fa5b0e64640 1 --2- 172.21.15.78:0/2429245143 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa5ac0b1e20 0x7fa5ac1380d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:02.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.445+0000 7fa5b0e64640 1 -- 172.21.15.78:0/2429245143 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa59c0094d0 con 0x7fa5ac0b2280 2023-12-12T10:13:02.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.445+0000 7fa5b1e66640 1 --2- 172.21.15.78:0/2429245143 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa5ac143770 0x7fa5ac0afc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T10:13:02.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.445+0000 7fa5b0e64640 1 --2- 172.21.15.78:0/2429245143 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5ac0b2280 0x7fa5ac1f6300 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fa59c01a9d0 tx=0x7fa59c0190c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:02.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.445+0000 7fa5a1ffb640 1 -- 172.21.15.78:0/2429245143 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa59c0b37d0 con 0x7fa5ac0b2280 2023-12-12T10:13:02.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.445+0000 7fa5a1ffb640 1 -- 172.21.15.78:0/2429245143 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa59c0b3930 con 0x7fa5ac0b2280 2023-12-12T10:13:02.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.445+0000 7fa5b38c9640 1 -- 172.21.15.78:0/2429245143 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5ac1f9be0 con 0x7fa5ac0b2280 2023-12-12T10:13:02.449 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.445+0000 7fa5a1ffb640 1 -- 172.21.15.78:0/2429245143 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa59c0b3ca0 con 0x7fa5ac0b2280 2023-12-12T10:13:02.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.445+0000 7fa5b38c9640 1 -- 172.21.15.78:0/2429245143 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5ac1378d0 con 0x7fa5ac0b2280 2023-12-12T10:13:02.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.445+0000 7fa5b38c9640 1 -- 172.21.15.78:0/2429245143 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5ac0671f0 con 0x7fa5ac0b2280 2023-12-12T10:13:02.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.445+0000 7fa5a1ffb640 1 -- 172.21.15.78:0/2429245143 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa59c0b2070 con 0x7fa5ac0b2280 2023-12-12T10:13:02.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.445+0000 7fa5a1ffb640 1 --2- 172.21.15.78:0/2429245143 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fa590066470 0x7fa590068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:02.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.445+0000 7fa5a1ffb640 1 -- 172.21.15.78:0/2429245143 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa59c11e460 con 0x7fa5ac0b2280 2023-12-12T10:13:02.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.449+0000 7fa5b1665640 1 --2- 172.21.15.78:0/2429245143 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fa590066470 0x7fa590068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:02.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.449+0000 7fa5b1665640 1 --2- 172.21.15.78:0/2429245143 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fa590066470 0x7fa590068930 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fa5ac0cd100 tx=0x7fa5a8009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:02.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.449+0000 7fa5a1ffb640 1 -- 172.21.15.78:0/2429245143 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa59c0eb5a0 con 0x7fa5ac0b2280 2023-12-12T10:13:02.605 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.601+0000 7fa5b38c9640 1 -- 172.21.15.78:0/2429245143 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa5ac137db0 con 0x7fa5ac0b2280 2023-12-12T10:13:02.605 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.601+0000 7fa5a1ffb640 1 -- 172.21.15.78:0/2429245143 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa59c0eebc0 con 0x7fa5ac0b2280 2023-12-12T10:13:02.605 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2023-12-12T10:13:02.607 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.601+0000 7fa5b38c9640 1 -- 172.21.15.78:0/2429245143 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fa590066470 msgr2=0x7fa590068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:02.607 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.601+0000 7fa5b38c9640 1 --2- 172.21.15.78:0/2429245143 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fa590066470 0x7fa590068930 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fa5ac0cd100 tx=0x7fa5a8009190 comp rx=0 tx=0).stop 2023-12-12T10:13:02.607 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.601+0000 7fa5b38c9640 1 -- 172.21.15.78:0/2429245143 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5ac0b2280 msgr2=0x7fa5ac1f6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:02.607 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.601+0000 7fa5b38c9640 1 --2- 172.21.15.78:0/2429245143 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5ac0b2280 0x7fa5ac1f6300 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fa59c01a9d0 tx=0x7fa59c0190c0 comp rx=0 tx=0).stop 2023-12-12T10:13:02.608 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.601+0000 7fa5b38c9640 1 -- 172.21.15.78:0/2429245143 shutdown_connections 2023-12-12T10:13:02.608 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.601+0000 7fa5b38c9640 1 --2- 172.21.15.78:0/2429245143 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fa590066470 0x7fa590068930 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:02.608 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.601+0000 7fa5b38c9640 1 --2- 172.21.15.78:0/2429245143 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa5ac143770 0x7fa5ac0afc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:02.608 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.601+0000 7fa5b38c9640 1 --2- 172.21.15.78:0/2429245143 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa5ac0b2280 0x7fa5ac1f6300 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:02.608 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.601+0000 7fa5b38c9640 1 --2- 172.21.15.78:0/2429245143 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa5ac0b1e20 0x7fa5ac1380d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:02.608 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.601+0000 7fa5b38c9640 1 -- 172.21.15.78:0/2429245143 >> 172.21.15.78:0/2429245143 conn(0x7fa5ac06a710 msgr2=0x7fa5ac071d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:02.608 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.601+0000 7fa5b38c9640 1 -- 172.21.15.78:0/2429245143 shutdown_connections 2023-12-12T10:13:02.608 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.605+0000 7fa5b38c9640 1 -- 172.21.15.78:0/2429245143 wait complete. 2023-12-12T10:13:02.626 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-12T10:13:02.767 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.765+0000 7fb93b580640 1 Processor -- start 2023-12-12T10:13:02.767 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.765+0000 7fb93b580640 1 -- start start 2023-12-12T10:13:02.769 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.765+0000 7fb93b580640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb934071d40 0x7fb934164fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:02.769 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.765+0000 7fb93b580640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb9341654e0 0x7fb9340b2c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:02.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.765+0000 7fb93b580640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fb9340b31b0 0x7fb934161960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:02.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.765+0000 7fb93b580640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb934072120 con 0x7fb9341654e0 2023-12-12T10:13:02.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.765+0000 7fb93b580640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb934165940 con 0x7fb9340b31b0 2023-12-12T10:13:02.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.765+0000 7fb93b580640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9340b39a0 con 0x7fb934071d40 2023-12-12T10:13:02.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.765+0000 7fb938b1b640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb9341654e0 0x7fb9340b2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:02.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.765+0000 7fb938b1b640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb9341654e0 0x7fb9340b2c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41856/0 (socket says 172.21.15.78:41856) 2023-12-12T10:13:02.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.765+0000 7fb938b1b640 1 -- 172.21.15.78:0/959536051 learned_addr learned my addr 172.21.15.78:0/959536051 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:13:02.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.765+0000 7fb939b1d640 1 --2- 172.21.15.78:0/959536051 >> v2:172.21.15.187:3300/0 conn(0x7fb9340b31b0 0x7fb934161960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:02.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.765+0000 7fb93931c640 1 --2- 172.21.15.78:0/959536051 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb934071d40 0x7fb934164fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:02.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.765+0000 7fb938b1b640 1 -- 172.21.15.78:0/959536051 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb934071d40 msgr2=0x7fb934164fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:13:02.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.765+0000 7fb938b1b640 1 --2- 172.21.15.78:0/959536051 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb934071d40 0x7fb934164fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:02.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.765+0000 7fb938b1b640 1 -- 172.21.15.78:0/959536051 >> v2:172.21.15.187:3300/0 conn(0x7fb9340b31b0 msgr2=0x7fb934161960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:13:02.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.765+0000 7fb938b1b640 1 --2- 172.21.15.78:0/959536051 >> v2:172.21.15.187:3300/0 conn(0x7fb9340b31b0 0x7fb934161960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:02.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.765+0000 7fb938b1b640 1 -- 172.21.15.78:0/959536051 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9340b3c80 con 0x7fb9341654e0 2023-12-12T10:13:02.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.765+0000 7fb93931c640 1 --2- 172.21.15.78:0/959536051 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb934071d40 0x7fb934164fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T10:13:02.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.769+0000 7fb938b1b640 1 --2- 172.21.15.78:0/959536051 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb9341654e0 0x7fb9340b2c70 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fb934070080 tx=0x7fb92401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=400dc7f99151c2ec server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:02.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.769+0000 7fb92bfff640 1 -- 172.21.15.78:0/959536051 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9240aa5f0 con 0x7fb9341654e0 2023-12-12T10:13:02.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.769+0000 7fb92bfff640 1 -- 172.21.15.78:0/959536051 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9240aa750 con 0x7fb9341654e0 2023-12-12T10:13:02.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.769+0000 7fb92bfff640 1 -- 172.21.15.78:0/959536051 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9240aaae0 con 0x7fb9341654e0 2023-12-12T10:13:02.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.769+0000 7fb93b580640 1 -- 172.21.15.78:0/959536051 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb9341654e0 msgr2=0x7fb9340b2c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:02.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.769+0000 7fb93b580640 1 --2- 172.21.15.78:0/959536051 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb9341654e0 0x7fb9340b2c70 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fb934070080 tx=0x7fb92401c4d0 comp rx=0 tx=0).stop 2023-12-12T10:13:02.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.769+0000 7fb93b580640 1 -- 172.21.15.78:0/959536051 shutdown_connections 2023-12-12T10:13:02.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.769+0000 7fb93b580640 1 --2- 172.21.15.78:0/959536051 >> v2:172.21.15.187:3300/0 conn(0x7fb9340b31b0 0x7fb934161960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:02.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.769+0000 7fb93b580640 1 --2- 172.21.15.78:0/959536051 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb9341654e0 0x7fb9340b2c70 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:02.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.769+0000 7fb93b580640 1 --2- 172.21.15.78:0/959536051 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb934071d40 0x7fb934164fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:02.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.769+0000 7fb93b580640 1 -- 172.21.15.78:0/959536051 >> 172.21.15.78:0/959536051 conn(0x7fb93406a710 msgr2=0x7fb93406ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:02.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.769+0000 7fb93b580640 1 -- 172.21.15.78:0/959536051 shutdown_connections 2023-12-12T10:13:02.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.769+0000 7fb93b580640 1 -- 172.21.15.78:0/959536051 wait complete. 2023-12-12T10:13:02.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.769+0000 7fb93b580640 1 Processor -- start 2023-12-12T10:13:02.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.773+0000 7fb93b580640 1 -- start start 2023-12-12T10:13:02.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.773+0000 7fb93b580640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb934071d40 0x7fb93416b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:02.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.773+0000 7fb93b580640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb9340b31b0 0x7fb934167100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:02.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.773+0000 7fb93b580640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb9341654e0 0x7fb93415e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:02.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.773+0000 7fb93b580640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb934167ae0 con 0x7fb9340b31b0 2023-12-12T10:13:02.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.773+0000 7fb93b580640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb934167dc0 con 0x7fb934071d40 2023-12-12T10:13:02.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.773+0000 7fb93b580640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9341680a0 con 0x7fb9341654e0 2023-12-12T10:13:02.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.773+0000 7fb938b1b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb9340b31b0 0x7fb934167100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:02.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.773+0000 7fb938b1b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb9340b31b0 0x7fb934167100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41870/0 (socket says 172.21.15.78:41870) 2023-12-12T10:13:02.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.773+0000 7fb938b1b640 1 -- 172.21.15.78:0/1634191988 learned_addr learned my addr 172.21.15.78:0/1634191988 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:13:02.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.773+0000 7fb93931c640 1 --2- 172.21.15.78:0/1634191988 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb934071d40 0x7fb93416b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:02.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.773+0000 7fb939b1d640 1 --2- 172.21.15.78:0/1634191988 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb9341654e0 0x7fb93415e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:02.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.773+0000 7fb938b1b640 1 -- 172.21.15.78:0/1634191988 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb9341654e0 msgr2=0x7fb93415e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:02.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.773+0000 7fb938b1b640 1 --2- 172.21.15.78:0/1634191988 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb9341654e0 0x7fb93415e280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:02.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.773+0000 7fb938b1b640 1 -- 172.21.15.78:0/1634191988 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb934071d40 msgr2=0x7fb93416b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:02.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.773+0000 7fb938b1b640 1 --2- 172.21.15.78:0/1634191988 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb934071d40 0x7fb93416b010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:02.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.773+0000 7fb938b1b640 1 -- 172.21.15.78:0/1634191988 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9240094d0 con 0x7fb9340b31b0 2023-12-12T10:13:02.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.773+0000 7fb939b1d640 1 --2- 172.21.15.78:0/1634191988 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb9341654e0 0x7fb93415e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T10:13:02.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.773+0000 7fb938b1b640 1 --2- 172.21.15.78:0/1634191988 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb9340b31b0 0x7fb934167100 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fb9240ac040 tx=0x7fb92401ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:02.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.773+0000 7fb929ffb640 1 -- 172.21.15.78:0/1634191988 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9240bd5f0 con 0x7fb9340b31b0 2023-12-12T10:13:02.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.773+0000 7fb929ffb640 1 -- 172.21.15.78:0/1634191988 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9240bd770 con 0x7fb9340b31b0 2023-12-12T10:13:02.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.773+0000 7fb929ffb640 1 -- 172.21.15.78:0/1634191988 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9240bdb20 con 0x7fb9340b31b0 2023-12-12T10:13:02.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.773+0000 7fb93b580640 1 -- 172.21.15.78:0/1634191988 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb934168380 con 0x7fb9340b31b0 2023-12-12T10:13:02.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.773+0000 7fb93b580640 1 -- 172.21.15.78:0/1634191988 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9340cd810 con 0x7fb9340b31b0 2023-12-12T10:13:02.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.773+0000 7fb93b580640 1 -- 172.21.15.78:0/1634191988 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9340671f0 con 0x7fb9340b31b0 2023-12-12T10:13:02.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.777+0000 7fb929ffb640 1 -- 172.21.15.78:0/1634191988 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb9240b3600 con 0x7fb9340b31b0 2023-12-12T10:13:02.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.777+0000 7fb929ffb640 1 --2- 172.21.15.78:0/1634191988 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fb918066470 0x7fb918068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:02.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.777+0000 7fb929ffb640 1 -- 172.21.15.78:0/1634191988 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fb9240a7070 con 0x7fb9340b31b0 2023-12-12T10:13:02.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.777+0000 7fb93931c640 1 --2- 172.21.15.78:0/1634191988 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fb918066470 0x7fb918068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:02.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.777+0000 7fb93931c640 1 --2- 172.21.15.78:0/1634191988 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fb918066470 0x7fb918068930 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb930009950 tx=0x7fb930008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:02.784 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.781+0000 7fb929ffb640 1 -- 172.21.15.78:0/1634191988 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb9240ec280 con 0x7fb9340b31b0 2023-12-12T10:13:02.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.933+0000 7fb93b580640 1 -- 172.21.15.78:0/1634191988 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb934067530 con 0x7fb9340b31b0 2023-12-12T10:13:02.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.933+0000 7fb929ffb640 1 -- 172.21.15.78:0/1634191988 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb9240ef8a0 con 0x7fb9340b31b0 2023-12-12T10:13:02.936 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2023-12-12T10:13:02.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.933+0000 7fb93b580640 1 -- 172.21.15.78:0/1634191988 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fb918066470 msgr2=0x7fb918068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:02.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.933+0000 7fb93b580640 1 --2- 172.21.15.78:0/1634191988 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fb918066470 0x7fb918068930 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb930009950 tx=0x7fb930008040 comp rx=0 tx=0).stop 2023-12-12T10:13:02.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.933+0000 7fb93b580640 1 -- 172.21.15.78:0/1634191988 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb9340b31b0 msgr2=0x7fb934167100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:02.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.933+0000 7fb93b580640 1 --2- 172.21.15.78:0/1634191988 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb9340b31b0 0x7fb934167100 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fb9240ac040 tx=0x7fb92401ad10 comp rx=0 tx=0).stop 2023-12-12T10:13:02.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.933+0000 7fb93b580640 1 -- 172.21.15.78:0/1634191988 shutdown_connections 2023-12-12T10:13:02.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.933+0000 7fb93b580640 1 --2- 172.21.15.78:0/1634191988 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fb918066470 0x7fb918068930 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:02.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.933+0000 7fb93b580640 1 --2- 172.21.15.78:0/1634191988 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb9341654e0 0x7fb93415e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:02.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.933+0000 7fb93b580640 1 --2- 172.21.15.78:0/1634191988 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb9340b31b0 0x7fb934167100 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:02.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.933+0000 7fb93b580640 1 --2- 172.21.15.78:0/1634191988 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb934071d40 0x7fb93416b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:02.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.933+0000 7fb93b580640 1 -- 172.21.15.78:0/1634191988 >> 172.21.15.78:0/1634191988 conn(0x7fb93406a710 msgr2=0x7fb9340b17f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:02.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.933+0000 7fb93b580640 1 -- 172.21.15.78:0/1634191988 shutdown_connections 2023-12-12T10:13:02.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:02.933+0000 7fb93b580640 1 -- 172.21.15.78:0/1634191988 wait complete. 2023-12-12T10:13:02.957 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-12T10:13:03.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.093+0000 7f47b8017640 1 Processor -- start 2023-12-12T10:13:03.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.093+0000 7f47b8017640 1 -- start start 2023-12-12T10:13:03.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.097+0000 7f47b8017640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f47b0143770 0x7f47b00cdf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:03.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.097+0000 7f47b8017640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f47b00b1e20 0x7f47b0070f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:03.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.097+0000 7f47b8017640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47b0070a70 con 0x7f47b00b2280 2023-12-12T10:13:03.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.097+0000 7f47b8017640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47b015e920 con 0x7f47b0143770 2023-12-12T10:13:03.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.097+0000 7f47b8017640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47b0070440 con 0x7f47b00b1e20 2023-12-12T10:13:03.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.097+0000 7f47b65b4640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f47b00b2280 0x7f47b015a2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:36020/0 (socket says 172.21.15.78:36020) 2023-12-12T10:13:03.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.097+0000 7f47b65b4640 1 -- 172.21.15.78:0/1580538469 learned_addr learned my addr 172.21.15.78:0/1580538469 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-12-12T10:13:03.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.097+0000 7f47b55b2640 1 --2- 172.21.15.78:0/1580538469 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f47b00b1e20 0x7f47b0070f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:03.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.097+0000 7f47b5db3640 1 --2- 172.21.15.78:0/1580538469 >> v2:172.21.15.187:3300/0 conn(0x7f47b0143770 0x7f47b00cdf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:03.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.097+0000 7f47b4db1640 1 -- 172.21.15.78:0/1580538469 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 630508471 0 0) 0x7f47b0070a70 con 0x7f47b00b2280 2023-12-12T10:13:03.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.097+0000 7f47b4db1640 1 -- 172.21.15.78:0/1580538469 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f479c003530 con 0x7f47b00b2280 2023-12-12T10:13:03.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.097+0000 7f47b55b2640 1 -- 172.21.15.78:0/1580538469 >> v2:172.21.15.187:3300/0 conn(0x7f47b0143770 msgr2=0x7f47b00cdf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:13:03.101 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.097+0000 7f47b55b2640 1 --2- 172.21.15.78:0/1580538469 >> v2:172.21.15.187:3300/0 conn(0x7f47b0143770 0x7f47b00cdf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:03.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.097+0000 7f47b4db1640 1 -- 172.21.15.78:0/1580538469 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2184259756 0 0) 0x7f479c003530 con 0x7f47b00b2280 2023-12-12T10:13:03.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.097+0000 7f47b55b2640 1 -- 172.21.15.78:0/1580538469 >> v1:172.21.15.78:6789/0 conn(0x7f47b00b2280 legacy=0x7f47b015a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:03.102 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.097+0000 7f47b55b2640 1 -- 172.21.15.78:0/1580538469 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47b0143b50 con 0x7f47b00b1e20 2023-12-12T10:13:03.104 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.101+0000 7f47b55b2640 1 --2- 172.21.15.78:0/1580538469 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f47b00b1e20 0x7f47b0070f00 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f47a00097c0 tx=0x7f47a001c310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7658d2aa297be66d server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:03.104 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.101+0000 7f47b4db1640 1 -- 172.21.15.78:0/1580538469 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a8001a00 con 0x7f47b00b1e20 2023-12-12T10:13:03.104 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.101+0000 7f47b4db1640 1 -- 172.21.15.78:0/1580538469 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47a00a7050 con 0x7f47b00b1e20 2023-12-12T10:13:03.104 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.101+0000 7f47b4db1640 1 -- 172.21.15.78:0/1580538469 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a00ab620 con 0x7f47b00b1e20 2023-12-12T10:13:03.105 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.101+0000 7f47b8017640 1 -- 172.21.15.78:0/1580538469 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f47b00b1e20 msgr2=0x7f47b0070f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:03.105 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.101+0000 7f47b8017640 1 --2- 172.21.15.78:0/1580538469 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f47b00b1e20 0x7f47b0070f00 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f47a00097c0 tx=0x7f47a001c310 comp rx=0 tx=0).stop 2023-12-12T10:13:03.105 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.101+0000 7f47b8017640 1 -- 172.21.15.78:0/1580538469 shutdown_connections 2023-12-12T10:13:03.105 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.101+0000 7f47b8017640 1 --2- 172.21.15.78:0/1580538469 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f47b00b1e20 0x7f47b0070f00 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:03.105 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.101+0000 7f47b8017640 1 --2- 172.21.15.78:0/1580538469 >> v2:172.21.15.187:3300/0 conn(0x7f47b0143770 0x7f47b00cdf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:03.105 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.101+0000 7f47b8017640 1 -- 172.21.15.78:0/1580538469 >> 172.21.15.78:0/1580538469 conn(0x7f47b006a710 msgr2=0x7f47b006ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:03.105 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.101+0000 7f47b8017640 1 -- 172.21.15.78:0/1580538469 shutdown_connections 2023-12-12T10:13:03.105 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.101+0000 7f47b8017640 1 -- 172.21.15.78:0/1580538469 wait complete. 2023-12-12T10:13:03.106 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.101+0000 7f47b8017640 1 Processor -- start 2023-12-12T10:13:03.106 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.101+0000 7f47b8017640 1 -- start start 2023-12-12T10:13:03.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.105+0000 7f47b8017640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f47b00b1e20 0x7f47b01f94a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:03.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.105+0000 7f47b8017640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f47b00b2280 0x7f47b0156090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:03.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.105+0000 7f47b8017640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f47b0143770 0x7f47b01565d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:03.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.105+0000 7f47b8017640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47b01fa3d0 con 0x7f47b00b1e20 2023-12-12T10:13:03.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.105+0000 7f47b8017640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47b01554a0 con 0x7f47b0143770 2023-12-12T10:13:03.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.105+0000 7f47b8017640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47b01f9e10 con 0x7f47b00b2280 2023-12-12T10:13:03.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.105+0000 7f47b5db3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f47b00b1e20 0x7f47b01f94a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:03.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.105+0000 7f47b5db3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f47b00b1e20 0x7f47b01f94a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41884/0 (socket says 172.21.15.78:41884) 2023-12-12T10:13:03.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.105+0000 7f47b5db3640 1 -- 172.21.15.78:0/3862745395 learned_addr learned my addr 172.21.15.78:0/3862745395 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:13:03.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.105+0000 7f47b65b4640 1 --2- 172.21.15.78:0/3862745395 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f47b0143770 0x7f47b01565d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:03.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.105+0000 7f47b5db3640 1 -- 172.21.15.78:0/3862745395 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f47b00b2280 msgr2=0x7f47b0156090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:03.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.105+0000 7f47b5db3640 1 --2- 172.21.15.78:0/3862745395 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f47b00b2280 0x7f47b0156090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:03.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.105+0000 7f47b5db3640 1 -- 172.21.15.78:0/3862745395 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f47b0143770 msgr2=0x7f47b01565d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:03.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.105+0000 7f47b5db3640 1 --2- 172.21.15.78:0/3862745395 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f47b0143770 0x7f47b01565d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:03.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.105+0000 7f47b5db3640 1 -- 172.21.15.78:0/3862745395 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47a0009420 con 0x7f47b00b1e20 2023-12-12T10:13:03.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.105+0000 7f47b65b4640 1 --2- 172.21.15.78:0/3862745395 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f47b0143770 0x7f47b01565d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T10:13:03.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.105+0000 7f47b5db3640 1 --2- 172.21.15.78:0/3862745395 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f47b00b1e20 0x7f47b01f94a0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f47ac00e870 tx=0x7f47ac00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:03.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.105+0000 7f47a67fc640 1 -- 172.21.15.78:0/3862745395 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47ac009510 con 0x7f47b00b1e20 2023-12-12T10:13:03.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.105+0000 7f47a67fc640 1 -- 172.21.15.78:0/3862745395 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47ac00eec0 con 0x7f47b00b1e20 2023-12-12T10:13:03.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.105+0000 7f47a67fc640 1 -- 172.21.15.78:0/3862745395 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47ac00cb40 con 0x7f47b00b1e20 2023-12-12T10:13:03.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.105+0000 7f47b8017640 1 -- 172.21.15.78:0/3862745395 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47b01fa0f0 con 0x7f47b00b1e20 2023-12-12T10:13:03.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.105+0000 7f47b8017640 1 -- 172.21.15.78:0/3862745395 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47b013d7b0 con 0x7f47b00b1e20 2023-12-12T10:13:03.111 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.105+0000 7f47b8017640 1 -- 172.21.15.78:0/3862745395 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47b00671f0 con 0x7f47b00b1e20 2023-12-12T10:13:03.111 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.105+0000 7f47a67fc640 1 -- 172.21.15.78:0/3862745395 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f47ac00cca0 con 0x7f47b00b1e20 2023-12-12T10:13:03.111 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.109+0000 7f47a67fc640 1 --2- 172.21.15.78:0/3862745395 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f4794066470 0x7f4794068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:03.111 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.109+0000 7f47a67fc640 1 -- 172.21.15.78:0/3862745395 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f47ac0843d0 con 0x7f47b00b1e20 2023-12-12T10:13:03.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.109+0000 7f47b55b2640 1 --2- 172.21.15.78:0/3862745395 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f4794066470 0x7f4794068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:03.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.109+0000 7f47b55b2640 1 --2- 172.21.15.78:0/3862745395 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f4794066470 0x7f4794068930 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f47a00ad000 tx=0x7f47a0004740 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:03.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.113+0000 7f47a67fc640 1 -- 172.21.15.78:0/3862745395 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f47ac051480 con 0x7f47b00b1e20 2023-12-12T10:13:03.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.265+0000 7f47b8017640 1 -- 172.21.15.78:0/3862745395 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f47b0067530 con 0x7f47b00b1e20 2023-12-12T10:13:03.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.265+0000 7f47a67fc640 1 -- 172.21.15.78:0/3862745395 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f47ac054aa0 con 0x7f47b00b1e20 2023-12-12T10:13:03.269 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2023-12-12T10:13:03.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.265+0000 7f47b8017640 1 -- 172.21.15.78:0/3862745395 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f4794066470 msgr2=0x7f4794068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:03.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.265+0000 7f47b8017640 1 --2- 172.21.15.78:0/3862745395 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f4794066470 0x7f4794068930 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f47a00ad000 tx=0x7f47a0004740 comp rx=0 tx=0).stop 2023-12-12T10:13:03.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.265+0000 7f47b8017640 1 -- 172.21.15.78:0/3862745395 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f47b00b1e20 msgr2=0x7f47b01f94a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:03.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.265+0000 7f47b8017640 1 --2- 172.21.15.78:0/3862745395 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f47b00b1e20 0x7f47b01f94a0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f47ac00e870 tx=0x7f47ac00ec70 comp rx=0 tx=0).stop 2023-12-12T10:13:03.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.269+0000 7f47b8017640 1 -- 172.21.15.78:0/3862745395 shutdown_connections 2023-12-12T10:13:03.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.269+0000 7f47b8017640 1 --2- 172.21.15.78:0/3862745395 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f4794066470 0x7f4794068930 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:03.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.269+0000 7f47b8017640 1 --2- 172.21.15.78:0/3862745395 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f47b0143770 0x7f47b01565d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:03.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.269+0000 7f47b8017640 1 --2- 172.21.15.78:0/3862745395 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f47b00b2280 0x7f47b0156090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:03.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.269+0000 7f47b8017640 1 --2- 172.21.15.78:0/3862745395 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f47b00b1e20 0x7f47b01f94a0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:03.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.269+0000 7f47b8017640 1 -- 172.21.15.78:0/3862745395 >> 172.21.15.78:0/3862745395 conn(0x7f47b006a710 msgr2=0x7f47b00b3770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:03.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.269+0000 7f47b8017640 1 -- 172.21.15.78:0/3862745395 shutdown_connections 2023-12-12T10:13:03.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.269+0000 7f47b8017640 1 -- 172.21.15.78:0/3862745395 wait complete. 2023-12-12T10:13:03.291 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-12T10:13:03.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.429+0000 7f6ff271d640 1 Processor -- start 2023-12-12T10:13:03.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.429+0000 7f6ff271d640 1 -- start start 2023-12-12T10:13:03.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.429+0000 7f6ff271d640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f6fec0716f0 0x7f6fec071ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:03.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.429+0000 7f6ff271d640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f6fec072010 0x7f6fec146370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:03.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.429+0000 7f6ff271d640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6fec1468b0 0x7f6fec0b1f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:03.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.429+0000 7f6ff271d640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fec072730 con 0x7f6fec0716f0 2023-12-12T10:13:03.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.429+0000 7f6ff271d640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fec06d310 con 0x7f6fec072010 2023-12-12T10:13:03.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.429+0000 7f6ff271d640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fec06d5f0 con 0x7f6fec1468b0 2023-12-12T10:13:03.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.429+0000 7f6febfff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f6fec0716f0 0x7f6fec071ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:03.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.429+0000 7f6febfff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f6fec0716f0 0x7f6fec071ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41890/0 (socket says 172.21.15.78:41890) 2023-12-12T10:13:03.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.429+0000 7f6febfff640 1 -- 172.21.15.78:0/3233360454 learned_addr learned my addr 172.21.15.78:0/3233360454 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:13:03.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.429+0000 7f6feb7fe640 1 --2- 172.21.15.78:0/3233360454 >> v2:172.21.15.187:3300/0 conn(0x7f6fec072010 0x7f6fec146370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:03.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.429+0000 7f6febfff640 1 -- 172.21.15.78:0/3233360454 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6fec1468b0 msgr2=0x7f6fec0b1f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:13:03.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.429+0000 7f6ff0cba640 1 --2- 172.21.15.78:0/3233360454 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6fec1468b0 0x7f6fec0b1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:03.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.429+0000 7f6febfff640 1 --2- 172.21.15.78:0/3233360454 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6fec1468b0 0x7f6fec0b1f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:03.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.429+0000 7f6febfff640 1 -- 172.21.15.78:0/3233360454 >> v2:172.21.15.187:3300/0 conn(0x7f6fec072010 msgr2=0x7f6fec146370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:13:03.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.429+0000 7f6febfff640 1 --2- 172.21.15.78:0/3233360454 >> v2:172.21.15.187:3300/0 conn(0x7f6fec072010 0x7f6fec146370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:03.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.429+0000 7f6febfff640 1 -- 172.21.15.78:0/3233360454 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fec06d8d0 con 0x7f6fec0716f0 2023-12-12T10:13:03.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.429+0000 7f6feb7fe640 1 --2- 172.21.15.78:0/3233360454 >> v2:172.21.15.187:3300/0 conn(0x7f6fec072010 0x7f6fec146370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T10:13:03.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.429+0000 7f6ff0cba640 1 --2- 172.21.15.78:0/3233360454 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6fec1468b0 0x7f6fec0b1f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T10:13:03.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.433+0000 7f6febfff640 1 --2- 172.21.15.78:0/3233360454 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6fec0716f0 0x7f6fec071ad0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc009870 tx=0x7f6fdc01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5caeaaf9abfcbfef server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:03.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.433+0000 7f6feaffd640 1 -- 172.21.15.78:0/3233360454 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fdc0ac600 con 0x7f6fec0716f0 2023-12-12T10:13:03.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.433+0000 7f6feaffd640 1 -- 172.21.15.78:0/3233360454 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fdc0a8050 con 0x7f6fec0716f0 2023-12-12T10:13:03.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.433+0000 7f6feaffd640 1 -- 172.21.15.78:0/3233360454 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fdc0ac980 con 0x7f6fec0716f0 2023-12-12T10:13:03.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.433+0000 7f6ff271d640 1 -- 172.21.15.78:0/3233360454 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6fec0716f0 msgr2=0x7f6fec071ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:03.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.433+0000 7f6ff271d640 1 --2- 172.21.15.78:0/3233360454 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6fec0716f0 0x7f6fec071ad0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc009870 tx=0x7f6fdc01c4d0 comp rx=0 tx=0).stop 2023-12-12T10:13:03.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.433+0000 7f6ff271d640 1 -- 172.21.15.78:0/3233360454 shutdown_connections 2023-12-12T10:13:03.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.433+0000 7f6ff271d640 1 --2- 172.21.15.78:0/3233360454 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6fec1468b0 0x7f6fec0b1f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:03.438 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.433+0000 7f6ff271d640 1 --2- 172.21.15.78:0/3233360454 >> v2:172.21.15.187:3300/0 conn(0x7f6fec072010 0x7f6fec146370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:03.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.433+0000 7f6ff271d640 1 --2- 172.21.15.78:0/3233360454 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6fec0716f0 0x7f6fec071ad0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:03.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.433+0000 7f6ff271d640 1 -- 172.21.15.78:0/3233360454 >> 172.21.15.78:0/3233360454 conn(0x7f6fec06a710 msgr2=0x7f6fec06ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:03.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.433+0000 7f6ff271d640 1 -- 172.21.15.78:0/3233360454 shutdown_connections 2023-12-12T10:13:03.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.433+0000 7f6ff271d640 1 -- 172.21.15.78:0/3233360454 wait complete. 2023-12-12T10:13:03.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.437+0000 7f6ff271d640 1 Processor -- start 2023-12-12T10:13:03.439 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.437+0000 7f6ff271d640 1 -- start start 2023-12-12T10:13:03.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.437+0000 7f6ff271d640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6fec0716f0 0x7f6fec0cdfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:03.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.437+0000 7f6ff271d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6fec072010 0x7f6fec139030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:03.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.437+0000 7f6ff271d640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6fec1468b0 0x7f6fec13d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:03.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.437+0000 7f6ff271d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fec139570 con 0x7f6fec072010 2023-12-12T10:13:03.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.437+0000 7f6ff271d640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fec139840 con 0x7f6fec0716f0 2023-12-12T10:13:03.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.437+0000 7f6ff271d640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fec139b20 con 0x7f6fec1468b0 2023-12-12T10:13:03.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.437+0000 7f6feb7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6fec072010 0x7f6fec139030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:03.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.437+0000 7f6feb7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6fec072010 0x7f6fec139030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41902/0 (socket says 172.21.15.78:41902) 2023-12-12T10:13:03.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.437+0000 7f6feb7fe640 1 -- 172.21.15.78:0/656465072 learned_addr learned my addr 172.21.15.78:0/656465072 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:13:03.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.437+0000 7f6febfff640 1 --2- 172.21.15.78:0/656465072 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6fec0716f0 0x7f6fec0cdfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:03.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.437+0000 7f6ff0cba640 1 --2- 172.21.15.78:0/656465072 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6fec1468b0 0x7f6fec13d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:03.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.437+0000 7f6feb7fe640 1 -- 172.21.15.78:0/656465072 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6fec1468b0 msgr2=0x7f6fec13d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:03.442 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.437+0000 7f6feb7fe640 1 --2- 172.21.15.78:0/656465072 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6fec1468b0 0x7f6fec13d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:03.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.437+0000 7f6feb7fe640 1 -- 172.21.15.78:0/656465072 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6fec0716f0 msgr2=0x7f6fec0cdfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:03.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.437+0000 7f6feb7fe640 1 --2- 172.21.15.78:0/656465072 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6fec0716f0 0x7f6fec0cdfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:03.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.437+0000 7f6feb7fe640 1 -- 172.21.15.78:0/656465072 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fdc0094d0 con 0x7f6fec072010 2023-12-12T10:13:03.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.437+0000 7f6feb7fe640 1 --2- 172.21.15.78:0/656465072 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6fec072010 0x7f6fec139030 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f6fe000c7f0 tx=0x7f6fe000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:03.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.437+0000 7f6fe8ff9640 1 -- 172.21.15.78:0/656465072 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fe0007820 con 0x7f6fec072010 2023-12-12T10:13:03.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.437+0000 7f6fe8ff9640 1 -- 172.21.15.78:0/656465072 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fe0007980 con 0x7f6fec072010 2023-12-12T10:13:03.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.437+0000 7f6ff271d640 1 -- 172.21.15.78:0/656465072 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fec139e00 con 0x7f6fec072010 2023-12-12T10:13:03.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.437+0000 7f6fe8ff9640 1 -- 172.21.15.78:0/656465072 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fe0007d30 con 0x7f6fec072010 2023-12-12T10:13:03.443 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.437+0000 7f6ff271d640 1 -- 172.21.15.78:0/656465072 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fec13a3c0 con 0x7f6fec072010 2023-12-12T10:13:03.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.437+0000 7f6ff271d640 1 -- 172.21.15.78:0/656465072 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fec0671f0 con 0x7f6fec072010 2023-12-12T10:13:03.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.441+0000 7f6fe8ff9640 1 -- 172.21.15.78:0/656465072 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6fe00113f0 con 0x7f6fec072010 2023-12-12T10:13:03.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.441+0000 7f6fe8ff9640 1 --2- 172.21.15.78:0/656465072 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f6fd8066470 0x7f6fd8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:03.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.441+0000 7f6fe8ff9640 1 -- 172.21.15.78:0/656465072 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f6fe0084580 con 0x7f6fec072010 2023-12-12T10:13:03.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.441+0000 7f6febfff640 1 --2- 172.21.15.78:0/656465072 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f6fd8066470 0x7f6fd8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:03.445 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.441+0000 7f6febfff640 1 --2- 172.21.15.78:0/656465072 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f6fd8066470 0x7f6fd8068930 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc0ae000 tx=0x7f6fdc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:03.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.445+0000 7f6fe8ff9640 1 -- 172.21.15.78:0/656465072 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6fe00515b0 con 0x7f6fec072010 2023-12-12T10:13:03.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.601+0000 7f6ff271d640 1 -- 172.21.15.78:0/656465072 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f6fec067530 con 0x7f6fec072010 2023-12-12T10:13:03.606 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.601+0000 7f6fe8ff9640 1 -- 172.21.15.78:0/656465072 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f6fe0054bd0 con 0x7f6fec072010 2023-12-12T10:13:03.607 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2023-12-12T10:13:03.608 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.605+0000 7f6ff271d640 1 -- 172.21.15.78:0/656465072 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f6fd8066470 msgr2=0x7f6fd8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:03.608 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.605+0000 7f6ff271d640 1 --2- 172.21.15.78:0/656465072 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f6fd8066470 0x7f6fd8068930 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc0ae000 tx=0x7f6fdc008040 comp rx=0 tx=0).stop 2023-12-12T10:13:03.608 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.605+0000 7f6ff271d640 1 -- 172.21.15.78:0/656465072 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6fec072010 msgr2=0x7f6fec139030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:03.609 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.605+0000 7f6ff271d640 1 --2- 172.21.15.78:0/656465072 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6fec072010 0x7f6fec139030 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f6fe000c7f0 tx=0x7f6fe000ccb0 comp rx=0 tx=0).stop 2023-12-12T10:13:03.609 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.605+0000 7f6ff271d640 1 -- 172.21.15.78:0/656465072 shutdown_connections 2023-12-12T10:13:03.609 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.605+0000 7f6ff271d640 1 --2- 172.21.15.78:0/656465072 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f6fd8066470 0x7f6fd8068930 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:03.609 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.605+0000 7f6ff271d640 1 --2- 172.21.15.78:0/656465072 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6fec1468b0 0x7f6fec13d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:03.609 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.605+0000 7f6ff271d640 1 --2- 172.21.15.78:0/656465072 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6fec072010 0x7f6fec139030 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:03.609 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.605+0000 7f6ff271d640 1 --2- 172.21.15.78:0/656465072 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6fec0716f0 0x7f6fec0cdfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:03.609 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.605+0000 7f6ff271d640 1 -- 172.21.15.78:0/656465072 >> 172.21.15.78:0/656465072 conn(0x7f6fec06a710 msgr2=0x7f6fec13ea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:03.609 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.605+0000 7f6ff271d640 1 -- 172.21.15.78:0/656465072 shutdown_connections 2023-12-12T10:13:03.609 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.605+0000 7f6ff271d640 1 -- 172.21.15.78:0/656465072 wait complete. 2023-12-12T10:13:03.630 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-12T10:13:03.769 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.765+0000 7fb7e29b8640 1 Processor -- start 2023-12-12T10:13:03.769 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.765+0000 7fb7e29b8640 1 -- start start 2023-12-12T10:13:03.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.765+0000 7fb7e29b8640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fb7dc0cca80 0x7fb7dc06d780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:03.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.765+0000 7fb7e29b8640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7dc06b580 con 0x7fb7dc15d080 2023-12-12T10:13:03.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.765+0000 7fb7e29b8640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7dc06af50 con 0x7fb7dc06ba10 2023-12-12T10:13:03.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.765+0000 7fb7e29b8640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7dc06a900 con 0x7fb7dc0cca80 2023-12-12T10:13:03.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.765+0000 7fb7dbfff640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fb7dc15d080 0x7fb7dc160da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:36024/0 (socket says 172.21.15.78:36024) 2023-12-12T10:13:03.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.765+0000 7fb7dbfff640 1 -- 172.21.15.78:0/108830346 learned_addr learned my addr 172.21.15.78:0/108830346 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-12-12T10:13:03.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.765+0000 7fb7e0f55640 1 --2- 172.21.15.78:0/108830346 >> v2:172.21.15.187:3300/0 conn(0x7fb7dc0cca80 0x7fb7dc06d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:03.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.765+0000 7fb7daffd640 1 -- 172.21.15.78:0/108830346 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1812113303 0 0) 0x7fb7dc06b580 con 0x7fb7dc15d080 2023-12-12T10:13:03.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.765+0000 7fb7daffd640 1 -- 172.21.15.78:0/108830346 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb7c4003530 con 0x7fb7dc15d080 2023-12-12T10:13:03.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.769+0000 7fb7daffd640 1 -- 172.21.15.78:0/108830346 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 427028903 0 0) 0x7fb7dc06af50 con 0x7fb7dc06ba10 2023-12-12T10:13:03.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.769+0000 7fb7daffd640 1 -- 172.21.15.78:0/108830346 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb7dc06b580 con 0x7fb7dc06ba10 2023-12-12T10:13:03.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.769+0000 7fb7daffd640 1 -- 172.21.15.78:0/108830346 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4113096754 0 0) 0x7fb7c4003530 con 0x7fb7dc15d080 2023-12-12T10:13:03.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.769+0000 7fb7daffd640 1 -- 172.21.15.78:0/108830346 >> v2:172.21.15.187:3300/0 conn(0x7fb7dc0cca80 msgr2=0x7fb7dc06d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:13:03.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.769+0000 7fb7daffd640 1 --2- 172.21.15.78:0/108830346 >> v2:172.21.15.187:3300/0 conn(0x7fb7dc0cca80 0x7fb7dc06d780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:03.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.769+0000 7fb7daffd640 1 -- 172.21.15.78:0/108830346 >> v1:172.21.15.187:6789/0 conn(0x7fb7dc06ba10 legacy=0x7fb7dc0cc370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:03.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.769+0000 7fb7daffd640 1 -- 172.21.15.78:0/108830346 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7dc1618f0 con 0x7fb7dc15d080 2023-12-12T10:13:03.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.769+0000 7fb7daffd640 1 -- 172.21.15.78:0/108830346 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 465499599 0 0) 0x7fb7cc001680 con 0x7fb7dc15d080 2023-12-12T10:13:03.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.769+0000 7fb7daffd640 1 -- 172.21.15.78:0/108830346 >> v1:172.21.15.78:6789/0 conn(0x7fb7dc15d080 legacy=0x7fb7dc160da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:03.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.769+0000 7fb7daffd640 1 --2- 172.21.15.78:0/108830346 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb7c4003b10 0x7fb7c4003f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:03.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.769+0000 7fb7daffd640 1 --2- 172.21.15.78:0/108830346 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb7c40047d0 0x7fb7c4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:03.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.769+0000 7fb7daffd640 1 --2- 172.21.15.78:0/108830346 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb7c4005190 0x7fb7c400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:03.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.769+0000 7fb7daffd640 1 -- 172.21.15.78:0/108830346 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7dc06a900 con 0x7fb7c4003b10 2023-12-12T10:13:03.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.769+0000 7fb7daffd640 1 -- 172.21.15.78:0/108830346 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7c400c010 con 0x7fb7c4005190 2023-12-12T10:13:03.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.769+0000 7fb7daffd640 1 -- 172.21.15.78:0/108830346 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7c400c1d0 con 0x7fb7c40047d0 2023-12-12T10:13:03.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.769+0000 7fb7dbfff640 1 --2- 172.21.15.78:0/108830346 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb7c4003b10 0x7fb7c4003f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:03.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.769+0000 7fb7e0f55640 1 --2- 172.21.15.78:0/108830346 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb7c4005190 0x7fb7c400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:03.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.769+0000 7fb7db7fe640 1 --2- 172.21.15.78:0/108830346 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb7c40047d0 0x7fb7c4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:03.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.769+0000 7fb7dbfff640 1 -- 172.21.15.78:0/108830346 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb7c40047d0 msgr2=0x7fb7c4004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:13:03.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.769+0000 7fb7dbfff640 1 --2- 172.21.15.78:0/108830346 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb7c40047d0 0x7fb7c4004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:03.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.769+0000 7fb7dbfff640 1 -- 172.21.15.78:0/108830346 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb7c4005190 msgr2=0x7fb7c400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:13:03.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.769+0000 7fb7dbfff640 1 --2- 172.21.15.78:0/108830346 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb7c4005190 0x7fb7c400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:03.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.769+0000 7fb7dbfff640 1 -- 172.21.15.78:0/108830346 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7c4003530 con 0x7fb7c4003b10 2023-12-12T10:13:03.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.769+0000 7fb7e0f55640 1 --2- 172.21.15.78:0/108830346 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb7c4005190 0x7fb7c400b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T10:13:03.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.769+0000 7fb7e0f55640 1 -- 172.21.15.78:0/108830346 reap_dead start 2023-12-12T10:13:03.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.769+0000 7fb7dbfff640 1 --2- 172.21.15.78:0/108830346 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb7c4003b10 0x7fb7c4003f10 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fb7cc00c160 tx=0x7fb7cc01cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33584ec187d48066 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:03.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.773+0000 7fb7daffd640 1 -- 172.21.15.78:0/108830346 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7cc0a5920 con 0x7fb7c4003b10 2023-12-12T10:13:03.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.773+0000 7fb7daffd640 1 -- 172.21.15.78:0/108830346 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7cc0a5aa0 con 0x7fb7c4003b10 2023-12-12T10:13:03.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.773+0000 7fb7daffd640 1 -- 172.21.15.78:0/108830346 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7cc0a5e90 con 0x7fb7c4003b10 2023-12-12T10:13:03.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.773+0000 7fb7e29b8640 1 -- 172.21.15.78:0/108830346 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb7c4003b10 msgr2=0x7fb7c4003f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:03.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.773+0000 7fb7e29b8640 1 --2- 172.21.15.78:0/108830346 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb7c4003b10 0x7fb7c4003f10 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fb7cc00c160 tx=0x7fb7cc01cb90 comp rx=0 tx=0).stop 2023-12-12T10:13:03.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.773+0000 7fb7e29b8640 1 -- 172.21.15.78:0/108830346 shutdown_connections 2023-12-12T10:13:03.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.773+0000 7fb7e29b8640 1 --2- 172.21.15.78:0/108830346 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb7c4003b10 0x7fb7c4003f10 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:03.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.773+0000 7fb7e29b8640 1 -- 172.21.15.78:0/108830346 >> 172.21.15.78:0/108830346 conn(0x7fb7dc0b1650 msgr2=0x7fb7dc0b1a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:03.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.773+0000 7fb7e29b8640 1 -- 172.21.15.78:0/108830346 shutdown_connections 2023-12-12T10:13:03.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.773+0000 7fb7e29b8640 1 -- 172.21.15.78:0/108830346 wait complete. 2023-12-12T10:13:03.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.773+0000 7fb7e29b8640 1 Processor -- start 2023-12-12T10:13:03.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.773+0000 7fb7e29b8640 1 -- start start 2023-12-12T10:13:03.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.773+0000 7fb7e29b8640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb7c4003b10 0x7fb7dc1509c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:03.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.773+0000 7fb7e29b8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb7dc15eb50 0x7fb7dc0cde30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:03.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.773+0000 7fb7e29b8640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb7dc0ce370 0x7fb7dc156700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:03.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.773+0000 7fb7e29b8640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7dc15e730 con 0x7fb7dc15eb50 2023-12-12T10:13:03.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.773+0000 7fb7e29b8640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7dc0ce800 con 0x7fb7c4003b10 2023-12-12T10:13:03.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.773+0000 7fb7e29b8640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7dc150f00 con 0x7fb7dc0ce370 2023-12-12T10:13:03.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.777+0000 7fb7db7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb7dc15eb50 0x7fb7dc0cde30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:03.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.777+0000 7fb7db7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb7dc15eb50 0x7fb7dc0cde30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41926/0 (socket says 172.21.15.78:41926) 2023-12-12T10:13:03.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.777+0000 7fb7db7fe640 1 -- 172.21.15.78:0/2453964584 learned_addr learned my addr 172.21.15.78:0/2453964584 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:13:03.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.777+0000 7fb7dbfff640 1 --2- 172.21.15.78:0/2453964584 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb7c4003b10 0x7fb7dc1509c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:03.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.777+0000 7fb7e0f55640 1 --2- 172.21.15.78:0/2453964584 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb7dc0ce370 0x7fb7dc156700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:03.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.777+0000 7fb7db7fe640 1 -- 172.21.15.78:0/2453964584 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb7dc0ce370 msgr2=0x7fb7dc156700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:03.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.777+0000 7fb7db7fe640 1 --2- 172.21.15.78:0/2453964584 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb7dc0ce370 0x7fb7dc156700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:03.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.777+0000 7fb7db7fe640 1 -- 172.21.15.78:0/2453964584 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb7c4003b10 msgr2=0x7fb7dc1509c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:03.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.777+0000 7fb7db7fe640 1 --2- 172.21.15.78:0/2453964584 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb7c4003b10 0x7fb7dc1509c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:03.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.777+0000 7fb7db7fe640 1 -- 172.21.15.78:0/2453964584 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7dc15dd90 con 0x7fb7dc15eb50 2023-12-12T10:13:03.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.777+0000 7fb7e0f55640 1 --2- 172.21.15.78:0/2453964584 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb7dc0ce370 0x7fb7dc156700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T10:13:03.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.777+0000 7fb7db7fe640 1 --2- 172.21.15.78:0/2453964584 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb7dc15eb50 0x7fb7dc0cde30 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fb7d000e550 tx=0x7fb7d000ea10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:03.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.777+0000 7fb7d8ff9640 1 -- 172.21.15.78:0/2453964584 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d00052e0 con 0x7fb7dc15eb50 2023-12-12T10:13:03.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.777+0000 7fb7d8ff9640 1 -- 172.21.15.78:0/2453964584 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7d0005440 con 0x7fb7dc15eb50 2023-12-12T10:13:03.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.777+0000 7fb7e29b8640 1 -- 172.21.15.78:0/2453964584 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7dc15e070 con 0x7fb7dc15eb50 2023-12-12T10:13:03.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.777+0000 7fb7d8ff9640 1 -- 172.21.15.78:0/2453964584 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d0003840 con 0x7fb7dc15eb50 2023-12-12T10:13:03.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.777+0000 7fb7e29b8640 1 -- 172.21.15.78:0/2453964584 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7dc157430 con 0x7fb7dc15eb50 2023-12-12T10:13:03.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.777+0000 7fb7e29b8640 1 -- 172.21.15.78:0/2453964584 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7dc15e870 con 0x7fb7dc15eb50 2023-12-12T10:13:03.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.777+0000 7fb7d8ff9640 1 -- 172.21.15.78:0/2453964584 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb7d00039a0 con 0x7fb7dc15eb50 2023-12-12T10:13:03.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.777+0000 7fb7d8ff9640 1 --2- 172.21.15.78:0/2453964584 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fb7c80664a0 0x7fb7c8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:03.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.777+0000 7fb7d8ff9640 1 -- 172.21.15.78:0/2453964584 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fb7d0083ff0 con 0x7fb7dc15eb50 2023-12-12T10:13:03.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.781+0000 7fb7dbfff640 1 --2- 172.21.15.78:0/2453964584 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fb7c80664a0 0x7fb7c8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:03.784 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.781+0000 7fb7dbfff640 1 --2- 172.21.15.78:0/2453964584 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fb7c80664a0 0x7fb7c8068960 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fb7cc0aa000 tx=0x7fb7cc001a00 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:03.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.781+0000 7fb7d8ff9640 1 -- 172.21.15.78:0/2453964584 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb7dc15e870 con 0x7fb7dc15eb50 2023-12-12T10:13:03.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.945+0000 7fb7e29b8640 1 -- 172.21.15.78:0/2453964584 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fb7dc15e870 con 0x7fb7dc15eb50 2023-12-12T10:13:03.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.945+0000 7fb7d8ff9640 1 -- 172.21.15.78:0/2453964584 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7fb7dc15e870 con 0x7fb7dc15eb50 2023-12-12T10:13:03.951 INFO:teuthology.orchestra.run.smithi078.stderr:listed 0 entries 2023-12-12T10:13:03.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.949+0000 7fb7e29b8640 1 -- 172.21.15.78:0/2453964584 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fb7c80664a0 msgr2=0x7fb7c8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:03.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.949+0000 7fb7e29b8640 1 --2- 172.21.15.78:0/2453964584 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fb7c80664a0 0x7fb7c8068960 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fb7cc0aa000 tx=0x7fb7cc001a00 comp rx=0 tx=0).stop 2023-12-12T10:13:03.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.949+0000 7fb7e29b8640 1 -- 172.21.15.78:0/2453964584 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb7dc15eb50 msgr2=0x7fb7dc0cde30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:03.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.949+0000 7fb7e29b8640 1 --2- 172.21.15.78:0/2453964584 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb7dc15eb50 0x7fb7dc0cde30 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fb7d000e550 tx=0x7fb7d000ea10 comp rx=0 tx=0).stop 2023-12-12T10:13:03.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.949+0000 7fb7e29b8640 1 -- 172.21.15.78:0/2453964584 shutdown_connections 2023-12-12T10:13:03.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.949+0000 7fb7e29b8640 1 --2- 172.21.15.78:0/2453964584 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fb7c80664a0 0x7fb7c8068960 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:03.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.949+0000 7fb7e29b8640 1 --2- 172.21.15.78:0/2453964584 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb7dc0ce370 0x7fb7dc156700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:03.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.949+0000 7fb7e29b8640 1 --2- 172.21.15.78:0/2453964584 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb7dc15eb50 0x7fb7dc0cde30 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:03.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.949+0000 7fb7e29b8640 1 --2- 172.21.15.78:0/2453964584 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb7c4003b10 0x7fb7dc1509c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:03.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.949+0000 7fb7e29b8640 1 -- 172.21.15.78:0/2453964584 >> 172.21.15.78:0/2453964584 conn(0x7fb7dc0b1650 msgr2=0x7fb7dc0cfc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:03.954 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.949+0000 7fb7e29b8640 1 -- 172.21.15.78:0/2453964584 shutdown_connections 2023-12-12T10:13:03.954 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:03.949+0000 7fb7e29b8640 1 -- 172.21.15.78:0/2453964584 wait complete. 2023-12-12T10:13:03.973 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-12-12T10:13:03.973 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-12T10:13:03.984 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T10:13:04.121 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.117+0000 7f9a11d0f640 1 Processor -- start 2023-12-12T10:13:04.121 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.117+0000 7f9a11d0f640 1 -- start start 2023-12-12T10:13:04.122 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.117+0000 7f9a11d0f640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f9a0c15d3c0 0x7f9a0c0d3b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:04.122 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.117+0000 7f9a11d0f640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9a0c0ce670 0x7f9a0c0d15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:04.122 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.117+0000 7f9a11d0f640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a0c0b3250 con 0x7f9a0c0d1ae0 2023-12-12T10:13:04.123 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.117+0000 7f9a11d0f640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a0c0d1f70 con 0x7f9a0c15d3c0 2023-12-12T10:13:04.123 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.117+0000 7f9a11d0f640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a0c0cee50 con 0x7f9a0c0ce670 2023-12-12T10:13:04.123 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.117+0000 7f9a0b7fe640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f9a0c15d3c0 0x7f9a0c0d3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:04.123 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.117+0000 7f9a0b7fe640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f9a0c15d3c0 0x7f9a0c0d3b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.78:50982/0 (socket says 172.21.15.78:50982) 2023-12-12T10:13:04.123 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.117+0000 7f9a0b7fe640 1 -- 172.21.15.78:0/3765225661 learned_addr learned my addr 172.21.15.78:0/3765225661 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:13:04.123 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.117+0000 7f9a0affd640 1 --2- 172.21.15.78:0/3765225661 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9a0c0ce670 0x7f9a0c0d15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:04.123 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.117+0000 7f9a0b7fe640 1 -- 172.21.15.78:0/3765225661 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9a0c0ce670 msgr2=0x7f9a0c0d15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:13:04.124 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.117+0000 7f9a0b7fe640 1 --2- 172.21.15.78:0/3765225661 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9a0c0ce670 0x7f9a0c0d15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:04.124 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.117+0000 7f9a0b7fe640 1 -- 172.21.15.78:0/3765225661 >> v1:172.21.15.187:6789/0 conn(0x7f9a0c0d1ae0 legacy=0x7f9a0c0cf680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:04.124 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.117+0000 7f9a0b7fe640 1 -- 172.21.15.78:0/3765225661 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a0c0b2920 con 0x7f9a0c15d3c0 2023-12-12T10:13:04.126 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.121+0000 7f9a0b7fe640 1 --2- 172.21.15.78:0/3765225661 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9a0c15d3c0 0x7f9a0c0d3b10 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f99fc009870 tx=0x7f99fc01ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b5d4cb1b73749027 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:04.127 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.121+0000 7f9a0a7fc640 1 -- 172.21.15.78:0/3765225661 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99fc0a8a30 con 0x7f9a0c15d3c0 2023-12-12T10:13:04.127 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.121+0000 7f9a0a7fc640 1 -- 172.21.15.78:0/3765225661 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99fc0a8b90 con 0x7f9a0c15d3c0 2023-12-12T10:13:04.127 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.121+0000 7f9a0a7fc640 1 -- 172.21.15.78:0/3765225661 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99fc0b0440 con 0x7f9a0c15d3c0 2023-12-12T10:13:04.127 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.121+0000 7f9a11d0f640 1 -- 172.21.15.78:0/3765225661 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9a0c15d3c0 msgr2=0x7f9a0c0d3b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:04.127 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.121+0000 7f9a11d0f640 1 --2- 172.21.15.78:0/3765225661 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9a0c15d3c0 0x7f9a0c0d3b10 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f99fc009870 tx=0x7f99fc01ed30 comp rx=0 tx=0).stop 2023-12-12T10:13:04.127 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.125+0000 7f9a11d0f640 1 -- 172.21.15.78:0/3765225661 shutdown_connections 2023-12-12T10:13:04.127 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.125+0000 7f9a11d0f640 1 --2- 172.21.15.78:0/3765225661 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9a0c0ce670 0x7f9a0c0d15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:04.128 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.125+0000 7f9a11d0f640 1 --2- 172.21.15.78:0/3765225661 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9a0c15d3c0 0x7f9a0c0d3b10 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:04.128 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.125+0000 7f9a11d0f640 1 -- 172.21.15.78:0/3765225661 >> 172.21.15.78:0/3765225661 conn(0x7f9a0c09c2a0 msgr2=0x7f9a0c0d2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:04.128 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.125+0000 7f9a11d0f640 1 -- 172.21.15.78:0/3765225661 shutdown_connections 2023-12-12T10:13:04.128 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.125+0000 7f9a11d0f640 1 -- 172.21.15.78:0/3765225661 wait complete. 2023-12-12T10:13:04.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.125+0000 7f9a11d0f640 1 Processor -- start 2023-12-12T10:13:04.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.125+0000 7f9a11d0f640 1 -- start start 2023-12-12T10:13:04.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.125+0000 7f9a11d0f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9a0c0ce670 0x7f9a0c0ccbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:04.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.125+0000 7f9a11d0f640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9a0c0d1ae0 0x7f9a0c1f0140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:04.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.125+0000 7f9a11d0f640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9a0c15d3c0 0x7f9a0c0c8a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:04.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.125+0000 7f9a11d0f640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a0c0c8020 con 0x7f9a0c0ce670 2023-12-12T10:13:04.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.125+0000 7f9a11d0f640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a0c0c6fa0 con 0x7f9a0c0d1ae0 2023-12-12T10:13:04.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.125+0000 7f9a11d0f640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a0c0c7280 con 0x7f9a0c15d3c0 2023-12-12T10:13:04.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.125+0000 7f9a0b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9a0c0ce670 0x7f9a0c0ccbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:04.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.125+0000 7f9a0b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9a0c0ce670 0x7f9a0c0ccbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41940/0 (socket says 172.21.15.78:41940) 2023-12-12T10:13:04.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.125+0000 7f9a0b7fe640 1 -- 172.21.15.78:0/3390542336 learned_addr learned my addr 172.21.15.78:0/3390542336 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:13:04.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.125+0000 7f9a0affd640 1 --2- 172.21.15.78:0/3390542336 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9a0c0d1ae0 0x7f9a0c1f0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:04.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.125+0000 7f9a0bfff640 1 --2- 172.21.15.78:0/3390542336 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9a0c15d3c0 0x7f9a0c0c8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:04.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.125+0000 7f9a0b7fe640 1 -- 172.21.15.78:0/3390542336 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9a0c15d3c0 msgr2=0x7f9a0c0c8a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:04.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.125+0000 7f9a0b7fe640 1 --2- 172.21.15.78:0/3390542336 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9a0c15d3c0 0x7f9a0c0c8a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:04.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.125+0000 7f9a0b7fe640 1 -- 172.21.15.78:0/3390542336 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9a0c0d1ae0 msgr2=0x7f9a0c1f0140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:04.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.125+0000 7f9a0b7fe640 1 --2- 172.21.15.78:0/3390542336 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9a0c0d1ae0 0x7f9a0c1f0140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:04.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.125+0000 7f9a0b7fe640 1 -- 172.21.15.78:0/3390542336 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99fc0094d0 con 0x7f9a0c0ce670 2023-12-12T10:13:04.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.125+0000 7f9a0bfff640 1 --2- 172.21.15.78:0/3390542336 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9a0c15d3c0 0x7f9a0c0c8a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T10:13:04.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.125+0000 7f9a0b7fe640 1 --2- 172.21.15.78:0/3390542336 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9a0c0ce670 0x7f9a0c0ccbd0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f99fc0b3040 tx=0x7f99fc01bad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:04.133 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.129+0000 7f99f3fff640 1 -- 172.21.15.78:0/3390542336 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99fc0b0dd0 con 0x7f9a0c0ce670 2023-12-12T10:13:04.133 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.129+0000 7f99f3fff640 1 -- 172.21.15.78:0/3390542336 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99fc0bb460 con 0x7f9a0c0ce670 2023-12-12T10:13:04.133 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.129+0000 7f99f3fff640 1 -- 172.21.15.78:0/3390542336 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99fc0bb810 con 0x7f9a0c0ce670 2023-12-12T10:13:04.133 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.129+0000 7f9a11d0f640 1 -- 172.21.15.78:0/3390542336 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a0c0c7560 con 0x7f9a0c0ce670 2023-12-12T10:13:04.133 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.129+0000 7f9a11d0f640 1 -- 172.21.15.78:0/3390542336 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a0c0c7b20 con 0x7f9a0c0ce670 2023-12-12T10:13:04.133 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.129+0000 7f9a11d0f640 1 -- 172.21.15.78:0/3390542336 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a0c067530 con 0x7f9a0c0ce670 2023-12-12T10:13:04.133 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.129+0000 7f99f3fff640 1 -- 172.21.15.78:0/3390542336 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f99fc0b83f0 con 0x7f9a0c0ce670 2023-12-12T10:13:04.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.129+0000 7f99f3fff640 1 --2- 172.21.15.78:0/3390542336 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f99f8066470 0x7f99f8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:04.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.129+0000 7f99f3fff640 1 -- 172.21.15.78:0/3390542336 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f99fc121bd0 con 0x7f9a0c0ce670 2023-12-12T10:13:04.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.129+0000 7f9a0affd640 1 --2- 172.21.15.78:0/3390542336 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f99f8066470 0x7f99f8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:04.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.129+0000 7f9a0affd640 1 --2- 172.21.15.78:0/3390542336 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f99f8066470 0x7f99f8068930 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f9a0c0ccb60 tx=0x7f9a00008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:04.138 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.133+0000 7f99f3fff640 1 -- 172.21.15.78:0/3390542336 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f99fc0eeb70 con 0x7f9a0c0ce670 2023-12-12T10:13:04.290 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.285+0000 7f9a11d0f640 1 -- 172.21.15.78:0/3390542336 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9a0c0d1380 con 0x7f9a0c0ce670 2023-12-12T10:13:04.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.285+0000 7f99f3fff640 1 -- 172.21.15.78:0/3390542336 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18701 (secure 0 0 0) 0x7f99fc0b5090 con 0x7f9a0c0ce670 2023-12-12T10:13:04.291 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:13:04.292 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":26,"fsid":"fc81937c-bd26-483c-952b-d1324fcb0c9e","created":"2023-12-12T10:11:44.020214+0000","modified":"2023-12-12T10:12:50.919344+0000","last_up_change":"2023-12-12T10:11:56.278318+0000","last_in_change":"2023-12-12T10:11:46.553610+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T10:11:57.053584+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-12T10:12:07.454450+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-12T10:12:08.182909+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-12T10:12:11.977952+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"22dfdedf-5f6c-4b20-9f6c-30517a1db70a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6809","nonce":3345683600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6811","nonce":3345683600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6815","nonce":3345683600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6813","nonce":3345683600}]},"public_addr":"172.21.15.78:6809/3345683600","cluster_addr":"172.21.15.78:6811/3345683600","heartbeat_back_addr":"172.21.15.78:6815/3345683600","heartbeat_front_addr":"172.21.15.78:6813/3345683600","state":["exists","up"]},{"osd":1,"uuid":"be34a7f3-a69a-462e-9ddf-5e537448dba2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6801","nonce":962652768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6803","nonce":962652768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6807","nonce":962652768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6805","nonce":962652768}]},"public_addr":"172.21.15.78:6801/962652768","cluster_addr":"172.21.15.78:6803/962652768","heartbeat_back_addr":"172.21.15.78:6807/962652768","heartbeat_front_addr":"172.21.15.78:6805/962652768","state":["exists","up"]},{"osd":2,"uuid":"55b381de-5f56-4b14-80f7-e6e41e084a13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6818","nonce":2910206054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6822","nonce":2910206054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6829","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6831","nonce":2910206054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6826","nonce":2910206054}]},"public_addr":"172.21.15.78:6818/2910206054","cluster_addr":"172.21.15.78:6822/2910206054","heartbeat_back_addr":"172.21.15.78:6831/2910206054","heartbeat_front_addr":"172.21.15.78:6826/2910206054","state":["exists","up"]},{"osd":3,"uuid":"d7682de1-25cb-4cec-869f-8851c28b0e6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6819","nonce":3750796703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6821","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6823","nonce":3750796703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6830","nonce":3750796703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6825","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6827","nonce":3750796703}]},"public_addr":"172.21.15.78:6819/3750796703","cluster_addr":"172.21.15.78:6823/3750796703","heartbeat_back_addr":"172.21.15.78:6830/3750796703","heartbeat_front_addr":"172.21.15.78:6827/3750796703","state":["exists","up"]},{"osd":4,"uuid":"8279815a-d6c7-4199-871e-d28971b9dc07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6809","nonce":2944277204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6811","nonce":2944277204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6815","nonce":2944277204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6813","nonce":2944277204}]},"public_addr":"172.21.15.187:6809/2944277204","cluster_addr":"172.21.15.187:6811/2944277204","heartbeat_back_addr":"172.21.15.187:6815/2944277204","heartbeat_front_addr":"172.21.15.187:6813/2944277204","state":["exists","up"]},{"osd":5,"uuid":"0a714c65-f8ce-4340-968f-11a799677ef3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6801","nonce":185858620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6803","nonce":185858620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6807","nonce":185858620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6805","nonce":185858620}]},"public_addr":"172.21.15.187:6801/185858620","cluster_addr":"172.21.15.187:6803/185858620","heartbeat_back_addr":"172.21.15.187:6807/185858620","heartbeat_front_addr":"172.21.15.187:6805/185858620","state":["exists","up"]},{"osd":6,"uuid":"d0bba9ab-f7ee-449e-8999-1c0cf7e6d53c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6817","nonce":4213392126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6819","nonce":4213392126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6824","nonce":4213392126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6821","nonce":4213392126}]},"public_addr":"172.21.15.187:6817/4213392126","cluster_addr":"172.21.15.187:6819/4213392126","heartbeat_back_addr":"172.21.15.187:6824/4213392126","heartbeat_front_addr":"172.21.15.187:6821/4213392126","state":["exists","up"]},{"osd":7,"uuid":"efe5e0d9-2f87-4889-a27a-e2a95a632302","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6823","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6825","nonce":85774004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6827","nonce":85774004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6831","nonce":85774004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6829","nonce":85774004}]},"public_addr":"172.21.15.187:6825/85774004","cluster_addr":"172.21.15.187:6827/85774004","heartbeat_back_addr":"172.21.15.187:6831/85774004","heartbeat_front_addr":"172.21.15.187:6829/85774004","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.214447+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.448899+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.293107+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.564184+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.175026+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.097717+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.261141+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.287681+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.18","mappings":[{"from":3,"to":2}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.13","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T10:13:04.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.289+0000 7f9a11d0f640 1 -- 172.21.15.78:0/3390542336 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f99f8066470 msgr2=0x7f99f8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:04.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.289+0000 7f9a11d0f640 1 --2- 172.21.15.78:0/3390542336 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f99f8066470 0x7f99f8068930 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f9a0c0ccb60 tx=0x7f9a00008040 comp rx=0 tx=0).stop 2023-12-12T10:13:04.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.289+0000 7f9a11d0f640 1 -- 172.21.15.78:0/3390542336 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9a0c0ce670 msgr2=0x7f9a0c0ccbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:04.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.289+0000 7f9a11d0f640 1 --2- 172.21.15.78:0/3390542336 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9a0c0ce670 0x7f9a0c0ccbd0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f99fc0b3040 tx=0x7f99fc01bad0 comp rx=0 tx=0).stop 2023-12-12T10:13:04.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.289+0000 7f9a11d0f640 1 -- 172.21.15.78:0/3390542336 shutdown_connections 2023-12-12T10:13:04.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.289+0000 7f9a11d0f640 1 --2- 172.21.15.78:0/3390542336 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f99f8066470 0x7f99f8068930 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:04.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.289+0000 7f9a11d0f640 1 --2- 172.21.15.78:0/3390542336 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9a0c15d3c0 0x7f9a0c0c8a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:04.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.289+0000 7f9a11d0f640 1 --2- 172.21.15.78:0/3390542336 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9a0c0d1ae0 0x7f9a0c1f0140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:04.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.289+0000 7f9a11d0f640 1 --2- 172.21.15.78:0/3390542336 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9a0c0ce670 0x7f9a0c0ccbd0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:04.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.289+0000 7f9a11d0f640 1 -- 172.21.15.78:0/3390542336 >> 172.21.15.78:0/3390542336 conn(0x7f9a0c09c2a0 msgr2=0x7f9a0c06afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:04.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.289+0000 7f9a11d0f640 1 -- 172.21.15.78:0/3390542336 shutdown_connections 2023-12-12T10:13:04.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.289+0000 7f9a11d0f640 1 -- 172.21.15.78:0/3390542336 wait complete. 2023-12-12T10:13:04.313 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-12T10:11:57.053584+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-12T10:12:07.454450+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-12T10:12:08.182909+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-12T10:12:11.977952+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-12T10:13:04.314 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-12T10:13:04.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.449+0000 7f77ef59e640 1 Processor -- start 2023-12-12T10:13:04.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.449+0000 7f77ef59e640 1 -- start start 2023-12-12T10:13:04.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.453+0000 7f77ef59e640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f77f01444c0 0x7f77f015f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:04.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.453+0000 7f77ef59e640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f77f00cceb0 0x7f77f015b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:04.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.453+0000 7f77ef59e640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f77f00cec10 0x7f77f00cf080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:04.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.453+0000 7f77ef59e640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77f00cf5c0 con 0x7f77f01444c0 2023-12-12T10:13:04.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.453+0000 7f77ef59e640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77f00b1e60 con 0x7f77f00cceb0 2023-12-12T10:13:04.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.453+0000 7f77ef59e640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77f015bac0 con 0x7f77f00cec10 2023-12-12T10:13:04.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.453+0000 7f77ee59c640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f77f01444c0 0x7f77f015f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:04.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.453+0000 7f77ee59c640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f77f01444c0 0x7f77f015f320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41948/0 (socket says 172.21.15.78:41948) 2023-12-12T10:13:04.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.453+0000 7f77ee59c640 1 -- 172.21.15.78:0/4185113031 learned_addr learned my addr 172.21.15.78:0/4185113031 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:13:04.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.453+0000 7f77e7fff640 1 --2- 172.21.15.78:0/4185113031 >> v2:172.21.15.187:3300/0 conn(0x7f77f00cceb0 0x7f77f015b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:04.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.453+0000 7f77eed9d640 1 --2- 172.21.15.78:0/4185113031 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f77f00cec10 0x7f77f00cf080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:04.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.453+0000 7f77ee59c640 1 -- 172.21.15.78:0/4185113031 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f77f00cec10 msgr2=0x7f77f00cf080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:13:04.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.453+0000 7f77ee59c640 1 --2- 172.21.15.78:0/4185113031 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f77f00cec10 0x7f77f00cf080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:04.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.453+0000 7f77ee59c640 1 -- 172.21.15.78:0/4185113031 >> v2:172.21.15.187:3300/0 conn(0x7f77f00cceb0 msgr2=0x7f77f015b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:13:04.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.453+0000 7f77ee59c640 1 --2- 172.21.15.78:0/4185113031 >> v2:172.21.15.187:3300/0 conn(0x7f77f00cceb0 0x7f77f015b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:04.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.453+0000 7f77ee59c640 1 -- 172.21.15.78:0/4185113031 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77f015bda0 con 0x7f77f01444c0 2023-12-12T10:13:04.457 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.453+0000 7f77e7fff640 1 --2- 172.21.15.78:0/4185113031 >> v2:172.21.15.187:3300/0 conn(0x7f77f00cceb0 0x7f77f015b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T10:13:04.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.457+0000 7f77ee59c640 1 --2- 172.21.15.78:0/4185113031 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f77f01444c0 0x7f77f015f320 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f77f00b1810 tx=0x7f77e001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6023ac6a8b8c0125 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:04.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.457+0000 7f77edd9b640 1 -- 172.21.15.78:0/4185113031 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77e00aa610 con 0x7f77f01444c0 2023-12-12T10:13:04.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.457+0000 7f77edd9b640 1 -- 172.21.15.78:0/4185113031 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77e00a6040 con 0x7f77f01444c0 2023-12-12T10:13:04.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.457+0000 7f77edd9b640 1 -- 172.21.15.78:0/4185113031 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77e00aa990 con 0x7f77f01444c0 2023-12-12T10:13:04.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.457+0000 7f77ef59e640 1 -- 172.21.15.78:0/4185113031 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f77f01444c0 msgr2=0x7f77f015f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:04.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.457+0000 7f77ef59e640 1 --2- 172.21.15.78:0/4185113031 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f77f01444c0 0x7f77f015f320 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f77f00b1810 tx=0x7f77e001c4d0 comp rx=0 tx=0).stop 2023-12-12T10:13:04.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.457+0000 7f77ef59e640 1 -- 172.21.15.78:0/4185113031 shutdown_connections 2023-12-12T10:13:04.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.457+0000 7f77ef59e640 1 --2- 172.21.15.78:0/4185113031 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f77f00cec10 0x7f77f00cf080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:04.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.457+0000 7f77ef59e640 1 --2- 172.21.15.78:0/4185113031 >> v2:172.21.15.187:3300/0 conn(0x7f77f00cceb0 0x7f77f015b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:04.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.457+0000 7f77ef59e640 1 --2- 172.21.15.78:0/4185113031 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f77f01444c0 0x7f77f015f320 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:04.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.457+0000 7f77ef59e640 1 -- 172.21.15.78:0/4185113031 >> 172.21.15.78:0/4185113031 conn(0x7f77f006a710 msgr2=0x7f77f006ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:04.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.457+0000 7f77ef59e640 1 -- 172.21.15.78:0/4185113031 shutdown_connections 2023-12-12T10:13:04.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.457+0000 7f77ef59e640 1 -- 172.21.15.78:0/4185113031 wait complete. 2023-12-12T10:13:04.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.457+0000 7f77ef59e640 1 Processor -- start 2023-12-12T10:13:04.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.457+0000 7f77ef59e640 1 -- start start 2023-12-12T10:13:04.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.461+0000 7f77ef59e640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f77f00cceb0 0x7f77f0137440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:04.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.461+0000 7f77ef59e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f77f00cec10 0x7f77f0159ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:04.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.461+0000 7f77ef59e640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f77f01444c0 0x7f77f006dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:04.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.461+0000 7f77ef59e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77f013a490 con 0x7f77f00cec10 2023-12-12T10:13:04.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.461+0000 7f77ef59e640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77f0137d00 con 0x7f77f00cceb0 2023-12-12T10:13:04.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.461+0000 7f77ef59e640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77f0137a20 con 0x7f77f01444c0 2023-12-12T10:13:04.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.461+0000 7f77e7fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f77f00cec10 0x7f77f0159ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:04.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.461+0000 7f77e7fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f77f00cec10 0x7f77f0159ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41960/0 (socket says 172.21.15.78:41960) 2023-12-12T10:13:04.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.461+0000 7f77e7fff640 1 -- 172.21.15.78:0/2505135258 learned_addr learned my addr 172.21.15.78:0/2505135258 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:13:04.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.461+0000 7f77ee59c640 1 --2- 172.21.15.78:0/2505135258 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f77f00cceb0 0x7f77f0137440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:04.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.461+0000 7f77eed9d640 1 --2- 172.21.15.78:0/2505135258 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f77f01444c0 0x7f77f006dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:04.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.461+0000 7f77e7fff640 1 -- 172.21.15.78:0/2505135258 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f77f01444c0 msgr2=0x7f77f006dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:04.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.461+0000 7f77e7fff640 1 --2- 172.21.15.78:0/2505135258 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f77f01444c0 0x7f77f006dae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:04.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.461+0000 7f77e7fff640 1 -- 172.21.15.78:0/2505135258 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f77f00cceb0 msgr2=0x7f77f0137440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:04.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.461+0000 7f77e7fff640 1 --2- 172.21.15.78:0/2505135258 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f77f00cceb0 0x7f77f0137440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:04.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.461+0000 7f77e7fff640 1 -- 172.21.15.78:0/2505135258 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77e00094d0 con 0x7f77f00cec10 2023-12-12T10:13:04.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.461+0000 7f77eed9d640 1 --2- 172.21.15.78:0/2505135258 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f77f01444c0 0x7f77f006dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T10:13:04.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.461+0000 7f77e7fff640 1 --2- 172.21.15.78:0/2505135258 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f77f00cec10 0x7f77f0159ce0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f77d800e840 tx=0x7f77d800ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:04.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.461+0000 7f77e6ffd640 1 -- 172.21.15.78:0/2505135258 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d800c870 con 0x7f77f00cec10 2023-12-12T10:13:04.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.461+0000 7f77e6ffd640 1 -- 172.21.15.78:0/2505135258 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77d800c9d0 con 0x7f77f00cec10 2023-12-12T10:13:04.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.461+0000 7f77ef59e640 1 -- 172.21.15.78:0/2505135258 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77f0139dd0 con 0x7f77f00cec10 2023-12-12T10:13:04.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.461+0000 7f77e6ffd640 1 -- 172.21.15.78:0/2505135258 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d800cd80 con 0x7f77f00cec10 2023-12-12T10:13:04.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.461+0000 7f77ef59e640 1 -- 172.21.15.78:0/2505135258 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77f006e020 con 0x7f77f00cec10 2023-12-12T10:13:04.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.461+0000 7f77ef59e640 1 -- 172.21.15.78:0/2505135258 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77f00671f0 con 0x7f77f00cec10 2023-12-12T10:13:04.467 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.461+0000 7f77e6ffd640 1 -- 172.21.15.78:0/2505135258 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f77d8013410 con 0x7f77f00cec10 2023-12-12T10:13:04.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.465+0000 7f77e6ffd640 1 --2- 172.21.15.78:0/2505135258 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f77d0066470 0x7f77d0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:04.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.465+0000 7f77e6ffd640 1 -- 172.21.15.78:0/2505135258 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f77d8083f70 con 0x7f77f00cec10 2023-12-12T10:13:04.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.465+0000 7f77ee59c640 1 --2- 172.21.15.78:0/2505135258 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f77d0066470 0x7f77d0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:04.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.465+0000 7f77ee59c640 1 --2- 172.21.15.78:0/2505135258 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f77d0066470 0x7f77d0068930 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f77e00ae000 tx=0x7f77e00b5040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:04.472 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.469+0000 7f77e6ffd640 1 -- 172.21.15.78:0/2505135258 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f77d80510d0 con 0x7f77f00cec10 2023-12-12T10:13:04.625 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.621+0000 7f77ef59e640 1 -- 172.21.15.78:0/2505135258 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f77f0139c30 con 0x7f77f00cec10 2023-12-12T10:13:04.626 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.621+0000 7f77e6ffd640 1 -- 172.21.15.78:0/2505135258 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f77f0139c30 con 0x7f77f00cec10 2023-12-12T10:13:04.626 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2023-12-12T10:13:04.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.621+0000 7f77ef59e640 1 -- 172.21.15.78:0/2505135258 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f77d0066470 msgr2=0x7f77d0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:04.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.621+0000 7f77ef59e640 1 --2- 172.21.15.78:0/2505135258 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f77d0066470 0x7f77d0068930 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f77e00ae000 tx=0x7f77e00b5040 comp rx=0 tx=0).stop 2023-12-12T10:13:04.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.621+0000 7f77ef59e640 1 -- 172.21.15.78:0/2505135258 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f77f00cec10 msgr2=0x7f77f0159ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:04.628 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.621+0000 7f77ef59e640 1 --2- 172.21.15.78:0/2505135258 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f77f00cec10 0x7f77f0159ce0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f77d800e840 tx=0x7f77d800ed00 comp rx=0 tx=0).stop 2023-12-12T10:13:04.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.621+0000 7f77ef59e640 1 -- 172.21.15.78:0/2505135258 shutdown_connections 2023-12-12T10:13:04.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.621+0000 7f77ef59e640 1 --2- 172.21.15.78:0/2505135258 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f77d0066470 0x7f77d0068930 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:04.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.621+0000 7f77ef59e640 1 --2- 172.21.15.78:0/2505135258 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f77f01444c0 0x7f77f006dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:04.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.621+0000 7f77ef59e640 1 --2- 172.21.15.78:0/2505135258 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f77f00cec10 0x7f77f0159ce0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:04.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.621+0000 7f77ef59e640 1 --2- 172.21.15.78:0/2505135258 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f77f00cceb0 0x7f77f0137440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:04.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.621+0000 7f77ef59e640 1 -- 172.21.15.78:0/2505135258 >> 172.21.15.78:0/2505135258 conn(0x7f77f006a710 msgr2=0x7f77f0070090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:04.629 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.621+0000 7f77ef59e640 1 -- 172.21.15.78:0/2505135258 shutdown_connections 2023-12-12T10:13:04.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.621+0000 7f77ef59e640 1 -- 172.21.15.78:0/2505135258 wait complete. 2023-12-12T10:13:04.647 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-12T10:13:04.786 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.781+0000 7ff36119d640 1 Processor -- start 2023-12-12T10:13:04.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.781+0000 7ff36119d640 1 -- start start 2023-12-12T10:13:04.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.785+0000 7ff36119d640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff35c153ab0 0x7ff35c15a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:04.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.785+0000 7ff36119d640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7ff35c0b2b50 0x7ff35c06cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:04.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.785+0000 7ff36119d640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff35c0b1e20 con 0x7ff35c0ce490 2023-12-12T10:13:04.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.785+0000 7ff36119d640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff35c15aaa0 con 0x7ff35c153ab0 2023-12-12T10:13:04.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.785+0000 7ff36119d640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff35c0cea00 con 0x7ff35c0b2b50 2023-12-12T10:13:04.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.785+0000 7ff35ad9d640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff35c153ab0 0x7ff35c15a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:04.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.785+0000 7ff35ad9d640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff35c153ab0 0x7ff35c15a560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41962/0 (socket says 172.21.15.78:41962) 2023-12-12T10:13:04.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.785+0000 7ff35ad9d640 1 -- 172.21.15.78:0/2532534992 learned_addr learned my addr 172.21.15.78:0/2532534992 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:13:04.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.785+0000 7ff35259c640 1 --2- 172.21.15.78:0/2532534992 >> v2:172.21.15.187:3300/0 conn(0x7ff35c0b2b50 0x7ff35c06cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:04.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.785+0000 7ff35ad9d640 1 -- 172.21.15.78:0/2532534992 >> v2:172.21.15.187:3300/0 conn(0x7ff35c0b2b50 msgr2=0x7ff35c06cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:13:04.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.785+0000 7ff35ad9d640 1 --2- 172.21.15.78:0/2532534992 >> v2:172.21.15.187:3300/0 conn(0x7ff35c0b2b50 0x7ff35c06cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:04.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.785+0000 7ff35ad9d640 1 -- 172.21.15.78:0/2532534992 >> v1:172.21.15.187:6789/0 conn(0x7ff35c0ce490 legacy=0x7ff35c15d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:13:04.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.785+0000 7ff35ad9d640 1 -- 172.21.15.78:0/2532534992 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff35c0b2070 con 0x7ff35c153ab0 2023-12-12T10:13:04.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.785+0000 7ff35259c640 1 --2- 172.21.15.78:0/2532534992 >> v2:172.21.15.187:3300/0 conn(0x7ff35c0b2b50 0x7ff35c06cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T10:13:04.793 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.789+0000 7ff35ad9d640 1 --2- 172.21.15.78:0/2532534992 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff35c153ab0 0x7ff35c15a560 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7ff35c06e4f0 tx=0x7ff34401d840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57d0568bfe840924 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:04.793 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.789+0000 7ff35a59c640 1 -- 172.21.15.78:0/2532534992 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3440a76a0 con 0x7ff35c153ab0 2023-12-12T10:13:04.793 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.789+0000 7ff35a59c640 1 -- 172.21.15.78:0/2532534992 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3440a7800 con 0x7ff35c153ab0 2023-12-12T10:13:04.793 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.789+0000 7ff35a59c640 1 -- 172.21.15.78:0/2532534992 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3440a7b90 con 0x7ff35c153ab0 2023-12-12T10:13:04.793 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.789+0000 7ff36119d640 1 -- 172.21.15.78:0/2532534992 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff35c153ab0 msgr2=0x7ff35c15a560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:04.793 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.789+0000 7ff36119d640 1 --2- 172.21.15.78:0/2532534992 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff35c153ab0 0x7ff35c15a560 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7ff35c06e4f0 tx=0x7ff34401d840 comp rx=0 tx=0).stop 2023-12-12T10:13:04.793 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.789+0000 7ff36119d640 1 -- 172.21.15.78:0/2532534992 shutdown_connections 2023-12-12T10:13:04.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.789+0000 7ff36119d640 1 --2- 172.21.15.78:0/2532534992 >> v2:172.21.15.187:3300/0 conn(0x7ff35c0b2b50 0x7ff35c06cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:04.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.789+0000 7ff36119d640 1 --2- 172.21.15.78:0/2532534992 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff35c153ab0 0x7ff35c15a560 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:04.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.789+0000 7ff36119d640 1 -- 172.21.15.78:0/2532534992 >> 172.21.15.78:0/2532534992 conn(0x7ff35c06a710 msgr2=0x7ff35c06ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:04.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.789+0000 7ff36119d640 1 -- 172.21.15.78:0/2532534992 shutdown_connections 2023-12-12T10:13:04.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.789+0000 7ff36119d640 1 -- 172.21.15.78:0/2532534992 wait complete. 2023-12-12T10:13:04.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.789+0000 7ff36119d640 1 Processor -- start 2023-12-12T10:13:04.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.789+0000 7ff36119d640 1 -- start start 2023-12-12T10:13:04.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.793+0000 7ff36119d640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff35c0b2b50 0x7ff35c13eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:04.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.793+0000 7ff36119d640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff35c0ce490 0x7ff35c13f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:04.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.793+0000 7ff36119d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff35c153ab0 0x7ff35c151f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:04.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.793+0000 7ff36119d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff35c1524c0 con 0x7ff35c153ab0 2023-12-12T10:13:04.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.793+0000 7ff36119d640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff35c13f710 con 0x7ff35c0b2b50 2023-12-12T10:13:04.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.793+0000 7ff36119d640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff35c13f9f0 con 0x7ff35c0ce490 2023-12-12T10:13:04.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.793+0000 7ff35b59e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff35c153ab0 0x7ff35c151f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:04.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.793+0000 7ff35b59e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff35c153ab0 0x7ff35c151f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41968/0 (socket says 172.21.15.78:41968) 2023-12-12T10:13:04.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.793+0000 7ff35b59e640 1 -- 172.21.15.78:0/571823498 learned_addr learned my addr 172.21.15.78:0/571823498 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:13:04.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.793+0000 7ff35ad9d640 1 --2- 172.21.15.78:0/571823498 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff35c0b2b50 0x7ff35c13eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:04.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.793+0000 7ff35259c640 1 --2- 172.21.15.78:0/571823498 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff35c0ce490 0x7ff35c13f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:04.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.793+0000 7ff35b59e640 1 -- 172.21.15.78:0/571823498 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff35c0ce490 msgr2=0x7ff35c13f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:04.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.793+0000 7ff35b59e640 1 --2- 172.21.15.78:0/571823498 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff35c0ce490 0x7ff35c13f0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:04.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.793+0000 7ff35b59e640 1 -- 172.21.15.78:0/571823498 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff35c0b2b50 msgr2=0x7ff35c13eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:04.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.793+0000 7ff35b59e640 1 --2- 172.21.15.78:0/571823498 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff35c0b2b50 0x7ff35c13eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:04.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.793+0000 7ff35b59e640 1 -- 172.21.15.78:0/571823498 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff34400a670 con 0x7ff35c153ab0 2023-12-12T10:13:04.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.793+0000 7ff35259c640 1 --2- 172.21.15.78:0/571823498 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff35c0ce490 0x7ff35c13f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T10:13:04.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.793+0000 7ff35b59e640 1 --2- 172.21.15.78:0/571823498 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff35c153ab0 0x7ff35c151f80 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7ff35400c770 tx=0x7ff35400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:04.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.793+0000 7ff353fff640 1 -- 172.21.15.78:0/571823498 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff354003b80 con 0x7ff35c153ab0 2023-12-12T10:13:04.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.793+0000 7ff353fff640 1 -- 172.21.15.78:0/571823498 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff354003ce0 con 0x7ff35c153ab0 2023-12-12T10:13:04.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.793+0000 7ff36119d640 1 -- 172.21.15.78:0/571823498 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff35c13fcd0 con 0x7ff35c153ab0 2023-12-12T10:13:04.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.793+0000 7ff353fff640 1 -- 172.21.15.78:0/571823498 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff35400aa90 con 0x7ff35c153ab0 2023-12-12T10:13:04.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.793+0000 7ff36119d640 1 -- 172.21.15.78:0/571823498 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff35c140290 con 0x7ff35c153ab0 2023-12-12T10:13:04.800 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.793+0000 7ff36119d640 1 -- 172.21.15.78:0/571823498 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff35c0671f0 con 0x7ff35c153ab0 2023-12-12T10:13:04.800 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.793+0000 7ff353fff640 1 -- 172.21.15.78:0/571823498 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff35400abf0 con 0x7ff35c153ab0 2023-12-12T10:13:04.800 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.797+0000 7ff353fff640 1 --2- 172.21.15.78:0/571823498 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7ff33c066470 0x7ff33c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:04.800 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.797+0000 7ff353fff640 1 -- 172.21.15.78:0/571823498 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7ff354083ff0 con 0x7ff35c153ab0 2023-12-12T10:13:04.800 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.797+0000 7ff35ad9d640 1 --2- 172.21.15.78:0/571823498 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7ff33c066470 0x7ff33c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:04.800 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.797+0000 7ff35ad9d640 1 --2- 172.21.15.78:0/571823498 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7ff33c066470 0x7ff33c068930 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ff3440b0000 tx=0x7ff3440b3040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:04.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.801+0000 7ff353fff640 1 -- 172.21.15.78:0/571823498 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff3540510a0 con 0x7ff35c153ab0 2023-12-12T10:13:04.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.953+0000 7ff36119d640 1 -- 172.21.15.78:0/571823498 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff35c140480 con 0x7ff35c153ab0 2023-12-12T10:13:04.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.953+0000 7ff353fff640 1 -- 172.21.15.78:0/571823498 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff35c140480 con 0x7ff35c153ab0 2023-12-12T10:13:04.956 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2023-12-12T10:13:04.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.953+0000 7ff36119d640 1 -- 172.21.15.78:0/571823498 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7ff33c066470 msgr2=0x7ff33c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:04.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.953+0000 7ff36119d640 1 --2- 172.21.15.78:0/571823498 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7ff33c066470 0x7ff33c068930 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7ff3440b0000 tx=0x7ff3440b3040 comp rx=0 tx=0).stop 2023-12-12T10:13:04.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.953+0000 7ff36119d640 1 -- 172.21.15.78:0/571823498 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff35c153ab0 msgr2=0x7ff35c151f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:04.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.953+0000 7ff36119d640 1 --2- 172.21.15.78:0/571823498 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff35c153ab0 0x7ff35c151f80 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7ff35400c770 tx=0x7ff35400cc30 comp rx=0 tx=0).stop 2023-12-12T10:13:04.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.953+0000 7ff36119d640 1 -- 172.21.15.78:0/571823498 shutdown_connections 2023-12-12T10:13:04.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.953+0000 7ff36119d640 1 --2- 172.21.15.78:0/571823498 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7ff33c066470 0x7ff33c068930 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:04.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.953+0000 7ff36119d640 1 --2- 172.21.15.78:0/571823498 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff35c153ab0 0x7ff35c151f80 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:04.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.953+0000 7ff36119d640 1 --2- 172.21.15.78:0/571823498 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff35c0ce490 0x7ff35c13f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:04.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.953+0000 7ff36119d640 1 --2- 172.21.15.78:0/571823498 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff35c0b2b50 0x7ff35c13eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:04.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.953+0000 7ff36119d640 1 -- 172.21.15.78:0/571823498 >> 172.21.15.78:0/571823498 conn(0x7ff35c06a710 msgr2=0x7ff35c0cb960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:04.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.953+0000 7ff36119d640 1 -- 172.21.15.78:0/571823498 shutdown_connections 2023-12-12T10:13:04.959 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:04.953+0000 7ff36119d640 1 -- 172.21.15.78:0/571823498 wait complete. 2023-12-12T10:13:04.978 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-12T10:13:05.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.113+0000 7f858718d640 1 Processor -- start 2023-12-12T10:13:05.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.113+0000 7f858718d640 1 -- start start 2023-12-12T10:13:05.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.117+0000 7f858718d640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f85800cdf60 0x7f8580070f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:05.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.117+0000 7f858718d640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8580070a70 con 0x7f8580143770 2023-12-12T10:13:05.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.117+0000 7f858718d640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85800ce3c0 con 0x7f8580071440 2023-12-12T10:13:05.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.117+0000 7f858718d640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8580070440 con 0x7f85800cdf60 2023-12-12T10:13:05.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.117+0000 7f8577fff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f85800cdf60 0x7f8580070f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:05.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.117+0000 7f8577fff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f85800cdf60 0x7f8580070f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41972/0 (socket says 172.21.15.78:41972) 2023-12-12T10:13:05.121 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.117+0000 7f8577fff640 1 -- 172.21.15.78:0/1474821201 learned_addr learned my addr 172.21.15.78:0/1474821201 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:13:05.121 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.117+0000 7f8577fff640 1 -- 172.21.15.78:0/1474821201 >> v1:172.21.15.187:6789/0 conn(0x7f8580071440 legacy=0x7f858015d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:13:05.121 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.117+0000 7f8577fff640 1 -- 172.21.15.78:0/1474821201 >> v1:172.21.15.78:6789/0 conn(0x7f8580143770 legacy=0x7f85800b1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:05.121 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.117+0000 7f8577fff640 1 -- 172.21.15.78:0/1474821201 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85800b2530 con 0x7f85800cdf60 2023-12-12T10:13:05.123 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.121+0000 7f8577fff640 1 --2- 172.21.15.78:0/1474821201 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85800cdf60 0x7f8580070f00 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f8570009870 tx=0x7f857001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df2b03a3854eeb9 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:05.124 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.121+0000 7f85777fe640 1 -- 172.21.15.78:0/1474821201 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85700ab670 con 0x7f85800cdf60 2023-12-12T10:13:05.124 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.121+0000 7f85777fe640 1 -- 172.21.15.78:0/1474821201 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85700ab7d0 con 0x7f85800cdf60 2023-12-12T10:13:05.124 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.121+0000 7f85777fe640 1 -- 172.21.15.78:0/1474821201 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85700abb60 con 0x7f85800cdf60 2023-12-12T10:13:05.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.121+0000 7f858718d640 1 -- 172.21.15.78:0/1474821201 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85800cdf60 msgr2=0x7f8580070f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:05.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.121+0000 7f858718d640 1 --2- 172.21.15.78:0/1474821201 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85800cdf60 0x7f8580070f00 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f8570009870 tx=0x7f857001c470 comp rx=0 tx=0).stop 2023-12-12T10:13:05.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.121+0000 7f858718d640 1 -- 172.21.15.78:0/1474821201 shutdown_connections 2023-12-12T10:13:05.126 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.121+0000 7f858718d640 1 --2- 172.21.15.78:0/1474821201 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f85800cdf60 0x7f8580070f00 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:05.126 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.121+0000 7f858718d640 1 -- 172.21.15.78:0/1474821201 >> 172.21.15.78:0/1474821201 conn(0x7f858006a710 msgr2=0x7f858006ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:05.126 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.121+0000 7f858718d640 1 -- 172.21.15.78:0/1474821201 shutdown_connections 2023-12-12T10:13:05.126 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.121+0000 7f858718d640 1 -- 172.21.15.78:0/1474821201 wait complete. 2023-12-12T10:13:05.126 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.121+0000 7f858718d640 1 Processor -- start 2023-12-12T10:13:05.126 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.121+0000 7f858718d640 1 -- start start 2023-12-12T10:13:05.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.125+0000 7f858718d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8580071440 0x7f858013ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:05.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.125+0000 7f858718d640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f85800cdf60 0x7f8580141f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:05.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.125+0000 7f858718d640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8580143770 0x7f8580159850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:05.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.125+0000 7f858718d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8580142480 con 0x7f8580071440 2023-12-12T10:13:05.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.125+0000 7f858718d640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f858013b360 con 0x7f8580143770 2023-12-12T10:13:05.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.125+0000 7f858718d640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f858013b640 con 0x7f85800cdf60 2023-12-12T10:13:05.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.125+0000 7f8584f29640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8580071440 0x7f858013ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:05.129 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.125+0000 7f8584f29640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8580071440 0x7f858013ac80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41976/0 (socket says 172.21.15.78:41976) 2023-12-12T10:13:05.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.125+0000 7f8584f29640 1 -- 172.21.15.78:0/2540894818 learned_addr learned my addr 172.21.15.78:0/2540894818 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:13:05.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.125+0000 7f8584f29640 1 -- 172.21.15.78:0/2540894818 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f85800cdf60 msgr2=0x7f8580141f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:05.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.125+0000 7f8584f29640 1 --2- 172.21.15.78:0/2540894818 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f85800cdf60 0x7f8580141f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:05.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.125+0000 7f8584f29640 1 -- 172.21.15.78:0/2540894818 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8580143770 msgr2=0x7f8580159850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:05.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.125+0000 7f8584f29640 1 --2- 172.21.15.78:0/2540894818 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8580143770 0x7f8580159850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:05.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.125+0000 7f8584f29640 1 -- 172.21.15.78:0/2540894818 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85700094d0 con 0x7f8580071440 2023-12-12T10:13:05.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.125+0000 7f8584f29640 1 --2- 172.21.15.78:0/2540894818 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8580071440 0x7f858013ac80 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f857c00c3c0 tx=0x7f857c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:05.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.125+0000 7f85757fa640 1 -- 172.21.15.78:0/2540894818 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f857c0052d0 con 0x7f8580071440 2023-12-12T10:13:05.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.125+0000 7f85757fa640 1 -- 172.21.15.78:0/2540894818 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f857c005430 con 0x7f8580071440 2023-12-12T10:13:05.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.125+0000 7f858718d640 1 -- 172.21.15.78:0/2540894818 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f858013b920 con 0x7f8580071440 2023-12-12T10:13:05.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.125+0000 7f85757fa640 1 -- 172.21.15.78:0/2540894818 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f857c003840 con 0x7f8580071440 2023-12-12T10:13:05.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.125+0000 7f858718d640 1 -- 172.21.15.78:0/2540894818 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8580159d90 con 0x7f8580071440 2023-12-12T10:13:05.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.125+0000 7f858718d640 1 -- 172.21.15.78:0/2540894818 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85800671f0 con 0x7f8580071440 2023-12-12T10:13:05.131 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.125+0000 7f85757fa640 1 -- 172.21.15.78:0/2540894818 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f857c0039a0 con 0x7f8580071440 2023-12-12T10:13:05.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.129+0000 7f85757fa640 1 --2- 172.21.15.78:0/2540894818 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f856c066470 0x7f856c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:05.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.129+0000 7f85757fa640 1 -- 172.21.15.78:0/2540894818 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f857c083830 con 0x7f8580071440 2023-12-12T10:13:05.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.129+0000 7f8577fff640 1 --2- 172.21.15.78:0/2540894818 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f856c066470 0x7f856c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:05.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.129+0000 7f8577fff640 1 --2- 172.21.15.78:0/2540894818 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f856c066470 0x7f856c068930 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f85700af000 tx=0x7f8570008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:05.135 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.133+0000 7f85757fa640 1 -- 172.21.15.78:0/2540894818 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f857c050850 con 0x7f8580071440 2023-12-12T10:13:05.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.281+0000 7f858718d640 1 -- 172.21.15.78:0/2540894818 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f858013f330 con 0x7f8580071440 2023-12-12T10:13:05.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.281+0000 7f85757fa640 1 -- 172.21.15.78:0/2540894818 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f857c053e70 con 0x7f8580071440 2023-12-12T10:13:05.287 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2023-12-12T10:13:05.288 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.285+0000 7f858718d640 1 -- 172.21.15.78:0/2540894818 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f856c066470 msgr2=0x7f856c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:05.289 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.285+0000 7f858718d640 1 --2- 172.21.15.78:0/2540894818 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f856c066470 0x7f856c068930 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f85700af000 tx=0x7f8570008040 comp rx=0 tx=0).stop 2023-12-12T10:13:05.289 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.285+0000 7f858718d640 1 -- 172.21.15.78:0/2540894818 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8580071440 msgr2=0x7f858013ac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:05.289 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.285+0000 7f858718d640 1 --2- 172.21.15.78:0/2540894818 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8580071440 0x7f858013ac80 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f857c00c3c0 tx=0x7f857c00c880 comp rx=0 tx=0).stop 2023-12-12T10:13:05.289 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.285+0000 7f858718d640 1 -- 172.21.15.78:0/2540894818 shutdown_connections 2023-12-12T10:13:05.289 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.285+0000 7f858718d640 1 --2- 172.21.15.78:0/2540894818 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f856c066470 0x7f856c068930 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:05.289 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.285+0000 7f858718d640 1 --2- 172.21.15.78:0/2540894818 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8580143770 0x7f8580159850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:05.289 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.285+0000 7f858718d640 1 --2- 172.21.15.78:0/2540894818 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f85800cdf60 0x7f8580141f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:05.289 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.285+0000 7f858718d640 1 --2- 172.21.15.78:0/2540894818 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8580071440 0x7f858013ac80 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:05.289 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.285+0000 7f858718d640 1 -- 172.21.15.78:0/2540894818 >> 172.21.15.78:0/2540894818 conn(0x7f858006a710 msgr2=0x7f85800b3600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:05.289 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.285+0000 7f858718d640 1 -- 172.21.15.78:0/2540894818 shutdown_connections 2023-12-12T10:13:05.289 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.285+0000 7f858718d640 1 -- 172.21.15.78:0/2540894818 wait complete. 2023-12-12T10:13:05.308 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-12T10:13:05.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.445+0000 7f959d846640 1 Processor -- start 2023-12-12T10:13:05.448 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.445+0000 7f959d846640 1 -- start start 2023-12-12T10:13:05.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.445+0000 7f959d846640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f959806cf60 0x7f959815f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:05.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.445+0000 7f959d846640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f959815b390 0x7f959815b810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:05.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.445+0000 7f959d846640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95980cea30 con 0x7f95980cb4b0 2023-12-12T10:13:05.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.445+0000 7f959d846640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f959815bd50 con 0x7f959806cf60 2023-12-12T10:13:05.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.445+0000 7f959d846640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f959815bfc0 con 0x7f959815b390 2023-12-12T10:13:05.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.445+0000 7f95967fc640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f959806cf60 0x7f959815f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:05.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.445+0000 7f95967fc640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f959806cf60 0x7f959815f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41988/0 (socket says 172.21.15.78:41988) 2023-12-12T10:13:05.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.445+0000 7f95967fc640 1 -- 172.21.15.78:0/3757982508 learned_addr learned my addr 172.21.15.78:0/3757982508 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:13:05.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.445+0000 7f95977fe640 1 --2- 172.21.15.78:0/3757982508 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f959815b390 0x7f959815b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:05.450 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.445+0000 7f95967fc640 1 -- 172.21.15.78:0/3757982508 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f959815b390 msgr2=0x7f959815b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:13:05.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.445+0000 7f95967fc640 1 --2- 172.21.15.78:0/3757982508 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f959815b390 0x7f959815b810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:05.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.445+0000 7f95967fc640 1 -- 172.21.15.78:0/3757982508 >> v1:172.21.15.187:6789/0 conn(0x7f95980cb4b0 legacy=0x7f959806c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:05.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.445+0000 7f95967fc640 1 -- 172.21.15.78:0/3757982508 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f959815c2a0 con 0x7f959806cf60 2023-12-12T10:13:05.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.449+0000 7f95967fc640 1 --2- 172.21.15.78:0/3757982508 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f959806cf60 0x7f959815f500 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f958c009870 tx=0x7f958c01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccc55e24b03d4695 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:05.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.449+0000 7f9595ffb640 1 -- 172.21.15.78:0/3757982508 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f958c0ab680 con 0x7f959806cf60 2023-12-12T10:13:05.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.449+0000 7f9595ffb640 1 -- 172.21.15.78:0/3757982508 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f958c0ab7e0 con 0x7f959806cf60 2023-12-12T10:13:05.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.449+0000 7f9595ffb640 1 -- 172.21.15.78:0/3757982508 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f958c0abb70 con 0x7f959806cf60 2023-12-12T10:13:05.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.449+0000 7f959d846640 1 -- 172.21.15.78:0/3757982508 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f959806cf60 msgr2=0x7f959815f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:05.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.449+0000 7f959d846640 1 --2- 172.21.15.78:0/3757982508 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f959806cf60 0x7f959815f500 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f958c009870 tx=0x7f958c01c480 comp rx=0 tx=0).stop 2023-12-12T10:13:05.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.449+0000 7f959d846640 1 -- 172.21.15.78:0/3757982508 shutdown_connections 2023-12-12T10:13:05.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.449+0000 7f959d846640 1 --2- 172.21.15.78:0/3757982508 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f959815b390 0x7f959815b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:05.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.449+0000 7f959d846640 1 --2- 172.21.15.78:0/3757982508 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f959806cf60 0x7f959815f500 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:05.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.449+0000 7f959d846640 1 -- 172.21.15.78:0/3757982508 >> 172.21.15.78:0/3757982508 conn(0x7f959806a710 msgr2=0x7f959806ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:05.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.449+0000 7f959d846640 1 -- 172.21.15.78:0/3757982508 shutdown_connections 2023-12-12T10:13:05.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.449+0000 7f959d846640 1 -- 172.21.15.78:0/3757982508 wait complete. 2023-12-12T10:13:05.455 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.453+0000 7f959d846640 1 Processor -- start 2023-12-12T10:13:05.456 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.453+0000 7f959d846640 1 -- start start 2023-12-12T10:13:05.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.453+0000 7f959d846640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f959806cf60 0x7f959814d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:05.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.453+0000 7f959d846640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f95980cb4b0 0x7f9598149cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:05.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.453+0000 7f959d846640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f959815b390 0x7f9598150f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:05.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.453+0000 7f959d846640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f959814a210 con 0x7f959806cf60 2023-12-12T10:13:05.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.453+0000 7f959d846640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f959814cbb0 con 0x7f95980cb4b0 2023-12-12T10:13:05.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.453+0000 7f959d846640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f959814a640 con 0x7f959815b390 2023-12-12T10:13:05.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.453+0000 7f9596ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f959806cf60 0x7f959814d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:05.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.453+0000 7f9596ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f959806cf60 0x7f959814d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41992/0 (socket says 172.21.15.78:41992) 2023-12-12T10:13:05.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.453+0000 7f9596ffd640 1 -- 172.21.15.78:0/3732794190 learned_addr learned my addr 172.21.15.78:0/3732794190 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:13:05.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.453+0000 7f95967fc640 1 --2- 172.21.15.78:0/3732794190 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f95980cb4b0 0x7f9598149cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:05.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.453+0000 7f95977fe640 1 --2- 172.21.15.78:0/3732794190 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f959815b390 0x7f9598150f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:05.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.453+0000 7f9596ffd640 1 -- 172.21.15.78:0/3732794190 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f959815b390 msgr2=0x7f9598150f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:05.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.453+0000 7f9596ffd640 1 --2- 172.21.15.78:0/3732794190 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f959815b390 0x7f9598150f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:05.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.453+0000 7f9596ffd640 1 -- 172.21.15.78:0/3732794190 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f95980cb4b0 msgr2=0x7f9598149cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:05.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.453+0000 7f9596ffd640 1 --2- 172.21.15.78:0/3732794190 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f95980cb4b0 0x7f9598149cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:05.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.453+0000 7f9596ffd640 1 -- 172.21.15.78:0/3732794190 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f958c0094d0 con 0x7f959806cf60 2023-12-12T10:13:05.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.453+0000 7f95967fc640 1 --2- 172.21.15.78:0/3732794190 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f95980cb4b0 0x7f9598149cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T10:13:05.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.453+0000 7f9596ffd640 1 --2- 172.21.15.78:0/3732794190 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f959806cf60 0x7f959814d040 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f958800c500 tx=0x7f958800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:05.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.453+0000 7f957ffff640 1 -- 172.21.15.78:0/3732794190 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9588005220 con 0x7f959806cf60 2023-12-12T10:13:05.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.453+0000 7f957ffff640 1 -- 172.21.15.78:0/3732794190 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9588005380 con 0x7f959806cf60 2023-12-12T10:13:05.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.453+0000 7f957ffff640 1 -- 172.21.15.78:0/3732794190 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9588007270 con 0x7f959806cf60 2023-12-12T10:13:05.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.453+0000 7f959d846640 1 -- 172.21.15.78:0/3732794190 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f959814bfa0 con 0x7f959806cf60 2023-12-12T10:13:05.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.453+0000 7f959d846640 1 -- 172.21.15.78:0/3732794190 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f959814c560 con 0x7f959806cf60 2023-12-12T10:13:05.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.457+0000 7f959d846640 1 -- 172.21.15.78:0/3732794190 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95980671f0 con 0x7f959806cf60 2023-12-12T10:13:05.460 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.457+0000 7f957ffff640 1 -- 172.21.15.78:0/3732794190 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f95880073d0 con 0x7f959806cf60 2023-12-12T10:13:05.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.457+0000 7f957ffff640 1 --2- 172.21.15.78:0/3732794190 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f9584066470 0x7f9584068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:05.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.457+0000 7f957ffff640 1 -- 172.21.15.78:0/3732794190 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f9588083bc0 con 0x7f959806cf60 2023-12-12T10:13:05.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.457+0000 7f95967fc640 1 --2- 172.21.15.78:0/3732794190 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f9584066470 0x7f9584068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:05.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.457+0000 7f95967fc640 1 --2- 172.21.15.78:0/3732794190 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f9584066470 0x7f9584068930 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f958c0af000 tx=0x7f958c0a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:05.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.461+0000 7f957ffff640 1 -- 172.21.15.78:0/3732794190 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9588050bf0 con 0x7f959806cf60 2023-12-12T10:13:05.613 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.609+0000 7f959d846640 1 -- 172.21.15.78:0/3732794190 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f9598067530 con 0x7f959806cf60 2023-12-12T10:13:05.614 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.609+0000 7f957ffff640 1 -- 172.21.15.78:0/3732794190 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f9588054210 con 0x7f959806cf60 2023-12-12T10:13:05.614 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2023-12-12T10:13:05.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.613+0000 7f959d846640 1 -- 172.21.15.78:0/3732794190 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f9584066470 msgr2=0x7f9584068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:05.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.613+0000 7f959d846640 1 --2- 172.21.15.78:0/3732794190 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f9584066470 0x7f9584068930 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f958c0af000 tx=0x7f958c0a7000 comp rx=0 tx=0).stop 2023-12-12T10:13:05.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.613+0000 7f959d846640 1 -- 172.21.15.78:0/3732794190 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f959806cf60 msgr2=0x7f959814d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:05.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.613+0000 7f959d846640 1 --2- 172.21.15.78:0/3732794190 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f959806cf60 0x7f959814d040 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f958800c500 tx=0x7f958800c9c0 comp rx=0 tx=0).stop 2023-12-12T10:13:05.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.613+0000 7f959d846640 1 -- 172.21.15.78:0/3732794190 shutdown_connections 2023-12-12T10:13:05.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.613+0000 7f959d846640 1 --2- 172.21.15.78:0/3732794190 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f9584066470 0x7f9584068930 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:05.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.613+0000 7f959d846640 1 --2- 172.21.15.78:0/3732794190 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f959815b390 0x7f9598150f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:05.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.613+0000 7f959d846640 1 --2- 172.21.15.78:0/3732794190 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f95980cb4b0 0x7f9598149cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:05.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.613+0000 7f959d846640 1 --2- 172.21.15.78:0/3732794190 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f959806cf60 0x7f959814d040 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:05.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.613+0000 7f959d846640 1 -- 172.21.15.78:0/3732794190 >> 172.21.15.78:0/3732794190 conn(0x7f959806a710 msgr2=0x7f9598159e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:05.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.613+0000 7f959d846640 1 -- 172.21.15.78:0/3732794190 shutdown_connections 2023-12-12T10:13:05.616 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.613+0000 7f959d846640 1 -- 172.21.15.78:0/3732794190 wait complete. 2023-12-12T10:13:05.636 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-12T10:13:05.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.769+0000 7f874c8ea640 1 Processor -- start 2023-12-12T10:13:05.774 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.769+0000 7f874c8ea640 1 -- start start 2023-12-12T10:13:05.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.773+0000 7f874c8ea640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f874815baa0 0x7f874815f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:05.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.773+0000 7f874c8ea640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87480cea30 con 0x7f87480cb4b0 2023-12-12T10:13:05.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.773+0000 7f874c8ea640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f874815bfc0 con 0x7f874806cf60 2023-12-12T10:13:05.775 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.773+0000 7f874c8ea640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f874815c2a0 con 0x7f874815baa0 2023-12-12T10:13:05.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.773+0000 7f874659c640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f87480cb4b0 0x7f874806c850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:36042/0 (socket says 172.21.15.78:36042) 2023-12-12T10:13:05.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.773+0000 7f874659c640 1 -- 172.21.15.78:0/431334482 learned_addr learned my addr 172.21.15.78:0/431334482 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-12-12T10:13:05.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.773+0000 7f8746d9d640 1 --2- 172.21.15.78:0/431334482 >> v2:172.21.15.187:3300/0 conn(0x7f874815baa0 0x7f874815f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:05.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.773+0000 7f8745d9b640 1 -- 172.21.15.78:0/431334482 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 678088120 0 0) 0x7f87480cea30 con 0x7f87480cb4b0 2023-12-12T10:13:05.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.773+0000 7f8745d9b640 1 -- 172.21.15.78:0/431334482 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8734003530 con 0x7f87480cb4b0 2023-12-12T10:13:05.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.773+0000 7f8746d9d640 1 -- 172.21.15.78:0/431334482 >> v1:172.21.15.187:6789/0 conn(0x7f874806cf60 legacy=0x7f874815b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:05.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.773+0000 7f8745d9b640 1 -- 172.21.15.78:0/431334482 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 522239749 0 0) 0x7f8734003530 con 0x7f87480cb4b0 2023-12-12T10:13:05.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.773+0000 7f8746d9d640 1 -- 172.21.15.78:0/431334482 >> v1:172.21.15.78:6789/0 conn(0x7f87480cb4b0 legacy=0x7f874806c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:05.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.773+0000 7f8746d9d640 1 -- 172.21.15.78:0/431334482 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f874815ea20 con 0x7f874815baa0 2023-12-12T10:13:05.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.777+0000 7f8746d9d640 1 --2- 172.21.15.78:0/431334482 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f874815baa0 0x7f874815f500 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f8740009d90 tx=0x7f874001c7b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fe4fadf449103d2c server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:05.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.777+0000 7f8745d9b640 1 -- 172.21.15.78:0/431334482 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8738001680 con 0x7f874815baa0 2023-12-12T10:13:05.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.777+0000 7f8745d9b640 1 -- 172.21.15.78:0/431334482 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87400a55f0 con 0x7f874815baa0 2023-12-12T10:13:05.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.777+0000 7f8745d9b640 1 -- 172.21.15.78:0/431334482 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87400a5980 con 0x7f874815baa0 2023-12-12T10:13:05.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.777+0000 7f874c8ea640 1 -- 172.21.15.78:0/431334482 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f874815baa0 msgr2=0x7f874815f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:05.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.777+0000 7f874c8ea640 1 --2- 172.21.15.78:0/431334482 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f874815baa0 0x7f874815f500 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f8740009d90 tx=0x7f874001c7b0 comp rx=0 tx=0).stop 2023-12-12T10:13:05.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.777+0000 7f874c8ea640 1 -- 172.21.15.78:0/431334482 shutdown_connections 2023-12-12T10:13:05.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.777+0000 7f874c8ea640 1 --2- 172.21.15.78:0/431334482 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f874815baa0 0x7f874815f500 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:05.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.777+0000 7f874c8ea640 1 -- 172.21.15.78:0/431334482 >> 172.21.15.78:0/431334482 conn(0x7f874806a710 msgr2=0x7f874806ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:05.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.777+0000 7f874c8ea640 1 -- 172.21.15.78:0/431334482 shutdown_connections 2023-12-12T10:13:05.781 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.777+0000 7f874c8ea640 1 -- 172.21.15.78:0/431334482 wait complete. 2023-12-12T10:13:05.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.777+0000 7f874c8ea640 1 Processor -- start 2023-12-12T10:13:05.782 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.777+0000 7f874c8ea640 1 -- start start 2023-12-12T10:13:05.784 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.777+0000 7f874c8ea640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f874806cf60 0x7f8748150970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:05.785 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.781+0000 7f874c8ea640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f87480cb4b0 0x7f8748156d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:05.785 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.781+0000 7f874c8ea640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f874815baa0 0x7f874814c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:05.785 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.781+0000 7f874c8ea640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8748149ea0 con 0x7f874806cf60 2023-12-12T10:13:05.785 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.781+0000 7f874c8ea640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87481572d0 con 0x7f874815baa0 2023-12-12T10:13:05.785 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.781+0000 7f874c8ea640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8748151b60 con 0x7f87480cb4b0 2023-12-12T10:13:05.785 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.781+0000 7f874659c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f874806cf60 0x7f8748150970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:05.785 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.781+0000 7f874659c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f874806cf60 0x7f8748150970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:41994/0 (socket says 172.21.15.78:41994) 2023-12-12T10:13:05.785 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.781+0000 7f874659c640 1 -- 172.21.15.78:0/1388086981 learned_addr learned my addr 172.21.15.78:0/1388086981 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:13:05.785 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.781+0000 7f874659c640 1 -- 172.21.15.78:0/1388086981 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f87480cb4b0 msgr2=0x7f8748156d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:05.785 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.781+0000 7f874659c640 1 --2- 172.21.15.78:0/1388086981 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f87480cb4b0 0x7f8748156d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:05.785 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.781+0000 7f874659c640 1 -- 172.21.15.78:0/1388086981 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f874815baa0 msgr2=0x7f874814c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:05.785 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.781+0000 7f874659c640 1 --2- 172.21.15.78:0/1388086981 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f874815baa0 0x7f874814c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:05.785 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.781+0000 7f874659c640 1 -- 172.21.15.78:0/1388086981 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8740009a70 con 0x7f874806cf60 2023-12-12T10:13:05.785 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.781+0000 7f874659c640 1 --2- 172.21.15.78:0/1388086981 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f874806cf60 0x7f8748150970 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f873800c760 tx=0x7f873800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:05.786 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.781+0000 7f873effd640 1 -- 172.21.15.78:0/1388086981 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8738005cf0 con 0x7f874806cf60 2023-12-12T10:13:05.786 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.781+0000 7f873effd640 1 -- 172.21.15.78:0/1388086981 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8738005e50 con 0x7f874806cf60 2023-12-12T10:13:05.786 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.781+0000 7f874c8ea640 1 -- 172.21.15.78:0/1388086981 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8748150f50 con 0x7f874806cf60 2023-12-12T10:13:05.786 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.781+0000 7f873effd640 1 -- 172.21.15.78:0/1388086981 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8738007270 con 0x7f874806cf60 2023-12-12T10:13:05.786 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.781+0000 7f874c8ea640 1 -- 172.21.15.78:0/1388086981 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8748151510 con 0x7f874806cf60 2023-12-12T10:13:05.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.781+0000 7f874c8ea640 1 -- 172.21.15.78:0/1388086981 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87480671f0 con 0x7f874806cf60 2023-12-12T10:13:05.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.781+0000 7f873effd640 1 -- 172.21.15.78:0/1388086981 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f87380073d0 con 0x7f874806cf60 2023-12-12T10:13:05.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.781+0000 7f873effd640 1 --2- 172.21.15.78:0/1388086981 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f8728066470 0x7f8728068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:05.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.785+0000 7f873effd640 1 -- 172.21.15.78:0/1388086981 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f8738084150 con 0x7f874806cf60 2023-12-12T10:13:05.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.785+0000 7f873ffff640 1 --2- 172.21.15.78:0/1388086981 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f8728066470 0x7f8728068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:05.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.785+0000 7f873ffff640 1 --2- 172.21.15.78:0/1388086981 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f8728066470 0x7f8728068930 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f8730000f70 tx=0x7f87300079c0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:05.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.785+0000 7f873effd640 1 -- 172.21.15.78:0/1388086981 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f87380510e0 con 0x7f874806cf60 2023-12-12T10:13:05.955 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.949+0000 7f874c8ea640 1 -- 172.21.15.78:0/1388086981 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f87480ceba0 con 0x7f874806cf60 2023-12-12T10:13:05.956 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.949+0000 7f873effd640 1 -- 172.21.15.78:0/1388086981 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f8738054700 con 0x7f874806cf60 2023-12-12T10:13:05.956 INFO:teuthology.orchestra.run.smithi078.stderr:listed 0 entries 2023-12-12T10:13:05.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.953+0000 7f874c8ea640 1 -- 172.21.15.78:0/1388086981 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f8728066470 msgr2=0x7f8728068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:05.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.953+0000 7f874c8ea640 1 --2- 172.21.15.78:0/1388086981 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f8728066470 0x7f8728068930 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f8730000f70 tx=0x7f87300079c0 comp rx=0 tx=0).stop 2023-12-12T10:13:05.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.953+0000 7f874c8ea640 1 -- 172.21.15.78:0/1388086981 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f874806cf60 msgr2=0x7f8748150970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:05.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.953+0000 7f874c8ea640 1 --2- 172.21.15.78:0/1388086981 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f874806cf60 0x7f8748150970 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f873800c760 tx=0x7f873800cc20 comp rx=0 tx=0).stop 2023-12-12T10:13:05.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.953+0000 7f874c8ea640 1 -- 172.21.15.78:0/1388086981 shutdown_connections 2023-12-12T10:13:05.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.953+0000 7f874c8ea640 1 --2- 172.21.15.78:0/1388086981 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f8728066470 0x7f8728068930 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:05.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.953+0000 7f874c8ea640 1 --2- 172.21.15.78:0/1388086981 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f874815baa0 0x7f874814c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:05.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.953+0000 7f874c8ea640 1 --2- 172.21.15.78:0/1388086981 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f87480cb4b0 0x7f8748156d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:05.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.953+0000 7f874c8ea640 1 --2- 172.21.15.78:0/1388086981 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f874806cf60 0x7f8748150970 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:05.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.953+0000 7f874c8ea640 1 -- 172.21.15.78:0/1388086981 >> 172.21.15.78:0/1388086981 conn(0x7f874806a710 msgr2=0x7f8748072e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:05.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.953+0000 7f874c8ea640 1 -- 172.21.15.78:0/1388086981 shutdown_connections 2023-12-12T10:13:05.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:05.953+0000 7f874c8ea640 1 -- 172.21.15.78:0/1388086981 wait complete. 2023-12-12T10:13:05.976 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi187.front.sepia.ceph.com... 2023-12-12T10:13:05.976 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T10:13:05.976 DEBUG:teuthology.orchestra.run.smithi187:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2023-12-12T10:13:06.013 INFO:teuthology.orchestra.run:waiting for 300 2023-12-12T10:13:06.013 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi187.front.sepia.ceph.com 2023-12-12T10:13:06.013 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T10:13:06.013 DEBUG:teuthology.orchestra.run.smithi187:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-12T10:13:06.079 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-12-12T10:13:06.079 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-12T10:13:06.088 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-12-12T10:13:06.088 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-12T10:13:06.143 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T10:13:06.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.321+0000 7f1d8e52a640 1 Processor -- start 2023-12-12T10:13:06.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.321+0000 7f1d8e52a640 1 -- start start 2023-12-12T10:13:06.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.321+0000 7f1d8e52a640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f1d880b2710 0x7f1d8806a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:06.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.321+0000 7f1d8e52a640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1d8806bc70 0x7f1d88145e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:06.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.321+0000 7f1d8e52a640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f1d88160c60 0x7f1d88146340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:06.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.321+0000 7f1d8e52a640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d8806b850 con 0x7f1d88160c60 2023-12-12T10:13:06.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.321+0000 7f1d8e52a640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d880b4780 con 0x7f1d880b2710 2023-12-12T10:13:06.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.321+0000 7f1d8e52a640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d8806abd0 con 0x7f1d8806bc70 2023-12-12T10:13:06.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.321+0000 7f1d8cac7640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f1d88160c60 0x7f1d88146340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:06.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.321+0000 7f1d8cac7640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f1d88160c60 0x7f1d88146340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42010/0 (socket says 172.21.15.78:42010) 2023-12-12T10:13:06.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.321+0000 7f1d8cac7640 1 -- 172.21.15.78:0/1005627747 learned_addr learned my addr 172.21.15.78:0/1005627747 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:13:06.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.321+0000 7f1d87fff640 1 --2- 172.21.15.78:0/1005627747 >> v2:172.21.15.187:3300/0 conn(0x7f1d880b2710 0x7f1d8806a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:06.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.321+0000 7f1d877fe640 1 --2- 172.21.15.78:0/1005627747 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1d8806bc70 0x7f1d88145e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:06.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.321+0000 7f1d8cac7640 1 -- 172.21.15.78:0/1005627747 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1d8806bc70 msgr2=0x7f1d88145e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:13:06.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.321+0000 7f1d8cac7640 1 --2- 172.21.15.78:0/1005627747 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1d8806bc70 0x7f1d88145e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:06.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.321+0000 7f1d8cac7640 1 -- 172.21.15.78:0/1005627747 >> v2:172.21.15.187:3300/0 conn(0x7f1d880b2710 msgr2=0x7f1d8806a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:13:06.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.321+0000 7f1d8cac7640 1 --2- 172.21.15.78:0/1005627747 >> v2:172.21.15.187:3300/0 conn(0x7f1d880b2710 0x7f1d8806a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:06.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.321+0000 7f1d8cac7640 1 -- 172.21.15.78:0/1005627747 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d8806aeb0 con 0x7f1d88160c60 2023-12-12T10:13:06.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.325+0000 7f1d8cac7640 1 --2- 172.21.15.78:0/1005627747 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1d88160c60 0x7f1d88146340 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f1d88062380 tx=0x7f1d8001c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f3a36a850cd6e7c server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:06.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.325+0000 7f1d86ffd640 1 -- 172.21.15.78:0/1005627747 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d800a5710 con 0x7f1d88160c60 2023-12-12T10:13:06.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.325+0000 7f1d86ffd640 1 -- 172.21.15.78:0/1005627747 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d800a5870 con 0x7f1d88160c60 2023-12-12T10:13:06.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.325+0000 7f1d86ffd640 1 -- 172.21.15.78:0/1005627747 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d800a5c00 con 0x7f1d88160c60 2023-12-12T10:13:06.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.325+0000 7f1d8e52a640 1 -- 172.21.15.78:0/1005627747 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1d88160c60 msgr2=0x7f1d88146340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:06.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.325+0000 7f1d8e52a640 1 --2- 172.21.15.78:0/1005627747 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1d88160c60 0x7f1d88146340 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f1d88062380 tx=0x7f1d8001c9a0 comp rx=0 tx=0).stop 2023-12-12T10:13:06.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.325+0000 7f1d8e52a640 1 -- 172.21.15.78:0/1005627747 shutdown_connections 2023-12-12T10:13:06.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.325+0000 7f1d8e52a640 1 --2- 172.21.15.78:0/1005627747 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1d88160c60 0x7f1d88146340 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:06.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.325+0000 7f1d8e52a640 1 --2- 172.21.15.78:0/1005627747 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1d8806bc70 0x7f1d88145e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:06.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.325+0000 7f1d8e52a640 1 --2- 172.21.15.78:0/1005627747 >> v2:172.21.15.187:3300/0 conn(0x7f1d880b2710 0x7f1d8806a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:06.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.325+0000 7f1d8e52a640 1 -- 172.21.15.78:0/1005627747 >> 172.21.15.78:0/1005627747 conn(0x7f1d880cf480 msgr2=0x7f1d880cf890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:06.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.325+0000 7f1d8e52a640 1 -- 172.21.15.78:0/1005627747 shutdown_connections 2023-12-12T10:13:06.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.325+0000 7f1d8e52a640 1 -- 172.21.15.78:0/1005627747 wait complete. 2023-12-12T10:13:06.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.329+0000 7f1d8e52a640 1 Processor -- start 2023-12-12T10:13:06.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.329+0000 7f1d8e52a640 1 -- start start 2023-12-12T10:13:06.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.329+0000 7f1d8e52a640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1d8806bc70 0x7f1d880acd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:06.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.329+0000 7f1d8e52a640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1d880b2710 0x7f1d8815c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:06.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.329+0000 7f1d8e52a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1d88160c60 0x7f1d8815cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:06.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.329+0000 7f1d8e52a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d8815d300 con 0x7f1d88160c60 2023-12-12T10:13:06.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.329+0000 7f1d8e52a640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d88140300 con 0x7f1d8806bc70 2023-12-12T10:13:06.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.329+0000 7f1d8e52a640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d8813f780 con 0x7f1d880b2710 2023-12-12T10:13:06.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.329+0000 7f1d8cac7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1d88160c60 0x7f1d8815cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:06.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.329+0000 7f1d8cac7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1d88160c60 0x7f1d8815cdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42018/0 (socket says 172.21.15.78:42018) 2023-12-12T10:13:06.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.329+0000 7f1d8cac7640 1 -- 172.21.15.78:0/958036547 learned_addr learned my addr 172.21.15.78:0/958036547 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:13:06.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.329+0000 7f1d87fff640 1 --2- 172.21.15.78:0/958036547 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1d8806bc70 0x7f1d880acd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:06.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.329+0000 7f1d877fe640 1 --2- 172.21.15.78:0/958036547 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1d880b2710 0x7f1d8815c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:06.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.329+0000 7f1d8cac7640 1 -- 172.21.15.78:0/958036547 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1d880b2710 msgr2=0x7f1d8815c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:06.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.329+0000 7f1d8cac7640 1 --2- 172.21.15.78:0/958036547 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1d880b2710 0x7f1d8815c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:06.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.329+0000 7f1d8cac7640 1 -- 172.21.15.78:0/958036547 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1d8806bc70 msgr2=0x7f1d880acd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:06.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.329+0000 7f1d8cac7640 1 --2- 172.21.15.78:0/958036547 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1d8806bc70 0x7f1d880acd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:06.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.329+0000 7f1d8cac7640 1 -- 172.21.15.78:0/958036547 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d80009b30 con 0x7f1d88160c60 2023-12-12T10:13:06.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.329+0000 7f1d87fff640 1 --2- 172.21.15.78:0/958036547 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1d8806bc70 0x7f1d880acd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T10:13:06.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.329+0000 7f1d877fe640 1 --2- 172.21.15.78:0/958036547 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1d880b2710 0x7f1d8815c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T10:13:06.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.329+0000 7f1d8cac7640 1 --2- 172.21.15.78:0/958036547 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1d88160c60 0x7f1d8815cdc0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f1d8001d240 tx=0x7f1d80019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:06.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.329+0000 7f1d84ff9640 1 -- 172.21.15.78:0/958036547 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d800b8640 con 0x7f1d88160c60 2023-12-12T10:13:06.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.329+0000 7f1d84ff9640 1 -- 172.21.15.78:0/958036547 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d800b87c0 con 0x7f1d88160c60 2023-12-12T10:13:06.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.329+0000 7f1d84ff9640 1 -- 172.21.15.78:0/958036547 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d800b8b70 con 0x7f1d88160c60 2023-12-12T10:13:06.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.329+0000 7f1d8e52a640 1 -- 172.21.15.78:0/958036547 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d8813fa60 con 0x7f1d88160c60 2023-12-12T10:13:06.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.329+0000 7f1d8e52a640 1 -- 172.21.15.78:0/958036547 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d88140020 con 0x7f1d88160c60 2023-12-12T10:13:06.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.329+0000 7f1d8e52a640 1 -- 172.21.15.78:0/958036547 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d880b38b0 con 0x7f1d88160c60 2023-12-12T10:13:06.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.333+0000 7f1d84ff9640 1 -- 172.21.15.78:0/958036547 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f1d800b8cd0 con 0x7f1d88160c60 2023-12-12T10:13:06.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.333+0000 7f1d84ff9640 1 --2- 172.21.15.78:0/958036547 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f1d74066470 0x7f1d74068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:06.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.333+0000 7f1d84ff9640 1 -- 172.21.15.78:0/958036547 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f1d8011f570 con 0x7f1d88160c60 2023-12-12T10:13:06.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.333+0000 7f1d87fff640 1 --2- 172.21.15.78:0/958036547 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f1d74066470 0x7f1d74068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:06.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.333+0000 7f1d87fff640 1 --2- 172.21.15.78:0/958036547 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f1d74066470 0x7f1d74068930 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f1d88160370 tx=0x7f1d78008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:06.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.337+0000 7f1d84ff9640 1 -- 172.21.15.78:0/958036547 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1d800ec620 con 0x7f1d88160c60 2023-12-12T10:13:06.501 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.497+0000 7f1d8e52a640 1 -- 172.21.15.78:0/958036547 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1d88143d10 con 0x7f1d88160c60 2023-12-12T10:13:06.502 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.497+0000 7f1d84ff9640 1 -- 172.21.15.78:0/958036547 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18701 (secure 0 0 0) 0x7f1d800f6030 con 0x7f1d88160c60 2023-12-12T10:13:06.503 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:13:06.503 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":26,"fsid":"fc81937c-bd26-483c-952b-d1324fcb0c9e","created":"2023-12-12T10:11:44.020214+0000","modified":"2023-12-12T10:12:50.919344+0000","last_up_change":"2023-12-12T10:11:56.278318+0000","last_in_change":"2023-12-12T10:11:46.553610+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T10:11:57.053584+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-12T10:12:07.454450+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-12T10:12:08.182909+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-12T10:12:11.977952+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"22dfdedf-5f6c-4b20-9f6c-30517a1db70a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6809","nonce":3345683600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6811","nonce":3345683600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6815","nonce":3345683600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6813","nonce":3345683600}]},"public_addr":"172.21.15.78:6809/3345683600","cluster_addr":"172.21.15.78:6811/3345683600","heartbeat_back_addr":"172.21.15.78:6815/3345683600","heartbeat_front_addr":"172.21.15.78:6813/3345683600","state":["exists","up"]},{"osd":1,"uuid":"be34a7f3-a69a-462e-9ddf-5e537448dba2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6801","nonce":962652768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6803","nonce":962652768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6807","nonce":962652768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6805","nonce":962652768}]},"public_addr":"172.21.15.78:6801/962652768","cluster_addr":"172.21.15.78:6803/962652768","heartbeat_back_addr":"172.21.15.78:6807/962652768","heartbeat_front_addr":"172.21.15.78:6805/962652768","state":["exists","up"]},{"osd":2,"uuid":"55b381de-5f56-4b14-80f7-e6e41e084a13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6818","nonce":2910206054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6822","nonce":2910206054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6829","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6831","nonce":2910206054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6826","nonce":2910206054}]},"public_addr":"172.21.15.78:6818/2910206054","cluster_addr":"172.21.15.78:6822/2910206054","heartbeat_back_addr":"172.21.15.78:6831/2910206054","heartbeat_front_addr":"172.21.15.78:6826/2910206054","state":["exists","up"]},{"osd":3,"uuid":"d7682de1-25cb-4cec-869f-8851c28b0e6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6819","nonce":3750796703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6821","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6823","nonce":3750796703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6830","nonce":3750796703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6825","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6827","nonce":3750796703}]},"public_addr":"172.21.15.78:6819/3750796703","cluster_addr":"172.21.15.78:6823/3750796703","heartbeat_back_addr":"172.21.15.78:6830/3750796703","heartbeat_front_addr":"172.21.15.78:6827/3750796703","state":["exists","up"]},{"osd":4,"uuid":"8279815a-d6c7-4199-871e-d28971b9dc07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6809","nonce":2944277204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6811","nonce":2944277204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6815","nonce":2944277204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6813","nonce":2944277204}]},"public_addr":"172.21.15.187:6809/2944277204","cluster_addr":"172.21.15.187:6811/2944277204","heartbeat_back_addr":"172.21.15.187:6815/2944277204","heartbeat_front_addr":"172.21.15.187:6813/2944277204","state":["exists","up"]},{"osd":5,"uuid":"0a714c65-f8ce-4340-968f-11a799677ef3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6801","nonce":185858620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6803","nonce":185858620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6807","nonce":185858620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6805","nonce":185858620}]},"public_addr":"172.21.15.187:6801/185858620","cluster_addr":"172.21.15.187:6803/185858620","heartbeat_back_addr":"172.21.15.187:6807/185858620","heartbeat_front_addr":"172.21.15.187:6805/185858620","state":["exists","up"]},{"osd":6,"uuid":"d0bba9ab-f7ee-449e-8999-1c0cf7e6d53c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6817","nonce":4213392126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6819","nonce":4213392126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6824","nonce":4213392126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6821","nonce":4213392126}]},"public_addr":"172.21.15.187:6817/4213392126","cluster_addr":"172.21.15.187:6819/4213392126","heartbeat_back_addr":"172.21.15.187:6824/4213392126","heartbeat_front_addr":"172.21.15.187:6821/4213392126","state":["exists","up"]},{"osd":7,"uuid":"efe5e0d9-2f87-4889-a27a-e2a95a632302","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6823","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6825","nonce":85774004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6827","nonce":85774004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6831","nonce":85774004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6829","nonce":85774004}]},"public_addr":"172.21.15.187:6825/85774004","cluster_addr":"172.21.15.187:6827/85774004","heartbeat_back_addr":"172.21.15.187:6831/85774004","heartbeat_front_addr":"172.21.15.187:6829/85774004","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.214447+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.448899+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.293107+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.564184+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.175026+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.097717+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.261141+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.287681+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.18","mappings":[{"from":3,"to":2}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.13","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T10:13:06.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.501+0000 7f1d8e52a640 1 -- 172.21.15.78:0/958036547 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f1d74066470 msgr2=0x7f1d74068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:06.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.501+0000 7f1d8e52a640 1 --2- 172.21.15.78:0/958036547 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f1d74066470 0x7f1d74068930 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f1d88160370 tx=0x7f1d78008040 comp rx=0 tx=0).stop 2023-12-12T10:13:06.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.501+0000 7f1d8e52a640 1 -- 172.21.15.78:0/958036547 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1d88160c60 msgr2=0x7f1d8815cdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:06.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.501+0000 7f1d8e52a640 1 --2- 172.21.15.78:0/958036547 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1d88160c60 0x7f1d8815cdc0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f1d8001d240 tx=0x7f1d80019740 comp rx=0 tx=0).stop 2023-12-12T10:13:06.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.501+0000 7f1d8e52a640 1 -- 172.21.15.78:0/958036547 shutdown_connections 2023-12-12T10:13:06.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.501+0000 7f1d8e52a640 1 --2- 172.21.15.78:0/958036547 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f1d74066470 0x7f1d74068930 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:06.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.501+0000 7f1d8e52a640 1 --2- 172.21.15.78:0/958036547 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1d88160c60 0x7f1d8815cdc0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:06.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.501+0000 7f1d8e52a640 1 --2- 172.21.15.78:0/958036547 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1d880b2710 0x7f1d8815c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:06.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.501+0000 7f1d8e52a640 1 --2- 172.21.15.78:0/958036547 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1d8806bc70 0x7f1d880acd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:06.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.501+0000 7f1d8e52a640 1 -- 172.21.15.78:0/958036547 >> 172.21.15.78:0/958036547 conn(0x7f1d880cf480 msgr2=0x7f1d8815f4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:06.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.501+0000 7f1d8e52a640 1 -- 172.21.15.78:0/958036547 shutdown_connections 2023-12-12T10:13:06.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.501+0000 7f1d8e52a640 1 -- 172.21.15.78:0/958036547 wait complete. 2023-12-12T10:13:06.524 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-12T10:11:57.053584+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-12T10:12:07.454450+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-12T10:12:08.182909+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-12T10:12:11.977952+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-12T10:13:06.525 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-12T10:13:06.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.661+0000 7f9611172640 1 Processor -- start 2023-12-12T10:13:06.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.661+0000 7f9611172640 1 -- start start 2023-12-12T10:13:06.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.661+0000 7f9611172640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f960c06cf60 0x7f960c15f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:06.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.665+0000 7f9611172640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f960c0cea30 con 0x7f960c15b390 2023-12-12T10:13:06.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.665+0000 7f9611172640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f960c15bfc0 con 0x7f960c0cb4b0 2023-12-12T10:13:06.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.665+0000 7f9611172640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f960c15c2a0 con 0x7f960c06cf60 2023-12-12T10:13:06.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.665+0000 7f960b59e640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f960c15b390 0x7f960c0714e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:36044/0 (socket says 172.21.15.78:36044) 2023-12-12T10:13:06.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.665+0000 7f960b59e640 1 -- 172.21.15.78:0/363067352 learned_addr learned my addr 172.21.15.78:0/363067352 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-12-12T10:13:06.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.665+0000 7f9603fff640 1 --2- 172.21.15.78:0/363067352 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f960c06cf60 0x7f960c15f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:06.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.665+0000 7f960a59c640 1 -- 172.21.15.78:0/363067352 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2316603483 0 0) 0x7f960c0cea30 con 0x7f960c15b390 2023-12-12T10:13:06.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.665+0000 7f960a59c640 1 -- 172.21.15.78:0/363067352 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f95f8003530 con 0x7f960c15b390 2023-12-12T10:13:06.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.665+0000 7f960a59c640 1 -- 172.21.15.78:0/363067352 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1449659902 0 0) 0x7f960c15bfc0 con 0x7f960c0cb4b0 2023-12-12T10:13:06.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.665+0000 7f960a59c640 1 -- 172.21.15.78:0/363067352 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f960c0cea30 con 0x7f960c0cb4b0 2023-12-12T10:13:06.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.665+0000 7f9603fff640 1 -- 172.21.15.78:0/363067352 >> v1:172.21.15.187:6789/0 conn(0x7f960c0cb4b0 legacy=0x7f960c06c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:06.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.665+0000 7f9603fff640 1 -- 172.21.15.78:0/363067352 >> v1:172.21.15.78:6789/0 conn(0x7f960c15b390 legacy=0x7f960c0714e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:06.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.665+0000 7f9603fff640 1 -- 172.21.15.78:0/363067352 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f960c15ea20 con 0x7f960c06cf60 2023-12-12T10:13:06.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.665+0000 7f9603fff640 1 --2- 172.21.15.78:0/363067352 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f960c06cf60 0x7f960c15f500 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f95f40097f0 tx=0x7f95f401c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=74d2a0cd0d2d2255 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:06.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.669+0000 7f960a59c640 1 -- 172.21.15.78:0/363067352 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f40ab600 con 0x7f960c06cf60 2023-12-12T10:13:06.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.669+0000 7f960a59c640 1 -- 172.21.15.78:0/363067352 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95f40ab760 con 0x7f960c06cf60 2023-12-12T10:13:06.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.669+0000 7f960a59c640 1 -- 172.21.15.78:0/363067352 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f40abaf0 con 0x7f960c06cf60 2023-12-12T10:13:06.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.669+0000 7f9611172640 1 -- 172.21.15.78:0/363067352 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f960c06cf60 msgr2=0x7f960c15f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:06.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.669+0000 7f9611172640 1 --2- 172.21.15.78:0/363067352 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f960c06cf60 0x7f960c15f500 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f95f40097f0 tx=0x7f95f401c400 comp rx=0 tx=0).stop 2023-12-12T10:13:06.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.669+0000 7f9611172640 1 -- 172.21.15.78:0/363067352 shutdown_connections 2023-12-12T10:13:06.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.669+0000 7f9611172640 1 --2- 172.21.15.78:0/363067352 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f960c06cf60 0x7f960c15f500 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:06.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.669+0000 7f9611172640 1 -- 172.21.15.78:0/363067352 >> 172.21.15.78:0/363067352 conn(0x7f960c06a710 msgr2=0x7f960c06ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:06.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.669+0000 7f9611172640 1 -- 172.21.15.78:0/363067352 shutdown_connections 2023-12-12T10:13:06.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.669+0000 7f9611172640 1 -- 172.21.15.78:0/363067352 wait complete. 2023-12-12T10:13:06.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.669+0000 7f9611172640 1 Processor -- start 2023-12-12T10:13:06.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.669+0000 7f9611172640 1 -- start start 2023-12-12T10:13:06.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.669+0000 7f9611172640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f960c06cf60 0x7f960c15a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:06.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.673+0000 7f9611172640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f960c0cb4b0 0x7f960c15cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:06.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.673+0000 7f9611172640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f960c15b390 0x7f960c154940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:06.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.673+0000 7f9611172640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f960c14b9a0 con 0x7f960c06cf60 2023-12-12T10:13:06.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.673+0000 7f9611172640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f960c154460 con 0x7f960c15b390 2023-12-12T10:13:06.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.673+0000 7f9611172640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f960c166840 con 0x7f960c0cb4b0 2023-12-12T10:13:06.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.673+0000 7f960ad9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f960c06cf60 0x7f960c15a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:06.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.673+0000 7f960ad9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f960c06cf60 0x7f960c15a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42026/0 (socket says 172.21.15.78:42026) 2023-12-12T10:13:06.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.673+0000 7f960ad9d640 1 -- 172.21.15.78:0/3716976839 learned_addr learned my addr 172.21.15.78:0/3716976839 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:13:06.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.673+0000 7f9603fff640 1 --2- 172.21.15.78:0/3716976839 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f960c0cb4b0 0x7f960c15cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:06.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.673+0000 7f960b59e640 1 --2- 172.21.15.78:0/3716976839 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f960c15b390 0x7f960c154940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:06.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.673+0000 7f960ad9d640 1 -- 172.21.15.78:0/3716976839 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f960c0cb4b0 msgr2=0x7f960c15cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:06.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.673+0000 7f960ad9d640 1 --2- 172.21.15.78:0/3716976839 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f960c0cb4b0 0x7f960c15cf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:06.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.673+0000 7f960ad9d640 1 -- 172.21.15.78:0/3716976839 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f960c15b390 msgr2=0x7f960c154940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:06.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.673+0000 7f960ad9d640 1 --2- 172.21.15.78:0/3716976839 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f960c15b390 0x7f960c154940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:06.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.673+0000 7f960ad9d640 1 -- 172.21.15.78:0/3716976839 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95f4009420 con 0x7f960c06cf60 2023-12-12T10:13:06.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.673+0000 7f960ad9d640 1 --2- 172.21.15.78:0/3716976839 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f960c06cf60 0x7f960c15a7a0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f95fc00c490 tx=0x7f95fc00c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:06.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.673+0000 7f96037fe640 1 -- 172.21.15.78:0/3716976839 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95fc0052d0 con 0x7f960c06cf60 2023-12-12T10:13:06.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.673+0000 7f96037fe640 1 -- 172.21.15.78:0/3716976839 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95fc005430 con 0x7f960c06cf60 2023-12-12T10:13:06.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.673+0000 7f96037fe640 1 -- 172.21.15.78:0/3716976839 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95fc012870 con 0x7f960c06cf60 2023-12-12T10:13:06.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.673+0000 7f9611172640 1 -- 172.21.15.78:0/3716976839 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f960c14b100 con 0x7f960c06cf60 2023-12-12T10:13:06.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.673+0000 7f9611172640 1 -- 172.21.15.78:0/3716976839 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f960c14b6c0 con 0x7f960c06cf60 2023-12-12T10:13:06.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.673+0000 7f9611172640 1 -- 172.21.15.78:0/3716976839 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f960c0671f0 con 0x7f960c06cf60 2023-12-12T10:13:06.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.673+0000 7f96037fe640 1 -- 172.21.15.78:0/3716976839 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f95fc0129d0 con 0x7f960c06cf60 2023-12-12T10:13:06.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.673+0000 7f96037fe640 1 --2- 172.21.15.78:0/3716976839 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f95ec066470 0x7f95ec068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:06.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.677+0000 7f96037fe640 1 -- 172.21.15.78:0/3716976839 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f95fc083ec0 con 0x7f960c06cf60 2023-12-12T10:13:06.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.677+0000 7f9603fff640 1 --2- 172.21.15.78:0/3716976839 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f95ec066470 0x7f95ec068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:06.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.677+0000 7f9603fff640 1 --2- 172.21.15.78:0/3716976839 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f95ec066470 0x7f95ec068930 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f95f40af000 tx=0x7f95f40a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:06.683 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.681+0000 7f96037fe640 1 -- 172.21.15.78:0/3716976839 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f95fc050ee0 con 0x7f960c06cf60 2023-12-12T10:13:06.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.833+0000 7f9611172640 1 -- 172.21.15.78:0/3716976839 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f960c067530 con 0x7f960c06cf60 2023-12-12T10:13:06.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.833+0000 7f96037fe640 1 -- 172.21.15.78:0/3716976839 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f95fc054500 con 0x7f960c06cf60 2023-12-12T10:13:06.836 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2023-12-12T10:13:06.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.833+0000 7f9611172640 1 -- 172.21.15.78:0/3716976839 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f95ec066470 msgr2=0x7f95ec068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:06.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.833+0000 7f9611172640 1 --2- 172.21.15.78:0/3716976839 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f95ec066470 0x7f95ec068930 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f95f40af000 tx=0x7f95f40a7000 comp rx=0 tx=0).stop 2023-12-12T10:13:06.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.833+0000 7f9611172640 1 -- 172.21.15.78:0/3716976839 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f960c06cf60 msgr2=0x7f960c15a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:06.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.833+0000 7f9611172640 1 --2- 172.21.15.78:0/3716976839 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f960c06cf60 0x7f960c15a7a0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f95fc00c490 tx=0x7f95fc00c950 comp rx=0 tx=0).stop 2023-12-12T10:13:06.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.833+0000 7f9611172640 1 -- 172.21.15.78:0/3716976839 shutdown_connections 2023-12-12T10:13:06.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.833+0000 7f9611172640 1 --2- 172.21.15.78:0/3716976839 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f95ec066470 0x7f95ec068930 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:06.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.833+0000 7f9611172640 1 --2- 172.21.15.78:0/3716976839 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f960c15b390 0x7f960c154940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:06.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.833+0000 7f9611172640 1 --2- 172.21.15.78:0/3716976839 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f960c0cb4b0 0x7f960c15cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:06.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.833+0000 7f9611172640 1 --2- 172.21.15.78:0/3716976839 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f960c06cf60 0x7f960c15a7a0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:06.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.833+0000 7f9611172640 1 -- 172.21.15.78:0/3716976839 >> 172.21.15.78:0/3716976839 conn(0x7f960c06a710 msgr2=0x7f960c14ce10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:06.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.833+0000 7f9611172640 1 -- 172.21.15.78:0/3716976839 shutdown_connections 2023-12-12T10:13:06.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.833+0000 7f9611172640 1 -- 172.21.15.78:0/3716976839 wait complete. 2023-12-12T10:13:06.857 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-12T10:13:06.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.993+0000 7fe1bc0c9640 1 Processor -- start 2023-12-12T10:13:06.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.993+0000 7fe1bc0c9640 1 -- start start 2023-12-12T10:13:06.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.993+0000 7fe1bc0c9640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe1b415d080 0x7fe1b406ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:06.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.993+0000 7fe1bc0c9640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe1b40cca80 0x7fe1b41611e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:06.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.993+0000 7fe1bc0c9640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1b406bf50 con 0x7fe1b4160da0 2023-12-12T10:13:06.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.993+0000 7fe1bc0c9640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1b406b580 con 0x7fe1b40cca80 2023-12-12T10:13:06.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.993+0000 7fe1bc0c9640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b406af50 con 0x7fe1b415d080 2023-12-12T10:13:06.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.993+0000 7fe1b9664640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fe1b4160da0 0x7fe1b40cc370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:36048/0 (socket says 172.21.15.78:36048) 2023-12-12T10:13:06.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.993+0000 7fe1b9664640 1 -- 172.21.15.78:0/3827668172 learned_addr learned my addr 172.21.15.78:0/3827668172 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-12-12T10:13:06.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.993+0000 7fe1ba666640 1 --2- 172.21.15.78:0/3827668172 >> v2:172.21.15.78:3300/0 conn(0x7fe1b40cca80 0x7fe1b41611e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:06.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.993+0000 7fe1b9e65640 1 --2- 172.21.15.78:0/3827668172 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe1b415d080 0x7fe1b406ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:06.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.993+0000 7fe1ba666640 1 -- 172.21.15.78:0/3827668172 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe1b415d080 msgr2=0x7fe1b406ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:13:06.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.993+0000 7fe1ba666640 1 --2- 172.21.15.78:0/3827668172 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe1b415d080 0x7fe1b406ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:06.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.993+0000 7fe1ba666640 1 -- 172.21.15.78:0/3827668172 >> v1:172.21.15.78:6789/0 conn(0x7fe1b4160da0 legacy=0x7fe1b40cc370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:06.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.993+0000 7fe1ba666640 1 -- 172.21.15.78:0/3827668172 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1b406a900 con 0x7fe1b40cca80 2023-12-12T10:13:06.999 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.993+0000 7fe1b9e65640 1 --2- 172.21.15.78:0/3827668172 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe1b415d080 0x7fe1b406ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T10:13:07.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.997+0000 7fe1ba666640 1 --2- 172.21.15.78:0/3827668172 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1b40cca80 0x7fe1b41611e0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fe1ac009d90 tx=0x7fe1ac01c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a63b4aa8e45a85e8 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:07.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.997+0000 7fe1b8e63640 1 -- 172.21.15.78:0/3827668172 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1ac0a5900 con 0x7fe1b40cca80 2023-12-12T10:13:07.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.997+0000 7fe1b8e63640 1 -- 172.21.15.78:0/3827668172 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1ac0a5a60 con 0x7fe1b40cca80 2023-12-12T10:13:07.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.997+0000 7fe1b8e63640 1 -- 172.21.15.78:0/3827668172 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1ac0a5df0 con 0x7fe1b40cca80 2023-12-12T10:13:07.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.997+0000 7fe1bc0c9640 1 -- 172.21.15.78:0/3827668172 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1b40cca80 msgr2=0x7fe1b41611e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:07.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.997+0000 7fe1bc0c9640 1 --2- 172.21.15.78:0/3827668172 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1b40cca80 0x7fe1b41611e0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fe1ac009d90 tx=0x7fe1ac01c950 comp rx=0 tx=0).stop 2023-12-12T10:13:07.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.997+0000 7fe1bc0c9640 1 -- 172.21.15.78:0/3827668172 shutdown_connections 2023-12-12T10:13:07.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.997+0000 7fe1bc0c9640 1 --2- 172.21.15.78:0/3827668172 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1b40cca80 0x7fe1b41611e0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:07.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.997+0000 7fe1bc0c9640 1 --2- 172.21.15.78:0/3827668172 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe1b415d080 0x7fe1b406ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:07.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.997+0000 7fe1bc0c9640 1 -- 172.21.15.78:0/3827668172 >> 172.21.15.78:0/3827668172 conn(0x7fe1b40b1650 msgr2=0x7fe1b40b1a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:07.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.997+0000 7fe1bc0c9640 1 -- 172.21.15.78:0/3827668172 shutdown_connections 2023-12-12T10:13:07.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:06.997+0000 7fe1bc0c9640 1 -- 172.21.15.78:0/3827668172 wait complete. 2023-12-12T10:13:07.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.001+0000 7fe1bc0c9640 1 Processor -- start 2023-12-12T10:13:07.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.001+0000 7fe1bc0c9640 1 -- start start 2023-12-12T10:13:07.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.001+0000 7fe1bc0c9640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe1b40cca80 0x7fe1b40ac880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:07.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.001+0000 7fe1bc0c9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1b415d080 0x7fe1b415fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:07.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.001+0000 7fe1bc0c9640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe1b4160da0 0x7fe1b415b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:07.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.001+0000 7fe1bc0c9640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b41603c0 con 0x7fe1b415d080 2023-12-12T10:13:07.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.001+0000 7fe1bc0c9640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b415e090 con 0x7fe1b40cca80 2023-12-12T10:13:07.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.001+0000 7fe1bc0c9640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b40b0850 con 0x7fe1b4160da0 2023-12-12T10:13:07.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.001+0000 7fe1b9664640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1b415d080 0x7fe1b415fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:07.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.001+0000 7fe1b9664640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1b415d080 0x7fe1b415fe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42046/0 (socket says 172.21.15.78:42046) 2023-12-12T10:13:07.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.001+0000 7fe1b9664640 1 -- 172.21.15.78:0/2202575253 learned_addr learned my addr 172.21.15.78:0/2202575253 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:13:07.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.001+0000 7fe1b9664640 1 -- 172.21.15.78:0/2202575253 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe1b4160da0 msgr2=0x7fe1b415b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:07.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.001+0000 7fe1b9664640 1 --2- 172.21.15.78:0/2202575253 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe1b4160da0 0x7fe1b415b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:07.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.001+0000 7fe1b9664640 1 -- 172.21.15.78:0/2202575253 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe1b40cca80 msgr2=0x7fe1b40ac880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:07.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.001+0000 7fe1b9664640 1 --2- 172.21.15.78:0/2202575253 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe1b40cca80 0x7fe1b40ac880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:07.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.001+0000 7fe1b9664640 1 -- 172.21.15.78:0/2202575253 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1ac009a70 con 0x7fe1b415d080 2023-12-12T10:13:07.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.001+0000 7fe1b9664640 1 --2- 172.21.15.78:0/2202575253 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1b415d080 0x7fe1b415fe80 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fe1a400c400 tx=0x7fe1a400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:07.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.001+0000 7fe1aa7fc640 1 -- 172.21.15.78:0/2202575253 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a4005cf0 con 0x7fe1b415d080 2023-12-12T10:13:07.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.001+0000 7fe1aa7fc640 1 -- 172.21.15.78:0/2202575253 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1a4005e50 con 0x7fe1b415d080 2023-12-12T10:13:07.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.001+0000 7fe1aa7fc640 1 -- 172.21.15.78:0/2202575253 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a40072d0 con 0x7fe1b415d080 2023-12-12T10:13:07.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.001+0000 7fe1bc0c9640 1 -- 172.21.15.78:0/2202575253 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1b40b0b30 con 0x7fe1b415d080 2023-12-12T10:13:07.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.001+0000 7fe1bc0c9640 1 -- 172.21.15.78:0/2202575253 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1b415e350 con 0x7fe1b415d080 2023-12-12T10:13:07.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.005+0000 7fe1bc0c9640 1 -- 172.21.15.78:0/2202575253 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1b4067530 con 0x7fe1b415d080 2023-12-12T10:13:07.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.005+0000 7fe1aa7fc640 1 -- 172.21.15.78:0/2202575253 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe1a4007430 con 0x7fe1b415d080 2023-12-12T10:13:07.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.005+0000 7fe1aa7fc640 1 --2- 172.21.15.78:0/2202575253 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fe1980664c0 0x7fe198068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:07.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.005+0000 7fe1aa7fc640 1 -- 172.21.15.78:0/2202575253 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fe1a4083430 con 0x7fe1b415d080 2023-12-12T10:13:07.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.005+0000 7fe1b9e65640 1 --2- 172.21.15.78:0/2202575253 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fe1980664c0 0x7fe198068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:07.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.005+0000 7fe1b9e65640 1 --2- 172.21.15.78:0/2202575253 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fe1980664c0 0x7fe198068980 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fe1b0006e90 tx=0x7fe1b0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:07.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.009+0000 7fe1aa7fc640 1 -- 172.21.15.78:0/2202575253 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe1a4050680 con 0x7fe1b415d080 2023-12-12T10:13:07.130 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T10:13:07.134 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T10:13:07.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.161+0000 7fe1bc0c9640 1 -- 172.21.15.78:0/2202575253 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe1b406bf50 con 0x7fe1b415d080 2023-12-12T10:13:07.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.161+0000 7fe1aa7fc640 1 -- 172.21.15.78:0/2202575253 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe1b406bf50 con 0x7fe1b415d080 2023-12-12T10:13:07.166 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2023-12-12T10:13:07.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.165+0000 7fe1bc0c9640 1 -- 172.21.15.78:0/2202575253 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fe1980664c0 msgr2=0x7fe198068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:07.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.165+0000 7fe1bc0c9640 1 --2- 172.21.15.78:0/2202575253 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fe1980664c0 0x7fe198068980 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fe1b0006e90 tx=0x7fe1b0008040 comp rx=0 tx=0).stop 2023-12-12T10:13:07.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.165+0000 7fe1bc0c9640 1 -- 172.21.15.78:0/2202575253 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1b415d080 msgr2=0x7fe1b415fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:07.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.165+0000 7fe1bc0c9640 1 --2- 172.21.15.78:0/2202575253 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1b415d080 0x7fe1b415fe80 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fe1a400c400 tx=0x7fe1a400c8c0 comp rx=0 tx=0).stop 2023-12-12T10:13:07.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.165+0000 7fe1bc0c9640 1 -- 172.21.15.78:0/2202575253 shutdown_connections 2023-12-12T10:13:07.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.165+0000 7fe1bc0c9640 1 --2- 172.21.15.78:0/2202575253 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fe1980664c0 0x7fe198068980 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:07.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.165+0000 7fe1bc0c9640 1 --2- 172.21.15.78:0/2202575253 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe1b4160da0 0x7fe1b415b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:07.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.165+0000 7fe1bc0c9640 1 --2- 172.21.15.78:0/2202575253 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe1b415d080 0x7fe1b415fe80 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:07.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.165+0000 7fe1bc0c9640 1 --2- 172.21.15.78:0/2202575253 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe1b40cca80 0x7fe1b40ac880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:07.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.165+0000 7fe1bc0c9640 1 -- 172.21.15.78:0/2202575253 >> 172.21.15.78:0/2202575253 conn(0x7fe1b40b1650 msgr2=0x7fe1b40b1a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:07.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.165+0000 7fe1bc0c9640 1 -- 172.21.15.78:0/2202575253 shutdown_connections 2023-12-12T10:13:07.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.165+0000 7fe1bc0c9640 1 -- 172.21.15.78:0/2202575253 wait complete. 2023-12-12T10:13:07.187 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-12T10:13:07.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.361+0000 7f5e6fbf8640 1 Processor -- start 2023-12-12T10:13:07.367 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.361+0000 7f5e6fbf8640 1 -- start start 2023-12-12T10:13:07.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.365+0000 7f5e6fbf8640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f5e6815baa0 0x7f5e6815f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:07.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.365+0000 7f5e6fbf8640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e680cea30 con 0x7f5e6806cf60 2023-12-12T10:13:07.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.365+0000 7f5e6fbf8640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e6815bfc0 con 0x7f5e680cb4b0 2023-12-12T10:13:07.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.365+0000 7f5e6fbf8640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e6815c2a0 con 0x7f5e6815baa0 2023-12-12T10:13:07.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.365+0000 7f5e6d193640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f5e6806cf60 0x7f5e6815b390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:36062/0 (socket says 172.21.15.78:36062) 2023-12-12T10:13:07.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.365+0000 7f5e6d193640 1 -- 172.21.15.78:0/232269387 learned_addr learned my addr 172.21.15.78:0/232269387 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-12-12T10:13:07.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.365+0000 7f5e6e195640 1 --2- 172.21.15.78:0/232269387 >> v2:172.21.15.187:3300/0 conn(0x7f5e6815baa0 0x7f5e6815f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:07.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.365+0000 7f5e6c992640 1 -- 172.21.15.78:0/232269387 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 647637910 0 0) 0x7f5e680cea30 con 0x7f5e6806cf60 2023-12-12T10:13:07.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.365+0000 7f5e6c992640 1 -- 172.21.15.78:0/232269387 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e54003530 con 0x7f5e6806cf60 2023-12-12T10:13:07.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.365+0000 7f5e6c992640 1 -- 172.21.15.78:0/232269387 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 685966192 0 0) 0x7f5e54003530 con 0x7f5e6806cf60 2023-12-12T10:13:07.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.365+0000 7f5e6c992640 1 -- 172.21.15.78:0/232269387 >> v2:172.21.15.187:3300/0 conn(0x7f5e6815baa0 msgr2=0x7f5e6815f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:13:07.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.365+0000 7f5e6c992640 1 --2- 172.21.15.78:0/232269387 >> v2:172.21.15.187:3300/0 conn(0x7f5e6815baa0 0x7f5e6815f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:07.371 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.365+0000 7f5e6c992640 1 -- 172.21.15.78:0/232269387 >> v1:172.21.15.187:6789/0 conn(0x7f5e680cb4b0 legacy=0x7f5e6806c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:07.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.365+0000 7f5e6c992640 1 -- 172.21.15.78:0/232269387 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e6815ea20 con 0x7f5e6806cf60 2023-12-12T10:13:07.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.365+0000 7f5e6c992640 1 -- 172.21.15.78:0/232269387 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 465499599 0 0) 0x7f5e58001680 con 0x7f5e6806cf60 2023-12-12T10:13:07.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.365+0000 7f5e6c992640 1 -- 172.21.15.78:0/232269387 >> v1:172.21.15.78:6789/0 conn(0x7f5e6806cf60 legacy=0x7f5e6815b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:07.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.365+0000 7f5e6c992640 1 --2- 172.21.15.78:0/232269387 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5e54003980 0x7f5e54003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:07.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.365+0000 7f5e6c992640 1 --2- 172.21.15.78:0/232269387 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5e540047d0 0x7f5e54004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:07.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.365+0000 7f5e6c992640 1 --2- 172.21.15.78:0/232269387 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5e54005190 0x7f5e5400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:07.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.365+0000 7f5e6c992640 1 -- 172.21.15.78:0/232269387 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e6815c2a0 con 0x7f5e54003980 2023-12-12T10:13:07.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.365+0000 7f5e6c992640 1 -- 172.21.15.78:0/232269387 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e5400c130 con 0x7f5e540047d0 2023-12-12T10:13:07.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.365+0000 7f5e6c992640 1 -- 172.21.15.78:0/232269387 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e5400c2f0 con 0x7f5e54005190 2023-12-12T10:13:07.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.365+0000 7f5e6d994640 1 --2- 172.21.15.78:0/232269387 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5e54003980 0x7f5e54003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:07.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.365+0000 7f5e6d193640 1 --2- 172.21.15.78:0/232269387 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5e540047d0 0x7f5e54004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:07.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.365+0000 7f5e6e195640 1 --2- 172.21.15.78:0/232269387 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5e54005190 0x7f5e5400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:07.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.365+0000 7f5e6d994640 1 -- 172.21.15.78:0/232269387 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5e54005190 msgr2=0x7f5e5400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:13:07.372 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.365+0000 7f5e6d994640 1 --2- 172.21.15.78:0/232269387 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5e54005190 0x7f5e5400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:07.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.365+0000 7f5e6d994640 1 -- 172.21.15.78:0/232269387 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5e540047d0 msgr2=0x7f5e54004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:13:07.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.365+0000 7f5e6d994640 1 --2- 172.21.15.78:0/232269387 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5e540047d0 0x7f5e54004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:07.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.365+0000 7f5e6d994640 1 -- 172.21.15.78:0/232269387 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e54003530 con 0x7f5e54003980 2023-12-12T10:13:07.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.365+0000 7f5e6e195640 1 -- 172.21.15.78:0/232269387 reap_dead start 2023-12-12T10:13:07.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.369+0000 7f5e6d994640 1 --2- 172.21.15.78:0/232269387 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5e54003980 0x7f5e54003da0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f5e64001780 tx=0x7f5e6401c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e6df915324071fe server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:07.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.369+0000 7f5e6c992640 1 -- 172.21.15.78:0/232269387 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e640052d0 con 0x7f5e54003980 2023-12-12T10:13:07.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.369+0000 7f5e6c992640 1 -- 172.21.15.78:0/232269387 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e640a7050 con 0x7f5e54003980 2023-12-12T10:13:07.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.369+0000 7f5e6c992640 1 -- 172.21.15.78:0/232269387 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e64003600 con 0x7f5e54003980 2023-12-12T10:13:07.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.369+0000 7f5e6fbf8640 1 -- 172.21.15.78:0/232269387 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5e54003980 msgr2=0x7f5e54003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:07.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.369+0000 7f5e6fbf8640 1 --2- 172.21.15.78:0/232269387 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5e54003980 0x7f5e54003da0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f5e64001780 tx=0x7f5e6401c3b0 comp rx=0 tx=0).stop 2023-12-12T10:13:07.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.369+0000 7f5e6fbf8640 1 -- 172.21.15.78:0/232269387 shutdown_connections 2023-12-12T10:13:07.374 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.369+0000 7f5e6fbf8640 1 --2- 172.21.15.78:0/232269387 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5e54003980 0x7f5e54003da0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:07.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.369+0000 7f5e6fbf8640 1 -- 172.21.15.78:0/232269387 >> 172.21.15.78:0/232269387 conn(0x7f5e6806a710 msgr2=0x7f5e6806ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:07.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.369+0000 7f5e6fbf8640 1 -- 172.21.15.78:0/232269387 shutdown_connections 2023-12-12T10:13:07.375 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.369+0000 7f5e6fbf8640 1 -- 172.21.15.78:0/232269387 wait complete. 2023-12-12T10:13:07.376 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.373+0000 7f5e6fbf8640 1 Processor -- start 2023-12-12T10:13:07.376 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.373+0000 7f5e6fbf8640 1 -- start start 2023-12-12T10:13:07.377 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.373+0000 7f5e6fbf8640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5e54003980 0x7f5e6815ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:07.377 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.373+0000 7f5e6fbf8640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5e68148100 0x7f5e681539a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:07.377 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.373+0000 7f5e6fbf8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5e68154680 0x7f5e68154b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:07.377 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.373+0000 7f5e6fbf8640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e68155040 con 0x7f5e68154680 2023-12-12T10:13:07.377 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.373+0000 7f5e6fbf8640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e68153510 con 0x7f5e68148100 2023-12-12T10:13:07.377 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.373+0000 7f5e6fbf8640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e6815e410 con 0x7f5e54003980 2023-12-12T10:13:07.377 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.373+0000 7f5e6e195640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5e68154680 0x7f5e68154b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:07.377 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.373+0000 7f5e6d994640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5e54003980 0x7f5e6815ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:07.377 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.373+0000 7f5e6e195640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5e68154680 0x7f5e68154b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42070/0 (socket says 172.21.15.78:42070) 2023-12-12T10:13:07.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.373+0000 7f5e6e195640 1 -- 172.21.15.78:0/1690001771 learned_addr learned my addr 172.21.15.78:0/1690001771 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:13:07.378 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.373+0000 7f5e6d193640 1 --2- 172.21.15.78:0/1690001771 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5e68148100 0x7f5e681539a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:07.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.373+0000 7f5e6e195640 1 -- 172.21.15.78:0/1690001771 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5e54003980 msgr2=0x7f5e6815ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:07.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.373+0000 7f5e6e195640 1 --2- 172.21.15.78:0/1690001771 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5e54003980 0x7f5e6815ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:07.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.373+0000 7f5e6e195640 1 -- 172.21.15.78:0/1690001771 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5e68148100 msgr2=0x7f5e681539a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:07.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.373+0000 7f5e6e195640 1 --2- 172.21.15.78:0/1690001771 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5e68148100 0x7f5e681539a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:07.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.373+0000 7f5e6e195640 1 -- 172.21.15.78:0/1690001771 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e68148e00 con 0x7f5e68154680 2023-12-12T10:13:07.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.373+0000 7f5e6e195640 1 --2- 172.21.15.78:0/1690001771 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5e68154680 0x7f5e68154b00 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f5e6815bef0 tx=0x7f5e6000f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:07.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.373+0000 7f5e5e7fc640 1 -- 172.21.15.78:0/1690001771 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e6000e040 con 0x7f5e68154680 2023-12-12T10:13:07.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.373+0000 7f5e5e7fc640 1 -- 172.21.15.78:0/1690001771 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e6000f040 con 0x7f5e68154680 2023-12-12T10:13:07.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.373+0000 7f5e6fbf8640 1 -- 172.21.15.78:0/1690001771 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e6814d0d0 con 0x7f5e68154680 2023-12-12T10:13:07.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.373+0000 7f5e5e7fc640 1 -- 172.21.15.78:0/1690001771 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e60003be0 con 0x7f5e68154680 2023-12-12T10:13:07.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.373+0000 7f5e6fbf8640 1 -- 172.21.15.78:0/1690001771 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e681531a0 con 0x7f5e68154680 2023-12-12T10:13:07.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.373+0000 7f5e6fbf8640 1 -- 172.21.15.78:0/1690001771 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e680671f0 con 0x7f5e68154680 2023-12-12T10:13:07.380 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.377+0000 7f5e5e7fc640 1 -- 172.21.15.78:0/1690001771 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5e60003d40 con 0x7f5e68154680 2023-12-12T10:13:07.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.377+0000 7f5e5e7fc640 1 --2- 172.21.15.78:0/1690001771 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f5e4c066490 0x7f5e4c068950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:07.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.377+0000 7f5e5e7fc640 1 -- 172.21.15.78:0/1690001771 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f5e60084a50 con 0x7f5e68154680 2023-12-12T10:13:07.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.377+0000 7f5e6d994640 1 --2- 172.21.15.78:0/1690001771 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f5e4c066490 0x7f5e4c068950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:07.381 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.377+0000 7f5e6d994640 1 --2- 172.21.15.78:0/1690001771 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f5e4c066490 0x7f5e4c068950 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f5e64001750 tx=0x7f5e640011a0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:07.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.381+0000 7f5e5e7fc640 1 -- 172.21.15.78:0/1690001771 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5e60051bb0 con 0x7f5e68154680 2023-12-12T10:13:07.534 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.529+0000 7f5e6fbf8640 1 -- 172.21.15.78:0/1690001771 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5e68067530 con 0x7f5e68154680 2023-12-12T10:13:07.534 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.529+0000 7f5e5e7fc640 1 -- 172.21.15.78:0/1690001771 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5e600551d0 con 0x7f5e68154680 2023-12-12T10:13:07.534 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2023-12-12T10:13:07.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.533+0000 7f5e6fbf8640 1 -- 172.21.15.78:0/1690001771 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f5e4c066490 msgr2=0x7f5e4c068950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:07.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.533+0000 7f5e6fbf8640 1 --2- 172.21.15.78:0/1690001771 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f5e4c066490 0x7f5e4c068950 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f5e64001750 tx=0x7f5e640011a0 comp rx=0 tx=0).stop 2023-12-12T10:13:07.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.533+0000 7f5e6fbf8640 1 -- 172.21.15.78:0/1690001771 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5e68154680 msgr2=0x7f5e68154b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:07.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.533+0000 7f5e6fbf8640 1 --2- 172.21.15.78:0/1690001771 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5e68154680 0x7f5e68154b00 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f5e6815bef0 tx=0x7f5e6000f580 comp rx=0 tx=0).stop 2023-12-12T10:13:07.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.533+0000 7f5e6fbf8640 1 -- 172.21.15.78:0/1690001771 shutdown_connections 2023-12-12T10:13:07.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.533+0000 7f5e6fbf8640 1 --2- 172.21.15.78:0/1690001771 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f5e4c066490 0x7f5e4c068950 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:07.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.533+0000 7f5e6fbf8640 1 --2- 172.21.15.78:0/1690001771 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5e68154680 0x7f5e68154b00 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:07.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.533+0000 7f5e6fbf8640 1 --2- 172.21.15.78:0/1690001771 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5e68148100 0x7f5e681539a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:07.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.533+0000 7f5e6fbf8640 1 --2- 172.21.15.78:0/1690001771 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5e54003980 0x7f5e6815ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:07.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.533+0000 7f5e6fbf8640 1 -- 172.21.15.78:0/1690001771 >> 172.21.15.78:0/1690001771 conn(0x7f5e6806a710 msgr2=0x7f5e68149820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:07.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.533+0000 7f5e6fbf8640 1 -- 172.21.15.78:0/1690001771 shutdown_connections 2023-12-12T10:13:07.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.533+0000 7f5e6fbf8640 1 -- 172.21.15.78:0/1690001771 wait complete. 2023-12-12T10:13:07.555 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-12T10:13:07.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.689+0000 7f7e42b57640 1 Processor -- start 2023-12-12T10:13:07.695 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.693+0000 7f7e42b57640 1 -- start start 2023-12-12T10:13:07.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.693+0000 7f7e42b57640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f7e3c160890 0x7f7e3c0b5e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:07.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.693+0000 7f7e42b57640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e3c0d04f0 con 0x7f7e3c0d0be0 2023-12-12T10:13:07.696 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.693+0000 7f7e42b57640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e3c0b63a0 con 0x7f7e3c0d1ce0 2023-12-12T10:13:07.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.693+0000 7f7e42b57640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e3c0cdc20 con 0x7f7e3c160890 2023-12-12T10:13:07.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.693+0000 7f7e33fff640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f7e3c0d0be0 0x7f7e3c0d15d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:36064/0 (socket says 172.21.15.78:36064) 2023-12-12T10:13:07.697 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.693+0000 7f7e33fff640 1 -- 172.21.15.78:0/756018740 learned_addr learned my addr 172.21.15.78:0/756018740 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-12-12T10:13:07.698 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.693+0000 7f7e408f3640 1 --2- 172.21.15.78:0/756018740 >> v2:172.21.15.187:3300/0 conn(0x7f7e3c160890 0x7f7e3c0b5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:07.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.693+0000 7f7e337fe640 1 -- 172.21.15.78:0/756018740 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1398801186 0 0) 0x7f7e2c001120 con 0x7f7e3c0d0be0 2023-12-12T10:13:07.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.693+0000 7f7e337fe640 1 -- 172.21.15.78:0/756018740 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e24003530 con 0x7f7e3c0d0be0 2023-12-12T10:13:07.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.693+0000 7f7e337fe640 1 -- 172.21.15.78:0/756018740 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3509738771 0 0) 0x7f7e24003530 con 0x7f7e3c0d0be0 2023-12-12T10:13:07.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.693+0000 7f7e337fe640 1 -- 172.21.15.78:0/756018740 >> v2:172.21.15.187:3300/0 conn(0x7f7e3c160890 msgr2=0x7f7e3c0b5e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:13:07.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.693+0000 7f7e337fe640 1 --2- 172.21.15.78:0/756018740 >> v2:172.21.15.187:3300/0 conn(0x7f7e3c160890 0x7f7e3c0b5e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:07.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.693+0000 7f7e337fe640 1 -- 172.21.15.78:0/756018740 >> v1:172.21.15.187:6789/0 conn(0x7f7e3c0d1ce0 legacy=0x7f7e3c0ce3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:07.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.693+0000 7f7e337fe640 1 -- 172.21.15.78:0/756018740 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e3c0cfc50 con 0x7f7e3c0d0be0 2023-12-12T10:13:07.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.693+0000 7f7e337fe640 1 -- 172.21.15.78:0/756018740 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 465499599 0 0) 0x7f7e2c001810 con 0x7f7e3c0d0be0 2023-12-12T10:13:07.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.693+0000 7f7e337fe640 1 -- 172.21.15.78:0/756018740 >> v1:172.21.15.78:6789/0 conn(0x7f7e3c0d0be0 legacy=0x7f7e3c0d15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:07.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.693+0000 7f7e337fe640 1 --2- 172.21.15.78:0/756018740 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7e24003980 0x7f7e24003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:07.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.693+0000 7f7e337fe640 1 --2- 172.21.15.78:0/756018740 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7e240047d0 0x7f7e24004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:07.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.693+0000 7f7e337fe640 1 --2- 172.21.15.78:0/756018740 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7e24005190 0x7f7e2400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:07.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.693+0000 7f7e337fe640 1 -- 172.21.15.78:0/756018740 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e3c0cdc20 con 0x7f7e24005190 2023-12-12T10:13:07.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.693+0000 7f7e337fe640 1 -- 172.21.15.78:0/756018740 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e2400c030 con 0x7f7e24003980 2023-12-12T10:13:07.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.693+0000 7f7e337fe640 1 -- 172.21.15.78:0/756018740 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e2400c1f0 con 0x7f7e240047d0 2023-12-12T10:13:07.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.693+0000 7f7e410f4640 1 --2- 172.21.15.78:0/756018740 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7e24005190 0x7f7e2400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:07.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.693+0000 7f7e33fff640 1 --2- 172.21.15.78:0/756018740 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7e240047d0 0x7f7e24004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:07.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.693+0000 7f7e408f3640 1 --2- 172.21.15.78:0/756018740 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7e24003980 0x7f7e24003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:07.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.693+0000 7f7e410f4640 1 -- 172.21.15.78:0/756018740 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7e240047d0 msgr2=0x7f7e24004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:13:07.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.693+0000 7f7e410f4640 1 --2- 172.21.15.78:0/756018740 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7e240047d0 0x7f7e24004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:07.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.693+0000 7f7e410f4640 1 -- 172.21.15.78:0/756018740 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7e24003980 msgr2=0x7f7e24003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:13:07.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.693+0000 7f7e410f4640 1 --2- 172.21.15.78:0/756018740 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7e24003980 0x7f7e24003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:07.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.693+0000 7f7e410f4640 1 -- 172.21.15.78:0/756018740 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e24003530 con 0x7f7e24005190 2023-12-12T10:13:07.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.697+0000 7f7e410f4640 1 -- 172.21.15.78:0/756018740 reap_dead start 2023-12-12T10:13:07.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.697+0000 7f7e410f4640 1 --2- 172.21.15.78:0/756018740 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7e24005190 0x7f7e2400b990 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f7e34001e40 tx=0x7f7e3401c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e7f33f6685d4eb server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:07.702 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.697+0000 7f7e337fe640 1 -- 172.21.15.78:0/756018740 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e34003b80 con 0x7f7e24005190 2023-12-12T10:13:07.702 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.697+0000 7f7e337fe640 1 -- 172.21.15.78:0/756018740 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e34003ce0 con 0x7f7e24005190 2023-12-12T10:13:07.702 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.697+0000 7f7e337fe640 1 -- 172.21.15.78:0/756018740 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e34005260 con 0x7f7e24005190 2023-12-12T10:13:07.702 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.697+0000 7f7e42b57640 1 -- 172.21.15.78:0/756018740 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7e24005190 msgr2=0x7f7e2400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:07.702 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.697+0000 7f7e42b57640 1 --2- 172.21.15.78:0/756018740 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7e24005190 0x7f7e2400b990 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f7e34001e40 tx=0x7f7e3401c740 comp rx=0 tx=0).stop 2023-12-12T10:13:07.702 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.697+0000 7f7e42b57640 1 -- 172.21.15.78:0/756018740 shutdown_connections 2023-12-12T10:13:07.702 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.697+0000 7f7e42b57640 1 --2- 172.21.15.78:0/756018740 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7e24005190 0x7f7e2400b990 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:07.702 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.697+0000 7f7e42b57640 1 -- 172.21.15.78:0/756018740 >> 172.21.15.78:0/756018740 conn(0x7f7e3c09c2f0 msgr2=0x7f7e3c0d3010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:07.702 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.697+0000 7f7e42b57640 1 -- 172.21.15.78:0/756018740 shutdown_connections 2023-12-12T10:13:07.702 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.697+0000 7f7e42b57640 1 -- 172.21.15.78:0/756018740 wait complete. 2023-12-12T10:13:07.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.701+0000 7f7e42b57640 1 Processor -- start 2023-12-12T10:13:07.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.701+0000 7f7e42b57640 1 -- start start 2023-12-12T10:13:07.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.701+0000 7f7e42b57640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7e24005190 0x7f7e3c1557e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:07.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.701+0000 7f7e42b57640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7e3c0c7d80 0x7f7e3c0cc4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:07.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.701+0000 7f7e42b57640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7e3c0c8200 0x7f7e3c0cca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:07.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.701+0000 7f7e42b57640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e3c0c6ce0 con 0x7f7e24005190 2023-12-12T10:13:07.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.701+0000 7f7e42b57640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e3c0c6fc0 con 0x7f7e3c0c7d80 2023-12-12T10:13:07.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.701+0000 7f7e42b57640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e3c0c72a0 con 0x7f7e3c0c8200 2023-12-12T10:13:07.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.701+0000 7f7e408f3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7e24005190 0x7f7e3c1557e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:07.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.701+0000 7f7e408f3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7e24005190 0x7f7e3c1557e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42084/0 (socket says 172.21.15.78:42084) 2023-12-12T10:13:07.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.701+0000 7f7e408f3640 1 -- 172.21.15.78:0/240458925 learned_addr learned my addr 172.21.15.78:0/240458925 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:13:07.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.701+0000 7f7e410f4640 1 --2- 172.21.15.78:0/240458925 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7e3c0c8200 0x7f7e3c0cca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:07.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.701+0000 7f7e33fff640 1 --2- 172.21.15.78:0/240458925 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7e3c0c7d80 0x7f7e3c0cc4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:07.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.701+0000 7f7e408f3640 1 -- 172.21.15.78:0/240458925 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7e3c0c8200 msgr2=0x7f7e3c0cca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:07.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.701+0000 7f7e408f3640 1 --2- 172.21.15.78:0/240458925 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7e3c0c8200 0x7f7e3c0cca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:07.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.701+0000 7f7e408f3640 1 -- 172.21.15.78:0/240458925 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7e3c0c7d80 msgr2=0x7f7e3c0cc4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:07.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.701+0000 7f7e408f3640 1 --2- 172.21.15.78:0/240458925 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7e3c0c7d80 0x7f7e3c0cc4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:07.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.701+0000 7f7e408f3640 1 -- 172.21.15.78:0/240458925 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e3c0c7580 con 0x7f7e24005190 2023-12-12T10:13:07.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.701+0000 7f7e408f3640 1 --2- 172.21.15.78:0/240458925 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7e24005190 0x7f7e3c1557e0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f7e38011960 tx=0x7f7e38011d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:07.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.701+0000 7f7e317fa640 1 -- 172.21.15.78:0/240458925 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e3800fa30 con 0x7f7e24005190 2023-12-12T10:13:07.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.701+0000 7f7e317fa640 1 -- 172.21.15.78:0/240458925 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e3800fb90 con 0x7f7e24005190 2023-12-12T10:13:07.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.701+0000 7f7e317fa640 1 -- 172.21.15.78:0/240458925 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e38014440 con 0x7f7e24005190 2023-12-12T10:13:07.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.701+0000 7f7e42b57640 1 -- 172.21.15.78:0/240458925 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e3c0c7860 con 0x7f7e24005190 2023-12-12T10:13:07.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.701+0000 7f7e42b57640 1 -- 172.21.15.78:0/240458925 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e3c157d30 con 0x7f7e24005190 2023-12-12T10:13:07.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.705+0000 7f7e42b57640 1 -- 172.21.15.78:0/240458925 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e3c067530 con 0x7f7e24005190 2023-12-12T10:13:07.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.705+0000 7f7e317fa640 1 -- 172.21.15.78:0/240458925 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7e380145a0 con 0x7f7e24005190 2023-12-12T10:13:07.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.705+0000 7f7e317fa640 1 --2- 172.21.15.78:0/240458925 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f7e28066470 0x7f7e28068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:07.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.705+0000 7f7e317fa640 1 -- 172.21.15.78:0/240458925 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f7e380848c0 con 0x7f7e24005190 2023-12-12T10:13:07.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.705+0000 7f7e33fff640 1 --2- 172.21.15.78:0/240458925 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f7e28066470 0x7f7e28068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:07.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.705+0000 7f7e33fff640 1 --2- 172.21.15.78:0/240458925 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f7e28066470 0x7f7e28068930 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f7e2c001060 tx=0x7f7e2c001220 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:07.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.709+0000 7f7e317fa640 1 -- 172.21.15.78:0/240458925 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7e38051a10 con 0x7f7e24005190 2023-12-12T10:13:07.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.857+0000 7f7e42b57640 1 -- 172.21.15.78:0/240458925 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f7e3c0d0690 con 0x7f7e24005190 2023-12-12T10:13:07.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.857+0000 7f7e317fa640 1 -- 172.21.15.78:0/240458925 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f7e380220a0 con 0x7f7e24005190 2023-12-12T10:13:07.863 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2023-12-12T10:13:07.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.861+0000 7f7e42b57640 1 -- 172.21.15.78:0/240458925 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f7e28066470 msgr2=0x7f7e28068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:07.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.861+0000 7f7e42b57640 1 --2- 172.21.15.78:0/240458925 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f7e28066470 0x7f7e28068930 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f7e2c001060 tx=0x7f7e2c001220 comp rx=0 tx=0).stop 2023-12-12T10:13:07.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.861+0000 7f7e42b57640 1 -- 172.21.15.78:0/240458925 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7e24005190 msgr2=0x7f7e3c1557e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:07.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.861+0000 7f7e42b57640 1 --2- 172.21.15.78:0/240458925 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7e24005190 0x7f7e3c1557e0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f7e38011960 tx=0x7f7e38011d60 comp rx=0 tx=0).stop 2023-12-12T10:13:07.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.861+0000 7f7e42b57640 1 -- 172.21.15.78:0/240458925 shutdown_connections 2023-12-12T10:13:07.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.861+0000 7f7e42b57640 1 --2- 172.21.15.78:0/240458925 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f7e28066470 0x7f7e28068930 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:07.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.861+0000 7f7e42b57640 1 --2- 172.21.15.78:0/240458925 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7e3c0c8200 0x7f7e3c0cca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:07.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.861+0000 7f7e42b57640 1 --2- 172.21.15.78:0/240458925 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7e3c0c7d80 0x7f7e3c0cc4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:07.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.861+0000 7f7e42b57640 1 --2- 172.21.15.78:0/240458925 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7e24005190 0x7f7e3c1557e0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:07.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.861+0000 7f7e42b57640 1 -- 172.21.15.78:0/240458925 >> 172.21.15.78:0/240458925 conn(0x7f7e3c09c2f0 msgr2=0x7f7e3c06ba10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:07.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.861+0000 7f7e42b57640 1 -- 172.21.15.78:0/240458925 shutdown_connections 2023-12-12T10:13:07.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:07.861+0000 7f7e42b57640 1 -- 172.21.15.78:0/240458925 wait complete. 2023-12-12T10:13:07.884 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-12T10:13:08.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.017+0000 7f263c1f8640 1 Processor -- start 2023-12-12T10:13:08.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.017+0000 7f263c1f8640 1 -- start start 2023-12-12T10:13:08.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.021+0000 7f263c1f8640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f263406cf60 0x7f263415f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:08.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.021+0000 7f263c1f8640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26340cea30 con 0x7f26340cb4b0 2023-12-12T10:13:08.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.021+0000 7f263c1f8640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f263415bfc0 con 0x7f263415b390 2023-12-12T10:13:08.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.021+0000 7f263c1f8640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f263415c2a0 con 0x7f263406cf60 2023-12-12T10:13:08.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.021+0000 7f2639f94640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f26340cb4b0 0x7f263406c850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:36074/0 (socket says 172.21.15.78:36074) 2023-12-12T10:13:08.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.021+0000 7f2639f94640 1 -- 172.21.15.78:0/1113104333 learned_addr learned my addr 172.21.15.78:0/1113104333 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-12-12T10:13:08.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.021+0000 7f2639793640 1 --2- 172.21.15.78:0/1113104333 >> v2:172.21.15.187:3300/0 conn(0x7f263406cf60 0x7f263415f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:08.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.021+0000 7f2638f92640 1 -- 172.21.15.78:0/1113104333 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 842963430 0 0) 0x7f26340cea30 con 0x7f26340cb4b0 2023-12-12T10:13:08.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.021+0000 7f2638f92640 1 -- 172.21.15.78:0/1113104333 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2620003530 con 0x7f26340cb4b0 2023-12-12T10:13:08.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.021+0000 7f2638f92640 1 -- 172.21.15.78:0/1113104333 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1339916535 0 0) 0x7f2620003530 con 0x7f26340cb4b0 2023-12-12T10:13:08.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.021+0000 7f2638f92640 1 -- 172.21.15.78:0/1113104333 >> v2:172.21.15.187:3300/0 conn(0x7f263406cf60 msgr2=0x7f263415f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:13:08.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.021+0000 7f2638f92640 1 --2- 172.21.15.78:0/1113104333 >> v2:172.21.15.187:3300/0 conn(0x7f263406cf60 0x7f263415f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:08.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.021+0000 7f2638f92640 1 -- 172.21.15.78:0/1113104333 >> v1:172.21.15.187:6789/0 conn(0x7f263415b390 legacy=0x7f26340714e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:08.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.021+0000 7f2638f92640 1 -- 172.21.15.78:0/1113104333 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f263415ea20 con 0x7f26340cb4b0 2023-12-12T10:13:08.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.021+0000 7f2638f92640 1 -- 172.21.15.78:0/1113104333 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 465499599 0 0) 0x7f2630001680 con 0x7f26340cb4b0 2023-12-12T10:13:08.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.021+0000 7f2638f92640 1 -- 172.21.15.78:0/1113104333 >> v1:172.21.15.78:6789/0 conn(0x7f26340cb4b0 legacy=0x7f263406c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:08.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.021+0000 7f2638f92640 1 --2- 172.21.15.78:0/1113104333 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2620003980 0x7f2620003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:08.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.021+0000 7f2638f92640 1 --2- 172.21.15.78:0/1113104333 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f26200047d0 0x7f2620004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:08.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.021+0000 7f2638f92640 1 --2- 172.21.15.78:0/1113104333 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2620005190 0x7f262000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:08.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.021+0000 7f2638f92640 1 -- 172.21.15.78:0/1113104333 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f263415c2a0 con 0x7f26200047d0 2023-12-12T10:13:08.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.021+0000 7f2638f92640 1 -- 172.21.15.78:0/1113104333 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f262000c130 con 0x7f2620005190 2023-12-12T10:13:08.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.021+0000 7f2638f92640 1 -- 172.21.15.78:0/1113104333 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f262000c2f0 con 0x7f2620003980 2023-12-12T10:13:08.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.021+0000 7f2639793640 1 --2- 172.21.15.78:0/1113104333 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f26200047d0 0x7f2620004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:08.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.021+0000 7f2639f94640 1 --2- 172.21.15.78:0/1113104333 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2620003980 0x7f2620003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:08.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.021+0000 7f263a795640 1 --2- 172.21.15.78:0/1113104333 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2620005190 0x7f262000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:08.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.021+0000 7f2639793640 1 -- 172.21.15.78:0/1113104333 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2620003980 msgr2=0x7f2620003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:13:08.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.021+0000 7f2639793640 1 --2- 172.21.15.78:0/1113104333 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2620003980 0x7f2620003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:08.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.021+0000 7f2639793640 1 -- 172.21.15.78:0/1113104333 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2620005190 msgr2=0x7f262000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:13:08.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.021+0000 7f2639793640 1 --2- 172.21.15.78:0/1113104333 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2620005190 0x7f262000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:08.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.021+0000 7f2639793640 1 -- 172.21.15.78:0/1113104333 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2620003530 con 0x7f26200047d0 2023-12-12T10:13:08.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.021+0000 7f263a795640 1 --2- 172.21.15.78:0/1113104333 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2620005190 0x7f262000b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T10:13:08.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.021+0000 7f263a795640 1 -- 172.21.15.78:0/1113104333 reap_dead start 2023-12-12T10:13:08.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.025+0000 7f2639793640 1 --2- 172.21.15.78:0/1113104333 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f26200047d0 0x7f2620004c50 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f2624009ae0 tx=0x7f262401ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=661722815959ad40 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:08.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.025+0000 7f2638f92640 1 -- 172.21.15.78:0/1113104333 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26240a6510 con 0x7f26200047d0 2023-12-12T10:13:08.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.025+0000 7f2638f92640 1 -- 172.21.15.78:0/1113104333 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26240a6670 con 0x7f26200047d0 2023-12-12T10:13:08.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.025+0000 7f2638f92640 1 -- 172.21.15.78:0/1113104333 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26240a6a20 con 0x7f26200047d0 2023-12-12T10:13:08.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.025+0000 7f263c1f8640 1 -- 172.21.15.78:0/1113104333 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f26200047d0 msgr2=0x7f2620004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:08.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.025+0000 7f263c1f8640 1 --2- 172.21.15.78:0/1113104333 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f26200047d0 0x7f2620004c50 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f2624009ae0 tx=0x7f262401ca20 comp rx=0 tx=0).stop 2023-12-12T10:13:08.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.025+0000 7f263c1f8640 1 -- 172.21.15.78:0/1113104333 shutdown_connections 2023-12-12T10:13:08.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.025+0000 7f263c1f8640 1 --2- 172.21.15.78:0/1113104333 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f26200047d0 0x7f2620004c50 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:08.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.025+0000 7f263c1f8640 1 -- 172.21.15.78:0/1113104333 >> 172.21.15.78:0/1113104333 conn(0x7f263406a710 msgr2=0x7f263406ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:08.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.025+0000 7f263c1f8640 1 -- 172.21.15.78:0/1113104333 shutdown_connections 2023-12-12T10:13:08.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.025+0000 7f263c1f8640 1 -- 172.21.15.78:0/1113104333 wait complete. 2023-12-12T10:13:08.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.029+0000 7f263c1f8640 1 Processor -- start 2023-12-12T10:13:08.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.029+0000 7f263c1f8640 1 -- start start 2023-12-12T10:13:08.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.029+0000 7f263c1f8640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f26200047d0 0x7f26340c9450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:08.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.029+0000 7f263c1f8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f26340b29c0 0x7f263414b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:08.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.029+0000 7f263c1f8640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f263414e390 0x7f263414e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:08.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.029+0000 7f263c1f8640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f263414ed50 con 0x7f26340b29c0 2023-12-12T10:13:08.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.029+0000 7f263c1f8640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f263414bcc0 con 0x7f26200047d0 2023-12-12T10:13:08.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.029+0000 7f263c1f8640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26340c9ae0 con 0x7f263414e390 2023-12-12T10:13:08.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.029+0000 7f2639793640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f26340b29c0 0x7f263414b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:08.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.029+0000 7f2639793640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f26340b29c0 0x7f263414b780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42106/0 (socket says 172.21.15.78:42106) 2023-12-12T10:13:08.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.029+0000 7f2639f94640 1 --2- 172.21.15.78:0/3568993082 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f26200047d0 0x7f26340c9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:08.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.029+0000 7f2639793640 1 -- 172.21.15.78:0/3568993082 learned_addr learned my addr 172.21.15.78:0/3568993082 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:13:08.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.029+0000 7f263a795640 1 --2- 172.21.15.78:0/3568993082 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f263414e390 0x7f263414e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:08.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.029+0000 7f2639793640 1 -- 172.21.15.78:0/3568993082 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f263414e390 msgr2=0x7f263414e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:08.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.029+0000 7f2639793640 1 --2- 172.21.15.78:0/3568993082 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f263414e390 0x7f263414e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:08.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.029+0000 7f2639793640 1 -- 172.21.15.78:0/3568993082 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f26200047d0 msgr2=0x7f26340c9450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:08.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.029+0000 7f2639793640 1 --2- 172.21.15.78:0/3568993082 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f26200047d0 0x7f26340c9450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:08.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.029+0000 7f2639793640 1 -- 172.21.15.78:0/3568993082 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26340c9dc0 con 0x7f26340b29c0 2023-12-12T10:13:08.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.029+0000 7f2639f94640 1 --2- 172.21.15.78:0/3568993082 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f26200047d0 0x7f26340c9450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-12T10:13:08.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.029+0000 7f2639793640 1 --2- 172.21.15.78:0/3568993082 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f26340b29c0 0x7f263414b780 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f262401c850 tx=0x7f2620005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:08.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.029+0000 7f262a7fc640 1 -- 172.21.15.78:0/3568993082 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f262400f000 con 0x7f26340b29c0 2023-12-12T10:13:08.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.029+0000 7f262a7fc640 1 -- 172.21.15.78:0/3568993082 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26240a67e0 con 0x7f26340b29c0 2023-12-12T10:13:08.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.029+0000 7f263c1f8640 1 -- 172.21.15.78:0/3568993082 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26340ca0a0 con 0x7f26340b29c0 2023-12-12T10:13:08.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.029+0000 7f262a7fc640 1 -- 172.21.15.78:0/3568993082 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26240a6b90 con 0x7f26340b29c0 2023-12-12T10:13:08.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.029+0000 7f263c1f8640 1 -- 172.21.15.78:0/3568993082 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26340ca660 con 0x7f26340b29c0 2023-12-12T10:13:08.036 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.029+0000 7f263c1f8640 1 -- 172.21.15.78:0/3568993082 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26340671f0 con 0x7f26340b29c0 2023-12-12T10:13:08.036 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.033+0000 7f262a7fc640 1 -- 172.21.15.78:0/3568993082 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f26240a6cf0 con 0x7f26340b29c0 2023-12-12T10:13:08.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.033+0000 7f262a7fc640 1 --2- 172.21.15.78:0/3568993082 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f2618066470 0x7f2618068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:08.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.033+0000 7f262a7fc640 1 -- 172.21.15.78:0/3568993082 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f26240aa070 con 0x7f26340b29c0 2023-12-12T10:13:08.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.033+0000 7f2639f94640 1 --2- 172.21.15.78:0/3568993082 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f2618066470 0x7f2618068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:08.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.033+0000 7f2639f94640 1 --2- 172.21.15.78:0/3568993082 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f2618066470 0x7f2618068930 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2630000fc0 tx=0x7f2630007900 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:08.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.037+0000 7f262a7fc640 1 -- 172.21.15.78:0/3568993082 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f26240ebf40 con 0x7f26340b29c0 2023-12-12T10:13:08.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.201+0000 7f263c1f8640 1 -- 172.21.15.78:0/3568993082 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f2634067530 con 0x7f26340b29c0 2023-12-12T10:13:08.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.201+0000 7f262a7fc640 1 -- 172.21.15.78:0/3568993082 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f26240ef560 con 0x7f26340b29c0 2023-12-12T10:13:08.205 INFO:teuthology.orchestra.run.smithi078.stderr:listed 0 entries 2023-12-12T10:13:08.207 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.201+0000 7f263c1f8640 1 -- 172.21.15.78:0/3568993082 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f2618066470 msgr2=0x7f2618068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:08.207 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.201+0000 7f263c1f8640 1 --2- 172.21.15.78:0/3568993082 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f2618066470 0x7f2618068930 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2630000fc0 tx=0x7f2630007900 comp rx=0 tx=0).stop 2023-12-12T10:13:08.207 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.201+0000 7f263c1f8640 1 -- 172.21.15.78:0/3568993082 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f26340b29c0 msgr2=0x7f263414b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:08.207 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.201+0000 7f263c1f8640 1 --2- 172.21.15.78:0/3568993082 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f26340b29c0 0x7f263414b780 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f262401c850 tx=0x7f2620005800 comp rx=0 tx=0).stop 2023-12-12T10:13:08.207 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.201+0000 7f263c1f8640 1 -- 172.21.15.78:0/3568993082 shutdown_connections 2023-12-12T10:13:08.207 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.201+0000 7f263c1f8640 1 --2- 172.21.15.78:0/3568993082 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f2618066470 0x7f2618068930 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:08.207 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.201+0000 7f263c1f8640 1 --2- 172.21.15.78:0/3568993082 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f263414e390 0x7f263414e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:08.208 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.201+0000 7f263c1f8640 1 --2- 172.21.15.78:0/3568993082 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f26340b29c0 0x7f263414b780 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:08.208 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.201+0000 7f263c1f8640 1 --2- 172.21.15.78:0/3568993082 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f26200047d0 0x7f26340c9450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:08.208 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.201+0000 7f263c1f8640 1 -- 172.21.15.78:0/3568993082 >> 172.21.15.78:0/3568993082 conn(0x7f263406a710 msgr2=0x7f26340b1390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:08.208 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.201+0000 7f263c1f8640 1 -- 172.21.15.78:0/3568993082 shutdown_connections 2023-12-12T10:13:08.208 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.201+0000 7f263c1f8640 1 -- 172.21.15.78:0/3568993082 wait complete. 2023-12-12T10:13:08.227 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-12-12T10:13:08.227 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-12T10:13:08.236 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T10:13:08.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.413+0000 7f730d780640 1 Processor -- start 2023-12-12T10:13:08.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.413+0000 7f730d780640 1 -- start start 2023-12-12T10:13:08.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.417+0000 7f730d780640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f73080b2bc0 0x7f730806a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:08.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.417+0000 7f730d780640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f730806bbc0 0x7f730815d720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:08.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.417+0000 7f730d780640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f730806ab20 con 0x7f730815e360 2023-12-12T10:13:08.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.417+0000 7f730d780640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f730815e740 con 0x7f730806bbc0 2023-12-12T10:13:08.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.417+0000 7f730d780640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f730806ae00 con 0x7f73080b2bc0 2023-12-12T10:13:08.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.417+0000 7f73077fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f730806bbc0 0x7f730815d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:08.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.417+0000 7f73077fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f730806bbc0 0x7f730815d720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42112/0 (socket says 172.21.15.78:42112) 2023-12-12T10:13:08.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.417+0000 7f73077fe640 1 -- 172.21.15.78:0/267282800 learned_addr learned my addr 172.21.15.78:0/267282800 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:13:08.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.417+0000 7f72fe7fc640 1 --2- 172.21.15.78:0/267282800 >> v2:172.21.15.187:3300/0 conn(0x7f73080b2bc0 0x7f730806a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:08.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.417+0000 7f73077fe640 1 -- 172.21.15.78:0/267282800 >> v2:172.21.15.187:3300/0 conn(0x7f73080b2bc0 msgr2=0x7f730806a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:13:08.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.417+0000 7f73077fe640 1 --2- 172.21.15.78:0/267282800 >> v2:172.21.15.187:3300/0 conn(0x7f73080b2bc0 0x7f730806a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:08.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.417+0000 7f73077fe640 1 -- 172.21.15.78:0/267282800 >> v1:172.21.15.187:6789/0 conn(0x7f730815e360 legacy=0x7f73080b24b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:13:08.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.417+0000 7f73077fe640 1 -- 172.21.15.78:0/267282800 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f730806b0e0 con 0x7f730806bbc0 2023-12-12T10:13:08.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.417+0000 7f72fe7fc640 1 --2- 172.21.15.78:0/267282800 >> v2:172.21.15.187:3300/0 conn(0x7f73080b2bc0 0x7f730806a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T10:13:08.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.421+0000 7f73077fe640 1 --2- 172.21.15.78:0/267282800 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f730806bbc0 0x7f730815d720 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f730806dad0 tx=0x7f730001c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bec6c48ddc0c4bed server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:08.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.421+0000 7f73067fc640 1 -- 172.21.15.78:0/267282800 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73000a5820 con 0x7f730806bbc0 2023-12-12T10:13:08.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.421+0000 7f73067fc640 1 -- 172.21.15.78:0/267282800 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73000a5980 con 0x7f730806bbc0 2023-12-12T10:13:08.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.421+0000 7f73067fc640 1 -- 172.21.15.78:0/267282800 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73000a5d10 con 0x7f730806bbc0 2023-12-12T10:13:08.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.421+0000 7f730d780640 1 -- 172.21.15.78:0/267282800 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f730806bbc0 msgr2=0x7f730815d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:08.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.421+0000 7f730d780640 1 --2- 172.21.15.78:0/267282800 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f730806bbc0 0x7f730815d720 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f730806dad0 tx=0x7f730001c960 comp rx=0 tx=0).stop 2023-12-12T10:13:08.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.421+0000 7f730d780640 1 -- 172.21.15.78:0/267282800 shutdown_connections 2023-12-12T10:13:08.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.421+0000 7f730d780640 1 --2- 172.21.15.78:0/267282800 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f730806bbc0 0x7f730815d720 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:08.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.421+0000 7f730d780640 1 --2- 172.21.15.78:0/267282800 >> v2:172.21.15.187:3300/0 conn(0x7f73080b2bc0 0x7f730806a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:08.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.421+0000 7f730d780640 1 -- 172.21.15.78:0/267282800 >> 172.21.15.78:0/267282800 conn(0x7f73080cf480 msgr2=0x7f73080cf890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:08.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.421+0000 7f730d780640 1 -- 172.21.15.78:0/267282800 shutdown_connections 2023-12-12T10:13:08.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.421+0000 7f730d780640 1 -- 172.21.15.78:0/267282800 wait complete. 2023-12-12T10:13:08.427 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.421+0000 7f730d780640 1 Processor -- start 2023-12-12T10:13:08.427 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.421+0000 7f730d780640 1 -- start start 2023-12-12T10:13:08.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.425+0000 7f730d780640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f730806bbc0 0x7f730813c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:08.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.425+0000 7f730d780640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73080b2bc0 0x7f7308154510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:08.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.425+0000 7f730d780640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f730815e360 0x7f7308155ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:08.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.425+0000 7f730d780640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7308154a50 con 0x7f73080b2bc0 2023-12-12T10:13:08.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.425+0000 7f730d780640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f730813c860 con 0x7f730806bbc0 2023-12-12T10:13:08.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.425+0000 7f730d780640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f730813cb40 con 0x7f730815e360 2023-12-12T10:13:08.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.425+0000 7f72fe7fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73080b2bc0 0x7f7308154510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:08.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.425+0000 7f72fe7fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73080b2bc0 0x7f7308154510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42114/0 (socket says 172.21.15.78:42114) 2023-12-12T10:13:08.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.425+0000 7f72fe7fc640 1 -- 172.21.15.78:0/833913942 learned_addr learned my addr 172.21.15.78:0/833913942 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:13:08.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.425+0000 7f7306ffd640 1 --2- 172.21.15.78:0/833913942 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f730806bbc0 0x7f730813c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:08.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.425+0000 7f73077fe640 1 --2- 172.21.15.78:0/833913942 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f730815e360 0x7f7308155ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:08.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.425+0000 7f72fe7fc640 1 -- 172.21.15.78:0/833913942 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f730815e360 msgr2=0x7f7308155ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:08.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.425+0000 7f72fe7fc640 1 --2- 172.21.15.78:0/833913942 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f730815e360 0x7f7308155ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:08.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.425+0000 7f72fe7fc640 1 -- 172.21.15.78:0/833913942 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f730806bbc0 msgr2=0x7f730813c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:08.432 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.425+0000 7f72fe7fc640 1 --2- 172.21.15.78:0/833913942 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f730806bbc0 0x7f730813c1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:08.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.425+0000 7f72fe7fc640 1 -- 172.21.15.78:0/833913942 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7300009b30 con 0x7f73080b2bc0 2023-12-12T10:13:08.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.425+0000 7f72fe7fc640 1 --2- 172.21.15.78:0/833913942 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73080b2bc0 0x7f7308154510 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f72f000c7c0 tx=0x7f72f000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:08.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.425+0000 7f72fffff640 1 -- 172.21.15.78:0/833913942 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f0007a30 con 0x7f73080b2bc0 2023-12-12T10:13:08.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.425+0000 7f72fffff640 1 -- 172.21.15.78:0/833913942 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72f0007b90 con 0x7f73080b2bc0 2023-12-12T10:13:08.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.425+0000 7f730d780640 1 -- 172.21.15.78:0/833913942 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f730813ce20 con 0x7f73080b2bc0 2023-12-12T10:13:08.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.425+0000 7f72fffff640 1 -- 172.21.15.78:0/833913942 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f000ce70 con 0x7f73080b2bc0 2023-12-12T10:13:08.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.425+0000 7f730d780640 1 -- 172.21.15.78:0/833913942 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f730813d3e0 con 0x7f73080b2bc0 2023-12-12T10:13:08.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.425+0000 7f730d780640 1 -- 172.21.15.78:0/833913942 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7308067530 con 0x7f73080b2bc0 2023-12-12T10:13:08.433 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.425+0000 7f72fffff640 1 -- 172.21.15.78:0/833913942 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f72f00113f0 con 0x7f73080b2bc0 2023-12-12T10:13:08.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.429+0000 7f72fffff640 1 --2- 172.21.15.78:0/833913942 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f72e8066470 0x7f72e8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:08.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.429+0000 7f72fffff640 1 -- 172.21.15.78:0/833913942 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f72f0084730 con 0x7f73080b2bc0 2023-12-12T10:13:08.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.429+0000 7f7306ffd640 1 --2- 172.21.15.78:0/833913942 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f72e8066470 0x7f72e8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:08.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.429+0000 7f7306ffd640 1 --2- 172.21.15.78:0/833913942 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f72e8066470 0x7f72e8068930 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f730806e5d0 tx=0x7f72f8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:08.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.433+0000 7f72fffff640 1 -- 172.21.15.78:0/833913942 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f72f0051750 con 0x7f73080b2bc0 2023-12-12T10:13:08.589 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.585+0000 7f730d780640 1 -- 172.21.15.78:0/833913942 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f73080cf260 con 0x7f73080b2bc0 2023-12-12T10:13:08.590 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.585+0000 7f72fffff640 1 -- 172.21.15.78:0/833913942 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18701 (secure 0 0 0) 0x7f72f0054d70 con 0x7f73080b2bc0 2023-12-12T10:13:08.590 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:13:08.590 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":26,"fsid":"fc81937c-bd26-483c-952b-d1324fcb0c9e","created":"2023-12-12T10:11:44.020214+0000","modified":"2023-12-12T10:12:50.919344+0000","last_up_change":"2023-12-12T10:11:56.278318+0000","last_in_change":"2023-12-12T10:11:46.553610+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T10:11:57.053584+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-12T10:12:07.454450+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-12T10:12:08.182909+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-12T10:12:11.977952+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"22dfdedf-5f6c-4b20-9f6c-30517a1db70a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6809","nonce":3345683600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6811","nonce":3345683600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6815","nonce":3345683600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6813","nonce":3345683600}]},"public_addr":"172.21.15.78:6809/3345683600","cluster_addr":"172.21.15.78:6811/3345683600","heartbeat_back_addr":"172.21.15.78:6815/3345683600","heartbeat_front_addr":"172.21.15.78:6813/3345683600","state":["exists","up"]},{"osd":1,"uuid":"be34a7f3-a69a-462e-9ddf-5e537448dba2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6801","nonce":962652768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6803","nonce":962652768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6807","nonce":962652768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6805","nonce":962652768}]},"public_addr":"172.21.15.78:6801/962652768","cluster_addr":"172.21.15.78:6803/962652768","heartbeat_back_addr":"172.21.15.78:6807/962652768","heartbeat_front_addr":"172.21.15.78:6805/962652768","state":["exists","up"]},{"osd":2,"uuid":"55b381de-5f56-4b14-80f7-e6e41e084a13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6818","nonce":2910206054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6822","nonce":2910206054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6829","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6831","nonce":2910206054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6826","nonce":2910206054}]},"public_addr":"172.21.15.78:6818/2910206054","cluster_addr":"172.21.15.78:6822/2910206054","heartbeat_back_addr":"172.21.15.78:6831/2910206054","heartbeat_front_addr":"172.21.15.78:6826/2910206054","state":["exists","up"]},{"osd":3,"uuid":"d7682de1-25cb-4cec-869f-8851c28b0e6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6819","nonce":3750796703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6821","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6823","nonce":3750796703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6830","nonce":3750796703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6825","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6827","nonce":3750796703}]},"public_addr":"172.21.15.78:6819/3750796703","cluster_addr":"172.21.15.78:6823/3750796703","heartbeat_back_addr":"172.21.15.78:6830/3750796703","heartbeat_front_addr":"172.21.15.78:6827/3750796703","state":["exists","up"]},{"osd":4,"uuid":"8279815a-d6c7-4199-871e-d28971b9dc07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6809","nonce":2944277204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6811","nonce":2944277204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6815","nonce":2944277204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6813","nonce":2944277204}]},"public_addr":"172.21.15.187:6809/2944277204","cluster_addr":"172.21.15.187:6811/2944277204","heartbeat_back_addr":"172.21.15.187:6815/2944277204","heartbeat_front_addr":"172.21.15.187:6813/2944277204","state":["exists","up"]},{"osd":5,"uuid":"0a714c65-f8ce-4340-968f-11a799677ef3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6801","nonce":185858620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6803","nonce":185858620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6807","nonce":185858620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6805","nonce":185858620}]},"public_addr":"172.21.15.187:6801/185858620","cluster_addr":"172.21.15.187:6803/185858620","heartbeat_back_addr":"172.21.15.187:6807/185858620","heartbeat_front_addr":"172.21.15.187:6805/185858620","state":["exists","up"]},{"osd":6,"uuid":"d0bba9ab-f7ee-449e-8999-1c0cf7e6d53c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6817","nonce":4213392126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6819","nonce":4213392126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6824","nonce":4213392126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6821","nonce":4213392126}]},"public_addr":"172.21.15.187:6817/4213392126","cluster_addr":"172.21.15.187:6819/4213392126","heartbeat_back_addr":"172.21.15.187:6824/4213392126","heartbeat_front_addr":"172.21.15.187:6821/4213392126","state":["exists","up"]},{"osd":7,"uuid":"efe5e0d9-2f87-4889-a27a-e2a95a632302","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6823","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6825","nonce":85774004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6827","nonce":85774004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6831","nonce":85774004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6829","nonce":85774004}]},"public_addr":"172.21.15.187:6825/85774004","cluster_addr":"172.21.15.187:6827/85774004","heartbeat_back_addr":"172.21.15.187:6831/85774004","heartbeat_front_addr":"172.21.15.187:6829/85774004","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.214447+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.448899+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.293107+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.564184+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.175026+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.097717+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.261141+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.287681+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.18","mappings":[{"from":3,"to":2}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.13","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T10:13:08.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.589+0000 7f730d780640 1 -- 172.21.15.78:0/833913942 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f72e8066470 msgr2=0x7f72e8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:08.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.589+0000 7f730d780640 1 --2- 172.21.15.78:0/833913942 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f72e8066470 0x7f72e8068930 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f730806e5d0 tx=0x7f72f8008040 comp rx=0 tx=0).stop 2023-12-12T10:13:08.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.589+0000 7f730d780640 1 -- 172.21.15.78:0/833913942 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73080b2bc0 msgr2=0x7f7308154510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:08.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.589+0000 7f730d780640 1 --2- 172.21.15.78:0/833913942 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73080b2bc0 0x7f7308154510 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f72f000c7c0 tx=0x7f72f000cc80 comp rx=0 tx=0).stop 2023-12-12T10:13:08.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.589+0000 7f730d780640 1 -- 172.21.15.78:0/833913942 shutdown_connections 2023-12-12T10:13:08.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.589+0000 7f730d780640 1 --2- 172.21.15.78:0/833913942 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f72e8066470 0x7f72e8068930 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:08.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.589+0000 7f730d780640 1 --2- 172.21.15.78:0/833913942 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f730815e360 0x7f7308155ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:08.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.589+0000 7f730d780640 1 --2- 172.21.15.78:0/833913942 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f73080b2bc0 0x7f7308154510 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:08.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.589+0000 7f730d780640 1 --2- 172.21.15.78:0/833913942 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f730806bbc0 0x7f730813c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:08.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.589+0000 7f730d780640 1 -- 172.21.15.78:0/833913942 >> 172.21.15.78:0/833913942 conn(0x7f73080cf480 msgr2=0x7f730813f750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:08.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.589+0000 7f730d780640 1 -- 172.21.15.78:0/833913942 shutdown_connections 2023-12-12T10:13:08.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.589+0000 7f730d780640 1 -- 172.21.15.78:0/833913942 wait complete. 2023-12-12T10:13:08.612 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-12T10:11:57.053584+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-12T10:12:07.454450+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-12T10:12:08.182909+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-12T10:12:11.977952+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-12T10:13:08.613 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-12T10:13:08.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.749+0000 7f2a53172640 1 Processor -- start 2023-12-12T10:13:08.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.749+0000 7f2a53172640 1 -- start start 2023-12-12T10:13:08.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.753+0000 7f2a53172640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f2a4c0716f0 0x7f2a4c071ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:08.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.753+0000 7f2a53172640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a4c072730 con 0x7f2a4c072010 2023-12-12T10:13:08.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.753+0000 7f2a53172640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a4c06d310 con 0x7f2a4c0b2f30 2023-12-12T10:13:08.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.753+0000 7f2a53172640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a4c06d5f0 con 0x7f2a4c0716f0 2023-12-12T10:13:08.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.753+0000 7f2a50f0e640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f2a4c0716f0 0x7f2a4c071ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:08.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.753+0000 7f2a50f0e640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f2a4c0716f0 0x7f2a4c071ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42128/0 (socket says 172.21.15.78:42128) 2023-12-12T10:13:08.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.753+0000 7f2a50f0e640 1 -- 172.21.15.78:0/1363224292 learned_addr learned my addr 172.21.15.78:0/1363224292 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:13:08.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.753+0000 7f2a50f0e640 1 -- 172.21.15.78:0/1363224292 >> v1:172.21.15.187:6789/0 conn(0x7f2a4c0b2f30 legacy=0x7f2a4c166cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:08.757 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.753+0000 7f2a50f0e640 1 -- 172.21.15.78:0/1363224292 >> v1:172.21.15.78:6789/0 conn(0x7f2a4c072010 legacy=0x7f2a4c146370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:08.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.753+0000 7f2a50f0e640 1 -- 172.21.15.78:0/1363224292 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a4c06d8d0 con 0x7f2a4c0716f0 2023-12-12T10:13:08.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.757+0000 7f2a50f0e640 1 --2- 172.21.15.78:0/1363224292 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2a4c0716f0 0x7f2a4c071ad0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f2a400098a0 tx=0x7f2a4001c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c72500237fdcda6 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:08.760 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.757+0000 7f2a4b7fe640 1 -- 172.21.15.78:0/1363224292 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a400aa650 con 0x7f2a4c0716f0 2023-12-12T10:13:08.760 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.757+0000 7f2a4b7fe640 1 -- 172.21.15.78:0/1363224292 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a400aa7b0 con 0x7f2a4c0716f0 2023-12-12T10:13:08.760 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.757+0000 7f2a4b7fe640 1 -- 172.21.15.78:0/1363224292 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a400aab40 con 0x7f2a4c0716f0 2023-12-12T10:13:08.761 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.757+0000 7f2a53172640 1 -- 172.21.15.78:0/1363224292 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2a4c0716f0 msgr2=0x7f2a4c071ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:08.761 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.757+0000 7f2a53172640 1 --2- 172.21.15.78:0/1363224292 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2a4c0716f0 0x7f2a4c071ad0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f2a400098a0 tx=0x7f2a4001c4f0 comp rx=0 tx=0).stop 2023-12-12T10:13:08.762 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.757+0000 7f2a53172640 1 -- 172.21.15.78:0/1363224292 shutdown_connections 2023-12-12T10:13:08.762 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.757+0000 7f2a53172640 1 --2- 172.21.15.78:0/1363224292 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2a4c0716f0 0x7f2a4c071ad0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:08.762 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.757+0000 7f2a53172640 1 -- 172.21.15.78:0/1363224292 >> 172.21.15.78:0/1363224292 conn(0x7f2a4c06a710 msgr2=0x7f2a4c06ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:08.762 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.757+0000 7f2a53172640 1 -- 172.21.15.78:0/1363224292 shutdown_connections 2023-12-12T10:13:08.762 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.757+0000 7f2a53172640 1 -- 172.21.15.78:0/1363224292 wait complete. 2023-12-12T10:13:08.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.757+0000 7f2a53172640 1 Processor -- start 2023-12-12T10:13:08.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.757+0000 7f2a53172640 1 -- start start 2023-12-12T10:13:08.765 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.761+0000 7f2a53172640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2a4c0716f0 0x7f2a4c13d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:08.765 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.761+0000 7f2a53172640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2a4c072010 0x7f2a4c144c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:08.765 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.761+0000 7f2a53172640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2a4c0b2f30 0x7f2a4c162f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:08.765 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.761+0000 7f2a53172640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a4c1447f0 con 0x7f2a4c0b2f30 2023-12-12T10:13:08.765 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.761+0000 7f2a53172640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a4c143900 con 0x7f2a4c0716f0 2023-12-12T10:13:08.766 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.761+0000 7f2a53172640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a4c143be0 con 0x7f2a4c072010 2023-12-12T10:13:08.766 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.761+0000 7f2a5170f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2a4c0b2f30 0x7f2a4c162f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:08.766 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.761+0000 7f2a5170f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2a4c0b2f30 0x7f2a4c162f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42140/0 (socket says 172.21.15.78:42140) 2023-12-12T10:13:08.766 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.761+0000 7f2a5170f640 1 -- 172.21.15.78:0/1722886510 learned_addr learned my addr 172.21.15.78:0/1722886510 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:13:08.766 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.761+0000 7f2a5170f640 1 -- 172.21.15.78:0/1722886510 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2a4c072010 msgr2=0x7f2a4c144c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:08.766 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.761+0000 7f2a5170f640 1 --2- 172.21.15.78:0/1722886510 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2a4c072010 0x7f2a4c144c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:08.766 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.761+0000 7f2a5170f640 1 -- 172.21.15.78:0/1722886510 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2a4c0716f0 msgr2=0x7f2a4c13d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:08.766 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.761+0000 7f2a5170f640 1 --2- 172.21.15.78:0/1722886510 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2a4c0716f0 0x7f2a4c13d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:08.766 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.761+0000 7f2a5170f640 1 -- 172.21.15.78:0/1722886510 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a400094d0 con 0x7f2a4c0b2f30 2023-12-12T10:13:08.766 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.761+0000 7f2a5170f640 1 --2- 172.21.15.78:0/1722886510 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2a4c0b2f30 0x7f2a4c162f10 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f2a4400c730 tx=0x7f2a4400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:08.766 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.761+0000 7f2a497fa640 1 -- 172.21.15.78:0/1722886510 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a44003b80 con 0x7f2a4c0b2f30 2023-12-12T10:13:08.766 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.761+0000 7f2a497fa640 1 -- 172.21.15.78:0/1722886510 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a44003ce0 con 0x7f2a4c0b2f30 2023-12-12T10:13:08.766 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.761+0000 7f2a53172640 1 -- 172.21.15.78:0/1722886510 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a4c143ec0 con 0x7f2a4c0b2f30 2023-12-12T10:13:08.767 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.761+0000 7f2a497fa640 1 -- 172.21.15.78:0/1722886510 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a4400aa30 con 0x7f2a4c0b2f30 2023-12-12T10:13:08.767 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.761+0000 7f2a53172640 1 -- 172.21.15.78:0/1722886510 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a4c144480 con 0x7f2a4c0b2f30 2023-12-12T10:13:08.767 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.761+0000 7f2a53172640 1 -- 172.21.15.78:0/1722886510 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a4c0671f0 con 0x7f2a4c0b2f30 2023-12-12T10:13:08.767 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.761+0000 7f2a497fa640 1 -- 172.21.15.78:0/1722886510 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2a4400ab90 con 0x7f2a4c0b2f30 2023-12-12T10:13:08.768 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.765+0000 7f2a497fa640 1 --2- 172.21.15.78:0/1722886510 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f2a30066470 0x7f2a30068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:08.768 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.765+0000 7f2a497fa640 1 -- 172.21.15.78:0/1722886510 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f2a44084040 con 0x7f2a4c0b2f30 2023-12-12T10:13:08.768 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.765+0000 7f2a50f0e640 1 --2- 172.21.15.78:0/1722886510 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f2a30066470 0x7f2a30068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:08.768 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.765+0000 7f2a50f0e640 1 --2- 172.21.15.78:0/1722886510 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f2a30066470 0x7f2a30068930 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f2a400ae000 tx=0x7f2a40008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:08.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.765+0000 7f2a497fa640 1 -- 172.21.15.78:0/1722886510 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2a440510e0 con 0x7f2a4c0b2f30 2023-12-12T10:13:08.921 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.917+0000 7f2a53172640 1 -- 172.21.15.78:0/1722886510 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2a4c067530 con 0x7f2a4c0b2f30 2023-12-12T10:13:08.921 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.917+0000 7f2a497fa640 1 -- 172.21.15.78:0/1722886510 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2a44054700 con 0x7f2a4c0b2f30 2023-12-12T10:13:08.922 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2023-12-12T10:13:08.924 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.917+0000 7f2a53172640 1 -- 172.21.15.78:0/1722886510 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f2a30066470 msgr2=0x7f2a30068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:08.924 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.917+0000 7f2a53172640 1 --2- 172.21.15.78:0/1722886510 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f2a30066470 0x7f2a30068930 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f2a400ae000 tx=0x7f2a40008040 comp rx=0 tx=0).stop 2023-12-12T10:13:08.924 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.917+0000 7f2a53172640 1 -- 172.21.15.78:0/1722886510 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2a4c0b2f30 msgr2=0x7f2a4c162f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:08.924 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.917+0000 7f2a53172640 1 --2- 172.21.15.78:0/1722886510 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2a4c0b2f30 0x7f2a4c162f10 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f2a4400c730 tx=0x7f2a4400cbf0 comp rx=0 tx=0).stop 2023-12-12T10:13:08.924 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.921+0000 7f2a53172640 1 -- 172.21.15.78:0/1722886510 shutdown_connections 2023-12-12T10:13:08.924 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.921+0000 7f2a53172640 1 --2- 172.21.15.78:0/1722886510 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f2a30066470 0x7f2a30068930 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:08.924 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.921+0000 7f2a53172640 1 --2- 172.21.15.78:0/1722886510 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2a4c0b2f30 0x7f2a4c162f10 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:08.924 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.921+0000 7f2a53172640 1 --2- 172.21.15.78:0/1722886510 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2a4c072010 0x7f2a4c144c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:08.925 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.921+0000 7f2a53172640 1 --2- 172.21.15.78:0/1722886510 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2a4c0716f0 0x7f2a4c13d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:08.925 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.921+0000 7f2a53172640 1 -- 172.21.15.78:0/1722886510 >> 172.21.15.78:0/1722886510 conn(0x7f2a4c06a710 msgr2=0x7f2a4c0ae990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:08.925 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.921+0000 7f2a53172640 1 -- 172.21.15.78:0/1722886510 shutdown_connections 2023-12-12T10:13:08.925 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:08.921+0000 7f2a53172640 1 -- 172.21.15.78:0/1722886510 wait complete. 2023-12-12T10:13:08.943 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-12T10:13:09.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.077+0000 7fcf62e46640 1 Processor -- start 2023-12-12T10:13:09.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.077+0000 7fcf62e46640 1 -- start start 2023-12-12T10:13:09.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.081+0000 7fcf62e46640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fcf5c0b2b50 0x7fcf5c06cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:09.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.081+0000 7fcf62e46640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fcf5c0ce490 0x7fcf5c06d530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:09.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.081+0000 7fcf62e46640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf5c0b1e20 con 0x7fcf5c153ab0 2023-12-12T10:13:09.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.081+0000 7fcf62e46640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf5c0cea00 con 0x7fcf5c0ce490 2023-12-12T10:13:09.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.081+0000 7fcf62e46640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf5c0b2070 con 0x7fcf5c0b2b50 2023-12-12T10:13:09.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.081+0000 7fcf613e3640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fcf5c0ce490 0x7fcf5c06d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:09.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.081+0000 7fcf613e3640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fcf5c0ce490 0x7fcf5c06d530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:42152/0 (socket says 172.21.15.78:42152) 2023-12-12T10:13:09.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.081+0000 7fcf613e3640 1 -- 172.21.15.78:0/148064068 learned_addr learned my addr 172.21.15.78:0/148064068 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:13:09.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.081+0000 7fcf53fff640 1 --2- 172.21.15.78:0/148064068 >> v2:172.21.15.187:3300/0 conn(0x7fcf5c0b2b50 0x7fcf5c06cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:09.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.081+0000 7fcf613e3640 1 -- 172.21.15.78:0/148064068 >> v2:172.21.15.187:3300/0 conn(0x7fcf5c0b2b50 msgr2=0x7fcf5c06cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:13:09.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.081+0000 7fcf613e3640 1 --2- 172.21.15.78:0/148064068 >> v2:172.21.15.187:3300/0 conn(0x7fcf5c0b2b50 0x7fcf5c06cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:09.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.081+0000 7fcf613e3640 1 -- 172.21.15.78:0/148064068 >> v1:172.21.15.78:6789/0 conn(0x7fcf5c153ab0 legacy=0x7fcf5c15a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:09.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.081+0000 7fcf613e3640 1 -- 172.21.15.78:0/148064068 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf5c0b2350 con 0x7fcf5c0ce490 2023-12-12T10:13:09.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.085+0000 7fcf613e3640 1 --2- 172.21.15.78:0/148064068 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf5c0ce490 0x7fcf5c06d530 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fcf5c06e4f0 tx=0x7fcf5401c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1db78aa1833990 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:09.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.085+0000 7fcf537fe640 1 -- 172.21.15.78:0/148064068 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf540a5670 con 0x7fcf5c0ce490 2023-12-12T10:13:09.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.085+0000 7fcf537fe640 1 -- 172.21.15.78:0/148064068 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf540a57d0 con 0x7fcf5c0ce490 2023-12-12T10:13:09.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.085+0000 7fcf537fe640 1 -- 172.21.15.78:0/148064068 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf540a5b60 con 0x7fcf5c0ce490 2023-12-12T10:13:09.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.085+0000 7fcf62e46640 1 -- 172.21.15.78:0/148064068 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf5c0ce490 msgr2=0x7fcf5c06d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:09.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.085+0000 7fcf62e46640 1 --2- 172.21.15.78:0/148064068 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf5c0ce490 0x7fcf5c06d530 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fcf5c06e4f0 tx=0x7fcf5401c910 comp rx=0 tx=0).stop 2023-12-12T10:13:09.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.085+0000 7fcf62e46640 1 -- 172.21.15.78:0/148064068 shutdown_connections 2023-12-12T10:13:09.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.085+0000 7fcf62e46640 1 --2- 172.21.15.78:0/148064068 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf5c0ce490 0x7fcf5c06d530 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:09.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.085+0000 7fcf62e46640 1 --2- 172.21.15.78:0/148064068 >> v2:172.21.15.187:3300/0 conn(0x7fcf5c0b2b50 0x7fcf5c06cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:09.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.085+0000 7fcf62e46640 1 -- 172.21.15.78:0/148064068 >> 172.21.15.78:0/148064068 conn(0x7fcf5c06a710 msgr2=0x7fcf5c06ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:09.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.085+0000 7fcf62e46640 1 -- 172.21.15.78:0/148064068 shutdown_connections 2023-12-12T10:13:09.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.085+0000 7fcf62e46640 1 -- 172.21.15.78:0/148064068 wait complete. 2023-12-12T10:13:09.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.085+0000 7fcf62e46640 1 Processor -- start 2023-12-12T10:13:09.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.085+0000 7fcf62e46640 1 -- start start 2023-12-12T10:13:09.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.089+0000 7fcf62e46640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcf5c0b2b50 0x7fcf5c071eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:09.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.089+0000 7fcf62e46640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf5c0ce490 0x7fcf5c158810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:09.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.089+0000 7fcf62e46640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcf5c153ab0 0x7fcf5c143c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:09.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.089+0000 7fcf62e46640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf5c146590 con 0x7fcf5c0ce490 2023-12-12T10:13:09.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.089+0000 7fcf62e46640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf5c146850 con 0x7fcf5c153ab0 2023-12-12T10:13:09.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.089+0000 7fcf62e46640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf5c071260 con 0x7fcf5c0b2b50 2023-12-12T10:13:09.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.089+0000 7fcf53fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf5c0ce490 0x7fcf5c158810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:09.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.089+0000 7fcf53fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf5c0ce490 0x7fcf5c158810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:44436/0 (socket says 172.21.15.78:44436) 2023-12-12T10:13:09.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.089+0000 7fcf53fff640 1 -- 172.21.15.78:0/4015935850 learned_addr learned my addr 172.21.15.78:0/4015935850 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:13:09.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.089+0000 7fcf53fff640 1 -- 172.21.15.78:0/4015935850 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcf5c0b2b50 msgr2=0x7fcf5c071eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:09.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.089+0000 7fcf613e3640 1 --2- 172.21.15.78:0/4015935850 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcf5c153ab0 0x7fcf5c143c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:09.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.089+0000 7fcf60be2640 1 --2- 172.21.15.78:0/4015935850 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcf5c0b2b50 0x7fcf5c071eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:09.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.089+0000 7fcf53fff640 1 --2- 172.21.15.78:0/4015935850 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcf5c0b2b50 0x7fcf5c071eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:09.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.089+0000 7fcf53fff640 1 -- 172.21.15.78:0/4015935850 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcf5c153ab0 msgr2=0x7fcf5c143c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:09.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.089+0000 7fcf53fff640 1 --2- 172.21.15.78:0/4015935850 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcf5c153ab0 0x7fcf5c143c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:09.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.089+0000 7fcf53fff640 1 -- 172.21.15.78:0/4015935850 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf54009b30 con 0x7fcf5c0ce490 2023-12-12T10:13:09.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.089+0000 7fcf613e3640 1 --2- 172.21.15.78:0/4015935850 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcf5c153ab0 0x7fcf5c143c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T10:13:09.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.089+0000 7fcf60be2640 1 --2- 172.21.15.78:0/4015935850 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcf5c0b2b50 0x7fcf5c071eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T10:13:09.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.089+0000 7fcf53fff640 1 --2- 172.21.15.78:0/4015935850 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf5c0ce490 0x7fcf5c158810 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c00d800 tx=0x7fcf4c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:09.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.089+0000 7fcf517fa640 1 -- 172.21.15.78:0/4015935850 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf4c00b6c0 con 0x7fcf5c0ce490 2023-12-12T10:13:09.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.089+0000 7fcf517fa640 1 -- 172.21.15.78:0/4015935850 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf4c00b820 con 0x7fcf5c0ce490 2023-12-12T10:13:09.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.089+0000 7fcf517fa640 1 -- 172.21.15.78:0/4015935850 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf4c00bb90 con 0x7fcf5c0ce490 2023-12-12T10:13:09.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.089+0000 7fcf62e46640 1 -- 172.21.15.78:0/4015935850 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf5c071540 con 0x7fcf5c0ce490 2023-12-12T10:13:09.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.089+0000 7fcf62e46640 1 -- 172.21.15.78:0/4015935850 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf5c158d50 con 0x7fcf5c0ce490 2023-12-12T10:13:09.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.089+0000 7fcf62e46640 1 -- 172.21.15.78:0/4015935850 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf5c0671f0 con 0x7fcf5c0ce490 2023-12-12T10:13:09.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.089+0000 7fcf517fa640 1 -- 172.21.15.78:0/4015935850 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fcf4c00bcf0 con 0x7fcf5c0ce490 2023-12-12T10:13:09.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.093+0000 7fcf517fa640 1 --2- 172.21.15.78:0/4015935850 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fcf48066470 0x7fcf48068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:09.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.093+0000 7fcf517fa640 1 -- 172.21.15.78:0/4015935850 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fcf4c084870 con 0x7fcf5c0ce490 2023-12-12T10:13:09.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.093+0000 7fcf60be2640 1 --2- 172.21.15.78:0/4015935850 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fcf48066470 0x7fcf48068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:09.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.093+0000 7fcf60be2640 1 --2- 172.21.15.78:0/4015935850 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fcf48066470 0x7fcf48068930 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fcf58000f70 tx=0x7fcf58009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:09.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.097+0000 7fcf517fa640 1 -- 172.21.15.78:0/4015935850 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fcf4c051890 con 0x7fcf5c0ce490 2023-12-12T10:13:09.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.249+0000 7fcf62e46640 1 -- 172.21.15.78:0/4015935850 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcf5c158f70 con 0x7fcf5c0ce490 2023-12-12T10:13:09.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.249+0000 7fcf517fa640 1 -- 172.21.15.78:0/4015935850 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7fcf4c011340 con 0x7fcf5c0ce490 2023-12-12T10:13:09.253 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2023-12-12T10:13:09.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.249+0000 7fcf62e46640 1 -- 172.21.15.78:0/4015935850 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fcf48066470 msgr2=0x7fcf48068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:09.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.249+0000 7fcf62e46640 1 --2- 172.21.15.78:0/4015935850 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fcf48066470 0x7fcf48068930 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fcf58000f70 tx=0x7fcf58009040 comp rx=0 tx=0).stop 2023-12-12T10:13:09.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.249+0000 7fcf62e46640 1 -- 172.21.15.78:0/4015935850 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf5c0ce490 msgr2=0x7fcf5c158810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:09.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.249+0000 7fcf62e46640 1 --2- 172.21.15.78:0/4015935850 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf5c0ce490 0x7fcf5c158810 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c00d800 tx=0x7fcf4c00dcc0 comp rx=0 tx=0).stop 2023-12-12T10:13:09.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.249+0000 7fcf62e46640 1 -- 172.21.15.78:0/4015935850 shutdown_connections 2023-12-12T10:13:09.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.249+0000 7fcf62e46640 1 --2- 172.21.15.78:0/4015935850 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fcf48066470 0x7fcf48068930 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:09.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.249+0000 7fcf62e46640 1 --2- 172.21.15.78:0/4015935850 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcf5c153ab0 0x7fcf5c143c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:09.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.249+0000 7fcf62e46640 1 --2- 172.21.15.78:0/4015935850 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fcf5c0ce490 0x7fcf5c158810 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:09.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.249+0000 7fcf62e46640 1 --2- 172.21.15.78:0/4015935850 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcf5c0b2b50 0x7fcf5c071eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:09.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.249+0000 7fcf62e46640 1 -- 172.21.15.78:0/4015935850 >> 172.21.15.78:0/4015935850 conn(0x7fcf5c06a710 msgr2=0x7fcf5c0b1300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:09.255 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.249+0000 7fcf62e46640 1 -- 172.21.15.78:0/4015935850 shutdown_connections 2023-12-12T10:13:09.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.249+0000 7fcf62e46640 1 -- 172.21.15.78:0/4015935850 wait complete. 2023-12-12T10:13:09.274 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-12T10:13:09.415 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.409+0000 7fc245f85640 1 Processor -- start 2023-12-12T10:13:09.415 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.409+0000 7fc245f85640 1 -- start start 2023-12-12T10:13:09.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.413+0000 7fc245f85640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc24015d000 0x7fc2400cec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:09.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.413+0000 7fc245f85640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fc2400b3600 0x7fc2400cf150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:09.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.413+0000 7fc245f85640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc2400b3c70 0x7fc2400ac880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:09.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.413+0000 7fc245f85640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc24015d3e0 con 0x7fc2400b3c70 2023-12-12T10:13:09.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.413+0000 7fc245f85640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc24006cea0 con 0x7fc2400b3600 2023-12-12T10:13:09.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.413+0000 7fc245f85640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2400b27b0 con 0x7fc24015d000 2023-12-12T10:13:09.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.413+0000 7fc245784640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc2400b3c70 0x7fc2400ac880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:09.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.413+0000 7fc245784640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc2400b3c70 0x7fc2400ac880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:44446/0 (socket says 172.21.15.78:44446) 2023-12-12T10:13:09.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.413+0000 7fc245784640 1 -- 172.21.15.78:0/3877941950 learned_addr learned my addr 172.21.15.78:0/3877941950 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:13:09.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.413+0000 7fc237fff640 1 --2- 172.21.15.78:0/3877941950 >> v2:172.21.15.187:3300/0 conn(0x7fc2400b3600 0x7fc2400cf150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:09.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.413+0000 7fc244f83640 1 --2- 172.21.15.78:0/3877941950 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc24015d000 0x7fc2400cec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:09.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.413+0000 7fc245784640 1 -- 172.21.15.78:0/3877941950 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc24015d000 msgr2=0x7fc2400cec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:13:09.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.413+0000 7fc245784640 1 --2- 172.21.15.78:0/3877941950 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc24015d000 0x7fc2400cec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:09.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.413+0000 7fc245784640 1 -- 172.21.15.78:0/3877941950 >> v2:172.21.15.187:3300/0 conn(0x7fc2400b3600 msgr2=0x7fc2400cf150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:13:09.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.413+0000 7fc245784640 1 --2- 172.21.15.78:0/3877941950 >> v2:172.21.15.187:3300/0 conn(0x7fc2400b3600 0x7fc2400cf150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:09.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.413+0000 7fc245784640 1 -- 172.21.15.78:0/3877941950 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2400b2a90 con 0x7fc2400b3c70 2023-12-12T10:13:09.419 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.413+0000 7fc237fff640 1 --2- 172.21.15.78:0/3877941950 >> v2:172.21.15.187:3300/0 conn(0x7fc2400b3600 0x7fc2400cf150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T10:13:09.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.413+0000 7fc245784640 1 --2- 172.21.15.78:0/3877941950 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc2400b3c70 0x7fc2400ac880 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fc2400cf790 tx=0x7fc23801f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c9840a2cd168783 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:09.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.417+0000 7fc2377fe640 1 -- 172.21.15.78:0/3877941950 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2380af400 con 0x7fc2400b3c70 2023-12-12T10:13:09.420 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.417+0000 7fc2377fe640 1 -- 172.21.15.78:0/3877941950 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2380ab050 con 0x7fc2400b3c70 2023-12-12T10:13:09.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.417+0000 7fc2377fe640 1 -- 172.21.15.78:0/3877941950 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2380af780 con 0x7fc2400b3c70 2023-12-12T10:13:09.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.417+0000 7fc245f85640 1 -- 172.21.15.78:0/3877941950 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc2400b3c70 msgr2=0x7fc2400ac880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:09.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.417+0000 7fc245f85640 1 --2- 172.21.15.78:0/3877941950 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc2400b3c70 0x7fc2400ac880 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fc2400cf790 tx=0x7fc23801f1c0 comp rx=0 tx=0).stop 2023-12-12T10:13:09.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.417+0000 7fc245f85640 1 -- 172.21.15.78:0/3877941950 shutdown_connections 2023-12-12T10:13:09.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.417+0000 7fc245f85640 1 --2- 172.21.15.78:0/3877941950 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc2400b3c70 0x7fc2400ac880 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:09.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.417+0000 7fc245f85640 1 --2- 172.21.15.78:0/3877941950 >> v2:172.21.15.187:3300/0 conn(0x7fc2400b3600 0x7fc2400cf150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:09.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.417+0000 7fc245f85640 1 --2- 172.21.15.78:0/3877941950 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc24015d000 0x7fc2400cec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:09.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.417+0000 7fc245f85640 1 -- 172.21.15.78:0/3877941950 >> 172.21.15.78:0/3877941950 conn(0x7fc24006a710 msgr2=0x7fc24006ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:09.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.417+0000 7fc245f85640 1 -- 172.21.15.78:0/3877941950 shutdown_connections 2023-12-12T10:13:09.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.417+0000 7fc245f85640 1 -- 172.21.15.78:0/3877941950 wait complete. 2023-12-12T10:13:09.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.417+0000 7fc245f85640 1 Processor -- start 2023-12-12T10:13:09.422 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.417+0000 7fc245f85640 1 -- start start 2023-12-12T10:13:09.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.417+0000 7fc245f85640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc2400b3600 0x7fc24015fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:09.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.417+0000 7fc245f85640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc2400b3c70 0x7fc24014f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:09.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.417+0000 7fc245f85640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc24015d000 0x7fc2400b0890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:09.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.417+0000 7fc245f85640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2400cc930 con 0x7fc2400b3600 2023-12-12T10:13:09.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.417+0000 7fc245f85640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2400cc620 con 0x7fc2400b3c70 2023-12-12T10:13:09.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.417+0000 7fc245f85640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2400af250 con 0x7fc24015d000 2023-12-12T10:13:09.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.421+0000 7fc244f83640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc2400b3600 0x7fc24015fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:09.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.421+0000 7fc244f83640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc2400b3600 0x7fc24015fdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:44462/0 (socket says 172.21.15.78:44462) 2023-12-12T10:13:09.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.421+0000 7fc244f83640 1 -- 172.21.15.78:0/1472789062 learned_addr learned my addr 172.21.15.78:0/1472789062 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:13:09.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.421+0000 7fc245784640 1 --2- 172.21.15.78:0/1472789062 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc24015d000 0x7fc2400b0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:09.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.421+0000 7fc237fff640 1 --2- 172.21.15.78:0/1472789062 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc2400b3c70 0x7fc24014f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:09.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.421+0000 7fc244f83640 1 -- 172.21.15.78:0/1472789062 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc24015d000 msgr2=0x7fc2400b0890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:09.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.421+0000 7fc244f83640 1 --2- 172.21.15.78:0/1472789062 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc24015d000 0x7fc2400b0890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:09.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.421+0000 7fc244f83640 1 -- 172.21.15.78:0/1472789062 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc2400b3c70 msgr2=0x7fc24014f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:09.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.421+0000 7fc244f83640 1 --2- 172.21.15.78:0/1472789062 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc2400b3c70 0x7fc24014f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:09.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.421+0000 7fc244f83640 1 -- 172.21.15.78:0/1472789062 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc238009b30 con 0x7fc2400b3600 2023-12-12T10:13:09.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.421+0000 7fc244f83640 1 --2- 172.21.15.78:0/1472789062 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc2400b3600 0x7fc24015fdf0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fc23c00d620 tx=0x7fc23c00dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:09.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.421+0000 7fc2357fa640 1 -- 172.21.15.78:0/1472789062 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc23c00b620 con 0x7fc2400b3600 2023-12-12T10:13:09.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.421+0000 7fc2357fa640 1 -- 172.21.15.78:0/1472789062 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc23c00b780 con 0x7fc2400b3600 2023-12-12T10:13:09.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.421+0000 7fc2357fa640 1 -- 172.21.15.78:0/1472789062 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc23c00bb10 con 0x7fc2400b3600 2023-12-12T10:13:09.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.421+0000 7fc245f85640 1 -- 172.21.15.78:0/1472789062 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2400af510 con 0x7fc2400b3600 2023-12-12T10:13:09.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.421+0000 7fc245f85640 1 -- 172.21.15.78:0/1472789062 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc240160330 con 0x7fc2400b3600 2023-12-12T10:13:09.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.421+0000 7fc245f85640 1 -- 172.21.15.78:0/1472789062 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2400671f0 con 0x7fc2400b3600 2023-12-12T10:13:09.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.421+0000 7fc2357fa640 1 -- 172.21.15.78:0/1472789062 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc23c00bc70 con 0x7fc2400b3600 2023-12-12T10:13:09.427 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.421+0000 7fc2357fa640 1 --2- 172.21.15.78:0/1472789062 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fc22c066470 0x7fc22c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:09.427 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.425+0000 7fc2357fa640 1 -- 172.21.15.78:0/1472789062 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fc23c084730 con 0x7fc2400b3600 2023-12-12T10:13:09.427 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.425+0000 7fc237fff640 1 --2- 172.21.15.78:0/1472789062 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fc22c066470 0x7fc22c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:09.428 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.425+0000 7fc237fff640 1 --2- 172.21.15.78:0/1472789062 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fc22c066470 0x7fc22c068930 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fc24015f080 tx=0x7fc230008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:09.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.429+0000 7fc2357fa640 1 -- 172.21.15.78:0/1472789062 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc23c051750 con 0x7fc2400b3600 2023-12-12T10:13:09.579 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.577+0000 7fc245f85640 1 -- 172.21.15.78:0/1472789062 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc2400745a0 con 0x7fc2400b3600 2023-12-12T10:13:09.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.577+0000 7fc2357fa640 1 -- 172.21.15.78:0/1472789062 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc23c007380 con 0x7fc2400b3600 2023-12-12T10:13:09.580 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2023-12-12T10:13:09.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.577+0000 7fc245f85640 1 -- 172.21.15.78:0/1472789062 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fc22c066470 msgr2=0x7fc22c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:09.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.577+0000 7fc245f85640 1 --2- 172.21.15.78:0/1472789062 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fc22c066470 0x7fc22c068930 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fc24015f080 tx=0x7fc230008040 comp rx=0 tx=0).stop 2023-12-12T10:13:09.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.577+0000 7fc245f85640 1 -- 172.21.15.78:0/1472789062 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc2400b3600 msgr2=0x7fc24015fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:09.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.577+0000 7fc245f85640 1 --2- 172.21.15.78:0/1472789062 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc2400b3600 0x7fc24015fdf0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fc23c00d620 tx=0x7fc23c00dae0 comp rx=0 tx=0).stop 2023-12-12T10:13:09.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.577+0000 7fc245f85640 1 -- 172.21.15.78:0/1472789062 shutdown_connections 2023-12-12T10:13:09.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.577+0000 7fc245f85640 1 --2- 172.21.15.78:0/1472789062 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fc22c066470 0x7fc22c068930 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:09.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.577+0000 7fc245f85640 1 --2- 172.21.15.78:0/1472789062 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc24015d000 0x7fc2400b0890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:09.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.577+0000 7fc245f85640 1 --2- 172.21.15.78:0/1472789062 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc2400b3c70 0x7fc24014f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:09.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.577+0000 7fc245f85640 1 --2- 172.21.15.78:0/1472789062 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc2400b3600 0x7fc24015fdf0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:09.583 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.577+0000 7fc245f85640 1 -- 172.21.15.78:0/1472789062 >> 172.21.15.78:0/1472789062 conn(0x7fc24006a710 msgr2=0x7fc2401580b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:09.583 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.577+0000 7fc245f85640 1 -- 172.21.15.78:0/1472789062 shutdown_connections 2023-12-12T10:13:09.583 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.577+0000 7fc245f85640 1 -- 172.21.15.78:0/1472789062 wait complete. 2023-12-12T10:13:09.601 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-12T10:13:09.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.737+0000 7f37689f8640 1 Processor -- start 2023-12-12T10:13:09.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.737+0000 7f37689f8640 1 -- start start 2023-12-12T10:13:09.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.737+0000 7f37689f8640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3764160890 0x7f37640b5e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:09.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.737+0000 7f37689f8640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f37640d1ce0 0x7f37640d1040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:09.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.737+0000 7f37689f8640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37640d04f0 con 0x7f37640d0be0 2023-12-12T10:13:09.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.737+0000 7f37689f8640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37640b63a0 con 0x7f37640d1ce0 2023-12-12T10:13:09.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.737+0000 7f37689f8640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37640cdc20 con 0x7f3764160890 2023-12-12T10:13:09.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.737+0000 7f3762d9d640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f37640d1ce0 0x7f37640d1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:09.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.737+0000 7f3759d9b640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f37640d0be0 0x7f37640d15d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:35536/0 (socket says 172.21.15.78:35536) 2023-12-12T10:13:09.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.737+0000 7f3759d9b640 1 -- 172.21.15.78:0/809342804 learned_addr learned my addr 172.21.15.78:0/809342804 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-12-12T10:13:09.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.737+0000 7f376259c640 1 --2- 172.21.15.78:0/809342804 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3764160890 0x7f37640b5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:09.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.737+0000 7f3762d9d640 1 -- 172.21.15.78:0/809342804 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3764160890 msgr2=0x7f37640b5e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:13:09.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.737+0000 7f3762d9d640 1 --2- 172.21.15.78:0/809342804 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3764160890 0x7f37640b5e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:09.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.737+0000 7f3762d9d640 1 -- 172.21.15.78:0/809342804 >> v1:172.21.15.78:6789/0 conn(0x7f37640d0be0 legacy=0x7f37640d15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:09.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.737+0000 7f3762d9d640 1 -- 172.21.15.78:0/809342804 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37640cfc50 con 0x7f37640d1ce0 2023-12-12T10:13:09.745 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.741+0000 7f3762d9d640 1 --2- 172.21.15.78:0/809342804 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f37640d1ce0 0x7f37640d1040 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f375c0097c0 tx=0x7f375c01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8eab6ff3f7da966b server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:09.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.741+0000 7f3761d9b640 1 -- 172.21.15.78:0/809342804 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f375c0ab650 con 0x7f37640d1ce0 2023-12-12T10:13:09.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.741+0000 7f3761d9b640 1 -- 172.21.15.78:0/809342804 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f375c0ab7b0 con 0x7f37640d1ce0 2023-12-12T10:13:09.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.741+0000 7f3761d9b640 1 -- 172.21.15.78:0/809342804 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f375c0abb40 con 0x7f37640d1ce0 2023-12-12T10:13:09.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.741+0000 7f37689f8640 1 -- 172.21.15.78:0/809342804 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f37640d1ce0 msgr2=0x7f37640d1040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:09.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.741+0000 7f37689f8640 1 --2- 172.21.15.78:0/809342804 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f37640d1ce0 0x7f37640d1040 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f375c0097c0 tx=0x7f375c01c450 comp rx=0 tx=0).stop 2023-12-12T10:13:09.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.741+0000 7f37689f8640 1 -- 172.21.15.78:0/809342804 shutdown_connections 2023-12-12T10:13:09.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.741+0000 7f37689f8640 1 --2- 172.21.15.78:0/809342804 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f37640d1ce0 0x7f37640d1040 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:09.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.741+0000 7f37689f8640 1 --2- 172.21.15.78:0/809342804 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3764160890 0x7f37640b5e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:09.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.741+0000 7f37689f8640 1 -- 172.21.15.78:0/809342804 >> 172.21.15.78:0/809342804 conn(0x7f376409c2f0 msgr2=0x7f37640d3010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:09.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.741+0000 7f37689f8640 1 -- 172.21.15.78:0/809342804 shutdown_connections 2023-12-12T10:13:09.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.741+0000 7f37689f8640 1 -- 172.21.15.78:0/809342804 wait complete. 2023-12-12T10:13:09.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.745+0000 7f37689f8640 1 Processor -- start 2023-12-12T10:13:09.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.745+0000 7f37689f8640 1 -- start start 2023-12-12T10:13:09.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.745+0000 7f37689f8640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f37640d0be0 0x7f3764153c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:09.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.745+0000 7f37689f8640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f37640d1ce0 0x7f37640cc7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:09.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.745+0000 7f37689f8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3764160890 0x7f37640ca8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:09.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.745+0000 7f37689f8640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3764155de0 con 0x7f3764160890 2023-12-12T10:13:09.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.745+0000 7f37689f8640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37641554c0 con 0x7f37640d0be0 2023-12-12T10:13:09.752 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.745+0000 7f37689f8640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37641548b0 con 0x7f37640d1ce0 2023-12-12T10:13:09.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.745+0000 7f3762d9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3764160890 0x7f37640ca8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:09.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.745+0000 7f3762d9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3764160890 0x7f37640ca8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:44490/0 (socket says 172.21.15.78:44490) 2023-12-12T10:13:09.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.745+0000 7f3762d9d640 1 -- 172.21.15.78:0/917074970 learned_addr learned my addr 172.21.15.78:0/917074970 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:13:09.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.745+0000 7f3759d9b640 1 --2- 172.21.15.78:0/917074970 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f37640d1ce0 0x7f37640cc7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:09.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.745+0000 7f376259c640 1 --2- 172.21.15.78:0/917074970 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f37640d0be0 0x7f3764153c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:09.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.745+0000 7f3762d9d640 1 -- 172.21.15.78:0/917074970 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f37640d1ce0 msgr2=0x7f37640cc7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:09.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.745+0000 7f3762d9d640 1 --2- 172.21.15.78:0/917074970 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f37640d1ce0 0x7f37640cc7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:09.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.745+0000 7f3762d9d640 1 -- 172.21.15.78:0/917074970 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f37640d0be0 msgr2=0x7f3764153c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:09.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.745+0000 7f3762d9d640 1 --2- 172.21.15.78:0/917074970 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f37640d0be0 0x7f3764153c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:09.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.745+0000 7f3762d9d640 1 -- 172.21.15.78:0/917074970 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f375c009420 con 0x7f3764160890 2023-12-12T10:13:09.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.745+0000 7f376259c640 1 --2- 172.21.15.78:0/917074970 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f37640d0be0 0x7f3764153c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T10:13:09.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.745+0000 7f3762d9d640 1 --2- 172.21.15.78:0/917074970 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3764160890 0x7f37640ca8d0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f375c01a080 tx=0x7f375c01ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:09.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.745+0000 7f375b7fe640 1 -- 172.21.15.78:0/917074970 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f375c0b5810 con 0x7f3764160890 2023-12-12T10:13:09.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.745+0000 7f375b7fe640 1 -- 172.21.15.78:0/917074970 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f375c0b5970 con 0x7f3764160890 2023-12-12T10:13:09.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.745+0000 7f375b7fe640 1 -- 172.21.15.78:0/917074970 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f375c0b5d00 con 0x7f3764160890 2023-12-12T10:13:09.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.745+0000 7f37689f8640 1 -- 172.21.15.78:0/917074970 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3764154b90 con 0x7f3764160890 2023-12-12T10:13:09.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.749+0000 7f37689f8640 1 -- 172.21.15.78:0/917074970 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3764155150 con 0x7f3764160890 2023-12-12T10:13:09.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.749+0000 7f37689f8640 1 -- 172.21.15.78:0/917074970 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3764155630 con 0x7f3764160890 2023-12-12T10:13:09.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.749+0000 7f375b7fe640 1 -- 172.21.15.78:0/917074970 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f375c0b4390 con 0x7f3764160890 2023-12-12T10:13:09.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.749+0000 7f375b7fe640 1 --2- 172.21.15.78:0/917074970 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f3744066470 0x7f3744068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:09.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.749+0000 7f375b7fe640 1 -- 172.21.15.78:0/917074970 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f375c11eb40 con 0x7f3764160890 2023-12-12T10:13:09.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.749+0000 7f376259c640 1 --2- 172.21.15.78:0/917074970 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f3744066470 0x7f3744068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:09.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.753+0000 7f376259c640 1 --2- 172.21.15.78:0/917074970 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f3744066470 0x7f3744068930 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f3754003fd0 tx=0x7f3754003a00 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:09.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.753+0000 7f375b7fe640 1 -- 172.21.15.78:0/917074970 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f375c0ebca0 con 0x7f3764160890 2023-12-12T10:13:09.911 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.905+0000 7f37689f8640 1 -- 172.21.15.78:0/917074970 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f3764067530 con 0x7f3764160890 2023-12-12T10:13:09.911 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.909+0000 7f375b7fe640 1 -- 172.21.15.78:0/917074970 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f375c0b5e60 con 0x7f3764160890 2023-12-12T10:13:09.911 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2023-12-12T10:13:09.913 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.909+0000 7f37689f8640 1 -- 172.21.15.78:0/917074970 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f3744066470 msgr2=0x7f3744068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:09.913 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.909+0000 7f37689f8640 1 --2- 172.21.15.78:0/917074970 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f3744066470 0x7f3744068930 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f3754003fd0 tx=0x7f3754003a00 comp rx=0 tx=0).stop 2023-12-12T10:13:09.913 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.909+0000 7f37689f8640 1 -- 172.21.15.78:0/917074970 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3764160890 msgr2=0x7f37640ca8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:09.914 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.909+0000 7f37689f8640 1 --2- 172.21.15.78:0/917074970 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3764160890 0x7f37640ca8d0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f375c01a080 tx=0x7f375c01ac90 comp rx=0 tx=0).stop 2023-12-12T10:13:09.914 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.909+0000 7f37689f8640 1 -- 172.21.15.78:0/917074970 shutdown_connections 2023-12-12T10:13:09.914 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.909+0000 7f37689f8640 1 --2- 172.21.15.78:0/917074970 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f3744066470 0x7f3744068930 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:09.914 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.909+0000 7f37689f8640 1 --2- 172.21.15.78:0/917074970 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3764160890 0x7f37640ca8d0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:09.914 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.909+0000 7f37689f8640 1 --2- 172.21.15.78:0/917074970 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f37640d1ce0 0x7f37640cc7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:09.914 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.909+0000 7f37689f8640 1 --2- 172.21.15.78:0/917074970 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f37640d0be0 0x7f3764153c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:09.914 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.909+0000 7f37689f8640 1 -- 172.21.15.78:0/917074970 >> 172.21.15.78:0/917074970 conn(0x7f376409c2f0 msgr2=0x7f3764072e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:09.914 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.909+0000 7f37689f8640 1 -- 172.21.15.78:0/917074970 shutdown_connections 2023-12-12T10:13:09.914 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:09.909+0000 7f37689f8640 1 -- 172.21.15.78:0/917074970 wait complete. 2023-12-12T10:13:09.933 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-12T10:13:10.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.069+0000 7fbdafd9d640 1 Processor -- start 2023-12-12T10:13:10.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.069+0000 7fbdafd9d640 1 -- start start 2023-12-12T10:13:10.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.073+0000 7fbdafd9d640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fbda80716f0 0x7fbda8071ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:10.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.073+0000 7fbdafd9d640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbda8072010 0x7fbda8146370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:10.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.073+0000 7fbdafd9d640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbda8072730 con 0x7fbda81468b0 2023-12-12T10:13:10.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.073+0000 7fbdafd9d640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbda806d310 con 0x7fbda80716f0 2023-12-12T10:13:10.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.073+0000 7fbdafd9d640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbda806d5f0 con 0x7fbda8072010 2023-12-12T10:13:10.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.073+0000 7fbdae33a640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fbda81468b0 0x7fbda80b1f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:35552/0 (socket says 172.21.15.78:35552) 2023-12-12T10:13:10.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.073+0000 7fbdae33a640 1 -- 172.21.15.78:0/3977558618 learned_addr learned my addr 172.21.15.78:0/3977558618 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-12-12T10:13:10.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.073+0000 7fbdacb37640 1 -- 172.21.15.78:0/3977558618 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2836447263 0 0) 0x7fbda8072730 con 0x7fbda81468b0 2023-12-12T10:13:10.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.073+0000 7fbdad338640 1 --2- 172.21.15.78:0/3977558618 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbda8072010 0x7fbda8146370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:10.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.073+0000 7fbdadb39640 1 --2- 172.21.15.78:0/3977558618 >> v2:172.21.15.187:3300/0 conn(0x7fbda80716f0 0x7fbda8071ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:10.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.073+0000 7fbdacb37640 1 -- 172.21.15.78:0/3977558618 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd94003530 con 0x7fbda81468b0 2023-12-12T10:13:10.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.073+0000 7fbdacb37640 1 -- 172.21.15.78:0/3977558618 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2489125419 0 0) 0x7fbd94003530 con 0x7fbda81468b0 2023-12-12T10:13:10.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.073+0000 7fbdacb37640 1 -- 172.21.15.78:0/3977558618 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbda8072010 msgr2=0x7fbda8146370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:13:10.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.073+0000 7fbdacb37640 1 --2- 172.21.15.78:0/3977558618 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbda8072010 0x7fbda8146370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:10.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.073+0000 7fbdacb37640 1 -- 172.21.15.78:0/3977558618 >> v2:172.21.15.187:3300/0 conn(0x7fbda80716f0 msgr2=0x7fbda8071ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:13:10.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.073+0000 7fbdacb37640 1 --2- 172.21.15.78:0/3977558618 >> v2:172.21.15.187:3300/0 conn(0x7fbda80716f0 0x7fbda8071ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:10.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.073+0000 7fbdacb37640 1 -- 172.21.15.78:0/3977558618 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbda806d8d0 con 0x7fbda81468b0 2023-12-12T10:13:10.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.073+0000 7fbdacb37640 1 -- 172.21.15.78:0/3977558618 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 465499599 0 0) 0x7fbda0001a00 con 0x7fbda81468b0 2023-12-12T10:13:10.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.073+0000 7fbdacb37640 1 -- 172.21.15.78:0/3977558618 >> v1:172.21.15.78:6789/0 conn(0x7fbda81468b0 legacy=0x7fbda80b1f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:10.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.073+0000 7fbdacb37640 1 --2- 172.21.15.78:0/3977558618 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbd94003980 0x7fbd94003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:10.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.073+0000 7fbdacb37640 1 --2- 172.21.15.78:0/3977558618 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbd940047d0 0x7fbd94004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:10.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.073+0000 7fbdacb37640 1 --2- 172.21.15.78:0/3977558618 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbda8072010 0x7fbd94005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:10.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.073+0000 7fbdacb37640 1 -- 172.21.15.78:0/3977558618 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbda806d310 con 0x7fbd940047d0 2023-12-12T10:13:10.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.073+0000 7fbdacb37640 1 -- 172.21.15.78:0/3977558618 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbda806d5f0 con 0x7fbd94003980 2023-12-12T10:13:10.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.073+0000 7fbdacb37640 1 -- 172.21.15.78:0/3977558618 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd9400ba10 con 0x7fbda8072010 2023-12-12T10:13:10.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.073+0000 7fbdad338640 1 --2- 172.21.15.78:0/3977558618 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbd940047d0 0x7fbd94004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:10.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.073+0000 7fbdadb39640 1 --2- 172.21.15.78:0/3977558618 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbd94003980 0x7fbd94003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:10.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.073+0000 7fbdae33a640 1 --2- 172.21.15.78:0/3977558618 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbda8072010 0x7fbd94005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:10.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.073+0000 7fbdad338640 1 -- 172.21.15.78:0/3977558618 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbda8072010 msgr2=0x7fbd94005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:13:10.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.073+0000 7fbdad338640 1 --2- 172.21.15.78:0/3977558618 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbda8072010 0x7fbd94005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:10.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.073+0000 7fbdad338640 1 -- 172.21.15.78:0/3977558618 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbd94003980 msgr2=0x7fbd94003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:13:10.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.073+0000 7fbdad338640 1 --2- 172.21.15.78:0/3977558618 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbd94003980 0x7fbd94003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:10.080 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.073+0000 7fbdad338640 1 -- 172.21.15.78:0/3977558618 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd94003530 con 0x7fbd940047d0 2023-12-12T10:13:10.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.077+0000 7fbdad338640 1 --2- 172.21.15.78:0/3977558618 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbd940047d0 0x7fbd94004c50 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fbd98009ab0 tx=0x7fbd9801ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3f2554fa5b7b0f6 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:10.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.077+0000 7fbdacb37640 1 -- 172.21.15.78:0/3977558618 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd980a6410 con 0x7fbd940047d0 2023-12-12T10:13:10.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.077+0000 7fbdacb37640 1 -- 172.21.15.78:0/3977558618 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd980a6570 con 0x7fbd940047d0 2023-12-12T10:13:10.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.077+0000 7fbdacb37640 1 -- 172.21.15.78:0/3977558618 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd980a68e0 con 0x7fbd940047d0 2023-12-12T10:13:10.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.077+0000 7fbdafd9d640 1 -- 172.21.15.78:0/3977558618 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbd940047d0 msgr2=0x7fbd94004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:10.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.077+0000 7fbdafd9d640 1 --2- 172.21.15.78:0/3977558618 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbd940047d0 0x7fbd94004c50 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fbd98009ab0 tx=0x7fbd9801ca00 comp rx=0 tx=0).stop 2023-12-12T10:13:10.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.077+0000 7fbdae33a640 1 -- 172.21.15.78:0/3977558618 reap_dead start 2023-12-12T10:13:10.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.077+0000 7fbdafd9d640 1 -- 172.21.15.78:0/3977558618 shutdown_connections 2023-12-12T10:13:10.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.077+0000 7fbdafd9d640 1 -- 172.21.15.78:0/3977558618 >> 172.21.15.78:0/3977558618 conn(0x7fbda806a710 msgr2=0x7fbda806ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:10.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.077+0000 7fbdafd9d640 1 -- 172.21.15.78:0/3977558618 shutdown_connections 2023-12-12T10:13:10.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.077+0000 7fbdafd9d640 1 -- 172.21.15.78:0/3977558618 wait complete. 2023-12-12T10:13:10.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.081+0000 7fbdafd9d640 1 Processor -- start 2023-12-12T10:13:10.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.081+0000 7fbdafd9d640 1 -- start start 2023-12-12T10:13:10.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.081+0000 7fbdafd9d640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbd940047d0 0x7fbda8138850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:10.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.081+0000 7fbdafd9d640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbda815fc80 0x7fbda813e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:10.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.081+0000 7fbdafd9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbda8160520 0x7fbda813a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:10.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.081+0000 7fbdafd9d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbda8138f50 con 0x7fbda8160520 2023-12-12T10:13:10.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.081+0000 7fbdafd9d640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbda80af460 con 0x7fbd940047d0 2023-12-12T10:13:10.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.081+0000 7fbdafd9d640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbda81380b0 con 0x7fbda815fc80 2023-12-12T10:13:10.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.081+0000 7fbdae33a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbda8160520 0x7fbda813a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:10.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.081+0000 7fbdadb39640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbd940047d0 0x7fbda8138850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:10.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.081+0000 7fbdae33a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbda8160520 0x7fbda813a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:44504/0 (socket says 172.21.15.78:44504) 2023-12-12T10:13:10.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.081+0000 7fbdae33a640 1 -- 172.21.15.78:0/1652362522 learned_addr learned my addr 172.21.15.78:0/1652362522 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:13:10.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.081+0000 7fbdad338640 1 --2- 172.21.15.78:0/1652362522 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbda815fc80 0x7fbda813e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:10.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.081+0000 7fbdae33a640 1 -- 172.21.15.78:0/1652362522 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbda815fc80 msgr2=0x7fbda813e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:10.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.081+0000 7fbdae33a640 1 --2- 172.21.15.78:0/1652362522 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbda815fc80 0x7fbda813e210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:10.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.081+0000 7fbdae33a640 1 -- 172.21.15.78:0/1652362522 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbd940047d0 msgr2=0x7fbda8138850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:10.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.081+0000 7fbdae33a640 1 --2- 172.21.15.78:0/1652362522 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbd940047d0 0x7fbda8138850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:10.086 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.081+0000 7fbdae33a640 1 -- 172.21.15.78:0/1652362522 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbda813e750 con 0x7fbda8160520 2023-12-12T10:13:10.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.081+0000 7fbdae33a640 1 --2- 172.21.15.78:0/1652362522 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbda8160520 0x7fbda813a4e0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fbda0002240 tx=0x7fbda000a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:10.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.081+0000 7fbd9e7fc640 1 -- 172.21.15.78:0/1652362522 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbda0007970 con 0x7fbda8160520 2023-12-12T10:13:10.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.081+0000 7fbd9e7fc640 1 -- 172.21.15.78:0/1652362522 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbda0007af0 con 0x7fbda8160520 2023-12-12T10:13:10.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.081+0000 7fbdafd9d640 1 -- 172.21.15.78:0/1652362522 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbda80aeb30 con 0x7fbda8160520 2023-12-12T10:13:10.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.081+0000 7fbd9e7fc640 1 -- 172.21.15.78:0/1652362522 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbda0013610 con 0x7fbda8160520 2023-12-12T10:13:10.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.081+0000 7fbdafd9d640 1 -- 172.21.15.78:0/1652362522 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbda80af0f0 con 0x7fbda8160520 2023-12-12T10:13:10.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.081+0000 7fbdafd9d640 1 -- 172.21.15.78:0/1652362522 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbda80671f0 con 0x7fbda8160520 2023-12-12T10:13:10.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.085+0000 7fbd9e7fc640 1 -- 172.21.15.78:0/1652362522 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fbda0013770 con 0x7fbda8160520 2023-12-12T10:13:10.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.085+0000 7fbd9e7fc640 1 --2- 172.21.15.78:0/1652362522 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fbd8c0664a0 0x7fbd8c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:10.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.085+0000 7fbd9e7fc640 1 -- 172.21.15.78:0/1652362522 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fbda0084810 con 0x7fbda8160520 2023-12-12T10:13:10.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.085+0000 7fbdadb39640 1 --2- 172.21.15.78:0/1652362522 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fbd8c0664a0 0x7fbd8c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:10.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.085+0000 7fbdadb39640 1 --2- 172.21.15.78:0/1652362522 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fbd8c0664a0 0x7fbd8c068960 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fbda815d6c0 tx=0x7fbda4009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:10.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.089+0000 7fbd9e7fc640 1 -- 172.21.15.78:0/1652362522 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fbda00518c0 con 0x7fbda8160520 2023-12-12T10:13:10.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.253+0000 7fbdafd9d640 1 -- 172.21.15.78:0/1652362522 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fbda8067530 con 0x7fbda8160520 2023-12-12T10:13:10.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.253+0000 7fbd9e7fc640 1 -- 172.21.15.78:0/1652362522 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7fbda0054ee0 con 0x7fbda8160520 2023-12-12T10:13:10.258 INFO:teuthology.orchestra.run.smithi078.stderr:listed 0 entries 2023-12-12T10:13:10.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.257+0000 7fbdafd9d640 1 -- 172.21.15.78:0/1652362522 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fbd8c0664a0 msgr2=0x7fbd8c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:10.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.257+0000 7fbdafd9d640 1 --2- 172.21.15.78:0/1652362522 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fbd8c0664a0 0x7fbd8c068960 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fbda815d6c0 tx=0x7fbda4009190 comp rx=0 tx=0).stop 2023-12-12T10:13:10.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.257+0000 7fbdafd9d640 1 -- 172.21.15.78:0/1652362522 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbda8160520 msgr2=0x7fbda813a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:10.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.257+0000 7fbdafd9d640 1 --2- 172.21.15.78:0/1652362522 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbda8160520 0x7fbda813a4e0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fbda0002240 tx=0x7fbda000a6a0 comp rx=0 tx=0).stop 2023-12-12T10:13:10.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.257+0000 7fbdafd9d640 1 -- 172.21.15.78:0/1652362522 shutdown_connections 2023-12-12T10:13:10.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.257+0000 7fbdafd9d640 1 --2- 172.21.15.78:0/1652362522 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fbd8c0664a0 0x7fbd8c068960 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:10.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.257+0000 7fbdafd9d640 1 --2- 172.21.15.78:0/1652362522 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbda8160520 0x7fbda813a4e0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:10.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.257+0000 7fbdafd9d640 1 --2- 172.21.15.78:0/1652362522 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbda815fc80 0x7fbda813e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:10.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.257+0000 7fbdafd9d640 1 --2- 172.21.15.78:0/1652362522 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbd940047d0 0x7fbda8138850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:10.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.257+0000 7fbdafd9d640 1 -- 172.21.15.78:0/1652362522 >> 172.21.15.78:0/1652362522 conn(0x7fbda806a710 msgr2=0x7fbda806c730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:10.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.257+0000 7fbdafd9d640 1 -- 172.21.15.78:0/1652362522 shutdown_connections 2023-12-12T10:13:10.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.257+0000 7fbdafd9d640 1 -- 172.21.15.78:0/1652362522 wait complete. 2023-12-12T10:13:10.279 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi078.front.sepia.ceph.com... 2023-12-12T10:13:10.279 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T10:13:10.279 DEBUG:teuthology.orchestra.run.smithi078:> sudo fusermount -u /home/ubuntu/cephtest/mnt.2 2023-12-12T10:13:10.301 INFO:teuthology.orchestra.run:waiting for 300 2023-12-12T10:13:10.301 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi078.front.sepia.ceph.com 2023-12-12T10:13:10.301 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T10:13:10.301 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-12-12T10:13:10.356 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-12-12T10:13:10.357 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-12T10:13:10.367 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-12-12T10:13:10.367 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-12T10:13:10.418 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T10:13:10.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.553+0000 7fd574632640 1 Processor -- start 2023-12-12T10:13:10.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.553+0000 7fd574632640 1 -- start start 2023-12-12T10:13:10.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.553+0000 7fd574632640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd56c15d3c0 0x7fd56c0d3b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:10.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.553+0000 7fd574632640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd56c0d1cb0 0x7fd56c0b36e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:10.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.553+0000 7fd574632640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd56c0b3250 con 0x7fd56c0ce670 2023-12-12T10:13:10.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.553+0000 7fd574632640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd56c0cee50 con 0x7fd56c0d1cb0 2023-12-12T10:13:10.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.553+0000 7fd574632640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd56c0b2920 con 0x7fd56c15d3c0 2023-12-12T10:13:10.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.553+0000 7fd572bcf640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd56c0d1cb0 0x7fd56c0b36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:10.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.553+0000 7fd572bcf640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd56c0d1cb0 0x7fd56c0b36e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:44508/0 (socket says 172.21.15.78:44508) 2023-12-12T10:13:10.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.553+0000 7fd572bcf640 1 -- 172.21.15.78:0/2296133201 learned_addr learned my addr 172.21.15.78:0/2296133201 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:13:10.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.553+0000 7fd572bcf640 1 -- 172.21.15.78:0/2296133201 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd56c15d3c0 msgr2=0x7fd56c0d3b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:13:10.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.553+0000 7fd572bcf640 1 --2- 172.21.15.78:0/2296133201 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd56c15d3c0 0x7fd56c0d3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:10.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.553+0000 7fd572bcf640 1 -- 172.21.15.78:0/2296133201 >> v1:172.21.15.78:6789/0 conn(0x7fd56c0ce670 legacy=0x7fd56c0d15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:10.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.553+0000 7fd572bcf640 1 -- 172.21.15.78:0/2296133201 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd56c0b2c00 con 0x7fd56c0d1cb0 2023-12-12T10:13:10.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.557+0000 7fd572bcf640 1 --2- 172.21.15.78:0/2296133201 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd56c0d1cb0 0x7fd56c0b36e0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fd564009e80 tx=0x7fd56401f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f8f8d3634c32e49 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:10.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.557+0000 7fd5713cc640 1 -- 172.21.15.78:0/2296133201 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5640af400 con 0x7fd56c0d1cb0 2023-12-12T10:13:10.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.557+0000 7fd5713cc640 1 -- 172.21.15.78:0/2296133201 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5640ab050 con 0x7fd56c0d1cb0 2023-12-12T10:13:10.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.557+0000 7fd5713cc640 1 -- 172.21.15.78:0/2296133201 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5640af780 con 0x7fd56c0d1cb0 2023-12-12T10:13:10.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.557+0000 7fd574632640 1 -- 172.21.15.78:0/2296133201 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd56c0d1cb0 msgr2=0x7fd56c0b36e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:10.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.557+0000 7fd574632640 1 --2- 172.21.15.78:0/2296133201 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd56c0d1cb0 0x7fd56c0b36e0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fd564009e80 tx=0x7fd56401f1e0 comp rx=0 tx=0).stop 2023-12-12T10:13:10.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.557+0000 7fd574632640 1 -- 172.21.15.78:0/2296133201 shutdown_connections 2023-12-12T10:13:10.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.557+0000 7fd574632640 1 --2- 172.21.15.78:0/2296133201 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd56c0d1cb0 0x7fd56c0b36e0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:10.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.557+0000 7fd574632640 1 --2- 172.21.15.78:0/2296133201 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd56c15d3c0 0x7fd56c0d3b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:10.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.557+0000 7fd574632640 1 -- 172.21.15.78:0/2296133201 >> 172.21.15.78:0/2296133201 conn(0x7fd56c09c2a0 msgr2=0x7fd56c0d2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:10.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.557+0000 7fd574632640 1 -- 172.21.15.78:0/2296133201 shutdown_connections 2023-12-12T10:13:10.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.557+0000 7fd574632640 1 -- 172.21.15.78:0/2296133201 wait complete. 2023-12-12T10:13:10.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.557+0000 7fd574632640 1 Processor -- start 2023-12-12T10:13:10.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.561+0000 7fd574632640 1 -- start start 2023-12-12T10:13:10.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.561+0000 7fd574632640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd56c0ce670 0x7fd56c1604f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:10.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.561+0000 7fd574632640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd56c0d1cb0 0x7fd56c0caaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:10.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.561+0000 7fd574632640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd56c15d3c0 0x7fd56c0b10f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:10.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.561+0000 7fd574632640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd56c15f4e0 con 0x7fd56c15d3c0 2023-12-12T10:13:10.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.561+0000 7fd574632640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd56c15f730 con 0x7fd56c0ce670 2023-12-12T10:13:10.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.561+0000 7fd574632640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd56c15fa10 con 0x7fd56c0d1cb0 2023-12-12T10:13:10.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.561+0000 7fd572bcf640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd56c15d3c0 0x7fd56c0b10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:10.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.561+0000 7fd572bcf640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd56c15d3c0 0x7fd56c0b10f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:44516/0 (socket says 172.21.15.78:44516) 2023-12-12T10:13:10.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.561+0000 7fd572bcf640 1 -- 172.21.15.78:0/1739973207 learned_addr learned my addr 172.21.15.78:0/1739973207 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:13:10.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.561+0000 7fd5723ce640 1 --2- 172.21.15.78:0/1739973207 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd56c0ce670 0x7fd56c1604f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:10.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.561+0000 7fd571bcd640 1 --2- 172.21.15.78:0/1739973207 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd56c0d1cb0 0x7fd56c0caaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:10.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.561+0000 7fd572bcf640 1 -- 172.21.15.78:0/1739973207 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd56c0d1cb0 msgr2=0x7fd56c0caaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:10.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.561+0000 7fd572bcf640 1 --2- 172.21.15.78:0/1739973207 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd56c0d1cb0 0x7fd56c0caaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:10.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.561+0000 7fd572bcf640 1 -- 172.21.15.78:0/1739973207 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd56c0ce670 msgr2=0x7fd56c1604f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:10.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.561+0000 7fd572bcf640 1 --2- 172.21.15.78:0/1739973207 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd56c0ce670 0x7fd56c1604f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:10.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.561+0000 7fd572bcf640 1 -- 172.21.15.78:0/1739973207 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd564009b30 con 0x7fd56c15d3c0 2023-12-12T10:13:10.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.561+0000 7fd572bcf640 1 --2- 172.21.15.78:0/1739973207 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd56c15d3c0 0x7fd56c0b10f0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fd56401ce10 tx=0x7fd56401bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:10.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.561+0000 7fd562ffd640 1 -- 172.21.15.78:0/1739973207 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5640afd60 con 0x7fd56c15d3c0 2023-12-12T10:13:10.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.561+0000 7fd562ffd640 1 -- 172.21.15.78:0/1739973207 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd564009510 con 0x7fd56c15d3c0 2023-12-12T10:13:10.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.561+0000 7fd562ffd640 1 -- 172.21.15.78:0/1739973207 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5640ba660 con 0x7fd56c15d3c0 2023-12-12T10:13:10.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.561+0000 7fd574632640 1 -- 172.21.15.78:0/1739973207 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd56c15fcf0 con 0x7fd56c15d3c0 2023-12-12T10:13:10.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.561+0000 7fd574632640 1 -- 172.21.15.78:0/1739973207 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd56c0cafe0 con 0x7fd56c15d3c0 2023-12-12T10:13:10.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.561+0000 7fd574632640 1 -- 172.21.15.78:0/1739973207 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd56c067530 con 0x7fd56c15d3c0 2023-12-12T10:13:10.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.565+0000 7fd562ffd640 1 -- 172.21.15.78:0/1739973207 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd5640b6040 con 0x7fd56c15d3c0 2023-12-12T10:13:10.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.565+0000 7fd562ffd640 1 --2- 172.21.15.78:0/1739973207 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fd550066470 0x7fd550068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:10.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.565+0000 7fd562ffd640 1 -- 172.21.15.78:0/1739973207 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fd564122850 con 0x7fd56c15d3c0 2023-12-12T10:13:10.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.565+0000 7fd5723ce640 1 --2- 172.21.15.78:0/1739973207 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fd550066470 0x7fd550068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:10.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.565+0000 7fd5723ce640 1 --2- 172.21.15.78:0/1739973207 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fd550066470 0x7fd550068930 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fd568006fd0 tx=0x7fd568008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:10.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.569+0000 7fd562ffd640 1 -- 172.21.15.78:0/1739973207 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd5640ef900 con 0x7fd56c15d3c0 2023-12-12T10:13:10.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.721+0000 7fd574632640 1 -- 172.21.15.78:0/1739973207 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd56c1601a0 con 0x7fd56c15d3c0 2023-12-12T10:13:10.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.721+0000 7fd562ffd640 1 -- 172.21.15.78:0/1739973207 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18701 (secure 0 0 0) 0x7fd5640f2f20 con 0x7fd56c15d3c0 2023-12-12T10:13:10.725 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:13:10.726 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":26,"fsid":"fc81937c-bd26-483c-952b-d1324fcb0c9e","created":"2023-12-12T10:11:44.020214+0000","modified":"2023-12-12T10:12:50.919344+0000","last_up_change":"2023-12-12T10:11:56.278318+0000","last_in_change":"2023-12-12T10:11:46.553610+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T10:11:57.053584+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-12T10:12:07.454450+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-12T10:12:08.182909+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-12T10:12:11.977952+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"22dfdedf-5f6c-4b20-9f6c-30517a1db70a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6809","nonce":3345683600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6811","nonce":3345683600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6815","nonce":3345683600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6813","nonce":3345683600}]},"public_addr":"172.21.15.78:6809/3345683600","cluster_addr":"172.21.15.78:6811/3345683600","heartbeat_back_addr":"172.21.15.78:6815/3345683600","heartbeat_front_addr":"172.21.15.78:6813/3345683600","state":["exists","up"]},{"osd":1,"uuid":"be34a7f3-a69a-462e-9ddf-5e537448dba2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6801","nonce":962652768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6803","nonce":962652768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6807","nonce":962652768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6805","nonce":962652768}]},"public_addr":"172.21.15.78:6801/962652768","cluster_addr":"172.21.15.78:6803/962652768","heartbeat_back_addr":"172.21.15.78:6807/962652768","heartbeat_front_addr":"172.21.15.78:6805/962652768","state":["exists","up"]},{"osd":2,"uuid":"55b381de-5f56-4b14-80f7-e6e41e084a13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6818","nonce":2910206054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6822","nonce":2910206054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6829","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6831","nonce":2910206054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6826","nonce":2910206054}]},"public_addr":"172.21.15.78:6818/2910206054","cluster_addr":"172.21.15.78:6822/2910206054","heartbeat_back_addr":"172.21.15.78:6831/2910206054","heartbeat_front_addr":"172.21.15.78:6826/2910206054","state":["exists","up"]},{"osd":3,"uuid":"d7682de1-25cb-4cec-869f-8851c28b0e6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6819","nonce":3750796703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6821","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6823","nonce":3750796703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6830","nonce":3750796703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6825","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6827","nonce":3750796703}]},"public_addr":"172.21.15.78:6819/3750796703","cluster_addr":"172.21.15.78:6823/3750796703","heartbeat_back_addr":"172.21.15.78:6830/3750796703","heartbeat_front_addr":"172.21.15.78:6827/3750796703","state":["exists","up"]},{"osd":4,"uuid":"8279815a-d6c7-4199-871e-d28971b9dc07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6809","nonce":2944277204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6811","nonce":2944277204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6815","nonce":2944277204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6813","nonce":2944277204}]},"public_addr":"172.21.15.187:6809/2944277204","cluster_addr":"172.21.15.187:6811/2944277204","heartbeat_back_addr":"172.21.15.187:6815/2944277204","heartbeat_front_addr":"172.21.15.187:6813/2944277204","state":["exists","up"]},{"osd":5,"uuid":"0a714c65-f8ce-4340-968f-11a799677ef3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6801","nonce":185858620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6803","nonce":185858620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6807","nonce":185858620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6805","nonce":185858620}]},"public_addr":"172.21.15.187:6801/185858620","cluster_addr":"172.21.15.187:6803/185858620","heartbeat_back_addr":"172.21.15.187:6807/185858620","heartbeat_front_addr":"172.21.15.187:6805/185858620","state":["exists","up"]},{"osd":6,"uuid":"d0bba9ab-f7ee-449e-8999-1c0cf7e6d53c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6817","nonce":4213392126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6819","nonce":4213392126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6824","nonce":4213392126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6821","nonce":4213392126}]},"public_addr":"172.21.15.187:6817/4213392126","cluster_addr":"172.21.15.187:6819/4213392126","heartbeat_back_addr":"172.21.15.187:6824/4213392126","heartbeat_front_addr":"172.21.15.187:6821/4213392126","state":["exists","up"]},{"osd":7,"uuid":"efe5e0d9-2f87-4889-a27a-e2a95a632302","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6823","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6825","nonce":85774004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6827","nonce":85774004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6831","nonce":85774004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6829","nonce":85774004}]},"public_addr":"172.21.15.187:6825/85774004","cluster_addr":"172.21.15.187:6827/85774004","heartbeat_back_addr":"172.21.15.187:6831/85774004","heartbeat_front_addr":"172.21.15.187:6829/85774004","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.214447+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.448899+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.293107+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.564184+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.175026+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.097717+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.261141+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.287681+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.18","mappings":[{"from":3,"to":2}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.13","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T10:13:10.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.721+0000 7fd574632640 1 -- 172.21.15.78:0/1739973207 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fd550066470 msgr2=0x7fd550068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:10.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.721+0000 7fd574632640 1 --2- 172.21.15.78:0/1739973207 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fd550066470 0x7fd550068930 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fd568006fd0 tx=0x7fd568008040 comp rx=0 tx=0).stop 2023-12-12T10:13:10.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.721+0000 7fd574632640 1 -- 172.21.15.78:0/1739973207 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd56c15d3c0 msgr2=0x7fd56c0b10f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:10.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.721+0000 7fd574632640 1 --2- 172.21.15.78:0/1739973207 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd56c15d3c0 0x7fd56c0b10f0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fd56401ce10 tx=0x7fd56401bf80 comp rx=0 tx=0).stop 2023-12-12T10:13:10.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.725+0000 7fd574632640 1 -- 172.21.15.78:0/1739973207 shutdown_connections 2023-12-12T10:13:10.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.725+0000 7fd574632640 1 --2- 172.21.15.78:0/1739973207 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fd550066470 0x7fd550068930 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:10.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.725+0000 7fd574632640 1 --2- 172.21.15.78:0/1739973207 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd56c15d3c0 0x7fd56c0b10f0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:10.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.725+0000 7fd574632640 1 --2- 172.21.15.78:0/1739973207 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd56c0d1cb0 0x7fd56c0caaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:10.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.725+0000 7fd574632640 1 --2- 172.21.15.78:0/1739973207 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd56c0ce670 0x7fd56c1604f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:10.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.725+0000 7fd574632640 1 -- 172.21.15.78:0/1739973207 >> 172.21.15.78:0/1739973207 conn(0x7fd56c09c2a0 msgr2=0x7fd56c0b0390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:10.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.725+0000 7fd574632640 1 -- 172.21.15.78:0/1739973207 shutdown_connections 2023-12-12T10:13:10.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.725+0000 7fd574632640 1 -- 172.21.15.78:0/1739973207 wait complete. 2023-12-12T10:13:10.746 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-12T10:11:57.053584+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-12T10:12:07.454450+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-12T10:12:08.182909+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-12T10:12:11.977952+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-12T10:13:10.747 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-12T10:13:10.887 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.881+0000 7f3d1dc17640 1 Processor -- start 2023-12-12T10:13:10.887 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.881+0000 7f3d1dc17640 1 -- start start 2023-12-12T10:13:10.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.885+0000 7f3d1dc17640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f3d18143770 0x7f3d180cdf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:10.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.885+0000 7f3d1dc17640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f3d180b1e20 0x7f3d18070f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:10.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.885+0000 7f3d1dc17640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d18070a70 con 0x7f3d180b2280 2023-12-12T10:13:10.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.885+0000 7f3d1dc17640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d1815e920 con 0x7f3d18143770 2023-12-12T10:13:10.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.885+0000 7f3d1dc17640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d18070440 con 0x7f3d180b1e20 2023-12-12T10:13:10.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.885+0000 7f3d177fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f3d18143770 0x7f3d180cdf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:10.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.885+0000 7f3d177fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f3d18143770 0x7f3d180cdf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:44530/0 (socket says 172.21.15.78:44530) 2023-12-12T10:13:10.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.885+0000 7f3d177fe640 1 -- 172.21.15.78:0/28319882 learned_addr learned my addr 172.21.15.78:0/28319882 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:13:10.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.885+0000 7f3d16ffd640 1 --2- 172.21.15.78:0/28319882 >> v2:172.21.15.187:3300/0 conn(0x7f3d180b1e20 0x7f3d18070f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:10.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.885+0000 7f3d177fe640 1 -- 172.21.15.78:0/28319882 >> v2:172.21.15.187:3300/0 conn(0x7f3d180b1e20 msgr2=0x7f3d18070f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:13:10.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.885+0000 7f3d177fe640 1 --2- 172.21.15.78:0/28319882 >> v2:172.21.15.187:3300/0 conn(0x7f3d180b1e20 0x7f3d18070f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:10.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.885+0000 7f3d177fe640 1 -- 172.21.15.78:0/28319882 >> v1:172.21.15.78:6789/0 conn(0x7f3d180b2280 legacy=0x7f3d1815a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:10.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.885+0000 7f3d177fe640 1 -- 172.21.15.78:0/28319882 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d18143b50 con 0x7f3d18143770 2023-12-12T10:13:10.892 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.889+0000 7f3d177fe640 1 --2- 172.21.15.78:0/28319882 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d18143770 0x7f3d180cdf60 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f3d180aea60 tx=0x7f3d0801c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec81084c648f5058 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:10.892 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.889+0000 7f3d167fc640 1 -- 172.21.15.78:0/28319882 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d080ac640 con 0x7f3d18143770 2023-12-12T10:13:10.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.889+0000 7f3d167fc640 1 -- 172.21.15.78:0/28319882 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d080ac7a0 con 0x7f3d18143770 2023-12-12T10:13:10.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.889+0000 7f3d167fc640 1 -- 172.21.15.78:0/28319882 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d080acb30 con 0x7f3d18143770 2023-12-12T10:13:10.894 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.889+0000 7f3d1dc17640 1 -- 172.21.15.78:0/28319882 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d18143770 msgr2=0x7f3d180cdf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:10.894 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.889+0000 7f3d1dc17640 1 --2- 172.21.15.78:0/28319882 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d18143770 0x7f3d180cdf60 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f3d180aea60 tx=0x7f3d0801c3e0 comp rx=0 tx=0).stop 2023-12-12T10:13:10.894 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.889+0000 7f3d1dc17640 1 -- 172.21.15.78:0/28319882 shutdown_connections 2023-12-12T10:13:10.894 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.889+0000 7f3d1dc17640 1 --2- 172.21.15.78:0/28319882 >> v2:172.21.15.187:3300/0 conn(0x7f3d180b1e20 0x7f3d18070f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:10.894 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.889+0000 7f3d1dc17640 1 --2- 172.21.15.78:0/28319882 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d18143770 0x7f3d180cdf60 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:10.895 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.889+0000 7f3d1dc17640 1 -- 172.21.15.78:0/28319882 >> 172.21.15.78:0/28319882 conn(0x7f3d1806a710 msgr2=0x7f3d1806ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:10.895 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.889+0000 7f3d1dc17640 1 -- 172.21.15.78:0/28319882 shutdown_connections 2023-12-12T10:13:10.895 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.889+0000 7f3d1dc17640 1 -- 172.21.15.78:0/28319882 wait complete. 2023-12-12T10:13:10.895 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.889+0000 7f3d1dc17640 1 Processor -- start 2023-12-12T10:13:10.895 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.889+0000 7f3d1dc17640 1 -- start start 2023-12-12T10:13:10.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.893+0000 7f3d1dc17640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3d180b1e20 0x7f3d18130a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:10.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.893+0000 7f3d1dc17640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d180b2280 0x7f3d18132960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:10.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.893+0000 7f3d1dc17640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3d18143770 0x7f3d1812f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:10.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.893+0000 7f3d1dc17640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d181302f0 con 0x7f3d180b2280 2023-12-12T10:13:10.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.893+0000 7f3d1dc17640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d180aed30 con 0x7f3d18143770 2023-12-12T10:13:10.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.893+0000 7f3d1dc17640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d180af010 con 0x7f3d180b1e20 2023-12-12T10:13:10.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.893+0000 7f3d16ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d180b2280 0x7f3d18132960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:10.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.893+0000 7f3d16ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d180b2280 0x7f3d18132960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:44538/0 (socket says 172.21.15.78:44538) 2023-12-12T10:13:10.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.893+0000 7f3d16ffd640 1 -- 172.21.15.78:0/2210841698 learned_addr learned my addr 172.21.15.78:0/2210841698 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:13:10.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.893+0000 7f3d177fe640 1 --2- 172.21.15.78:0/2210841698 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3d180b1e20 0x7f3d18130a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:10.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.893+0000 7f3d17fff640 1 --2- 172.21.15.78:0/2210841698 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3d18143770 0x7f3d1812f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:10.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.893+0000 7f3d16ffd640 1 -- 172.21.15.78:0/2210841698 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3d180b1e20 msgr2=0x7f3d18130a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:10.898 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.893+0000 7f3d16ffd640 1 --2- 172.21.15.78:0/2210841698 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3d180b1e20 0x7f3d18130a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:10.898 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.893+0000 7f3d16ffd640 1 -- 172.21.15.78:0/2210841698 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3d18143770 msgr2=0x7f3d1812f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:10.898 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.893+0000 7f3d16ffd640 1 --2- 172.21.15.78:0/2210841698 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3d18143770 0x7f3d1812f930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:10.898 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.893+0000 7f3d16ffd640 1 -- 172.21.15.78:0/2210841698 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d080094d0 con 0x7f3d180b2280 2023-12-12T10:13:10.898 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.893+0000 7f3d16ffd640 1 --2- 172.21.15.78:0/2210841698 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d180b2280 0x7f3d18132960 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f3d0c00d800 tx=0x7f3d0c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:10.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.893+0000 7f3cfffff640 1 -- 172.21.15.78:0/2210841698 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d0c00b6c0 con 0x7f3d180b2280 2023-12-12T10:13:10.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.893+0000 7f3cfffff640 1 -- 172.21.15.78:0/2210841698 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d0c00b820 con 0x7f3d180b2280 2023-12-12T10:13:10.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.893+0000 7f3cfffff640 1 -- 172.21.15.78:0/2210841698 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d0c00bb90 con 0x7f3d180b2280 2023-12-12T10:13:10.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.893+0000 7f3d1dc17640 1 -- 172.21.15.78:0/2210841698 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d180af2f0 con 0x7f3d180b2280 2023-12-12T10:13:10.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.893+0000 7f3d1dc17640 1 -- 172.21.15.78:0/2210841698 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d18159a40 con 0x7f3d180b2280 2023-12-12T10:13:10.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.893+0000 7f3d1dc17640 1 -- 172.21.15.78:0/2210841698 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d180671f0 con 0x7f3d180b2280 2023-12-12T10:13:10.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.897+0000 7f3cfffff640 1 -- 172.21.15.78:0/2210841698 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3d0c00bcf0 con 0x7f3d180b2280 2023-12-12T10:13:10.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.897+0000 7f3cfffff640 1 --2- 172.21.15.78:0/2210841698 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f3d04066470 0x7f3d04068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:10.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.897+0000 7f3cfffff640 1 -- 172.21.15.78:0/2210841698 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f3d0c084620 con 0x7f3d180b2280 2023-12-12T10:13:10.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.897+0000 7f3d177fe640 1 --2- 172.21.15.78:0/2210841698 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f3d04066470 0x7f3d04068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:10.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.897+0000 7f3d177fe640 1 --2- 172.21.15.78:0/2210841698 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f3d04066470 0x7f3d04068930 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f3d080ae000 tx=0x7f3d080a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:10.904 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:10.901+0000 7f3cfffff640 1 -- 172.21.15.78:0/2210841698 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3d0c051780 con 0x7f3d180b2280 2023-12-12T10:13:11.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.049+0000 7f3d1dc17640 1 -- 172.21.15.78:0/2210841698 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3d18067530 con 0x7f3d180b2280 2023-12-12T10:13:11.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.053+0000 7f3cfffff640 1 -- 172.21.15.78:0/2210841698 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3d0c054da0 con 0x7f3d180b2280 2023-12-12T10:13:11.056 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2023-12-12T10:13:11.057 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.053+0000 7f3d1dc17640 1 -- 172.21.15.78:0/2210841698 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f3d04066470 msgr2=0x7f3d04068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:11.057 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.053+0000 7f3d1dc17640 1 --2- 172.21.15.78:0/2210841698 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f3d04066470 0x7f3d04068930 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f3d080ae000 tx=0x7f3d080a7000 comp rx=0 tx=0).stop 2023-12-12T10:13:11.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.053+0000 7f3d1dc17640 1 -- 172.21.15.78:0/2210841698 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d180b2280 msgr2=0x7f3d18132960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:11.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.053+0000 7f3d1dc17640 1 --2- 172.21.15.78:0/2210841698 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d180b2280 0x7f3d18132960 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f3d0c00d800 tx=0x7f3d0c00dcc0 comp rx=0 tx=0).stop 2023-12-12T10:13:11.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.053+0000 7f3d1dc17640 1 -- 172.21.15.78:0/2210841698 shutdown_connections 2023-12-12T10:13:11.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.053+0000 7f3d1dc17640 1 --2- 172.21.15.78:0/2210841698 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f3d04066470 0x7f3d04068930 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:11.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.053+0000 7f3d1dc17640 1 --2- 172.21.15.78:0/2210841698 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3d18143770 0x7f3d1812f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:11.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.053+0000 7f3d1dc17640 1 --2- 172.21.15.78:0/2210841698 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d180b2280 0x7f3d18132960 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:11.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.053+0000 7f3d1dc17640 1 --2- 172.21.15.78:0/2210841698 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3d180b1e20 0x7f3d18130a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:11.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.053+0000 7f3d1dc17640 1 -- 172.21.15.78:0/2210841698 >> 172.21.15.78:0/2210841698 conn(0x7f3d1806a710 msgr2=0x7f3d18137e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:11.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.053+0000 7f3d1dc17640 1 -- 172.21.15.78:0/2210841698 shutdown_connections 2023-12-12T10:13:11.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.053+0000 7f3d1dc17640 1 -- 172.21.15.78:0/2210841698 wait complete. 2023-12-12T10:13:11.077 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-12T10:13:11.219 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.213+0000 7f999352a640 1 Processor -- start 2023-12-12T10:13:11.219 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.213+0000 7f999352a640 1 -- start start 2023-12-12T10:13:11.221 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.217+0000 7f999352a640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f998c0cb4b0 0x7f998c15f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:11.221 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.217+0000 7f999352a640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f998c15baa0 0x7f998c06cc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:11.221 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.217+0000 7f999352a640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f998c0cea30 con 0x7f998c06c850 2023-12-12T10:13:11.221 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.217+0000 7f999352a640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f998c06d1d0 con 0x7f998c15baa0 2023-12-12T10:13:11.221 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.217+0000 7f999352a640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f998c15bfc0 con 0x7f998c0cb4b0 2023-12-12T10:13:11.221 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.217+0000 7f9991ac7640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f998c15baa0 0x7f998c06cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:11.221 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.217+0000 7f9991ac7640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f998c15baa0 0x7f998c06cc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:44542/0 (socket says 172.21.15.78:44542) 2023-12-12T10:13:11.221 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.217+0000 7f9991ac7640 1 -- 172.21.15.78:0/1146641640 learned_addr learned my addr 172.21.15.78:0/1146641640 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:13:11.221 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.217+0000 7f99912c6640 1 --2- 172.21.15.78:0/1146641640 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f998c0cb4b0 0x7f998c15f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:11.222 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.217+0000 7f9991ac7640 1 -- 172.21.15.78:0/1146641640 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f998c0cb4b0 msgr2=0x7f998c15f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:13:11.222 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.217+0000 7f9991ac7640 1 --2- 172.21.15.78:0/1146641640 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f998c0cb4b0 0x7f998c15f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:11.222 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.217+0000 7f9991ac7640 1 -- 172.21.15.78:0/1146641640 >> v1:172.21.15.187:6789/0 conn(0x7f998c06c850 legacy=0x7f998c15b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:11.222 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.217+0000 7f9991ac7640 1 -- 172.21.15.78:0/1146641640 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f998c15c2a0 con 0x7f998c15baa0 2023-12-12T10:13:11.226 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.221+0000 7f9991ac7640 1 --2- 172.21.15.78:0/1146641640 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f998c15baa0 0x7f998c06cc90 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f9984009e50 tx=0x7f998401c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5d75fc2a645f39e server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:11.226 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.221+0000 7f9983fff640 1 -- 172.21.15.78:0/1146641640 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99840a5810 con 0x7f998c15baa0 2023-12-12T10:13:11.226 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.221+0000 7f9983fff640 1 -- 172.21.15.78:0/1146641640 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99840a5970 con 0x7f998c15baa0 2023-12-12T10:13:11.227 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.221+0000 7f9983fff640 1 -- 172.21.15.78:0/1146641640 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99840a5d00 con 0x7f998c15baa0 2023-12-12T10:13:11.227 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.221+0000 7f999352a640 1 -- 172.21.15.78:0/1146641640 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f998c15baa0 msgr2=0x7f998c06cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:11.227 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.221+0000 7f999352a640 1 --2- 172.21.15.78:0/1146641640 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f998c15baa0 0x7f998c06cc90 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f9984009e50 tx=0x7f998401c950 comp rx=0 tx=0).stop 2023-12-12T10:13:11.227 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.221+0000 7f999352a640 1 -- 172.21.15.78:0/1146641640 shutdown_connections 2023-12-12T10:13:11.227 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.221+0000 7f999352a640 1 --2- 172.21.15.78:0/1146641640 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f998c15baa0 0x7f998c06cc90 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:11.227 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.221+0000 7f999352a640 1 --2- 172.21.15.78:0/1146641640 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f998c0cb4b0 0x7f998c15f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:11.227 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.221+0000 7f999352a640 1 -- 172.21.15.78:0/1146641640 >> 172.21.15.78:0/1146641640 conn(0x7f998c06a710 msgr2=0x7f998c06ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:11.227 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.221+0000 7f999352a640 1 -- 172.21.15.78:0/1146641640 shutdown_connections 2023-12-12T10:13:11.227 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.221+0000 7f999352a640 1 -- 172.21.15.78:0/1146641640 wait complete. 2023-12-12T10:13:11.227 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.221+0000 7f999352a640 1 Processor -- start 2023-12-12T10:13:11.227 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.221+0000 7f999352a640 1 -- start start 2023-12-12T10:13:11.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.225+0000 7f999352a640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f998c06c850 0x7f998c1553c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:11.229 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.225+0000 7f999352a640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f998c0cb4b0 0x7f998c145b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:11.229 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.225+0000 7f999352a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f998c15baa0 0x7f998c14eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:11.229 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.225+0000 7f999352a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f998c152b10 con 0x7f998c15baa0 2023-12-12T10:13:11.229 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.225+0000 7f999352a640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f998c1460d0 con 0x7f998c0cb4b0 2023-12-12T10:13:11.229 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.225+0000 7f999352a640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f998c14f3f0 con 0x7f998c06c850 2023-12-12T10:13:11.229 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.225+0000 7f9991ac7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f998c15baa0 0x7f998c14eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:11.229 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.225+0000 7f9991ac7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f998c15baa0 0x7f998c14eeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:44556/0 (socket says 172.21.15.78:44556) 2023-12-12T10:13:11.229 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.225+0000 7f9991ac7640 1 -- 172.21.15.78:0/2316782621 learned_addr learned my addr 172.21.15.78:0/2316782621 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:13:11.229 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.225+0000 7f99912c6640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f998c06c850 0x7f998c1553c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:11.229 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.225+0000 7f9990ac5640 1 --2- 172.21.15.78:0/2316782621 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f998c0cb4b0 0x7f998c145b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:11.229 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.225+0000 7f9991ac7640 1 -- 172.21.15.78:0/2316782621 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f998c06c850 msgr2=0x7f998c1553c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:11.229 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.225+0000 7f9991ac7640 1 --2- 172.21.15.78:0/2316782621 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f998c06c850 0x7f998c1553c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:11.229 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.225+0000 7f9991ac7640 1 -- 172.21.15.78:0/2316782621 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f998c0cb4b0 msgr2=0x7f998c145b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:11.230 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.225+0000 7f9991ac7640 1 --2- 172.21.15.78:0/2316782621 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f998c0cb4b0 0x7f998c145b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:11.230 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.225+0000 7f9991ac7640 1 -- 172.21.15.78:0/2316782621 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9984009b30 con 0x7f998c15baa0 2023-12-12T10:13:11.230 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.225+0000 7f9991ac7640 1 --2- 172.21.15.78:0/2316782621 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f998c15baa0 0x7f998c14eeb0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f99840af040 tx=0x7f99840196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:11.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.225+0000 7f9981ffb640 1 -- 172.21.15.78:0/2316782621 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99840b8640 con 0x7f998c15baa0 2023-12-12T10:13:11.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.225+0000 7f9981ffb640 1 -- 172.21.15.78:0/2316782621 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99840b87a0 con 0x7f998c15baa0 2023-12-12T10:13:11.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.225+0000 7f999352a640 1 -- 172.21.15.78:0/2316782621 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f998c152550 con 0x7f998c15baa0 2023-12-12T10:13:11.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.225+0000 7f9981ffb640 1 -- 172.21.15.78:0/2316782621 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99840b8b10 con 0x7f998c15baa0 2023-12-12T10:13:11.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.225+0000 7f999352a640 1 -- 172.21.15.78:0/2316782621 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f998c154bc0 con 0x7f998c15baa0 2023-12-12T10:13:11.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.225+0000 7f999352a640 1 -- 172.21.15.78:0/2316782621 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f998c0671f0 con 0x7f998c15baa0 2023-12-12T10:13:11.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.229+0000 7f9981ffb640 1 -- 172.21.15.78:0/2316782621 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f99840b8c70 con 0x7f998c15baa0 2023-12-12T10:13:11.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.229+0000 7f9981ffb640 1 --2- 172.21.15.78:0/2316782621 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f9970066470 0x7f9970068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:11.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.229+0000 7f9981ffb640 1 -- 172.21.15.78:0/2316782621 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f998411f380 con 0x7f998c15baa0 2023-12-12T10:13:11.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.229+0000 7f99912c6640 1 --2- 172.21.15.78:0/2316782621 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f9970066470 0x7f9970068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:11.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.229+0000 7f99912c6640 1 --2- 172.21.15.78:0/2316782621 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f9970066470 0x7f9970068930 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f9988009b60 tx=0x7f9988009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:11.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.233+0000 7f9981ffb640 1 -- 172.21.15.78:0/2316782621 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f99840ec560 con 0x7f998c15baa0 2023-12-12T10:13:11.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.385+0000 7f999352a640 1 -- 172.21.15.78:0/2316782621 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f998c154a20 con 0x7f998c15baa0 2023-12-12T10:13:11.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.385+0000 7f9981ffb640 1 -- 172.21.15.78:0/2316782621 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f998c154a20 con 0x7f998c15baa0 2023-12-12T10:13:11.388 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2023-12-12T10:13:11.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.385+0000 7f999352a640 1 -- 172.21.15.78:0/2316782621 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f9970066470 msgr2=0x7f9970068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:11.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.385+0000 7f999352a640 1 --2- 172.21.15.78:0/2316782621 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f9970066470 0x7f9970068930 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f9988009b60 tx=0x7f9988009190 comp rx=0 tx=0).stop 2023-12-12T10:13:11.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.385+0000 7f999352a640 1 -- 172.21.15.78:0/2316782621 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f998c15baa0 msgr2=0x7f998c14eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:11.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.385+0000 7f999352a640 1 --2- 172.21.15.78:0/2316782621 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f998c15baa0 0x7f998c14eeb0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f99840af040 tx=0x7f99840196f0 comp rx=0 tx=0).stop 2023-12-12T10:13:11.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.385+0000 7f999352a640 1 -- 172.21.15.78:0/2316782621 shutdown_connections 2023-12-12T10:13:11.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.385+0000 7f999352a640 1 --2- 172.21.15.78:0/2316782621 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f9970066470 0x7f9970068930 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:11.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.385+0000 7f999352a640 1 --2- 172.21.15.78:0/2316782621 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f998c15baa0 0x7f998c14eeb0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:11.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.385+0000 7f999352a640 1 --2- 172.21.15.78:0/2316782621 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f998c0cb4b0 0x7f998c145b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:11.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.385+0000 7f999352a640 1 --2- 172.21.15.78:0/2316782621 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f998c06c850 0x7f998c1553c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:11.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.385+0000 7f999352a640 1 -- 172.21.15.78:0/2316782621 >> 172.21.15.78:0/2316782621 conn(0x7f998c06a710 msgr2=0x7f998c0721d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:11.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.385+0000 7f999352a640 1 -- 172.21.15.78:0/2316782621 shutdown_connections 2023-12-12T10:13:11.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.385+0000 7f999352a640 1 -- 172.21.15.78:0/2316782621 wait complete. 2023-12-12T10:13:11.409 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-12T10:13:11.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.545+0000 7f83b5c79640 1 Processor -- start 2023-12-12T10:13:11.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.545+0000 7f83b5c79640 1 -- start start 2023-12-12T10:13:11.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.549+0000 7f83b5c79640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f83b00b2b50 0x7f83b006cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:11.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.549+0000 7f83b5c79640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f83b00ce490 0x7f83b006d530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:11.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.549+0000 7f83b5c79640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83b00b1e20 con 0x7f83b0153ab0 2023-12-12T10:13:11.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.549+0000 7f83b5c79640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83b00cea00 con 0x7f83b00ce490 2023-12-12T10:13:11.552 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.549+0000 7f83b5c79640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83b00b2070 con 0x7f83b00b2b50 2023-12-12T10:13:11.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.549+0000 7f83affff640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f83b00ce490 0x7f83b006d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:11.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.549+0000 7f83a7fff640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f83b00b2b50 0x7f83b006cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:11.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.549+0000 7f83affff640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f83b00ce490 0x7f83b006d530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.78:45516/0 (socket says 172.21.15.78:45516) 2023-12-12T10:13:11.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.549+0000 7f83affff640 1 -- 172.21.15.78:0/3054466346 learned_addr learned my addr 172.21.15.78:0/3054466346 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:13:11.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.549+0000 7f83a7fff640 1 -- 172.21.15.78:0/3054466346 >> v2:172.21.15.187:3300/0 conn(0x7f83b00ce490 msgr2=0x7f83b006d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:13:11.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.549+0000 7f83a7fff640 1 --2- 172.21.15.78:0/3054466346 >> v2:172.21.15.187:3300/0 conn(0x7f83b00ce490 0x7f83b006d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:11.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.549+0000 7f83a7fff640 1 -- 172.21.15.78:0/3054466346 >> v1:172.21.15.187:6789/0 conn(0x7f83b0153ab0 legacy=0x7f83b015a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:11.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.549+0000 7f83a7fff640 1 -- 172.21.15.78:0/3054466346 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83b00b2350 con 0x7f83b00b2b50 2023-12-12T10:13:11.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.553+0000 7f83a7fff640 1 --2- 172.21.15.78:0/3054466346 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f83b00b2b50 0x7f83b006cff0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f83980097c0 tx=0x7f839801c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a79250694f73b26d server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:11.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.553+0000 7f83aeffd640 1 -- 172.21.15.78:0/3054466346 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83980ab600 con 0x7f83b00b2b50 2023-12-12T10:13:11.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.553+0000 7f83aeffd640 1 -- 172.21.15.78:0/3054466346 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83980a7050 con 0x7f83b00b2b50 2023-12-12T10:13:11.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.553+0000 7f83aeffd640 1 -- 172.21.15.78:0/3054466346 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83980ab980 con 0x7f83b00b2b50 2023-12-12T10:13:11.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.553+0000 7f83b5c79640 1 -- 172.21.15.78:0/3054466346 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f83b00b2b50 msgr2=0x7f83b006cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:11.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.553+0000 7f83b5c79640 1 --2- 172.21.15.78:0/3054466346 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f83b00b2b50 0x7f83b006cff0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f83980097c0 tx=0x7f839801c3c0 comp rx=0 tx=0).stop 2023-12-12T10:13:11.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.553+0000 7f83b5c79640 1 -- 172.21.15.78:0/3054466346 shutdown_connections 2023-12-12T10:13:11.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.553+0000 7f83b5c79640 1 --2- 172.21.15.78:0/3054466346 >> v2:172.21.15.187:3300/0 conn(0x7f83b00ce490 0x7f83b006d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:11.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.553+0000 7f83b5c79640 1 --2- 172.21.15.78:0/3054466346 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f83b00b2b50 0x7f83b006cff0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:11.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.553+0000 7f83b5c79640 1 -- 172.21.15.78:0/3054466346 >> 172.21.15.78:0/3054466346 conn(0x7f83b006a710 msgr2=0x7f83b006ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:11.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.553+0000 7f83b5c79640 1 -- 172.21.15.78:0/3054466346 shutdown_connections 2023-12-12T10:13:11.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.553+0000 7f83b5c79640 1 -- 172.21.15.78:0/3054466346 wait complete. 2023-12-12T10:13:11.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.553+0000 7f83b5c79640 1 Processor -- start 2023-12-12T10:13:11.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.553+0000 7f83b5c79640 1 -- start start 2023-12-12T10:13:11.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.553+0000 7f83b5c79640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83b00b2b50 0x7f83b0143240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:11.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.557+0000 7f83b5c79640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f83b00ce490 0x7f83b0147d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:11.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.557+0000 7f83b5c79640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f83b0153ab0 0x7f83b014ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:11.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.557+0000 7f83b5c79640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83b01483d0 con 0x7f83b00b2b50 2023-12-12T10:13:11.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.557+0000 7f83b5c79640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83b01486b0 con 0x7f83b0153ab0 2023-12-12T10:13:11.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.557+0000 7f83b5c79640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83b0148990 con 0x7f83b00ce490 2023-12-12T10:13:11.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.557+0000 7f83af7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83b00b2b50 0x7f83b0143240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:11.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.557+0000 7f83af7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83b00b2b50 0x7f83b0143240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:44560/0 (socket says 172.21.15.78:44560) 2023-12-12T10:13:11.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.557+0000 7f83af7fe640 1 -- 172.21.15.78:0/3083683386 learned_addr learned my addr 172.21.15.78:0/3083683386 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:13:11.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.557+0000 7f83a7fff640 1 --2- 172.21.15.78:0/3083683386 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f83b00ce490 0x7f83b0147d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:11.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.557+0000 7f83affff640 1 --2- 172.21.15.78:0/3083683386 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f83b0153ab0 0x7f83b014ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:11.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.557+0000 7f83af7fe640 1 -- 172.21.15.78:0/3083683386 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f83b00ce490 msgr2=0x7f83b0147d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:11.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.557+0000 7f83af7fe640 1 --2- 172.21.15.78:0/3083683386 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f83b00ce490 0x7f83b0147d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:11.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.557+0000 7f83af7fe640 1 -- 172.21.15.78:0/3083683386 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f83b0153ab0 msgr2=0x7f83b014ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:11.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.557+0000 7f83af7fe640 1 --2- 172.21.15.78:0/3083683386 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f83b0153ab0 0x7f83b014ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:11.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.557+0000 7f83af7fe640 1 -- 172.21.15.78:0/3083683386 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8398009420 con 0x7f83b00b2b50 2023-12-12T10:13:11.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.557+0000 7f83af7fe640 1 --2- 172.21.15.78:0/3083683386 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83b00b2b50 0x7f83b0143240 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f83a000c3c0 tx=0x7f83a000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:11.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.557+0000 7f83acff9640 1 -- 172.21.15.78:0/3083683386 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83a00052d0 con 0x7f83b00b2b50 2023-12-12T10:13:11.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.557+0000 7f83acff9640 1 -- 172.21.15.78:0/3083683386 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83a0005430 con 0x7f83b00b2b50 2023-12-12T10:13:11.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.557+0000 7f83acff9640 1 -- 172.21.15.78:0/3083683386 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83a0003840 con 0x7f83b00b2b50 2023-12-12T10:13:11.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.557+0000 7f83b5c79640 1 -- 172.21.15.78:0/3083683386 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83b0148c70 con 0x7f83b00b2b50 2023-12-12T10:13:11.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.557+0000 7f83b5c79640 1 -- 172.21.15.78:0/3083683386 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83b0149470 con 0x7f83b00b2b50 2023-12-12T10:13:11.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.557+0000 7f83b5c79640 1 -- 172.21.15.78:0/3083683386 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83b00671f0 con 0x7f83b00b2b50 2023-12-12T10:13:11.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.557+0000 7f83acff9640 1 -- 172.21.15.78:0/3083683386 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f83a00039a0 con 0x7f83b00b2b50 2023-12-12T10:13:11.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.561+0000 7f83acff9640 1 --2- 172.21.15.78:0/3083683386 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f8390066470 0x7f8390068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:11.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.561+0000 7f83acff9640 1 -- 172.21.15.78:0/3083683386 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f83a0083780 con 0x7f83b00b2b50 2023-12-12T10:13:11.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.561+0000 7f83a7fff640 1 --2- 172.21.15.78:0/3083683386 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f8390066470 0x7f8390068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:11.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.561+0000 7f83a7fff640 1 --2- 172.21.15.78:0/3083683386 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f8390066470 0x7f8390068930 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f83980ad000 tx=0x7f8398008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:11.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.565+0000 7f83acff9640 1 -- 172.21.15.78:0/3083683386 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f83a0050850 con 0x7f83b00b2b50 2023-12-12T10:13:11.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.713+0000 7f83b5c79640 1 -- 172.21.15.78:0/3083683386 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f83b0067530 con 0x7f83b00b2b50 2023-12-12T10:13:11.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.713+0000 7f83acff9640 1 -- 172.21.15.78:0/3083683386 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f83a0053e70 con 0x7f83b00b2b50 2023-12-12T10:13:11.718 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2023-12-12T10:13:11.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.717+0000 7f83b5c79640 1 -- 172.21.15.78:0/3083683386 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f8390066470 msgr2=0x7f8390068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:11.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.717+0000 7f83b5c79640 1 --2- 172.21.15.78:0/3083683386 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f8390066470 0x7f8390068930 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f83980ad000 tx=0x7f8398008040 comp rx=0 tx=0).stop 2023-12-12T10:13:11.720 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.717+0000 7f83b5c79640 1 -- 172.21.15.78:0/3083683386 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83b00b2b50 msgr2=0x7f83b0143240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:11.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.717+0000 7f83b5c79640 1 --2- 172.21.15.78:0/3083683386 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83b00b2b50 0x7f83b0143240 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f83a000c3c0 tx=0x7f83a000c880 comp rx=0 tx=0).stop 2023-12-12T10:13:11.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.717+0000 7f83b5c79640 1 -- 172.21.15.78:0/3083683386 shutdown_connections 2023-12-12T10:13:11.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.717+0000 7f83b5c79640 1 --2- 172.21.15.78:0/3083683386 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f8390066470 0x7f8390068930 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:11.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.717+0000 7f83b5c79640 1 --2- 172.21.15.78:0/3083683386 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f83b0153ab0 0x7f83b014ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:11.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.717+0000 7f83b5c79640 1 --2- 172.21.15.78:0/3083683386 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f83b00ce490 0x7f83b0147d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:11.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.717+0000 7f83b5c79640 1 --2- 172.21.15.78:0/3083683386 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f83b00b2b50 0x7f83b0143240 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:11.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.717+0000 7f83b5c79640 1 -- 172.21.15.78:0/3083683386 >> 172.21.15.78:0/3083683386 conn(0x7f83b006a710 msgr2=0x7f83b006aaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:11.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.717+0000 7f83b5c79640 1 -- 172.21.15.78:0/3083683386 shutdown_connections 2023-12-12T10:13:11.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.717+0000 7f83b5c79640 1 -- 172.21.15.78:0/3083683386 wait complete. 2023-12-12T10:13:11.739 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-12T10:13:11.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.873+0000 7f8df84c9640 1 Processor -- start 2023-12-12T10:13:11.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.873+0000 7f8df84c9640 1 -- start start 2023-12-12T10:13:11.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.877+0000 7f8df84c9640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8df006cf60 0x7f8df015f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:11.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.877+0000 7f8df84c9640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8df015b390 0x7f8df015b810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:11.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.877+0000 7f8df84c9640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8df00cea30 con 0x7f8df00cb4b0 2023-12-12T10:13:11.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.877+0000 7f8df84c9640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8df015bd50 con 0x7f8df006cf60 2023-12-12T10:13:11.881 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.877+0000 7f8df84c9640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8df015bfc0 con 0x7f8df015b390 2023-12-12T10:13:11.881 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.877+0000 7f8df5a64640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8df006cf60 0x7f8df015f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:11.881 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.877+0000 7f8df5a64640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8df006cf60 0x7f8df015f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:44574/0 (socket says 172.21.15.78:44574) 2023-12-12T10:13:11.881 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.877+0000 7f8df5a64640 1 -- 172.21.15.78:0/3947848818 learned_addr learned my addr 172.21.15.78:0/3947848818 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:13:11.881 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.877+0000 7f8df6a66640 1 --2- 172.21.15.78:0/3947848818 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8df015b390 0x7f8df015b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:11.881 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.877+0000 7f8df5a64640 1 -- 172.21.15.78:0/3947848818 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8df015b390 msgr2=0x7f8df015b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:13:11.881 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.877+0000 7f8df5a64640 1 --2- 172.21.15.78:0/3947848818 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8df015b390 0x7f8df015b810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:11.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.877+0000 7f8df5a64640 1 -- 172.21.15.78:0/3947848818 >> v1:172.21.15.187:6789/0 conn(0x7f8df00cb4b0 legacy=0x7f8df006c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:11.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.877+0000 7f8df5a64640 1 -- 172.21.15.78:0/3947848818 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8df015c2a0 con 0x7f8df006cf60 2023-12-12T10:13:11.883 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.881+0000 7f8df5a64640 1 --2- 172.21.15.78:0/3947848818 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8df006cf60 0x7f8df015f500 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f8de0009870 tx=0x7f8de001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2244064436df421a server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:11.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.881+0000 7f8df5263640 1 -- 172.21.15.78:0/3947848818 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8de00ab680 con 0x7f8df006cf60 2023-12-12T10:13:11.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.881+0000 7f8df5263640 1 -- 172.21.15.78:0/3947848818 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8de00ab7e0 con 0x7f8df006cf60 2023-12-12T10:13:11.884 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.881+0000 7f8df5263640 1 -- 172.21.15.78:0/3947848818 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8de00abb70 con 0x7f8df006cf60 2023-12-12T10:13:11.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.881+0000 7f8df84c9640 1 -- 172.21.15.78:0/3947848818 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8df006cf60 msgr2=0x7f8df015f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:11.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.881+0000 7f8df84c9640 1 --2- 172.21.15.78:0/3947848818 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8df006cf60 0x7f8df015f500 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f8de0009870 tx=0x7f8de001c480 comp rx=0 tx=0).stop 2023-12-12T10:13:11.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.881+0000 7f8df84c9640 1 -- 172.21.15.78:0/3947848818 shutdown_connections 2023-12-12T10:13:11.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.881+0000 7f8df84c9640 1 --2- 172.21.15.78:0/3947848818 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8df015b390 0x7f8df015b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:11.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.881+0000 7f8df84c9640 1 --2- 172.21.15.78:0/3947848818 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8df006cf60 0x7f8df015f500 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:11.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.881+0000 7f8df84c9640 1 -- 172.21.15.78:0/3947848818 >> 172.21.15.78:0/3947848818 conn(0x7f8df006a710 msgr2=0x7f8df006ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:11.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.881+0000 7f8df84c9640 1 -- 172.21.15.78:0/3947848818 shutdown_connections 2023-12-12T10:13:11.885 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.881+0000 7f8df84c9640 1 -- 172.21.15.78:0/3947848818 wait complete. 2023-12-12T10:13:11.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.881+0000 7f8df84c9640 1 Processor -- start 2023-12-12T10:13:11.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.881+0000 7f8df84c9640 1 -- start start 2023-12-12T10:13:11.888 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.885+0000 7f8df84c9640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8df006cf60 0x7f8df0149bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:11.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.885+0000 7f8df84c9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8df00cb4b0 0x7f8df01504e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:11.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.885+0000 7f8df84c9640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8df015b390 0x7f8df00b0b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:11.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.885+0000 7f8df84c9640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8df0152ca0 con 0x7f8df00cb4b0 2023-12-12T10:13:11.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.885+0000 7f8df84c9640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8df0151280 con 0x7f8df015b390 2023-12-12T10:13:11.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.885+0000 7f8df84c9640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8df0150fa0 con 0x7f8df006cf60 2023-12-12T10:13:11.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.885+0000 7f8df5a64640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8df00cb4b0 0x7f8df01504e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:11.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.885+0000 7f8df5a64640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8df00cb4b0 0x7f8df01504e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:44590/0 (socket says 172.21.15.78:44590) 2023-12-12T10:13:11.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.885+0000 7f8df5a64640 1 -- 172.21.15.78:0/1063539295 learned_addr learned my addr 172.21.15.78:0/1063539295 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:13:11.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.885+0000 7f8df6a66640 1 --2- 172.21.15.78:0/1063539295 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8df015b390 0x7f8df00b0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:11.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.885+0000 7f8df6265640 1 --2- 172.21.15.78:0/1063539295 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8df006cf60 0x7f8df0149bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:11.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.885+0000 7f8df5a64640 1 -- 172.21.15.78:0/1063539295 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8df006cf60 msgr2=0x7f8df0149bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:11.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.885+0000 7f8df5a64640 1 --2- 172.21.15.78:0/1063539295 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8df006cf60 0x7f8df0149bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:11.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.885+0000 7f8df5a64640 1 -- 172.21.15.78:0/1063539295 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8df015b390 msgr2=0x7f8df00b0b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:11.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.885+0000 7f8df5a64640 1 --2- 172.21.15.78:0/1063539295 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8df015b390 0x7f8df00b0b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:11.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.885+0000 7f8df5a64640 1 -- 172.21.15.78:0/1063539295 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8de00094d0 con 0x7f8df00cb4b0 2023-12-12T10:13:11.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.885+0000 7f8df6a66640 1 --2- 172.21.15.78:0/1063539295 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8df015b390 0x7f8df00b0b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T10:13:11.890 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.885+0000 7f8df5a64640 1 --2- 172.21.15.78:0/1063539295 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8df00cb4b0 0x7f8df01504e0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f8de001a0b0 tx=0x7f8de001acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:11.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.885+0000 7f8de6ffd640 1 -- 172.21.15.78:0/1063539295 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8de00b4800 con 0x7f8df00cb4b0 2023-12-12T10:13:11.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.885+0000 7f8de6ffd640 1 -- 172.21.15.78:0/1063539295 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8de00b4960 con 0x7f8df00cb4b0 2023-12-12T10:13:11.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.885+0000 7f8de6ffd640 1 -- 172.21.15.78:0/1063539295 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8de00b4d10 con 0x7f8df00cb4b0 2023-12-12T10:13:11.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.885+0000 7f8df84c9640 1 -- 172.21.15.78:0/1063539295 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8df01525e0 con 0x7f8df00cb4b0 2023-12-12T10:13:11.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.885+0000 7f8df84c9640 1 -- 172.21.15.78:0/1063539295 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8df014ac60 con 0x7f8df00cb4b0 2023-12-12T10:13:11.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.885+0000 7f8df84c9640 1 -- 172.21.15.78:0/1063539295 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8df00671f0 con 0x7f8df00cb4b0 2023-12-12T10:13:11.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.885+0000 7f8de6ffd640 1 -- 172.21.15.78:0/1063539295 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f8de00c7440 con 0x7f8df00cb4b0 2023-12-12T10:13:11.892 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.889+0000 7f8de6ffd640 1 --2- 172.21.15.78:0/1063539295 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f8dd4066470 0x7f8dd4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:11.892 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.889+0000 7f8de6ffd640 1 -- 172.21.15.78:0/1063539295 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f8de011eff0 con 0x7f8df00cb4b0 2023-12-12T10:13:11.892 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.889+0000 7f8df6265640 1 --2- 172.21.15.78:0/1063539295 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f8dd4066470 0x7f8dd4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:11.892 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.889+0000 7f8df6265640 1 --2- 172.21.15.78:0/1063539295 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f8dd4066470 0x7f8dd4068930 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f8dec007fd0 tx=0x7f8dec009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:11.895 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:11.893+0000 7f8de6ffd640 1 -- 172.21.15.78:0/1063539295 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8de00ec190 con 0x7f8df00cb4b0 2023-12-12T10:13:12.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.041+0000 7f8df84c9640 1 -- 172.21.15.78:0/1063539295 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f8df0152de0 con 0x7f8df00cb4b0 2023-12-12T10:13:12.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.041+0000 7f8de6ffd640 1 -- 172.21.15.78:0/1063539295 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f8df0152de0 con 0x7f8df00cb4b0 2023-12-12T10:13:12.047 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2023-12-12T10:13:12.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.045+0000 7f8df84c9640 1 -- 172.21.15.78:0/1063539295 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f8dd4066470 msgr2=0x7f8dd4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:12.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.045+0000 7f8df84c9640 1 --2- 172.21.15.78:0/1063539295 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f8dd4066470 0x7f8dd4068930 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f8dec007fd0 tx=0x7f8dec009040 comp rx=0 tx=0).stop 2023-12-12T10:13:12.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.045+0000 7f8df84c9640 1 -- 172.21.15.78:0/1063539295 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8df00cb4b0 msgr2=0x7f8df01504e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:12.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.045+0000 7f8df84c9640 1 --2- 172.21.15.78:0/1063539295 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8df00cb4b0 0x7f8df01504e0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f8de001a0b0 tx=0x7f8de001acc0 comp rx=0 tx=0).stop 2023-12-12T10:13:12.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.045+0000 7f8df84c9640 1 -- 172.21.15.78:0/1063539295 shutdown_connections 2023-12-12T10:13:12.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.045+0000 7f8df84c9640 1 --2- 172.21.15.78:0/1063539295 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f8dd4066470 0x7f8dd4068930 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:12.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.045+0000 7f8df84c9640 1 --2- 172.21.15.78:0/1063539295 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8df015b390 0x7f8df00b0b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:12.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.045+0000 7f8df84c9640 1 --2- 172.21.15.78:0/1063539295 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8df00cb4b0 0x7f8df01504e0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:12.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.045+0000 7f8df84c9640 1 --2- 172.21.15.78:0/1063539295 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8df006cf60 0x7f8df0149bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:12.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.045+0000 7f8df84c9640 1 -- 172.21.15.78:0/1063539295 >> 172.21.15.78:0/1063539295 conn(0x7f8df006a710 msgr2=0x7f8df0151be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:12.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.045+0000 7f8df84c9640 1 -- 172.21.15.78:0/1063539295 shutdown_connections 2023-12-12T10:13:12.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.045+0000 7f8df84c9640 1 -- 172.21.15.78:0/1063539295 wait complete. 2023-12-12T10:13:12.068 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-12T10:13:12.208 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.205+0000 7ff76f11d640 1 Processor -- start 2023-12-12T10:13:12.208 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.205+0000 7ff76f11d640 1 -- start start 2023-12-12T10:13:12.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.205+0000 7ff76f11d640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff7680cdf60 0x7ff768070f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:12.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.205+0000 7ff76f11d640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7ff768071440 0x7ff76815d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:12.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.205+0000 7ff76f11d640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff768070a70 con 0x7ff768143770 2023-12-12T10:13:12.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.205+0000 7ff76f11d640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7680ce3c0 con 0x7ff768071440 2023-12-12T10:13:12.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.205+0000 7ff76f11d640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7680718b0 con 0x7ff7680cdf60 2023-12-12T10:13:12.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.205+0000 7ff76ceb9640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7ff768143770 0x7ff7680b1e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:35584/0 (socket says 172.21.15.78:35584) 2023-12-12T10:13:12.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.205+0000 7ff76ceb9640 1 -- 172.21.15.78:0/539565713 learned_addr learned my addr 172.21.15.78:0/539565713 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-12-12T10:13:12.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.205+0000 7ff767fff640 1 --2- 172.21.15.78:0/539565713 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff7680cdf60 0x7ff768070f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:12.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.205+0000 7ff76d6ba640 1 --2- 172.21.15.78:0/539565713 >> v2:172.21.15.187:3300/0 conn(0x7ff768071440 0x7ff76815d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:12.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.205+0000 7ff7677fe640 1 -- 172.21.15.78:0/539565713 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2752402012 0 0) 0x7ff768070a70 con 0x7ff768143770 2023-12-12T10:13:12.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.205+0000 7ff7677fe640 1 -- 172.21.15.78:0/539565713 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff758003530 con 0x7ff768143770 2023-12-12T10:13:12.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.205+0000 7ff7677fe640 1 -- 172.21.15.78:0/539565713 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2754206928 0 0) 0x7ff758003530 con 0x7ff768143770 2023-12-12T10:13:12.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.205+0000 7ff7677fe640 1 -- 172.21.15.78:0/539565713 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff7680cdf60 msgr2=0x7ff768070f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:13:12.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.205+0000 7ff7677fe640 1 --2- 172.21.15.78:0/539565713 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff7680cdf60 0x7ff768070f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:12.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.205+0000 7ff7677fe640 1 -- 172.21.15.78:0/539565713 >> v2:172.21.15.187:3300/0 conn(0x7ff768071440 msgr2=0x7ff76815d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:13:12.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.205+0000 7ff7677fe640 1 --2- 172.21.15.78:0/539565713 >> v2:172.21.15.187:3300/0 conn(0x7ff768071440 0x7ff76815d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:12.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.205+0000 7ff7677fe640 1 -- 172.21.15.78:0/539565713 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff768070440 con 0x7ff768143770 2023-12-12T10:13:12.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.205+0000 7ff7677fe640 1 -- 172.21.15.78:0/539565713 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 465499599 0 0) 0x7ff75c001680 con 0x7ff768143770 2023-12-12T10:13:12.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.205+0000 7ff7677fe640 1 -- 172.21.15.78:0/539565713 >> v1:172.21.15.78:6789/0 conn(0x7ff768143770 legacy=0x7ff7680b1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:12.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.205+0000 7ff7677fe640 1 --2- 172.21.15.78:0/539565713 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff758003980 0x7ff758003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:12.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.205+0000 7ff7677fe640 1 --2- 172.21.15.78:0/539565713 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff7580047d0 0x7ff758004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:12.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.205+0000 7ff7677fe640 1 --2- 172.21.15.78:0/539565713 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff7680cdf60 0x7ff758005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:12.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.205+0000 7ff7677fe640 1 -- 172.21.15.78:0/539565713 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7680ce3c0 con 0x7ff7580047d0 2023-12-12T10:13:12.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.205+0000 7ff7677fe640 1 -- 172.21.15.78:0/539565713 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7680718b0 con 0x7ff758003980 2023-12-12T10:13:12.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.205+0000 7ff7677fe640 1 -- 172.21.15.78:0/539565713 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff75800b990 con 0x7ff7680cdf60 2023-12-12T10:13:12.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.205+0000 7ff767fff640 1 --2- 172.21.15.78:0/539565713 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff7580047d0 0x7ff758004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:12.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.205+0000 7ff76ceb9640 1 --2- 172.21.15.78:0/539565713 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff758003980 0x7ff758003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:12.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.205+0000 7ff76d6ba640 1 --2- 172.21.15.78:0/539565713 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff7680cdf60 0x7ff758005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:12.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.205+0000 7ff767fff640 1 -- 172.21.15.78:0/539565713 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff7680cdf60 msgr2=0x7ff758005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:13:12.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.205+0000 7ff767fff640 1 --2- 172.21.15.78:0/539565713 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff7680cdf60 0x7ff758005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:12.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.205+0000 7ff767fff640 1 -- 172.21.15.78:0/539565713 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff758003980 msgr2=0x7ff758003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:13:12.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.205+0000 7ff767fff640 1 --2- 172.21.15.78:0/539565713 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff758003980 0x7ff758003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:12.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.205+0000 7ff767fff640 1 -- 172.21.15.78:0/539565713 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff758003530 con 0x7ff7580047d0 2023-12-12T10:13:12.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.209+0000 7ff767fff640 1 --2- 172.21.15.78:0/539565713 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff7580047d0 0x7ff758004c50 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7ff754009b10 tx=0x7ff75401ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2b8d5475e9453bf server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:12.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.209+0000 7ff7677fe640 1 -- 172.21.15.78:0/539565713 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7540a6460 con 0x7ff7580047d0 2023-12-12T10:13:12.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.209+0000 7ff7677fe640 1 -- 172.21.15.78:0/539565713 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7540a65c0 con 0x7ff7580047d0 2023-12-12T10:13:12.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.209+0000 7ff7677fe640 1 -- 172.21.15.78:0/539565713 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7540a6970 con 0x7ff7580047d0 2023-12-12T10:13:12.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.209+0000 7ff76f11d640 1 -- 172.21.15.78:0/539565713 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff7580047d0 msgr2=0x7ff758004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:12.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.209+0000 7ff76f11d640 1 --2- 172.21.15.78:0/539565713 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff7580047d0 0x7ff758004c50 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7ff754009b10 tx=0x7ff75401ca50 comp rx=0 tx=0).stop 2023-12-12T10:13:12.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.209+0000 7ff76d6ba640 1 -- 172.21.15.78:0/539565713 reap_dead start 2023-12-12T10:13:12.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.209+0000 7ff76f11d640 1 -- 172.21.15.78:0/539565713 shutdown_connections 2023-12-12T10:13:12.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.209+0000 7ff76f11d640 1 -- 172.21.15.78:0/539565713 >> 172.21.15.78:0/539565713 conn(0x7ff76806a710 msgr2=0x7ff76806ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:12.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.209+0000 7ff76f11d640 1 -- 172.21.15.78:0/539565713 shutdown_connections 2023-12-12T10:13:12.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.209+0000 7ff76f11d640 1 -- 172.21.15.78:0/539565713 wait complete. 2023-12-12T10:13:12.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.213+0000 7ff76f11d640 1 Processor -- start 2023-12-12T10:13:12.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.213+0000 7ff76f11d640 1 -- start start 2023-12-12T10:13:12.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.213+0000 7ff76f11d640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff7580047d0 0x7ff76815f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:12.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.213+0000 7ff76f11d640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff76815b7e0 0x7ff76815bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:12.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.213+0000 7ff76f11d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff76813b1f0 0x7ff76813b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:12.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.213+0000 7ff76f11d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff76815cf60 con 0x7ff76813b1f0 2023-12-12T10:13:12.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.213+0000 7ff76f11d640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff76813bbb0 con 0x7ff7580047d0 2023-12-12T10:13:12.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.213+0000 7ff76f11d640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff76815c350 con 0x7ff76815b7e0 2023-12-12T10:13:12.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.213+0000 7ff76d6ba640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff76813b1f0 0x7ff76813b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:12.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.213+0000 7ff76d6ba640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff76813b1f0 0x7ff76813b670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:44610/0 (socket says 172.21.15.78:44610) 2023-12-12T10:13:12.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.213+0000 7ff76d6ba640 1 -- 172.21.15.78:0/4092131432 learned_addr learned my addr 172.21.15.78:0/4092131432 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:13:12.219 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.213+0000 7ff76ceb9640 1 --2- 172.21.15.78:0/4092131432 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff7580047d0 0x7ff76815f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:12.219 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.213+0000 7ff767fff640 1 --2- 172.21.15.78:0/4092131432 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff76815b7e0 0x7ff76815bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:12.219 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.213+0000 7ff76d6ba640 1 -- 172.21.15.78:0/4092131432 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff76815b7e0 msgr2=0x7ff76815bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:12.219 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.213+0000 7ff76d6ba640 1 --2- 172.21.15.78:0/4092131432 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff76815b7e0 0x7ff76815bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:12.219 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.213+0000 7ff76d6ba640 1 -- 172.21.15.78:0/4092131432 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff7580047d0 msgr2=0x7ff76815f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:12.219 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.213+0000 7ff76d6ba640 1 --2- 172.21.15.78:0/4092131432 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff7580047d0 0x7ff76815f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:12.219 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.213+0000 7ff76d6ba640 1 -- 172.21.15.78:0/4092131432 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff76815c630 con 0x7ff76813b1f0 2023-12-12T10:13:12.219 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.213+0000 7ff76d6ba640 1 --2- 172.21.15.78:0/4092131432 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff76813b1f0 0x7ff76813b670 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7ff76806cb50 tx=0x7ff7600115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:12.220 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.213+0000 7ff7657fa640 1 -- 172.21.15.78:0/4092131432 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff76000e070 con 0x7ff76813b1f0 2023-12-12T10:13:12.220 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.213+0000 7ff7657fa640 1 -- 172.21.15.78:0/4092131432 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff760011ed0 con 0x7ff76813b1f0 2023-12-12T10:13:12.220 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.213+0000 7ff7657fa640 1 -- 172.21.15.78:0/4092131432 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7600039a0 con 0x7ff76813b1f0 2023-12-12T10:13:12.220 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.213+0000 7ff76f11d640 1 -- 172.21.15.78:0/4092131432 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff76815c910 con 0x7ff76813b1f0 2023-12-12T10:13:12.220 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.213+0000 7ff76f11d640 1 -- 172.21.15.78:0/4092131432 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff768160250 con 0x7ff76813b1f0 2023-12-12T10:13:12.220 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.217+0000 7ff76f11d640 1 -- 172.21.15.78:0/4092131432 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7680671f0 con 0x7ff76813b1f0 2023-12-12T10:13:12.221 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.217+0000 7ff7657fa640 1 -- 172.21.15.78:0/4092131432 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff760003b20 con 0x7ff76813b1f0 2023-12-12T10:13:12.221 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.217+0000 7ff7657fa640 1 --2- 172.21.15.78:0/4092131432 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7ff74c066470 0x7ff74c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:12.222 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.217+0000 7ff7657fa640 1 -- 172.21.15.78:0/4092131432 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7ff7600847f0 con 0x7ff76813b1f0 2023-12-12T10:13:12.222 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.217+0000 7ff76ceb9640 1 --2- 172.21.15.78:0/4092131432 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7ff74c066470 0x7ff74c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:12.222 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.217+0000 7ff76ceb9640 1 --2- 172.21.15.78:0/4092131432 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7ff74c066470 0x7ff74c068930 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff76813dac0 tx=0x7ff75c007900 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:12.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.221+0000 7ff7657fa640 1 -- 172.21.15.78:0/4092131432 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff760051960 con 0x7ff76813b1f0 2023-12-12T10:13:12.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.381+0000 7ff76f11d640 1 -- 172.21.15.78:0/4092131432 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7ff768067530 con 0x7ff76813b1f0 2023-12-12T10:13:12.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.381+0000 7ff7657fa640 1 -- 172.21.15.78:0/4092131432 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7ff760054f80 con 0x7ff76813b1f0 2023-12-12T10:13:12.385 INFO:teuthology.orchestra.run.smithi078.stderr:listed 0 entries 2023-12-12T10:13:12.387 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.381+0000 7ff76f11d640 1 -- 172.21.15.78:0/4092131432 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7ff74c066470 msgr2=0x7ff74c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:12.387 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.381+0000 7ff76f11d640 1 --2- 172.21.15.78:0/4092131432 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7ff74c066470 0x7ff74c068930 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff76813dac0 tx=0x7ff75c007900 comp rx=0 tx=0).stop 2023-12-12T10:13:12.387 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.381+0000 7ff76f11d640 1 -- 172.21.15.78:0/4092131432 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff76813b1f0 msgr2=0x7ff76813b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:12.387 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.381+0000 7ff76f11d640 1 --2- 172.21.15.78:0/4092131432 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff76813b1f0 0x7ff76813b670 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7ff76806cb50 tx=0x7ff7600115a0 comp rx=0 tx=0).stop 2023-12-12T10:13:12.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.381+0000 7ff76f11d640 1 -- 172.21.15.78:0/4092131432 shutdown_connections 2023-12-12T10:13:12.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.381+0000 7ff76f11d640 1 --2- 172.21.15.78:0/4092131432 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7ff74c066470 0x7ff74c068930 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:12.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.385+0000 7ff76f11d640 1 --2- 172.21.15.78:0/4092131432 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff76813b1f0 0x7ff76813b670 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:12.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.385+0000 7ff76f11d640 1 --2- 172.21.15.78:0/4092131432 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff76815b7e0 0x7ff76815bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:12.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.385+0000 7ff76f11d640 1 --2- 172.21.15.78:0/4092131432 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff7580047d0 0x7ff76815f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:12.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.385+0000 7ff76f11d640 1 -- 172.21.15.78:0/4092131432 >> 172.21.15.78:0/4092131432 conn(0x7ff76806a710 msgr2=0x7ff7681643a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:12.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.385+0000 7ff76f11d640 1 -- 172.21.15.78:0/4092131432 shutdown_connections 2023-12-12T10:13:12.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.385+0000 7ff76f11d640 1 -- 172.21.15.78:0/4092131432 wait complete. 2023-12-12T10:13:12.407 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-12-12T10:13:12.407 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-12T10:13:12.417 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T10:13:12.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.549+0000 7fbbf7454640 1 Processor -- start 2023-12-12T10:13:12.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.549+0000 7fbbf7454640 1 -- start start 2023-12-12T10:13:12.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.553+0000 7fbbf7454640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fbbf00b47d0 0x7fbbf01580a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:12.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.553+0000 7fbbf7454640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbf00ae1f0 con 0x7fbbf00cb7e0 2023-12-12T10:13:12.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.553+0000 7fbbf7454640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbf015c410 con 0x7fbbf00ade10 2023-12-12T10:13:12.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.553+0000 7fbbf7454640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbf015b800 con 0x7fbbf00b47d0 2023-12-12T10:13:12.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.553+0000 7fbbf49ef640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fbbf00cb7e0 0x7fbbf00b40c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:35600/0 (socket says 172.21.15.78:35600) 2023-12-12T10:13:12.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.553+0000 7fbbf49ef640 1 -- 172.21.15.78:0/1738711921 learned_addr learned my addr 172.21.15.78:0/1738711921 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-12-12T10:13:12.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.553+0000 7fbbf59f1640 1 --2- 172.21.15.78:0/1738711921 >> v2:172.21.15.187:3300/0 conn(0x7fbbf00b47d0 0x7fbbf01580a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:12.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.553+0000 7fbbe7fff640 1 -- 172.21.15.78:0/1738711921 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1341379341 0 0) 0x7fbbf00ae1f0 con 0x7fbbf00cb7e0 2023-12-12T10:13:12.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.553+0000 7fbbe7fff640 1 -- 172.21.15.78:0/1738711921 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbbdc003530 con 0x7fbbf00cb7e0 2023-12-12T10:13:12.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.553+0000 7fbbf59f1640 1 -- 172.21.15.78:0/1738711921 >> v1:172.21.15.187:6789/0 conn(0x7fbbf00ade10 legacy=0x7fbbf00ce5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:12.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.553+0000 7fbbe7fff640 1 -- 172.21.15.78:0/1738711921 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1280162161 0 0) 0x7fbbf015c410 con 0x7fbbf00ade10 2023-12-12T10:13:12.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.553+0000 7fbbf59f1640 1 -- 172.21.15.78:0/1738711921 >> v1:172.21.15.78:6789/0 conn(0x7fbbf00cb7e0 legacy=0x7fbbf00b40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:12.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.553+0000 7fbbf59f1640 1 -- 172.21.15.78:0/1738711921 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbf015bae0 con 0x7fbbf00b47d0 2023-12-12T10:13:12.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.557+0000 7fbbf59f1640 1 --2- 172.21.15.78:0/1738711921 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbbf00b47d0 0x7fbbf01580a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fbbe8009d90 tx=0x7fbbe801c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=168b2b3bbb5a8c1f server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:12.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.557+0000 7fbbe7fff640 1 -- 172.21.15.78:0/1738711921 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbe80a5900 con 0x7fbbf00b47d0 2023-12-12T10:13:12.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.557+0000 7fbbe7fff640 1 -- 172.21.15.78:0/1738711921 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbe80a5a60 con 0x7fbbf00b47d0 2023-12-12T10:13:12.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.557+0000 7fbbe7fff640 1 -- 172.21.15.78:0/1738711921 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbe80a5df0 con 0x7fbbf00b47d0 2023-12-12T10:13:12.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.557+0000 7fbbf7454640 1 -- 172.21.15.78:0/1738711921 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbbf00b47d0 msgr2=0x7fbbf01580a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:12.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.557+0000 7fbbf7454640 1 --2- 172.21.15.78:0/1738711921 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbbf00b47d0 0x7fbbf01580a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fbbe8009d90 tx=0x7fbbe801c950 comp rx=0 tx=0).stop 2023-12-12T10:13:12.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.557+0000 7fbbf7454640 1 -- 172.21.15.78:0/1738711921 shutdown_connections 2023-12-12T10:13:12.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.557+0000 7fbbf7454640 1 --2- 172.21.15.78:0/1738711921 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbbf00b47d0 0x7fbbf01580a0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:12.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.557+0000 7fbbf7454640 1 -- 172.21.15.78:0/1738711921 >> 172.21.15.78:0/1738711921 conn(0x7fbbf006c5d0 msgr2=0x7fbbf006c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:12.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.557+0000 7fbbf7454640 1 -- 172.21.15.78:0/1738711921 shutdown_connections 2023-12-12T10:13:12.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.557+0000 7fbbf7454640 1 -- 172.21.15.78:0/1738711921 wait complete. 2023-12-12T10:13:12.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.557+0000 7fbbf7454640 1 Processor -- start 2023-12-12T10:13:12.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.557+0000 7fbbf7454640 1 -- start start 2023-12-12T10:13:12.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.561+0000 7fbbf7454640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbbf00ade10 0x7fbbf0156a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:12.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.561+0000 7fbbf7454640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbbf00b47d0 0x7fbbf014cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:12.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.561+0000 7fbbf7454640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbbf00cb7e0 0x7fbbf00b19f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:12.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.561+0000 7fbbf7454640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbf0151830 con 0x7fbbf00b47d0 2023-12-12T10:13:12.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.561+0000 7fbbf7454640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbf0153c40 con 0x7fbbf00cb7e0 2023-12-12T10:13:12.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.561+0000 7fbbf7454640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbf0153f20 con 0x7fbbf00ade10 2023-12-12T10:13:12.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.561+0000 7fbbf49ef640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbbf00b47d0 0x7fbbf014cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:12.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.561+0000 7fbbf49ef640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbbf00b47d0 0x7fbbf014cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:44614/0 (socket says 172.21.15.78:44614) 2023-12-12T10:13:12.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.561+0000 7fbbf49ef640 1 -- 172.21.15.78:0/2894882030 learned_addr learned my addr 172.21.15.78:0/2894882030 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:13:12.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.561+0000 7fbbf59f1640 1 --2- 172.21.15.78:0/2894882030 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbbf00cb7e0 0x7fbbf00b19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:12.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.561+0000 7fbbf51f0640 1 --2- 172.21.15.78:0/2894882030 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbbf00ade10 0x7fbbf0156a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:12.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.561+0000 7fbbf49ef640 1 -- 172.21.15.78:0/2894882030 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbbf00ade10 msgr2=0x7fbbf0156a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:12.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.561+0000 7fbbf49ef640 1 --2- 172.21.15.78:0/2894882030 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbbf00ade10 0x7fbbf0156a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:12.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.561+0000 7fbbf49ef640 1 -- 172.21.15.78:0/2894882030 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbbf00cb7e0 msgr2=0x7fbbf00b19f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:12.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.561+0000 7fbbf49ef640 1 --2- 172.21.15.78:0/2894882030 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbbf00cb7e0 0x7fbbf00b19f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:12.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.561+0000 7fbbf49ef640 1 -- 172.21.15.78:0/2894882030 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbe8009a70 con 0x7fbbf00b47d0 2023-12-12T10:13:12.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.561+0000 7fbbf49ef640 1 --2- 172.21.15.78:0/2894882030 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbbf00b47d0 0x7fbbf014cbe0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fbbe000c390 tx=0x7fbbe000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:12.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.561+0000 7fbbe5ffb640 1 -- 172.21.15.78:0/2894882030 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbe0005cf0 con 0x7fbbf00b47d0 2023-12-12T10:13:12.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.561+0000 7fbbe5ffb640 1 -- 172.21.15.78:0/2894882030 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbe0005e70 con 0x7fbbf00b47d0 2023-12-12T10:13:12.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.561+0000 7fbbe5ffb640 1 -- 172.21.15.78:0/2894882030 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbe00072f0 con 0x7fbbf00b47d0 2023-12-12T10:13:12.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.561+0000 7fbbf7454640 1 -- 172.21.15.78:0/2894882030 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbf0154200 con 0x7fbbf00b47d0 2023-12-12T10:13:12.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.561+0000 7fbbf7454640 1 -- 172.21.15.78:0/2894882030 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbf0153860 con 0x7fbbf00b47d0 2023-12-12T10:13:12.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.561+0000 7fbbf7454640 1 -- 172.21.15.78:0/2894882030 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbf00671f0 con 0x7fbbf00b47d0 2023-12-12T10:13:12.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.565+0000 7fbbe5ffb640 1 -- 172.21.15.78:0/2894882030 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fbbe0007450 con 0x7fbbf00b47d0 2023-12-12T10:13:12.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.565+0000 7fbbe5ffb640 1 --2- 172.21.15.78:0/2894882030 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fbbd4066470 0x7fbbd4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:12.569 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.565+0000 7fbbe5ffb640 1 -- 172.21.15.78:0/2894882030 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fbbe0083750 con 0x7fbbf00b47d0 2023-12-12T10:13:12.569 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.565+0000 7fbbf51f0640 1 --2- 172.21.15.78:0/2894882030 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fbbd4066470 0x7fbbd4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:12.569 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.565+0000 7fbbf51f0640 1 --2- 172.21.15.78:0/2894882030 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fbbd4066470 0x7fbbd4068930 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fbbec000f70 tx=0x7fbbec009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:12.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.569+0000 7fbbe5ffb640 1 -- 172.21.15.78:0/2894882030 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fbbe00509f0 con 0x7fbbf00b47d0 2023-12-12T10:13:12.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.721+0000 7fbbf7454640 1 -- 172.21.15.78:0/2894882030 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbbf0151600 con 0x7fbbf00b47d0 2023-12-12T10:13:12.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.721+0000 7fbbe5ffb640 1 -- 172.21.15.78:0/2894882030 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18701 (secure 0 0 0) 0x7fbbf0151600 con 0x7fbbf00b47d0 2023-12-12T10:13:12.726 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:13:12.726 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":26,"fsid":"fc81937c-bd26-483c-952b-d1324fcb0c9e","created":"2023-12-12T10:11:44.020214+0000","modified":"2023-12-12T10:12:50.919344+0000","last_up_change":"2023-12-12T10:11:56.278318+0000","last_in_change":"2023-12-12T10:11:46.553610+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T10:11:57.053584+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-12T10:12:07.454450+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-12T10:12:08.182909+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-12T10:12:11.977952+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"22dfdedf-5f6c-4b20-9f6c-30517a1db70a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6809","nonce":3345683600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6811","nonce":3345683600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6815","nonce":3345683600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6813","nonce":3345683600}]},"public_addr":"172.21.15.78:6809/3345683600","cluster_addr":"172.21.15.78:6811/3345683600","heartbeat_back_addr":"172.21.15.78:6815/3345683600","heartbeat_front_addr":"172.21.15.78:6813/3345683600","state":["exists","up"]},{"osd":1,"uuid":"be34a7f3-a69a-462e-9ddf-5e537448dba2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6801","nonce":962652768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6803","nonce":962652768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6807","nonce":962652768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6805","nonce":962652768}]},"public_addr":"172.21.15.78:6801/962652768","cluster_addr":"172.21.15.78:6803/962652768","heartbeat_back_addr":"172.21.15.78:6807/962652768","heartbeat_front_addr":"172.21.15.78:6805/962652768","state":["exists","up"]},{"osd":2,"uuid":"55b381de-5f56-4b14-80f7-e6e41e084a13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6818","nonce":2910206054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6822","nonce":2910206054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6829","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6831","nonce":2910206054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6826","nonce":2910206054}]},"public_addr":"172.21.15.78:6818/2910206054","cluster_addr":"172.21.15.78:6822/2910206054","heartbeat_back_addr":"172.21.15.78:6831/2910206054","heartbeat_front_addr":"172.21.15.78:6826/2910206054","state":["exists","up"]},{"osd":3,"uuid":"d7682de1-25cb-4cec-869f-8851c28b0e6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6819","nonce":3750796703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6821","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6823","nonce":3750796703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6830","nonce":3750796703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6825","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6827","nonce":3750796703}]},"public_addr":"172.21.15.78:6819/3750796703","cluster_addr":"172.21.15.78:6823/3750796703","heartbeat_back_addr":"172.21.15.78:6830/3750796703","heartbeat_front_addr":"172.21.15.78:6827/3750796703","state":["exists","up"]},{"osd":4,"uuid":"8279815a-d6c7-4199-871e-d28971b9dc07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6809","nonce":2944277204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6811","nonce":2944277204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6815","nonce":2944277204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6813","nonce":2944277204}]},"public_addr":"172.21.15.187:6809/2944277204","cluster_addr":"172.21.15.187:6811/2944277204","heartbeat_back_addr":"172.21.15.187:6815/2944277204","heartbeat_front_addr":"172.21.15.187:6813/2944277204","state":["exists","up"]},{"osd":5,"uuid":"0a714c65-f8ce-4340-968f-11a799677ef3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6801","nonce":185858620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6803","nonce":185858620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6807","nonce":185858620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6805","nonce":185858620}]},"public_addr":"172.21.15.187:6801/185858620","cluster_addr":"172.21.15.187:6803/185858620","heartbeat_back_addr":"172.21.15.187:6807/185858620","heartbeat_front_addr":"172.21.15.187:6805/185858620","state":["exists","up"]},{"osd":6,"uuid":"d0bba9ab-f7ee-449e-8999-1c0cf7e6d53c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6817","nonce":4213392126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6819","nonce":4213392126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6824","nonce":4213392126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6821","nonce":4213392126}]},"public_addr":"172.21.15.187:6817/4213392126","cluster_addr":"172.21.15.187:6819/4213392126","heartbeat_back_addr":"172.21.15.187:6824/4213392126","heartbeat_front_addr":"172.21.15.187:6821/4213392126","state":["exists","up"]},{"osd":7,"uuid":"efe5e0d9-2f87-4889-a27a-e2a95a632302","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6823","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6825","nonce":85774004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6827","nonce":85774004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6831","nonce":85774004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6829","nonce":85774004}]},"public_addr":"172.21.15.187:6825/85774004","cluster_addr":"172.21.15.187:6827/85774004","heartbeat_back_addr":"172.21.15.187:6831/85774004","heartbeat_front_addr":"172.21.15.187:6829/85774004","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.214447+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.448899+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.293107+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.564184+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.175026+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.097717+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.261141+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.287681+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.18","mappings":[{"from":3,"to":2}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.13","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T10:13:12.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.725+0000 7fbbf7454640 1 -- 172.21.15.78:0/2894882030 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fbbd4066470 msgr2=0x7fbbd4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:12.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.725+0000 7fbbf7454640 1 --2- 172.21.15.78:0/2894882030 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fbbd4066470 0x7fbbd4068930 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fbbec000f70 tx=0x7fbbec009040 comp rx=0 tx=0).stop 2023-12-12T10:13:12.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.725+0000 7fbbf7454640 1 -- 172.21.15.78:0/2894882030 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbbf00b47d0 msgr2=0x7fbbf014cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:12.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.725+0000 7fbbf7454640 1 --2- 172.21.15.78:0/2894882030 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbbf00b47d0 0x7fbbf014cbe0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fbbe000c390 tx=0x7fbbe000c850 comp rx=0 tx=0).stop 2023-12-12T10:13:12.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.725+0000 7fbbf7454640 1 -- 172.21.15.78:0/2894882030 shutdown_connections 2023-12-12T10:13:12.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.725+0000 7fbbf7454640 1 --2- 172.21.15.78:0/2894882030 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fbbd4066470 0x7fbbd4068930 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:12.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.725+0000 7fbbf7454640 1 --2- 172.21.15.78:0/2894882030 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbbf00cb7e0 0x7fbbf00b19f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:12.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.725+0000 7fbbf7454640 1 --2- 172.21.15.78:0/2894882030 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbbf00b47d0 0x7fbbf014cbe0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:12.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.725+0000 7fbbf7454640 1 --2- 172.21.15.78:0/2894882030 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbbf00ade10 0x7fbbf0156a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:12.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.725+0000 7fbbf7454640 1 -- 172.21.15.78:0/2894882030 >> 172.21.15.78:0/2894882030 conn(0x7fbbf006c5d0 msgr2=0x7fbbf00cafa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:12.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.725+0000 7fbbf7454640 1 -- 172.21.15.78:0/2894882030 shutdown_connections 2023-12-12T10:13:12.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.725+0000 7fbbf7454640 1 -- 172.21.15.78:0/2894882030 wait complete. 2023-12-12T10:13:12.749 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-12T10:11:57.053584+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-12T10:12:07.454450+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-12T10:12:08.182909+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-12T10:12:11.977952+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-12T10:13:12.749 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-12T10:13:12.892 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.889+0000 7fd4b93aa640 1 Processor -- start 2023-12-12T10:13:12.892 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.889+0000 7fd4b93aa640 1 -- start start 2023-12-12T10:13:12.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.889+0000 7fd4b93aa640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fd4b40cff80 0x7fd4b40d3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:12.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.889+0000 7fd4b93aa640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd4b40ce6d0 0x7fd4b40ceb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:12.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.889+0000 7fd4b93aa640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4b40cdc50 con 0x7fd4b415f900 2023-12-12T10:13:12.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.889+0000 7fd4b93aa640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4b40d0460 con 0x7fd4b40cff80 2023-12-12T10:13:12.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.889+0000 7fd4b93aa640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4b40d0740 con 0x7fd4b40ce6d0 2023-12-12T10:13:12.894 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.889+0000 7fd4b27fc640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fd4b40cff80 0x7fd4b40d3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:12.894 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.889+0000 7fd4b37fe640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd4b40ce6d0 0x7fd4b40ceb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:12.894 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.889+0000 7fd4b27fc640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fd4b40cff80 0x7fd4b40d3ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.78:45614/0 (socket says 172.21.15.78:45614) 2023-12-12T10:13:12.894 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.889+0000 7fd4b37fe640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd4b40ce6d0 0x7fd4b40ceb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.78:55550/0 (socket says 172.21.15.78:55550) 2023-12-12T10:13:12.894 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.889+0000 7fd4b27fc640 1 -- 172.21.15.78:0/2005871469 learned_addr learned my addr 172.21.15.78:0/2005871469 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:13:12.894 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.889+0000 7fd4b2ffd640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7fd4b415f900 0x7fd4b40b28f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.78:54726/0 (socket says 172.21.15.78:54726) 2023-12-12T10:13:12.894 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.889+0000 7fd4b27fc640 1 -- 172.21.15.78:0/2005871469 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd4b40ce6d0 msgr2=0x7fd4b40ceb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:13:12.894 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.889+0000 7fd4b27fc640 1 --2- 172.21.15.78:0/2005871469 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd4b40ce6d0 0x7fd4b40ceb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:12.894 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.889+0000 7fd4b27fc640 1 -- 172.21.15.78:0/2005871469 >> v1:172.21.15.187:6789/0 conn(0x7fd4b415f900 legacy=0x7fd4b40b28f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:12.895 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.889+0000 7fd4b27fc640 1 -- 172.21.15.78:0/2005871469 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4b40cded0 con 0x7fd4b40cff80 2023-12-12T10:13:12.895 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.889+0000 7fd4b1ffb640 1 -- 172.21.15.78:0/2005871469 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3039806646 0 0) 0x7fd4b40cdc50 con 0x7fd4b415f900 2023-12-12T10:13:12.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.893+0000 7fd4b27fc640 1 --2- 172.21.15.78:0/2005871469 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd4b40cff80 0x7fd4b40d3ab0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fd4a8009870 tx=0x7fd4a801c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2889cdf93c3ca1db server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:12.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.893+0000 7fd4b1ffb640 1 -- 172.21.15.78:0/2005871469 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4a80ac600 con 0x7fd4b40cff80 2023-12-12T10:13:12.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.893+0000 7fd4b1ffb640 1 -- 172.21.15.78:0/2005871469 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4a80a8050 con 0x7fd4b40cff80 2023-12-12T10:13:12.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.893+0000 7fd4b1ffb640 1 -- 172.21.15.78:0/2005871469 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4a80ac980 con 0x7fd4b40cff80 2023-12-12T10:13:12.898 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.893+0000 7fd4b93aa640 1 -- 172.21.15.78:0/2005871469 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd4b40cff80 msgr2=0x7fd4b40d3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:12.898 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.893+0000 7fd4b93aa640 1 --2- 172.21.15.78:0/2005871469 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd4b40cff80 0x7fd4b40d3ab0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fd4a8009870 tx=0x7fd4a801c480 comp rx=0 tx=0).stop 2023-12-12T10:13:12.898 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.893+0000 7fd4b93aa640 1 -- 172.21.15.78:0/2005871469 shutdown_connections 2023-12-12T10:13:12.898 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.893+0000 7fd4b93aa640 1 --2- 172.21.15.78:0/2005871469 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd4b40ce6d0 0x7fd4b40ceb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:12.898 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.893+0000 7fd4b93aa640 1 --2- 172.21.15.78:0/2005871469 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd4b40cff80 0x7fd4b40d3ab0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:12.898 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.893+0000 7fd4b93aa640 1 -- 172.21.15.78:0/2005871469 >> 172.21.15.78:0/2005871469 conn(0x7fd4b40d2f90 msgr2=0x7fd4b40d33a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:12.898 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.893+0000 7fd4b93aa640 1 -- 172.21.15.78:0/2005871469 shutdown_connections 2023-12-12T10:13:12.898 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.893+0000 7fd4b93aa640 1 -- 172.21.15.78:0/2005871469 wait complete. 2023-12-12T10:13:12.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.897+0000 7fd4b93aa640 1 Processor -- start 2023-12-12T10:13:12.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.897+0000 7fd4b93aa640 1 -- start start 2023-12-12T10:13:12.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.897+0000 7fd4b93aa640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd4b40ce6d0 0x7fd4b414a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:12.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.897+0000 7fd4b93aa640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd4b40cff80 0x7fd4b40b5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:12.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.897+0000 7fd4b93aa640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd4b415f900 0x7fd4b40b1340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:12.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.897+0000 7fd4b93aa640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4b40ccf20 con 0x7fd4b415f900 2023-12-12T10:13:12.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.897+0000 7fd4b93aa640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4b40c94c0 con 0x7fd4b40ce6d0 2023-12-12T10:13:12.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.897+0000 7fd4b93aa640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4b40c9950 con 0x7fd4b40cff80 2023-12-12T10:13:12.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.897+0000 7fd4b2ffd640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd4b40ce6d0 0x7fd4b414a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:12.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.897+0000 7fd4b27fc640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd4b40cff80 0x7fd4b40b5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:12.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.897+0000 7fd4b37fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd4b415f900 0x7fd4b40b1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:12.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.897+0000 7fd4b2ffd640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd4b40ce6d0 0x7fd4b414a260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.78:45624/0 (socket says 172.21.15.78:45624) 2023-12-12T10:13:12.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.897+0000 7fd4b2ffd640 1 -- 172.21.15.78:0/2751978335 learned_addr learned my addr 172.21.15.78:0/2751978335 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:13:12.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.897+0000 7fd4b27fc640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd4b40cff80 0x7fd4b40b5150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.78:55562/0 (socket says 172.21.15.78:55562) 2023-12-12T10:13:12.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.897+0000 7fd4b27fc640 1 -- 172.21.15.78:0/2751978335 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd4b40ce6d0 msgr2=0x7fd4b414a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:12.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.897+0000 7fd4b27fc640 1 --2- 172.21.15.78:0/2751978335 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd4b40ce6d0 0x7fd4b414a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:12.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.897+0000 7fd4b27fc640 1 -- 172.21.15.78:0/2751978335 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd4b415f900 msgr2=0x7fd4b40b1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:12.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.897+0000 7fd4b27fc640 1 --2- 172.21.15.78:0/2751978335 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd4b415f900 0x7fd4b40b1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:12.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.897+0000 7fd4b27fc640 1 -- 172.21.15.78:0/2751978335 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4a80094d0 con 0x7fd4b40cff80 2023-12-12T10:13:12.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.897+0000 7fd4b37fe640 1 --2- 172.21.15.78:0/2751978335 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd4b415f900 0x7fd4b40b1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-12T10:13:12.903 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.897+0000 7fd4b27fc640 1 --2- 172.21.15.78:0/2751978335 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd4b40cff80 0x7fd4b40b5150 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd4a80ac000 tx=0x7fd4a801acc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:12.903 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.897+0000 7fd49b7fe640 1 -- 172.21.15.78:0/2751978335 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4a8004020 con 0x7fd4b40cff80 2023-12-12T10:13:12.904 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.897+0000 7fd4b93aa640 1 -- 172.21.15.78:0/2751978335 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4b414a7a0 con 0x7fd4b40cff80 2023-12-12T10:13:12.904 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.897+0000 7fd49b7fe640 1 -- 172.21.15.78:0/2751978335 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4a8004180 con 0x7fd4b40cff80 2023-12-12T10:13:12.904 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.897+0000 7fd49b7fe640 1 -- 172.21.15.78:0/2751978335 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4a80044f0 con 0x7fd4b40cff80 2023-12-12T10:13:12.904 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.897+0000 7fd4b93aa640 1 -- 172.21.15.78:0/2751978335 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4b40b5690 con 0x7fd4b40cff80 2023-12-12T10:13:12.904 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.901+0000 7fd4b93aa640 1 -- 172.21.15.78:0/2751978335 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4b40c9630 con 0x7fd4b40cff80 2023-12-12T10:13:12.904 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.901+0000 7fd49b7fe640 1 -- 172.21.15.78:0/2751978335 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd4a80b3040 con 0x7fd4b40cff80 2023-12-12T10:13:12.905 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.901+0000 7fd49b7fe640 1 --2- 172.21.15.78:0/2751978335 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fd4a0066470 0x7fd4a0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:12.905 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.901+0000 7fd49b7fe640 1 -- 172.21.15.78:0/2751978335 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fd4a811e880 con 0x7fd4b40cff80 2023-12-12T10:13:12.905 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.901+0000 7fd4b2ffd640 1 --2- 172.21.15.78:0/2751978335 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fd4a0066470 0x7fd4a0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:12.906 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.901+0000 7fd4b2ffd640 1 --2- 172.21.15.78:0/2751978335 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fd4a0066470 0x7fd4a0068930 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fd4a4000f70 tx=0x7fd4a4007eb0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:12.909 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:12.905+0000 7fd49b7fe640 1 -- 172.21.15.78:0/2751978335 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd4a80eba70 con 0x7fd4b40cff80 2023-12-12T10:13:13.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.057+0000 7fd4b93aa640 1 -- 172.21.15.78:0/2751978335 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd4b4067530 con 0x7fd4b40cff80 2023-12-12T10:13:13.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.057+0000 7fd49b7fe640 1 -- 172.21.15.78:0/2751978335 <== mon.2 v2:172.21.15.187:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd4a80ef090 con 0x7fd4b40cff80 2023-12-12T10:13:13.062 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2023-12-12T10:13:13.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.061+0000 7fd4b93aa640 1 -- 172.21.15.78:0/2751978335 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fd4a0066470 msgr2=0x7fd4a0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:13.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.061+0000 7fd4b93aa640 1 --2- 172.21.15.78:0/2751978335 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fd4a0066470 0x7fd4a0068930 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fd4a4000f70 tx=0x7fd4a4007eb0 comp rx=0 tx=0).stop 2023-12-12T10:13:13.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.061+0000 7fd4b93aa640 1 -- 172.21.15.78:0/2751978335 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd4b40cff80 msgr2=0x7fd4b40b5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:13.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.061+0000 7fd4b93aa640 1 --2- 172.21.15.78:0/2751978335 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd4b40cff80 0x7fd4b40b5150 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd4a80ac000 tx=0x7fd4a801acc0 comp rx=0 tx=0).stop 2023-12-12T10:13:13.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.061+0000 7fd4b93aa640 1 -- 172.21.15.78:0/2751978335 shutdown_connections 2023-12-12T10:13:13.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.061+0000 7fd4b93aa640 1 --2- 172.21.15.78:0/2751978335 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fd4a0066470 0x7fd4a0068930 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:13.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.061+0000 7fd4b93aa640 1 --2- 172.21.15.78:0/2751978335 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd4b415f900 0x7fd4b40b1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:13.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.061+0000 7fd4b93aa640 1 --2- 172.21.15.78:0/2751978335 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd4b40cff80 0x7fd4b40b5150 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:13.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.061+0000 7fd4b93aa640 1 --2- 172.21.15.78:0/2751978335 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd4b40ce6d0 0x7fd4b414a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:13.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.061+0000 7fd4b93aa640 1 -- 172.21.15.78:0/2751978335 >> 172.21.15.78:0/2751978335 conn(0x7fd4b40d2f90 msgr2=0x7fd4b406c520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:13.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.061+0000 7fd4b93aa640 1 -- 172.21.15.78:0/2751978335 shutdown_connections 2023-12-12T10:13:13.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.061+0000 7fd4b93aa640 1 -- 172.21.15.78:0/2751978335 wait complete. 2023-12-12T10:13:13.083 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-12T10:13:13.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.221+0000 7f3915f01640 1 Processor -- start 2023-12-12T10:13:13.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.221+0000 7f3915f01640 1 -- start start 2023-12-12T10:13:13.226 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.221+0000 7f3915f01640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f3910143770 0x7f39100cdf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:13.227 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.221+0000 7f3915f01640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3910071610 0x7f391015d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:13.227 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.221+0000 7f3915f01640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3910070a70 con 0x7f39100b1e20 2023-12-12T10:13:13.227 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.221+0000 7f3915f01640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3910070440 con 0x7f3910143770 2023-12-12T10:13:13.227 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.221+0000 7f3915f01640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3910143b50 con 0x7f3910071610 2023-12-12T10:13:13.227 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.221+0000 7f390f7fe640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f3910143770 0x7f39100cdf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:13.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.221+0000 7f390ffff640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3910071610 0x7f391015d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:13.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.225+0000 7f390effd640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f39100b1e20 0x7f3910070f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.78:54734/0 (socket says 172.21.15.78:54734) 2023-12-12T10:13:13.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.225+0000 7f390effd640 1 -- 172.21.15.78:0/3760113108 learned_addr learned my addr 172.21.15.78:0/3760113108 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-12-12T10:13:13.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.225+0000 7f390ffff640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3910071610 0x7f391015d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.78:55568/0 (socket says 172.21.15.78:55568) 2023-12-12T10:13:13.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.225+0000 7f390f7fe640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f3910143770 0x7f39100cdf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.78:45634/0 (socket says 172.21.15.78:45634) 2023-12-12T10:13:13.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.225+0000 7f390f7fe640 1 -- 172.21.15.78:0/3760113108 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3910071610 msgr2=0x7f391015d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:13:13.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.225+0000 7f390f7fe640 1 --2- 172.21.15.78:0/3760113108 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3910071610 0x7f391015d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:13.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.225+0000 7f390f7fe640 1 -- 172.21.15.78:0/3760113108 >> v1:172.21.15.187:6789/0 conn(0x7f39100b1e20 legacy=0x7f3910070f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:13.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.225+0000 7f390f7fe640 1 -- 172.21.15.78:0/3760113108 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39100ce620 con 0x7f3910143770 2023-12-12T10:13:13.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.225+0000 7f390ffff640 1 --2- 172.21.15.78:0/3760113108 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3910071610 0x7f391015d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-12T10:13:13.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.225+0000 7f390f7fe640 1 --2- 172.21.15.78:0/3760113108 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3910143770 0x7f39100cdf60 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f39000097c0 tx=0x7f390001c3f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=acc73eaee6ae6a01 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:13.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.229+0000 7f390e7fc640 1 -- 172.21.15.78:0/3760113108 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39000ab600 con 0x7f3910143770 2023-12-12T10:13:13.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.229+0000 7f390e7fc640 1 -- 172.21.15.78:0/3760113108 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39000a7050 con 0x7f3910143770 2023-12-12T10:13:13.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.229+0000 7f390e7fc640 1 -- 172.21.15.78:0/3760113108 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39000ab980 con 0x7f3910143770 2023-12-12T10:13:13.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.229+0000 7f3915f01640 1 -- 172.21.15.78:0/3760113108 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3910143770 msgr2=0x7f39100cdf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:13.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.229+0000 7f3915f01640 1 --2- 172.21.15.78:0/3760113108 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3910143770 0x7f39100cdf60 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f39000097c0 tx=0x7f390001c3f0 comp rx=0 tx=0).stop 2023-12-12T10:13:13.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.229+0000 7f3915f01640 1 -- 172.21.15.78:0/3760113108 shutdown_connections 2023-12-12T10:13:13.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.229+0000 7f3915f01640 1 --2- 172.21.15.78:0/3760113108 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3910071610 0x7f391015d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:13.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.229+0000 7f3915f01640 1 --2- 172.21.15.78:0/3760113108 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3910143770 0x7f39100cdf60 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:13.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.229+0000 7f3915f01640 1 -- 172.21.15.78:0/3760113108 >> 172.21.15.78:0/3760113108 conn(0x7f391006a710 msgr2=0x7f391006ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:13.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.229+0000 7f3915f01640 1 -- 172.21.15.78:0/3760113108 shutdown_connections 2023-12-12T10:13:13.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.229+0000 7f3915f01640 1 -- 172.21.15.78:0/3760113108 wait complete. 2023-12-12T10:13:13.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.229+0000 7f3915f01640 1 Processor -- start 2023-12-12T10:13:13.234 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.229+0000 7f3915f01640 1 -- start start 2023-12-12T10:13:13.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.229+0000 7f3915f01640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3910071610 0x7f39101391c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:13.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.229+0000 7f3915f01640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f39100b1e20 0x7f391015c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:13.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.229+0000 7f3915f01640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3910143770 0x7f39101378d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:13.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.229+0000 7f3915f01640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3910138120 con 0x7f39100b1e20 2023-12-12T10:13:13.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.229+0000 7f3915f01640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3910138400 con 0x7f3910071610 2023-12-12T10:13:13.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.229+0000 7f3915f01640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39101386e0 con 0x7f3910143770 2023-12-12T10:13:13.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.233+0000 7f390effd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f39100b1e20 0x7f391015c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:13.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.233+0000 7f390effd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f39100b1e20 0x7f391015c810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:44638/0 (socket says 172.21.15.78:44638) 2023-12-12T10:13:13.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.233+0000 7f390effd640 1 -- 172.21.15.78:0/2809217363 learned_addr learned my addr 172.21.15.78:0/2809217363 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:13:13.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.233+0000 7f390f7fe640 1 --2- 172.21.15.78:0/2809217363 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3910071610 0x7f39101391c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:13.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.233+0000 7f390ffff640 1 --2- 172.21.15.78:0/2809217363 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3910143770 0x7f39101378d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:13.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.233+0000 7f390effd640 1 -- 172.21.15.78:0/2809217363 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3910143770 msgr2=0x7f39101378d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:13.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.233+0000 7f390effd640 1 --2- 172.21.15.78:0/2809217363 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3910143770 0x7f39101378d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:13.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.233+0000 7f390effd640 1 -- 172.21.15.78:0/2809217363 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3910071610 msgr2=0x7f39101391c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:13.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.233+0000 7f390effd640 1 --2- 172.21.15.78:0/2809217363 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3910071610 0x7f39101391c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:13.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.233+0000 7f390effd640 1 -- 172.21.15.78:0/2809217363 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3908009a70 con 0x7f39100b1e20 2023-12-12T10:13:13.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.233+0000 7f390effd640 1 --2- 172.21.15.78:0/2809217363 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f39100b1e20 0x7f391015c810 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f390400c500 tx=0x7f390400c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:13.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.233+0000 7f38f7fff640 1 -- 172.21.15.78:0/2809217363 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3904005cf0 con 0x7f39100b1e20 2023-12-12T10:13:13.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.233+0000 7f38f7fff640 1 -- 172.21.15.78:0/2809217363 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3904005e50 con 0x7f39100b1e20 2023-12-12T10:13:13.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.233+0000 7f38f7fff640 1 -- 172.21.15.78:0/2809217363 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39040072d0 con 0x7f39100b1e20 2023-12-12T10:13:13.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.233+0000 7f3915f01640 1 -- 172.21.15.78:0/2809217363 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3900009420 con 0x7f39100b1e20 2023-12-12T10:13:13.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.233+0000 7f3915f01640 1 -- 172.21.15.78:0/2809217363 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3910138ca0 con 0x7f39100b1e20 2023-12-12T10:13:13.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.233+0000 7f3915f01640 1 -- 172.21.15.78:0/2809217363 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39100671f0 con 0x7f39100b1e20 2023-12-12T10:13:13.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.233+0000 7f38f7fff640 1 -- 172.21.15.78:0/2809217363 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3904007430 con 0x7f39100b1e20 2023-12-12T10:13:13.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.237+0000 7f38f7fff640 1 --2- 172.21.15.78:0/2809217363 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f38fc0664a0 0x7f38fc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:13.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.237+0000 7f38f7fff640 1 -- 172.21.15.78:0/2809217363 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f3904083640 con 0x7f39100b1e20 2023-12-12T10:13:13.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.237+0000 7f390f7fe640 1 --2- 172.21.15.78:0/2809217363 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f38fc0664a0 0x7f38fc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:13.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.237+0000 7f390f7fe640 1 --2- 172.21.15.78:0/2809217363 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f38fc0664a0 0x7f38fc068960 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f39000ad000 tx=0x7f39000a4f90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:13.243 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.241+0000 7f38f7fff640 1 -- 172.21.15.78:0/2809217363 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f39040507b0 con 0x7f39100b1e20 2023-12-12T10:13:13.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.389+0000 7f3915f01640 1 -- 172.21.15.78:0/2809217363 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3910067530 con 0x7f39100b1e20 2023-12-12T10:13:13.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.389+0000 7f38f7fff640 1 -- 172.21.15.78:0/2809217363 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3904053dd0 con 0x7f39100b1e20 2023-12-12T10:13:13.394 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2023-12-12T10:13:13.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.393+0000 7f3915f01640 1 -- 172.21.15.78:0/2809217363 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f38fc0664a0 msgr2=0x7f38fc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:13.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.393+0000 7f3915f01640 1 --2- 172.21.15.78:0/2809217363 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f38fc0664a0 0x7f38fc068960 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f39000ad000 tx=0x7f39000a4f90 comp rx=0 tx=0).stop 2023-12-12T10:13:13.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.393+0000 7f3915f01640 1 -- 172.21.15.78:0/2809217363 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f39100b1e20 msgr2=0x7f391015c810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:13.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.393+0000 7f3915f01640 1 --2- 172.21.15.78:0/2809217363 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f39100b1e20 0x7f391015c810 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f390400c500 tx=0x7f390400c900 comp rx=0 tx=0).stop 2023-12-12T10:13:13.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.393+0000 7f3915f01640 1 -- 172.21.15.78:0/2809217363 shutdown_connections 2023-12-12T10:13:13.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.393+0000 7f3915f01640 1 --2- 172.21.15.78:0/2809217363 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f38fc0664a0 0x7f38fc068960 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:13.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.393+0000 7f3915f01640 1 --2- 172.21.15.78:0/2809217363 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3910143770 0x7f39101378d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:13.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.393+0000 7f3915f01640 1 --2- 172.21.15.78:0/2809217363 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f39100b1e20 0x7f391015c810 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:13.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.393+0000 7f3915f01640 1 --2- 172.21.15.78:0/2809217363 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3910071610 0x7f39101391c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:13.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.393+0000 7f3915f01640 1 -- 172.21.15.78:0/2809217363 >> 172.21.15.78:0/2809217363 conn(0x7f391006a710 msgr2=0x7f39100cd840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:13.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.393+0000 7f3915f01640 1 -- 172.21.15.78:0/2809217363 shutdown_connections 2023-12-12T10:13:13.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.393+0000 7f3915f01640 1 -- 172.21.15.78:0/2809217363 wait complete. 2023-12-12T10:13:13.415 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-12T10:13:13.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.553+0000 7fae0f6aa640 1 Processor -- start 2023-12-12T10:13:13.556 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.553+0000 7fae0f6aa640 1 -- start start 2023-12-12T10:13:13.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.553+0000 7fae0f6aa640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fae080cdf60 0x7fae08070f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:13.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.553+0000 7fae0f6aa640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae08070a70 con 0x7fae08143770 2023-12-12T10:13:13.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.553+0000 7fae0f6aa640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae080ce3c0 con 0x7fae08071440 2023-12-12T10:13:13.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.553+0000 7fae0f6aa640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae080718b0 con 0x7fae080cdf60 2023-12-12T10:13:13.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.553+0000 7fae0d446640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fae08143770 0x7fae080b1e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:35614/0 (socket says 172.21.15.78:35614) 2023-12-12T10:13:13.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.553+0000 7fae0d446640 1 -- 172.21.15.78:0/2072185071 learned_addr learned my addr 172.21.15.78:0/2072185071 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-12-12T10:13:13.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.553+0000 7fae0cc45640 1 --2- 172.21.15.78:0/2072185071 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fae080cdf60 0x7fae08070f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:13.558 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.553+0000 7fadfffff640 1 -- 172.21.15.78:0/2072185071 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3178959705 0 0) 0x7fae08070a70 con 0x7fae08143770 2023-12-12T10:13:13.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.553+0000 7fadfffff640 1 -- 172.21.15.78:0/2072185071 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fadf4003530 con 0x7fae08143770 2023-12-12T10:13:13.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.553+0000 7fadfffff640 1 -- 172.21.15.78:0/2072185071 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 810191300 0 0) 0x7fae080ce3c0 con 0x7fae08071440 2023-12-12T10:13:13.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.553+0000 7fadfffff640 1 -- 172.21.15.78:0/2072185071 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae08070a70 con 0x7fae08071440 2023-12-12T10:13:13.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.553+0000 7fadfffff640 1 -- 172.21.15.78:0/2072185071 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3486198407 0 0) 0x7fadf4003530 con 0x7fae08143770 2023-12-12T10:13:13.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.553+0000 7fae0cc45640 1 -- 172.21.15.78:0/2072185071 >> v1:172.21.15.187:6789/0 conn(0x7fae08071440 legacy=0x7fae0815d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:13.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.553+0000 7fae0cc45640 1 -- 172.21.15.78:0/2072185071 >> v1:172.21.15.78:6789/0 conn(0x7fae08143770 legacy=0x7fae080b1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:13.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.553+0000 7fae0cc45640 1 -- 172.21.15.78:0/2072185071 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae08070440 con 0x7fae080cdf60 2023-12-12T10:13:13.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.557+0000 7fae0cc45640 1 --2- 172.21.15.78:0/2072185071 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fae080cdf60 0x7fae08070f00 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fadf80097f0 tx=0x7fadf801c350 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab36d1de8b4314d server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:13.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.557+0000 7fadfffff640 1 -- 172.21.15.78:0/2072185071 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae04001680 con 0x7fae080cdf60 2023-12-12T10:13:13.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.557+0000 7fadfffff640 1 -- 172.21.15.78:0/2072185071 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadf80a7050 con 0x7fae080cdf60 2023-12-12T10:13:13.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.557+0000 7fadfffff640 1 -- 172.21.15.78:0/2072185071 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf80ab620 con 0x7fae080cdf60 2023-12-12T10:13:13.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.557+0000 7fae0f6aa640 1 -- 172.21.15.78:0/2072185071 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fae080cdf60 msgr2=0x7fae08070f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:13.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.557+0000 7fae0f6aa640 1 --2- 172.21.15.78:0/2072185071 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fae080cdf60 0x7fae08070f00 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fadf80097f0 tx=0x7fadf801c350 comp rx=0 tx=0).stop 2023-12-12T10:13:13.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.557+0000 7fae0f6aa640 1 -- 172.21.15.78:0/2072185071 shutdown_connections 2023-12-12T10:13:13.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.557+0000 7fae0f6aa640 1 --2- 172.21.15.78:0/2072185071 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fae080cdf60 0x7fae08070f00 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:13.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.557+0000 7fae0f6aa640 1 -- 172.21.15.78:0/2072185071 >> 172.21.15.78:0/2072185071 conn(0x7fae0806a710 msgr2=0x7fae0806ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:13.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.557+0000 7fae0f6aa640 1 -- 172.21.15.78:0/2072185071 shutdown_connections 2023-12-12T10:13:13.563 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.557+0000 7fae0f6aa640 1 -- 172.21.15.78:0/2072185071 wait complete. 2023-12-12T10:13:13.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.561+0000 7fae0f6aa640 1 Processor -- start 2023-12-12T10:13:13.564 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.561+0000 7fae0f6aa640 1 -- start start 2023-12-12T10:13:13.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.561+0000 7fae0f6aa640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fae08071440 0x7fae08137fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:13.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.561+0000 7fae0f6aa640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae080cdf60 0x7fae08071d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:13.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.561+0000 7fae0f6aa640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fae08143770 0x7fae08072270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:13.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.561+0000 7fae0f6aa640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae08138500 con 0x7fae080cdf60 2023-12-12T10:13:13.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.561+0000 7fae0f6aa640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae08132050 con 0x7fae08143770 2023-12-12T10:13:13.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.561+0000 7fae0f6aa640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae08132330 con 0x7fae08071440 2023-12-12T10:13:13.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.561+0000 7fae0cc45640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae080cdf60 0x7fae08071d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:13.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.561+0000 7fae0cc45640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae080cdf60 0x7fae08071d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:44640/0 (socket says 172.21.15.78:44640) 2023-12-12T10:13:13.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.561+0000 7fae0cc45640 1 -- 172.21.15.78:0/4099619870 learned_addr learned my addr 172.21.15.78:0/4099619870 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:13:13.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.561+0000 7fae0d446640 1 --2- 172.21.15.78:0/4099619870 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fae08071440 0x7fae08137fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:13.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.561+0000 7fae0dc47640 1 --2- 172.21.15.78:0/4099619870 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fae08143770 0x7fae08072270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:13.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.561+0000 7fae0cc45640 1 -- 172.21.15.78:0/4099619870 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fae08071440 msgr2=0x7fae08137fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:13.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.561+0000 7fae0cc45640 1 --2- 172.21.15.78:0/4099619870 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fae08071440 0x7fae08137fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:13.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.561+0000 7fae0cc45640 1 -- 172.21.15.78:0/4099619870 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fae08143770 msgr2=0x7fae08072270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:13.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.561+0000 7fae0cc45640 1 --2- 172.21.15.78:0/4099619870 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fae08143770 0x7fae08072270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:13.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.561+0000 7fae0cc45640 1 -- 172.21.15.78:0/4099619870 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadf8009420 con 0x7fae080cdf60 2023-12-12T10:13:13.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.561+0000 7fae0cc45640 1 --2- 172.21.15.78:0/4099619870 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae080cdf60 0x7fae08071d30 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fadf80ae040 tx=0x7fadf801ab90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:13.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.561+0000 7fadfdffb640 1 -- 172.21.15.78:0/4099619870 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf8004020 con 0x7fae080cdf60 2023-12-12T10:13:13.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.561+0000 7fadfdffb640 1 -- 172.21.15.78:0/4099619870 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadf80041a0 con 0x7fae080cdf60 2023-12-12T10:13:13.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.561+0000 7fae0f6aa640 1 -- 172.21.15.78:0/4099619870 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae08132610 con 0x7fae080cdf60 2023-12-12T10:13:13.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.561+0000 7fadfdffb640 1 -- 172.21.15.78:0/4099619870 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf8003620 con 0x7fae080cdf60 2023-12-12T10:13:13.569 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.561+0000 7fae0f6aa640 1 -- 172.21.15.78:0/4099619870 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae08132bd0 con 0x7fae080cdf60 2023-12-12T10:13:13.569 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.565+0000 7fae0f6aa640 1 -- 172.21.15.78:0/4099619870 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae080671f0 con 0x7fae080cdf60 2023-12-12T10:13:13.569 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.565+0000 7fadfdffb640 1 -- 172.21.15.78:0/4099619870 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fadf8003780 con 0x7fae080cdf60 2023-12-12T10:13:13.569 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.565+0000 7fadfdffb640 1 --2- 172.21.15.78:0/4099619870 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fadec0664a0 0x7fadec068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:13.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.565+0000 7fadfdffb640 1 -- 172.21.15.78:0/4099619870 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fadf811e350 con 0x7fae080cdf60 2023-12-12T10:13:13.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.565+0000 7fae0d446640 1 --2- 172.21.15.78:0/4099619870 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fadec0664a0 0x7fadec068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:13.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.565+0000 7fae0d446640 1 --2- 172.21.15.78:0/4099619870 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fadec0664a0 0x7fadec068960 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fae04000f70 tx=0x7fae040016c0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:13.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.569+0000 7fadfdffb640 1 -- 172.21.15.78:0/4099619870 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fadf80eb550 con 0x7fae080cdf60 2023-12-12T10:13:13.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.721+0000 7fae0f6aa640 1 -- 172.21.15.78:0/4099619870 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fae08132dc0 con 0x7fae080cdf60 2023-12-12T10:13:13.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.721+0000 7fadfdffb640 1 -- 172.21.15.78:0/4099619870 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7fadf80eeb70 con 0x7fae080cdf60 2023-12-12T10:13:13.726 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2023-12-12T10:13:13.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.725+0000 7fae0f6aa640 1 -- 172.21.15.78:0/4099619870 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fadec0664a0 msgr2=0x7fadec068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:13.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.725+0000 7fae0f6aa640 1 --2- 172.21.15.78:0/4099619870 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fadec0664a0 0x7fadec068960 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fae04000f70 tx=0x7fae040016c0 comp rx=0 tx=0).stop 2023-12-12T10:13:13.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.725+0000 7fae0f6aa640 1 -- 172.21.15.78:0/4099619870 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae080cdf60 msgr2=0x7fae08071d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:13.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.725+0000 7fae0f6aa640 1 --2- 172.21.15.78:0/4099619870 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae080cdf60 0x7fae08071d30 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fadf80ae040 tx=0x7fadf801ab90 comp rx=0 tx=0).stop 2023-12-12T10:13:13.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.725+0000 7fae0f6aa640 1 -- 172.21.15.78:0/4099619870 shutdown_connections 2023-12-12T10:13:13.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.725+0000 7fae0f6aa640 1 --2- 172.21.15.78:0/4099619870 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fadec0664a0 0x7fadec068960 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:13.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.725+0000 7fae0f6aa640 1 --2- 172.21.15.78:0/4099619870 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fae08143770 0x7fae08072270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:13.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.725+0000 7fae0f6aa640 1 --2- 172.21.15.78:0/4099619870 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fae080cdf60 0x7fae08071d30 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:13.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.725+0000 7fae0f6aa640 1 --2- 172.21.15.78:0/4099619870 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fae08071440 0x7fae08137fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:13.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.725+0000 7fae0f6aa640 1 -- 172.21.15.78:0/4099619870 >> 172.21.15.78:0/4099619870 conn(0x7fae0806a710 msgr2=0x7fae081393d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:13.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.725+0000 7fae0f6aa640 1 -- 172.21.15.78:0/4099619870 shutdown_connections 2023-12-12T10:13:13.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.725+0000 7fae0f6aa640 1 -- 172.21.15.78:0/4099619870 wait complete. 2023-12-12T10:13:13.747 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-12T10:13:13.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.889+0000 7f8a4052a640 1 Processor -- start 2023-12-12T10:13:13.892 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.889+0000 7f8a4052a640 1 -- start start 2023-12-12T10:13:13.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.889+0000 7f8a4052a640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8a38143770 0x7f8a380cdf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:13.894 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.889+0000 7f8a4052a640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8a38071610 0x7f8a3815d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:13.894 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.889+0000 7f8a4052a640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a38070a70 con 0x7f8a380b1e20 2023-12-12T10:13:13.894 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.889+0000 7f8a4052a640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a38070440 con 0x7f8a38071610 2023-12-12T10:13:13.894 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.889+0000 7f8a4052a640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a38143b50 con 0x7f8a38143770 2023-12-12T10:13:13.894 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.889+0000 7f8a3eac7640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8a38071610 0x7f8a3815d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:13.894 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.889+0000 7f8a3eac7640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8a38071610 0x7f8a3815d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:44648/0 (socket says 172.21.15.78:44648) 2023-12-12T10:13:13.894 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.889+0000 7f8a3eac7640 1 -- 172.21.15.78:0/3105806014 learned_addr learned my addr 172.21.15.78:0/3105806014 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:13:13.894 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.889+0000 7f8a3e2c6640 1 --2- 172.21.15.78:0/3105806014 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8a38143770 0x7f8a380cdf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:13.894 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.889+0000 7f8a3eac7640 1 -- 172.21.15.78:0/3105806014 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8a38143770 msgr2=0x7f8a380cdf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:13:13.894 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.889+0000 7f8a3eac7640 1 --2- 172.21.15.78:0/3105806014 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8a38143770 0x7f8a380cdf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:13.894 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.889+0000 7f8a3eac7640 1 -- 172.21.15.78:0/3105806014 >> v1:172.21.15.187:6789/0 conn(0x7f8a380b1e20 legacy=0x7f8a38070f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:13.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.889+0000 7f8a3eac7640 1 -- 172.21.15.78:0/3105806014 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a380ce620 con 0x7f8a38071610 2023-12-12T10:13:13.898 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.893+0000 7f8a3eac7640 1 --2- 172.21.15.78:0/3105806014 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8a38071610 0x7f8a3815d910 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f8a3000d150 tx=0x7f8a3001eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=913e42df583a13a2 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:13.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.893+0000 7f8a3d2c4640 1 -- 172.21.15.78:0/3105806014 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a3000b2d0 con 0x7f8a38071610 2023-12-12T10:13:13.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.893+0000 7f8a3d2c4640 1 -- 172.21.15.78:0/3105806014 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a3000b430 con 0x7f8a38071610 2023-12-12T10:13:13.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.893+0000 7f8a3d2c4640 1 -- 172.21.15.78:0/3105806014 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a300a7b80 con 0x7f8a38071610 2023-12-12T10:13:13.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.893+0000 7f8a4052a640 1 -- 172.21.15.78:0/3105806014 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8a38071610 msgr2=0x7f8a3815d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:13.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.893+0000 7f8a4052a640 1 --2- 172.21.15.78:0/3105806014 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8a38071610 0x7f8a3815d910 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f8a3000d150 tx=0x7f8a3001eb80 comp rx=0 tx=0).stop 2023-12-12T10:13:13.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.893+0000 7f8a4052a640 1 -- 172.21.15.78:0/3105806014 shutdown_connections 2023-12-12T10:13:13.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.893+0000 7f8a4052a640 1 --2- 172.21.15.78:0/3105806014 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8a38071610 0x7f8a3815d910 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:13.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.893+0000 7f8a4052a640 1 --2- 172.21.15.78:0/3105806014 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8a38143770 0x7f8a380cdf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:13.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.893+0000 7f8a4052a640 1 -- 172.21.15.78:0/3105806014 >> 172.21.15.78:0/3105806014 conn(0x7f8a3806a710 msgr2=0x7f8a3806ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:13.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.893+0000 7f8a4052a640 1 -- 172.21.15.78:0/3105806014 shutdown_connections 2023-12-12T10:13:13.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.893+0000 7f8a4052a640 1 -- 172.21.15.78:0/3105806014 wait complete. 2023-12-12T10:13:13.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.893+0000 7f8a4052a640 1 Processor -- start 2023-12-12T10:13:13.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.897+0000 7f8a4052a640 1 -- start start 2023-12-12T10:13:13.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.897+0000 7f8a4052a640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8a38071610 0x7f8a38130990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:13.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.897+0000 7f8a4052a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8a380b1e20 0x7f8a38131960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:13.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.897+0000 7f8a4052a640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8a38143770 0x7f8a380ad800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:13.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.897+0000 7f8a4052a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a381f6620 con 0x7f8a380b1e20 2023-12-12T10:13:13.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.897+0000 7f8a4052a640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a38136a40 con 0x7f8a38071610 2023-12-12T10:13:13.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.897+0000 7f8a4052a640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a38135ec0 con 0x7f8a38143770 2023-12-12T10:13:13.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.897+0000 7f8a3dac5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8a380b1e20 0x7f8a38131960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:13.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.897+0000 7f8a3dac5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8a380b1e20 0x7f8a38131960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:44660/0 (socket says 172.21.15.78:44660) 2023-12-12T10:13:13.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.897+0000 7f8a3dac5640 1 -- 172.21.15.78:0/3046375752 learned_addr learned my addr 172.21.15.78:0/3046375752 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:13:13.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.897+0000 7f8a3e2c6640 1 --2- 172.21.15.78:0/3046375752 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8a38071610 0x7f8a38130990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:13.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.897+0000 7f8a3eac7640 1 --2- 172.21.15.78:0/3046375752 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8a38143770 0x7f8a380ad800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:13.903 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.897+0000 7f8a3dac5640 1 -- 172.21.15.78:0/3046375752 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8a38143770 msgr2=0x7f8a380ad800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:13.904 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.897+0000 7f8a3dac5640 1 --2- 172.21.15.78:0/3046375752 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8a38143770 0x7f8a380ad800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:13.904 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.897+0000 7f8a3dac5640 1 -- 172.21.15.78:0/3046375752 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8a38071610 msgr2=0x7f8a38130990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:13.904 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.897+0000 7f8a3dac5640 1 --2- 172.21.15.78:0/3046375752 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8a38071610 0x7f8a38130990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:13.904 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.897+0000 7f8a3dac5640 1 -- 172.21.15.78:0/3046375752 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a3000bd40 con 0x7f8a380b1e20 2023-12-12T10:13:13.904 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.897+0000 7f8a3dac5640 1 --2- 172.21.15.78:0/3046375752 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8a380b1e20 0x7f8a38131960 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f8a2800c530 tx=0x7f8a2800c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:13.904 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.897+0000 7f8a2effd640 1 -- 172.21.15.78:0/3046375752 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a28005220 con 0x7f8a380b1e20 2023-12-12T10:13:13.904 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.897+0000 7f8a2effd640 1 -- 172.21.15.78:0/3046375752 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a28005380 con 0x7f8a380b1e20 2023-12-12T10:13:13.904 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.897+0000 7f8a2effd640 1 -- 172.21.15.78:0/3046375752 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a28007270 con 0x7f8a380b1e20 2023-12-12T10:13:13.904 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.897+0000 7f8a4052a640 1 -- 172.21.15.78:0/3046375752 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a381361a0 con 0x7f8a380b1e20 2023-12-12T10:13:13.904 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.897+0000 7f8a4052a640 1 -- 172.21.15.78:0/3046375752 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a38135b50 con 0x7f8a380b1e20 2023-12-12T10:13:13.904 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.897+0000 7f8a4052a640 1 -- 172.21.15.78:0/3046375752 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a380671f0 con 0x7f8a380b1e20 2023-12-12T10:13:13.904 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.901+0000 7f8a2effd640 1 -- 172.21.15.78:0/3046375752 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f8a280073d0 con 0x7f8a380b1e20 2023-12-12T10:13:13.905 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.901+0000 7f8a2effd640 1 --2- 172.21.15.78:0/3046375752 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f8a1c066470 0x7f8a1c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:13.905 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.901+0000 7f8a2effd640 1 -- 172.21.15.78:0/3046375752 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f8a28083b50 con 0x7f8a380b1e20 2023-12-12T10:13:13.905 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.901+0000 7f8a3e2c6640 1 --2- 172.21.15.78:0/3046375752 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f8a1c066470 0x7f8a1c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:13.905 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.901+0000 7f8a3e2c6640 1 --2- 172.21.15.78:0/3046375752 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f8a1c066470 0x7f8a1c068930 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f8a3400b930 tx=0x7f8a34008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:13.908 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:13.905+0000 7f8a2effd640 1 -- 172.21.15.78:0/3046375752 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8a28050c00 con 0x7f8a380b1e20 2023-12-12T10:13:14.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.057+0000 7f8a4052a640 1 -- 172.21.15.78:0/3046375752 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f8a381f6760 con 0x7f8a380b1e20 2023-12-12T10:13:14.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.057+0000 7f8a2effd640 1 -- 172.21.15.78:0/3046375752 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f8a28054220 con 0x7f8a380b1e20 2023-12-12T10:13:14.062 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2023-12-12T10:13:14.063 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.061+0000 7f8a4052a640 1 -- 172.21.15.78:0/3046375752 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f8a1c066470 msgr2=0x7f8a1c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:14.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.061+0000 7f8a4052a640 1 --2- 172.21.15.78:0/3046375752 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f8a1c066470 0x7f8a1c068930 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f8a3400b930 tx=0x7f8a34008040 comp rx=0 tx=0).stop 2023-12-12T10:13:14.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.061+0000 7f8a4052a640 1 -- 172.21.15.78:0/3046375752 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8a380b1e20 msgr2=0x7f8a38131960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:14.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.061+0000 7f8a4052a640 1 --2- 172.21.15.78:0/3046375752 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8a380b1e20 0x7f8a38131960 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f8a2800c530 tx=0x7f8a2800c9f0 comp rx=0 tx=0).stop 2023-12-12T10:13:14.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.061+0000 7f8a4052a640 1 -- 172.21.15.78:0/3046375752 shutdown_connections 2023-12-12T10:13:14.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.061+0000 7f8a4052a640 1 --2- 172.21.15.78:0/3046375752 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f8a1c066470 0x7f8a1c068930 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:14.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.061+0000 7f8a4052a640 1 --2- 172.21.15.78:0/3046375752 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8a38143770 0x7f8a380ad800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:14.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.061+0000 7f8a4052a640 1 --2- 172.21.15.78:0/3046375752 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8a380b1e20 0x7f8a38131960 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:14.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.061+0000 7f8a4052a640 1 --2- 172.21.15.78:0/3046375752 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8a38071610 0x7f8a38130990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:14.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.061+0000 7f8a4052a640 1 -- 172.21.15.78:0/3046375752 >> 172.21.15.78:0/3046375752 conn(0x7f8a3806a710 msgr2=0x7f8a3813bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:14.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.061+0000 7f8a4052a640 1 -- 172.21.15.78:0/3046375752 shutdown_connections 2023-12-12T10:13:14.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.061+0000 7f8a4052a640 1 -- 172.21.15.78:0/3046375752 wait complete. 2023-12-12T10:13:14.083 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-12T10:13:14.222 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.217+0000 7f328f49a640 1 Processor -- start 2023-12-12T10:13:14.222 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.217+0000 7f328f49a640 1 -- start start 2023-12-12T10:13:14.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.221+0000 7f328f49a640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f3288071610 0x7f3288164ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:14.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.221+0000 7f328f49a640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3288070a70 con 0x7f32880cdf60 2023-12-12T10:13:14.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.221+0000 7f328f49a640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32880ce3c0 con 0x7f3288143770 2023-12-12T10:13:14.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.221+0000 7f328f49a640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f328815e920 con 0x7f3288071610 2023-12-12T10:13:14.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.221+0000 7f328ca35640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f32880cdf60 0x7f3288070f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:35628/0 (socket says 172.21.15.78:35628) 2023-12-12T10:13:14.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.221+0000 7f328ca35640 1 -- 172.21.15.78:0/4050987512 learned_addr learned my addr 172.21.15.78:0/4050987512 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-12-12T10:13:14.224 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.221+0000 7f328da37640 1 --2- 172.21.15.78:0/4050987512 >> v2:172.21.15.187:3300/0 conn(0x7f3288071610 0x7f3288164ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:14.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.221+0000 7f327ffff640 1 -- 172.21.15.78:0/4050987512 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1512731190 0 0) 0x7f3288070a70 con 0x7f32880cdf60 2023-12-12T10:13:14.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.221+0000 7f327ffff640 1 -- 172.21.15.78:0/4050987512 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3274003530 con 0x7f32880cdf60 2023-12-12T10:13:14.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.221+0000 7f327ffff640 1 -- 172.21.15.78:0/4050987512 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2966645150 0 0) 0x7f3274003530 con 0x7f32880cdf60 2023-12-12T10:13:14.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.221+0000 7f328da37640 1 -- 172.21.15.78:0/4050987512 >> v1:172.21.15.187:6789/0 conn(0x7f3288143770 legacy=0x7f32880b1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:14.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.221+0000 7f328da37640 1 -- 172.21.15.78:0/4050987512 >> v1:172.21.15.78:6789/0 conn(0x7f32880cdf60 legacy=0x7f3288070f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:14.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.221+0000 7f328da37640 1 -- 172.21.15.78:0/4050987512 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3288070440 con 0x7f3288071610 2023-12-12T10:13:14.227 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.225+0000 7f328da37640 1 --2- 172.21.15.78:0/4050987512 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3288071610 0x7f3288164ca0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f3288070630 tx=0x7f328001c670 comp rx=0 tx=0).ready entity=mon.1 client_cookie=34c212968f9d1c6b server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:14.227 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.225+0000 7f327ffff640 1 -- 172.21.15.78:0/4050987512 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3278001680 con 0x7f3288071610 2023-12-12T10:13:14.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.225+0000 7f327ffff640 1 -- 172.21.15.78:0/4050987512 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32800a6500 con 0x7f3288071610 2023-12-12T10:13:14.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.225+0000 7f327ffff640 1 -- 172.21.15.78:0/4050987512 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32800a6890 con 0x7f3288071610 2023-12-12T10:13:14.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.225+0000 7f328f49a640 1 -- 172.21.15.78:0/4050987512 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3288071610 msgr2=0x7f3288164ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:14.229 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.225+0000 7f328f49a640 1 --2- 172.21.15.78:0/4050987512 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3288071610 0x7f3288164ca0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f3288070630 tx=0x7f328001c670 comp rx=0 tx=0).stop 2023-12-12T10:13:14.229 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.225+0000 7f328f49a640 1 -- 172.21.15.78:0/4050987512 shutdown_connections 2023-12-12T10:13:14.229 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.225+0000 7f328f49a640 1 --2- 172.21.15.78:0/4050987512 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3288071610 0x7f3288164ca0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:14.229 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.225+0000 7f328f49a640 1 -- 172.21.15.78:0/4050987512 >> 172.21.15.78:0/4050987512 conn(0x7f328806a710 msgr2=0x7f328806ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:14.229 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.225+0000 7f328f49a640 1 -- 172.21.15.78:0/4050987512 shutdown_connections 2023-12-12T10:13:14.229 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.225+0000 7f328f49a640 1 -- 172.21.15.78:0/4050987512 wait complete. 2023-12-12T10:13:14.230 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.225+0000 7f328f49a640 1 Processor -- start 2023-12-12T10:13:14.230 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.225+0000 7f328f49a640 1 -- start start 2023-12-12T10:13:14.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.225+0000 7f328f49a640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3288071610 0x7f3288159370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:14.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.225+0000 7f328f49a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32880cdf60 0x7f3288139fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:14.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.225+0000 7f328f49a640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3288143770 0x7f328813ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:14.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.225+0000 7f328f49a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3288135230 con 0x7f32880cdf60 2023-12-12T10:13:14.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.225+0000 7f328f49a640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3288138ce0 con 0x7f3288071610 2023-12-12T10:13:14.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.225+0000 7f328f49a640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3288139b40 con 0x7f3288143770 2023-12-12T10:13:14.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.229+0000 7f328ca35640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32880cdf60 0x7f3288139fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:14.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.229+0000 7f328ca35640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32880cdf60 0x7f3288139fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:44674/0 (socket says 172.21.15.78:44674) 2023-12-12T10:13:14.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.229+0000 7f328ca35640 1 -- 172.21.15.78:0/1362238050 learned_addr learned my addr 172.21.15.78:0/1362238050 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:13:14.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.229+0000 7f328ca35640 1 -- 172.21.15.78:0/1362238050 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3288143770 msgr2=0x7f328813ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:14.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.229+0000 7f328ca35640 1 --2- 172.21.15.78:0/1362238050 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3288143770 0x7f328813ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:14.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.229+0000 7f328ca35640 1 -- 172.21.15.78:0/1362238050 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3288071610 msgr2=0x7f3288159370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:14.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.229+0000 7f328d236640 1 --2- 172.21.15.78:0/1362238050 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3288071610 0x7f3288159370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:14.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.229+0000 7f328ca35640 1 --2- 172.21.15.78:0/1362238050 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3288071610 0x7f3288159370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:14.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.229+0000 7f328ca35640 1 -- 172.21.15.78:0/1362238050 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3280009a70 con 0x7f32880cdf60 2023-12-12T10:13:14.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.229+0000 7f328d236640 1 --2- 172.21.15.78:0/1362238050 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3288071610 0x7f3288159370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T10:13:14.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.229+0000 7f328ca35640 1 --2- 172.21.15.78:0/1362238050 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32880cdf60 0x7f3288139fd0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f327800c760 tx=0x7f327800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:14.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.229+0000 7f327dffb640 1 -- 172.21.15.78:0/1362238050 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32780072d0 con 0x7f32880cdf60 2023-12-12T10:13:14.234 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.229+0000 7f327dffb640 1 -- 172.21.15.78:0/1362238050 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3278007450 con 0x7f32880cdf60 2023-12-12T10:13:14.234 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.229+0000 7f327dffb640 1 -- 172.21.15.78:0/1362238050 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32780047f0 con 0x7f32880cdf60 2023-12-12T10:13:14.234 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.229+0000 7f328f49a640 1 -- 172.21.15.78:0/1362238050 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3288138f30 con 0x7f32880cdf60 2023-12-12T10:13:14.234 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.229+0000 7f328f49a640 1 -- 172.21.15.78:0/1362238050 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32881394f0 con 0x7f32880cdf60 2023-12-12T10:13:14.234 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.229+0000 7f328f49a640 1 -- 172.21.15.78:0/1362238050 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32880671f0 con 0x7f32880cdf60 2023-12-12T10:13:14.234 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.229+0000 7f327dffb640 1 -- 172.21.15.78:0/1362238050 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3278004950 con 0x7f32880cdf60 2023-12-12T10:13:14.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.233+0000 7f327dffb640 1 --2- 172.21.15.78:0/1362238050 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f326c0664a0 0x7f326c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:14.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.233+0000 7f327dffb640 1 -- 172.21.15.78:0/1362238050 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f32780836a0 con 0x7f32880cdf60 2023-12-12T10:13:14.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.233+0000 7f328d236640 1 --2- 172.21.15.78:0/1362238050 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f326c0664a0 0x7f326c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:14.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.233+0000 7f328d236640 1 --2- 172.21.15.78:0/1362238050 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f326c0664a0 0x7f326c068960 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f328813eda0 tx=0x7f3284009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:14.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.237+0000 7f327dffb640 1 -- 172.21.15.78:0/1362238050 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3278050750 con 0x7f32880cdf60 2023-12-12T10:13:14.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.401+0000 7f328f49a640 1 -- 172.21.15.78:0/1362238050 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f3288067530 con 0x7f32880cdf60 2023-12-12T10:13:14.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.401+0000 7f327dffb640 1 -- 172.21.15.78:0/1362238050 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f3278053d70 con 0x7f32880cdf60 2023-12-12T10:13:14.404 INFO:teuthology.orchestra.run.smithi078.stderr:listed 0 entries 2023-12-12T10:13:14.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.401+0000 7f328f49a640 1 -- 172.21.15.78:0/1362238050 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f326c0664a0 msgr2=0x7f326c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:14.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.401+0000 7f328f49a640 1 --2- 172.21.15.78:0/1362238050 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f326c0664a0 0x7f326c068960 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f328813eda0 tx=0x7f3284009040 comp rx=0 tx=0).stop 2023-12-12T10:13:14.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.401+0000 7f328f49a640 1 -- 172.21.15.78:0/1362238050 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32880cdf60 msgr2=0x7f3288139fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:14.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.401+0000 7f328f49a640 1 --2- 172.21.15.78:0/1362238050 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32880cdf60 0x7f3288139fd0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f327800c760 tx=0x7f327800cc20 comp rx=0 tx=0).stop 2023-12-12T10:13:14.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.401+0000 7f328f49a640 1 -- 172.21.15.78:0/1362238050 shutdown_connections 2023-12-12T10:13:14.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.401+0000 7f328f49a640 1 --2- 172.21.15.78:0/1362238050 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f326c0664a0 0x7f326c068960 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:14.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.401+0000 7f328f49a640 1 --2- 172.21.15.78:0/1362238050 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3288143770 0x7f328813ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:14.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.401+0000 7f328f49a640 1 --2- 172.21.15.78:0/1362238050 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f32880cdf60 0x7f3288139fd0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:14.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.401+0000 7f328f49a640 1 --2- 172.21.15.78:0/1362238050 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3288071610 0x7f3288159370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:14.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.401+0000 7f328f49a640 1 -- 172.21.15.78:0/1362238050 >> 172.21.15.78:0/1362238050 conn(0x7f328806a710 msgr2=0x7f328806d4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:14.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.401+0000 7f328f49a640 1 -- 172.21.15.78:0/1362238050 shutdown_connections 2023-12-12T10:13:14.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.401+0000 7f328f49a640 1 -- 172.21.15.78:0/1362238050 wait complete. 2023-12-12T10:13:14.425 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi187.front.sepia.ceph.com... 2023-12-12T10:13:14.426 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T10:13:14.426 DEBUG:teuthology.orchestra.run.smithi187:> sudo fusermount -u /home/ubuntu/cephtest/mnt.3 2023-12-12T10:13:14.450 INFO:teuthology.orchestra.run:waiting for 300 2023-12-12T10:13:14.451 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi187.front.sepia.ceph.com 2023-12-12T10:13:14.451 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T10:13:14.451 DEBUG:teuthology.orchestra.run.smithi187:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-12-12T10:13:14.506 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-12-12T10:13:14.507 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-12T10:13:14.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.641+0000 7f536a617640 1 Processor -- start 2023-12-12T10:13:14.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.641+0000 7f536a617640 1 -- start start 2023-12-12T10:13:14.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.641+0000 7f536a617640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f536415d3c0 0x7f53640d3b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:14.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.641+0000 7f536a617640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f53640ce670 0x7f53640d15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:14.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.641+0000 7f536a617640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53640b3250 con 0x7f53640d1ae0 2023-12-12T10:13:14.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.641+0000 7f536a617640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53640d1f70 con 0x7f536415d3c0 2023-12-12T10:13:14.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.641+0000 7f536a617640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53640cee50 con 0x7f53640ce670 2023-12-12T10:13:14.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.641+0000 7f5363fff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f536415d3c0 0x7f53640d3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:14.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.641+0000 7f5363fff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f536415d3c0 0x7f53640d3b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:44690/0 (socket says 172.21.15.78:44690) 2023-12-12T10:13:14.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.641+0000 7f5363fff640 1 -- 172.21.15.78:0/761961218 learned_addr learned my addr 172.21.15.78:0/761961218 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:13:14.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.641+0000 7f53637fe640 1 --2- 172.21.15.78:0/761961218 >> v2:172.21.15.187:3300/0 conn(0x7f53640ce670 0x7f53640d15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:14.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.641+0000 7f5363fff640 1 -- 172.21.15.78:0/761961218 >> v2:172.21.15.187:3300/0 conn(0x7f53640ce670 msgr2=0x7f53640d15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:13:14.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.641+0000 7f5363fff640 1 --2- 172.21.15.78:0/761961218 >> v2:172.21.15.187:3300/0 conn(0x7f53640ce670 0x7f53640d15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:14.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.641+0000 7f5363fff640 1 -- 172.21.15.78:0/761961218 >> v1:172.21.15.78:6789/0 conn(0x7f53640d1ae0 legacy=0x7f53640cf680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:14.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.641+0000 7f5363fff640 1 -- 172.21.15.78:0/761961218 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53640b2920 con 0x7f536415d3c0 2023-12-12T10:13:14.648 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.645+0000 7f5363fff640 1 --2- 172.21.15.78:0/761961218 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f536415d3c0 0x7f53640d3b10 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f5354009870 tx=0x7f535401ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56cd7ebebf43bfd9 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:14.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.645+0000 7f5362ffd640 1 -- 172.21.15.78:0/761961218 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53540a89f0 con 0x7f536415d3c0 2023-12-12T10:13:14.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.645+0000 7f5362ffd640 1 -- 172.21.15.78:0/761961218 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53540a8b50 con 0x7f536415d3c0 2023-12-12T10:13:14.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.645+0000 7f5362ffd640 1 -- 172.21.15.78:0/761961218 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53540b0440 con 0x7f536415d3c0 2023-12-12T10:13:14.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.645+0000 7f536a617640 1 -- 172.21.15.78:0/761961218 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f536415d3c0 msgr2=0x7f53640d3b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:14.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.645+0000 7f536a617640 1 --2- 172.21.15.78:0/761961218 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f536415d3c0 0x7f53640d3b10 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f5354009870 tx=0x7f535401ecf0 comp rx=0 tx=0).stop 2023-12-12T10:13:14.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.645+0000 7f536a617640 1 -- 172.21.15.78:0/761961218 shutdown_connections 2023-12-12T10:13:14.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.645+0000 7f536a617640 1 --2- 172.21.15.78:0/761961218 >> v2:172.21.15.187:3300/0 conn(0x7f53640ce670 0x7f53640d15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:14.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.645+0000 7f536a617640 1 --2- 172.21.15.78:0/761961218 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f536415d3c0 0x7f53640d3b10 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:14.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.645+0000 7f536a617640 1 -- 172.21.15.78:0/761961218 >> 172.21.15.78:0/761961218 conn(0x7f536409c2a0 msgr2=0x7f53640d2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:14.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.645+0000 7f536a617640 1 -- 172.21.15.78:0/761961218 shutdown_connections 2023-12-12T10:13:14.650 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.645+0000 7f536a617640 1 -- 172.21.15.78:0/761961218 wait complete. 2023-12-12T10:13:14.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.649+0000 7f536a617640 1 Processor -- start 2023-12-12T10:13:14.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.649+0000 7f536a617640 1 -- start start 2023-12-12T10:13:14.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.649+0000 7f536a617640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f53640ce670 0x7f53640ccdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:14.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.649+0000 7f536a617640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f53640d1ae0 0x7f53641f2db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:14.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.649+0000 7f536a617640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f536415d3c0 0x7f53641f32f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:14.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.649+0000 7f536a617640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53640b60b0 con 0x7f53640d1ae0 2023-12-12T10:13:14.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.649+0000 7f536a617640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5364159d70 con 0x7f53640ce670 2023-12-12T10:13:14.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.649+0000 7f536a617640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53640cd300 con 0x7f536415d3c0 2023-12-12T10:13:14.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.649+0000 7f53637fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f53640d1ae0 0x7f53641f2db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:14.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.649+0000 7f53637fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f53640d1ae0 0x7f53641f2db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:44702/0 (socket says 172.21.15.78:44702) 2023-12-12T10:13:14.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.649+0000 7f53637fe640 1 -- 172.21.15.78:0/2348011428 learned_addr learned my addr 172.21.15.78:0/2348011428 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:13:14.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.649+0000 7f5363fff640 1 --2- 172.21.15.78:0/2348011428 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f53640ce670 0x7f53640ccdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:14.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.649+0000 7f5368bb4640 1 --2- 172.21.15.78:0/2348011428 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f536415d3c0 0x7f53641f32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:14.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.649+0000 7f53637fe640 1 -- 172.21.15.78:0/2348011428 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f536415d3c0 msgr2=0x7f53641f32f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:14.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.649+0000 7f53637fe640 1 --2- 172.21.15.78:0/2348011428 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f536415d3c0 0x7f53641f32f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:14.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.649+0000 7f53637fe640 1 -- 172.21.15.78:0/2348011428 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f53640ce670 msgr2=0x7f53640ccdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:14.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.649+0000 7f53637fe640 1 --2- 172.21.15.78:0/2348011428 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f53640ce670 0x7f53640ccdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:14.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.649+0000 7f53637fe640 1 -- 172.21.15.78:0/2348011428 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53540094d0 con 0x7f53640d1ae0 2023-12-12T10:13:14.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.649+0000 7f53637fe640 1 --2- 172.21.15.78:0/2348011428 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f53640d1ae0 0x7f53641f2db0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f535800d620 tx=0x7f535800dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:14.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.649+0000 7f5360ff9640 1 -- 172.21.15.78:0/2348011428 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f535800b620 con 0x7f53640d1ae0 2023-12-12T10:13:14.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.649+0000 7f5360ff9640 1 -- 172.21.15.78:0/2348011428 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f535800b780 con 0x7f53640d1ae0 2023-12-12T10:13:14.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.649+0000 7f536a617640 1 -- 172.21.15.78:0/2348011428 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53641f0560 con 0x7f53640d1ae0 2023-12-12T10:13:14.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.649+0000 7f5360ff9640 1 -- 172.21.15.78:0/2348011428 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f535800bb10 con 0x7f53640d1ae0 2023-12-12T10:13:14.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.649+0000 7f536a617640 1 -- 172.21.15.78:0/2348011428 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53640cb850 con 0x7f53640d1ae0 2023-12-12T10:13:14.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.649+0000 7f536a617640 1 -- 172.21.15.78:0/2348011428 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5364067530 con 0x7f53640d1ae0 2023-12-12T10:13:14.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.653+0000 7f5360ff9640 1 -- 172.21.15.78:0/2348011428 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f535800bc70 con 0x7f53640d1ae0 2023-12-12T10:13:14.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.653+0000 7f5360ff9640 1 --2- 172.21.15.78:0/2348011428 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f5350066470 0x7f5350068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:14.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.653+0000 7f5360ff9640 1 -- 172.21.15.78:0/2348011428 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f5358084310 con 0x7f53640d1ae0 2023-12-12T10:13:14.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.653+0000 7f5363fff640 1 --2- 172.21.15.78:0/2348011428 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f5350066470 0x7f5350068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:14.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.653+0000 7f5363fff640 1 --2- 172.21.15.78:0/2348011428 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f5350066470 0x7f5350068930 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f53540b2000 tx=0x7f5354009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:14.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.657+0000 7f5360ff9640 1 -- 172.21.15.78:0/2348011428 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5358051510 con 0x7f53640d1ae0 2023-12-12T10:13:14.843 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.837+0000 7f536a617640 1 -- 172.21.15.78:0/2348011428 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f53641f0560 con 0x7f53640d1ae0 2023-12-12T10:13:14.843 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.841+0000 7f5360ff9640 1 -- 172.21.15.78:0/2348011428 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4912 (secure 0 0 0) 0x7f53641f0560 con 0x7f53640d1ae0 2023-12-12T10:13:14.844 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:13:14.844 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/3747609982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":3747609982},{"type":"v1","addr":"172.21.15.187:6834","nonce":3747609982}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4282,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/3245919280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":3245919280},{"type":"v1","addr":"172.21.15.187:6835","nonce":3245919280}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4293,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/3902814576","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":3902814576},{"type":"v1","addr":"172.21.15.78:6835","nonce":3902814576}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-12T10:12:09.200933+0000","modified":"2023-12-12T10:12:26.296409+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4296},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4296":{"gid":4296,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.78:6837/739552946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":739552946},{"type":"v1","addr":"172.21.15.78:6837","nonce":739552946}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-12T10:13:14.844 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 9 2023-12-12T10:13:14.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.841+0000 7f536a617640 1 -- 172.21.15.78:0/2348011428 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f5350066470 msgr2=0x7f5350068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:14.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.841+0000 7f536a617640 1 --2- 172.21.15.78:0/2348011428 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f5350066470 0x7f5350068930 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f53540b2000 tx=0x7f5354009040 comp rx=0 tx=0).stop 2023-12-12T10:13:14.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.841+0000 7f536a617640 1 -- 172.21.15.78:0/2348011428 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f53640d1ae0 msgr2=0x7f53641f2db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:14.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.841+0000 7f536a617640 1 --2- 172.21.15.78:0/2348011428 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f53640d1ae0 0x7f53641f2db0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f535800d620 tx=0x7f535800dae0 comp rx=0 tx=0).stop 2023-12-12T10:13:14.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.841+0000 7f536a617640 1 -- 172.21.15.78:0/2348011428 shutdown_connections 2023-12-12T10:13:14.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.841+0000 7f536a617640 1 --2- 172.21.15.78:0/2348011428 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f5350066470 0x7f5350068930 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:14.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.841+0000 7f536a617640 1 --2- 172.21.15.78:0/2348011428 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f536415d3c0 0x7f53641f32f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:14.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.841+0000 7f536a617640 1 --2- 172.21.15.78:0/2348011428 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f53640d1ae0 0x7f53641f2db0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:14.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.841+0000 7f536a617640 1 --2- 172.21.15.78:0/2348011428 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f53640ce670 0x7f53640ccdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:14.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.841+0000 7f536a617640 1 -- 172.21.15.78:0/2348011428 >> 172.21.15.78:0/2348011428 conn(0x7f536409c2a0 msgr2=0x7f536406afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:14.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.841+0000 7f536a617640 1 -- 172.21.15.78:0/2348011428 shutdown_connections 2023-12-12T10:13:14.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.841+0000 7f536a617640 1 -- 172.21.15.78:0/2348011428 wait complete. 2023-12-12T10:13:14.865 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T10:13:15.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:14.997+0000 7ff3d392a640 1 Processor -- start 2023-12-12T10:13:15.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.001+0000 7ff3d392a640 1 -- start start 2023-12-12T10:13:15.005 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.001+0000 7ff3d392a640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff3cc15d3c0 0x7ff3cc0d3b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:15.005 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.001+0000 7ff3d392a640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7ff3cc0ce670 0x7ff3cc0d15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:15.005 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.001+0000 7ff3d392a640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3cc0b3250 con 0x7ff3cc0d1ae0 2023-12-12T10:13:15.005 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.001+0000 7ff3d392a640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3cc0d1f70 con 0x7ff3cc15d3c0 2023-12-12T10:13:15.005 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.001+0000 7ff3d392a640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3cc0cee50 con 0x7ff3cc0ce670 2023-12-12T10:13:15.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.001+0000 7ff3d16c6640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff3cc15d3c0 0x7ff3cc0d3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:15.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.001+0000 7ff3d16c6640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff3cc15d3c0 0x7ff3cc0d3b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:44708/0 (socket says 172.21.15.78:44708) 2023-12-12T10:13:15.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.001+0000 7ff3d16c6640 1 -- 172.21.15.78:0/3500694047 learned_addr learned my addr 172.21.15.78:0/3500694047 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:13:15.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.001+0000 7ff3d1ec7640 1 --1- 172.21.15.78:0/3500694047 >> v1:172.21.15.78:6789/0 conn(0x7ff3cc0d1ae0 0x7ff3cc0cf680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:35660/0 (socket says 172.21.15.78:35660) 2023-12-12T10:13:15.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.001+0000 7ff3d0ec5640 1 --2- 172.21.15.78:0/3500694047 >> v2:172.21.15.187:3300/0 conn(0x7ff3cc0ce670 0x7ff3cc0d15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:15.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.001+0000 7ff3d16c6640 1 -- 172.21.15.78:0/3500694047 >> v2:172.21.15.187:3300/0 conn(0x7ff3cc0ce670 msgr2=0x7ff3cc0d15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:13:15.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.001+0000 7ff3d16c6640 1 --2- 172.21.15.78:0/3500694047 >> v2:172.21.15.187:3300/0 conn(0x7ff3cc0ce670 0x7ff3cc0d15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:15.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.001+0000 7ff3d16c6640 1 -- 172.21.15.78:0/3500694047 >> v1:172.21.15.78:6789/0 conn(0x7ff3cc0d1ae0 legacy=0x7ff3cc0cf680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:15.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.001+0000 7ff3d16c6640 1 -- 172.21.15.78:0/3500694047 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3cc0b2920 con 0x7ff3cc15d3c0 2023-12-12T10:13:15.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.005+0000 7ff3d16c6640 1 --2- 172.21.15.78:0/3500694047 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff3cc15d3c0 0x7ff3cc0d3b10 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7ff3c8009870 tx=0x7ff3c801ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b22642eb93509e80 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:15.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.005+0000 7ff3c3fff640 1 -- 172.21.15.78:0/3500694047 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3c80a89f0 con 0x7ff3cc15d3c0 2023-12-12T10:13:15.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.005+0000 7ff3c3fff640 1 -- 172.21.15.78:0/3500694047 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3c80a8b50 con 0x7ff3cc15d3c0 2023-12-12T10:13:15.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.005+0000 7ff3c3fff640 1 -- 172.21.15.78:0/3500694047 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3c80b0440 con 0x7ff3cc15d3c0 2023-12-12T10:13:15.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.005+0000 7ff3d392a640 1 -- 172.21.15.78:0/3500694047 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff3cc15d3c0 msgr2=0x7ff3cc0d3b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:15.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.005+0000 7ff3d392a640 1 --2- 172.21.15.78:0/3500694047 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff3cc15d3c0 0x7ff3cc0d3b10 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7ff3c8009870 tx=0x7ff3c801ecf0 comp rx=0 tx=0).stop 2023-12-12T10:13:15.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.005+0000 7ff3d392a640 1 -- 172.21.15.78:0/3500694047 shutdown_connections 2023-12-12T10:13:15.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.005+0000 7ff3d392a640 1 --2- 172.21.15.78:0/3500694047 >> v2:172.21.15.187:3300/0 conn(0x7ff3cc0ce670 0x7ff3cc0d15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:15.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.005+0000 7ff3d392a640 1 --2- 172.21.15.78:0/3500694047 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff3cc15d3c0 0x7ff3cc0d3b10 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:15.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.005+0000 7ff3d392a640 1 -- 172.21.15.78:0/3500694047 >> 172.21.15.78:0/3500694047 conn(0x7ff3cc09c2a0 msgr2=0x7ff3cc0d2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:15.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.005+0000 7ff3d392a640 1 -- 172.21.15.78:0/3500694047 shutdown_connections 2023-12-12T10:13:15.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.005+0000 7ff3d392a640 1 -- 172.21.15.78:0/3500694047 wait complete. 2023-12-12T10:13:15.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.005+0000 7ff3d392a640 1 Processor -- start 2023-12-12T10:13:15.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.009+0000 7ff3d392a640 1 -- start start 2023-12-12T10:13:15.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.009+0000 7ff3d392a640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff3cc0ce670 0x7ff3cc0ccdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:15.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.009+0000 7ff3d392a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff3cc0d1ae0 0x7ff3cc1f2db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:15.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.009+0000 7ff3d392a640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff3cc15d3c0 0x7ff3cc1f32f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:15.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.009+0000 7ff3d392a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3cc0b60b0 con 0x7ff3cc0d1ae0 2023-12-12T10:13:15.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.009+0000 7ff3d392a640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3cc159d70 con 0x7ff3cc0ce670 2023-12-12T10:13:15.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.009+0000 7ff3d392a640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3cc0cd300 con 0x7ff3cc15d3c0 2023-12-12T10:13:15.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.009+0000 7ff3d0ec5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff3cc0d1ae0 0x7ff3cc1f2db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:15.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.009+0000 7ff3d0ec5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff3cc0d1ae0 0x7ff3cc1f2db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:44718/0 (socket says 172.21.15.78:44718) 2023-12-12T10:13:15.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.009+0000 7ff3d0ec5640 1 -- 172.21.15.78:0/2196561865 learned_addr learned my addr 172.21.15.78:0/2196561865 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:13:15.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.009+0000 7ff3d16c6640 1 --2- 172.21.15.78:0/2196561865 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff3cc0ce670 0x7ff3cc0ccdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:15.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.009+0000 7ff3d1ec7640 1 --2- 172.21.15.78:0/2196561865 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff3cc15d3c0 0x7ff3cc1f32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:15.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.009+0000 7ff3d0ec5640 1 -- 172.21.15.78:0/2196561865 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff3cc15d3c0 msgr2=0x7ff3cc1f32f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:15.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.009+0000 7ff3d0ec5640 1 --2- 172.21.15.78:0/2196561865 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff3cc15d3c0 0x7ff3cc1f32f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:15.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.009+0000 7ff3d0ec5640 1 -- 172.21.15.78:0/2196561865 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff3cc0ce670 msgr2=0x7ff3cc0ccdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:15.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.009+0000 7ff3d0ec5640 1 --2- 172.21.15.78:0/2196561865 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff3cc0ce670 0x7ff3cc0ccdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:15.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.009+0000 7ff3d0ec5640 1 -- 172.21.15.78:0/2196561865 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3c80094d0 con 0x7ff3cc0d1ae0 2023-12-12T10:13:15.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.009+0000 7ff3d0ec5640 1 --2- 172.21.15.78:0/2196561865 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff3cc0d1ae0 0x7ff3cc1f2db0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7ff3bc00d620 tx=0x7ff3bc00dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:15.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.009+0000 7ff3c1ffb640 1 -- 172.21.15.78:0/2196561865 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3bc00b620 con 0x7ff3cc0d1ae0 2023-12-12T10:13:15.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.009+0000 7ff3c1ffb640 1 -- 172.21.15.78:0/2196561865 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3bc00b780 con 0x7ff3cc0d1ae0 2023-12-12T10:13:15.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.009+0000 7ff3d392a640 1 -- 172.21.15.78:0/2196561865 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3cc1f0560 con 0x7ff3cc0d1ae0 2023-12-12T10:13:15.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.009+0000 7ff3c1ffb640 1 -- 172.21.15.78:0/2196561865 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3bc00bb10 con 0x7ff3cc0d1ae0 2023-12-12T10:13:15.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.009+0000 7ff3d392a640 1 -- 172.21.15.78:0/2196561865 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3cc0cb850 con 0x7ff3cc0d1ae0 2023-12-12T10:13:15.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.009+0000 7ff3d392a640 1 -- 172.21.15.78:0/2196561865 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3cc067530 con 0x7ff3cc0d1ae0 2023-12-12T10:13:15.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.013+0000 7ff3c1ffb640 1 -- 172.21.15.78:0/2196561865 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff3bc00bc70 con 0x7ff3cc0d1ae0 2023-12-12T10:13:15.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.013+0000 7ff3c1ffb640 1 --2- 172.21.15.78:0/2196561865 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7ff3b0066470 0x7ff3b0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:15.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.013+0000 7ff3c1ffb640 1 -- 172.21.15.78:0/2196561865 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7ff3bc084320 con 0x7ff3cc0d1ae0 2023-12-12T10:13:15.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.013+0000 7ff3d16c6640 1 --2- 172.21.15.78:0/2196561865 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7ff3b0066470 0x7ff3b0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:15.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.013+0000 7ff3d16c6640 1 --2- 172.21.15.78:0/2196561865 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7ff3b0066470 0x7ff3b0068930 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7ff3c80b2000 tx=0x7ff3c8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:15.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.017+0000 7ff3c1ffb640 1 -- 172.21.15.78:0/2196561865 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff3bc051520 con 0x7ff3cc0d1ae0 2023-12-12T10:13:15.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.169+0000 7ff3d392a640 1 -- 172.21.15.78:0/2196561865 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff3cc1f0560 con 0x7ff3cc0d1ae0 2023-12-12T10:13:15.176 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.173+0000 7ff3c1ffb640 1 -- 172.21.15.78:0/2196561865 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18701 (secure 0 0 0) 0x7ff3cc1f0560 con 0x7ff3cc0d1ae0 2023-12-12T10:13:15.176 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:13:15.176 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":26,"fsid":"fc81937c-bd26-483c-952b-d1324fcb0c9e","created":"2023-12-12T10:11:44.020214+0000","modified":"2023-12-12T10:12:50.919344+0000","last_up_change":"2023-12-12T10:11:56.278318+0000","last_in_change":"2023-12-12T10:11:46.553610+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T10:11:57.053584+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-12T10:12:07.454450+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-12T10:12:08.182909+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-12T10:12:11.977952+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"22dfdedf-5f6c-4b20-9f6c-30517a1db70a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6809","nonce":3345683600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6811","nonce":3345683600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6815","nonce":3345683600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6813","nonce":3345683600}]},"public_addr":"172.21.15.78:6809/3345683600","cluster_addr":"172.21.15.78:6811/3345683600","heartbeat_back_addr":"172.21.15.78:6815/3345683600","heartbeat_front_addr":"172.21.15.78:6813/3345683600","state":["exists","up"]},{"osd":1,"uuid":"be34a7f3-a69a-462e-9ddf-5e537448dba2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6801","nonce":962652768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6803","nonce":962652768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6807","nonce":962652768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6805","nonce":962652768}]},"public_addr":"172.21.15.78:6801/962652768","cluster_addr":"172.21.15.78:6803/962652768","heartbeat_back_addr":"172.21.15.78:6807/962652768","heartbeat_front_addr":"172.21.15.78:6805/962652768","state":["exists","up"]},{"osd":2,"uuid":"55b381de-5f56-4b14-80f7-e6e41e084a13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6818","nonce":2910206054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6822","nonce":2910206054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6829","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6831","nonce":2910206054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6826","nonce":2910206054}]},"public_addr":"172.21.15.78:6818/2910206054","cluster_addr":"172.21.15.78:6822/2910206054","heartbeat_back_addr":"172.21.15.78:6831/2910206054","heartbeat_front_addr":"172.21.15.78:6826/2910206054","state":["exists","up"]},{"osd":3,"uuid":"d7682de1-25cb-4cec-869f-8851c28b0e6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6819","nonce":3750796703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6821","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6823","nonce":3750796703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6830","nonce":3750796703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6825","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6827","nonce":3750796703}]},"public_addr":"172.21.15.78:6819/3750796703","cluster_addr":"172.21.15.78:6823/3750796703","heartbeat_back_addr":"172.21.15.78:6830/3750796703","heartbeat_front_addr":"172.21.15.78:6827/3750796703","state":["exists","up"]},{"osd":4,"uuid":"8279815a-d6c7-4199-871e-d28971b9dc07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6809","nonce":2944277204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6811","nonce":2944277204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6815","nonce":2944277204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6813","nonce":2944277204}]},"public_addr":"172.21.15.187:6809/2944277204","cluster_addr":"172.21.15.187:6811/2944277204","heartbeat_back_addr":"172.21.15.187:6815/2944277204","heartbeat_front_addr":"172.21.15.187:6813/2944277204","state":["exists","up"]},{"osd":5,"uuid":"0a714c65-f8ce-4340-968f-11a799677ef3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6801","nonce":185858620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6803","nonce":185858620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6807","nonce":185858620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6805","nonce":185858620}]},"public_addr":"172.21.15.187:6801/185858620","cluster_addr":"172.21.15.187:6803/185858620","heartbeat_back_addr":"172.21.15.187:6807/185858620","heartbeat_front_addr":"172.21.15.187:6805/185858620","state":["exists","up"]},{"osd":6,"uuid":"d0bba9ab-f7ee-449e-8999-1c0cf7e6d53c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6817","nonce":4213392126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6819","nonce":4213392126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6824","nonce":4213392126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6821","nonce":4213392126}]},"public_addr":"172.21.15.187:6817/4213392126","cluster_addr":"172.21.15.187:6819/4213392126","heartbeat_back_addr":"172.21.15.187:6824/4213392126","heartbeat_front_addr":"172.21.15.187:6821/4213392126","state":["exists","up"]},{"osd":7,"uuid":"efe5e0d9-2f87-4889-a27a-e2a95a632302","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6823","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6825","nonce":85774004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6827","nonce":85774004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6831","nonce":85774004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6829","nonce":85774004}]},"public_addr":"172.21.15.187:6825/85774004","cluster_addr":"172.21.15.187:6827/85774004","heartbeat_back_addr":"172.21.15.187:6831/85774004","heartbeat_front_addr":"172.21.15.187:6829/85774004","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.214447+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.448899+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.293107+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.564184+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.175026+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.097717+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.261141+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.287681+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.18","mappings":[{"from":3,"to":2}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.13","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T10:13:15.178 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.173+0000 7ff3d392a640 1 -- 172.21.15.78:0/2196561865 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7ff3b0066470 msgr2=0x7ff3b0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:15.178 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.173+0000 7ff3d392a640 1 --2- 172.21.15.78:0/2196561865 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7ff3b0066470 0x7ff3b0068930 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7ff3c80b2000 tx=0x7ff3c8009040 comp rx=0 tx=0).stop 2023-12-12T10:13:15.178 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.173+0000 7ff3d392a640 1 -- 172.21.15.78:0/2196561865 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff3cc0d1ae0 msgr2=0x7ff3cc1f2db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:15.178 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.173+0000 7ff3d392a640 1 --2- 172.21.15.78:0/2196561865 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff3cc0d1ae0 0x7ff3cc1f2db0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7ff3bc00d620 tx=0x7ff3bc00dae0 comp rx=0 tx=0).stop 2023-12-12T10:13:15.179 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.173+0000 7ff3d392a640 1 -- 172.21.15.78:0/2196561865 shutdown_connections 2023-12-12T10:13:15.179 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.173+0000 7ff3d392a640 1 --2- 172.21.15.78:0/2196561865 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7ff3b0066470 0x7ff3b0068930 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:15.179 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.173+0000 7ff3d392a640 1 --2- 172.21.15.78:0/2196561865 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff3cc15d3c0 0x7ff3cc1f32f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:15.179 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.173+0000 7ff3d392a640 1 --2- 172.21.15.78:0/2196561865 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff3cc0d1ae0 0x7ff3cc1f2db0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:15.179 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.173+0000 7ff3d392a640 1 --2- 172.21.15.78:0/2196561865 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff3cc0ce670 0x7ff3cc0ccdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:15.179 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.173+0000 7ff3d392a640 1 -- 172.21.15.78:0/2196561865 >> 172.21.15.78:0/2196561865 conn(0x7ff3cc09c2a0 msgr2=0x7ff3cc06afc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:15.179 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.173+0000 7ff3d392a640 1 -- 172.21.15.78:0/2196561865 shutdown_connections 2023-12-12T10:13:15.179 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.173+0000 7ff3d392a640 1 -- 172.21.15.78:0/2196561865 wait complete. 2023-12-12T10:13:15.199 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-12T10:11:57.053584+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-12T10:12:07.454450+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-12T10:12:08.182909+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-12T10:12:11.977952+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-12T10:13:15.199 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-12T10:13:15.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.337+0000 7f74a8b57640 1 Processor -- start 2023-12-12T10:13:15.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.337+0000 7f74a8b57640 1 -- start start 2023-12-12T10:13:15.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.337+0000 7f74a8b57640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f74a4143770 0x7f74a40cdf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:15.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.337+0000 7f74a8b57640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f74a40b1e20 0x7f74a4070f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:15.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.337+0000 7f74a8b57640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74a4070a70 con 0x7f74a40b2280 2023-12-12T10:13:15.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.337+0000 7f74a8b57640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74a415e920 con 0x7f74a4143770 2023-12-12T10:13:15.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.337+0000 7f74a8b57640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74a4070440 con 0x7f74a40b1e20 2023-12-12T10:13:15.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.337+0000 7f74a2d9d640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f74a40b2280 0x7f74a415a2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:35668/0 (socket says 172.21.15.78:35668) 2023-12-12T10:13:15.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.337+0000 7f74a2d9d640 1 -- 172.21.15.78:0/2543671920 learned_addr learned my addr 172.21.15.78:0/2543671920 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-12-12T10:13:15.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.337+0000 7f74a1d9b640 1 --2- 172.21.15.78:0/2543671920 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f74a40b1e20 0x7f74a4070f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:15.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.337+0000 7f74a259c640 1 --2- 172.21.15.78:0/2543671920 >> v2:172.21.15.187:3300/0 conn(0x7f74a4143770 0x7f74a40cdf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:15.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.337+0000 7f74a159a640 1 -- 172.21.15.78:0/2543671920 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 838480829 0 0) 0x7f74a4070a70 con 0x7f74a40b2280 2023-12-12T10:13:15.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.337+0000 7f74a159a640 1 -- 172.21.15.78:0/2543671920 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f748c003530 con 0x7f74a40b2280 2023-12-12T10:13:15.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.337+0000 7f74a1d9b640 1 -- 172.21.15.78:0/2543671920 >> v2:172.21.15.187:3300/0 conn(0x7f74a4143770 msgr2=0x7f74a40cdf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:13:15.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.337+0000 7f74a1d9b640 1 --2- 172.21.15.78:0/2543671920 >> v2:172.21.15.187:3300/0 conn(0x7f74a4143770 0x7f74a40cdf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:15.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.337+0000 7f74a1d9b640 1 -- 172.21.15.78:0/2543671920 >> v1:172.21.15.78:6789/0 conn(0x7f74a40b2280 legacy=0x7f74a415a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:15.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.337+0000 7f74a1d9b640 1 -- 172.21.15.78:0/2543671920 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74a4143b50 con 0x7f74a40b1e20 2023-12-12T10:13:15.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.337+0000 7f74a259c640 1 --2- 172.21.15.78:0/2543671920 >> v2:172.21.15.187:3300/0 conn(0x7f74a4143770 0x7f74a40cdf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-12T10:13:15.345 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.341+0000 7f74a1d9b640 1 --2- 172.21.15.78:0/2543671920 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f74a40b1e20 0x7f74a4070f00 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f74980097c0 tx=0x7f749801c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c73ed766c06962e server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:15.345 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.341+0000 7f74a159a640 1 -- 172.21.15.78:0/2543671920 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74980ab5f0 con 0x7f74a40b1e20 2023-12-12T10:13:15.345 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.341+0000 7f74a159a640 1 -- 172.21.15.78:0/2543671920 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74980ab750 con 0x7f74a40b1e20 2023-12-12T10:13:15.346 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.341+0000 7f74a159a640 1 -- 172.21.15.78:0/2543671920 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74980abae0 con 0x7f74a40b1e20 2023-12-12T10:13:15.346 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.341+0000 7f74a8b57640 1 -- 172.21.15.78:0/2543671920 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f74a40b1e20 msgr2=0x7f74a4070f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:15.346 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.341+0000 7f74a8b57640 1 --2- 172.21.15.78:0/2543671920 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f74a40b1e20 0x7f74a4070f00 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f74980097c0 tx=0x7f749801c3f0 comp rx=0 tx=0).stop 2023-12-12T10:13:15.346 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.341+0000 7f74a8b57640 1 -- 172.21.15.78:0/2543671920 shutdown_connections 2023-12-12T10:13:15.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.341+0000 7f74a8b57640 1 --2- 172.21.15.78:0/2543671920 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f74a40b1e20 0x7f74a4070f00 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:15.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.341+0000 7f74a8b57640 1 --2- 172.21.15.78:0/2543671920 >> v2:172.21.15.187:3300/0 conn(0x7f74a4143770 0x7f74a40cdf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:15.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.341+0000 7f74a8b57640 1 -- 172.21.15.78:0/2543671920 >> 172.21.15.78:0/2543671920 conn(0x7f74a406a710 msgr2=0x7f74a406ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:15.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.341+0000 7f74a8b57640 1 -- 172.21.15.78:0/2543671920 shutdown_connections 2023-12-12T10:13:15.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.341+0000 7f74a8b57640 1 -- 172.21.15.78:0/2543671920 wait complete. 2023-12-12T10:13:15.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.345+0000 7f74a8b57640 1 Processor -- start 2023-12-12T10:13:15.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.345+0000 7f74a8b57640 1 -- start start 2023-12-12T10:13:15.350 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.345+0000 7f74a8b57640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f74a40b1e20 0x7f74a4159520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:15.351 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.345+0000 7f74a8b57640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74a40b2280 0x7f74a4137600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:15.351 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.345+0000 7f74a8b57640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f74a4143770 0x7f74a41333e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:15.351 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.345+0000 7f74a8b57640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74a4159a60 con 0x7f74a40b2280 2023-12-12T10:13:15.351 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.345+0000 7f74a8b57640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74a4138b10 con 0x7f74a40b1e20 2023-12-12T10:13:15.351 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.345+0000 7f74a8b57640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74a4137f00 con 0x7f74a4143770 2023-12-12T10:13:15.351 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.345+0000 7f74a1d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74a40b2280 0x7f74a4137600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:15.351 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.345+0000 7f74a1d9b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74a40b2280 0x7f74a4137600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:44724/0 (socket says 172.21.15.78:44724) 2023-12-12T10:13:15.351 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.345+0000 7f74a1d9b640 1 -- 172.21.15.78:0/2917142303 learned_addr learned my addr 172.21.15.78:0/2917142303 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:13:15.351 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.345+0000 7f74a2d9d640 1 --2- 172.21.15.78:0/2917142303 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f74a4143770 0x7f74a41333e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:15.351 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.345+0000 7f74a259c640 1 --2- 172.21.15.78:0/2917142303 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f74a40b1e20 0x7f74a4159520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:15.351 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.345+0000 7f74a1d9b640 1 -- 172.21.15.78:0/2917142303 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f74a4143770 msgr2=0x7f74a41333e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:15.351 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.345+0000 7f74a1d9b640 1 --2- 172.21.15.78:0/2917142303 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f74a4143770 0x7f74a41333e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:15.351 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.345+0000 7f74a1d9b640 1 -- 172.21.15.78:0/2917142303 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f74a40b1e20 msgr2=0x7f74a4159520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:15.351 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.345+0000 7f74a1d9b640 1 --2- 172.21.15.78:0/2917142303 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f74a40b1e20 0x7f74a4159520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:15.352 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.345+0000 7f74a1d9b640 1 -- 172.21.15.78:0/2917142303 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7494009420 con 0x7f74a40b2280 2023-12-12T10:13:15.352 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.345+0000 7f74a1d9b640 1 --2- 172.21.15.78:0/2917142303 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74a40b2280 0x7f74a4137600 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f74980ad040 tx=0x7f749801ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:15.352 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.345+0000 7f7492ffd640 1 -- 172.21.15.78:0/2917142303 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74980bf610 con 0x7f74a40b2280 2023-12-12T10:13:15.352 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.345+0000 7f7492ffd640 1 -- 172.21.15.78:0/2917142303 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74980bf770 con 0x7f74a40b2280 2023-12-12T10:13:15.352 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.345+0000 7f7492ffd640 1 -- 172.21.15.78:0/2917142303 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74980bfb20 con 0x7f74a40b2280 2023-12-12T10:13:15.352 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.345+0000 7f74a8b57640 1 -- 172.21.15.78:0/2917142303 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7498009420 con 0x7f74a40b2280 2023-12-12T10:13:15.352 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.345+0000 7f74a8b57640 1 -- 172.21.15.78:0/2917142303 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74a41384c0 con 0x7f74a40b2280 2023-12-12T10:13:15.352 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.349+0000 7f74a8b57640 1 -- 172.21.15.78:0/2917142303 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74a40671f0 con 0x7f74a40b2280 2023-12-12T10:13:15.353 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.349+0000 7f7492ffd640 1 -- 172.21.15.78:0/2917142303 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f74980bfc80 con 0x7f74a40b2280 2023-12-12T10:13:15.353 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.349+0000 7f7492ffd640 1 --2- 172.21.15.78:0/2917142303 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f7484066470 0x7f7484068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:15.353 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.349+0000 7f7492ffd640 1 -- 172.21.15.78:0/2917142303 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f74980a8050 con 0x7f74a40b2280 2023-12-12T10:13:15.353 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.349+0000 7f74a259c640 1 --2- 172.21.15.78:0/2917142303 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f7484066470 0x7f7484068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:15.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.349+0000 7f74a259c640 1 --2- 172.21.15.78:0/2917142303 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f7484066470 0x7f7484068930 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f7494009be0 tx=0x7f7494008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:15.357 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.353+0000 7f7492ffd640 1 -- 172.21.15.78:0/2917142303 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f74980eb9e0 con 0x7f74a40b2280 2023-12-12T10:13:15.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.501+0000 7f74a8b57640 1 -- 172.21.15.78:0/2917142303 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f74a4138c80 con 0x7f74a40b2280 2023-12-12T10:13:15.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.501+0000 7f7492ffd640 1 -- 172.21.15.78:0/2917142303 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f74980ef000 con 0x7f74a40b2280 2023-12-12T10:13:15.507 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2023-12-12T10:13:15.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.505+0000 7f74a8b57640 1 -- 172.21.15.78:0/2917142303 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f7484066470 msgr2=0x7f7484068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:15.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.505+0000 7f74a8b57640 1 --2- 172.21.15.78:0/2917142303 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f7484066470 0x7f7484068930 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f7494009be0 tx=0x7f7494008040 comp rx=0 tx=0).stop 2023-12-12T10:13:15.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.505+0000 7f74a8b57640 1 -- 172.21.15.78:0/2917142303 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74a40b2280 msgr2=0x7f74a4137600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:15.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.505+0000 7f74a8b57640 1 --2- 172.21.15.78:0/2917142303 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74a40b2280 0x7f74a4137600 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f74980ad040 tx=0x7f749801ac30 comp rx=0 tx=0).stop 2023-12-12T10:13:15.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.505+0000 7f74a8b57640 1 -- 172.21.15.78:0/2917142303 shutdown_connections 2023-12-12T10:13:15.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.505+0000 7f74a8b57640 1 --2- 172.21.15.78:0/2917142303 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f7484066470 0x7f7484068930 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:15.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.505+0000 7f74a8b57640 1 --2- 172.21.15.78:0/2917142303 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f74a4143770 0x7f74a41333e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:15.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.505+0000 7f74a8b57640 1 --2- 172.21.15.78:0/2917142303 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f74a40b2280 0x7f74a4137600 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:15.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.505+0000 7f74a8b57640 1 --2- 172.21.15.78:0/2917142303 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f74a40b1e20 0x7f74a4159520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:15.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.505+0000 7f74a8b57640 1 -- 172.21.15.78:0/2917142303 >> 172.21.15.78:0/2917142303 conn(0x7f74a406a710 msgr2=0x7f74a406aaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:15.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.505+0000 7f74a8b57640 1 -- 172.21.15.78:0/2917142303 shutdown_connections 2023-12-12T10:13:15.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.505+0000 7f74a8b57640 1 -- 172.21.15.78:0/2917142303 wait complete. 2023-12-12T10:13:15.528 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-12T10:13:15.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.665+0000 7f784e66b640 1 Processor -- start 2023-12-12T10:13:15.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.665+0000 7f784e66b640 1 -- start start 2023-12-12T10:13:15.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.665+0000 7f784e66b640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f78480d1ce0 0x7f78480d1040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:15.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.665+0000 7f784e66b640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78480d04f0 con 0x7f78480d0be0 2023-12-12T10:13:15.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.665+0000 7f784e66b640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78480cdc20 con 0x7f7848160890 2023-12-12T10:13:15.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.665+0000 7f784e66b640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78480cfc50 con 0x7f78480d1ce0 2023-12-12T10:13:15.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.665+0000 7f784cc08640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f78480d1ce0 0x7f78480d1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:15.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.665+0000 7f784cc08640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f78480d1ce0 0x7f78480d1040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:44730/0 (socket says 172.21.15.78:44730) 2023-12-12T10:13:15.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.665+0000 7f784cc08640 1 -- 172.21.15.78:0/3586129156 learned_addr learned my addr 172.21.15.78:0/3586129156 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:13:15.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.665+0000 7f784cc08640 1 -- 172.21.15.78:0/3586129156 >> v1:172.21.15.187:6789/0 conn(0x7f7848160890 legacy=0x7f78480b5e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:15.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.665+0000 7f784cc08640 1 -- 172.21.15.78:0/3586129156 >> v1:172.21.15.78:6789/0 conn(0x7f78480d0be0 legacy=0x7f78480d15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:15.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.665+0000 7f784cc08640 1 -- 172.21.15.78:0/3586129156 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78480cff30 con 0x7f78480d1ce0 2023-12-12T10:13:15.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.669+0000 7f784cc08640 1 --2- 172.21.15.78:0/3586129156 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f78480d1ce0 0x7f78480d1040 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f7840009e50 tx=0x7f784001c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38a56cfb0696aef5 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:15.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.669+0000 7f7846ffd640 1 -- 172.21.15.78:0/3586129156 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78400a58a0 con 0x7f78480d1ce0 2023-12-12T10:13:15.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.669+0000 7f7846ffd640 1 -- 172.21.15.78:0/3586129156 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78400a5a00 con 0x7f78480d1ce0 2023-12-12T10:13:15.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.669+0000 7f7846ffd640 1 -- 172.21.15.78:0/3586129156 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78400a5d90 con 0x7f78480d1ce0 2023-12-12T10:13:15.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.669+0000 7f784e66b640 1 -- 172.21.15.78:0/3586129156 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f78480d1ce0 msgr2=0x7f78480d1040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:15.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.669+0000 7f784e66b640 1 --2- 172.21.15.78:0/3586129156 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f78480d1ce0 0x7f78480d1040 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f7840009e50 tx=0x7f784001c9e0 comp rx=0 tx=0).stop 2023-12-12T10:13:15.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.669+0000 7f784e66b640 1 -- 172.21.15.78:0/3586129156 shutdown_connections 2023-12-12T10:13:15.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.669+0000 7f784e66b640 1 --2- 172.21.15.78:0/3586129156 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f78480d1ce0 0x7f78480d1040 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:15.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.669+0000 7f784e66b640 1 -- 172.21.15.78:0/3586129156 >> 172.21.15.78:0/3586129156 conn(0x7f784809c2f0 msgr2=0x7f78480d3010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:15.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.669+0000 7f784e66b640 1 -- 172.21.15.78:0/3586129156 shutdown_connections 2023-12-12T10:13:15.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.669+0000 7f784e66b640 1 -- 172.21.15.78:0/3586129156 wait complete. 2023-12-12T10:13:15.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.673+0000 7f784e66b640 1 Processor -- start 2023-12-12T10:13:15.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.673+0000 7f784e66b640 1 -- start start 2023-12-12T10:13:15.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.673+0000 7f784e66b640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f78480d0be0 0x7f784814e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:15.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.673+0000 7f784e66b640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f78480d1ce0 0x7f78480ca0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:15.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.673+0000 7f784e66b640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7848160890 0x7f78480c8800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:15.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.673+0000 7f784e66b640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78480ca620 con 0x7f7848160890 2023-12-12T10:13:15.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.673+0000 7f784e66b640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78480c8d40 con 0x7f78480d1ce0 2023-12-12T10:13:15.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.673+0000 7f784e66b640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f784814efd0 con 0x7f78480d0be0 2023-12-12T10:13:15.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.673+0000 7f784cc08640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7848160890 0x7f78480c8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:15.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.673+0000 7f784cc08640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7848160890 0x7f78480c8800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:44734/0 (socket says 172.21.15.78:44734) 2023-12-12T10:13:15.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.673+0000 7f784cc08640 1 -- 172.21.15.78:0/2234937847 learned_addr learned my addr 172.21.15.78:0/2234937847 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:13:15.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.673+0000 7f7847fff640 1 --2- 172.21.15.78:0/2234937847 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f78480d0be0 0x7f784814e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:15.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.673+0000 7f78477fe640 1 --2- 172.21.15.78:0/2234937847 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f78480d1ce0 0x7f78480ca0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:15.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.673+0000 7f784cc08640 1 -- 172.21.15.78:0/2234937847 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f78480d0be0 msgr2=0x7f784814e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:15.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.673+0000 7f784cc08640 1 --2- 172.21.15.78:0/2234937847 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f78480d0be0 0x7f784814e930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:15.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.673+0000 7f784cc08640 1 -- 172.21.15.78:0/2234937847 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f78480d1ce0 msgr2=0x7f78480ca0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:15.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.673+0000 7f784cc08640 1 --2- 172.21.15.78:0/2234937847 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f78480d1ce0 0x7f78480ca0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:15.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.673+0000 7f784cc08640 1 -- 172.21.15.78:0/2234937847 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7840009b30 con 0x7f7848160890 2023-12-12T10:13:15.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.673+0000 7f784cc08640 1 --2- 172.21.15.78:0/2234937847 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7848160890 0x7f78480c8800 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f78400af040 tx=0x7f7840019780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:15.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.673+0000 7f7844ff9640 1 -- 172.21.15.78:0/2234937847 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78400b8670 con 0x7f7848160890 2023-12-12T10:13:15.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.673+0000 7f7844ff9640 1 -- 172.21.15.78:0/2234937847 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78400b87f0 con 0x7f7848160890 2023-12-12T10:13:15.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.673+0000 7f784e66b640 1 -- 172.21.15.78:0/2234937847 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78480ca810 con 0x7f7848160890 2023-12-12T10:13:15.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.673+0000 7f7844ff9640 1 -- 172.21.15.78:0/2234937847 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78400b8ba0 con 0x7f7848160890 2023-12-12T10:13:15.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.673+0000 7f784e66b640 1 -- 172.21.15.78:0/2234937847 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78480cadd0 con 0x7f7848160890 2023-12-12T10:13:15.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.677+0000 7f784e66b640 1 -- 172.21.15.78:0/2234937847 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7848067530 con 0x7f7848160890 2023-12-12T10:13:15.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.677+0000 7f7844ff9640 1 -- 172.21.15.78:0/2234937847 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f78400b8d00 con 0x7f7848160890 2023-12-12T10:13:15.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.677+0000 7f7844ff9640 1 --2- 172.21.15.78:0/2234937847 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f7834066470 0x7f7834068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:15.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.677+0000 7f7844ff9640 1 -- 172.21.15.78:0/2234937847 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f784011f930 con 0x7f7848160890 2023-12-12T10:13:15.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.677+0000 7f7847fff640 1 --2- 172.21.15.78:0/2234937847 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f7834066470 0x7f7834068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:15.682 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.677+0000 7f7847fff640 1 --2- 172.21.15.78:0/2234937847 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f7834066470 0x7f7834068930 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f7838007fd0 tx=0x7f7838009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:15.685 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.681+0000 7f7844ff9640 1 -- 172.21.15.78:0/2234937847 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f78400ecb30 con 0x7f7848160890 2023-12-12T10:13:15.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.829+0000 7f784e66b640 1 -- 172.21.15.78:0/2234937847 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f78480d0690 con 0x7f7848160890 2023-12-12T10:13:15.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.829+0000 7f7844ff9640 1 -- 172.21.15.78:0/2234937847 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f784011de60 con 0x7f7848160890 2023-12-12T10:13:15.835 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2023-12-12T10:13:15.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.833+0000 7f784e66b640 1 -- 172.21.15.78:0/2234937847 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f7834066470 msgr2=0x7f7834068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:15.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.833+0000 7f784e66b640 1 --2- 172.21.15.78:0/2234937847 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f7834066470 0x7f7834068930 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f7838007fd0 tx=0x7f7838009040 comp rx=0 tx=0).stop 2023-12-12T10:13:15.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.833+0000 7f784e66b640 1 -- 172.21.15.78:0/2234937847 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7848160890 msgr2=0x7f78480c8800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:15.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.833+0000 7f784e66b640 1 --2- 172.21.15.78:0/2234937847 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7848160890 0x7f78480c8800 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f78400af040 tx=0x7f7840019780 comp rx=0 tx=0).stop 2023-12-12T10:13:15.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.833+0000 7f784e66b640 1 -- 172.21.15.78:0/2234937847 shutdown_connections 2023-12-12T10:13:15.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.833+0000 7f784e66b640 1 --2- 172.21.15.78:0/2234937847 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f7834066470 0x7f7834068930 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:15.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.833+0000 7f784e66b640 1 --2- 172.21.15.78:0/2234937847 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7848160890 0x7f78480c8800 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:15.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.833+0000 7f784e66b640 1 --2- 172.21.15.78:0/2234937847 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f78480d1ce0 0x7f78480ca0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:15.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.833+0000 7f784e66b640 1 --2- 172.21.15.78:0/2234937847 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f78480d0be0 0x7f784814e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:15.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.833+0000 7f784e66b640 1 -- 172.21.15.78:0/2234937847 >> 172.21.15.78:0/2234937847 conn(0x7f784809c2f0 msgr2=0x7f78481549a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:15.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.833+0000 7f784e66b640 1 -- 172.21.15.78:0/2234937847 shutdown_connections 2023-12-12T10:13:15.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.833+0000 7f784e66b640 1 -- 172.21.15.78:0/2234937847 wait complete. 2023-12-12T10:13:15.856 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-12T10:13:15.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.989+0000 7f64507c4640 1 Processor -- start 2023-12-12T10:13:15.995 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.993+0000 7f64507c4640 1 -- start start 2023-12-12T10:13:15.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.993+0000 7f64507c4640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f64480cb4b0 0x7f644815f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:15.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.993+0000 7f64507c4640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f644806c850 0x7f644806ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:15.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.993+0000 7f64507c4640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f644815b390 0x7f644815b820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:15.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.993+0000 7f64507c4640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f644806d200 con 0x7f644806c850 2023-12-12T10:13:15.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.993+0000 7f64507c4640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64480cea30 con 0x7f64480cb4b0 2023-12-12T10:13:15.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.993+0000 7f64507c4640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f644815bd60 con 0x7f644815b390 2023-12-12T10:13:15.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.993+0000 7f644dd5f640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f644806c850 0x7f644806ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:15.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.993+0000 7f644dd5f640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f644806c850 0x7f644806ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:44750/0 (socket says 172.21.15.78:44750) 2023-12-12T10:13:15.997 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.993+0000 7f644dd5f640 1 -- 172.21.15.78:0/3480685330 learned_addr learned my addr 172.21.15.78:0/3480685330 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:13:15.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.993+0000 7f644e560640 1 --2- 172.21.15.78:0/3480685330 >> v2:172.21.15.187:3300/0 conn(0x7f64480cb4b0 0x7f644815f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:15.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.993+0000 7f644ed61640 1 --2- 172.21.15.78:0/3480685330 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f644815b390 0x7f644815b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:15.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.993+0000 7f644dd5f640 1 -- 172.21.15.78:0/3480685330 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f644815b390 msgr2=0x7f644815b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:13:15.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.993+0000 7f644dd5f640 1 --2- 172.21.15.78:0/3480685330 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f644815b390 0x7f644815b820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:15.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.993+0000 7f644dd5f640 1 -- 172.21.15.78:0/3480685330 >> v2:172.21.15.187:3300/0 conn(0x7f64480cb4b0 msgr2=0x7f644815f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:13:15.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.993+0000 7f644dd5f640 1 --2- 172.21.15.78:0/3480685330 >> v2:172.21.15.187:3300/0 conn(0x7f64480cb4b0 0x7f644815f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:15.998 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.993+0000 7f644dd5f640 1 -- 172.21.15.78:0/3480685330 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f644815bfc0 con 0x7f644806c850 2023-12-12T10:13:16.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.997+0000 7f644dd5f640 1 --2- 172.21.15.78:0/3480685330 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f644806c850 0x7f644806ccc0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f644806dbd0 tx=0x7f643801c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e56117457cfd0803 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:16.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.997+0000 7f644d55e640 1 -- 172.21.15.78:0/3480685330 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64380ab600 con 0x7f644806c850 2023-12-12T10:13:16.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.997+0000 7f644d55e640 1 -- 172.21.15.78:0/3480685330 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64380ab760 con 0x7f644806c850 2023-12-12T10:13:16.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.997+0000 7f644d55e640 1 -- 172.21.15.78:0/3480685330 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64380abaf0 con 0x7f644806c850 2023-12-12T10:13:16.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.997+0000 7f64507c4640 1 -- 172.21.15.78:0/3480685330 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f644806c850 msgr2=0x7f644806ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:16.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.997+0000 7f64507c4640 1 --2- 172.21.15.78:0/3480685330 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f644806c850 0x7f644806ccc0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f644806dbd0 tx=0x7f643801c440 comp rx=0 tx=0).stop 2023-12-12T10:13:16.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.997+0000 7f64507c4640 1 -- 172.21.15.78:0/3480685330 shutdown_connections 2023-12-12T10:13:16.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.997+0000 7f64507c4640 1 --2- 172.21.15.78:0/3480685330 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f644815b390 0x7f644815b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:16.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.997+0000 7f64507c4640 1 --2- 172.21.15.78:0/3480685330 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f644806c850 0x7f644806ccc0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:16.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.997+0000 7f64507c4640 1 --2- 172.21.15.78:0/3480685330 >> v2:172.21.15.187:3300/0 conn(0x7f64480cb4b0 0x7f644815f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:16.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.997+0000 7f64507c4640 1 -- 172.21.15.78:0/3480685330 >> 172.21.15.78:0/3480685330 conn(0x7f644806a710 msgr2=0x7f644806ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:16.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.997+0000 7f64507c4640 1 -- 172.21.15.78:0/3480685330 shutdown_connections 2023-12-12T10:13:16.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.997+0000 7f64507c4640 1 -- 172.21.15.78:0/3480685330 wait complete. 2023-12-12T10:13:16.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:15.997+0000 7f64507c4640 1 Processor -- start 2023-12-12T10:13:16.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.001+0000 7f64507c4640 1 -- start start 2023-12-12T10:13:16.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.001+0000 7f64507c4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f644806c850 0x7f6448153700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:16.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.001+0000 7f64507c4640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f64480cb4b0 0x7f644815d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:16.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.001+0000 7f64507c4640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f644815b390 0x7f6448148050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:16.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.001+0000 7f64507c4640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6448153c40 con 0x7f644806c850 2023-12-12T10:13:16.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.001+0000 7f64507c4640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6448153270 con 0x7f644815b390 2023-12-12T10:13:16.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.001+0000 7f64507c4640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64481555d0 con 0x7f64480cb4b0 2023-12-12T10:13:16.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.001+0000 7f644e560640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f644806c850 0x7f6448153700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:16.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.001+0000 7f644e560640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f644806c850 0x7f6448153700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:44758/0 (socket says 172.21.15.78:44758) 2023-12-12T10:13:16.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.001+0000 7f644e560640 1 -- 172.21.15.78:0/394985986 learned_addr learned my addr 172.21.15.78:0/394985986 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:13:16.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.001+0000 7f644dd5f640 1 --2- 172.21.15.78:0/394985986 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f64480cb4b0 0x7f644815d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:16.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.001+0000 7f644ed61640 1 --2- 172.21.15.78:0/394985986 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f644815b390 0x7f6448148050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:16.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.001+0000 7f644e560640 1 -- 172.21.15.78:0/394985986 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f64480cb4b0 msgr2=0x7f644815d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:16.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.001+0000 7f644e560640 1 --2- 172.21.15.78:0/394985986 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f64480cb4b0 0x7f644815d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:16.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.001+0000 7f644e560640 1 -- 172.21.15.78:0/394985986 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f644815b390 msgr2=0x7f6448148050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:16.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.001+0000 7f644e560640 1 --2- 172.21.15.78:0/394985986 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f644815b390 0x7f6448148050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:16.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.001+0000 7f644e560640 1 -- 172.21.15.78:0/394985986 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64380094d0 con 0x7f644806c850 2023-12-12T10:13:16.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.001+0000 7f644ed61640 1 --2- 172.21.15.78:0/394985986 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f644815b390 0x7f6448148050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T10:13:16.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.001+0000 7f644e560640 1 --2- 172.21.15.78:0/394985986 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f644806c850 0x7f6448153700 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f644400d5f0 tx=0x7f644400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:16.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.001+0000 7f643effd640 1 -- 172.21.15.78:0/394985986 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64440125f0 con 0x7f644806c850 2023-12-12T10:13:16.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.001+0000 7f643effd640 1 -- 172.21.15.78:0/394985986 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6444012750 con 0x7f644806c850 2023-12-12T10:13:16.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.001+0000 7f643effd640 1 -- 172.21.15.78:0/394985986 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6444012ae0 con 0x7f644806c850 2023-12-12T10:13:16.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.001+0000 7f64507c4640 1 -- 172.21.15.78:0/394985986 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6448152c20 con 0x7f644806c850 2023-12-12T10:13:16.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.001+0000 7f64507c4640 1 -- 172.21.15.78:0/394985986 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f644815db50 con 0x7f644806c850 2023-12-12T10:13:16.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.001+0000 7f64507c4640 1 -- 172.21.15.78:0/394985986 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64480671f0 con 0x7f644806c850 2023-12-12T10:13:16.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.005+0000 7f643effd640 1 -- 172.21.15.78:0/394985986 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6444012c40 con 0x7f644806c850 2023-12-12T10:13:16.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.005+0000 7f643effd640 1 --2- 172.21.15.78:0/394985986 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f642c0664a0 0x7f642c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:16.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.005+0000 7f643effd640 1 -- 172.21.15.78:0/394985986 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f6444084620 con 0x7f644806c850 2023-12-12T10:13:16.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.005+0000 7f644dd5f640 1 --2- 172.21.15.78:0/394985986 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f642c0664a0 0x7f642c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:16.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.005+0000 7f644dd5f640 1 --2- 172.21.15.78:0/394985986 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f642c0664a0 0x7f642c068960 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f64380af000 tx=0x7f64380b6040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:16.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.009+0000 7f643effd640 1 -- 172.21.15.78:0/394985986 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f64440516d0 con 0x7f644806c850 2023-12-12T10:13:16.163 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.157+0000 7f64507c4640 1 -- 172.21.15.78:0/394985986 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f644815dd40 con 0x7f644806c850 2023-12-12T10:13:16.163 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.157+0000 7f643effd640 1 -- 172.21.15.78:0/394985986 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f644815dd40 con 0x7f644806c850 2023-12-12T10:13:16.163 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2023-12-12T10:13:16.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.161+0000 7f64507c4640 1 -- 172.21.15.78:0/394985986 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f642c0664a0 msgr2=0x7f642c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:16.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.161+0000 7f64507c4640 1 --2- 172.21.15.78:0/394985986 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f642c0664a0 0x7f642c068960 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f64380af000 tx=0x7f64380b6040 comp rx=0 tx=0).stop 2023-12-12T10:13:16.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.161+0000 7f64507c4640 1 -- 172.21.15.78:0/394985986 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f644806c850 msgr2=0x7f6448153700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:16.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.161+0000 7f64507c4640 1 --2- 172.21.15.78:0/394985986 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f644806c850 0x7f6448153700 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f644400d5f0 tx=0x7f644400dab0 comp rx=0 tx=0).stop 2023-12-12T10:13:16.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.161+0000 7f64507c4640 1 -- 172.21.15.78:0/394985986 shutdown_connections 2023-12-12T10:13:16.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.161+0000 7f64507c4640 1 --2- 172.21.15.78:0/394985986 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f642c0664a0 0x7f642c068960 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:16.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.161+0000 7f64507c4640 1 --2- 172.21.15.78:0/394985986 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f644815b390 0x7f6448148050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:16.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.161+0000 7f64507c4640 1 --2- 172.21.15.78:0/394985986 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f64480cb4b0 0x7f644815d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:16.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.161+0000 7f64507c4640 1 --2- 172.21.15.78:0/394985986 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f644806c850 0x7f6448153700 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:16.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.161+0000 7f64507c4640 1 -- 172.21.15.78:0/394985986 >> 172.21.15.78:0/394985986 conn(0x7f644806a710 msgr2=0x7f64480af300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:16.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.161+0000 7f64507c4640 1 -- 172.21.15.78:0/394985986 shutdown_connections 2023-12-12T10:13:16.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.161+0000 7f64507c4640 1 -- 172.21.15.78:0/394985986 wait complete. 2023-12-12T10:13:16.183 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-12T10:13:16.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.321+0000 7fa7c19df640 1 Processor -- start 2023-12-12T10:13:16.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.321+0000 7fa7c19df640 1 -- start start 2023-12-12T10:13:16.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.321+0000 7fa7c19df640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fa7bc160890 0x7fa7bc0b5e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:16.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.321+0000 7fa7c19df640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7bc0d04f0 con 0x7fa7bc0d0be0 2023-12-12T10:13:16.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.321+0000 7fa7c19df640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7bc0b63a0 con 0x7fa7bc0d1ce0 2023-12-12T10:13:16.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.321+0000 7fa7c19df640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7bc0cdc20 con 0x7fa7bc160890 2023-12-12T10:13:16.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.325+0000 7fa7b3fff640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fa7bc0d0be0 0x7fa7bc0d15d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:35678/0 (socket says 172.21.15.78:35678) 2023-12-12T10:13:16.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.325+0000 7fa7b3fff640 1 -- 172.21.15.78:0/3312116694 learned_addr learned my addr 172.21.15.78:0/3312116694 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-12-12T10:13:16.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.325+0000 7fa7baffd640 1 --2- 172.21.15.78:0/3312116694 >> v2:172.21.15.187:3300/0 conn(0x7fa7bc160890 0x7fa7bc0b5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:16.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.325+0000 7fa7ba7fc640 1 -- 172.21.15.78:0/3312116694 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3919241650 0 0) 0x7fa7a4001120 con 0x7fa7bc0d0be0 2023-12-12T10:13:16.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.325+0000 7fa7ba7fc640 1 -- 172.21.15.78:0/3312116694 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa7a8003530 con 0x7fa7bc0d0be0 2023-12-12T10:13:16.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.325+0000 7fa7ba7fc640 1 -- 172.21.15.78:0/3312116694 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2298630737 0 0) 0x7fa7a8003530 con 0x7fa7bc0d0be0 2023-12-12T10:13:16.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.325+0000 7fa7ba7fc640 1 -- 172.21.15.78:0/3312116694 >> v2:172.21.15.187:3300/0 conn(0x7fa7bc160890 msgr2=0x7fa7bc0b5e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:13:16.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.325+0000 7fa7ba7fc640 1 --2- 172.21.15.78:0/3312116694 >> v2:172.21.15.187:3300/0 conn(0x7fa7bc160890 0x7fa7bc0b5e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:16.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.325+0000 7fa7ba7fc640 1 -- 172.21.15.78:0/3312116694 >> v1:172.21.15.187:6789/0 conn(0x7fa7bc0d1ce0 legacy=0x7fa7bc0ce3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:16.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.325+0000 7fa7ba7fc640 1 -- 172.21.15.78:0/3312116694 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7bc0cfc50 con 0x7fa7bc0d0be0 2023-12-12T10:13:16.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.325+0000 7fa7ba7fc640 1 -- 172.21.15.78:0/3312116694 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 465499599 0 0) 0x7fa7a4001810 con 0x7fa7bc0d0be0 2023-12-12T10:13:16.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.325+0000 7fa7ba7fc640 1 -- 172.21.15.78:0/3312116694 >> v1:172.21.15.78:6789/0 conn(0x7fa7bc0d0be0 legacy=0x7fa7bc0d15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:16.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.325+0000 7fa7ba7fc640 1 --2- 172.21.15.78:0/3312116694 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa7a8003980 0x7fa7a8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:16.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.325+0000 7fa7ba7fc640 1 --2- 172.21.15.78:0/3312116694 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa7a80047d0 0x7fa7a8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:16.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.325+0000 7fa7ba7fc640 1 --2- 172.21.15.78:0/3312116694 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa7a8005190 0x7fa7a800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:16.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.325+0000 7fa7ba7fc640 1 -- 172.21.15.78:0/3312116694 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7bc0cdc20 con 0x7fa7a80047d0 2023-12-12T10:13:16.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.325+0000 7fa7ba7fc640 1 -- 172.21.15.78:0/3312116694 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a800c030 con 0x7fa7a8003980 2023-12-12T10:13:16.330 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.325+0000 7fa7ba7fc640 1 -- 172.21.15.78:0/3312116694 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7a800c1f0 con 0x7fa7a8005190 2023-12-12T10:13:16.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.325+0000 7fa7b3fff640 1 --2- 172.21.15.78:0/3312116694 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa7a80047d0 0x7fa7a8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:16.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.325+0000 7fa7baffd640 1 --2- 172.21.15.78:0/3312116694 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa7a8003980 0x7fa7a8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:16.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.325+0000 7fa7bb7fe640 1 --2- 172.21.15.78:0/3312116694 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa7a8005190 0x7fa7a800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:16.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.325+0000 7fa7b3fff640 1 -- 172.21.15.78:0/3312116694 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa7a8005190 msgr2=0x7fa7a800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:13:16.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.325+0000 7fa7b3fff640 1 --2- 172.21.15.78:0/3312116694 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa7a8005190 0x7fa7a800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:16.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.325+0000 7fa7b3fff640 1 -- 172.21.15.78:0/3312116694 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa7a8003980 msgr2=0x7fa7a8003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:13:16.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.325+0000 7fa7b3fff640 1 --2- 172.21.15.78:0/3312116694 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa7a8003980 0x7fa7a8003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:16.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.325+0000 7fa7bb7fe640 1 -- 172.21.15.78:0/3312116694 reap_dead start 2023-12-12T10:13:16.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.325+0000 7fa7b3fff640 1 -- 172.21.15.78:0/3312116694 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7a8003530 con 0x7fa7a80047d0 2023-12-12T10:13:16.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.325+0000 7fa7baffd640 1 --2- 172.21.15.78:0/3312116694 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa7a8003980 0x7fa7a8003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-12T10:13:16.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.329+0000 7fa7b3fff640 1 --2- 172.21.15.78:0/3312116694 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa7a80047d0 0x7fa7a8004c50 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fa7a400c240 tx=0x7fa7a401f3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bba9486fdf030e0f server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:16.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.329+0000 7fa7ba7fc640 1 -- 172.21.15.78:0/3312116694 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7a4005ae0 con 0x7fa7a80047d0 2023-12-12T10:13:16.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.329+0000 7fa7ba7fc640 1 -- 172.21.15.78:0/3312116694 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7a40ab070 con 0x7fa7a80047d0 2023-12-12T10:13:16.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.329+0000 7fa7ba7fc640 1 -- 172.21.15.78:0/3312116694 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7a4007070 con 0x7fa7a80047d0 2023-12-12T10:13:16.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.329+0000 7fa7c19df640 1 -- 172.21.15.78:0/3312116694 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa7a80047d0 msgr2=0x7fa7a8004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:16.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.329+0000 7fa7c19df640 1 --2- 172.21.15.78:0/3312116694 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa7a80047d0 0x7fa7a8004c50 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fa7a400c240 tx=0x7fa7a401f3b0 comp rx=0 tx=0).stop 2023-12-12T10:13:16.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.329+0000 7fa7c19df640 1 -- 172.21.15.78:0/3312116694 shutdown_connections 2023-12-12T10:13:16.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.329+0000 7fa7c19df640 1 --2- 172.21.15.78:0/3312116694 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa7a80047d0 0x7fa7a8004c50 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:16.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.329+0000 7fa7c19df640 1 -- 172.21.15.78:0/3312116694 >> 172.21.15.78:0/3312116694 conn(0x7fa7bc09c2f0 msgr2=0x7fa7bc0d3010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:16.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.329+0000 7fa7c19df640 1 -- 172.21.15.78:0/3312116694 shutdown_connections 2023-12-12T10:13:16.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.329+0000 7fa7c19df640 1 -- 172.21.15.78:0/3312116694 wait complete. 2023-12-12T10:13:16.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.329+0000 7fa7c19df640 1 Processor -- start 2023-12-12T10:13:16.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.329+0000 7fa7c19df640 1 -- start start 2023-12-12T10:13:16.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.333+0000 7fa7c19df640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa7a80047d0 0x7fa7bc1f39e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:16.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.333+0000 7fa7c19df640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa7bc1f27e0 0x7fa7bc0ce770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:16.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.333+0000 7fa7c19df640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa7bc0cecb0 0x7fa7bc1efe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:16.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.333+0000 7fa7c19df640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7bc1f3f20 con 0x7fa7bc0cecb0 2023-12-12T10:13:16.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.333+0000 7fa7c19df640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7bc0cf130 con 0x7fa7bc1f27e0 2023-12-12T10:13:16.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.333+0000 7fa7c19df640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7bc0c9620 con 0x7fa7a80047d0 2023-12-12T10:13:16.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.333+0000 7fa7bb7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa7bc0cecb0 0x7fa7bc1efe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:16.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.333+0000 7fa7bb7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa7bc0cecb0 0x7fa7bc1efe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:44774/0 (socket says 172.21.15.78:44774) 2023-12-12T10:13:16.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.333+0000 7fa7bb7fe640 1 -- 172.21.15.78:0/686628641 learned_addr learned my addr 172.21.15.78:0/686628641 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:13:16.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.333+0000 7fa7baffd640 1 --2- 172.21.15.78:0/686628641 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa7a80047d0 0x7fa7bc1f39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:16.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.333+0000 7fa7b3fff640 1 --2- 172.21.15.78:0/686628641 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa7bc1f27e0 0x7fa7bc0ce770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:16.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.333+0000 7fa7bb7fe640 1 -- 172.21.15.78:0/686628641 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa7a80047d0 msgr2=0x7fa7bc1f39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:16.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.333+0000 7fa7bb7fe640 1 --2- 172.21.15.78:0/686628641 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa7a80047d0 0x7fa7bc1f39e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:16.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.333+0000 7fa7bb7fe640 1 -- 172.21.15.78:0/686628641 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa7bc1f27e0 msgr2=0x7fa7bc0ce770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:16.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.333+0000 7fa7bb7fe640 1 --2- 172.21.15.78:0/686628641 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa7bc1f27e0 0x7fa7bc0ce770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:16.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.333+0000 7fa7bb7fe640 1 -- 172.21.15.78:0/686628641 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7bc0cc1b0 con 0x7fa7bc0cecb0 2023-12-12T10:13:16.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.333+0000 7fa7bb7fe640 1 --2- 172.21.15.78:0/686628641 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa7bc0cecb0 0x7fa7bc1efe20 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fa7bc162050 tx=0x7fa7b400eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:16.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.333+0000 7fa7b8ff9640 1 -- 172.21.15.78:0/686628641 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7b400ee90 con 0x7fa7bc0cecb0 2023-12-12T10:13:16.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.333+0000 7fa7b8ff9640 1 -- 172.21.15.78:0/686628641 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7b4003980 con 0x7fa7bc0cecb0 2023-12-12T10:13:16.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.333+0000 7fa7b8ff9640 1 -- 172.21.15.78:0/686628641 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7b4003d70 con 0x7fa7bc0cecb0 2023-12-12T10:13:16.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.333+0000 7fa7c19df640 1 -- 172.21.15.78:0/686628641 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7bc0cb5a0 con 0x7fa7bc0cecb0 2023-12-12T10:13:16.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.333+0000 7fa7c19df640 1 -- 172.21.15.78:0/686628641 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7bc0cbb60 con 0x7fa7bc0cecb0 2023-12-12T10:13:16.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.333+0000 7fa7c19df640 1 -- 172.21.15.78:0/686628641 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7bc1f0ba0 con 0x7fa7bc0cecb0 2023-12-12T10:13:16.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.333+0000 7fa7b8ff9640 1 -- 172.21.15.78:0/686628641 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa7b40050d0 con 0x7fa7bc0cecb0 2023-12-12T10:13:16.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.337+0000 7fa7b8ff9640 1 --2- 172.21.15.78:0/686628641 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fa79c0664a0 0x7fa79c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:16.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.337+0000 7fa7b8ff9640 1 -- 172.21.15.78:0/686628641 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa7b4083f10 con 0x7fa7bc0cecb0 2023-12-12T10:13:16.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.337+0000 7fa7baffd640 1 --2- 172.21.15.78:0/686628641 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fa79c0664a0 0x7fa79c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:16.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.337+0000 7fa7baffd640 1 --2- 172.21.15.78:0/686628641 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fa79c0664a0 0x7fa79c068960 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fa7bc069bd0 tx=0x7fa7ac009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:16.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.341+0000 7fa7b8ff9640 1 -- 172.21.15.78:0/686628641 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa7bc1f0ba0 con 0x7fa7bc0cecb0 2023-12-12T10:13:16.492 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.489+0000 7fa7c19df640 1 -- 172.21.15.78:0/686628641 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fa7bc1f0ba0 con 0x7fa7bc0cecb0 2023-12-12T10:13:16.493 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.489+0000 7fa7b8ff9640 1 -- 172.21.15.78:0/686628641 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7fa7bc1f0ba0 con 0x7fa7bc0cecb0 2023-12-12T10:13:16.493 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2023-12-12T10:13:16.495 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.489+0000 7fa7c19df640 1 -- 172.21.15.78:0/686628641 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fa79c0664a0 msgr2=0x7fa79c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:16.495 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.489+0000 7fa7c19df640 1 --2- 172.21.15.78:0/686628641 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fa79c0664a0 0x7fa79c068960 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fa7bc069bd0 tx=0x7fa7ac009190 comp rx=0 tx=0).stop 2023-12-12T10:13:16.495 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.489+0000 7fa7c19df640 1 -- 172.21.15.78:0/686628641 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa7bc0cecb0 msgr2=0x7fa7bc1efe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:16.495 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.489+0000 7fa7c19df640 1 --2- 172.21.15.78:0/686628641 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa7bc0cecb0 0x7fa7bc1efe20 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fa7bc162050 tx=0x7fa7b400eb50 comp rx=0 tx=0).stop 2023-12-12T10:13:16.495 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.489+0000 7fa7c19df640 1 -- 172.21.15.78:0/686628641 shutdown_connections 2023-12-12T10:13:16.495 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.489+0000 7fa7c19df640 1 --2- 172.21.15.78:0/686628641 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fa79c0664a0 0x7fa79c068960 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:16.495 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.489+0000 7fa7c19df640 1 --2- 172.21.15.78:0/686628641 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa7bc0cecb0 0x7fa7bc1efe20 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:16.495 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.489+0000 7fa7c19df640 1 --2- 172.21.15.78:0/686628641 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa7bc1f27e0 0x7fa7bc0ce770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:16.495 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.489+0000 7fa7c19df640 1 --2- 172.21.15.78:0/686628641 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa7a80047d0 0x7fa7bc1f39e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:16.495 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.489+0000 7fa7c19df640 1 -- 172.21.15.78:0/686628641 >> 172.21.15.78:0/686628641 conn(0x7fa7bc09c2f0 msgr2=0x7fa7bc15b750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:16.495 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.489+0000 7fa7c19df640 1 -- 172.21.15.78:0/686628641 shutdown_connections 2023-12-12T10:13:16.496 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.489+0000 7fa7c19df640 1 -- 172.21.15.78:0/686628641 wait complete. 2023-12-12T10:13:16.514 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-12T10:13:16.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.649+0000 7eff21d57640 1 Processor -- start 2023-12-12T10:13:16.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.649+0000 7eff21d57640 1 -- start start 2023-12-12T10:13:16.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.653+0000 7eff21d57640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7eff1c13c860 0x7eff1c0b4270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:16.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.653+0000 7eff21d57640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7eff1c0b47b0 0x7eff1c070bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:16.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.653+0000 7eff21d57640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7eff1c071100 0x7eff1c15d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:16.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.653+0000 7eff21d57640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff1c0b4c30 con 0x7eff1c071100 2023-12-12T10:13:16.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.653+0000 7eff21d57640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff1c0718f0 con 0x7eff1c13c860 2023-12-12T10:13:16.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.653+0000 7eff21d57640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff1c071bd0 con 0x7eff1c0b47b0 2023-12-12T10:13:16.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.653+0000 7eff1bfff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7eff1c071100 0x7eff1c15d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:16.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.653+0000 7eff1bfff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7eff1c071100 0x7eff1c15d170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:44776/0 (socket says 172.21.15.78:44776) 2023-12-12T10:13:16.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.653+0000 7eff1bfff640 1 -- 172.21.15.78:0/3061588278 learned_addr learned my addr 172.21.15.78:0/3061588278 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:13:16.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.653+0000 7eff1b7fe640 1 --2- 172.21.15.78:0/3061588278 >> v2:172.21.15.187:3300/0 conn(0x7eff1c13c860 0x7eff1c0b4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:16.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.653+0000 7eff1affd640 1 --2- 172.21.15.78:0/3061588278 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7eff1c0b47b0 0x7eff1c070bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:16.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.653+0000 7eff1bfff640 1 -- 172.21.15.78:0/3061588278 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7eff1c0b47b0 msgr2=0x7eff1c070bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:13:16.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.653+0000 7eff1bfff640 1 --2- 172.21.15.78:0/3061588278 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7eff1c0b47b0 0x7eff1c070bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:16.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.653+0000 7eff1bfff640 1 -- 172.21.15.78:0/3061588278 >> v2:172.21.15.187:3300/0 conn(0x7eff1c13c860 msgr2=0x7eff1c0b4270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:13:16.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.653+0000 7eff1bfff640 1 --2- 172.21.15.78:0/3061588278 >> v2:172.21.15.187:3300/0 conn(0x7eff1c13c860 0x7eff1c0b4270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:16.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.653+0000 7eff1bfff640 1 -- 172.21.15.78:0/3061588278 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff1c071eb0 con 0x7eff1c071100 2023-12-12T10:13:16.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.653+0000 7eff1bfff640 1 --2- 172.21.15.78:0/3061588278 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff1c071100 0x7eff1c15d170 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7eff1c06e290 tx=0x7eff1401dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29866fc4cc0e8a31 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:16.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.657+0000 7eff1a7fc640 1 -- 172.21.15.78:0/3061588278 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff140a68b0 con 0x7eff1c071100 2023-12-12T10:13:16.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.657+0000 7eff1a7fc640 1 -- 172.21.15.78:0/3061588278 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff140a6a10 con 0x7eff1c071100 2023-12-12T10:13:16.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.657+0000 7eff1a7fc640 1 -- 172.21.15.78:0/3061588278 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff140a6da0 con 0x7eff1c071100 2023-12-12T10:13:16.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.657+0000 7eff21d57640 1 -- 172.21.15.78:0/3061588278 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff1c071100 msgr2=0x7eff1c15d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:16.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.657+0000 7eff21d57640 1 --2- 172.21.15.78:0/3061588278 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff1c071100 0x7eff1c15d170 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7eff1c06e290 tx=0x7eff1401dab0 comp rx=0 tx=0).stop 2023-12-12T10:13:16.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.657+0000 7eff21d57640 1 -- 172.21.15.78:0/3061588278 shutdown_connections 2023-12-12T10:13:16.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.657+0000 7eff21d57640 1 --2- 172.21.15.78:0/3061588278 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff1c071100 0x7eff1c15d170 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:16.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.657+0000 7eff21d57640 1 --2- 172.21.15.78:0/3061588278 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7eff1c0b47b0 0x7eff1c070bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:16.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.657+0000 7eff21d57640 1 --2- 172.21.15.78:0/3061588278 >> v2:172.21.15.187:3300/0 conn(0x7eff1c13c860 0x7eff1c0b4270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:16.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.657+0000 7eff21d57640 1 -- 172.21.15.78:0/3061588278 >> 172.21.15.78:0/3061588278 conn(0x7eff1c06c5d0 msgr2=0x7eff1c06c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:16.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.657+0000 7eff21d57640 1 -- 172.21.15.78:0/3061588278 shutdown_connections 2023-12-12T10:13:16.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.657+0000 7eff21d57640 1 -- 172.21.15.78:0/3061588278 wait complete. 2023-12-12T10:13:16.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.657+0000 7eff21d57640 1 Processor -- start 2023-12-12T10:13:16.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.657+0000 7eff21d57640 1 -- start start 2023-12-12T10:13:16.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.657+0000 7eff21d57640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7eff1c071100 0x7eff1c1516f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:16.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.657+0000 7eff21d57640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7eff1c0b47b0 0x7eff1c0afcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:16.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.657+0000 7eff21d57640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff1c13c860 0x7eff1c0b0210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:16.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.657+0000 7eff21d57640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff1c0af4d0 con 0x7eff1c13c860 2023-12-12T10:13:16.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.657+0000 7eff21d57640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff1c0af8f0 con 0x7eff1c071100 2023-12-12T10:13:16.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.657+0000 7eff21d57640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff1c150f90 con 0x7eff1c0b47b0 2023-12-12T10:13:16.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.657+0000 7eff1bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff1c13c860 0x7eff1c0b0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:16.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.661+0000 7eff1bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff1c13c860 0x7eff1c0b0210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:44786/0 (socket says 172.21.15.78:44786) 2023-12-12T10:13:16.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.661+0000 7eff1bfff640 1 -- 172.21.15.78:0/3684043232 learned_addr learned my addr 172.21.15.78:0/3684043232 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:13:16.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.661+0000 7eff1b7fe640 1 --2- 172.21.15.78:0/3684043232 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7eff1c071100 0x7eff1c1516f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:16.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.661+0000 7eff1affd640 1 --2- 172.21.15.78:0/3684043232 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7eff1c0b47b0 0x7eff1c0afcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:16.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.661+0000 7eff1bfff640 1 -- 172.21.15.78:0/3684043232 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7eff1c0b47b0 msgr2=0x7eff1c0afcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:16.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.661+0000 7eff1bfff640 1 --2- 172.21.15.78:0/3684043232 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7eff1c0b47b0 0x7eff1c0afcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:16.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.661+0000 7eff1bfff640 1 -- 172.21.15.78:0/3684043232 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7eff1c071100 msgr2=0x7eff1c1516f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:16.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.661+0000 7eff1bfff640 1 --2- 172.21.15.78:0/3684043232 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7eff1c071100 0x7eff1c1516f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:16.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.661+0000 7eff1bfff640 1 -- 172.21.15.78:0/3684043232 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff14009b30 con 0x7eff1c13c860 2023-12-12T10:13:16.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.661+0000 7eff1bfff640 1 --2- 172.21.15.78:0/3684043232 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff1c13c860 0x7eff1c0b0210 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7eff1401e350 tx=0x7eff1401c2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:16.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.661+0000 7eff03fff640 1 -- 172.21.15.78:0/3684043232 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff140b9680 con 0x7eff1c13c860 2023-12-12T10:13:16.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.661+0000 7eff03fff640 1 -- 172.21.15.78:0/3684043232 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff140b97e0 con 0x7eff1c13c860 2023-12-12T10:13:16.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.661+0000 7eff21d57640 1 -- 172.21.15.78:0/3684043232 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff1c14eeb0 con 0x7eff1c13c860 2023-12-12T10:13:16.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.661+0000 7eff03fff640 1 -- 172.21.15.78:0/3684043232 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff140b9b90 con 0x7eff1c13c860 2023-12-12T10:13:16.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.661+0000 7eff21d57640 1 -- 172.21.15.78:0/3684043232 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff1c151c30 con 0x7eff1c13c860 2023-12-12T10:13:16.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.661+0000 7eff21d57640 1 -- 172.21.15.78:0/3684043232 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff1c0671f0 con 0x7eff1c13c860 2023-12-12T10:13:16.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.661+0000 7eff03fff640 1 -- 172.21.15.78:0/3684043232 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7eff140b9cf0 con 0x7eff1c13c860 2023-12-12T10:13:16.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.661+0000 7eff03fff640 1 --2- 172.21.15.78:0/3684043232 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7eff08066470 0x7eff08068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:16.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.661+0000 7eff03fff640 1 -- 172.21.15.78:0/3684043232 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7eff1411ee30 con 0x7eff1c13c860 2023-12-12T10:13:16.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.665+0000 7eff1b7fe640 1 --2- 172.21.15.78:0/3684043232 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7eff08066470 0x7eff08068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:16.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.665+0000 7eff1b7fe640 1 --2- 172.21.15.78:0/3684043232 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7eff08066470 0x7eff08068930 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7eff0c0079c0 tx=0x7eff0c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:16.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.665+0000 7eff03fff640 1 -- 172.21.15.78:0/3684043232 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7eff140ebf90 con 0x7eff1c13c860 2023-12-12T10:13:16.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.849+0000 7eff21d57640 1 -- 172.21.15.78:0/3684043232 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7eff1c0af610 con 0x7eff1c13c860 2023-12-12T10:13:16.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.849+0000 7eff03fff640 1 -- 172.21.15.78:0/3684043232 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4912 (secure 0 0 0) 0x7eff140be090 con 0x7eff1c13c860 2023-12-12T10:13:16.853 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:13:16.853 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/3747609982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":3747609982},{"type":"v1","addr":"172.21.15.187:6834","nonce":3747609982}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4282,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/3245919280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":3245919280},{"type":"v1","addr":"172.21.15.187:6835","nonce":3245919280}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4293,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/3902814576","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":3902814576},{"type":"v1","addr":"172.21.15.78:6835","nonce":3902814576}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-12T10:12:09.200933+0000","modified":"2023-12-12T10:12:26.296409+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4296},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4296":{"gid":4296,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.78:6837/739552946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":739552946},{"type":"v1","addr":"172.21.15.78:6837","nonce":739552946}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-12T10:13:16.853 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 9 2023-12-12T10:13:16.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.849+0000 7eff21d57640 1 -- 172.21.15.78:0/3684043232 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7eff08066470 msgr2=0x7eff08068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:16.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.849+0000 7eff21d57640 1 --2- 172.21.15.78:0/3684043232 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7eff08066470 0x7eff08068930 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7eff0c0079c0 tx=0x7eff0c008040 comp rx=0 tx=0).stop 2023-12-12T10:13:16.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.849+0000 7eff21d57640 1 -- 172.21.15.78:0/3684043232 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff1c13c860 msgr2=0x7eff1c0b0210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:16.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.849+0000 7eff21d57640 1 --2- 172.21.15.78:0/3684043232 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff1c13c860 0x7eff1c0b0210 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7eff1401e350 tx=0x7eff1401c2f0 comp rx=0 tx=0).stop 2023-12-12T10:13:16.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.849+0000 7eff21d57640 1 -- 172.21.15.78:0/3684043232 shutdown_connections 2023-12-12T10:13:16.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.849+0000 7eff21d57640 1 --2- 172.21.15.78:0/3684043232 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7eff08066470 0x7eff08068930 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:16.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.849+0000 7eff21d57640 1 --2- 172.21.15.78:0/3684043232 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7eff1c13c860 0x7eff1c0b0210 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:16.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.849+0000 7eff21d57640 1 --2- 172.21.15.78:0/3684043232 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7eff1c0b47b0 0x7eff1c0afcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:16.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.849+0000 7eff21d57640 1 --2- 172.21.15.78:0/3684043232 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7eff1c071100 0x7eff1c1516f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:16.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.849+0000 7eff21d57640 1 -- 172.21.15.78:0/3684043232 >> 172.21.15.78:0/3684043232 conn(0x7eff1c06c5d0 msgr2=0x7eff1c06db70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:16.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.853+0000 7eff21d57640 1 -- 172.21.15.78:0/3684043232 shutdown_connections 2023-12-12T10:13:16.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:16.853+0000 7eff21d57640 1 -- 172.21.15.78:0/3684043232 wait complete. 2023-12-12T10:13:16.875 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T10:13:17.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.009+0000 7fd4880ea640 1 Processor -- start 2023-12-12T10:13:17.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.009+0000 7fd4880ea640 1 -- start start 2023-12-12T10:13:17.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.009+0000 7fd4880ea640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd4800ade10 0x7fd4800ce5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:17.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.009+0000 7fd4880ea640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fd4800cb7e0 0x7fd4800b40c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:17.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.009+0000 7fd4880ea640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4800ae1f0 con 0x7fd4800b4600 2023-12-12T10:13:17.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.009+0000 7fd4880ea640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4800b4ab0 con 0x7fd4800cb7e0 2023-12-12T10:13:17.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.009+0000 7fd4880ea640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd48015c410 con 0x7fd4800ade10 2023-12-12T10:13:17.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.009+0000 7fd485e86640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd4800ade10 0x7fd4800ce5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:17.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.009+0000 7fd485685640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fd4800cb7e0 0x7fd4800b40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:17.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.009+0000 7fd485e86640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd4800ade10 0x7fd4800ce5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.78:55716/0 (socket says 172.21.15.78:55716) 2023-12-12T10:13:17.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.009+0000 7fd486687640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7fd4800b4600 0x7fd4801580a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.78:54796/0 (socket says 172.21.15.78:54796) 2023-12-12T10:13:17.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.009+0000 7fd485e86640 1 -- 172.21.15.78:0/910262443 learned_addr learned my addr 172.21.15.78:0/910262443 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:13:17.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.009+0000 7fd485e86640 1 -- 172.21.15.78:0/910262443 >> v2:172.21.15.187:3300/0 conn(0x7fd4800cb7e0 msgr2=0x7fd4800b40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:13:17.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.009+0000 7fd485e86640 1 --2- 172.21.15.78:0/910262443 >> v2:172.21.15.187:3300/0 conn(0x7fd4800cb7e0 0x7fd4800b40c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:17.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.009+0000 7fd485e86640 1 -- 172.21.15.78:0/910262443 >> v1:172.21.15.187:6789/0 conn(0x7fd4800b4600 legacy=0x7fd4801580a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:17.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.009+0000 7fd485e86640 1 -- 172.21.15.78:0/910262443 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4800ceb00 con 0x7fd4800ade10 2023-12-12T10:13:17.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.013+0000 7fd485e86640 1 --2- 172.21.15.78:0/910262443 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd4800ade10 0x7fd4800ce5c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd47c009870 tx=0x7fd47c01c540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=18c5390e1535031b server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:17.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.013+0000 7fd484e84640 1 -- 172.21.15.78:0/910262443 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd47c0a7070 con 0x7fd4800ade10 2023-12-12T10:13:17.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.013+0000 7fd484e84640 1 -- 172.21.15.78:0/910262443 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd47c0ab430 con 0x7fd4800ade10 2023-12-12T10:13:17.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.013+0000 7fd484e84640 1 -- 172.21.15.78:0/910262443 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd47c0ab7c0 con 0x7fd4800ade10 2023-12-12T10:13:17.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.013+0000 7fd4880ea640 1 -- 172.21.15.78:0/910262443 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd4800ade10 msgr2=0x7fd4800ce5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:17.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.013+0000 7fd4880ea640 1 --2- 172.21.15.78:0/910262443 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd4800ade10 0x7fd4800ce5c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd47c009870 tx=0x7fd47c01c540 comp rx=0 tx=0).stop 2023-12-12T10:13:17.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.013+0000 7fd4880ea640 1 -- 172.21.15.78:0/910262443 shutdown_connections 2023-12-12T10:13:17.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.013+0000 7fd4880ea640 1 --2- 172.21.15.78:0/910262443 >> v2:172.21.15.187:3300/0 conn(0x7fd4800cb7e0 0x7fd4800b40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:17.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.013+0000 7fd4880ea640 1 --2- 172.21.15.78:0/910262443 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd4800ade10 0x7fd4800ce5c0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:17.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.013+0000 7fd4880ea640 1 -- 172.21.15.78:0/910262443 >> 172.21.15.78:0/910262443 conn(0x7fd48006c5d0 msgr2=0x7fd48006c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:17.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.013+0000 7fd4880ea640 1 -- 172.21.15.78:0/910262443 shutdown_connections 2023-12-12T10:13:17.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.013+0000 7fd4880ea640 1 -- 172.21.15.78:0/910262443 wait complete. 2023-12-12T10:13:17.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.017+0000 7fd4880ea640 1 Processor -- start 2023-12-12T10:13:17.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.017+0000 7fd4880ea640 1 -- start start 2023-12-12T10:13:17.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.017+0000 7fd4880ea640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd4800ade10 0x7fd48014c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:17.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.017+0000 7fd4880ea640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd4800b4600 0x7fd480153eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:17.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.017+0000 7fd4880ea640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd4800cb7e0 0x7fd480150e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:17.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.017+0000 7fd4880ea640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4801559a0 con 0x7fd4800ade10 2023-12-12T10:13:17.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.017+0000 7fd4880ea640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd480154900 con 0x7fd4800cb7e0 2023-12-12T10:13:17.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.017+0000 7fd4880ea640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd480154be0 con 0x7fd4800b4600 2023-12-12T10:13:17.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.017+0000 7fd485e86640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd4800ade10 0x7fd48014c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:17.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.017+0000 7fd485e86640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd4800ade10 0x7fd48014c010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:44792/0 (socket says 172.21.15.78:44792) 2023-12-12T10:13:17.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.017+0000 7fd485e86640 1 -- 172.21.15.78:0/458261251 learned_addr learned my addr 172.21.15.78:0/458261251 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:13:17.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.017+0000 7fd485685640 1 --2- 172.21.15.78:0/458261251 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd4800b4600 0x7fd480153eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:17.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.017+0000 7fd486687640 1 --2- 172.21.15.78:0/458261251 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd4800cb7e0 0x7fd480150e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:17.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.017+0000 7fd485e86640 1 -- 172.21.15.78:0/458261251 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd4800b4600 msgr2=0x7fd480153eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:17.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.017+0000 7fd485e86640 1 --2- 172.21.15.78:0/458261251 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd4800b4600 0x7fd480153eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:17.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.017+0000 7fd485e86640 1 -- 172.21.15.78:0/458261251 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd4800cb7e0 msgr2=0x7fd480150e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:17.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.017+0000 7fd485e86640 1 --2- 172.21.15.78:0/458261251 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd4800cb7e0 0x7fd480150e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:17.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.017+0000 7fd485e86640 1 -- 172.21.15.78:0/458261251 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd47c0094d0 con 0x7fd4800ade10 2023-12-12T10:13:17.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.017+0000 7fd485e86640 1 --2- 172.21.15.78:0/458261251 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd4800ade10 0x7fd48014c010 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fd47c0ad040 tx=0x7fd47c0192e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:17.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.017+0000 7fd4767fc640 1 -- 172.21.15.78:0/458261251 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd47c0b4620 con 0x7fd4800ade10 2023-12-12T10:13:17.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.017+0000 7fd4767fc640 1 -- 172.21.15.78:0/458261251 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd47c0b4780 con 0x7fd4800ade10 2023-12-12T10:13:17.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.017+0000 7fd4767fc640 1 -- 172.21.15.78:0/458261251 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd47c0b4b30 con 0x7fd4800ade10 2023-12-12T10:13:17.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.017+0000 7fd4880ea640 1 -- 172.21.15.78:0/458261251 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd480154ec0 con 0x7fd4800ade10 2023-12-12T10:13:17.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.017+0000 7fd4880ea640 1 -- 172.21.15.78:0/458261251 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd480155480 con 0x7fd4800ade10 2023-12-12T10:13:17.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.021+0000 7fd4880ea640 1 -- 172.21.15.78:0/458261251 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4800671f0 con 0x7fd4800ade10 2023-12-12T10:13:17.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.021+0000 7fd4767fc640 1 -- 172.21.15.78:0/458261251 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd47c0b4c90 con 0x7fd4800ade10 2023-12-12T10:13:17.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.021+0000 7fd4767fc640 1 --2- 172.21.15.78:0/458261251 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fd464066470 0x7fd464068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:17.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.021+0000 7fd4767fc640 1 -- 172.21.15.78:0/458261251 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fd47c11e580 con 0x7fd4800ade10 2023-12-12T10:13:17.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.021+0000 7fd485685640 1 --2- 172.21.15.78:0/458261251 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fd464066470 0x7fd464068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:17.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.021+0000 7fd485685640 1 --2- 172.21.15.78:0/458261251 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fd464066470 0x7fd464068930 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fd4800af8c0 tx=0x7fd470008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:17.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.025+0000 7fd4767fc640 1 -- 172.21.15.78:0/458261251 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd47c0eb5a0 con 0x7fd4800ade10 2023-12-12T10:13:17.182 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.177+0000 7fd4880ea640 1 -- 172.21.15.78:0/458261251 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd480067530 con 0x7fd4800ade10 2023-12-12T10:13:17.182 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.177+0000 7fd4767fc640 1 -- 172.21.15.78:0/458261251 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18701 (secure 0 0 0) 0x7fd47c0eebc0 con 0x7fd4800ade10 2023-12-12T10:13:17.182 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:13:17.183 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":26,"fsid":"fc81937c-bd26-483c-952b-d1324fcb0c9e","created":"2023-12-12T10:11:44.020214+0000","modified":"2023-12-12T10:12:50.919344+0000","last_up_change":"2023-12-12T10:11:56.278318+0000","last_in_change":"2023-12-12T10:11:46.553610+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T10:11:57.053584+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-12T10:12:07.454450+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-12T10:12:08.182909+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-12T10:12:11.977952+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"22dfdedf-5f6c-4b20-9f6c-30517a1db70a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6809","nonce":3345683600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6811","nonce":3345683600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6815","nonce":3345683600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6813","nonce":3345683600}]},"public_addr":"172.21.15.78:6809/3345683600","cluster_addr":"172.21.15.78:6811/3345683600","heartbeat_back_addr":"172.21.15.78:6815/3345683600","heartbeat_front_addr":"172.21.15.78:6813/3345683600","state":["exists","up"]},{"osd":1,"uuid":"be34a7f3-a69a-462e-9ddf-5e537448dba2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6801","nonce":962652768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6803","nonce":962652768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6807","nonce":962652768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6805","nonce":962652768}]},"public_addr":"172.21.15.78:6801/962652768","cluster_addr":"172.21.15.78:6803/962652768","heartbeat_back_addr":"172.21.15.78:6807/962652768","heartbeat_front_addr":"172.21.15.78:6805/962652768","state":["exists","up"]},{"osd":2,"uuid":"55b381de-5f56-4b14-80f7-e6e41e084a13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6818","nonce":2910206054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6822","nonce":2910206054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6829","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6831","nonce":2910206054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6826","nonce":2910206054}]},"public_addr":"172.21.15.78:6818/2910206054","cluster_addr":"172.21.15.78:6822/2910206054","heartbeat_back_addr":"172.21.15.78:6831/2910206054","heartbeat_front_addr":"172.21.15.78:6826/2910206054","state":["exists","up"]},{"osd":3,"uuid":"d7682de1-25cb-4cec-869f-8851c28b0e6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6819","nonce":3750796703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6821","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6823","nonce":3750796703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6830","nonce":3750796703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6825","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6827","nonce":3750796703}]},"public_addr":"172.21.15.78:6819/3750796703","cluster_addr":"172.21.15.78:6823/3750796703","heartbeat_back_addr":"172.21.15.78:6830/3750796703","heartbeat_front_addr":"172.21.15.78:6827/3750796703","state":["exists","up"]},{"osd":4,"uuid":"8279815a-d6c7-4199-871e-d28971b9dc07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6809","nonce":2944277204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6811","nonce":2944277204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6815","nonce":2944277204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6813","nonce":2944277204}]},"public_addr":"172.21.15.187:6809/2944277204","cluster_addr":"172.21.15.187:6811/2944277204","heartbeat_back_addr":"172.21.15.187:6815/2944277204","heartbeat_front_addr":"172.21.15.187:6813/2944277204","state":["exists","up"]},{"osd":5,"uuid":"0a714c65-f8ce-4340-968f-11a799677ef3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6801","nonce":185858620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6803","nonce":185858620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6807","nonce":185858620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6805","nonce":185858620}]},"public_addr":"172.21.15.187:6801/185858620","cluster_addr":"172.21.15.187:6803/185858620","heartbeat_back_addr":"172.21.15.187:6807/185858620","heartbeat_front_addr":"172.21.15.187:6805/185858620","state":["exists","up"]},{"osd":6,"uuid":"d0bba9ab-f7ee-449e-8999-1c0cf7e6d53c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6817","nonce":4213392126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6819","nonce":4213392126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6824","nonce":4213392126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6821","nonce":4213392126}]},"public_addr":"172.21.15.187:6817/4213392126","cluster_addr":"172.21.15.187:6819/4213392126","heartbeat_back_addr":"172.21.15.187:6824/4213392126","heartbeat_front_addr":"172.21.15.187:6821/4213392126","state":["exists","up"]},{"osd":7,"uuid":"efe5e0d9-2f87-4889-a27a-e2a95a632302","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6823","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6825","nonce":85774004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6827","nonce":85774004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6831","nonce":85774004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6829","nonce":85774004}]},"public_addr":"172.21.15.187:6825/85774004","cluster_addr":"172.21.15.187:6827/85774004","heartbeat_back_addr":"172.21.15.187:6831/85774004","heartbeat_front_addr":"172.21.15.187:6829/85774004","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.214447+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.448899+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.293107+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.564184+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.175026+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.097717+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.261141+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.287681+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.18","mappings":[{"from":3,"to":2}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.13","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T10:13:17.183 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.177+0000 7fd4880ea640 1 -- 172.21.15.78:0/458261251 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fd464066470 msgr2=0x7fd464068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:17.184 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.177+0000 7fd4880ea640 1 --2- 172.21.15.78:0/458261251 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fd464066470 0x7fd464068930 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fd4800af8c0 tx=0x7fd470008040 comp rx=0 tx=0).stop 2023-12-12T10:13:17.184 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.177+0000 7fd4880ea640 1 -- 172.21.15.78:0/458261251 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd4800ade10 msgr2=0x7fd48014c010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:17.184 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.177+0000 7fd4880ea640 1 --2- 172.21.15.78:0/458261251 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd4800ade10 0x7fd48014c010 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fd47c0ad040 tx=0x7fd47c0192e0 comp rx=0 tx=0).stop 2023-12-12T10:13:17.184 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.177+0000 7fd4880ea640 1 -- 172.21.15.78:0/458261251 shutdown_connections 2023-12-12T10:13:17.184 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.177+0000 7fd4880ea640 1 --2- 172.21.15.78:0/458261251 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fd464066470 0x7fd464068930 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:17.184 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.177+0000 7fd4880ea640 1 --2- 172.21.15.78:0/458261251 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd4800cb7e0 0x7fd480150e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:17.184 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.177+0000 7fd4880ea640 1 --2- 172.21.15.78:0/458261251 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd4800b4600 0x7fd480153eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:17.184 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.177+0000 7fd4880ea640 1 --2- 172.21.15.78:0/458261251 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd4800ade10 0x7fd48014c010 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:17.184 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.177+0000 7fd4880ea640 1 -- 172.21.15.78:0/458261251 >> 172.21.15.78:0/458261251 conn(0x7fd48006c5d0 msgr2=0x7fd4800acd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:17.184 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.177+0000 7fd4880ea640 1 -- 172.21.15.78:0/458261251 shutdown_connections 2023-12-12T10:13:17.184 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.177+0000 7fd4880ea640 1 -- 172.21.15.78:0/458261251 wait complete. 2023-12-12T10:13:17.202 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-12T10:13:17.202 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-12T10:13:17.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.337+0000 7fbaba72a640 1 Processor -- start 2023-12-12T10:13:17.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.337+0000 7fbaba72a640 1 -- start start 2023-12-12T10:13:17.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.337+0000 7fbaba72a640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fbab413ceb0 0x7fbab413d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:17.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.337+0000 7fbaba72a640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbab413fc60 0x7fbab4072030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:17.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.337+0000 7fbaba72a640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbab40705a0 con 0x7fbab4071bf0 2023-12-12T10:13:17.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.337+0000 7fbaba72a640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbab4140410 con 0x7fbab413ceb0 2023-12-12T10:13:17.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.337+0000 7fbaba72a640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbab40cdc90 con 0x7fbab413fc60 2023-12-12T10:13:17.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.337+0000 7fbab3fff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fbab413ceb0 0x7fbab413d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:17.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.337+0000 7fbab3fff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fbab413ceb0 0x7fbab413d4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:44800/0 (socket says 172.21.15.78:44800) 2023-12-12T10:13:17.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.337+0000 7fbab3fff640 1 -- 172.21.15.78:0/3022807398 learned_addr learned my addr 172.21.15.78:0/3022807398 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:13:17.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.337+0000 7fbab3fff640 1 -- 172.21.15.78:0/3022807398 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbab413fc60 msgr2=0x7fbab4072030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:13:17.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.337+0000 7fbab8cc7640 1 --2- 172.21.15.78:0/3022807398 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbab413fc60 0x7fbab4072030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:17.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.337+0000 7fbab3fff640 1 --2- 172.21.15.78:0/3022807398 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbab413fc60 0x7fbab4072030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:17.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.337+0000 7fbab3fff640 1 -- 172.21.15.78:0/3022807398 >> v1:172.21.15.78:6789/0 conn(0x7fbab4071bf0 legacy=0x7fbab413f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:17.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.337+0000 7fbab3fff640 1 -- 172.21.15.78:0/3022807398 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbab4072570 con 0x7fbab413ceb0 2023-12-12T10:13:17.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.337+0000 7fbab8cc7640 1 --2- 172.21.15.78:0/3022807398 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbab413fc60 0x7fbab4072030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T10:13:17.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.341+0000 7fbab3fff640 1 --2- 172.21.15.78:0/3022807398 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbab413ceb0 0x7fbab413d4c0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fbaa4009870 tx=0x7fbaa401c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b28742a0d257cd6 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:17.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.341+0000 7fbab2ffd640 1 -- 172.21.15.78:0/3022807398 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaa40ab600 con 0x7fbab413ceb0 2023-12-12T10:13:17.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.341+0000 7fbab2ffd640 1 -- 172.21.15.78:0/3022807398 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbaa40a7050 con 0x7fbab413ceb0 2023-12-12T10:13:17.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.341+0000 7fbab2ffd640 1 -- 172.21.15.78:0/3022807398 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaa40ab980 con 0x7fbab413ceb0 2023-12-12T10:13:17.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.341+0000 7fbaba72a640 1 -- 172.21.15.78:0/3022807398 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbab413ceb0 msgr2=0x7fbab413d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:17.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.341+0000 7fbaba72a640 1 --2- 172.21.15.78:0/3022807398 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbab413ceb0 0x7fbab413d4c0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fbaa4009870 tx=0x7fbaa401c540 comp rx=0 tx=0).stop 2023-12-12T10:13:17.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.341+0000 7fbaba72a640 1 -- 172.21.15.78:0/3022807398 shutdown_connections 2023-12-12T10:13:17.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.341+0000 7fbaba72a640 1 --2- 172.21.15.78:0/3022807398 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbab413fc60 0x7fbab4072030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:17.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.341+0000 7fbaba72a640 1 --2- 172.21.15.78:0/3022807398 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbab413ceb0 0x7fbab413d4c0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:17.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.341+0000 7fbaba72a640 1 -- 172.21.15.78:0/3022807398 >> 172.21.15.78:0/3022807398 conn(0x7fbab406c5d0 msgr2=0x7fbab406c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:17.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.341+0000 7fbaba72a640 1 -- 172.21.15.78:0/3022807398 shutdown_connections 2023-12-12T10:13:17.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.345+0000 7fbaba72a640 1 -- 172.21.15.78:0/3022807398 wait complete. 2023-12-12T10:13:17.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.345+0000 7fbaba72a640 1 Processor -- start 2023-12-12T10:13:17.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.345+0000 7fbaba72a640 1 -- start start 2023-12-12T10:13:17.352 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.345+0000 7fbaba72a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbab4071bf0 0x7fbab4150940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:17.352 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.345+0000 7fbaba72a640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbab413ceb0 0x7fbab40b28e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:17.352 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.345+0000 7fbaba72a640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbab413fc60 0x7fbab413ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:17.352 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.345+0000 7fbaba72a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbab413c4d0 con 0x7fbab4071bf0 2023-12-12T10:13:17.352 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.345+0000 7fbaba72a640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbab4152320 con 0x7fbab413fc60 2023-12-12T10:13:17.352 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.345+0000 7fbaba72a640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbab4152600 con 0x7fbab413ceb0 2023-12-12T10:13:17.352 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.345+0000 7fbab3fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbab4071bf0 0x7fbab4150940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:17.352 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.345+0000 7fbab3fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbab4071bf0 0x7fbab4150940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:44816/0 (socket says 172.21.15.78:44816) 2023-12-12T10:13:17.352 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.345+0000 7fbab3fff640 1 -- 172.21.15.78:0/3457626449 learned_addr learned my addr 172.21.15.78:0/3457626449 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:13:17.353 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.345+0000 7fbab37fe640 1 --2- 172.21.15.78:0/3457626449 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbab413ceb0 0x7fbab40b28e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:17.353 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.345+0000 7fbab3fff640 1 -- 172.21.15.78:0/3457626449 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbab413ceb0 msgr2=0x7fbab40b28e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:17.353 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.345+0000 7fbab8cc7640 1 --2- 172.21.15.78:0/3457626449 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbab413fc60 0x7fbab413ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:17.353 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.345+0000 7fbab3fff640 1 --2- 172.21.15.78:0/3457626449 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbab413ceb0 0x7fbab40b28e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:17.353 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.345+0000 7fbab3fff640 1 -- 172.21.15.78:0/3457626449 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbab413fc60 msgr2=0x7fbab413ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:17.353 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.345+0000 7fbab3fff640 1 --2- 172.21.15.78:0/3457626449 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbab413fc60 0x7fbab413ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:17.353 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.345+0000 7fbab3fff640 1 -- 172.21.15.78:0/3457626449 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaa40094d0 con 0x7fbab4071bf0 2023-12-12T10:13:17.353 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.345+0000 7fbab37fe640 1 --2- 172.21.15.78:0/3457626449 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbab413ceb0 0x7fbab40b28e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T10:13:17.353 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.345+0000 7fbab8cc7640 1 --2- 172.21.15.78:0/3457626449 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbab413fc60 0x7fbab413ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T10:13:17.353 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.349+0000 7fbab3fff640 1 --2- 172.21.15.78:0/3457626449 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbab4071bf0 0x7fbab4150940 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fbaa40ae040 tx=0x7fbaa40192e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:17.353 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.349+0000 7fbab0ff9640 1 -- 172.21.15.78:0/3457626449 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaa40b4640 con 0x7fbab4071bf0 2023-12-12T10:13:17.353 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.349+0000 7fbab0ff9640 1 -- 172.21.15.78:0/3457626449 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbaa40b47a0 con 0x7fbab4071bf0 2023-12-12T10:13:17.353 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.349+0000 7fbab0ff9640 1 -- 172.21.15.78:0/3457626449 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaa40b4b50 con 0x7fbab4071bf0 2023-12-12T10:13:17.353 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.349+0000 7fbaba72a640 1 -- 172.21.15.78:0/3457626449 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbab41528e0 con 0x7fbab4071bf0 2023-12-12T10:13:17.353 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.349+0000 7fbaba72a640 1 -- 172.21.15.78:0/3457626449 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbab40b2e20 con 0x7fbab4071bf0 2023-12-12T10:13:17.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.349+0000 7fbaba72a640 1 -- 172.21.15.78:0/3457626449 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbab40671f0 con 0x7fbab4071bf0 2023-12-12T10:13:17.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.349+0000 7fbab0ff9640 1 -- 172.21.15.78:0/3457626449 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fbaa40b2070 con 0x7fbab4071bf0 2023-12-12T10:13:17.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.349+0000 7fbab0ff9640 1 --2- 172.21.15.78:0/3457626449 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fbaa0066470 0x7fbaa0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:17.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.349+0000 7fbab0ff9640 1 -- 172.21.15.78:0/3457626449 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fbaa411e290 con 0x7fbab4071bf0 2023-12-12T10:13:17.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.349+0000 7fbab37fe640 1 --2- 172.21.15.78:0/3457626449 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fbaa0066470 0x7fbaa0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:17.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.353+0000 7fbab37fe640 1 --2- 172.21.15.78:0/3457626449 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fbaa0066470 0x7fbaa0068930 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fbab40b23c0 tx=0x7fbaa8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:17.358 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.353+0000 7fbab0ff9640 1 -- 172.21.15.78:0/3457626449 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fbaa40eb350 con 0x7fbab4071bf0 2023-12-12T10:13:17.539 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.533+0000 7fbaba72a640 1 -- 172.21.15.78:0/3457626449 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbab4067530 con 0x7fbab4071bf0 2023-12-12T10:13:17.539 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.537+0000 7fbab0ff9640 1 -- 172.21.15.78:0/3457626449 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4912 (secure 0 0 0) 0x7fbaa40ee970 con 0x7fbab4071bf0 2023-12-12T10:13:17.539 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:13:17.540 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/3747609982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":3747609982},{"type":"v1","addr":"172.21.15.187:6834","nonce":3747609982}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4282,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/3245919280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":3245919280},{"type":"v1","addr":"172.21.15.187:6835","nonce":3245919280}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4293,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/3902814576","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":3902814576},{"type":"v1","addr":"172.21.15.78:6835","nonce":3902814576}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-12T10:12:09.200933+0000","modified":"2023-12-12T10:12:26.296409+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4296},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4296":{"gid":4296,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.78:6837/739552946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":739552946},{"type":"v1","addr":"172.21.15.78:6837","nonce":739552946}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-12T10:13:17.540 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 9 2023-12-12T10:13:17.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.537+0000 7fbaba72a640 1 -- 172.21.15.78:0/3457626449 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fbaa0066470 msgr2=0x7fbaa0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:17.541 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.537+0000 7fbaba72a640 1 --2- 172.21.15.78:0/3457626449 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fbaa0066470 0x7fbaa0068930 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fbab40b23c0 tx=0x7fbaa8009040 comp rx=0 tx=0).stop 2023-12-12T10:13:17.542 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.537+0000 7fbaba72a640 1 -- 172.21.15.78:0/3457626449 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbab4071bf0 msgr2=0x7fbab4150940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:17.542 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.537+0000 7fbaba72a640 1 --2- 172.21.15.78:0/3457626449 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbab4071bf0 0x7fbab4150940 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fbaa40ae040 tx=0x7fbaa40192e0 comp rx=0 tx=0).stop 2023-12-12T10:13:17.542 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.537+0000 7fbaba72a640 1 -- 172.21.15.78:0/3457626449 shutdown_connections 2023-12-12T10:13:17.542 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.537+0000 7fbaba72a640 1 --2- 172.21.15.78:0/3457626449 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fbaa0066470 0x7fbaa0068930 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:17.542 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.537+0000 7fbaba72a640 1 --2- 172.21.15.78:0/3457626449 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbab413fc60 0x7fbab413ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:17.542 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.537+0000 7fbaba72a640 1 --2- 172.21.15.78:0/3457626449 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbab413ceb0 0x7fbab40b28e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:17.542 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.537+0000 7fbaba72a640 1 --2- 172.21.15.78:0/3457626449 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fbab4071bf0 0x7fbab4150940 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:17.542 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.537+0000 7fbaba72a640 1 -- 172.21.15.78:0/3457626449 >> 172.21.15.78:0/3457626449 conn(0x7fbab406c5d0 msgr2=0x7fbab4142650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:17.542 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.537+0000 7fbaba72a640 1 -- 172.21.15.78:0/3457626449 shutdown_connections 2023-12-12T10:13:17.542 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.537+0000 7fbaba72a640 1 -- 172.21.15.78:0/3457626449 wait complete. 2023-12-12T10:13:17.561 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-12T10:13:17.698 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.693+0000 7f478e268640 1 Processor -- start 2023-12-12T10:13:17.698 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.693+0000 7f478e268640 1 -- start start 2023-12-12T10:13:17.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.693+0000 7f478e268640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f4788071bf0 0x7f4788072030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:17.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.693+0000 7f478e268640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47880705a0 con 0x7f478813f550 2023-12-12T10:13:17.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.693+0000 7f478e268640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4788140410 con 0x7f478813ceb0 2023-12-12T10:13:17.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.693+0000 7f478e268640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47880cdc90 con 0x7f4788071bf0 2023-12-12T10:13:17.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.697+0000 7f47877fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f4788071bf0 0x7f4788072030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:17.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.697+0000 7f47877fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f4788071bf0 0x7f4788072030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:44830/0 (socket says 172.21.15.78:44830) 2023-12-12T10:13:17.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.697+0000 7f47877fe640 1 -- 172.21.15.78:0/1165431128 learned_addr learned my addr 172.21.15.78:0/1165431128 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:13:17.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.697+0000 7f47877fe640 1 -- 172.21.15.78:0/1165431128 >> v1:172.21.15.187:6789/0 conn(0x7f478813ceb0 legacy=0x7f478813d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:13:17.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.697+0000 7f47877fe640 1 -- 172.21.15.78:0/1165431128 >> v1:172.21.15.78:6789/0 conn(0x7f478813f550 legacy=0x7f47880ce120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:13:17.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.697+0000 7f47877fe640 1 -- 172.21.15.78:0/1165431128 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4788072570 con 0x7f4788071bf0 2023-12-12T10:13:17.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.697+0000 7f47877fe640 1 --2- 172.21.15.78:0/1165431128 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4788071bf0 0x7f4788072030 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f477c009870 tx=0x7f477c01c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf5602b7524380ff server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:17.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.697+0000 7f4786ffd640 1 -- 172.21.15.78:0/1165431128 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f477c0ab600 con 0x7f4788071bf0 2023-12-12T10:13:17.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.697+0000 7f4786ffd640 1 -- 172.21.15.78:0/1165431128 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f477c0a7050 con 0x7f4788071bf0 2023-12-12T10:13:17.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.697+0000 7f4786ffd640 1 -- 172.21.15.78:0/1165431128 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f477c0ab980 con 0x7f4788071bf0 2023-12-12T10:13:17.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.701+0000 7f478e268640 1 -- 172.21.15.78:0/1165431128 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4788071bf0 msgr2=0x7f4788072030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:17.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.701+0000 7f478e268640 1 --2- 172.21.15.78:0/1165431128 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4788071bf0 0x7f4788072030 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f477c009870 tx=0x7f477c01c4c0 comp rx=0 tx=0).stop 2023-12-12T10:13:17.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.701+0000 7f478e268640 1 -- 172.21.15.78:0/1165431128 shutdown_connections 2023-12-12T10:13:17.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.701+0000 7f478e268640 1 --2- 172.21.15.78:0/1165431128 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4788071bf0 0x7f4788072030 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:17.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.701+0000 7f478e268640 1 -- 172.21.15.78:0/1165431128 >> 172.21.15.78:0/1165431128 conn(0x7f478806c5d0 msgr2=0x7f478806c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:17.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.701+0000 7f478e268640 1 -- 172.21.15.78:0/1165431128 shutdown_connections 2023-12-12T10:13:17.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.701+0000 7f478e268640 1 -- 172.21.15.78:0/1165431128 wait complete. 2023-12-12T10:13:17.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.701+0000 7f478e268640 1 Processor -- start 2023-12-12T10:13:17.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.701+0000 7f478e268640 1 -- start start 2023-12-12T10:13:17.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.701+0000 7f478e268640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4788071bf0 0x7f4788150f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:17.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.701+0000 7f478e268640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f478813ceb0 0x7f47881375d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:17.712 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.701+0000 7f478e268640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f478813f550 0x7f478813c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:17.713 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.701+0000 7f478e268640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47880b4950 con 0x7f478813f550 2023-12-12T10:13:17.713 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.701+0000 7f478e268640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f478813c630 con 0x7f478813ceb0 2023-12-12T10:13:17.713 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.701+0000 7f478e268640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47881435c0 con 0x7f4788071bf0 2023-12-12T10:13:17.713 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.701+0000 7f478c805640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f478813f550 0x7f478813c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:17.713 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.701+0000 7f478c805640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f478813f550 0x7f478813c0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:44838/0 (socket says 172.21.15.78:44838) 2023-12-12T10:13:17.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.701+0000 7f478c805640 1 -- 172.21.15.78:0/1458836655 learned_addr learned my addr 172.21.15.78:0/1458836655 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:13:17.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.701+0000 7f47877fe640 1 --2- 172.21.15.78:0/1458836655 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f478813ceb0 0x7f47881375d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:17.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.701+0000 7f4787fff640 1 --2- 172.21.15.78:0/1458836655 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4788071bf0 0x7f4788150f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:17.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.705+0000 7f478c805640 1 -- 172.21.15.78:0/1458836655 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4788071bf0 msgr2=0x7f4788150f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:17.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.705+0000 7f478c805640 1 --2- 172.21.15.78:0/1458836655 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4788071bf0 0x7f4788150f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:17.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.705+0000 7f478c805640 1 -- 172.21.15.78:0/1458836655 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f478813ceb0 msgr2=0x7f47881375d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:17.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.705+0000 7f478c805640 1 --2- 172.21.15.78:0/1458836655 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f478813ceb0 0x7f47881375d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:17.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.705+0000 7f478c805640 1 -- 172.21.15.78:0/1458836655 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f477c0094d0 con 0x7f478813f550 2023-12-12T10:13:17.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.705+0000 7f4787fff640 1 --2- 172.21.15.78:0/1458836655 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4788071bf0 0x7f4788150f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T10:13:17.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.705+0000 7f478c805640 1 --2- 172.21.15.78:0/1458836655 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f478813f550 0x7f478813c0f0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f478000b970 tx=0x7f478000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:17.715 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.705+0000 7f4784ff9640 1 -- 172.21.15.78:0/1458836655 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f478000cb40 con 0x7f478813f550 2023-12-12T10:13:17.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.705+0000 7f4784ff9640 1 -- 172.21.15.78:0/1458836655 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f478000cca0 con 0x7f478813f550 2023-12-12T10:13:17.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.705+0000 7f4784ff9640 1 -- 172.21.15.78:0/1458836655 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4780014680 con 0x7f478813f550 2023-12-12T10:13:17.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.705+0000 7f478e268640 1 -- 172.21.15.78:0/1458836655 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47880afad0 con 0x7f478813f550 2023-12-12T10:13:17.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.705+0000 7f478e268640 1 -- 172.21.15.78:0/1458836655 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4788154520 con 0x7f478813f550 2023-12-12T10:13:17.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.705+0000 7f478e268640 1 -- 172.21.15.78:0/1458836655 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47880671f0 con 0x7f478813f550 2023-12-12T10:13:17.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.705+0000 7f4784ff9640 1 -- 172.21.15.78:0/1458836655 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f478001d3b0 con 0x7f478813f550 2023-12-12T10:13:17.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.705+0000 7f4784ff9640 1 --2- 172.21.15.78:0/1458836655 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f4774066470 0x7f4774068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:17.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.705+0000 7f4784ff9640 1 -- 172.21.15.78:0/1458836655 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f4780084100 con 0x7f478813f550 2023-12-12T10:13:17.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.705+0000 7f4787fff640 1 --2- 172.21.15.78:0/1458836655 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f4774066470 0x7f4774068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:17.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.709+0000 7f4787fff640 1 --2- 172.21.15.78:0/1458836655 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f4774066470 0x7f4774068930 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f478815b4d0 tx=0x7f4778009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:17.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.709+0000 7f4784ff9640 1 -- 172.21.15.78:0/1458836655 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f47800511b0 con 0x7f478813f550 2023-12-12T10:13:17.894 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.889+0000 7f478e268640 1 -- 172.21.15.78:0/1458836655 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4788154380 con 0x7f478813f550 2023-12-12T10:13:17.895 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.889+0000 7f4784ff9640 1 -- 172.21.15.78:0/1458836655 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4912 (secure 0 0 0) 0x7f4788154380 con 0x7f478813f550 2023-12-12T10:13:17.895 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:13:17.895 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/3747609982","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":3747609982},{"type":"v1","addr":"172.21.15.187:6834","nonce":3747609982}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4282,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/3245919280","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":3245919280},{"type":"v1","addr":"172.21.15.187:6835","nonce":3245919280}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4293,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6835/3902814576","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":3902814576},{"type":"v1","addr":"172.21.15.78:6835","nonce":3902814576}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-12T10:12:09.200933+0000","modified":"2023-12-12T10:12:26.296409+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4296},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4296":{"gid":4296,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.78:6837/739552946","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6836","nonce":739552946},{"type":"v1","addr":"172.21.15.78:6837","nonce":739552946}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-12T10:13:17.895 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 9 2023-12-12T10:13:17.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.893+0000 7f478e268640 1 -- 172.21.15.78:0/1458836655 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f4774066470 msgr2=0x7f4774068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:17.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.893+0000 7f478e268640 1 --2- 172.21.15.78:0/1458836655 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f4774066470 0x7f4774068930 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f478815b4d0 tx=0x7f4778009040 comp rx=0 tx=0).stop 2023-12-12T10:13:17.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.893+0000 7f478e268640 1 -- 172.21.15.78:0/1458836655 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f478813f550 msgr2=0x7f478813c0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:17.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.893+0000 7f478e268640 1 --2- 172.21.15.78:0/1458836655 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f478813f550 0x7f478813c0f0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f478000b970 tx=0x7f478000be30 comp rx=0 tx=0).stop 2023-12-12T10:13:17.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.893+0000 7f478e268640 1 -- 172.21.15.78:0/1458836655 shutdown_connections 2023-12-12T10:13:17.898 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.893+0000 7f478e268640 1 --2- 172.21.15.78:0/1458836655 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f4774066470 0x7f4774068930 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:17.898 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.893+0000 7f478e268640 1 --2- 172.21.15.78:0/1458836655 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f478813f550 0x7f478813c0f0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:17.898 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.893+0000 7f478e268640 1 --2- 172.21.15.78:0/1458836655 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f478813ceb0 0x7f47881375d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:17.898 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.893+0000 7f478e268640 1 --2- 172.21.15.78:0/1458836655 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4788071bf0 0x7f4788150f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:17.898 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.893+0000 7f478e268640 1 -- 172.21.15.78:0/1458836655 >> 172.21.15.78:0/1458836655 conn(0x7f478806c5d0 msgr2=0x7f478815b590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:17.898 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.893+0000 7f478e268640 1 -- 172.21.15.78:0/1458836655 shutdown_connections 2023-12-12T10:13:17.898 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:17.893+0000 7f478e268640 1 -- 172.21.15.78:0/1458836655 wait complete. 2023-12-12T10:13:17.916 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T10:13:18.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.053+0000 7f4807e68640 1 Processor -- start 2023-12-12T10:13:18.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.053+0000 7f4807e68640 1 -- start start 2023-12-12T10:13:18.059 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.057+0000 7f4807e68640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f480015d3c0 0x7f48000d3b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:18.059 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.057+0000 7f4807e68640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f48000ce670 0x7f48000d15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:18.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.057+0000 7f4807e68640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48000b3250 con 0x7f48000d1ae0 2023-12-12T10:13:18.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.057+0000 7f4807e68640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48000d1f70 con 0x7f480015d3c0 2023-12-12T10:13:18.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.057+0000 7f4807e68640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48000cee50 con 0x7f48000ce670 2023-12-12T10:13:18.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.057+0000 7f4806405640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f48000d1ae0 0x7f48000cf680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:35708/0 (socket says 172.21.15.78:35708) 2023-12-12T10:13:18.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.057+0000 7f4806405640 1 -- 172.21.15.78:0/1706650041 learned_addr learned my addr 172.21.15.78:0/1706650041 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-12-12T10:13:18.063 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.057+0000 7f4805c04640 1 --2- 172.21.15.78:0/1706650041 >> v2:172.21.15.187:3300/0 conn(0x7f480015d3c0 0x7f48000d3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:18.063 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.057+0000 7f4805403640 1 --2- 172.21.15.78:0/1706650041 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f48000ce670 0x7f48000d15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:18.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.057+0000 7f4804c02640 1 -- 172.21.15.78:0/1706650041 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2848452749 0 0) 0x7f48000b3250 con 0x7f48000d1ae0 2023-12-12T10:13:18.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.057+0000 7f4804c02640 1 -- 172.21.15.78:0/1706650041 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47ec003530 con 0x7f48000d1ae0 2023-12-12T10:13:18.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.057+0000 7f4804c02640 1 -- 172.21.15.78:0/1706650041 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3641355456 0 0) 0x7f47ec003530 con 0x7f48000d1ae0 2023-12-12T10:13:18.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.057+0000 7f4804c02640 1 -- 172.21.15.78:0/1706650041 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f48000ce670 msgr2=0x7f48000d15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:13:18.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.057+0000 7f4804c02640 1 --2- 172.21.15.78:0/1706650041 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f48000ce670 0x7f48000d15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:18.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.057+0000 7f4804c02640 1 -- 172.21.15.78:0/1706650041 >> v2:172.21.15.187:3300/0 conn(0x7f480015d3c0 msgr2=0x7f48000d3b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:13:18.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.057+0000 7f4804c02640 1 --2- 172.21.15.78:0/1706650041 >> v2:172.21.15.187:3300/0 conn(0x7f480015d3c0 0x7f48000d3b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:18.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.057+0000 7f4804c02640 1 -- 172.21.15.78:0/1706650041 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48000b2920 con 0x7f48000d1ae0 2023-12-12T10:13:18.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.057+0000 7f4804c02640 1 -- 172.21.15.78:0/1706650041 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 465499599 0 0) 0x7f47f8001a00 con 0x7f48000d1ae0 2023-12-12T10:13:18.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.057+0000 7f4804c02640 1 -- 172.21.15.78:0/1706650041 >> v1:172.21.15.78:6789/0 conn(0x7f48000d1ae0 legacy=0x7f48000cf680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:18.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.057+0000 7f4804c02640 1 --2- 172.21.15.78:0/1706650041 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f48000ce670 0x7f47ec003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:18.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.057+0000 7f4804c02640 1 --2- 172.21.15.78:0/1706650041 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f47ec003f50 0x7f47ec0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:18.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.057+0000 7f4804c02640 1 --2- 172.21.15.78:0/1706650041 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f47ec004d10 0x7f47ec005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:18.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.057+0000 7f4804c02640 1 -- 172.21.15.78:0/1706650041 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48000d1f70 con 0x7f47ec004d10 2023-12-12T10:13:18.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.057+0000 7f4804c02640 1 -- 172.21.15.78:0/1706650041 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48000cee50 con 0x7f47ec003f50 2023-12-12T10:13:18.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.057+0000 7f4804c02640 1 -- 172.21.15.78:0/1706650041 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47ec00ba10 con 0x7f48000ce670 2023-12-12T10:13:18.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.057+0000 7f4806405640 1 --2- 172.21.15.78:0/1706650041 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f47ec004d10 0x7f47ec005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:18.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.057+0000 7f4805c04640 1 --2- 172.21.15.78:0/1706650041 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f48000ce670 0x7f47ec003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:18.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.057+0000 7f4805403640 1 --2- 172.21.15.78:0/1706650041 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f47ec003f50 0x7f47ec0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:18.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.057+0000 7f4806405640 1 -- 172.21.15.78:0/1706650041 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f48000ce670 msgr2=0x7f47ec003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:13:18.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.057+0000 7f4806405640 1 --2- 172.21.15.78:0/1706650041 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f48000ce670 0x7f47ec003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:18.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.057+0000 7f4806405640 1 -- 172.21.15.78:0/1706650041 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f47ec003f50 msgr2=0x7f47ec0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:13:18.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.057+0000 7f4806405640 1 --2- 172.21.15.78:0/1706650041 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f47ec003f50 0x7f47ec0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:18.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.057+0000 7f4806405640 1 -- 172.21.15.78:0/1706650041 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47ec003530 con 0x7f47ec004d10 2023-12-12T10:13:18.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.061+0000 7f4806405640 1 --2- 172.21.15.78:0/1706650041 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f47ec004d10 0x7f47ec005190 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f47f800a780 tx=0x7f47f801d280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dcc237f132de82b server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:18.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.061+0000 7f4804c02640 1 -- 172.21.15.78:0/1706650041 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47f80ad630 con 0x7f47ec004d10 2023-12-12T10:13:18.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.061+0000 7f4804c02640 1 -- 172.21.15.78:0/1706650041 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47f80a8070 con 0x7f47ec004d10 2023-12-12T10:13:18.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.061+0000 7f4804c02640 1 -- 172.21.15.78:0/1706650041 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47f80ada10 con 0x7f47ec004d10 2023-12-12T10:13:18.070 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.061+0000 7f4807e68640 1 -- 172.21.15.78:0/1706650041 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f47ec004d10 msgr2=0x7f47ec005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:18.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.061+0000 7f4807e68640 1 --2- 172.21.15.78:0/1706650041 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f47ec004d10 0x7f47ec005190 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f47f800a780 tx=0x7f47f801d280 comp rx=0 tx=0).stop 2023-12-12T10:13:18.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.061+0000 7f4806405640 1 -- 172.21.15.78:0/1706650041 reap_dead start 2023-12-12T10:13:18.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.061+0000 7f4807e68640 1 -- 172.21.15.78:0/1706650041 shutdown_connections 2023-12-12T10:13:18.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.061+0000 7f4807e68640 1 -- 172.21.15.78:0/1706650041 >> 172.21.15.78:0/1706650041 conn(0x7f480009c2a0 msgr2=0x7f48000d2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:18.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.061+0000 7f4807e68640 1 -- 172.21.15.78:0/1706650041 shutdown_connections 2023-12-12T10:13:18.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.061+0000 7f4807e68640 1 -- 172.21.15.78:0/1706650041 wait complete. 2023-12-12T10:13:18.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.065+0000 7f4807e68640 1 Processor -- start 2023-12-12T10:13:18.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.065+0000 7f4807e68640 1 -- start start 2023-12-12T10:13:18.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.065+0000 7f4807e68640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f47ec004d10 0x7f480015e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:18.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.065+0000 7f4807e68640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f480015ec60 0x7f480015b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:18.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.065+0000 7f4807e68640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4800152090 0x7f4800152520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:18.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.065+0000 7f4807e68640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4800152a60 con 0x7f47ec004d10 2023-12-12T10:13:18.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.065+0000 7f4807e68640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f480015fd50 con 0x7f480015ec60 2023-12-12T10:13:18.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.065+0000 7f4807e68640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f480015e870 con 0x7f4800152090 2023-12-12T10:13:18.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.065+0000 7f4805c04640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f47ec004d10 0x7f480015e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:18.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.065+0000 7f4805c04640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f47ec004d10 0x7f480015e330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:44858/0 (socket says 172.21.15.78:44858) 2023-12-12T10:13:18.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.065+0000 7f4805c04640 1 -- 172.21.15.78:0/3897112477 learned_addr learned my addr 172.21.15.78:0/3897112477 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:13:18.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.065+0000 7f4805c04640 1 -- 172.21.15.78:0/3897112477 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4800152090 msgr2=0x7f4800152520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:18.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.065+0000 7f4805c04640 1 --2- 172.21.15.78:0/3897112477 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4800152090 0x7f4800152520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:18.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.065+0000 7f4805c04640 1 -- 172.21.15.78:0/3897112477 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f480015ec60 msgr2=0x7f480015b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:18.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.065+0000 7f4805c04640 1 --2- 172.21.15.78:0/3897112477 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f480015ec60 0x7f480015b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:18.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.065+0000 7f4805c04640 1 -- 172.21.15.78:0/3897112477 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f480015f1d0 con 0x7f47ec004d10 2023-12-12T10:13:18.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.065+0000 7f4805c04640 1 --2- 172.21.15.78:0/3897112477 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f47ec004d10 0x7f480015e330 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f47fc011ad0 tx=0x7f47fc011f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:18.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.065+0000 7f47f67fc640 1 -- 172.21.15.78:0/3897112477 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47fc00fb30 con 0x7f47ec004d10 2023-12-12T10:13:18.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.065+0000 7f47f67fc640 1 -- 172.21.15.78:0/3897112477 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47fc00fc90 con 0x7f47ec004d10 2023-12-12T10:13:18.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.065+0000 7f4807e68640 1 -- 172.21.15.78:0/3897112477 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f480015f4b0 con 0x7f47ec004d10 2023-12-12T10:13:18.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.065+0000 7f47f67fc640 1 -- 172.21.15.78:0/3897112477 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47fc014440 con 0x7f47ec004d10 2023-12-12T10:13:18.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.065+0000 7f4807e68640 1 -- 172.21.15.78:0/3897112477 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f480015fa70 con 0x7f47ec004d10 2023-12-12T10:13:18.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.065+0000 7f4807e68640 1 -- 172.21.15.78:0/3897112477 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4800067530 con 0x7f47ec004d10 2023-12-12T10:13:18.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.069+0000 7f47f67fc640 1 -- 172.21.15.78:0/3897112477 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f47fc0145a0 con 0x7f47ec004d10 2023-12-12T10:13:18.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.069+0000 7f47f67fc640 1 --2- 172.21.15.78:0/3897112477 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f47e4066470 0x7f47e4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:18.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.069+0000 7f47f67fc640 1 -- 172.21.15.78:0/3897112477 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f47fc084b50 con 0x7f47ec004d10 2023-12-12T10:13:18.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.069+0000 7f4805403640 1 --2- 172.21.15.78:0/3897112477 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f47e4066470 0x7f47e4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:18.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.069+0000 7f4805403640 1 --2- 172.21.15.78:0/3897112477 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f47e4066470 0x7f47e4068930 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f47f0009a60 tx=0x7f47f0009340 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:18.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.073+0000 7f47f67fc640 1 -- 172.21.15.78:0/3897112477 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f47fc051c80 con 0x7f47ec004d10 2023-12-12T10:13:18.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.229+0000 7f4807e68640 1 -- 172.21.15.78:0/3897112477 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f48000d1380 con 0x7f47ec004d10 2023-12-12T10:13:18.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.229+0000 7f47f67fc640 1 -- 172.21.15.78:0/3897112477 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18701 (secure 0 0 0) 0x7f47fc0552a0 con 0x7f47ec004d10 2023-12-12T10:13:18.233 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:13:18.233 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":26,"fsid":"fc81937c-bd26-483c-952b-d1324fcb0c9e","created":"2023-12-12T10:11:44.020214+0000","modified":"2023-12-12T10:12:50.919344+0000","last_up_change":"2023-12-12T10:11:56.278318+0000","last_in_change":"2023-12-12T10:11:46.553610+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T10:11:57.053584+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-12T10:12:07.454450+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-12T10:12:08.182909+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-12T10:12:11.977952+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"22dfdedf-5f6c-4b20-9f6c-30517a1db70a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6809","nonce":3345683600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6811","nonce":3345683600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6815","nonce":3345683600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6813","nonce":3345683600}]},"public_addr":"172.21.15.78:6809/3345683600","cluster_addr":"172.21.15.78:6811/3345683600","heartbeat_back_addr":"172.21.15.78:6815/3345683600","heartbeat_front_addr":"172.21.15.78:6813/3345683600","state":["exists","up"]},{"osd":1,"uuid":"be34a7f3-a69a-462e-9ddf-5e537448dba2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6801","nonce":962652768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6803","nonce":962652768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6807","nonce":962652768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6805","nonce":962652768}]},"public_addr":"172.21.15.78:6801/962652768","cluster_addr":"172.21.15.78:6803/962652768","heartbeat_back_addr":"172.21.15.78:6807/962652768","heartbeat_front_addr":"172.21.15.78:6805/962652768","state":["exists","up"]},{"osd":2,"uuid":"55b381de-5f56-4b14-80f7-e6e41e084a13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6818","nonce":2910206054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6822","nonce":2910206054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6829","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6831","nonce":2910206054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6826","nonce":2910206054}]},"public_addr":"172.21.15.78:6818/2910206054","cluster_addr":"172.21.15.78:6822/2910206054","heartbeat_back_addr":"172.21.15.78:6831/2910206054","heartbeat_front_addr":"172.21.15.78:6826/2910206054","state":["exists","up"]},{"osd":3,"uuid":"d7682de1-25cb-4cec-869f-8851c28b0e6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6819","nonce":3750796703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6821","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6823","nonce":3750796703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6830","nonce":3750796703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6825","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6827","nonce":3750796703}]},"public_addr":"172.21.15.78:6819/3750796703","cluster_addr":"172.21.15.78:6823/3750796703","heartbeat_back_addr":"172.21.15.78:6830/3750796703","heartbeat_front_addr":"172.21.15.78:6827/3750796703","state":["exists","up"]},{"osd":4,"uuid":"8279815a-d6c7-4199-871e-d28971b9dc07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6809","nonce":2944277204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6811","nonce":2944277204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6815","nonce":2944277204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6813","nonce":2944277204}]},"public_addr":"172.21.15.187:6809/2944277204","cluster_addr":"172.21.15.187:6811/2944277204","heartbeat_back_addr":"172.21.15.187:6815/2944277204","heartbeat_front_addr":"172.21.15.187:6813/2944277204","state":["exists","up"]},{"osd":5,"uuid":"0a714c65-f8ce-4340-968f-11a799677ef3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6801","nonce":185858620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6803","nonce":185858620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6807","nonce":185858620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6805","nonce":185858620}]},"public_addr":"172.21.15.187:6801/185858620","cluster_addr":"172.21.15.187:6803/185858620","heartbeat_back_addr":"172.21.15.187:6807/185858620","heartbeat_front_addr":"172.21.15.187:6805/185858620","state":["exists","up"]},{"osd":6,"uuid":"d0bba9ab-f7ee-449e-8999-1c0cf7e6d53c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6817","nonce":4213392126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6819","nonce":4213392126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6824","nonce":4213392126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6821","nonce":4213392126}]},"public_addr":"172.21.15.187:6817/4213392126","cluster_addr":"172.21.15.187:6819/4213392126","heartbeat_back_addr":"172.21.15.187:6824/4213392126","heartbeat_front_addr":"172.21.15.187:6821/4213392126","state":["exists","up"]},{"osd":7,"uuid":"efe5e0d9-2f87-4889-a27a-e2a95a632302","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6823","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6825","nonce":85774004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6827","nonce":85774004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6831","nonce":85774004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6829","nonce":85774004}]},"public_addr":"172.21.15.187:6825/85774004","cluster_addr":"172.21.15.187:6827/85774004","heartbeat_back_addr":"172.21.15.187:6831/85774004","heartbeat_front_addr":"172.21.15.187:6829/85774004","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.214447+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.448899+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.293107+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.564184+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.175026+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.097717+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.261141+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.287681+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.18","mappings":[{"from":3,"to":2}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.13","mappings":[{"from":1,"to":2}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T10:13:18.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.229+0000 7f4807e68640 1 -- 172.21.15.78:0/3897112477 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f47e4066470 msgr2=0x7f47e4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:18.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.229+0000 7f4807e68640 1 --2- 172.21.15.78:0/3897112477 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f47e4066470 0x7f47e4068930 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f47f0009a60 tx=0x7f47f0009340 comp rx=0 tx=0).stop 2023-12-12T10:13:18.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.229+0000 7f4807e68640 1 -- 172.21.15.78:0/3897112477 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f47ec004d10 msgr2=0x7f480015e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:18.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.229+0000 7f4807e68640 1 --2- 172.21.15.78:0/3897112477 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f47ec004d10 0x7f480015e330 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f47fc011ad0 tx=0x7f47fc011f90 comp rx=0 tx=0).stop 2023-12-12T10:13:18.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.229+0000 7f4807e68640 1 -- 172.21.15.78:0/3897112477 shutdown_connections 2023-12-12T10:13:18.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.229+0000 7f4807e68640 1 --2- 172.21.15.78:0/3897112477 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f47e4066470 0x7f47e4068930 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:18.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.229+0000 7f4807e68640 1 --2- 172.21.15.78:0/3897112477 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4800152090 0x7f4800152520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:18.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.229+0000 7f4807e68640 1 --2- 172.21.15.78:0/3897112477 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f480015ec60 0x7f480015b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:18.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.229+0000 7f4807e68640 1 --2- 172.21.15.78:0/3897112477 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f47ec004d10 0x7f480015e330 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:18.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.229+0000 7f4807e68640 1 -- 172.21.15.78:0/3897112477 >> 172.21.15.78:0/3897112477 conn(0x7f480009c2a0 msgr2=0x7f48000d2f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:18.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.229+0000 7f4807e68640 1 -- 172.21.15.78:0/3897112477 shutdown_connections 2023-12-12T10:13:18.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.229+0000 7f4807e68640 1 -- 172.21.15.78:0/3897112477 wait complete. 2023-12-12T10:13:18.255 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-12T10:13:18.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.389+0000 7f97e199d640 1 Processor -- start 2023-12-12T10:13:18.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.389+0000 7f97e199d640 1 -- start start 2023-12-12T10:13:18.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.389+0000 7f97e199d640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f97dc143770 0x7f97dc0cdf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:18.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.389+0000 7f97e199d640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f97dc0b1e20 0x7f97dc070f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:18.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.389+0000 7f97e199d640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97dc070a70 con 0x7f97dc0b2280 2023-12-12T10:13:18.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.389+0000 7f97e199d640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97dc15e920 con 0x7f97dc143770 2023-12-12T10:13:18.395 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.389+0000 7f97e199d640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97dc070440 con 0x7f97dc0b1e20 2023-12-12T10:13:18.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.393+0000 7f97d27fc640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f97dc0b1e20 0x7f97dc070f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:18.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.393+0000 7f97daffd640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f97dc143770 0x7f97dc0cdf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:18.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.393+0000 7f97db7fe640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f97dc0b2280 0x7f97dc15a2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.78:54822/0 (socket says 172.21.15.78:54822) 2023-12-12T10:13:18.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.393+0000 7f97db7fe640 1 -- 172.21.15.78:0/1887284763 learned_addr learned my addr 172.21.15.78:0/1887284763 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-12-12T10:13:18.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.393+0000 7f97d27fc640 1 -- 172.21.15.78:0/1887284763 >> v2:172.21.15.187:3300/0 conn(0x7f97dc143770 msgr2=0x7f97dc0cdf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:13:18.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.393+0000 7f97d27fc640 1 --2- 172.21.15.78:0/1887284763 >> v2:172.21.15.187:3300/0 conn(0x7f97dc143770 0x7f97dc0cdf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:18.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.393+0000 7f97d27fc640 1 -- 172.21.15.78:0/1887284763 >> v1:172.21.15.187:6789/0 conn(0x7f97dc0b2280 legacy=0x7f97dc15a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:18.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.393+0000 7f97d27fc640 1 -- 172.21.15.78:0/1887284763 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97dc143b50 con 0x7f97dc0b1e20 2023-12-12T10:13:18.398 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.393+0000 7f97d27fc640 1 --2- 172.21.15.78:0/1887284763 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f97dc0b1e20 0x7f97dc070f00 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f97c40097c0 tx=0x7f97c401c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dbb66fcdddf62d68 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:18.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.393+0000 7f97da7fc640 1 -- 172.21.15.78:0/1887284763 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97c40a6040 con 0x7f97dc0b1e20 2023-12-12T10:13:18.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.393+0000 7f97da7fc640 1 -- 172.21.15.78:0/1887284763 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97c40aa600 con 0x7f97dc0b1e20 2023-12-12T10:13:18.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.397+0000 7f97da7fc640 1 -- 172.21.15.78:0/1887284763 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97c40aa990 con 0x7f97dc0b1e20 2023-12-12T10:13:18.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.397+0000 7f97e199d640 1 -- 172.21.15.78:0/1887284763 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f97dc0b1e20 msgr2=0x7f97dc070f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:18.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.397+0000 7f97e199d640 1 --2- 172.21.15.78:0/1887284763 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f97dc0b1e20 0x7f97dc070f00 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f97c40097c0 tx=0x7f97c401c480 comp rx=0 tx=0).stop 2023-12-12T10:13:18.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.397+0000 7f97e199d640 1 -- 172.21.15.78:0/1887284763 shutdown_connections 2023-12-12T10:13:18.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.397+0000 7f97e199d640 1 --2- 172.21.15.78:0/1887284763 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f97dc0b1e20 0x7f97dc070f00 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:18.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.397+0000 7f97e199d640 1 --2- 172.21.15.78:0/1887284763 >> v2:172.21.15.187:3300/0 conn(0x7f97dc143770 0x7f97dc0cdf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:18.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.397+0000 7f97e199d640 1 -- 172.21.15.78:0/1887284763 >> 172.21.15.78:0/1887284763 conn(0x7f97dc06a710 msgr2=0x7f97dc06ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:18.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.397+0000 7f97e199d640 1 -- 172.21.15.78:0/1887284763 shutdown_connections 2023-12-12T10:13:18.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.397+0000 7f97e199d640 1 -- 172.21.15.78:0/1887284763 wait complete. 2023-12-12T10:13:18.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.397+0000 7f97e199d640 1 Processor -- start 2023-12-12T10:13:18.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.397+0000 7f97e199d640 1 -- start start 2023-12-12T10:13:18.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.397+0000 7f97e199d640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f97dc0b1e20 0x7f97dc157ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:18.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.397+0000 7f97e199d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f97dc0b2280 0x7f97dc0b30a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:18.403 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.397+0000 7f97e199d640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f97dc143770 0x7f97dc0b35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:18.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.397+0000 7f97e199d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97dc13fb60 con 0x7f97dc0b2280 2023-12-12T10:13:18.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.397+0000 7f97e199d640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97dc13fe00 con 0x7f97dc0b1e20 2023-12-12T10:13:18.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.397+0000 7f97e199d640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97dc1400e0 con 0x7f97dc143770 2023-12-12T10:13:18.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.397+0000 7f97d27fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f97dc0b2280 0x7f97dc0b30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:18.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.397+0000 7f97d27fc640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f97dc0b2280 0x7f97dc0b30a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:44866/0 (socket says 172.21.15.78:44866) 2023-12-12T10:13:18.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.397+0000 7f97d27fc640 1 -- 172.21.15.78:0/1952451932 learned_addr learned my addr 172.21.15.78:0/1952451932 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:13:18.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.397+0000 7f97db7fe640 1 --2- 172.21.15.78:0/1952451932 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f97dc143770 0x7f97dc0b35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:18.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.397+0000 7f97daffd640 1 --2- 172.21.15.78:0/1952451932 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f97dc0b1e20 0x7f97dc157ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:18.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.401+0000 7f97d27fc640 1 -- 172.21.15.78:0/1952451932 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f97dc143770 msgr2=0x7f97dc0b35e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:18.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.401+0000 7f97d27fc640 1 --2- 172.21.15.78:0/1952451932 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f97dc143770 0x7f97dc0b35e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:18.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.401+0000 7f97d27fc640 1 -- 172.21.15.78:0/1952451932 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f97dc0b1e20 msgr2=0x7f97dc157ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:18.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.401+0000 7f97d27fc640 1 --2- 172.21.15.78:0/1952451932 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f97dc0b1e20 0x7f97dc157ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:18.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.401+0000 7f97d27fc640 1 -- 172.21.15.78:0/1952451932 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97c4009420 con 0x7f97dc0b2280 2023-12-12T10:13:18.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.401+0000 7f97d27fc640 1 --2- 172.21.15.78:0/1952451932 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f97dc0b2280 0x7f97dc0b30a0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f97c401ab30 tx=0x7f97c401acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:18.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.401+0000 7f97d8ff9640 1 -- 172.21.15.78:0/1952451932 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97c40b3800 con 0x7f97dc0b2280 2023-12-12T10:13:18.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.401+0000 7f97d8ff9640 1 -- 172.21.15.78:0/1952451932 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97c40b3960 con 0x7f97dc0b2280 2023-12-12T10:13:18.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.401+0000 7f97d8ff9640 1 -- 172.21.15.78:0/1952451932 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97c40b3d10 con 0x7f97dc0b2280 2023-12-12T10:13:18.405 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.401+0000 7f97e199d640 1 -- 172.21.15.78:0/1952451932 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97dc1403c0 con 0x7f97dc0b2280 2023-12-12T10:13:18.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.401+0000 7f97e199d640 1 -- 172.21.15.78:0/1952451932 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97dc1f93d0 con 0x7f97dc0b2280 2023-12-12T10:13:18.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.401+0000 7f97e199d640 1 -- 172.21.15.78:0/1952451932 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97dc0671f0 con 0x7f97dc0b2280 2023-12-12T10:13:18.406 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.401+0000 7f97d8ff9640 1 -- 172.21.15.78:0/1952451932 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f97c40b2380 con 0x7f97dc0b2280 2023-12-12T10:13:18.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.401+0000 7f97d8ff9640 1 --2- 172.21.15.78:0/1952451932 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f97bc066470 0x7f97bc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:18.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.401+0000 7f97d8ff9640 1 -- 172.21.15.78:0/1952451932 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f97c411e960 con 0x7f97dc0b2280 2023-12-12T10:13:18.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.405+0000 7f97daffd640 1 --2- 172.21.15.78:0/1952451932 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f97bc066470 0x7f97bc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:18.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.405+0000 7f97daffd640 1 --2- 172.21.15.78:0/1952451932 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f97bc066470 0x7f97bc068930 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f97cc009ac0 tx=0x7f97cc009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:18.411 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.405+0000 7f97d8ff9640 1 -- 172.21.15.78:0/1952451932 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f97c40eba30 con 0x7f97dc0b2280 2023-12-12T10:13:18.591 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.589+0000 7f97e199d640 1 -- 172.21.15.78:0/1952451932 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f97dc140220 con 0x7f97dc0b2280 2023-12-12T10:13:18.640 INFO:tasks.ceph.mon.a.smithi078.stderr:2023-12-12T10:13:18.589+0000 7f1ddc928640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-12T10:13:18.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.593+0000 7f97d8ff9640 1 -- 172.21.15.78:0/1952451932 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v10) v1 ==== 161+0+0 (secure 0 0 0) 0x7f97dc140220 con 0x7f97dc0b2280 2023-12-12T10:13:18.641 INFO:teuthology.orchestra.run.smithi078.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-12T10:13:18.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.593+0000 7f97e199d640 1 -- 172.21.15.78:0/1952451932 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f97bc066470 msgr2=0x7f97bc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:18.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.593+0000 7f97e199d640 1 --2- 172.21.15.78:0/1952451932 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f97bc066470 0x7f97bc068930 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f97cc009ac0 tx=0x7f97cc009190 comp rx=0 tx=0).stop 2023-12-12T10:13:18.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.593+0000 7f97e199d640 1 -- 172.21.15.78:0/1952451932 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f97dc0b2280 msgr2=0x7f97dc0b30a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:18.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.593+0000 7f97e199d640 1 --2- 172.21.15.78:0/1952451932 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f97dc0b2280 0x7f97dc0b30a0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f97c401ab30 tx=0x7f97c401acc0 comp rx=0 tx=0).stop 2023-12-12T10:13:18.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.593+0000 7f97e199d640 1 -- 172.21.15.78:0/1952451932 shutdown_connections 2023-12-12T10:13:18.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.593+0000 7f97e199d640 1 --2- 172.21.15.78:0/1952451932 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f97bc066470 0x7f97bc068930 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:18.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.593+0000 7f97e199d640 1 --2- 172.21.15.78:0/1952451932 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f97dc143770 0x7f97dc0b35e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:18.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.593+0000 7f97e199d640 1 --2- 172.21.15.78:0/1952451932 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f97dc0b2280 0x7f97dc0b30a0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:18.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.593+0000 7f97e199d640 1 --2- 172.21.15.78:0/1952451932 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f97dc0b1e20 0x7f97dc157ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:18.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.593+0000 7f97e199d640 1 -- 172.21.15.78:0/1952451932 >> 172.21.15.78:0/1952451932 conn(0x7f97dc06a710 msgr2=0x7f97dc0b2710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:18.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.593+0000 7f97e199d640 1 -- 172.21.15.78:0/1952451932 shutdown_connections 2023-12-12T10:13:18.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.597+0000 7f97e199d640 1 -- 172.21.15.78:0/1952451932 wait complete. 2023-12-12T10:13:18.642 INFO:tasks.ceph.mds.c.smithi078.stderr: -4366> 2023-12-12T10:12:13.787+0000 7f94984e5640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-12T10:13:18.643 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-12T10:13:18.654 INFO:tasks.ceph.mds.c.smithi078.stdout:starting mds.c at 2023-12-12T10:13:18.783 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.781+0000 7f21a9d72640 1 Processor -- start 2023-12-12T10:13:18.784 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.781+0000 7f21a9d72640 1 -- start start 2023-12-12T10:13:18.785 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.781+0000 7f21a9d72640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f21a406cf60 0x7f21a415f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:18.785 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.781+0000 7f21a9d72640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f21a415b390 0x7f21a415b840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:18.785 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.781+0000 7f21a9d72640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21a40cea30 con 0x7f21a40cb4b0 2023-12-12T10:13:18.785 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.781+0000 7f21a9d72640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21a415bd80 con 0x7f21a415b390 2023-12-12T10:13:18.785 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.781+0000 7f21a9d72640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21a415bfc0 con 0x7f21a406cf60 2023-12-12T10:13:18.785 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.781+0000 7f21a37fe640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f21a40cb4b0 0x7f21a406c850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:35738/0 (socket says 172.21.15.78:35738) 2023-12-12T10:13:18.785 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.781+0000 7f21a37fe640 1 -- 172.21.15.78:0/772571215 learned_addr learned my addr 172.21.15.78:0/772571215 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-12-12T10:13:18.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.781+0000 7f219bfff640 1 --2- 172.21.15.78:0/772571215 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f21a406cf60 0x7f21a415f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:18.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.781+0000 7f21a3fff640 1 --2- 172.21.15.78:0/772571215 >> v2:172.21.15.187:3300/0 conn(0x7f21a415b390 0x7f21a415b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:18.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.781+0000 7f21a2ffd640 1 -- 172.21.15.78:0/772571215 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 200596185 0 0) 0x7f21a40cea30 con 0x7f21a40cb4b0 2023-12-12T10:13:18.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.781+0000 7f21a2ffd640 1 -- 172.21.15.78:0/772571215 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2190003530 con 0x7f21a40cb4b0 2023-12-12T10:13:18.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.781+0000 7f21a2ffd640 1 -- 172.21.15.78:0/772571215 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 506134758 0 0) 0x7f2190003530 con 0x7f21a40cb4b0 2023-12-12T10:13:18.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.781+0000 7f21a2ffd640 1 -- 172.21.15.78:0/772571215 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f21a406cf60 msgr2=0x7f21a415f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:13:18.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.781+0000 7f21a2ffd640 1 --2- 172.21.15.78:0/772571215 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f21a406cf60 0x7f21a415f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:18.787 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.781+0000 7f21a2ffd640 1 -- 172.21.15.78:0/772571215 >> v2:172.21.15.187:3300/0 conn(0x7f21a415b390 msgr2=0x7f21a415b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:13:18.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.781+0000 7f21a2ffd640 1 --2- 172.21.15.78:0/772571215 >> v2:172.21.15.187:3300/0 conn(0x7f21a415b390 0x7f21a415b840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:18.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.781+0000 7f21a2ffd640 1 -- 172.21.15.78:0/772571215 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21a415c2a0 con 0x7f21a40cb4b0 2023-12-12T10:13:18.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.781+0000 7f21a2ffd640 1 -- 172.21.15.78:0/772571215 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 465499599 0 0) 0x7f2194001680 con 0x7f21a40cb4b0 2023-12-12T10:13:18.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.781+0000 7f21a2ffd640 1 -- 172.21.15.78:0/772571215 >> v1:172.21.15.78:6789/0 conn(0x7f21a40cb4b0 legacy=0x7f21a406c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:18.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.781+0000 7f21a2ffd640 1 --2- 172.21.15.78:0/772571215 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2190003980 0x7f2190003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:18.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.781+0000 7f21a2ffd640 1 --2- 172.21.15.78:0/772571215 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f21900047d0 0x7f2190004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:18.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.781+0000 7f21a2ffd640 1 --2- 172.21.15.78:0/772571215 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f21a406cf60 0x7f2190005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:18.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.781+0000 7f21a2ffd640 1 -- 172.21.15.78:0/772571215 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21a415bd80 con 0x7f21900047d0 2023-12-12T10:13:18.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.781+0000 7f21a2ffd640 1 -- 172.21.15.78:0/772571215 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21a415bfc0 con 0x7f2190003980 2023-12-12T10:13:18.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.781+0000 7f21a2ffd640 1 -- 172.21.15.78:0/772571215 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f219000b9c0 con 0x7f21a406cf60 2023-12-12T10:13:18.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.781+0000 7f219bfff640 1 --2- 172.21.15.78:0/772571215 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f21900047d0 0x7f2190004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:18.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.781+0000 7f21a37fe640 1 --2- 172.21.15.78:0/772571215 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2190003980 0x7f2190003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:18.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.781+0000 7f21a3fff640 1 --2- 172.21.15.78:0/772571215 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f21a406cf60 0x7f2190005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:18.788 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.781+0000 7f219bfff640 1 -- 172.21.15.78:0/772571215 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f21a406cf60 msgr2=0x7f2190005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:13:18.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.781+0000 7f219bfff640 1 --2- 172.21.15.78:0/772571215 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f21a406cf60 0x7f2190005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:18.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.781+0000 7f219bfff640 1 -- 172.21.15.78:0/772571215 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2190003980 msgr2=0x7f2190003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:13:18.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.781+0000 7f219bfff640 1 --2- 172.21.15.78:0/772571215 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2190003980 0x7f2190003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:18.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.781+0000 7f219bfff640 1 -- 172.21.15.78:0/772571215 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2190003530 con 0x7f21900047d0 2023-12-12T10:13:18.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.781+0000 7f21a3fff640 1 --2- 172.21.15.78:0/772571215 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f21a406cf60 0x7f2190005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T10:13:18.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.781+0000 7f21a37fe640 1 --2- 172.21.15.78:0/772571215 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2190003980 0x7f2190003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T10:13:18.789 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.785+0000 7f219bfff640 1 --2- 172.21.15.78:0/772571215 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f21900047d0 0x7f2190004c50 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f218c009ae0 tx=0x7f218c01c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fffc37ca8f78da65 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:18.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.785+0000 7f21a2ffd640 1 -- 172.21.15.78:0/772571215 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f218c0a6430 con 0x7f21900047d0 2023-12-12T10:13:18.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.785+0000 7f21a2ffd640 1 -- 172.21.15.78:0/772571215 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f218c0a6590 con 0x7f21900047d0 2023-12-12T10:13:18.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.785+0000 7f21a2ffd640 1 -- 172.21.15.78:0/772571215 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f218c0a6940 con 0x7f21900047d0 2023-12-12T10:13:18.790 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.785+0000 7f21a9d72640 1 -- 172.21.15.78:0/772571215 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f21900047d0 msgr2=0x7f2190004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:18.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.785+0000 7f21a9d72640 1 --2- 172.21.15.78:0/772571215 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f21900047d0 0x7f2190004c50 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f218c009ae0 tx=0x7f218c01c9c0 comp rx=0 tx=0).stop 2023-12-12T10:13:18.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.785+0000 7f21a3fff640 1 -- 172.21.15.78:0/772571215 reap_dead start 2023-12-12T10:13:18.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.785+0000 7f21a9d72640 1 -- 172.21.15.78:0/772571215 shutdown_connections 2023-12-12T10:13:18.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.785+0000 7f21a9d72640 1 -- 172.21.15.78:0/772571215 >> 172.21.15.78:0/772571215 conn(0x7f21a406a710 msgr2=0x7f21a406ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:18.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.785+0000 7f21a9d72640 1 -- 172.21.15.78:0/772571215 shutdown_connections 2023-12-12T10:13:18.791 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.785+0000 7f21a9d72640 1 -- 172.21.15.78:0/772571215 wait complete. 2023-12-12T10:13:18.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.789+0000 7f21a9d72640 1 Processor -- start 2023-12-12T10:13:18.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.789+0000 7f21a9d72640 1 -- start start 2023-12-12T10:13:18.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.789+0000 7f21a9d72640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f21900047d0 0x7f21a415aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:18.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.789+0000 7f21a9d72640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f21a40a8e30 0x7f21a415dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:18.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.789+0000 7f21a9d72640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f21a4150890 0x7f21a4150d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:18.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.789+0000 7f21a9d72640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21a41f6af0 con 0x7f21a40a8e30 2023-12-12T10:13:18.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.789+0000 7f21a9d72640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21a41f6dd0 con 0x7f21900047d0 2023-12-12T10:13:18.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.789+0000 7f21a9d72640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21a41f70b0 con 0x7f21a4150890 2023-12-12T10:13:18.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.789+0000 7f219bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f21a40a8e30 0x7f21a415dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:18.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.789+0000 7f219bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f21a40a8e30 0x7f21a415dbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:44902/0 (socket says 172.21.15.78:44902) 2023-12-12T10:13:18.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.789+0000 7f219bfff640 1 -- 172.21.15.78:0/2781101612 learned_addr learned my addr 172.21.15.78:0/2781101612 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:13:18.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.789+0000 7f21a3fff640 1 --2- 172.21.15.78:0/2781101612 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f21a4150890 0x7f21a4150d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:18.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.789+0000 7f21a37fe640 1 --2- 172.21.15.78:0/2781101612 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f21900047d0 0x7f21a415aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:18.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.789+0000 7f219bfff640 1 -- 172.21.15.78:0/2781101612 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f21a4150890 msgr2=0x7f21a4150d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:18.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.789+0000 7f219bfff640 1 --2- 172.21.15.78:0/2781101612 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f21a4150890 0x7f21a4150d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:18.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.789+0000 7f219bfff640 1 -- 172.21.15.78:0/2781101612 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f21900047d0 msgr2=0x7f21a415aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:18.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.789+0000 7f219bfff640 1 --2- 172.21.15.78:0/2781101612 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f21900047d0 0x7f21a415aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:18.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.789+0000 7f219bfff640 1 -- 172.21.15.78:0/2781101612 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21a41f7390 con 0x7f21a40a8e30 2023-12-12T10:13:18.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.789+0000 7f21a37fe640 1 --2- 172.21.15.78:0/2781101612 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f21900047d0 0x7f21a415aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T10:13:18.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.789+0000 7f219bfff640 1 --2- 172.21.15.78:0/2781101612 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f21a40a8e30 0x7f21a415dbf0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f218c009ae0 tx=0x7f2190005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:18.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.789+0000 7f21a0ff9640 1 -- 172.21.15.78:0/2781101612 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f218c00f000 con 0x7f21a40a8e30 2023-12-12T10:13:18.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.789+0000 7f21a0ff9640 1 -- 172.21.15.78:0/2781101612 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f218c0a6d80 con 0x7f21a40a8e30 2023-12-12T10:13:18.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.789+0000 7f21a9d72640 1 -- 172.21.15.78:0/2781101612 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21a41f7670 con 0x7f21a40a8e30 2023-12-12T10:13:18.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.789+0000 7f21a0ff9640 1 -- 172.21.15.78:0/2781101612 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f218c0b9630 con 0x7f21a40a8e30 2023-12-12T10:13:18.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.789+0000 7f21a9d72640 1 -- 172.21.15.78:0/2781101612 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21a40a92b0 con 0x7f21a40a8e30 2023-12-12T10:13:18.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.793+0000 7f21a9d72640 1 -- 172.21.15.78:0/2781101612 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21a40671f0 con 0x7f21a40a8e30 2023-12-12T10:13:18.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.793+0000 7f21a0ff9640 1 -- 172.21.15.78:0/2781101612 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f218c0a7410 con 0x7f21a40a8e30 2023-12-12T10:13:18.797 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.793+0000 7f21a0ff9640 1 --2- 172.21.15.78:0/2781101612 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f21840664a0 0x7f2184068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:18.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.793+0000 7f21a0ff9640 1 -- 172.21.15.78:0/2781101612 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6749+0+0 (secure 0 0 0) 0x7f218c11dda0 con 0x7f21a40a8e30 2023-12-12T10:13:18.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.793+0000 7f21a37fe640 1 --2- 172.21.15.78:0/2781101612 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f21840664a0 0x7f2184068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:18.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.793+0000 7f21a37fe640 1 --2- 172.21.15.78:0/2781101612 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f21840664a0 0x7f2184068960 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f21a41ea520 tx=0x7f2194000f20 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:18.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.797+0000 7f21a0ff9640 1 -- 172.21.15.78:0/2781101612 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f218c0ead70 con 0x7f21a40a8e30 2023-12-12T10:13:18.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:18.981+0000 7f21a9d72640 1 -- 172.21.15.78:0/2781101612 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f21a41f71f0 con 0x7f21a40a8e30 2023-12-12T10:13:19.599 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:19.597+0000 7f21a0ff9640 1 -- 172.21.15.78:0/2781101612 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f21a41f71f0 con 0x7f21a40a8e30 2023-12-12T10:13:19.602 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:19.597+0000 7f21a9d72640 1 -- 172.21.15.78:0/2781101612 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f21840664a0 msgr2=0x7f2184068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:19.602 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:19.597+0000 7f21a9d72640 1 --2- 172.21.15.78:0/2781101612 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f21840664a0 0x7f2184068960 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f21a41ea520 tx=0x7f2194000f20 comp rx=0 tx=0).stop 2023-12-12T10:13:19.602 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:19.597+0000 7f21a9d72640 1 -- 172.21.15.78:0/2781101612 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f21a40a8e30 msgr2=0x7f21a415dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:19.602 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:19.597+0000 7f21a9d72640 1 --2- 172.21.15.78:0/2781101612 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f21a40a8e30 0x7f21a415dbf0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f218c009ae0 tx=0x7f2190005800 comp rx=0 tx=0).stop 2023-12-12T10:13:19.602 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:19.597+0000 7f21a9d72640 1 -- 172.21.15.78:0/2781101612 shutdown_connections 2023-12-12T10:13:19.603 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:19.597+0000 7f21a9d72640 1 --2- 172.21.15.78:0/2781101612 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f21840664a0 0x7f2184068960 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:19.603 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:19.597+0000 7f21a9d72640 1 --2- 172.21.15.78:0/2781101612 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f21a4150890 0x7f21a4150d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:19.603 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:19.597+0000 7f21a9d72640 1 --2- 172.21.15.78:0/2781101612 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f21a40a8e30 0x7f21a415dbf0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:19.603 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:19.597+0000 7f21a9d72640 1 --2- 172.21.15.78:0/2781101612 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f21900047d0 0x7f21a415aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:19.603 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:19.597+0000 7f21a9d72640 1 -- 172.21.15.78:0/2781101612 >> 172.21.15.78:0/2781101612 conn(0x7f21a406a710 msgr2=0x7f21a415fcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:19.603 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:19.597+0000 7f21a9d72640 1 -- 172.21.15.78:0/2781101612 shutdown_connections 2023-12-12T10:13:19.603 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:19.597+0000 7f21a9d72640 1 -- 172.21.15.78:0/2781101612 wait complete. 2023-12-12T10:13:19.626 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-12T10:13:19.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:19.809+0000 7fc0fd71d640 1 Processor -- start 2023-12-12T10:13:19.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:19.809+0000 7fc0fd71d640 1 -- start start 2023-12-12T10:13:19.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:19.809+0000 7fc0fd71d640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fc0f8150ee0 0x7fc0f815d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:19.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:19.809+0000 7fc0fd71d640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0f80c3d60 con 0x7fc0f80cc920 2023-12-12T10:13:19.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:19.809+0000 7fc0fd71d640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0f80caef0 con 0x7fc0f80cf540 2023-12-12T10:13:19.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:19.809+0000 7fc0fd71d640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0f81512c0 con 0x7fc0f8150ee0 2023-12-12T10:13:19.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:19.809+0000 7fc0f77fe640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fc0f80cc920 0x7fc0f815a3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:38796/0 (socket says 172.21.15.78:38796) 2023-12-12T10:13:19.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:19.809+0000 7fc0f77fe640 1 -- 172.21.15.78:0/1819208526 learned_addr learned my addr 172.21.15.78:0/1819208526 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-12-12T10:13:19.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:19.809+0000 7fc0f6ffd640 1 --2- 172.21.15.78:0/1819208526 >> v2:172.21.15.187:3300/0 conn(0x7fc0f8150ee0 0x7fc0f815d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:19.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:19.809+0000 7fc0f67fc640 1 -- 172.21.15.78:0/1819208526 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1737988317 0 0) 0x7fc0f80c3d60 con 0x7fc0f80cc920 2023-12-12T10:13:19.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:19.809+0000 7fc0f67fc640 1 -- 172.21.15.78:0/1819208526 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0e4003530 con 0x7fc0f80cc920 2023-12-12T10:13:19.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:19.809+0000 7fc0f6ffd640 1 -- 172.21.15.78:0/1819208526 >> v1:172.21.15.187:6789/0 conn(0x7fc0f80cf540 legacy=0x7fc0f815dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:19.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:19.809+0000 7fc0f6ffd640 1 -- 172.21.15.78:0/1819208526 >> v1:172.21.15.78:6789/0 conn(0x7fc0f80cc920 legacy=0x7fc0f815a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:19.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:19.809+0000 7fc0f67fc640 1 -- 172.21.15.78:0/1819208526 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2654335234 0 0) 0x7fc0e4003530 con 0x7fc0f80cc920 2023-12-12T10:13:19.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:19.809+0000 7fc0f6ffd640 1 -- 172.21.15.78:0/1819208526 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0f80ca930 con 0x7fc0f8150ee0 2023-12-12T10:13:19.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:19.813+0000 7fc0f6ffd640 1 --2- 172.21.15.78:0/1819208526 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc0f8150ee0 0x7fc0f815d9a0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc0e00097c0 tx=0x7fc0e001c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a265d2450c0acab7 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:19.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:19.813+0000 7fc0f67fc640 1 -- 172.21.15.78:0/1819208526 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0e00a4ea0 con 0x7fc0f8150ee0 2023-12-12T10:13:19.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:19.813+0000 7fc0f67fc640 1 -- 172.21.15.78:0/1819208526 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0e00a7050 con 0x7fc0f8150ee0 2023-12-12T10:13:19.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:19.813+0000 7fc0f67fc640 1 -- 172.21.15.78:0/1819208526 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0f815b2d0 con 0x7fc0f8150ee0 2023-12-12T10:13:19.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:19.813+0000 7fc0fd71d640 1 -- 172.21.15.78:0/1819208526 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc0f8150ee0 msgr2=0x7fc0f815d9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:19.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:19.813+0000 7fc0fd71d640 1 --2- 172.21.15.78:0/1819208526 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc0f8150ee0 0x7fc0f815d9a0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc0e00097c0 tx=0x7fc0e001c3a0 comp rx=0 tx=0).stop 2023-12-12T10:13:19.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:19.813+0000 7fc0fd71d640 1 -- 172.21.15.78:0/1819208526 shutdown_connections 2023-12-12T10:13:19.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:19.813+0000 7fc0fd71d640 1 --2- 172.21.15.78:0/1819208526 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc0f8150ee0 0x7fc0f815d9a0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:19.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:19.813+0000 7fc0fd71d640 1 -- 172.21.15.78:0/1819208526 >> 172.21.15.78:0/1819208526 conn(0x7fc0f80cea20 msgr2=0x7fc0f80cee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:19.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:19.813+0000 7fc0fd71d640 1 -- 172.21.15.78:0/1819208526 shutdown_connections 2023-12-12T10:13:19.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:19.813+0000 7fc0fd71d640 1 -- 172.21.15.78:0/1819208526 wait complete. 2023-12-12T10:13:19.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:19.813+0000 7fc0fd71d640 1 Processor -- start 2023-12-12T10:13:19.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:19.817+0000 7fc0fd71d640 1 -- start start 2023-12-12T10:13:19.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:19.817+0000 7fc0fd71d640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc0f80cc920 0x7fc0f814d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:19.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:19.817+0000 7fc0fd71d640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc0f80cf540 0x7fc0f8140510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:19.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:19.817+0000 7fc0fd71d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc0f8150ee0 0x7fc0f8140a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:19.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:19.817+0000 7fc0fd71d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f814ce70 con 0x7fc0f8150ee0 2023-12-12T10:13:19.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:19.817+0000 7fc0fd71d640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f81655e0 con 0x7fc0f80cc920 2023-12-12T10:13:19.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:19.817+0000 7fc0fd71d640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f8165150 con 0x7fc0f80cf540 2023-12-12T10:13:19.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:19.817+0000 7fc0f77fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc0f8150ee0 0x7fc0f8140a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:19.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:19.817+0000 7fc0f77fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc0f8150ee0 0x7fc0f8140a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50248/0 (socket says 172.21.15.78:50248) 2023-12-12T10:13:19.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:19.817+0000 7fc0f77fe640 1 -- 172.21.15.78:0/4116663541 learned_addr learned my addr 172.21.15.78:0/4116663541 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:13:19.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:19.817+0000 7fc0ee7fc640 1 --2- 172.21.15.78:0/4116663541 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc0f80cf540 0x7fc0f8140510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:19.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:19.817+0000 7fc0f6ffd640 1 --2- 172.21.15.78:0/4116663541 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc0f80cc920 0x7fc0f814d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:19.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:19.817+0000 7fc0f77fe640 1 -- 172.21.15.78:0/4116663541 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc0f80cf540 msgr2=0x7fc0f8140510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:19.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:19.817+0000 7fc0f77fe640 1 --2- 172.21.15.78:0/4116663541 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc0f80cf540 0x7fc0f8140510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:19.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:19.817+0000 7fc0f77fe640 1 -- 172.21.15.78:0/4116663541 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc0f80cc920 msgr2=0x7fc0f814d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:19.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:19.817+0000 7fc0f77fe640 1 --2- 172.21.15.78:0/4116663541 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc0f80cc920 0x7fc0f814d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:19.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:19.817+0000 7fc0f77fe640 1 -- 172.21.15.78:0/4116663541 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0e0009420 con 0x7fc0f8150ee0 2023-12-12T10:13:19.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:19.817+0000 7fc0f77fe640 1 --2- 172.21.15.78:0/4116663541 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc0f8150ee0 0x7fc0f8140a50 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fc0f0002130 tx=0x7fc0f000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:19.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:19.817+0000 7fc0effff640 1 -- 172.21.15.78:0/4116663541 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0f0012600 con 0x7fc0f8150ee0 2023-12-12T10:13:19.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:19.817+0000 7fc0effff640 1 -- 172.21.15.78:0/4116663541 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0f0012780 con 0x7fc0f8150ee0 2023-12-12T10:13:19.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:19.817+0000 7fc0effff640 1 -- 172.21.15.78:0/4116663541 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0f0012b70 con 0x7fc0f8150ee0 2023-12-12T10:13:19.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:19.817+0000 7fc0fd71d640 1 -- 172.21.15.78:0/4116663541 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0f8164580 con 0x7fc0f8150ee0 2023-12-12T10:13:19.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:19.817+0000 7fc0fd71d640 1 -- 172.21.15.78:0/4116663541 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0f8164b00 con 0x7fc0f8150ee0 2023-12-12T10:13:19.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:19.817+0000 7fc0fd71d640 1 -- 172.21.15.78:0/4116663541 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0f81652e0 con 0x7fc0f8150ee0 2023-12-12T10:13:19.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:19.821+0000 7fc0effff640 1 -- 172.21.15.78:0/4116663541 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc0f0012cd0 con 0x7fc0f8150ee0 2023-12-12T10:13:19.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:19.821+0000 7fc0effff640 1 --2- 172.21.15.78:0/4116663541 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fc0d8066470 0x7fc0d8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:19.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:19.821+0000 7fc0effff640 1 -- 172.21.15.78:0/4116663541 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6749+0+0 (secure 0 0 0) 0x7fc0f0084c90 con 0x7fc0f8150ee0 2023-12-12T10:13:19.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:19.821+0000 7fc0f6ffd640 1 --2- 172.21.15.78:0/4116663541 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fc0d8066470 0x7fc0d8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:19.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:19.821+0000 7fc0f6ffd640 1 --2- 172.21.15.78:0/4116663541 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fc0d8066470 0x7fc0d8068930 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fc0e00ad000 tx=0x7fc0e00a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:19.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:19.825+0000 7fc0effff640 1 -- 172.21.15.78:0/4116663541 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc0f0051c60 con 0x7fc0f8150ee0 2023-12-12T10:13:19.979 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:19.977+0000 7fc0fd71d640 1 -- 172.21.15.78:0/4116663541 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fc0f8074610 con 0x7fc0f8150ee0 2023-12-12T10:13:20.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:20.925+0000 7fc0effff640 1 -- 172.21.15.78:0/4116663541 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v28) v1 ==== 181+0+0 (secure 0 0 0) 0x7fc0f0055280 con 0x7fc0f8150ee0 2023-12-12T10:13:20.929 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_metadata' removed 2023-12-12T10:13:20.931 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:20.925+0000 7fc0fd71d640 1 -- 172.21.15.78:0/4116663541 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fc0d8066470 msgr2=0x7fc0d8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:20.932 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:20.925+0000 7fc0fd71d640 1 --2- 172.21.15.78:0/4116663541 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fc0d8066470 0x7fc0d8068930 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fc0e00ad000 tx=0x7fc0e00a6000 comp rx=0 tx=0).stop 2023-12-12T10:13:20.932 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:20.925+0000 7fc0fd71d640 1 -- 172.21.15.78:0/4116663541 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc0f8150ee0 msgr2=0x7fc0f8140a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:20.932 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:20.925+0000 7fc0fd71d640 1 --2- 172.21.15.78:0/4116663541 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc0f8150ee0 0x7fc0f8140a50 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fc0f0002130 tx=0x7fc0f000a430 comp rx=0 tx=0).stop 2023-12-12T10:13:20.932 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:20.929+0000 7fc0fd71d640 1 -- 172.21.15.78:0/4116663541 shutdown_connections 2023-12-12T10:13:20.932 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:20.929+0000 7fc0fd71d640 1 --2- 172.21.15.78:0/4116663541 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fc0d8066470 0x7fc0d8068930 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:20.932 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:20.929+0000 7fc0fd71d640 1 --2- 172.21.15.78:0/4116663541 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc0f8150ee0 0x7fc0f8140a50 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:20.932 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:20.929+0000 7fc0fd71d640 1 --2- 172.21.15.78:0/4116663541 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc0f80cf540 0x7fc0f8140510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:20.932 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:20.929+0000 7fc0fd71d640 1 --2- 172.21.15.78:0/4116663541 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc0f80cc920 0x7fc0f814d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:20.932 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:20.929+0000 7fc0fd71d640 1 -- 172.21.15.78:0/4116663541 >> 172.21.15.78:0/4116663541 conn(0x7fc0f80cea20 msgr2=0x7fc0f80706e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:20.933 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:20.929+0000 7fc0fd71d640 1 -- 172.21.15.78:0/4116663541 shutdown_connections 2023-12-12T10:13:20.933 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:20.929+0000 7fc0fd71d640 1 -- 172.21.15.78:0/4116663541 wait complete. 2023-12-12T10:13:20.958 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-12T10:13:21.103 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:21.101+0000 7f8221217640 1 Processor -- start 2023-12-12T10:13:21.104 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:21.101+0000 7f8221217640 1 -- start start 2023-12-12T10:13:21.106 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:21.101+0000 7f8221217640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f821c0ce500 0x7f821c071490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:21.106 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:21.101+0000 7f8221217640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f821c0719d0 0x7f821c06c740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:21.106 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:21.101+0000 7f8221217640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f821c0ceb30 con 0x7f821c0cb670 2023-12-12T10:13:21.106 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:21.101+0000 7f8221217640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f821c071e60 con 0x7f821c0719d0 2023-12-12T10:13:21.106 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:21.101+0000 7f8221217640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f821c072370 con 0x7f821c0ce500 2023-12-12T10:13:21.106 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:21.101+0000 7f821b59e640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f821c0719d0 0x7f821c06c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:21.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:21.101+0000 7f821b59e640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f821c0719d0 0x7f821c06c740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50252/0 (socket says 172.21.15.78:50252) 2023-12-12T10:13:21.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:21.101+0000 7f821b59e640 1 -- 172.21.15.78:0/2441951958 learned_addr learned my addr 172.21.15.78:0/2441951958 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:13:21.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:21.101+0000 7f821a59c640 1 --2- 172.21.15.78:0/2441951958 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f821c0ce500 0x7f821c071490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:21.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:21.101+0000 7f821b59e640 1 -- 172.21.15.78:0/2441951958 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f821c0ce500 msgr2=0x7f821c071490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:13:21.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:21.101+0000 7f821b59e640 1 --2- 172.21.15.78:0/2441951958 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f821c0ce500 0x7f821c071490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:21.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:21.101+0000 7f821b59e640 1 -- 172.21.15.78:0/2441951958 >> v1:172.21.15.187:6789/0 conn(0x7f821c0cb670 legacy=0x7f821c15bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:13:21.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:21.101+0000 7f821b59e640 1 -- 172.21.15.78:0/2441951958 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f821c0cc090 con 0x7f821c0719d0 2023-12-12T10:13:21.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:21.101+0000 7f821a59c640 1 --2- 172.21.15.78:0/2441951958 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f821c0ce500 0x7f821c071490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T10:13:21.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:21.105+0000 7f821b59e640 1 --2- 172.21.15.78:0/2441951958 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f821c0719d0 0x7f821c06c740 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f8214009e50 tx=0x7f821401c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=659e5476e4febe3b server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:21.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:21.105+0000 7f8219d9b640 1 -- 172.21.15.78:0/2441951958 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82140a5740 con 0x7f821c0719d0 2023-12-12T10:13:21.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:21.105+0000 7f8219d9b640 1 -- 172.21.15.78:0/2441951958 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82140a58a0 con 0x7f821c0719d0 2023-12-12T10:13:21.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:21.105+0000 7f8219d9b640 1 -- 172.21.15.78:0/2441951958 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82140a5c30 con 0x7f821c0719d0 2023-12-12T10:13:21.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:21.105+0000 7f8221217640 1 -- 172.21.15.78:0/2441951958 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f821c0719d0 msgr2=0x7f821c06c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:21.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:21.105+0000 7f8221217640 1 --2- 172.21.15.78:0/2441951958 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f821c0719d0 0x7f821c06c740 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f8214009e50 tx=0x7f821401c9d0 comp rx=0 tx=0).stop 2023-12-12T10:13:21.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:21.105+0000 7f8221217640 1 -- 172.21.15.78:0/2441951958 shutdown_connections 2023-12-12T10:13:21.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:21.105+0000 7f8221217640 1 --2- 172.21.15.78:0/2441951958 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f821c0719d0 0x7f821c06c740 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:21.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:21.105+0000 7f8221217640 1 --2- 172.21.15.78:0/2441951958 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f821c0ce500 0x7f821c071490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:21.111 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:21.105+0000 7f8221217640 1 -- 172.21.15.78:0/2441951958 >> 172.21.15.78:0/2441951958 conn(0x7f821c06a710 msgr2=0x7f821c06ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:21.111 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:21.105+0000 7f8221217640 1 -- 172.21.15.78:0/2441951958 shutdown_connections 2023-12-12T10:13:21.111 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:21.105+0000 7f8221217640 1 -- 172.21.15.78:0/2441951958 wait complete. 2023-12-12T10:13:21.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:21.105+0000 7f8221217640 1 Processor -- start 2023-12-12T10:13:21.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:21.109+0000 7f8221217640 1 -- start start 2023-12-12T10:13:21.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:21.109+0000 7f8221217640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f821c0719d0 0x7f821c165480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:21.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:21.109+0000 7f8221217640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f821c0cb670 0x7f821c160460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:21.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:21.109+0000 7f8221217640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f821c0ce500 0x7f821c149fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:21.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:21.109+0000 7f8221217640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f821c14a510 con 0x7f821c0ce500 2023-12-12T10:13:21.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:21.109+0000 7f8221217640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f821c160b40 con 0x7f821c0719d0 2023-12-12T10:13:21.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:21.109+0000 7f8221217640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f821c160e20 con 0x7f821c0cb670 2023-12-12T10:13:21.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:21.109+0000 7f821b59e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f821c0ce500 0x7f821c149fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:21.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:21.109+0000 7f821b59e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f821c0ce500 0x7f821c149fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50260/0 (socket says 172.21.15.78:50260) 2023-12-12T10:13:21.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:21.109+0000 7f821b59e640 1 -- 172.21.15.78:0/1594648950 learned_addr learned my addr 172.21.15.78:0/1594648950 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:13:21.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:21.109+0000 7f821a59c640 1 --2- 172.21.15.78:0/1594648950 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f821c0cb670 0x7f821c160460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:21.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:21.109+0000 7f821ad9d640 1 --2- 172.21.15.78:0/1594648950 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f821c0719d0 0x7f821c165480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:21.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:21.109+0000 7f821b59e640 1 -- 172.21.15.78:0/1594648950 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f821c0cb670 msgr2=0x7f821c160460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:21.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:21.109+0000 7f821b59e640 1 --2- 172.21.15.78:0/1594648950 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f821c0cb670 0x7f821c160460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:21.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:21.109+0000 7f821b59e640 1 -- 172.21.15.78:0/1594648950 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f821c0719d0 msgr2=0x7f821c165480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:21.116 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:21.109+0000 7f821b59e640 1 --2- 172.21.15.78:0/1594648950 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f821c0719d0 0x7f821c165480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:21.116 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:21.109+0000 7f821b59e640 1 -- 172.21.15.78:0/1594648950 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8214009b30 con 0x7f821c0ce500 2023-12-12T10:13:21.116 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:21.109+0000 7f821b59e640 1 --2- 172.21.15.78:0/1594648950 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f821c0ce500 0x7f821c149fd0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f82140af040 tx=0x7f8214019770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:21.116 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:21.109+0000 7f82037fe640 1 -- 172.21.15.78:0/1594648950 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82140b8670 con 0x7f821c0ce500 2023-12-12T10:13:21.116 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:21.109+0000 7f82037fe640 1 -- 172.21.15.78:0/1594648950 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82140b87d0 con 0x7f821c0ce500 2023-12-12T10:13:21.116 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:21.109+0000 7f8221217640 1 -- 172.21.15.78:0/1594648950 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f821c0ccfd0 con 0x7f821c0ce500 2023-12-12T10:13:21.116 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:21.109+0000 7f82037fe640 1 -- 172.21.15.78:0/1594648950 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82140b8b80 con 0x7f821c0ce500 2023-12-12T10:13:21.116 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:21.109+0000 7f8221217640 1 -- 172.21.15.78:0/1594648950 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f821c1613e0 con 0x7f821c0ce500 2023-12-12T10:13:21.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:21.109+0000 7f8221217640 1 -- 172.21.15.78:0/1594648950 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f821c0671f0 con 0x7f821c0ce500 2023-12-12T10:13:21.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:21.113+0000 7f82037fe640 1 -- 172.21.15.78:0/1594648950 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f82140b8ce0 con 0x7f821c0ce500 2023-12-12T10:13:21.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:21.113+0000 7f82037fe640 1 --2- 172.21.15.78:0/1594648950 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f8208066470 0x7f8208068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:21.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:21.113+0000 7f82037fe640 1 -- 172.21.15.78:0/1594648950 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6311+0+0 (secure 0 0 0) 0x7f821411f640 con 0x7f821c0ce500 2023-12-12T10:13:21.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:21.113+0000 7f821ad9d640 1 --2- 172.21.15.78:0/1594648950 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f8208066470 0x7f8208068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:21.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:21.113+0000 7f821ad9d640 1 --2- 172.21.15.78:0/1594648950 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f8208066470 0x7f8208068930 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f821c06b1d0 tx=0x7f820c007e40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:21.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:21.117+0000 7f82037fe640 1 -- 172.21.15.78:0/1594648950 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f82140ec870 con 0x7f821c0ce500 2023-12-12T10:13:21.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:21.285+0000 7f8221217640 1 -- 172.21.15.78:0/1594648950 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f821c067530 con 0x7f821c0ce500 2023-12-12T10:13:21.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:21.929+0000 7f82037fe640 1 -- 172.21.15.78:0/1594648950 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v29) v1 ==== 169+0+0 (secure 0 0 0) 0x7f82140efe90 con 0x7f821c0ce500 2023-12-12T10:13:21.935 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_data' removed 2023-12-12T10:13:21.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:21.933+0000 7f8221217640 1 -- 172.21.15.78:0/1594648950 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f8208066470 msgr2=0x7f8208068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:21.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:21.933+0000 7f8221217640 1 --2- 172.21.15.78:0/1594648950 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f8208066470 0x7f8208068930 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f821c06b1d0 tx=0x7f820c007e40 comp rx=0 tx=0).stop 2023-12-12T10:13:21.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:21.933+0000 7f8221217640 1 -- 172.21.15.78:0/1594648950 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f821c0ce500 msgr2=0x7f821c149fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:21.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:21.933+0000 7f8221217640 1 --2- 172.21.15.78:0/1594648950 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f821c0ce500 0x7f821c149fd0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f82140af040 tx=0x7f8214019770 comp rx=0 tx=0).stop 2023-12-12T10:13:21.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:21.933+0000 7f8221217640 1 -- 172.21.15.78:0/1594648950 shutdown_connections 2023-12-12T10:13:21.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:21.933+0000 7f8221217640 1 --2- 172.21.15.78:0/1594648950 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f8208066470 0x7f8208068930 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:21.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:21.933+0000 7f8221217640 1 --2- 172.21.15.78:0/1594648950 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f821c0ce500 0x7f821c149fd0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:21.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:21.933+0000 7f8221217640 1 --2- 172.21.15.78:0/1594648950 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f821c0cb670 0x7f821c160460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:21.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:21.933+0000 7f8221217640 1 --2- 172.21.15.78:0/1594648950 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f821c0719d0 0x7f821c165480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:21.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:21.933+0000 7f8221217640 1 -- 172.21.15.78:0/1594648950 >> 172.21.15.78:0/1594648950 conn(0x7f821c06a710 msgr2=0x7f821c072e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:21.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:21.933+0000 7f8221217640 1 -- 172.21.15.78:0/1594648950 shutdown_connections 2023-12-12T10:13:21.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:21.933+0000 7f8221217640 1 -- 172.21.15.78:0/1594648950 wait complete. 2023-12-12T10:13:21.963 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2023-12-12T10:13:22.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:22.101+0000 7ff5c35e7640 1 Processor -- start 2023-12-12T10:13:22.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:22.105+0000 7ff5c35e7640 1 -- start start 2023-12-12T10:13:22.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:22.105+0000 7ff5c35e7640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7ff5bc0cb670 0x7ff5bc0ce500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:22.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:22.105+0000 7ff5c35e7640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff5bc15bdd0 0x7ff5bc071490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:22.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:22.105+0000 7ff5c35e7640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff5bc0719d0 0x7ff5bc15e970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:22.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:22.105+0000 7ff5c35e7640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5bc071e60 con 0x7ff5bc0719d0 2023-12-12T10:13:22.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:22.105+0000 7ff5c35e7640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5bc072370 con 0x7ff5bc0cb670 2023-12-12T10:13:22.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:22.105+0000 7ff5c35e7640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5bc0ceb30 con 0x7ff5bc15bdd0 2023-12-12T10:13:22.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:22.105+0000 7ff5c1b84640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff5bc0719d0 0x7ff5bc15e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:22.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:22.105+0000 7ff5c1b84640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff5bc0719d0 0x7ff5bc15e970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50268/0 (socket says 172.21.15.78:50268) 2023-12-12T10:13:22.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:22.105+0000 7ff5c1b84640 1 -- 172.21.15.78:0/2340617243 learned_addr learned my addr 172.21.15.78:0/2340617243 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:13:22.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:22.105+0000 7ff5c0b82640 1 --2- 172.21.15.78:0/2340617243 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff5bc15bdd0 0x7ff5bc071490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:22.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:22.105+0000 7ff5c1383640 1 --2- 172.21.15.78:0/2340617243 >> v2:172.21.15.187:3300/0 conn(0x7ff5bc0cb670 0x7ff5bc0ce500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:22.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:22.105+0000 7ff5c1b84640 1 -- 172.21.15.78:0/2340617243 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff5bc15bdd0 msgr2=0x7ff5bc071490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:13:22.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:22.105+0000 7ff5c1b84640 1 --2- 172.21.15.78:0/2340617243 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff5bc15bdd0 0x7ff5bc071490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:22.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:22.105+0000 7ff5c1b84640 1 -- 172.21.15.78:0/2340617243 >> v2:172.21.15.187:3300/0 conn(0x7ff5bc0cb670 msgr2=0x7ff5bc0ce500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:13:22.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:22.105+0000 7ff5c1b84640 1 --2- 172.21.15.78:0/2340617243 >> v2:172.21.15.187:3300/0 conn(0x7ff5bc0cb670 0x7ff5bc0ce500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:22.110 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:22.105+0000 7ff5c1b84640 1 -- 172.21.15.78:0/2340617243 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5bc0cc090 con 0x7ff5bc0719d0 2023-12-12T10:13:22.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:22.109+0000 7ff5c1b84640 1 --2- 172.21.15.78:0/2340617243 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5bc0719d0 0x7ff5bc15e970 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7ff5bc070650 tx=0x7ff5b401c6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1675fd95dedf680d server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:22.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:22.109+0000 7ff5b3fff640 1 -- 172.21.15.78:0/2340617243 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5b40a5560 con 0x7ff5bc0719d0 2023-12-12T10:13:22.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:22.109+0000 7ff5b3fff640 1 -- 172.21.15.78:0/2340617243 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5b40a56c0 con 0x7ff5bc0719d0 2023-12-12T10:13:22.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:22.109+0000 7ff5b3fff640 1 -- 172.21.15.78:0/2340617243 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5b40a5a50 con 0x7ff5bc0719d0 2023-12-12T10:13:22.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:22.109+0000 7ff5c35e7640 1 -- 172.21.15.78:0/2340617243 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5bc0719d0 msgr2=0x7ff5bc15e970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:22.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:22.109+0000 7ff5c35e7640 1 --2- 172.21.15.78:0/2340617243 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5bc0719d0 0x7ff5bc15e970 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7ff5bc070650 tx=0x7ff5b401c6e0 comp rx=0 tx=0).stop 2023-12-12T10:13:22.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:22.109+0000 7ff5c35e7640 1 -- 172.21.15.78:0/2340617243 shutdown_connections 2023-12-12T10:13:22.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:22.109+0000 7ff5c35e7640 1 --2- 172.21.15.78:0/2340617243 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5bc0719d0 0x7ff5bc15e970 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:22.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:22.109+0000 7ff5c35e7640 1 --2- 172.21.15.78:0/2340617243 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff5bc15bdd0 0x7ff5bc071490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:22.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:22.109+0000 7ff5c35e7640 1 --2- 172.21.15.78:0/2340617243 >> v2:172.21.15.187:3300/0 conn(0x7ff5bc0cb670 0x7ff5bc0ce500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:22.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:22.109+0000 7ff5c35e7640 1 -- 172.21.15.78:0/2340617243 >> 172.21.15.78:0/2340617243 conn(0x7ff5bc06a710 msgr2=0x7ff5bc06ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:22.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:22.109+0000 7ff5c35e7640 1 -- 172.21.15.78:0/2340617243 shutdown_connections 2023-12-12T10:13:22.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:22.109+0000 7ff5c35e7640 1 -- 172.21.15.78:0/2340617243 wait complete. 2023-12-12T10:13:22.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:22.109+0000 7ff5c35e7640 1 Processor -- start 2023-12-12T10:13:22.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:22.109+0000 7ff5c35e7640 1 -- start start 2023-12-12T10:13:22.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:22.113+0000 7ff5c35e7640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff5bc0719d0 0x7ff5bc14bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:22.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:22.113+0000 7ff5c35e7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5bc0cb670 0x7ff5bc153050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:22.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:22.113+0000 7ff5c35e7640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff5bc15bdd0 0x7ff5bc14cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:22.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:22.113+0000 7ff5c35e7640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5bc153590 con 0x7ff5bc0cb670 2023-12-12T10:13:22.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:22.113+0000 7ff5c35e7640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5bc14d530 con 0x7ff5bc15bdd0 2023-12-12T10:13:22.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:22.113+0000 7ff5c35e7640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5bc14e310 con 0x7ff5bc0719d0 2023-12-12T10:13:22.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:22.113+0000 7ff5c0b82640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5bc0cb670 0x7ff5bc153050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:22.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:22.113+0000 7ff5c0b82640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5bc0cb670 0x7ff5bc153050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50284/0 (socket says 172.21.15.78:50284) 2023-12-12T10:13:22.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:22.113+0000 7ff5c0b82640 1 -- 172.21.15.78:0/1499342053 learned_addr learned my addr 172.21.15.78:0/1499342053 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:13:22.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:22.113+0000 7ff5c1383640 1 --2- 172.21.15.78:0/1499342053 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff5bc0719d0 0x7ff5bc14bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:22.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:22.113+0000 7ff5c1b84640 1 --2- 172.21.15.78:0/1499342053 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff5bc15bdd0 0x7ff5bc14cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:22.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:22.113+0000 7ff5c0b82640 1 -- 172.21.15.78:0/1499342053 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff5bc0719d0 msgr2=0x7ff5bc14bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:22.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:22.113+0000 7ff5c0b82640 1 --2- 172.21.15.78:0/1499342053 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff5bc0719d0 0x7ff5bc14bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:22.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:22.113+0000 7ff5c0b82640 1 -- 172.21.15.78:0/1499342053 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff5bc15bdd0 msgr2=0x7ff5bc14cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:22.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:22.113+0000 7ff5c0b82640 1 --2- 172.21.15.78:0/1499342053 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff5bc15bdd0 0x7ff5bc14cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:22.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:22.113+0000 7ff5c0b82640 1 -- 172.21.15.78:0/1499342053 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5b4009b30 con 0x7ff5bc0cb670 2023-12-12T10:13:22.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:22.113+0000 7ff5c1383640 1 --2- 172.21.15.78:0/1499342053 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff5bc0719d0 0x7ff5bc14bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T10:13:22.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:22.113+0000 7ff5c1b84640 1 --2- 172.21.15.78:0/1499342053 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff5bc15bdd0 0x7ff5bc14cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T10:13:22.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:22.113+0000 7ff5c0b82640 1 --2- 172.21.15.78:0/1499342053 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5bc0cb670 0x7ff5bc153050 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7ff5ac00d5f0 tx=0x7ff5ac00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:22.121 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:22.113+0000 7ff5b1ffb640 1 -- 172.21.15.78:0/1499342053 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5ac0125f0 con 0x7ff5bc0cb670 2023-12-12T10:13:22.121 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:22.113+0000 7ff5b1ffb640 1 -- 172.21.15.78:0/1499342053 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5ac012750 con 0x7ff5bc0cb670 2023-12-12T10:13:22.121 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:22.113+0000 7ff5c35e7640 1 -- 172.21.15.78:0/1499342053 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5bc0ccfd0 con 0x7ff5bc0cb670 2023-12-12T10:13:22.121 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:22.113+0000 7ff5b1ffb640 1 -- 172.21.15.78:0/1499342053 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5ac012ae0 con 0x7ff5bc0cb670 2023-12-12T10:13:22.121 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:22.113+0000 7ff5c35e7640 1 -- 172.21.15.78:0/1499342053 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5bc14da70 con 0x7ff5bc0cb670 2023-12-12T10:13:22.122 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:22.113+0000 7ff5c35e7640 1 -- 172.21.15.78:0/1499342053 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5bc0671f0 con 0x7ff5bc0cb670 2023-12-12T10:13:22.122 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:22.113+0000 7ff5b1ffb640 1 -- 172.21.15.78:0/1499342053 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff5ac012c40 con 0x7ff5bc0cb670 2023-12-12T10:13:22.122 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:22.117+0000 7ff5b1ffb640 1 --2- 172.21.15.78:0/1499342053 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7ff5a0066470 0x7ff5a0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:22.122 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:22.117+0000 7ff5b1ffb640 1 -- 172.21.15.78:0/1499342053 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5781+0+0 (secure 0 0 0) 0x7ff5ac084310 con 0x7ff5bc0cb670 2023-12-12T10:13:22.122 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:22.117+0000 7ff5c1383640 1 --2- 172.21.15.78:0/1499342053 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7ff5a0066470 0x7ff5a0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:22.122 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:22.117+0000 7ff5c1383640 1 --2- 172.21.15.78:0/1499342053 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7ff5a0066470 0x7ff5a0068930 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ff5b8007a70 tx=0x7ff5b8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:22.124 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:22.121+0000 7ff5b1ffb640 1 -- 172.21.15.78:0/1499342053 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff5ac051730 con 0x7ff5bc0cb670 2023-12-12T10:13:22.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:22.273+0000 7ff5c35e7640 1 -- 172.21.15.78:0/1499342053 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ff5bc067530 con 0x7ff5bc0cb670 2023-12-12T10:13:22.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:22.941+0000 7ff5b1ffb640 1 -- 172.21.15.78:0/1499342053 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v30) v1 ==== 178+0+0 (secure 0 0 0) 0x7ff5ac007380 con 0x7ff5bc0cb670 2023-12-12T10:13:22.945 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_data_ec' removed 2023-12-12T10:13:22.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:22.941+0000 7ff5c35e7640 1 -- 172.21.15.78:0/1499342053 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7ff5a0066470 msgr2=0x7ff5a0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:22.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:22.941+0000 7ff5c35e7640 1 --2- 172.21.15.78:0/1499342053 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7ff5a0066470 0x7ff5a0068930 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ff5b8007a70 tx=0x7ff5b8008040 comp rx=0 tx=0).stop 2023-12-12T10:13:22.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:22.941+0000 7ff5c35e7640 1 -- 172.21.15.78:0/1499342053 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5bc0cb670 msgr2=0x7ff5bc153050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:22.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:22.941+0000 7ff5c35e7640 1 --2- 172.21.15.78:0/1499342053 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5bc0cb670 0x7ff5bc153050 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7ff5ac00d5f0 tx=0x7ff5ac00dab0 comp rx=0 tx=0).stop 2023-12-12T10:13:22.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:22.941+0000 7ff5c35e7640 1 -- 172.21.15.78:0/1499342053 shutdown_connections 2023-12-12T10:13:22.948 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:22.941+0000 7ff5c35e7640 1 --2- 172.21.15.78:0/1499342053 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7ff5a0066470 0x7ff5a0068930 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:22.948 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:22.941+0000 7ff5c35e7640 1 --2- 172.21.15.78:0/1499342053 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff5bc15bdd0 0x7ff5bc14cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:22.948 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:22.941+0000 7ff5c35e7640 1 --2- 172.21.15.78:0/1499342053 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff5bc0cb670 0x7ff5bc153050 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:22.948 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:22.941+0000 7ff5c35e7640 1 --2- 172.21.15.78:0/1499342053 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff5bc0719d0 0x7ff5bc14bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:22.948 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:22.941+0000 7ff5c35e7640 1 -- 172.21.15.78:0/1499342053 >> 172.21.15.78:0/1499342053 conn(0x7ff5bc06a710 msgr2=0x7ff5bc06aaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:22.948 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:22.941+0000 7ff5c35e7640 1 -- 172.21.15.78:0/1499342053 shutdown_connections 2023-12-12T10:13:22.948 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:22.941+0000 7ff5c35e7640 1 -- 172.21.15.78:0/1499342053 wait complete. 2023-12-12T10:13:22.976 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-12T10:13:22.976 INFO:tasks.ceph.mds.a:Stopping old one... 2023-12-12T10:13:22.976 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-12T10:13:22.976 INFO:teuthology.orchestra.run:waiting for 300 2023-12-12T10:13:22.977 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-12T10:13:22.977 INFO:tasks.ceph.mds.c:Stopping old one... 2023-12-12T10:13:22.977 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-12T10:13:22.977 INFO:teuthology.orchestra.run:waiting for 300 2023-12-12T10:13:22.977 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-12T10:13:22.977 INFO:tasks.ceph.mds.b:Stopping old one... 2023-12-12T10:13:22.977 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-12T10:13:22.978 INFO:teuthology.orchestra.run:waiting for 300 2023-12-12T10:13:22.978 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-12T10:13:22.978 INFO:tasks.ceph.mds.d:Stopping old one... 2023-12-12T10:13:22.978 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-12T10:13:22.978 INFO:teuthology.orchestra.run:waiting for 300 2023-12-12T10:13:22.993 INFO:tasks.ceph.mds.c:Stopped 2023-12-12T10:13:22.993 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-12T10:13:22.994 INFO:tasks.ceph.mds.a:Stopped 2023-12-12T10:13:22.994 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-12T10:13:22.995 INFO:tasks.ceph.mds.b:Stopped 2023-12-12T10:13:22.995 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-12T10:13:22.996 INFO:tasks.ceph.mds.d:Stopped 2023-12-12T10:13:22.996 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-12T10:13:23.042 INFO:tasks.ceph.mds.c:Started 2023-12-12T10:13:23.043 DEBUG:teuthology.parallel:result is None 2023-12-12T10:13:23.044 INFO:tasks.ceph.mds.b:Started 2023-12-12T10:13:23.044 DEBUG:teuthology.parallel:result is None 2023-12-12T10:13:23.044 INFO:tasks.ceph.mds.a:Started 2023-12-12T10:13:23.044 DEBUG:teuthology.parallel:result is None 2023-12-12T10:13:23.046 INFO:tasks.ceph.mds.d:Started 2023-12-12T10:13:23.046 DEBUG:teuthology.parallel:result is None 2023-12-12T10:13:23.046 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-12-12T10:13:23.132 INFO:tasks.ceph.mds.c.smithi078.stdout:starting mds.c at 2023-12-12T10:13:23.133 INFO:tasks.ceph.mds.a.smithi078.stdout:starting mds.a at 2023-12-12T10:13:23.134 INFO:tasks.ceph.mds.d.smithi187.stdout:starting mds.d at 2023-12-12T10:13:23.134 INFO:tasks.ceph.mds.b.smithi187.stdout:starting mds.b at 2023-12-12T10:13:23.136 INFO:tasks.ceph.mds.d.smithi187.stderr:2023-12-12T10:13:23.131+0000 7f80a513e640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6832/0: (98) Address already in use 2023-12-12T10:13:23.193 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:23.189+0000 7f088a29c640 1 Processor -- start 2023-12-12T10:13:23.194 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:23.189+0000 7f088a29c640 1 -- start start 2023-12-12T10:13:23.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:23.189+0000 7f088a29c640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f08840cdf60 0x7f0884070f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:23.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:23.189+0000 7f088a29c640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f0884071440 0x7f088415d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:23.195 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:23.189+0000 7f088a29c640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0884070a70 con 0x7f0884143770 2023-12-12T10:13:23.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:23.189+0000 7f088a29c640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08840ce3c0 con 0x7f0884071440 2023-12-12T10:13:23.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:23.189+0000 7f088a29c640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08840718b0 con 0x7f08840cdf60 2023-12-12T10:13:23.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:23.189+0000 7f0883fff640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f0884143770 0x7f08840b1e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.78:47352/0 (socket says 172.21.15.78:47352) 2023-12-12T10:13:23.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:23.189+0000 7f0883fff640 1 -- 172.21.15.78:0/2208448892 learned_addr learned my addr 172.21.15.78:0/2208448892 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-12-12T10:13:23.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:23.189+0000 7f0888839640 1 --2- 172.21.15.78:0/2208448892 >> v2:172.21.15.78:3300/0 conn(0x7f0884071440 0x7f088415d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:23.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:23.189+0000 7f08837fe640 1 --2- 172.21.15.78:0/2208448892 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f08840cdf60 0x7f0884070f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:23.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:23.193+0000 7f0888839640 1 -- 172.21.15.78:0/2208448892 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f08840cdf60 msgr2=0x7f0884070f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:13:23.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:23.193+0000 7f0882ffd640 1 -- 172.21.15.78:0/2208448892 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 724612838 0 0) 0x7f0884070a70 con 0x7f0884143770 2023-12-12T10:13:23.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:23.193+0000 7f0888839640 1 --2- 172.21.15.78:0/2208448892 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f08840cdf60 0x7f0884070f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:23.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:23.193+0000 7f0888839640 1 -- 172.21.15.78:0/2208448892 >> v1:172.21.15.187:6789/0 conn(0x7f0884143770 legacy=0x7f08840b1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:23.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:23.193+0000 7f0888839640 1 -- 172.21.15.78:0/2208448892 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0884070440 con 0x7f0884071440 2023-12-12T10:13:23.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:23.193+0000 7f0888839640 1 --2- 172.21.15.78:0/2208448892 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0884071440 0x7f088415d910 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f087c009d90 tx=0x7f087c01c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a745b1c90433eb5 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:23.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:23.193+0000 7f0882ffd640 1 -- 172.21.15.78:0/2208448892 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f087c0a5980 con 0x7f0884071440 2023-12-12T10:13:23.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:23.193+0000 7f0882ffd640 1 -- 172.21.15.78:0/2208448892 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f087c0a5ae0 con 0x7f0884071440 2023-12-12T10:13:23.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:23.193+0000 7f0882ffd640 1 -- 172.21.15.78:0/2208448892 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f087c0a5e70 con 0x7f0884071440 2023-12-12T10:13:23.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:23.193+0000 7f088a29c640 1 -- 172.21.15.78:0/2208448892 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0884071440 msgr2=0x7f088415d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:23.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:23.193+0000 7f088a29c640 1 --2- 172.21.15.78:0/2208448892 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0884071440 0x7f088415d910 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f087c009d90 tx=0x7f087c01c8c0 comp rx=0 tx=0).stop 2023-12-12T10:13:23.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:23.193+0000 7f088a29c640 1 -- 172.21.15.78:0/2208448892 shutdown_connections 2023-12-12T10:13:23.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:23.193+0000 7f088a29c640 1 --2- 172.21.15.78:0/2208448892 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0884071440 0x7f088415d910 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:23.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:23.197+0000 7f088a29c640 1 --2- 172.21.15.78:0/2208448892 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f08840cdf60 0x7f0884070f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:23.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:23.197+0000 7f088a29c640 1 -- 172.21.15.78:0/2208448892 >> 172.21.15.78:0/2208448892 conn(0x7f088406a710 msgr2=0x7f088406ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:23.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:23.197+0000 7f088a29c640 1 -- 172.21.15.78:0/2208448892 shutdown_connections 2023-12-12T10:13:23.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:23.197+0000 7f088a29c640 1 -- 172.21.15.78:0/2208448892 wait complete. 2023-12-12T10:13:23.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:23.197+0000 7f088a29c640 1 Processor -- start 2023-12-12T10:13:23.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:23.197+0000 7f088a29c640 1 -- start start 2023-12-12T10:13:23.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:23.197+0000 7f088a29c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0884071440 0x7f0884139370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:23.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:23.197+0000 7f088a29c640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f08840cdf60 0x7f08841f9140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:23.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:23.197+0000 7f088a29c640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0884143770 0x7f08841f5370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:23.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:23.197+0000 7f088a29c640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08840ae6e0 con 0x7f0884071440 2023-12-12T10:13:23.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:23.197+0000 7f088a29c640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08840ae9c0 con 0x7f0884143770 2023-12-12T10:13:23.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:23.197+0000 7f088a29c640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08841f9680 con 0x7f08840cdf60 2023-12-12T10:13:23.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:23.197+0000 7f0883fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0884071440 0x7f0884139370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:23.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:23.197+0000 7f0883fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0884071440 0x7f0884139370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50342/0 (socket says 172.21.15.78:50342) 2023-12-12T10:13:23.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:23.197+0000 7f0883fff640 1 -- 172.21.15.78:0/917910538 learned_addr learned my addr 172.21.15.78:0/917910538 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:13:23.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:23.197+0000 7f0888839640 1 --2- 172.21.15.78:0/917910538 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0884143770 0x7f08841f5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:23.203 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:23.197+0000 7f08837fe640 1 --2- 172.21.15.78:0/917910538 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f08840cdf60 0x7f08841f9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:23.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:23.197+0000 7f0883fff640 1 -- 172.21.15.78:0/917910538 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f08840cdf60 msgr2=0x7f08841f9140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:23.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:23.197+0000 7f0883fff640 1 --2- 172.21.15.78:0/917910538 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f08840cdf60 0x7f08841f9140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:23.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:23.197+0000 7f0883fff640 1 -- 172.21.15.78:0/917910538 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0884143770 msgr2=0x7f08841f5370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:23.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:23.197+0000 7f0883fff640 1 --2- 172.21.15.78:0/917910538 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0884143770 0x7f08841f5370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:23.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:23.197+0000 7f0883fff640 1 -- 172.21.15.78:0/917910538 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f087c009a70 con 0x7f0884071440 2023-12-12T10:13:23.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:23.197+0000 7f0883fff640 1 --2- 172.21.15.78:0/917910538 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0884071440 0x7f0884139370 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f087400c4b0 tx=0x7f087400c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:23.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:23.197+0000 7f0880ff9640 1 -- 172.21.15.78:0/917910538 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08740074e0 con 0x7f0884071440 2023-12-12T10:13:23.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:23.201+0000 7f0880ff9640 1 -- 172.21.15.78:0/917910538 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0874007660 con 0x7f0884071440 2023-12-12T10:13:23.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:23.201+0000 7f088a29c640 1 -- 172.21.15.78:0/917910538 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08841f98e0 con 0x7f0884071440 2023-12-12T10:13:23.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:23.201+0000 7f0880ff9640 1 -- 172.21.15.78:0/917910538 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0874004a30 con 0x7f0884071440 2023-12-12T10:13:23.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:23.201+0000 7f088a29c640 1 -- 172.21.15.78:0/917910538 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08841f9ea0 con 0x7f0884071440 2023-12-12T10:13:23.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:23.201+0000 7f088a29c640 1 -- 172.21.15.78:0/917910538 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08840671f0 con 0x7f0884071440 2023-12-12T10:13:23.205 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:23.201+0000 7f0880ff9640 1 -- 172.21.15.78:0/917910538 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f0874004b90 con 0x7f0884071440 2023-12-12T10:13:23.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:23.201+0000 7f0880ff9640 1 --2- 172.21.15.78:0/917910538 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f0870066470 0x7f0870068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:23.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:23.201+0000 7f0880ff9640 1 -- 172.21.15.78:0/917910538 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f0874082de0 con 0x7f0884071440 2023-12-12T10:13:23.206 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:23.201+0000 7f08837fe640 1 --2- 172.21.15.78:0/917910538 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f0870066470 0x7f0870068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:23.207 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:23.201+0000 7f08837fe640 1 --2- 172.21.15.78:0/917910538 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f0870066470 0x7f0870068930 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f08840b08e0 tx=0x7f0878009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:23.210 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:23.205+0000 7f0880ff9640 1 -- 172.21.15.78:0/917910538 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0874050430 con 0x7f0884071440 2023-12-12T10:13:23.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:23.393+0000 7f088a29c640 1 -- 172.21.15.78:0/917910538 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f08841fa0c0 con 0x7f0884071440 2023-12-12T10:13:24.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:24.933+0000 7f0880ff9640 1 -- 172.21.15.78:0/917910538 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v35) v1 ==== 97+0+0 (secure 0 0 0) 0x7f0874018080 con 0x7f0884071440 2023-12-12T10:13:24.939 INFO:teuthology.orchestra.run.smithi078.stderr: removed all blocklist entries 2023-12-12T10:13:24.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:24.937+0000 7f088a29c640 1 -- 172.21.15.78:0/917910538 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f0870066470 msgr2=0x7f0870068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:24.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:24.937+0000 7f088a29c640 1 --2- 172.21.15.78:0/917910538 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f0870066470 0x7f0870068930 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f08840b08e0 tx=0x7f0878009190 comp rx=0 tx=0).stop 2023-12-12T10:13:24.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:24.937+0000 7f088a29c640 1 -- 172.21.15.78:0/917910538 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0884071440 msgr2=0x7f0884139370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:24.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:24.937+0000 7f088a29c640 1 --2- 172.21.15.78:0/917910538 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0884071440 0x7f0884139370 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f087400c4b0 tx=0x7f087400c970 comp rx=0 tx=0).stop 2023-12-12T10:13:24.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:24.937+0000 7f088a29c640 1 -- 172.21.15.78:0/917910538 shutdown_connections 2023-12-12T10:13:24.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:24.937+0000 7f088a29c640 1 --2- 172.21.15.78:0/917910538 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f0870066470 0x7f0870068930 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:24.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:24.937+0000 7f088a29c640 1 --2- 172.21.15.78:0/917910538 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0884143770 0x7f08841f5370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:24.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:24.937+0000 7f088a29c640 1 --2- 172.21.15.78:0/917910538 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f08840cdf60 0x7f08841f9140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:24.942 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:24.937+0000 7f088a29c640 1 --2- 172.21.15.78:0/917910538 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f0884071440 0x7f0884139370 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:24.943 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:24.937+0000 7f088a29c640 1 -- 172.21.15.78:0/917910538 >> 172.21.15.78:0/917910538 conn(0x7f088406a710 msgr2=0x7f08840cd660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:24.943 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:24.937+0000 7f088a29c640 1 -- 172.21.15.78:0/917910538 shutdown_connections 2023-12-12T10:13:24.943 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:24.937+0000 7f088a29c640 1 -- 172.21.15.78:0/917910538 wait complete. 2023-12-12T10:13:24.965 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-12-12T10:13:25.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.101+0000 7f3196501640 1 Processor -- start 2023-12-12T10:13:25.107 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.101+0000 7f3196501640 1 -- start start 2023-12-12T10:13:25.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.105+0000 7f3196501640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f319015e360 0x7f319006a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:25.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.105+0000 7f3196501640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f319006bbc0 0x7f319015d720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:25.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.105+0000 7f3196501640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f319006ab20 con 0x7f31900b24b0 2023-12-12T10:13:25.108 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.105+0000 7f3196501640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f319015e740 con 0x7f319015e360 2023-12-12T10:13:25.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.105+0000 7f3196501640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f319006ae00 con 0x7f319006bbc0 2023-12-12T10:13:25.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.105+0000 7f3194a9e640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f31900b24b0 0x7f319006cac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:38808/0 (socket says 172.21.15.78:38808) 2023-12-12T10:13:25.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.105+0000 7f3194a9e640 1 -- 172.21.15.78:0/4172438967 learned_addr learned my addr 172.21.15.78:0/4172438967 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-12-12T10:13:25.111 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.105+0000 7f318f7fe640 1 --2- 172.21.15.78:0/4172438967 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f319006bbc0 0x7f319015d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:25.111 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.105+0000 7f318ffff640 1 --2- 172.21.15.78:0/4172438967 >> v2:172.21.15.187:3300/0 conn(0x7f319015e360 0x7f319006a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:25.111 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.105+0000 7f318effd640 1 -- 172.21.15.78:0/4172438967 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3233966590 0 0) 0x7f319006ab20 con 0x7f31900b24b0 2023-12-12T10:13:25.111 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.105+0000 7f318effd640 1 -- 172.21.15.78:0/4172438967 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3178003530 con 0x7f31900b24b0 2023-12-12T10:13:25.111 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.105+0000 7f318effd640 1 -- 172.21.15.78:0/4172438967 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3171071595 0 0) 0x7f3178003530 con 0x7f31900b24b0 2023-12-12T10:13:25.111 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.105+0000 7f318effd640 1 -- 172.21.15.78:0/4172438967 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f319006bbc0 msgr2=0x7f319015d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:13:25.111 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.105+0000 7f318effd640 1 --2- 172.21.15.78:0/4172438967 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f319006bbc0 0x7f319015d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:25.111 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.105+0000 7f318effd640 1 -- 172.21.15.78:0/4172438967 >> v2:172.21.15.187:3300/0 conn(0x7f319015e360 msgr2=0x7f319006a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:13:25.111 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.105+0000 7f318effd640 1 --2- 172.21.15.78:0/4172438967 >> v2:172.21.15.187:3300/0 conn(0x7f319015e360 0x7f319006a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:25.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.105+0000 7f318effd640 1 -- 172.21.15.78:0/4172438967 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f319006b0e0 con 0x7f31900b24b0 2023-12-12T10:13:25.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.105+0000 7f318effd640 1 -- 172.21.15.78:0/4172438967 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 465499599 0 0) 0x7f3188001a00 con 0x7f31900b24b0 2023-12-12T10:13:25.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.105+0000 7f318effd640 1 -- 172.21.15.78:0/4172438967 >> v1:172.21.15.78:6789/0 conn(0x7f31900b24b0 legacy=0x7f319006cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:25.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.105+0000 7f318effd640 1 --2- 172.21.15.78:0/4172438967 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3178003980 0x7f3178003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:25.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.105+0000 7f318effd640 1 --2- 172.21.15.78:0/4172438967 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f31780047d0 0x7f3178004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:25.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.105+0000 7f318effd640 1 --2- 172.21.15.78:0/4172438967 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f319006bbc0 0x7f3178005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:25.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.105+0000 7f318effd640 1 -- 172.21.15.78:0/4172438967 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f319015e740 con 0x7f3178003980 2023-12-12T10:13:25.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.105+0000 7f318effd640 1 -- 172.21.15.78:0/4172438967 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f319006ae00 con 0x7f31780047d0 2023-12-12T10:13:25.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.105+0000 7f318effd640 1 -- 172.21.15.78:0/4172438967 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f317800b990 con 0x7f319006bbc0 2023-12-12T10:13:25.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.105+0000 7f318ffff640 1 --2- 172.21.15.78:0/4172438967 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3178003980 0x7f3178003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:25.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.105+0000 7f318f7fe640 1 --2- 172.21.15.78:0/4172438967 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f31780047d0 0x7f3178004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:25.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.105+0000 7f3194a9e640 1 --2- 172.21.15.78:0/4172438967 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f319006bbc0 0x7f3178005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:25.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.105+0000 7f318ffff640 1 -- 172.21.15.78:0/4172438967 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f319006bbc0 msgr2=0x7f3178005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:13:25.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.105+0000 7f318ffff640 1 --2- 172.21.15.78:0/4172438967 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f319006bbc0 0x7f3178005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:25.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.105+0000 7f318ffff640 1 -- 172.21.15.78:0/4172438967 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f31780047d0 msgr2=0x7f3178004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:13:25.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.105+0000 7f318ffff640 1 --2- 172.21.15.78:0/4172438967 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f31780047d0 0x7f3178004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:25.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.105+0000 7f318ffff640 1 -- 172.21.15.78:0/4172438967 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3178003530 con 0x7f3178003980 2023-12-12T10:13:25.113 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.105+0000 7f318f7fe640 1 --2- 172.21.15.78:0/4172438967 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f31780047d0 0x7f3178004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T10:13:25.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.109+0000 7f318ffff640 1 --2- 172.21.15.78:0/4172438967 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3178003980 0x7f3178003da0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f3180009ae0 tx=0x7f318001ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dce37326bdafb157 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:25.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.109+0000 7f318effd640 1 -- 172.21.15.78:0/4172438967 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31800a6470 con 0x7f3178003980 2023-12-12T10:13:25.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.109+0000 7f318effd640 1 -- 172.21.15.78:0/4172438967 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31800a65d0 con 0x7f3178003980 2023-12-12T10:13:25.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.109+0000 7f318effd640 1 -- 172.21.15.78:0/4172438967 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31800a6980 con 0x7f3178003980 2023-12-12T10:13:25.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.109+0000 7f3196501640 1 -- 172.21.15.78:0/4172438967 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3178003980 msgr2=0x7f3178003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:25.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.109+0000 7f3196501640 1 --2- 172.21.15.78:0/4172438967 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3178003980 0x7f3178003da0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f3180009ae0 tx=0x7f318001ca60 comp rx=0 tx=0).stop 2023-12-12T10:13:25.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.109+0000 7f3194a9e640 1 -- 172.21.15.78:0/4172438967 reap_dead start 2023-12-12T10:13:25.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.109+0000 7f3196501640 1 -- 172.21.15.78:0/4172438967 shutdown_connections 2023-12-12T10:13:25.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.109+0000 7f3196501640 1 -- 172.21.15.78:0/4172438967 >> 172.21.15.78:0/4172438967 conn(0x7f31900cf480 msgr2=0x7f31900cf890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:25.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.109+0000 7f3196501640 1 -- 172.21.15.78:0/4172438967 shutdown_connections 2023-12-12T10:13:25.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.109+0000 7f3196501640 1 -- 172.21.15.78:0/4172438967 wait complete. 2023-12-12T10:13:25.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.113+0000 7f3196501640 1 Processor -- start 2023-12-12T10:13:25.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.113+0000 7f3196501640 1 -- start start 2023-12-12T10:13:25.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.113+0000 7f3196501640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3178003980 0x7f3190161c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:25.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.113+0000 7f3196501640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f31901426e0 0x7f319013f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:25.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.113+0000 7f3196501640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3190142b60 0x7f319013fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:25.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.113+0000 7f3196501640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3190142410 con 0x7f3190142b60 2023-12-12T10:13:25.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.113+0000 7f3196501640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3190140b60 con 0x7f3178003980 2023-12-12T10:13:25.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.113+0000 7f3196501640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3190140e40 con 0x7f31901426e0 2023-12-12T10:13:25.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.113+0000 7f3194a9e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3190142b60 0x7f319013fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:25.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.113+0000 7f318ffff640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3178003980 0x7f3190161c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:25.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.113+0000 7f3194a9e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3190142b60 0x7f319013fee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50364/0 (socket says 172.21.15.78:50364) 2023-12-12T10:13:25.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.113+0000 7f3194a9e640 1 -- 172.21.15.78:0/700655726 learned_addr learned my addr 172.21.15.78:0/700655726 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:13:25.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.113+0000 7f318f7fe640 1 --2- 172.21.15.78:0/700655726 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f31901426e0 0x7f319013f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:25.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.113+0000 7f3194a9e640 1 -- 172.21.15.78:0/700655726 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f31901426e0 msgr2=0x7f319013f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:25.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.113+0000 7f3194a9e640 1 --2- 172.21.15.78:0/700655726 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f31901426e0 0x7f319013f9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:25.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.113+0000 7f3194a9e640 1 -- 172.21.15.78:0/700655726 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3178003980 msgr2=0x7f3190161c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:25.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.113+0000 7f3194a9e640 1 --2- 172.21.15.78:0/700655726 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3178003980 0x7f3190161c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:25.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.113+0000 7f3194a9e640 1 -- 172.21.15.78:0/700655726 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31900b2e50 con 0x7f3190142b60 2023-12-12T10:13:25.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.113+0000 7f318ffff640 1 --2- 172.21.15.78:0/700655726 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3178003980 0x7f3190161c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-12T10:13:25.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.113+0000 7f3194a9e640 1 --2- 172.21.15.78:0/700655726 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3190142b60 0x7f319013fee0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f3188001340 tx=0x7f318800e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:25.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.113+0000 7f318cff9640 1 -- 172.21.15.78:0/700655726 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f318800eb90 con 0x7f3190142b60 2023-12-12T10:13:25.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.113+0000 7f318cff9640 1 -- 172.21.15.78:0/700655726 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f318800ed10 con 0x7f3190142b60 2023-12-12T10:13:25.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.113+0000 7f3196501640 1 -- 172.21.15.78:0/700655726 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3190141120 con 0x7f3190142b60 2023-12-12T10:13:25.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.113+0000 7f318cff9640 1 -- 172.21.15.78:0/700655726 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3188013660 con 0x7f3190142b60 2023-12-12T10:13:25.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.113+0000 7f3196501640 1 -- 172.21.15.78:0/700655726 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31901416e0 con 0x7f3190142b60 2023-12-12T10:13:25.121 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.113+0000 7f3196501640 1 -- 172.21.15.78:0/700655726 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3190067530 con 0x7f3190142b60 2023-12-12T10:13:25.121 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.117+0000 7f318cff9640 1 -- 172.21.15.78:0/700655726 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f31880137c0 con 0x7f3190142b60 2023-12-12T10:13:25.121 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.117+0000 7f318cff9640 1 --2- 172.21.15.78:0/700655726 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f317c066470 0x7f317c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:25.121 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.117+0000 7f318cff9640 1 -- 172.21.15.78:0/700655726 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f3188083f80 con 0x7f3190142b60 2023-12-12T10:13:25.121 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.117+0000 7f318ffff640 1 --2- 172.21.15.78:0/700655726 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f317c066470 0x7f317c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:25.121 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.117+0000 7f318ffff640 1 --2- 172.21.15.78:0/700655726 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f317c066470 0x7f317c068930 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f31800ad000 tx=0x7f31800b2040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:25.124 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.121+0000 7f318cff9640 1 -- 172.21.15.78:0/700655726 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f31880516b0 con 0x7f3190142b60 2023-12-12T10:13:25.326 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.321+0000 7f3196501640 1 -- 172.21.15.78:0/700655726 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f31900cf260 con 0x7f3190142b60 2023-12-12T10:13:25.327 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.321+0000 7f318cff9640 1 -- 172.21.15.78:0/700655726 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f3188054cd0 con 0x7f3190142b60 2023-12-12T10:13:25.327 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:13:25.327 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2023-12-12T10:13:25.327 INFO:teuthology.orchestra.run.smithi078.stdout: "auth_dump": [ 2023-12-12T10:13:25.327 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-12-12T10:13:25.327 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "mds.a", 2023-12-12T10:13:25.327 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQC9MXhl9jLUEhAApdljSVpok5F0hiRP2zOrHw==", 2023-12-12T10:13:25.327 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-12-12T10:13:25.327 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2023-12-12T10:13:25.327 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow *", 2023-12-12T10:13:25.327 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow *", 2023-12-12T10:13:25.328 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-12-12T10:13:25.328 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-12-12T10:13:25.328 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-12-12T10:13:25.328 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-12-12T10:13:25.328 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "mds.b", 2023-12-12T10:13:25.328 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQC9MXhljP3pHhAA4G39b2V4Ss3HHgiSovCiTg==", 2023-12-12T10:13:25.328 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-12-12T10:13:25.328 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2023-12-12T10:13:25.328 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow *", 2023-12-12T10:13:25.328 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow *", 2023-12-12T10:13:25.328 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-12-12T10:13:25.328 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-12-12T10:13:25.328 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-12-12T10:13:25.329 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-12-12T10:13:25.329 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "mds.c", 2023-12-12T10:13:25.329 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQC9MXhlPncKGhAAqLdE0ZFUkmDYyZjNiHasIg==", 2023-12-12T10:13:25.329 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-12-12T10:13:25.329 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2023-12-12T10:13:25.329 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow *", 2023-12-12T10:13:25.329 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow *", 2023-12-12T10:13:25.329 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-12-12T10:13:25.329 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-12-12T10:13:25.329 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-12-12T10:13:25.329 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-12-12T10:13:25.329 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "mds.d", 2023-12-12T10:13:25.329 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQC9MXhl20VVJhAAzcJ9IWPIA8/OYLC2LSCo0Q==", 2023-12-12T10:13:25.329 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-12-12T10:13:25.330 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2023-12-12T10:13:25.330 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow *", 2023-12-12T10:13:25.330 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow *", 2023-12-12T10:13:25.330 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-12-12T10:13:25.330 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-12-12T10:13:25.330 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-12-12T10:13:25.330 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-12-12T10:13:25.330 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.0", 2023-12-12T10:13:25.330 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDBMXhlx8boBRAAcI7xK/k/mqAZ4v40kgfXpA==", 2023-12-12T10:13:25.330 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-12-12T10:13:25.330 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2023-12-12T10:13:25.330 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2023-12-12T10:13:25.330 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-12-12T10:13:25.330 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-12-12T10:13:25.331 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-12-12T10:13:25.331 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-12-12T10:13:25.331 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.1", 2023-12-12T10:13:25.331 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDEMXhltRBsDRAAf+fuh4ShmFR2ePtiQKdRgw==", 2023-12-12T10:13:25.331 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-12-12T10:13:25.331 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2023-12-12T10:13:25.331 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2023-12-12T10:13:25.331 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-12-12T10:13:25.331 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-12-12T10:13:25.331 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-12-12T10:13:25.331 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-12-12T10:13:25.331 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.2", 2023-12-12T10:13:25.331 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDHMXhlvm7JExAAgHaGX0EjAqZf0WQ/lPsR/g==", 2023-12-12T10:13:25.331 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-12-12T10:13:25.331 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2023-12-12T10:13:25.332 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2023-12-12T10:13:25.332 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-12-12T10:13:25.332 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-12-12T10:13:25.332 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-12-12T10:13:25.332 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-12-12T10:13:25.332 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.3", 2023-12-12T10:13:25.332 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDKMXhlFktwGhAA+1TmvEYdPEKwZ68amhEodg==", 2023-12-12T10:13:25.332 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-12-12T10:13:25.332 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2023-12-12T10:13:25.332 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2023-12-12T10:13:25.332 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-12-12T10:13:25.332 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-12-12T10:13:25.332 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-12-12T10:13:25.332 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-12-12T10:13:25.333 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.4", 2023-12-12T10:13:25.333 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDQMXhlZG3GJRAAhvNGOPLGeX6mMB3t9xEj7w==", 2023-12-12T10:13:25.333 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-12-12T10:13:25.333 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2023-12-12T10:13:25.333 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2023-12-12T10:13:25.333 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-12-12T10:13:25.333 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-12-12T10:13:25.333 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-12-12T10:13:25.333 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-12-12T10:13:25.333 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.5", 2023-12-12T10:13:25.333 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDTMXhlNAFwLBAAmp85VURm5enm2MtSCOUEHg==", 2023-12-12T10:13:25.333 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-12-12T10:13:25.333 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2023-12-12T10:13:25.333 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2023-12-12T10:13:25.334 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-12-12T10:13:25.334 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-12-12T10:13:25.334 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-12-12T10:13:25.334 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-12-12T10:13:25.334 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.6", 2023-12-12T10:13:25.334 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDWMXhlI0aoMxAA/U9uyt/vGAlvtWVVgzf/yg==", 2023-12-12T10:13:25.334 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-12-12T10:13:25.334 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2023-12-12T10:13:25.334 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2023-12-12T10:13:25.334 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-12-12T10:13:25.334 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-12-12T10:13:25.334 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-12-12T10:13:25.334 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-12-12T10:13:25.334 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "osd.7", 2023-12-12T10:13:25.335 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDZMXhlifvzORAAzssIwFAoRndB0Nll7RBmqg==", 2023-12-12T10:13:25.335 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-12-12T10:13:25.335 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow profile osd", 2023-12-12T10:13:25.335 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile osd", 2023-12-12T10:13:25.335 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-12-12T10:13:25.335 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-12-12T10:13:25.335 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-12-12T10:13:25.335 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-12-12T10:13:25.335 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.0", 2023-12-12T10:13:25.336 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQC9MXhlbW+PKhAAckuiPNqUk5U7bz+jhw/xLA==", 2023-12-12T10:13:25.336 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-12-12T10:13:25.336 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2023-12-12T10:13:25.336 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow r", 2023-12-12T10:13:25.336 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow rw", 2023-12-12T10:13:25.336 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow rwx" 2023-12-12T10:13:25.336 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-12-12T10:13:25.336 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-12-12T10:13:25.336 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-12-12T10:13:25.336 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.1", 2023-12-12T10:13:25.336 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQC9MXhlDwRkNBAA3jpUbIHYb/ScB4g37WDdIQ==", 2023-12-12T10:13:25.336 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-12-12T10:13:25.336 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2023-12-12T10:13:25.336 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow r", 2023-12-12T10:13:25.337 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow rw", 2023-12-12T10:13:25.337 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow rwx" 2023-12-12T10:13:25.337 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-12-12T10:13:25.337 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-12-12T10:13:25.337 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-12-12T10:13:25.337 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.2", 2023-12-12T10:13:25.337 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQC9MXhlS0PyMBAAaQhxEPiqOOJUhwLxkad3Rw==", 2023-12-12T10:13:25.337 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-12-12T10:13:25.337 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2023-12-12T10:13:25.337 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow r", 2023-12-12T10:13:25.337 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow rw", 2023-12-12T10:13:25.337 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow rwx" 2023-12-12T10:13:25.337 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-12-12T10:13:25.337 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-12-12T10:13:25.337 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-12-12T10:13:25.338 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.3", 2023-12-12T10:13:25.338 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQC9MXhlxoXFOhAAL4yd3Yg5ZW/LywH2s+qCLQ==", 2023-12-12T10:13:25.338 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-12-12T10:13:25.338 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow", 2023-12-12T10:13:25.338 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow r", 2023-12-12T10:13:25.338 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow rw", 2023-12-12T10:13:25.338 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow rwx" 2023-12-12T10:13:25.338 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-12-12T10:13:25.338 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-12-12T10:13:25.338 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-12-12T10:13:25.338 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.admin", 2023-12-12T10:13:25.338 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQC8MXhlGNj4MRAAyhNfkejCH0AJOmIYX6KUZg==", 2023-12-12T10:13:25.338 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-12-12T10:13:25.338 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow *", 2023-12-12T10:13:25.339 INFO:teuthology.orchestra.run.smithi078.stdout: "mgr": "allow *", 2023-12-12T10:13:25.339 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow *", 2023-12-12T10:13:25.339 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-12-12T10:13:25.339 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-12-12T10:13:25.339 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-12-12T10:13:25.339 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-12-12T10:13:25.339 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.bootstrap-mds", 2023-12-12T10:13:25.339 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDgMXhl97g9ARAA2uBmjGBUkkJjS1o8kkck4w==", 2023-12-12T10:13:25.339 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-12-12T10:13:25.339 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile bootstrap-mds" 2023-12-12T10:13:25.339 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-12-12T10:13:25.339 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-12-12T10:13:25.339 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-12-12T10:13:25.339 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.bootstrap-mgr", 2023-12-12T10:13:25.339 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDgMXhlYsk9ARAAFO2zd2VxnX8g6SKESalzRQ==", 2023-12-12T10:13:25.340 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-12-12T10:13:25.340 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile bootstrap-mgr" 2023-12-12T10:13:25.340 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-12-12T10:13:25.340 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-12-12T10:13:25.340 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-12-12T10:13:25.340 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.bootstrap-osd", 2023-12-12T10:13:25.340 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDgMXhl19U9ARAAq5PESceDh3Ax4k+mZajXwQ==", 2023-12-12T10:13:25.340 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-12-12T10:13:25.340 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile bootstrap-osd" 2023-12-12T10:13:25.340 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-12-12T10:13:25.340 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-12-12T10:13:25.340 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-12-12T10:13:25.340 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.bootstrap-rbd", 2023-12-12T10:13:25.340 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDgMXhlewA+ARAAlnPWqlDQEdrOYutjnHkqKQ==", 2023-12-12T10:13:25.341 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-12-12T10:13:25.341 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile bootstrap-rbd" 2023-12-12T10:13:25.341 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-12-12T10:13:25.341 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-12-12T10:13:25.341 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-12-12T10:13:25.341 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-12-12T10:13:25.341 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDgMXhl9wo+ARAABWOO9KE0abUXxSb7MDdXNA==", 2023-12-12T10:13:25.341 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-12-12T10:13:25.341 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-12-12T10:13:25.341 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-12-12T10:13:25.341 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-12-12T10:13:25.341 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-12-12T10:13:25.341 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "client.bootstrap-rgw", 2023-12-12T10:13:25.341 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQDgMXhlpBM+ARAAiE7vPSvm4uSdMTh3fRIjpQ==", 2023-12-12T10:13:25.342 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-12-12T10:13:25.342 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile bootstrap-rgw" 2023-12-12T10:13:25.342 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-12-12T10:13:25.342 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-12-12T10:13:25.342 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-12-12T10:13:25.342 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "mgr.x", 2023-12-12T10:13:25.342 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQC9MXhl8XMNDhAATAoK79OFyqhqJrtBKqLbvg==", 2023-12-12T10:13:25.342 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-12-12T10:13:25.342 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow *", 2023-12-12T10:13:25.342 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile mgr", 2023-12-12T10:13:25.342 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-12-12T10:13:25.342 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-12-12T10:13:25.342 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-12-12T10:13:25.342 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-12-12T10:13:25.343 INFO:teuthology.orchestra.run.smithi078.stdout: "entity": "mgr.y", 2023-12-12T10:13:25.343 INFO:teuthology.orchestra.run.smithi078.stdout: "key": "AQC9MXhlkyRwChAAs+qyqXewUeMJCk4wb5karA==", 2023-12-12T10:13:25.343 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": { 2023-12-12T10:13:25.343 INFO:teuthology.orchestra.run.smithi078.stdout: "mds": "allow *", 2023-12-12T10:13:25.343 INFO:teuthology.orchestra.run.smithi078.stdout: "mon": "allow profile mgr", 2023-12-12T10:13:25.343 INFO:teuthology.orchestra.run.smithi078.stdout: "osd": "allow *" 2023-12-12T10:13:25.343 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-12-12T10:13:25.343 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-12-12T10:13:25.343 INFO:teuthology.orchestra.run.smithi078.stdout: ] 2023-12-12T10:13:25.343 INFO:teuthology.orchestra.run.smithi078.stdout:} 2023-12-12T10:13:25.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.325+0000 7f3196501640 1 -- 172.21.15.78:0/700655726 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f317c066470 msgr2=0x7f317c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:25.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.325+0000 7f3196501640 1 --2- 172.21.15.78:0/700655726 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f317c066470 0x7f317c068930 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f31800ad000 tx=0x7f31800b2040 comp rx=0 tx=0).stop 2023-12-12T10:13:25.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.325+0000 7f3196501640 1 -- 172.21.15.78:0/700655726 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3190142b60 msgr2=0x7f319013fee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:25.345 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.325+0000 7f3196501640 1 --2- 172.21.15.78:0/700655726 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3190142b60 0x7f319013fee0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f3188001340 tx=0x7f318800e530 comp rx=0 tx=0).stop 2023-12-12T10:13:25.345 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.325+0000 7f3196501640 1 -- 172.21.15.78:0/700655726 shutdown_connections 2023-12-12T10:13:25.345 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.325+0000 7f3196501640 1 --2- 172.21.15.78:0/700655726 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f317c066470 0x7f317c068930 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:25.345 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.325+0000 7f3196501640 1 --2- 172.21.15.78:0/700655726 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3190142b60 0x7f319013fee0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:25.345 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.325+0000 7f3196501640 1 --2- 172.21.15.78:0/700655726 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f31901426e0 0x7f319013f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:25.345 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.325+0000 7f3196501640 1 --2- 172.21.15.78:0/700655726 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3178003980 0x7f3190161c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:25.345 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.325+0000 7f3196501640 1 -- 172.21.15.78:0/700655726 >> 172.21.15.78:0/700655726 conn(0x7f31900cf480 msgr2=0x7f319006cac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:25.345 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.325+0000 7f3196501640 1 -- 172.21.15.78:0/700655726 shutdown_connections 2023-12-12T10:13:25.345 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.325+0000 7f3196501640 1 -- 172.21.15.78:0/700655726 wait complete. 2023-12-12T10:13:25.347 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-12-12T10:13:25.486 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.481+0000 7f260adb8640 1 Processor -- start 2023-12-12T10:13:25.487 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.481+0000 7f260adb8640 1 -- start start 2023-12-12T10:13:25.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.485+0000 7f260adb8640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2604071d40 0x7f2604164fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:25.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.485+0000 7f260adb8640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f26040b3380 0x7f260406cc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:25.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.485+0000 7f260adb8640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2604165940 con 0x7f26041654e0 2023-12-12T10:13:25.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.485+0000 7f260adb8640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2604072120 con 0x7f26040b3380 2023-12-12T10:13:25.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.485+0000 7f260adb8640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26040b39a0 con 0x7f2604071d40 2023-12-12T10:13:25.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.485+0000 7f25fbfff640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f26041654e0 0x7f26040b2c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:38822/0 (socket says 172.21.15.78:38822) 2023-12-12T10:13:25.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.485+0000 7f25fbfff640 1 -- 172.21.15.78:0/3512800607 learned_addr learned my addr 172.21.15.78:0/3512800607 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-12-12T10:13:25.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.485+0000 7f2609355640 1 --2- 172.21.15.78:0/3512800607 >> v2:172.21.15.78:3300/0 conn(0x7f26040b3380 0x7f260406cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:25.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.485+0000 7f2608b54640 1 --2- 172.21.15.78:0/3512800607 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2604071d40 0x7f2604164fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:25.489 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.485+0000 7f2609355640 1 -- 172.21.15.78:0/3512800607 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2604071d40 msgr2=0x7f2604164fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:13:25.489 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.485+0000 7f2609355640 1 --2- 172.21.15.78:0/3512800607 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2604071d40 0x7f2604164fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:25.489 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.485+0000 7f2609355640 1 -- 172.21.15.78:0/3512800607 >> v1:172.21.15.78:6789/0 conn(0x7f26041654e0 legacy=0x7f26040b2c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:25.489 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.485+0000 7f2609355640 1 -- 172.21.15.78:0/3512800607 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26040b3c80 con 0x7f26040b3380 2023-12-12T10:13:25.489 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.485+0000 7f2608b54640 1 --2- 172.21.15.78:0/3512800607 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2604071d40 0x7f2604164fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T10:13:25.491 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.489+0000 7f2609355640 1 --2- 172.21.15.78:0/3512800607 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f26040b3380 0x7f260406cc80 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f25fc009d90 tx=0x7f25fc01c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce50ca1ffacc315e server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:25.492 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.489+0000 7f25fb7fe640 1 -- 172.21.15.78:0/3512800607 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25fc0a59e0 con 0x7f26040b3380 2023-12-12T10:13:25.492 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.489+0000 7f25fb7fe640 1 -- 172.21.15.78:0/3512800607 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25fc0a5b40 con 0x7f26040b3380 2023-12-12T10:13:25.492 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.489+0000 7f25fb7fe640 1 -- 172.21.15.78:0/3512800607 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25fc0ad440 con 0x7f26040b3380 2023-12-12T10:13:25.492 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.489+0000 7f260adb8640 1 -- 172.21.15.78:0/3512800607 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f26040b3380 msgr2=0x7f260406cc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:25.492 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.489+0000 7f260adb8640 1 --2- 172.21.15.78:0/3512800607 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f26040b3380 0x7f260406cc80 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f25fc009d90 tx=0x7f25fc01c920 comp rx=0 tx=0).stop 2023-12-12T10:13:25.493 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.489+0000 7f260adb8640 1 -- 172.21.15.78:0/3512800607 shutdown_connections 2023-12-12T10:13:25.493 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.489+0000 7f260adb8640 1 --2- 172.21.15.78:0/3512800607 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f26040b3380 0x7f260406cc80 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:25.493 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.489+0000 7f260adb8640 1 --2- 172.21.15.78:0/3512800607 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2604071d40 0x7f2604164fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:25.493 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.489+0000 7f260adb8640 1 -- 172.21.15.78:0/3512800607 >> 172.21.15.78:0/3512800607 conn(0x7f260406a710 msgr2=0x7f260406ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:25.493 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.489+0000 7f260adb8640 1 -- 172.21.15.78:0/3512800607 shutdown_connections 2023-12-12T10:13:25.493 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.489+0000 7f260adb8640 1 -- 172.21.15.78:0/3512800607 wait complete. 2023-12-12T10:13:25.494 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.489+0000 7f260adb8640 1 Processor -- start 2023-12-12T10:13:25.494 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.489+0000 7f260adb8640 1 -- start start 2023-12-12T10:13:25.497 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.493+0000 7f260adb8640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2604071d40 0x7f26041575c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:25.497 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.493+0000 7f260adb8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f26040b3380 0x7f2604156050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:25.497 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.493+0000 7f260adb8640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f26041654e0 0x7f26040cd390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:25.497 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.493+0000 7f260adb8640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26041571a0 con 0x7f26040b3380 2023-12-12T10:13:25.497 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.493+0000 7f260adb8640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f260416b260 con 0x7f26041654e0 2023-12-12T10:13:25.497 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.493+0000 7f260adb8640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26040cdb00 con 0x7f2604071d40 2023-12-12T10:13:25.497 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.493+0000 7f25fbfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f26040b3380 0x7f2604156050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:25.498 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.493+0000 7f25fbfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f26040b3380 0x7f2604156050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50390/0 (socket says 172.21.15.78:50390) 2023-12-12T10:13:25.498 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.493+0000 7f25fbfff640 1 -- 172.21.15.78:0/364870438 learned_addr learned my addr 172.21.15.78:0/364870438 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:13:25.498 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.493+0000 7f2608b54640 1 --2- 172.21.15.78:0/364870438 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2604071d40 0x7f26041575c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:25.498 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.493+0000 7f2609355640 1 --2- 172.21.15.78:0/364870438 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f26041654e0 0x7f26040cd390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:25.498 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.493+0000 7f25fbfff640 1 -- 172.21.15.78:0/364870438 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2604071d40 msgr2=0x7f26041575c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:25.498 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.493+0000 7f25fbfff640 1 --2- 172.21.15.78:0/364870438 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2604071d40 0x7f26041575c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:25.498 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.493+0000 7f25fbfff640 1 -- 172.21.15.78:0/364870438 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f26041654e0 msgr2=0x7f26040cd390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:25.498 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.493+0000 7f25fbfff640 1 --2- 172.21.15.78:0/364870438 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f26041654e0 0x7f26040cd390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:25.498 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.493+0000 7f25fbfff640 1 -- 172.21.15.78:0/364870438 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25fc009a70 con 0x7f26040b3380 2023-12-12T10:13:25.498 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.493+0000 7f25fbfff640 1 --2- 172.21.15.78:0/364870438 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f26040b3380 0x7f2604156050 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f25f400c400 tx=0x7f25f400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:25.498 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.493+0000 7f25f97fa640 1 -- 172.21.15.78:0/364870438 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25f4005cf0 con 0x7f26040b3380 2023-12-12T10:13:25.498 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.493+0000 7f25f97fa640 1 -- 172.21.15.78:0/364870438 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25f4005e50 con 0x7f26040b3380 2023-12-12T10:13:25.498 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.493+0000 7f25f97fa640 1 -- 172.21.15.78:0/364870438 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25f40072d0 con 0x7f26040b3380 2023-12-12T10:13:25.499 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.493+0000 7f260adb8640 1 -- 172.21.15.78:0/364870438 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26040cd8d0 con 0x7f26040b3380 2023-12-12T10:13:25.499 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.493+0000 7f260adb8640 1 -- 172.21.15.78:0/364870438 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2604156ae0 con 0x7f26040b3380 2023-12-12T10:13:25.499 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.493+0000 7f260adb8640 1 -- 172.21.15.78:0/364870438 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26040671f0 con 0x7f26040b3380 2023-12-12T10:13:25.499 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.493+0000 7f25f97fa640 1 -- 172.21.15.78:0/364870438 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f25f4007430 con 0x7f26040b3380 2023-12-12T10:13:25.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.497+0000 7f25f97fa640 1 --2- 172.21.15.78:0/364870438 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f25f0066470 0x7f25f0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:25.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.497+0000 7f25f97fa640 1 -- 172.21.15.78:0/364870438 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f25f40831c0 con 0x7f26040b3380 2023-12-12T10:13:25.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.497+0000 7f2608b54640 1 --2- 172.21.15.78:0/364870438 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f25f0066470 0x7f25f0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:25.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.497+0000 7f2608b54640 1 --2- 172.21.15.78:0/364870438 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f25f0066470 0x7f25f0068930 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f26000098b0 tx=0x7f2600008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:25.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.501+0000 7f25f97fa640 1 -- 172.21.15.78:0/364870438 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f25f4050900 con 0x7f26040b3380 2023-12-12T10:13:25.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.721+0000 7f260adb8640 1 -- 172.21.15.78:0/364870438 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f2604067530 con 0x7f26040b3380 2023-12-12T10:13:25.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.725+0000 7f25f97fa640 1 -- 172.21.15.78:0/364870438 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7f25f4053f20 con 0x7f26040b3380 2023-12-12T10:13:25.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.725+0000 7f260adb8640 1 -- 172.21.15.78:0/364870438 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f25f0066470 msgr2=0x7f25f0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:25.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.725+0000 7f260adb8640 1 --2- 172.21.15.78:0/364870438 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f25f0066470 0x7f25f0068930 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f26000098b0 tx=0x7f2600008040 comp rx=0 tx=0).stop 2023-12-12T10:13:25.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.725+0000 7f260adb8640 1 -- 172.21.15.78:0/364870438 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f26040b3380 msgr2=0x7f2604156050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:25.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.725+0000 7f260adb8640 1 --2- 172.21.15.78:0/364870438 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f26040b3380 0x7f2604156050 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f25f400c400 tx=0x7f25f400c8c0 comp rx=0 tx=0).stop 2023-12-12T10:13:25.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.725+0000 7f260adb8640 1 -- 172.21.15.78:0/364870438 shutdown_connections 2023-12-12T10:13:25.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.725+0000 7f260adb8640 1 --2- 172.21.15.78:0/364870438 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f25f0066470 0x7f25f0068930 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:25.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.725+0000 7f260adb8640 1 --2- 172.21.15.78:0/364870438 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f26041654e0 0x7f26040cd390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:25.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.725+0000 7f260adb8640 1 --2- 172.21.15.78:0/364870438 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f26040b3380 0x7f2604156050 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:25.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.725+0000 7f260adb8640 1 --2- 172.21.15.78:0/364870438 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2604071d40 0x7f26041575c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:25.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.725+0000 7f260adb8640 1 -- 172.21.15.78:0/364870438 >> 172.21.15.78:0/364870438 conn(0x7f260406a710 msgr2=0x7f26040afeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:25.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.725+0000 7f260adb8640 1 -- 172.21.15.78:0/364870438 shutdown_connections 2023-12-12T10:13:25.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.725+0000 7f260adb8640 1 -- 172.21.15.78:0/364870438 wait complete. 2023-12-12T10:13:25.749 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-12-12T10:13:25.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.881+0000 7f5c665c4640 1 Processor -- start 2023-12-12T10:13:25.887 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.881+0000 7f5c665c4640 1 -- start start 2023-12-12T10:13:25.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.885+0000 7f5c665c4640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f5c6015baa0 0x7f5c6015f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:25.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.885+0000 7f5c665c4640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c600cea30 con 0x7f5c600cb4b0 2023-12-12T10:13:25.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.885+0000 7f5c665c4640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c6015bfc0 con 0x7f5c6006cf60 2023-12-12T10:13:25.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.885+0000 7f5c665c4640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c6015c2a0 con 0x7f5c6015baa0 2023-12-12T10:13:25.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.885+0000 7f5c5ffff640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f5c600cb4b0 0x7f5c6006c850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:38834/0 (socket says 172.21.15.78:38834) 2023-12-12T10:13:25.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.885+0000 7f5c5ffff640 1 -- 172.21.15.78:0/2392451851 learned_addr learned my addr 172.21.15.78:0/2392451851 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-12-12T10:13:25.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.885+0000 7f5c64b61640 1 --2- 172.21.15.78:0/2392451851 >> v2:172.21.15.187:3300/0 conn(0x7f5c6015baa0 0x7f5c6015f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:25.892 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.885+0000 7f5c5effd640 1 -- 172.21.15.78:0/2392451851 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3707984916 0 0) 0x7f5c600cea30 con 0x7f5c600cb4b0 2023-12-12T10:13:25.892 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.885+0000 7f5c5effd640 1 -- 172.21.15.78:0/2392451851 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5c48003530 con 0x7f5c600cb4b0 2023-12-12T10:13:25.892 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.885+0000 7f5c5effd640 1 -- 172.21.15.78:0/2392451851 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3784561694 0 0) 0x7f5c48003530 con 0x7f5c600cb4b0 2023-12-12T10:13:25.892 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.885+0000 7f5c5effd640 1 -- 172.21.15.78:0/2392451851 >> v2:172.21.15.187:3300/0 conn(0x7f5c6015baa0 msgr2=0x7f5c6015f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:13:25.892 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.885+0000 7f5c5effd640 1 --2- 172.21.15.78:0/2392451851 >> v2:172.21.15.187:3300/0 conn(0x7f5c6015baa0 0x7f5c6015f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:25.892 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.885+0000 7f5c5effd640 1 -- 172.21.15.78:0/2392451851 >> v1:172.21.15.187:6789/0 conn(0x7f5c6006cf60 legacy=0x7f5c6015b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:25.892 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.885+0000 7f5c5effd640 1 -- 172.21.15.78:0/2392451851 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c6015ea20 con 0x7f5c600cb4b0 2023-12-12T10:13:25.892 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.885+0000 7f5c5effd640 1 -- 172.21.15.78:0/2392451851 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 465499599 0 0) 0x7f5c50001680 con 0x7f5c600cb4b0 2023-12-12T10:13:25.892 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.885+0000 7f5c5effd640 1 -- 172.21.15.78:0/2392451851 >> v1:172.21.15.78:6789/0 conn(0x7f5c600cb4b0 legacy=0x7f5c6006c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:25.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.885+0000 7f5c5effd640 1 --2- 172.21.15.78:0/2392451851 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5c48003980 0x7f5c48003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:25.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.885+0000 7f5c5effd640 1 --2- 172.21.15.78:0/2392451851 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5c480047d0 0x7f5c48004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:25.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.885+0000 7f5c5effd640 1 --2- 172.21.15.78:0/2392451851 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5c48005190 0x7f5c4800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:25.895 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.885+0000 7f5c5effd640 1 -- 172.21.15.78:0/2392451851 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c6015c2a0 con 0x7f5c48003980 2023-12-12T10:13:25.895 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.885+0000 7f5c5effd640 1 -- 172.21.15.78:0/2392451851 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c4800c130 con 0x7f5c480047d0 2023-12-12T10:13:25.895 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.885+0000 7f5c5effd640 1 -- 172.21.15.78:0/2392451851 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c4800c2f0 con 0x7f5c48005190 2023-12-12T10:13:25.895 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.885+0000 7f5c5ffff640 1 --2- 172.21.15.78:0/2392451851 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5c48003980 0x7f5c48003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:25.895 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.885+0000 7f5c5f7fe640 1 --2- 172.21.15.78:0/2392451851 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5c480047d0 0x7f5c48004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:25.895 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.885+0000 7f5c64b61640 1 --2- 172.21.15.78:0/2392451851 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5c48005190 0x7f5c4800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:25.895 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.885+0000 7f5c5ffff640 1 -- 172.21.15.78:0/2392451851 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5c48005190 msgr2=0x7f5c4800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:13:25.896 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.885+0000 7f5c5ffff640 1 --2- 172.21.15.78:0/2392451851 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5c48005190 0x7f5c4800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:25.896 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.885+0000 7f5c5ffff640 1 -- 172.21.15.78:0/2392451851 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5c480047d0 msgr2=0x7f5c48004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:13:25.896 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.885+0000 7f5c5ffff640 1 --2- 172.21.15.78:0/2392451851 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5c480047d0 0x7f5c48004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:25.896 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.885+0000 7f5c5ffff640 1 -- 172.21.15.78:0/2392451851 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c48003530 con 0x7f5c48003980 2023-12-12T10:13:25.896 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.885+0000 7f5c64b61640 1 -- 172.21.15.78:0/2392451851 reap_dead start 2023-12-12T10:13:25.898 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.889+0000 7f5c5ffff640 1 --2- 172.21.15.78:0/2392451851 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5c48003980 0x7f5c48003da0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f5c5000c240 tx=0x7f5c5001cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2195be3155d104 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:25.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.889+0000 7f5c5effd640 1 -- 172.21.15.78:0/2392451851 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c50005ae0 con 0x7f5c48003980 2023-12-12T10:13:25.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.889+0000 7f5c5effd640 1 -- 172.21.15.78:0/2392451851 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c50005c40 con 0x7f5c48003980 2023-12-12T10:13:25.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.889+0000 7f5c5effd640 1 -- 172.21.15.78:0/2392451851 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c500a59c0 con 0x7f5c48003980 2023-12-12T10:13:25.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.889+0000 7f5c665c4640 1 -- 172.21.15.78:0/2392451851 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5c48003980 msgr2=0x7f5c48003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:25.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.889+0000 7f5c665c4640 1 --2- 172.21.15.78:0/2392451851 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5c48003980 0x7f5c48003da0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f5c5000c240 tx=0x7f5c5001cb90 comp rx=0 tx=0).stop 2023-12-12T10:13:25.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.889+0000 7f5c665c4640 1 -- 172.21.15.78:0/2392451851 shutdown_connections 2023-12-12T10:13:25.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.889+0000 7f5c665c4640 1 --2- 172.21.15.78:0/2392451851 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5c48003980 0x7f5c48003da0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:25.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.889+0000 7f5c665c4640 1 -- 172.21.15.78:0/2392451851 >> 172.21.15.78:0/2392451851 conn(0x7f5c6006a710 msgr2=0x7f5c6006ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:25.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.889+0000 7f5c665c4640 1 -- 172.21.15.78:0/2392451851 shutdown_connections 2023-12-12T10:13:25.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.889+0000 7f5c665c4640 1 -- 172.21.15.78:0/2392451851 wait complete. 2023-12-12T10:13:25.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.889+0000 7f5c665c4640 1 Processor -- start 2023-12-12T10:13:25.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.893+0000 7f5c665c4640 1 -- start start 2023-12-12T10:13:25.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.893+0000 7f5c665c4640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5c48003980 0x7f5c600c3d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:25.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.893+0000 7f5c665c4640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5c601e7c70 0x7f5c600b2c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:25.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.893+0000 7f5c665c4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5c600b31a0 0x7f5c601406e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:25.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.893+0000 7f5c665c4640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c600b3650 con 0x7f5c600b31a0 2023-12-12T10:13:25.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.893+0000 7f5c665c4640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c600c4370 con 0x7f5c48003980 2023-12-12T10:13:25.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.893+0000 7f5c665c4640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c6013e630 con 0x7f5c601e7c70 2023-12-12T10:13:25.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.893+0000 7f5c64b61640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5c600b31a0 0x7f5c601406e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:25.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.893+0000 7f5c64b61640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5c600b31a0 0x7f5c601406e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50408/0 (socket says 172.21.15.78:50408) 2023-12-12T10:13:25.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.893+0000 7f5c64b61640 1 -- 172.21.15.78:0/2576439177 learned_addr learned my addr 172.21.15.78:0/2576439177 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:13:25.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.893+0000 7f5c5ffff640 1 --2- 172.21.15.78:0/2576439177 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5c48003980 0x7f5c600c3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:25.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.893+0000 7f5c5f7fe640 1 --2- 172.21.15.78:0/2576439177 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5c601e7c70 0x7f5c600b2c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:25.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.893+0000 7f5c64b61640 1 -- 172.21.15.78:0/2576439177 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5c601e7c70 msgr2=0x7f5c600b2c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:25.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.893+0000 7f5c64b61640 1 --2- 172.21.15.78:0/2576439177 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5c601e7c70 0x7f5c600b2c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:25.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.893+0000 7f5c64b61640 1 -- 172.21.15.78:0/2576439177 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5c48003980 msgr2=0x7f5c600c3d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:25.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.893+0000 7f5c64b61640 1 --2- 172.21.15.78:0/2576439177 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5c48003980 0x7f5c600c3d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:25.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.893+0000 7f5c64b61640 1 -- 172.21.15.78:0/2576439177 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c6013e8d0 con 0x7f5c600b31a0 2023-12-12T10:13:25.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.893+0000 7f5c64b61640 1 --2- 172.21.15.78:0/2576439177 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5c600b31a0 0x7f5c601406e0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f5c600cd330 tx=0x7f5c580115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:25.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.893+0000 7f5c5cff9640 1 -- 172.21.15.78:0/2576439177 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c5800e070 con 0x7f5c600b31a0 2023-12-12T10:13:25.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.893+0000 7f5c5cff9640 1 -- 172.21.15.78:0/2576439177 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c58011de0 con 0x7f5c600b31a0 2023-12-12T10:13:25.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.893+0000 7f5c665c4640 1 -- 172.21.15.78:0/2576439177 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c6013ebb0 con 0x7f5c600b31a0 2023-12-12T10:13:25.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.893+0000 7f5c5cff9640 1 -- 172.21.15.78:0/2576439177 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c580039a0 con 0x7f5c600b31a0 2023-12-12T10:13:25.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.893+0000 7f5c665c4640 1 -- 172.21.15.78:0/2576439177 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c60140c20 con 0x7f5c600b31a0 2023-12-12T10:13:25.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.893+0000 7f5c665c4640 1 -- 172.21.15.78:0/2576439177 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c600671f0 con 0x7f5c600b31a0 2023-12-12T10:13:25.903 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.897+0000 7f5c5cff9640 1 -- 172.21.15.78:0/2576439177 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5c58003b00 con 0x7f5c600b31a0 2023-12-12T10:13:25.903 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.897+0000 7f5c5cff9640 1 --2- 172.21.15.78:0/2576439177 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f5c4c066470 0x7f5c4c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:25.903 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.897+0000 7f5c5cff9640 1 -- 172.21.15.78:0/2576439177 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f5c58084360 con 0x7f5c600b31a0 2023-12-12T10:13:25.903 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.897+0000 7f5c5ffff640 1 --2- 172.21.15.78:0/2576439177 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f5c4c066470 0x7f5c4c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:25.904 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.897+0000 7f5c5ffff640 1 --2- 172.21.15.78:0/2576439177 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f5c4c066470 0x7f5c4c068930 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f5c500ab000 tx=0x7f5c500b1040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:25.904 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:25.901+0000 7f5c5cff9640 1 -- 172.21.15.78:0/2576439177 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5c580519f0 con 0x7f5c600b31a0 2023-12-12T10:13:26.109 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.105+0000 7f5c665c4640 1 -- 172.21.15.78:0/2576439177 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f5c60067530 con 0x7f5c600b31a0 2023-12-12T10:13:26.111 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.109+0000 7f5c5cff9640 1 -- 172.21.15.78:0/2576439177 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7f5c58055010 con 0x7f5c600b31a0 2023-12-12T10:13:26.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.109+0000 7f5c665c4640 1 -- 172.21.15.78:0/2576439177 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f5c4c066470 msgr2=0x7f5c4c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:26.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.109+0000 7f5c665c4640 1 --2- 172.21.15.78:0/2576439177 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f5c4c066470 0x7f5c4c068930 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f5c500ab000 tx=0x7f5c500b1040 comp rx=0 tx=0).stop 2023-12-12T10:13:26.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.109+0000 7f5c665c4640 1 -- 172.21.15.78:0/2576439177 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5c600b31a0 msgr2=0x7f5c601406e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:26.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.109+0000 7f5c665c4640 1 --2- 172.21.15.78:0/2576439177 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5c600b31a0 0x7f5c601406e0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f5c600cd330 tx=0x7f5c580115a0 comp rx=0 tx=0).stop 2023-12-12T10:13:26.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.109+0000 7f5c665c4640 1 -- 172.21.15.78:0/2576439177 shutdown_connections 2023-12-12T10:13:26.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.109+0000 7f5c665c4640 1 --2- 172.21.15.78:0/2576439177 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f5c4c066470 0x7f5c4c068930 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:26.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.109+0000 7f5c665c4640 1 --2- 172.21.15.78:0/2576439177 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5c600b31a0 0x7f5c601406e0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:26.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.109+0000 7f5c665c4640 1 --2- 172.21.15.78:0/2576439177 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5c601e7c70 0x7f5c600b2c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:26.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.109+0000 7f5c665c4640 1 --2- 172.21.15.78:0/2576439177 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5c48003980 0x7f5c600c3d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:26.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.109+0000 7f5c665c4640 1 -- 172.21.15.78:0/2576439177 >> 172.21.15.78:0/2576439177 conn(0x7f5c6006a710 msgr2=0x7f5c6015c680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:26.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.109+0000 7f5c665c4640 1 -- 172.21.15.78:0/2576439177 shutdown_connections 2023-12-12T10:13:26.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.109+0000 7f5c665c4640 1 -- 172.21.15.78:0/2576439177 wait complete. 2023-12-12T10:13:26.133 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-12-12T10:13:26.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.269+0000 7f2c4f501640 1 Processor -- start 2023-12-12T10:13:26.272 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.269+0000 7f2c4f501640 1 -- start start 2023-12-12T10:13:26.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.269+0000 7f2c4f501640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2c4806dc90 0x7f2c480b3380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:26.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.269+0000 7f2c4f501640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c480b39a0 con 0x7f2c481656b0 2023-12-12T10:13:26.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.269+0000 7f2c4f501640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c480b3c80 con 0x7f2c48071d40 2023-12-12T10:13:26.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.269+0000 7f2c4f501640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c48072120 con 0x7f2c4806dc90 2023-12-12T10:13:26.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.269+0000 7f2c4ca9c640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f2c481656b0 0x7f2c480b2c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:38836/0 (socket says 172.21.15.78:38836) 2023-12-12T10:13:26.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.269+0000 7f2c4ca9c640 1 -- 172.21.15.78:0/2851750753 learned_addr learned my addr 172.21.15.78:0/2851750753 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-12-12T10:13:26.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.269+0000 7f2c4da9e640 1 --2- 172.21.15.78:0/2851750753 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2c4806dc90 0x7f2c480b3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:26.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.269+0000 7f2c3ffff640 1 -- 172.21.15.78:0/2851750753 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1038024903 0 0) 0x7f2c480b39a0 con 0x7f2c481656b0 2023-12-12T10:13:26.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.269+0000 7f2c3ffff640 1 -- 172.21.15.78:0/2851750753 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c34003530 con 0x7f2c481656b0 2023-12-12T10:13:26.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.269+0000 7f2c3ffff640 1 -- 172.21.15.78:0/2851750753 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 310105787 0 0) 0x7f2c480b3c80 con 0x7f2c48071d40 2023-12-12T10:13:26.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.269+0000 7f2c3ffff640 1 -- 172.21.15.78:0/2851750753 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c480b39a0 con 0x7f2c48071d40 2023-12-12T10:13:26.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.269+0000 7f2c4da9e640 1 -- 172.21.15.78:0/2851750753 >> v1:172.21.15.187:6789/0 conn(0x7f2c48071d40 legacy=0x7f2c48164fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:26.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.269+0000 7f2c4da9e640 1 -- 172.21.15.78:0/2851750753 >> v1:172.21.15.78:6789/0 conn(0x7f2c481656b0 legacy=0x7f2c480b2c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:26.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.269+0000 7f2c4da9e640 1 -- 172.21.15.78:0/2851750753 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c480b3f60 con 0x7f2c4806dc90 2023-12-12T10:13:26.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.273+0000 7f2c4da9e640 1 --2- 172.21.15.78:0/2851750753 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2c4806dc90 0x7f2c480b3380 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2c40009dc0 tx=0x7f2c4001c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d6901e5a4534823d server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:26.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.273+0000 7f2c3ffff640 1 -- 172.21.15.78:0/2851750753 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c400a5a00 con 0x7f2c4806dc90 2023-12-12T10:13:26.277 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.273+0000 7f2c3ffff640 1 -- 172.21.15.78:0/2851750753 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c400a5b60 con 0x7f2c4806dc90 2023-12-12T10:13:26.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.273+0000 7f2c3ffff640 1 -- 172.21.15.78:0/2851750753 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c400ad440 con 0x7f2c4806dc90 2023-12-12T10:13:26.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.273+0000 7f2c4f501640 1 -- 172.21.15.78:0/2851750753 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2c4806dc90 msgr2=0x7f2c480b3380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:26.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.273+0000 7f2c4f501640 1 --2- 172.21.15.78:0/2851750753 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2c4806dc90 0x7f2c480b3380 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2c40009dc0 tx=0x7f2c4001c940 comp rx=0 tx=0).stop 2023-12-12T10:13:26.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.273+0000 7f2c4f501640 1 -- 172.21.15.78:0/2851750753 shutdown_connections 2023-12-12T10:13:26.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.273+0000 7f2c4f501640 1 --2- 172.21.15.78:0/2851750753 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2c4806dc90 0x7f2c480b3380 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:26.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.273+0000 7f2c4f501640 1 -- 172.21.15.78:0/2851750753 >> 172.21.15.78:0/2851750753 conn(0x7f2c4806a710 msgr2=0x7f2c4806ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:26.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.273+0000 7f2c4f501640 1 -- 172.21.15.78:0/2851750753 shutdown_connections 2023-12-12T10:13:26.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.273+0000 7f2c4f501640 1 -- 172.21.15.78:0/2851750753 wait complete. 2023-12-12T10:13:26.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.277+0000 7f2c4f501640 1 Processor -- start 2023-12-12T10:13:26.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.277+0000 7f2c4f501640 1 -- start start 2023-12-12T10:13:26.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.277+0000 7f2c4f501640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2c4806dc90 0x7f2c48141c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:26.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.277+0000 7f2c4f501640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2c48071d40 0x7f2c48070580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:26.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.277+0000 7f2c4f501640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2c481656b0 0x7f2c480aefb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:26.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.277+0000 7f2c4f501640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c480cd220 con 0x7f2c4806dc90 2023-12-12T10:13:26.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.277+0000 7f2c4f501640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c4816b0b0 con 0x7f2c481656b0 2023-12-12T10:13:26.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.277+0000 7f2c4f501640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c480cc8f0 con 0x7f2c48071d40 2023-12-12T10:13:26.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.277+0000 7f2c4d29d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2c4806dc90 0x7f2c48141c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:26.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.277+0000 7f2c4d29d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2c4806dc90 0x7f2c48141c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50414/0 (socket says 172.21.15.78:50414) 2023-12-12T10:13:26.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.277+0000 7f2c4d29d640 1 -- 172.21.15.78:0/3161900788 learned_addr learned my addr 172.21.15.78:0/3161900788 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:13:26.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.277+0000 7f2c4da9e640 1 --2- 172.21.15.78:0/3161900788 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2c481656b0 0x7f2c480aefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:26.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.277+0000 7f2c4ca9c640 1 --2- 172.21.15.78:0/3161900788 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2c48071d40 0x7f2c48070580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:26.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.277+0000 7f2c4d29d640 1 -- 172.21.15.78:0/3161900788 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2c48071d40 msgr2=0x7f2c48070580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:26.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.277+0000 7f2c4d29d640 1 --2- 172.21.15.78:0/3161900788 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2c48071d40 0x7f2c48070580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:26.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.277+0000 7f2c4d29d640 1 -- 172.21.15.78:0/3161900788 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2c481656b0 msgr2=0x7f2c480aefb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:26.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.277+0000 7f2c4d29d640 1 --2- 172.21.15.78:0/3161900788 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2c481656b0 0x7f2c480aefb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:26.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.277+0000 7f2c4d29d640 1 -- 172.21.15.78:0/3161900788 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c40009a70 con 0x7f2c4806dc90 2023-12-12T10:13:26.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.277+0000 7f2c4d29d640 1 --2- 172.21.15.78:0/3161900788 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2c4806dc90 0x7f2c48141c90 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f2c4400c490 tx=0x7f2c4400c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:26.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.277+0000 7f2c3dffb640 1 -- 172.21.15.78:0/3161900788 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c440052d0 con 0x7f2c4806dc90 2023-12-12T10:13:26.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.277+0000 7f2c3dffb640 1 -- 172.21.15.78:0/3161900788 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c44005430 con 0x7f2c4806dc90 2023-12-12T10:13:26.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.277+0000 7f2c3dffb640 1 -- 172.21.15.78:0/3161900788 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c44012870 con 0x7f2c4806dc90 2023-12-12T10:13:26.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.277+0000 7f2c4f501640 1 -- 172.21.15.78:0/3161900788 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c480ccbd0 con 0x7f2c4806dc90 2023-12-12T10:13:26.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.277+0000 7f2c4f501640 1 -- 172.21.15.78:0/3161900788 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c48154a90 con 0x7f2c4806dc90 2023-12-12T10:13:26.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.281+0000 7f2c4f501640 1 -- 172.21.15.78:0/3161900788 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c480671f0 con 0x7f2c4806dc90 2023-12-12T10:13:26.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.281+0000 7f2c3dffb640 1 -- 172.21.15.78:0/3161900788 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2c440129d0 con 0x7f2c4806dc90 2023-12-12T10:13:26.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.281+0000 7f2c3dffb640 1 --2- 172.21.15.78:0/3161900788 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f2c2c066470 0x7f2c2c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:26.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.281+0000 7f2c3dffb640 1 -- 172.21.15.78:0/3161900788 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f2c440836e0 con 0x7f2c4806dc90 2023-12-12T10:13:26.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.281+0000 7f2c4ca9c640 1 --2- 172.21.15.78:0/3161900788 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f2c2c066470 0x7f2c2c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:26.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.281+0000 7f2c4ca9c640 1 --2- 172.21.15.78:0/3161900788 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f2c2c066470 0x7f2c2c068930 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f2c480b27c0 tx=0x7f2c38007d40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:26.289 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.285+0000 7f2c3dffb640 1 -- 172.21.15.78:0/3161900788 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2c440548b0 con 0x7f2c4806dc90 2023-12-12T10:13:26.491 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.485+0000 7f2c4f501640 1 -- 172.21.15.78:0/3161900788 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f2c48067530 con 0x7f2c4806dc90 2023-12-12T10:13:26.494 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.489+0000 7f2c3dffb640 1 -- 172.21.15.78:0/3161900788 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7f2c44054440 con 0x7f2c4806dc90 2023-12-12T10:13:26.496 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.493+0000 7f2c4f501640 1 -- 172.21.15.78:0/3161900788 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f2c2c066470 msgr2=0x7f2c2c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:26.496 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.493+0000 7f2c4f501640 1 --2- 172.21.15.78:0/3161900788 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f2c2c066470 0x7f2c2c068930 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f2c480b27c0 tx=0x7f2c38007d40 comp rx=0 tx=0).stop 2023-12-12T10:13:26.496 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.493+0000 7f2c4f501640 1 -- 172.21.15.78:0/3161900788 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2c4806dc90 msgr2=0x7f2c48141c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:26.496 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.493+0000 7f2c4f501640 1 --2- 172.21.15.78:0/3161900788 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2c4806dc90 0x7f2c48141c90 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f2c4400c490 tx=0x7f2c4400c950 comp rx=0 tx=0).stop 2023-12-12T10:13:26.497 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.493+0000 7f2c4f501640 1 -- 172.21.15.78:0/3161900788 shutdown_connections 2023-12-12T10:13:26.497 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.493+0000 7f2c4f501640 1 --2- 172.21.15.78:0/3161900788 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f2c2c066470 0x7f2c2c068930 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:26.497 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.493+0000 7f2c4f501640 1 --2- 172.21.15.78:0/3161900788 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2c481656b0 0x7f2c480aefb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:26.497 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.493+0000 7f2c4f501640 1 --2- 172.21.15.78:0/3161900788 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2c48071d40 0x7f2c48070580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:26.497 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.493+0000 7f2c4f501640 1 --2- 172.21.15.78:0/3161900788 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2c4806dc90 0x7f2c48141c90 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:26.497 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.493+0000 7f2c4f501640 1 -- 172.21.15.78:0/3161900788 >> 172.21.15.78:0/3161900788 conn(0x7f2c4806a710 msgr2=0x7f2c4806aaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:26.497 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.493+0000 7f2c4f501640 1 -- 172.21.15.78:0/3161900788 shutdown_connections 2023-12-12T10:13:26.497 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.493+0000 7f2c4f501640 1 -- 172.21.15.78:0/3161900788 wait complete. 2023-12-12T10:13:26.515 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-12-12T10:13:26.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.649+0000 7ff99a9df640 1 Processor -- start 2023-12-12T10:13:26.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.649+0000 7ff99a9df640 1 -- start start 2023-12-12T10:13:26.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.649+0000 7ff99a9df640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7ff994160890 0x7ff9940b5e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:26.660 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.649+0000 7ff99a9df640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9940d04f0 con 0x7ff9940d0be0 2023-12-12T10:13:26.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.649+0000 7ff99a9df640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9940b63a0 con 0x7ff9940d1ce0 2023-12-12T10:13:26.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.649+0000 7ff99a9df640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9940cdc20 con 0x7ff994160890 2023-12-12T10:13:26.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.649+0000 7ff9937fe640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7ff9940d0be0 0x7ff9940d15d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:38846/0 (socket says 172.21.15.78:38846) 2023-12-12T10:13:26.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.649+0000 7ff9937fe640 1 -- 172.21.15.78:0/391574716 learned_addr learned my addr 172.21.15.78:0/391574716 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-12-12T10:13:26.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.649+0000 7ff992ffd640 1 -- 172.21.15.78:0/391574716 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2532650894 0 0) 0x7ff988001120 con 0x7ff9940d0be0 2023-12-12T10:13:26.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.649+0000 7ff992ffd640 1 -- 172.21.15.78:0/391574716 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff97c003530 con 0x7ff9940d0be0 2023-12-12T10:13:26.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.649+0000 7ff993fff640 1 --2- 172.21.15.78:0/391574716 >> v2:172.21.15.187:3300/0 conn(0x7ff994160890 0x7ff9940b5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:26.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.649+0000 7ff992ffd640 1 -- 172.21.15.78:0/391574716 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2572861403 0 0) 0x7ff97c003530 con 0x7ff9940d0be0 2023-12-12T10:13:26.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.649+0000 7ff992ffd640 1 -- 172.21.15.78:0/391574716 >> v2:172.21.15.187:3300/0 conn(0x7ff994160890 msgr2=0x7ff9940b5e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:13:26.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.649+0000 7ff992ffd640 1 --2- 172.21.15.78:0/391574716 >> v2:172.21.15.187:3300/0 conn(0x7ff994160890 0x7ff9940b5e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:26.662 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.649+0000 7ff992ffd640 1 -- 172.21.15.78:0/391574716 >> v1:172.21.15.187:6789/0 conn(0x7ff9940d1ce0 legacy=0x7ff9940ce3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:26.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.649+0000 7ff992ffd640 1 -- 172.21.15.78:0/391574716 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9940cfc50 con 0x7ff9940d0be0 2023-12-12T10:13:26.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.649+0000 7ff992ffd640 1 -- 172.21.15.78:0/391574716 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 465499599 0 0) 0x7ff988001810 con 0x7ff9940d0be0 2023-12-12T10:13:26.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.649+0000 7ff992ffd640 1 -- 172.21.15.78:0/391574716 >> v1:172.21.15.78:6789/0 conn(0x7ff9940d0be0 legacy=0x7ff9940d15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:26.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.649+0000 7ff992ffd640 1 --2- 172.21.15.78:0/391574716 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff97c003980 0x7ff97c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:26.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.649+0000 7ff992ffd640 1 --2- 172.21.15.78:0/391574716 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff97c0047d0 0x7ff97c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:26.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.649+0000 7ff992ffd640 1 --2- 172.21.15.78:0/391574716 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff97c005190 0x7ff97c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:26.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.653+0000 7ff992ffd640 1 -- 172.21.15.78:0/391574716 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9940cdc20 con 0x7ff97c0047d0 2023-12-12T10:13:26.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.653+0000 7ff992ffd640 1 -- 172.21.15.78:0/391574716 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff97c00c0e0 con 0x7ff97c005190 2023-12-12T10:13:26.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.653+0000 7ff992ffd640 1 -- 172.21.15.78:0/391574716 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff97c00c2a0 con 0x7ff97c003980 2023-12-12T10:13:26.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.653+0000 7ff9937fe640 1 --2- 172.21.15.78:0/391574716 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff97c0047d0 0x7ff97c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:26.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.653+0000 7ff993fff640 1 --2- 172.21.15.78:0/391574716 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff97c003980 0x7ff97c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:26.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.653+0000 7ff998f7c640 1 --2- 172.21.15.78:0/391574716 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff97c005190 0x7ff97c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:26.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.653+0000 7ff9937fe640 1 -- 172.21.15.78:0/391574716 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff97c003980 msgr2=0x7ff97c003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:13:26.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.653+0000 7ff9937fe640 1 --2- 172.21.15.78:0/391574716 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff97c003980 0x7ff97c003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:26.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.653+0000 7ff9937fe640 1 -- 172.21.15.78:0/391574716 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff97c005190 msgr2=0x7ff97c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:13:26.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.653+0000 7ff9937fe640 1 --2- 172.21.15.78:0/391574716 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff97c005190 0x7ff97c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:26.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.653+0000 7ff9937fe640 1 -- 172.21.15.78:0/391574716 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff97c003530 con 0x7ff97c0047d0 2023-12-12T10:13:26.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.653+0000 7ff998f7c640 1 --2- 172.21.15.78:0/391574716 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff97c005190 0x7ff97c00b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T10:13:26.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.653+0000 7ff998f7c640 1 -- 172.21.15.78:0/391574716 reap_dead start 2023-12-12T10:13:26.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.653+0000 7ff9937fe640 1 --2- 172.21.15.78:0/391574716 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff97c0047d0 0x7ff97c004c50 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7ff98800c240 tx=0x7ff98801f3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d39d226e140da759 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:26.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.653+0000 7ff992ffd640 1 -- 172.21.15.78:0/391574716 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff988005ae0 con 0x7ff97c0047d0 2023-12-12T10:13:26.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.653+0000 7ff992ffd640 1 -- 172.21.15.78:0/391574716 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9880ab070 con 0x7ff97c0047d0 2023-12-12T10:13:26.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.653+0000 7ff992ffd640 1 -- 172.21.15.78:0/391574716 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff988007070 con 0x7ff97c0047d0 2023-12-12T10:13:26.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.657+0000 7ff99a9df640 1 -- 172.21.15.78:0/391574716 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff97c0047d0 msgr2=0x7ff97c004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:26.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.657+0000 7ff99a9df640 1 --2- 172.21.15.78:0/391574716 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff97c0047d0 0x7ff97c004c50 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7ff98800c240 tx=0x7ff98801f3b0 comp rx=0 tx=0).stop 2023-12-12T10:13:26.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.657+0000 7ff99a9df640 1 -- 172.21.15.78:0/391574716 shutdown_connections 2023-12-12T10:13:26.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.657+0000 7ff99a9df640 1 --2- 172.21.15.78:0/391574716 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff97c0047d0 0x7ff97c004c50 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:26.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.657+0000 7ff99a9df640 1 -- 172.21.15.78:0/391574716 >> 172.21.15.78:0/391574716 conn(0x7ff99409c2f0 msgr2=0x7ff9940d3010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:26.667 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.657+0000 7ff99a9df640 1 -- 172.21.15.78:0/391574716 shutdown_connections 2023-12-12T10:13:26.668 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.657+0000 7ff99a9df640 1 -- 172.21.15.78:0/391574716 wait complete. 2023-12-12T10:13:26.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.657+0000 7ff99a9df640 1 Processor -- start 2023-12-12T10:13:26.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.657+0000 7ff99a9df640 1 -- start start 2023-12-12T10:13:26.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.657+0000 7ff99a9df640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff97c0047d0 0x7ff9940b8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:26.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.657+0000 7ff99a9df640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9940c89f0 0x7ff99414d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:26.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.657+0000 7ff99a9df640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff9940c8e70 0x7ff99414d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:26.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.657+0000 7ff99a9df640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9940ca4a0 con 0x7ff9940c89f0 2023-12-12T10:13:26.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.657+0000 7ff99a9df640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9940ca780 con 0x7ff9940c8e70 2023-12-12T10:13:26.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.657+0000 7ff99a9df640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9940caa60 con 0x7ff97c0047d0 2023-12-12T10:13:26.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.657+0000 7ff9937fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9940c89f0 0x7ff99414d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:26.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.657+0000 7ff9937fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9940c89f0 0x7ff99414d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50436/0 (socket says 172.21.15.78:50436) 2023-12-12T10:13:26.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.657+0000 7ff9937fe640 1 -- 172.21.15.78:0/4011787492 learned_addr learned my addr 172.21.15.78:0/4011787492 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:13:26.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.661+0000 7ff993fff640 1 --2- 172.21.15.78:0/4011787492 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff97c0047d0 0x7ff9940b8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:26.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.661+0000 7ff998f7c640 1 --2- 172.21.15.78:0/4011787492 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff9940c8e70 0x7ff99414d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:26.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.661+0000 7ff9937fe640 1 -- 172.21.15.78:0/4011787492 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff97c0047d0 msgr2=0x7ff9940b8040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:26.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.661+0000 7ff9937fe640 1 --2- 172.21.15.78:0/4011787492 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff97c0047d0 0x7ff9940b8040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:26.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.661+0000 7ff9937fe640 1 -- 172.21.15.78:0/4011787492 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff9940c8e70 msgr2=0x7ff99414d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:26.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.661+0000 7ff9937fe640 1 --2- 172.21.15.78:0/4011787492 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff9940c8e70 0x7ff99414d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:26.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.661+0000 7ff9937fe640 1 -- 172.21.15.78:0/4011787492 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9940cad40 con 0x7ff9940c89f0 2023-12-12T10:13:26.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.661+0000 7ff998f7c640 1 --2- 172.21.15.78:0/4011787492 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff9940c8e70 0x7ff99414d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T10:13:26.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.661+0000 7ff9937fe640 1 --2- 172.21.15.78:0/4011787492 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9940c89f0 0x7ff99414d040 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7ff988001ad0 tx=0x7ff97c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:26.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.661+0000 7ff990ff9640 1 -- 172.21.15.78:0/4011787492 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff988001610 con 0x7ff9940c89f0 2023-12-12T10:13:26.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.661+0000 7ff990ff9640 1 -- 172.21.15.78:0/4011787492 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff988001770 con 0x7ff9940c89f0 2023-12-12T10:13:26.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.661+0000 7ff99a9df640 1 -- 172.21.15.78:0/4011787492 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9940cb020 con 0x7ff9940c89f0 2023-12-12T10:13:26.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.661+0000 7ff990ff9640 1 -- 172.21.15.78:0/4011787492 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff988007290 con 0x7ff9940c89f0 2023-12-12T10:13:26.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.661+0000 7ff99a9df640 1 -- 172.21.15.78:0/4011787492 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9940cb540 con 0x7ff9940c89f0 2023-12-12T10:13:26.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.661+0000 7ff99a9df640 1 -- 172.21.15.78:0/4011787492 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9940cb1b0 con 0x7ff9940c89f0 2023-12-12T10:13:26.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.661+0000 7ff990ff9640 1 -- 172.21.15.78:0/4011787492 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff9880b9030 con 0x7ff9940c89f0 2023-12-12T10:13:26.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.661+0000 7ff990ff9640 1 --2- 172.21.15.78:0/4011787492 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7ff9800664a0 0x7ff980068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:26.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.661+0000 7ff990ff9640 1 -- 172.21.15.78:0/4011787492 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7ff9880b7070 con 0x7ff9940c89f0 2023-12-12T10:13:26.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.661+0000 7ff993fff640 1 --2- 172.21.15.78:0/4011787492 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7ff9800664a0 0x7ff980068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:26.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.665+0000 7ff993fff640 1 --2- 172.21.15.78:0/4011787492 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7ff9800664a0 0x7ff980068960 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7ff994069bd0 tx=0x7ff984008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:26.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.665+0000 7ff990ff9640 1 -- 172.21.15.78:0/4011787492 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff9880ee010 con 0x7ff9940c89f0 2023-12-12T10:13:26.873 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.869+0000 7ff99a9df640 1 -- 172.21.15.78:0/4011787492 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7ff994067530 con 0x7ff9940c89f0 2023-12-12T10:13:26.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.873+0000 7ff990ff9640 1 -- 172.21.15.78:0/4011787492 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7ff9880c10a0 con 0x7ff9940c89f0 2023-12-12T10:13:26.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.877+0000 7ff99a9df640 1 -- 172.21.15.78:0/4011787492 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7ff9800664a0 msgr2=0x7ff980068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:26.880 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.877+0000 7ff99a9df640 1 --2- 172.21.15.78:0/4011787492 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7ff9800664a0 0x7ff980068960 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7ff994069bd0 tx=0x7ff984008040 comp rx=0 tx=0).stop 2023-12-12T10:13:26.881 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.877+0000 7ff99a9df640 1 -- 172.21.15.78:0/4011787492 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9940c89f0 msgr2=0x7ff99414d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:26.881 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.877+0000 7ff99a9df640 1 --2- 172.21.15.78:0/4011787492 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9940c89f0 0x7ff99414d040 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7ff988001ad0 tx=0x7ff97c005800 comp rx=0 tx=0).stop 2023-12-12T10:13:26.881 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.877+0000 7ff99a9df640 1 -- 172.21.15.78:0/4011787492 shutdown_connections 2023-12-12T10:13:26.881 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.877+0000 7ff99a9df640 1 --2- 172.21.15.78:0/4011787492 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7ff9800664a0 0x7ff980068960 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:26.881 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.877+0000 7ff99a9df640 1 --2- 172.21.15.78:0/4011787492 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff9940c8e70 0x7ff99414d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:26.881 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.877+0000 7ff99a9df640 1 --2- 172.21.15.78:0/4011787492 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff9940c89f0 0x7ff99414d040 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:26.881 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.877+0000 7ff99a9df640 1 --2- 172.21.15.78:0/4011787492 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff97c0047d0 0x7ff9940b8040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:26.881 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.877+0000 7ff99a9df640 1 -- 172.21.15.78:0/4011787492 >> 172.21.15.78:0/4011787492 conn(0x7ff99409c2f0 msgr2=0x7ff99406b030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:26.881 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.877+0000 7ff99a9df640 1 -- 172.21.15.78:0/4011787492 shutdown_connections 2023-12-12T10:13:26.881 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:26.877+0000 7ff99a9df640 1 -- 172.21.15.78:0/4011787492 wait complete. 2023-12-12T10:13:26.899 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-12-12T10:13:27.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.033+0000 7fb328f0f640 1 Processor -- start 2023-12-12T10:13:27.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.033+0000 7fb328f0f640 1 -- start start 2023-12-12T10:13:27.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.037+0000 7fb328f0f640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fb3240d1ce0 0x7fb3240d1040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:27.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.037+0000 7fb328f0f640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3240d04f0 con 0x7fb3240d0be0 2023-12-12T10:13:27.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.037+0000 7fb328f0f640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3240cdc20 con 0x7fb324160890 2023-12-12T10:13:27.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.037+0000 7fb328f0f640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3240cfc50 con 0x7fb3240d1ce0 2023-12-12T10:13:27.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.037+0000 7fb319d9b640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fb3240d0be0 0x7fb3240d15d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:38850/0 (socket says 172.21.15.78:38850) 2023-12-12T10:13:27.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.037+0000 7fb319d9b640 1 -- 172.21.15.78:0/3115641369 learned_addr learned my addr 172.21.15.78:0/3115641369 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-12-12T10:13:27.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.037+0000 7fb322d9d640 1 --2- 172.21.15.78:0/3115641369 >> v2:172.21.15.187:3300/0 conn(0x7fb3240d1ce0 0x7fb3240d1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:27.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.037+0000 7fb321d9b640 1 -- 172.21.15.78:0/3115641369 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1454877695 0 0) 0x7fb30c001120 con 0x7fb3240d0be0 2023-12-12T10:13:27.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.037+0000 7fb321d9b640 1 -- 172.21.15.78:0/3115641369 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb310003530 con 0x7fb3240d0be0 2023-12-12T10:13:27.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.037+0000 7fb321d9b640 1 -- 172.21.15.78:0/3115641369 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1191832184 0 0) 0x7fb3240cdc20 con 0x7fb324160890 2023-12-12T10:13:27.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.037+0000 7fb321d9b640 1 -- 172.21.15.78:0/3115641369 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb30c001120 con 0x7fb324160890 2023-12-12T10:13:27.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.037+0000 7fb322d9d640 1 -- 172.21.15.78:0/3115641369 >> v1:172.21.15.187:6789/0 conn(0x7fb324160890 legacy=0x7fb3240b5e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:27.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.037+0000 7fb322d9d640 1 -- 172.21.15.78:0/3115641369 >> v1:172.21.15.78:6789/0 conn(0x7fb3240d0be0 legacy=0x7fb3240d15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:27.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.037+0000 7fb322d9d640 1 -- 172.21.15.78:0/3115641369 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3240cff30 con 0x7fb3240d1ce0 2023-12-12T10:13:27.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.041+0000 7fb322d9d640 1 --2- 172.21.15.78:0/3115641369 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb3240d1ce0 0x7fb3240d1040 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fb31c009d90 tx=0x7fb31c01c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=43c31513ea2e5e3d server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:27.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.041+0000 7fb321d9b640 1 -- 172.21.15.78:0/3115641369 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb31c0a59e0 con 0x7fb3240d1ce0 2023-12-12T10:13:27.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.041+0000 7fb321d9b640 1 -- 172.21.15.78:0/3115641369 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb31c0a5b40 con 0x7fb3240d1ce0 2023-12-12T10:13:27.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.041+0000 7fb321d9b640 1 -- 172.21.15.78:0/3115641369 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb31c0ad440 con 0x7fb3240d1ce0 2023-12-12T10:13:27.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.041+0000 7fb328f0f640 1 -- 172.21.15.78:0/3115641369 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb3240d1ce0 msgr2=0x7fb3240d1040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:27.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.041+0000 7fb328f0f640 1 --2- 172.21.15.78:0/3115641369 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb3240d1ce0 0x7fb3240d1040 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fb31c009d90 tx=0x7fb31c01c920 comp rx=0 tx=0).stop 2023-12-12T10:13:27.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.041+0000 7fb328f0f640 1 -- 172.21.15.78:0/3115641369 shutdown_connections 2023-12-12T10:13:27.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.041+0000 7fb328f0f640 1 --2- 172.21.15.78:0/3115641369 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb3240d1ce0 0x7fb3240d1040 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:27.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.041+0000 7fb328f0f640 1 -- 172.21.15.78:0/3115641369 >> 172.21.15.78:0/3115641369 conn(0x7fb32409c2f0 msgr2=0x7fb3240d3010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:27.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.041+0000 7fb328f0f640 1 -- 172.21.15.78:0/3115641369 shutdown_connections 2023-12-12T10:13:27.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.041+0000 7fb328f0f640 1 -- 172.21.15.78:0/3115641369 wait complete. 2023-12-12T10:13:27.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.041+0000 7fb328f0f640 1 Processor -- start 2023-12-12T10:13:27.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.045+0000 7fb328f0f640 1 -- start start 2023-12-12T10:13:27.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.045+0000 7fb328f0f640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb3240d0be0 0x7fb32415fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:27.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.045+0000 7fb328f0f640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb3240d1ce0 0x7fb32414b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:27.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.045+0000 7fb328f0f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb324160890 0x7fb3240ca0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:27.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.045+0000 7fb328f0f640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3240ccf30 con 0x7fb324160890 2023-12-12T10:13:27.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.045+0000 7fb328f0f640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb32414bb80 con 0x7fb3240d0be0 2023-12-12T10:13:27.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.045+0000 7fb328f0f640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3240cc320 con 0x7fb3240d1ce0 2023-12-12T10:13:27.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.045+0000 7fb322d9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb324160890 0x7fb3240ca0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:27.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.045+0000 7fb322d9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb324160890 0x7fb3240ca0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50440/0 (socket says 172.21.15.78:50440) 2023-12-12T10:13:27.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.045+0000 7fb322d9d640 1 -- 172.21.15.78:0/3861454739 learned_addr learned my addr 172.21.15.78:0/3861454739 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:13:27.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.045+0000 7fb32259c640 1 --2- 172.21.15.78:0/3861454739 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb3240d0be0 0x7fb32415fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:27.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.045+0000 7fb319d9b640 1 --2- 172.21.15.78:0/3861454739 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb3240d1ce0 0x7fb32414b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:27.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.045+0000 7fb322d9d640 1 -- 172.21.15.78:0/3861454739 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb3240d1ce0 msgr2=0x7fb32414b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:27.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.045+0000 7fb322d9d640 1 --2- 172.21.15.78:0/3861454739 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb3240d1ce0 0x7fb32414b640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:27.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.045+0000 7fb322d9d640 1 -- 172.21.15.78:0/3861454739 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb3240d0be0 msgr2=0x7fb32415fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:27.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.045+0000 7fb322d9d640 1 --2- 172.21.15.78:0/3861454739 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb3240d0be0 0x7fb32415fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:27.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.045+0000 7fb322d9d640 1 -- 172.21.15.78:0/3861454739 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb31c009a70 con 0x7fb324160890 2023-12-12T10:13:27.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.045+0000 7fb319d9b640 1 --2- 172.21.15.78:0/3861454739 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb3240d1ce0 0x7fb32414b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T10:13:27.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.045+0000 7fb322d9d640 1 --2- 172.21.15.78:0/3861454739 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb324160890 0x7fb3240ca0e0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fb31c01a550 tx=0x7fb31c0196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:27.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.045+0000 7fb31b7fe640 1 -- 172.21.15.78:0/3861454739 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb31c0adce0 con 0x7fb324160890 2023-12-12T10:13:27.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.045+0000 7fb31b7fe640 1 -- 172.21.15.78:0/3861454739 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb31c0ade40 con 0x7fb324160890 2023-12-12T10:13:27.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.045+0000 7fb31b7fe640 1 -- 172.21.15.78:0/3861454739 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb31c0b9670 con 0x7fb324160890 2023-12-12T10:13:27.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.045+0000 7fb328f0f640 1 -- 172.21.15.78:0/3861454739 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3240cc600 con 0x7fb324160890 2023-12-12T10:13:27.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.045+0000 7fb328f0f640 1 -- 172.21.15.78:0/3861454739 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3240ccbc0 con 0x7fb324160890 2023-12-12T10:13:27.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.045+0000 7fb328f0f640 1 -- 172.21.15.78:0/3861454739 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3240b5ba0 con 0x7fb324160890 2023-12-12T10:13:27.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.049+0000 7fb31b7fe640 1 -- 172.21.15.78:0/3861454739 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb31c0b97d0 con 0x7fb324160890 2023-12-12T10:13:27.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.049+0000 7fb31b7fe640 1 --2- 172.21.15.78:0/3861454739 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fb304066470 0x7fb304068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:27.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.049+0000 7fb31b7fe640 1 -- 172.21.15.78:0/3861454739 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fb31c11f300 con 0x7fb324160890 2023-12-12T10:13:27.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.049+0000 7fb32259c640 1 --2- 172.21.15.78:0/3861454739 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fb304066470 0x7fb304068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:27.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.049+0000 7fb32259c640 1 --2- 172.21.15.78:0/3861454739 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fb304066470 0x7fb304068930 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fb3140011f0 tx=0x7fb314009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:27.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.053+0000 7fb31b7fe640 1 -- 172.21.15.78:0/3861454739 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb3240b5ba0 con 0x7fb324160890 2023-12-12T10:13:27.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.257+0000 7fb328f0f640 1 -- 172.21.15.78:0/3861454739 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7fb3240b5ba0 con 0x7fb324160890 2023-12-12T10:13:27.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.261+0000 7fb31b7fe640 1 -- 172.21.15.78:0/3861454739 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v11) v1 ==== 97+0+0 (secure 0 0 0) 0x7fb3240b5ba0 con 0x7fb324160890 2023-12-12T10:13:27.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.261+0000 7fb328f0f640 1 -- 172.21.15.78:0/3861454739 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fb304066470 msgr2=0x7fb304068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:27.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.261+0000 7fb328f0f640 1 --2- 172.21.15.78:0/3861454739 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fb304066470 0x7fb304068930 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fb3140011f0 tx=0x7fb314009040 comp rx=0 tx=0).stop 2023-12-12T10:13:27.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.261+0000 7fb328f0f640 1 -- 172.21.15.78:0/3861454739 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb324160890 msgr2=0x7fb3240ca0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:27.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.261+0000 7fb328f0f640 1 --2- 172.21.15.78:0/3861454739 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb324160890 0x7fb3240ca0e0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fb31c01a550 tx=0x7fb31c0196c0 comp rx=0 tx=0).stop 2023-12-12T10:13:27.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.261+0000 7fb328f0f640 1 -- 172.21.15.78:0/3861454739 shutdown_connections 2023-12-12T10:13:27.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.261+0000 7fb328f0f640 1 --2- 172.21.15.78:0/3861454739 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fb304066470 0x7fb304068930 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:27.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.261+0000 7fb328f0f640 1 --2- 172.21.15.78:0/3861454739 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb324160890 0x7fb3240ca0e0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:27.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.261+0000 7fb328f0f640 1 --2- 172.21.15.78:0/3861454739 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb3240d1ce0 0x7fb32414b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:27.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.261+0000 7fb328f0f640 1 --2- 172.21.15.78:0/3861454739 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb3240d0be0 0x7fb32415fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:27.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.261+0000 7fb328f0f640 1 -- 172.21.15.78:0/3861454739 >> 172.21.15.78:0/3861454739 conn(0x7fb32409c2f0 msgr2=0x7fb32406beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:27.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.261+0000 7fb328f0f640 1 -- 172.21.15.78:0/3861454739 shutdown_connections 2023-12-12T10:13:27.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.261+0000 7fb328f0f640 1 -- 172.21.15.78:0/3861454739 wait complete. 2023-12-12T10:13:27.286 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-12-12T10:13:27.423 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.421+0000 7f44a0617640 1 Processor -- start 2023-12-12T10:13:27.424 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.421+0000 7f44a0617640 1 -- start start 2023-12-12T10:13:27.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.421+0000 7f44a0617640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f449815d080 0x7f449806ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:27.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.421+0000 7f44a0617640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4498160da0 0x7f44981611e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:27.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.421+0000 7f44a0617640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f44980cc370 0x7f44980cc7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:27.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.421+0000 7f44a0617640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44980ccd10 con 0x7f449815d080 2023-12-12T10:13:27.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.421+0000 7f44a0617640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f449806bf50 con 0x7f44980cc370 2023-12-12T10:13:27.425 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.421+0000 7f44a0617640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f449806b580 con 0x7f4498160da0 2023-12-12T10:13:27.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.421+0000 7f449e3b3640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f449815d080 0x7f449806ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:27.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.421+0000 7f449e3b3640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f449815d080 0x7f449806ba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50446/0 (socket says 172.21.15.78:50446) 2023-12-12T10:13:27.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.421+0000 7f449e3b3640 1 -- 172.21.15.78:0/3878542813 learned_addr learned my addr 172.21.15.78:0/3878542813 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:13:27.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.421+0000 7f449e3b3640 1 -- 172.21.15.78:0/3878542813 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4498160da0 msgr2=0x7f44981611e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:13:27.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.421+0000 7f449dbb2640 1 --2- 172.21.15.78:0/3878542813 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4498160da0 0x7f44981611e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:27.426 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.421+0000 7f449ebb4640 1 --2- 172.21.15.78:0/3878542813 >> v2:172.21.15.187:3300/0 conn(0x7f44980cc370 0x7f44980cc7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:27.427 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.421+0000 7f449e3b3640 1 --2- 172.21.15.78:0/3878542813 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4498160da0 0x7f44981611e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:27.427 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.421+0000 7f449e3b3640 1 -- 172.21.15.78:0/3878542813 >> v2:172.21.15.187:3300/0 conn(0x7f44980cc370 msgr2=0x7f44980cc7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:13:27.427 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.421+0000 7f449e3b3640 1 --2- 172.21.15.78:0/3878542813 >> v2:172.21.15.187:3300/0 conn(0x7f44980cc370 0x7f44980cc7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:27.427 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.421+0000 7f449e3b3640 1 -- 172.21.15.78:0/3878542813 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f449806af50 con 0x7f449815d080 2023-12-12T10:13:27.428 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.425+0000 7f449e3b3640 1 --2- 172.21.15.78:0/3878542813 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f449815d080 0x7f449806ba10 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f449806b140 tx=0x7f449401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=917df37802012978 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:27.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.425+0000 7f449d3b1640 1 -- 172.21.15.78:0/3878542813 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44940ac410 con 0x7f449815d080 2023-12-12T10:13:27.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.425+0000 7f449d3b1640 1 -- 172.21.15.78:0/3878542813 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44940ac570 con 0x7f449815d080 2023-12-12T10:13:27.429 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.425+0000 7f449d3b1640 1 -- 172.21.15.78:0/3878542813 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44940ac900 con 0x7f449815d080 2023-12-12T10:13:27.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.425+0000 7f44a0617640 1 -- 172.21.15.78:0/3878542813 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f449815d080 msgr2=0x7f449806ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:27.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.425+0000 7f44a0617640 1 --2- 172.21.15.78:0/3878542813 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f449815d080 0x7f449806ba10 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f449806b140 tx=0x7f449401c500 comp rx=0 tx=0).stop 2023-12-12T10:13:27.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.425+0000 7f44a0617640 1 -- 172.21.15.78:0/3878542813 shutdown_connections 2023-12-12T10:13:27.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.425+0000 7f44a0617640 1 --2- 172.21.15.78:0/3878542813 >> v2:172.21.15.187:3300/0 conn(0x7f44980cc370 0x7f44980cc7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:27.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.425+0000 7f44a0617640 1 --2- 172.21.15.78:0/3878542813 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4498160da0 0x7f44981611e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:27.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.425+0000 7f44a0617640 1 --2- 172.21.15.78:0/3878542813 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f449815d080 0x7f449806ba10 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:27.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.425+0000 7f44a0617640 1 -- 172.21.15.78:0/3878542813 >> 172.21.15.78:0/3878542813 conn(0x7f44980b1650 msgr2=0x7f44980b1a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:27.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.425+0000 7f44a0617640 1 -- 172.21.15.78:0/3878542813 shutdown_connections 2023-12-12T10:13:27.430 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.425+0000 7f44a0617640 1 -- 172.21.15.78:0/3878542813 wait complete. 2023-12-12T10:13:27.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.429+0000 7f44a0617640 1 Processor -- start 2023-12-12T10:13:27.431 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.429+0000 7f44a0617640 1 -- start start 2023-12-12T10:13:27.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.429+0000 7f44a0617640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f44980cc370 0x7f4498151fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:27.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.429+0000 7f44a0617640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f449815d080 0x7f4498153630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:27.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.429+0000 7f44a0617640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4498160da0 0x7f44981547b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:27.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.429+0000 7f44a0617640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f449815ef60 con 0x7f44980cc370 2023-12-12T10:13:27.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.429+0000 7f44a0617640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f449815f240 con 0x7f449815d080 2023-12-12T10:13:27.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.429+0000 7f44a0617640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f449815f520 con 0x7f4498160da0 2023-12-12T10:13:27.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.429+0000 7f449e3b3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f44980cc370 0x7f4498151fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:27.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.429+0000 7f449e3b3640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f44980cc370 0x7f4498151fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50462/0 (socket says 172.21.15.78:50462) 2023-12-12T10:13:27.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.429+0000 7f449e3b3640 1 -- 172.21.15.78:0/2594358528 learned_addr learned my addr 172.21.15.78:0/2594358528 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:13:27.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.429+0000 7f449dbb2640 1 --2- 172.21.15.78:0/2594358528 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f449815d080 0x7f4498153630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:27.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.429+0000 7f449e3b3640 1 -- 172.21.15.78:0/2594358528 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4498160da0 msgr2=0x7f44981547b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:27.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.429+0000 7f449ebb4640 1 --2- 172.21.15.78:0/2594358528 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4498160da0 0x7f44981547b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:27.434 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.429+0000 7f449e3b3640 1 --2- 172.21.15.78:0/2594358528 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4498160da0 0x7f44981547b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:27.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.429+0000 7f449e3b3640 1 -- 172.21.15.78:0/2594358528 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f449815d080 msgr2=0x7f4498153630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:27.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.429+0000 7f449e3b3640 1 --2- 172.21.15.78:0/2594358528 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f449815d080 0x7f4498153630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:27.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.429+0000 7f449e3b3640 1 -- 172.21.15.78:0/2594358528 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44940094d0 con 0x7f44980cc370 2023-12-12T10:13:27.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.429+0000 7f449dbb2640 1 --2- 172.21.15.78:0/2594358528 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f449815d080 0x7f4498153630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T10:13:27.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.429+0000 7f449ebb4640 1 --2- 172.21.15.78:0/2594358528 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4498160da0 0x7f44981547b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T10:13:27.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.429+0000 7f449e3b3640 1 --2- 172.21.15.78:0/2594358528 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f44980cc370 0x7f4498151fc0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f44940af040 tx=0x7f44940192a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:27.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.429+0000 7f448effd640 1 -- 172.21.15.78:0/2594358528 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44940ac410 con 0x7f44980cc370 2023-12-12T10:13:27.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.429+0000 7f448effd640 1 -- 172.21.15.78:0/2594358528 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44940b65f0 con 0x7f44980cc370 2023-12-12T10:13:27.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.429+0000 7f448effd640 1 -- 172.21.15.78:0/2594358528 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44940b69a0 con 0x7f44980cc370 2023-12-12T10:13:27.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.429+0000 7f44a0617640 1 -- 172.21.15.78:0/2594358528 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f449815f800 con 0x7f44980cc370 2023-12-12T10:13:27.435 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.429+0000 7f44a0617640 1 -- 172.21.15.78:0/2594358528 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44980ac880 con 0x7f44980cc370 2023-12-12T10:13:27.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.429+0000 7f44a0617640 1 -- 172.21.15.78:0/2594358528 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4498067530 con 0x7f44980cc370 2023-12-12T10:13:27.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.433+0000 7f448effd640 1 -- 172.21.15.78:0/2594358528 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f44940b6b00 con 0x7f44980cc370 2023-12-12T10:13:27.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.433+0000 7f448effd640 1 --2- 172.21.15.78:0/2594358528 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f447c066470 0x7f447c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:27.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.433+0000 7f448effd640 1 -- 172.21.15.78:0/2594358528 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f449411e760 con 0x7f44980cc370 2023-12-12T10:13:27.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.433+0000 7f449dbb2640 1 --2- 172.21.15.78:0/2594358528 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f447c066470 0x7f447c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:27.437 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.433+0000 7f449dbb2640 1 --2- 172.21.15.78:0/2594358528 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f447c066470 0x7f447c068930 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f4488006fd0 tx=0x7f4488008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:27.441 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.437+0000 7f448effd640 1 -- 172.21.15.78:0/2594358528 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f44940ebe70 con 0x7f44980cc370 2023-12-12T10:13:27.639 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.633+0000 7f44a0617640 1 -- 172.21.15.78:0/2594358528 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f449815f0a0 con 0x7f44980cc370 2023-12-12T10:13:27.642 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.637+0000 7f448effd640 1 -- 172.21.15.78:0/2594358528 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7f449815f0a0 con 0x7f44980cc370 2023-12-12T10:13:27.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.641+0000 7f44a0617640 1 -- 172.21.15.78:0/2594358528 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f447c066470 msgr2=0x7f447c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:27.644 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.641+0000 7f44a0617640 1 --2- 172.21.15.78:0/2594358528 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f447c066470 0x7f447c068930 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f4488006fd0 tx=0x7f4488008040 comp rx=0 tx=0).stop 2023-12-12T10:13:27.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.641+0000 7f44a0617640 1 -- 172.21.15.78:0/2594358528 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f44980cc370 msgr2=0x7f4498151fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:27.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.641+0000 7f44a0617640 1 --2- 172.21.15.78:0/2594358528 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f44980cc370 0x7f4498151fc0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f44940af040 tx=0x7f44940192a0 comp rx=0 tx=0).stop 2023-12-12T10:13:27.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.641+0000 7f44a0617640 1 -- 172.21.15.78:0/2594358528 shutdown_connections 2023-12-12T10:13:27.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.641+0000 7f44a0617640 1 --2- 172.21.15.78:0/2594358528 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f447c066470 0x7f447c068930 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:27.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.641+0000 7f44a0617640 1 --2- 172.21.15.78:0/2594358528 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4498160da0 0x7f44981547b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:27.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.641+0000 7f44a0617640 1 --2- 172.21.15.78:0/2594358528 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f449815d080 0x7f4498153630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:27.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.641+0000 7f44a0617640 1 --2- 172.21.15.78:0/2594358528 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f44980cc370 0x7f4498151fc0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:27.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.641+0000 7f44a0617640 1 -- 172.21.15.78:0/2594358528 >> 172.21.15.78:0/2594358528 conn(0x7f44980b1650 msgr2=0x7f44980cf3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:27.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.641+0000 7f44a0617640 1 -- 172.21.15.78:0/2594358528 shutdown_connections 2023-12-12T10:13:27.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.641+0000 7f44a0617640 1 -- 172.21.15.78:0/2594358528 wait complete. 2023-12-12T10:13:27.664 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T10:13:27.800 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.797+0000 7f3ab66c9640 1 Processor -- start 2023-12-12T10:13:27.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.797+0000 7f3ab66c9640 1 -- start start 2023-12-12T10:13:27.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.797+0000 7f3ab66c9640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3ab015d3c0 0x7f3ab00d3b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:27.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.797+0000 7f3ab66c9640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f3ab00d1cb0 0x7f3ab00b36e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:27.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.797+0000 7f3ab66c9640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ab00b3250 con 0x7f3ab00ce670 2023-12-12T10:13:27.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.797+0000 7f3ab66c9640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ab00cee50 con 0x7f3ab00d1cb0 2023-12-12T10:13:27.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.797+0000 7f3ab66c9640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ab00b2920 con 0x7f3ab015d3c0 2023-12-12T10:13:27.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.797+0000 7f3aaf7fe640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f3ab00ce670 0x7f3ab00d15a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:38864/0 (socket says 172.21.15.78:38864) 2023-12-12T10:13:27.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.797+0000 7f3aaf7fe640 1 -- 172.21.15.78:0/1176749591 learned_addr learned my addr 172.21.15.78:0/1176749591 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-12-12T10:13:27.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.797+0000 7f3aaffff640 1 --2- 172.21.15.78:0/1176749591 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3ab015d3c0 0x7f3ab00d3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:27.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.797+0000 7f3ab4c66640 1 --2- 172.21.15.78:0/1176749591 >> v2:172.21.15.187:3300/0 conn(0x7f3ab00d1cb0 0x7f3ab00b36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:27.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.797+0000 7f3aaeffd640 1 -- 172.21.15.78:0/1176749591 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3535448967 0 0) 0x7f3ab00b3250 con 0x7f3ab00ce670 2023-12-12T10:13:27.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.797+0000 7f3aaeffd640 1 -- 172.21.15.78:0/1176749591 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a98003530 con 0x7f3ab00ce670 2023-12-12T10:13:27.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.797+0000 7f3aaeffd640 1 -- 172.21.15.78:0/1176749591 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3551585079 0 0) 0x7f3a98003530 con 0x7f3ab00ce670 2023-12-12T10:13:27.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.797+0000 7f3aaeffd640 1 -- 172.21.15.78:0/1176749591 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3ab015d3c0 msgr2=0x7f3ab00d3b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:13:27.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.797+0000 7f3aaeffd640 1 --2- 172.21.15.78:0/1176749591 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3ab015d3c0 0x7f3ab00d3b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:27.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.797+0000 7f3aaeffd640 1 -- 172.21.15.78:0/1176749591 >> v2:172.21.15.187:3300/0 conn(0x7f3ab00d1cb0 msgr2=0x7f3ab00b36e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:13:27.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.797+0000 7f3aaeffd640 1 --2- 172.21.15.78:0/1176749591 >> v2:172.21.15.187:3300/0 conn(0x7f3ab00d1cb0 0x7f3ab00b36e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:27.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.797+0000 7f3aaeffd640 1 -- 172.21.15.78:0/1176749591 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ab00b2c00 con 0x7f3ab00ce670 2023-12-12T10:13:27.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.797+0000 7f3aaeffd640 1 -- 172.21.15.78:0/1176749591 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 465499599 0 0) 0x7f3aa4001680 con 0x7f3ab00ce670 2023-12-12T10:13:27.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.797+0000 7f3aaeffd640 1 -- 172.21.15.78:0/1176749591 >> v1:172.21.15.78:6789/0 conn(0x7f3ab00ce670 legacy=0x7f3ab00d15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:27.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.797+0000 7f3aaeffd640 1 --2- 172.21.15.78:0/1176749591 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3ab015d3c0 0x7f3a98003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:27.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.797+0000 7f3aaeffd640 1 --2- 172.21.15.78:0/1176749591 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3a98003f00 0x7f3a980047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:27.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.797+0000 7f3aaeffd640 1 --2- 172.21.15.78:0/1176749591 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3a98004d10 0x7f3a98005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:27.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.797+0000 7f3aaeffd640 1 -- 172.21.15.78:0/1176749591 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ab00cee50 con 0x7f3a98003f00 2023-12-12T10:13:27.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.797+0000 7f3aaeffd640 1 -- 172.21.15.78:0/1176749591 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ab00b2920 con 0x7f3a98004d10 2023-12-12T10:13:27.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.797+0000 7f3aaeffd640 1 -- 172.21.15.78:0/1176749591 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a9800b9c0 con 0x7f3ab015d3c0 2023-12-12T10:13:27.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.797+0000 7f3aaf7fe640 1 --2- 172.21.15.78:0/1176749591 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3a98003f00 0x7f3a980047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:27.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.801+0000 7f3ab4c66640 1 --2- 172.21.15.78:0/1176749591 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3a98004d10 0x7f3a98005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:27.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.801+0000 7f3aaffff640 1 --2- 172.21.15.78:0/1176749591 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3ab015d3c0 0x7f3a98003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:27.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.801+0000 7f3aaf7fe640 1 -- 172.21.15.78:0/1176749591 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3ab015d3c0 msgr2=0x7f3a98003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:13:27.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.801+0000 7f3aaf7fe640 1 --2- 172.21.15.78:0/1176749591 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3ab015d3c0 0x7f3a98003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:27.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.801+0000 7f3aaf7fe640 1 -- 172.21.15.78:0/1176749591 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3a98004d10 msgr2=0x7f3a98005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:13:27.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.801+0000 7f3aaf7fe640 1 --2- 172.21.15.78:0/1176749591 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3a98004d10 0x7f3a98005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:27.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.801+0000 7f3aaf7fe640 1 -- 172.21.15.78:0/1176749591 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a98003530 con 0x7f3a98003f00 2023-12-12T10:13:27.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.801+0000 7f3ab4c66640 1 --2- 172.21.15.78:0/1176749591 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3a98004d10 0x7f3a98005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T10:13:27.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.801+0000 7f3aaffff640 1 --2- 172.21.15.78:0/1176749591 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3ab015d3c0 0x7f3a98003980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T10:13:27.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.801+0000 7f3aaf7fe640 1 --2- 172.21.15.78:0/1176749591 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3a98003f00 0x7f3a980047d0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f3aa400c240 tx=0x7f3aa401cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a118c89c3ff0359 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:27.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.801+0000 7f3aaeffd640 1 -- 172.21.15.78:0/1176749591 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aa40a5b40 con 0x7f3a98003f00 2023-12-12T10:13:27.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.801+0000 7f3aaeffd640 1 -- 172.21.15.78:0/1176749591 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3aa40a5ca0 con 0x7f3a98003f00 2023-12-12T10:13:27.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.801+0000 7f3aaeffd640 1 -- 172.21.15.78:0/1176749591 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aa4005b20 con 0x7f3a98003f00 2023-12-12T10:13:27.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.801+0000 7f3ab66c9640 1 -- 172.21.15.78:0/1176749591 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3a98003f00 msgr2=0x7f3a980047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:27.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.801+0000 7f3ab66c9640 1 --2- 172.21.15.78:0/1176749591 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3a98003f00 0x7f3a980047d0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f3aa400c240 tx=0x7f3aa401cc40 comp rx=0 tx=0).stop 2023-12-12T10:13:27.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.801+0000 7f3ab4c66640 1 -- 172.21.15.78:0/1176749591 reap_dead start 2023-12-12T10:13:27.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.801+0000 7f3ab66c9640 1 -- 172.21.15.78:0/1176749591 shutdown_connections 2023-12-12T10:13:27.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.801+0000 7f3ab66c9640 1 -- 172.21.15.78:0/1176749591 >> 172.21.15.78:0/1176749591 conn(0x7f3ab009c2a0 msgr2=0x7f3ab00d2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:27.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.805+0000 7f3ab66c9640 1 -- 172.21.15.78:0/1176749591 shutdown_connections 2023-12-12T10:13:27.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.805+0000 7f3ab66c9640 1 -- 172.21.15.78:0/1176749591 wait complete. 2023-12-12T10:13:27.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.805+0000 7f3ab66c9640 1 Processor -- start 2023-12-12T10:13:27.809 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.805+0000 7f3ab66c9640 1 -- start start 2023-12-12T10:13:27.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.805+0000 7f3ab66c9640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3a98003f00 0x7f3ab00cc7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:27.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.805+0000 7f3ab66c9640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3ab00c93b0 0x7f3ab015e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:27.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.805+0000 7f3ab66c9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ab00c9830 0x7f3ab015ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:27.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.805+0000 7f3ab66c9640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ab00c7dd0 con 0x7f3ab00c9830 2023-12-12T10:13:27.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.805+0000 7f3ab66c9640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ab00b8600 con 0x7f3ab00c93b0 2023-12-12T10:13:27.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.805+0000 7f3ab66c9640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ab00cb710 con 0x7f3a98003f00 2023-12-12T10:13:27.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.805+0000 7f3ab4c66640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ab00c9830 0x7f3ab015ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:27.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.805+0000 7f3ab4c66640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ab00c9830 0x7f3ab015ee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50478/0 (socket says 172.21.15.78:50478) 2023-12-12T10:13:27.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.805+0000 7f3ab4c66640 1 -- 172.21.15.78:0/2254816331 learned_addr learned my addr 172.21.15.78:0/2254816331 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:13:27.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.805+0000 7f3aaf7fe640 1 --2- 172.21.15.78:0/2254816331 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3ab00c93b0 0x7f3ab015e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:27.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.805+0000 7f3aaffff640 1 --2- 172.21.15.78:0/2254816331 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3a98003f00 0x7f3ab00cc7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:27.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.805+0000 7f3ab4c66640 1 -- 172.21.15.78:0/2254816331 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3a98003f00 msgr2=0x7f3ab00cc7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:27.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.805+0000 7f3ab4c66640 1 --2- 172.21.15.78:0/2254816331 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3a98003f00 0x7f3ab00cc7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:27.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.805+0000 7f3ab4c66640 1 -- 172.21.15.78:0/2254816331 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3ab00c93b0 msgr2=0x7f3ab015e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:27.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.805+0000 7f3ab4c66640 1 --2- 172.21.15.78:0/2254816331 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3ab00c93b0 0x7f3ab015e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:27.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.805+0000 7f3ab4c66640 1 -- 172.21.15.78:0/2254816331 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ab00cb9f0 con 0x7f3ab00c9830 2023-12-12T10:13:27.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.805+0000 7f3ab4c66640 1 --2- 172.21.15.78:0/2254816331 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ab00c9830 0x7f3ab015ee50 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f3ab008b870 tx=0x7f3aa8010590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:27.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.809+0000 7f3aacff9640 1 -- 172.21.15.78:0/2254816331 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aa800e050 con 0x7f3ab00c9830 2023-12-12T10:13:27.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.809+0000 7f3aacff9640 1 -- 172.21.15.78:0/2254816331 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3aa800f040 con 0x7f3ab00c9830 2023-12-12T10:13:27.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.809+0000 7f3aacff9640 1 -- 172.21.15.78:0/2254816331 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aa80039a0 con 0x7f3ab00c9830 2023-12-12T10:13:27.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.809+0000 7f3ab66c9640 1 -- 172.21.15.78:0/2254816331 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ab00cbcd0 con 0x7f3ab00c9830 2023-12-12T10:13:27.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.809+0000 7f3ab66c9640 1 -- 172.21.15.78:0/2254816331 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ab00cc290 con 0x7f3ab00c9830 2023-12-12T10:13:27.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.809+0000 7f3ab66c9640 1 -- 172.21.15.78:0/2254816331 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ab00b2270 con 0x7f3ab00c9830 2023-12-12T10:13:27.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.809+0000 7f3aacff9640 1 -- 172.21.15.78:0/2254816331 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3aa8015440 con 0x7f3ab00c9830 2023-12-12T10:13:27.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.809+0000 7f3aacff9640 1 --2- 172.21.15.78:0/2254816331 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f3a9c0664a0 0x7f3a9c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:27.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.809+0000 7f3aacff9640 1 -- 172.21.15.78:0/2254816331 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f3aa8084270 con 0x7f3ab00c9830 2023-12-12T10:13:27.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.809+0000 7f3aaffff640 1 --2- 172.21.15.78:0/2254816331 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f3a9c0664a0 0x7f3a9c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:27.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.809+0000 7f3aaffff640 1 --2- 172.21.15.78:0/2254816331 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f3a9c0664a0 0x7f3a9c068960 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f3ab015a270 tx=0x7f3aa0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:27.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.813+0000 7f3aacff9640 1 -- 172.21.15.78:0/2254816331 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3aa80518f0 con 0x7f3ab00c9830 2023-12-12T10:13:27.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.965+0000 7f3ab66c9640 1 -- 172.21.15.78:0/2254816331 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3ab00cc4b0 con 0x7f3ab00c9830 2023-12-12T10:13:27.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.969+0000 7f3aacff9640 1 -- 172.21.15.78:0/2254816331 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+13026 (secure 0 0 0) 0x7f3aa8054f10 con 0x7f3ab00c9830 2023-12-12T10:13:27.974 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:13:27.974 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":35,"fsid":"fc81937c-bd26-483c-952b-d1324fcb0c9e","created":"2023-12-12T10:11:44.020214+0000","modified":"2023-12-12T10:13:24.935304+0000","last_up_change":"2023-12-12T10:11:56.278318+0000","last_in_change":"2023-12-12T10:11:46.553610+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T10:11:57.053584+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"22dfdedf-5f6c-4b20-9f6c-30517a1db70a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6809","nonce":3345683600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6811","nonce":3345683600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6815","nonce":3345683600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6813","nonce":3345683600}]},"public_addr":"172.21.15.78:6809/3345683600","cluster_addr":"172.21.15.78:6811/3345683600","heartbeat_back_addr":"172.21.15.78:6815/3345683600","heartbeat_front_addr":"172.21.15.78:6813/3345683600","state":["exists","up"]},{"osd":1,"uuid":"be34a7f3-a69a-462e-9ddf-5e537448dba2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6801","nonce":962652768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6803","nonce":962652768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6807","nonce":962652768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6805","nonce":962652768}]},"public_addr":"172.21.15.78:6801/962652768","cluster_addr":"172.21.15.78:6803/962652768","heartbeat_back_addr":"172.21.15.78:6807/962652768","heartbeat_front_addr":"172.21.15.78:6805/962652768","state":["exists","up"]},{"osd":2,"uuid":"55b381de-5f56-4b14-80f7-e6e41e084a13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6818","nonce":2910206054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6822","nonce":2910206054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6829","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6831","nonce":2910206054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6826","nonce":2910206054}]},"public_addr":"172.21.15.78:6818/2910206054","cluster_addr":"172.21.15.78:6822/2910206054","heartbeat_back_addr":"172.21.15.78:6831/2910206054","heartbeat_front_addr":"172.21.15.78:6826/2910206054","state":["exists","up"]},{"osd":3,"uuid":"d7682de1-25cb-4cec-869f-8851c28b0e6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6819","nonce":3750796703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6821","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6823","nonce":3750796703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6830","nonce":3750796703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6825","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6827","nonce":3750796703}]},"public_addr":"172.21.15.78:6819/3750796703","cluster_addr":"172.21.15.78:6823/3750796703","heartbeat_back_addr":"172.21.15.78:6830/3750796703","heartbeat_front_addr":"172.21.15.78:6827/3750796703","state":["exists","up"]},{"osd":4,"uuid":"8279815a-d6c7-4199-871e-d28971b9dc07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6809","nonce":2944277204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6811","nonce":2944277204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6815","nonce":2944277204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6813","nonce":2944277204}]},"public_addr":"172.21.15.187:6809/2944277204","cluster_addr":"172.21.15.187:6811/2944277204","heartbeat_back_addr":"172.21.15.187:6815/2944277204","heartbeat_front_addr":"172.21.15.187:6813/2944277204","state":["exists","up"]},{"osd":5,"uuid":"0a714c65-f8ce-4340-968f-11a799677ef3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6801","nonce":185858620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6803","nonce":185858620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6807","nonce":185858620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6805","nonce":185858620}]},"public_addr":"172.21.15.187:6801/185858620","cluster_addr":"172.21.15.187:6803/185858620","heartbeat_back_addr":"172.21.15.187:6807/185858620","heartbeat_front_addr":"172.21.15.187:6805/185858620","state":["exists","up"]},{"osd":6,"uuid":"d0bba9ab-f7ee-449e-8999-1c0cf7e6d53c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6817","nonce":4213392126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6819","nonce":4213392126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6824","nonce":4213392126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6821","nonce":4213392126}]},"public_addr":"172.21.15.187:6817/4213392126","cluster_addr":"172.21.15.187:6819/4213392126","heartbeat_back_addr":"172.21.15.187:6824/4213392126","heartbeat_front_addr":"172.21.15.187:6821/4213392126","state":["exists","up"]},{"osd":7,"uuid":"efe5e0d9-2f87-4889-a27a-e2a95a632302","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6823","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6825","nonce":85774004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6827","nonce":85774004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6831","nonce":85774004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6829","nonce":85774004}]},"public_addr":"172.21.15.187:6825/85774004","cluster_addr":"172.21.15.187:6827/85774004","heartbeat_back_addr":"172.21.15.187:6831/85774004","heartbeat_front_addr":"172.21.15.187:6829/85774004","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.214447+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.448899+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.293107+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.564184+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.175026+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.097717+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.261141+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.287681+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T10:13:27.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.973+0000 7f3ab66c9640 1 -- 172.21.15.78:0/2254816331 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f3a9c0664a0 msgr2=0x7f3a9c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:27.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.973+0000 7f3ab66c9640 1 --2- 172.21.15.78:0/2254816331 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f3a9c0664a0 0x7f3a9c068960 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f3ab015a270 tx=0x7f3aa0008040 comp rx=0 tx=0).stop 2023-12-12T10:13:27.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.973+0000 7f3ab66c9640 1 -- 172.21.15.78:0/2254816331 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ab00c9830 msgr2=0x7f3ab015ee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:27.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.973+0000 7f3ab66c9640 1 --2- 172.21.15.78:0/2254816331 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ab00c9830 0x7f3ab015ee50 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f3ab008b870 tx=0x7f3aa8010590 comp rx=0 tx=0).stop 2023-12-12T10:13:27.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.973+0000 7f3ab66c9640 1 -- 172.21.15.78:0/2254816331 shutdown_connections 2023-12-12T10:13:27.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.973+0000 7f3ab66c9640 1 --2- 172.21.15.78:0/2254816331 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f3a9c0664a0 0x7f3a9c068960 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:27.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.973+0000 7f3ab66c9640 1 --2- 172.21.15.78:0/2254816331 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ab00c9830 0x7f3ab015ee50 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:27.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.973+0000 7f3ab66c9640 1 --2- 172.21.15.78:0/2254816331 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3ab00c93b0 0x7f3ab015e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:27.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.973+0000 7f3ab66c9640 1 --2- 172.21.15.78:0/2254816331 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3a98003f00 0x7f3ab00cc7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:27.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.973+0000 7f3ab66c9640 1 -- 172.21.15.78:0/2254816331 >> 172.21.15.78:0/2254816331 conn(0x7f3ab009c2a0 msgr2=0x7f3ab015c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:27.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.973+0000 7f3ab66c9640 1 -- 172.21.15.78:0/2254816331 shutdown_connections 2023-12-12T10:13:27.977 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:27.973+0000 7f3ab66c9640 1 -- 172.21.15.78:0/2254816331 wait complete. 2023-12-12T10:13:27.996 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-12T10:11:57.053584+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-12T10:13:27.996 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-12T10:13:28.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.133+0000 7f8ecdddf640 1 Processor -- start 2023-12-12T10:13:28.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.133+0000 7f8ecdddf640 1 -- start start 2023-12-12T10:13:28.138 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.133+0000 7f8ecdddf640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8ec8160890 0x7f8ec80b5e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:28.138 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.133+0000 7f8ecdddf640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ec80d04f0 con 0x7f8ec80d1ce0 2023-12-12T10:13:28.138 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.133+0000 7f8ecdddf640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ec80b63a0 con 0x7f8ec80d0be0 2023-12-12T10:13:28.138 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.133+0000 7f8ecdddf640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ec80cdc20 con 0x7f8ec8160890 2023-12-12T10:13:28.138 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.133+0000 7f8ec77fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8ec8160890 0x7f8ec80b5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:28.138 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.133+0000 7f8ec7fff640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f8ec80d1ce0 0x7f8ec80ce3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:38874/0 (socket says 172.21.15.78:38874) 2023-12-12T10:13:28.138 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.133+0000 7f8ec7fff640 1 -- 172.21.15.78:0/3473922008 learned_addr learned my addr 172.21.15.78:0/3473922008 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-12-12T10:13:28.139 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.133+0000 7f8ec77fe640 1 -- 172.21.15.78:0/3473922008 >> v1:172.21.15.187:6789/0 conn(0x7f8ec80d0be0 legacy=0x7f8ec80d15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:13:28.139 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.133+0000 7f8ec77fe640 1 -- 172.21.15.78:0/3473922008 >> v1:172.21.15.78:6789/0 conn(0x7f8ec80d1ce0 legacy=0x7f8ec80ce3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:28.139 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.133+0000 7f8ec67fc640 1 -- 172.21.15.78:0/3473922008 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4156409464 0 0) 0x7f8ec00014a0 con 0x7f8ec80d1ce0 2023-12-12T10:13:28.139 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.133+0000 7f8ec77fe640 1 -- 172.21.15.78:0/3473922008 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ec80cfc50 con 0x7f8ec8160890 2023-12-12T10:13:28.142 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.137+0000 7f8ec77fe640 1 --2- 172.21.15.78:0/3473922008 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ec8160890 0x7f8ec80b5e60 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f8eb80097c0 tx=0x7f8eb801c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f2e71ec07babe91 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:28.142 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.137+0000 7f8ec67fc640 1 -- 172.21.15.78:0/3473922008 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eb80ab600 con 0x7f8ec8160890 2023-12-12T10:13:28.142 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.137+0000 7f8ec67fc640 1 -- 172.21.15.78:0/3473922008 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8eb80a7050 con 0x7f8ec8160890 2023-12-12T10:13:28.142 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.137+0000 7f8ec67fc640 1 -- 172.21.15.78:0/3473922008 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eb80ab980 con 0x7f8ec8160890 2023-12-12T10:13:28.143 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.137+0000 7f8ecdddf640 1 -- 172.21.15.78:0/3473922008 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ec8160890 msgr2=0x7f8ec80b5e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:28.143 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.137+0000 7f8ecdddf640 1 --2- 172.21.15.78:0/3473922008 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ec8160890 0x7f8ec80b5e60 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f8eb80097c0 tx=0x7f8eb801c410 comp rx=0 tx=0).stop 2023-12-12T10:13:28.143 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.137+0000 7f8ecdddf640 1 -- 172.21.15.78:0/3473922008 shutdown_connections 2023-12-12T10:13:28.143 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.137+0000 7f8ecdddf640 1 --2- 172.21.15.78:0/3473922008 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ec8160890 0x7f8ec80b5e60 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:28.143 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.137+0000 7f8ecdddf640 1 -- 172.21.15.78:0/3473922008 >> 172.21.15.78:0/3473922008 conn(0x7f8ec809c2f0 msgr2=0x7f8ec80d3010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:28.143 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.137+0000 7f8ecdddf640 1 -- 172.21.15.78:0/3473922008 shutdown_connections 2023-12-12T10:13:28.143 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.137+0000 7f8ecdddf640 1 -- 172.21.15.78:0/3473922008 wait complete. 2023-12-12T10:13:28.144 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.141+0000 7f8ecdddf640 1 Processor -- start 2023-12-12T10:13:28.144 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.141+0000 7f8ecdddf640 1 -- start start 2023-12-12T10:13:28.147 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.141+0000 7f8ecdddf640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ec80d0be0 0x7f8ec8154640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:28.147 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.141+0000 7f8ecdddf640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8ec80d1ce0 0x7f8ec80c85a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:28.147 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.141+0000 7f8ecdddf640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8ec8160890 0x7f8ec80ca0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:28.147 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.141+0000 7f8ecdddf640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec81f6ae0 con 0x7f8ec80d0be0 2023-12-12T10:13:28.147 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.141+0000 7f8ecdddf640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec8154b80 con 0x7f8ec80d1ce0 2023-12-12T10:13:28.147 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.141+0000 7f8ecdddf640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ec80c8eb0 con 0x7f8ec8160890 2023-12-12T10:13:28.147 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.141+0000 7f8ec77fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ec80d0be0 0x7f8ec8154640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:28.147 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.141+0000 7f8ec77fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ec80d0be0 0x7f8ec8154640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50494/0 (socket says 172.21.15.78:50494) 2023-12-12T10:13:28.147 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.141+0000 7f8ec77fe640 1 -- 172.21.15.78:0/3487612563 learned_addr learned my addr 172.21.15.78:0/3487612563 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:13:28.147 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.141+0000 7f8ec6ffd640 1 --2- 172.21.15.78:0/3487612563 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8ec80d1ce0 0x7f8ec80c85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:28.147 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.141+0000 7f8ec7fff640 1 --2- 172.21.15.78:0/3487612563 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8ec8160890 0x7f8ec80ca0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:28.148 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.141+0000 7f8ec77fe640 1 -- 172.21.15.78:0/3487612563 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8ec8160890 msgr2=0x7f8ec80ca0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:28.148 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.141+0000 7f8ec77fe640 1 --2- 172.21.15.78:0/3487612563 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8ec8160890 0x7f8ec80ca0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:28.148 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.141+0000 7f8ec77fe640 1 -- 172.21.15.78:0/3487612563 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8ec80d1ce0 msgr2=0x7f8ec80c85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:28.148 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.141+0000 7f8ec77fe640 1 --2- 172.21.15.78:0/3487612563 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8ec80d1ce0 0x7f8ec80c85a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:28.148 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.141+0000 7f8ec77fe640 1 -- 172.21.15.78:0/3487612563 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8eb8009420 con 0x7f8ec80d0be0 2023-12-12T10:13:28.148 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.141+0000 7f8ec77fe640 1 --2- 172.21.15.78:0/3487612563 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ec80d0be0 0x7f8ec8154640 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f8eb801aac0 tx=0x7f8eb801ac50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:28.148 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.141+0000 7f8eaffff640 1 -- 172.21.15.78:0/3487612563 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eb80b7650 con 0x7f8ec80d0be0 2023-12-12T10:13:28.148 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.141+0000 7f8eaffff640 1 -- 172.21.15.78:0/3487612563 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8eb80b77d0 con 0x7f8ec80d0be0 2023-12-12T10:13:28.148 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.141+0000 7f8eaffff640 1 -- 172.21.15.78:0/3487612563 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eb80b7b80 con 0x7f8ec80d0be0 2023-12-12T10:13:28.148 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.141+0000 7f8ecdddf640 1 -- 172.21.15.78:0/3487612563 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ec80c9190 con 0x7f8ec80d0be0 2023-12-12T10:13:28.148 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.141+0000 7f8ecdddf640 1 -- 172.21.15.78:0/3487612563 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ec80c9750 con 0x7f8ec80d0be0 2023-12-12T10:13:28.149 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.145+0000 7f8ecdddf640 1 -- 172.21.15.78:0/3487612563 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ec8067530 con 0x7f8ec80d0be0 2023-12-12T10:13:28.149 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.145+0000 7f8eaffff640 1 -- 172.21.15.78:0/3487612563 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f8eb80b7ce0 con 0x7f8ec80d0be0 2023-12-12T10:13:28.150 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.145+0000 7f8eaffff640 1 --2- 172.21.15.78:0/3487612563 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f8eb40664a0 0x7f8eb4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:28.150 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.145+0000 7f8eaffff640 1 -- 172.21.15.78:0/3487612563 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f8eb811e650 con 0x7f8ec80d0be0 2023-12-12T10:13:28.150 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.145+0000 7f8ec6ffd640 1 --2- 172.21.15.78:0/3487612563 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f8eb40664a0 0x7f8eb4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:28.150 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.145+0000 7f8ec6ffd640 1 --2- 172.21.15.78:0/3487612563 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f8eb40664a0 0x7f8eb4068960 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f8ec8155a70 tx=0x7f8ebc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:28.153 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.149+0000 7f8eaffff640 1 -- 172.21.15.78:0/3487612563 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8eb80ebdf0 con 0x7f8ec80d0be0 2023-12-12T10:13:28.303 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.297+0000 7f8ecdddf640 1 -- 172.21.15.78:0/3487612563 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8ec80d0690 con 0x7f8ec80d0be0 2023-12-12T10:13:28.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.301+0000 7f8eaffff640 1 -- 172.21.15.78:0/3487612563 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v35) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8eb80ef410 con 0x7f8ec80d0be0 2023-12-12T10:13:28.304 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2023-12-12T10:13:28.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.301+0000 7f8ecdddf640 1 -- 172.21.15.78:0/3487612563 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f8eb40664a0 msgr2=0x7f8eb4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:28.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.301+0000 7f8ecdddf640 1 --2- 172.21.15.78:0/3487612563 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f8eb40664a0 0x7f8eb4068960 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f8ec8155a70 tx=0x7f8ebc008040 comp rx=0 tx=0).stop 2023-12-12T10:13:28.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.301+0000 7f8ecdddf640 1 -- 172.21.15.78:0/3487612563 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ec80d0be0 msgr2=0x7f8ec8154640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:28.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.301+0000 7f8ecdddf640 1 --2- 172.21.15.78:0/3487612563 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ec80d0be0 0x7f8ec8154640 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f8eb801aac0 tx=0x7f8eb801ac50 comp rx=0 tx=0).stop 2023-12-12T10:13:28.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.301+0000 7f8ecdddf640 1 -- 172.21.15.78:0/3487612563 shutdown_connections 2023-12-12T10:13:28.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.301+0000 7f8ecdddf640 1 --2- 172.21.15.78:0/3487612563 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f8eb40664a0 0x7f8eb4068960 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:28.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.301+0000 7f8ecdddf640 1 --2- 172.21.15.78:0/3487612563 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8ec8160890 0x7f8ec80ca0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:28.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.301+0000 7f8ecdddf640 1 --2- 172.21.15.78:0/3487612563 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8ec80d1ce0 0x7f8ec80c85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:28.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.301+0000 7f8ecdddf640 1 --2- 172.21.15.78:0/3487612563 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8ec80d0be0 0x7f8ec8154640 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:28.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.301+0000 7f8ecdddf640 1 -- 172.21.15.78:0/3487612563 >> 172.21.15.78:0/3487612563 conn(0x7f8ec809c2f0 msgr2=0x7f8ec80d1560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:28.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.301+0000 7f8ecdddf640 1 -- 172.21.15.78:0/3487612563 shutdown_connections 2023-12-12T10:13:28.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.301+0000 7f8ecdddf640 1 -- 172.21.15.78:0/3487612563 wait complete. 2023-12-12T10:13:28.325 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-12T10:13:28.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.457+0000 7f930c18d640 1 Processor -- start 2023-12-12T10:13:28.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.461+0000 7f930c18d640 1 -- start start 2023-12-12T10:13:28.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.461+0000 7f930c18d640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f930415d0c0 0x7f93040cf070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:28.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.461+0000 7f930c18d640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f93040cddc0 0x7f93040d0050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:28.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.461+0000 7f930c18d640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f930406e5c0 con 0x7f930406f660 2023-12-12T10:13:28.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.461+0000 7f930c18d640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93040ce7f0 con 0x7f93040cddc0 2023-12-12T10:13:28.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.461+0000 7f930c18d640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f930406e8a0 con 0x7f930415d0c0 2023-12-12T10:13:28.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.461+0000 7f930a72a640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f93040cddc0 0x7f93040d0050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:28.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.461+0000 7f930a72a640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f93040cddc0 0x7f93040d0050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50504/0 (socket says 172.21.15.78:50504) 2023-12-12T10:13:28.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.461+0000 7f930a72a640 1 -- 172.21.15.78:0/2919774401 learned_addr learned my addr 172.21.15.78:0/2919774401 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:13:28.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.461+0000 7f9309728640 1 --1- 172.21.15.78:0/2919774401 >> v1:172.21.15.78:6789/0 conn(0x7f930406f660 0x7f93040cd6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:38890/0 (socket says 172.21.15.78:38890) 2023-12-12T10:13:28.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.461+0000 7f9309f29640 1 --2- 172.21.15.78:0/2919774401 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f930415d0c0 0x7f93040cf070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:28.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.461+0000 7f930a72a640 1 -- 172.21.15.78:0/2919774401 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f930415d0c0 msgr2=0x7f93040cf070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:13:28.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.461+0000 7f930a72a640 1 --2- 172.21.15.78:0/2919774401 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f930415d0c0 0x7f93040cf070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:28.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.461+0000 7f930a72a640 1 -- 172.21.15.78:0/2919774401 >> v1:172.21.15.78:6789/0 conn(0x7f930406f660 legacy=0x7f93040cd6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:28.466 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.461+0000 7f930a72a640 1 -- 172.21.15.78:0/2919774401 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f930406eb80 con 0x7f93040cddc0 2023-12-12T10:13:28.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.465+0000 7f930a72a640 1 --2- 172.21.15.78:0/2919774401 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f93040cddc0 0x7f93040d0050 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f92fc009e50 tx=0x7f92fc01c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72fce01f23ca6427 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:28.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.465+0000 7f9308f27640 1 -- 172.21.15.78:0/2919774401 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92fc0a58a0 con 0x7f93040cddc0 2023-12-12T10:13:28.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.465+0000 7f9308f27640 1 -- 172.21.15.78:0/2919774401 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92fc0a5a00 con 0x7f93040cddc0 2023-12-12T10:13:28.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.465+0000 7f9308f27640 1 -- 172.21.15.78:0/2919774401 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92fc0a5d90 con 0x7f93040cddc0 2023-12-12T10:13:28.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.465+0000 7f930c18d640 1 -- 172.21.15.78:0/2919774401 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f93040cddc0 msgr2=0x7f93040d0050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:28.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.465+0000 7f930c18d640 1 --2- 172.21.15.78:0/2919774401 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f93040cddc0 0x7f93040d0050 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f92fc009e50 tx=0x7f92fc01c9e0 comp rx=0 tx=0).stop 2023-12-12T10:13:28.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.465+0000 7f930c18d640 1 -- 172.21.15.78:0/2919774401 shutdown_connections 2023-12-12T10:13:28.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.465+0000 7f930c18d640 1 --2- 172.21.15.78:0/2919774401 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f93040cddc0 0x7f93040d0050 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:28.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.465+0000 7f930c18d640 1 --2- 172.21.15.78:0/2919774401 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f930415d0c0 0x7f93040cf070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:28.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.465+0000 7f930c18d640 1 -- 172.21.15.78:0/2919774401 >> 172.21.15.78:0/2919774401 conn(0x7f93040d0e30 msgr2=0x7f93040d1240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:28.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.465+0000 7f930c18d640 1 -- 172.21.15.78:0/2919774401 shutdown_connections 2023-12-12T10:13:28.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.465+0000 7f930c18d640 1 -- 172.21.15.78:0/2919774401 wait complete. 2023-12-12T10:13:28.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.465+0000 7f930c18d640 1 Processor -- start 2023-12-12T10:13:28.471 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.465+0000 7f930c18d640 1 -- start start 2023-12-12T10:13:28.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.469+0000 7f930c18d640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f930406f660 0x7f93040c64a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:28.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.469+0000 7f930c18d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f93040cddc0 0x7f93041513a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:28.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.469+0000 7f930c18d640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f930415d0c0 0x7f93040c4940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:28.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.469+0000 7f930c18d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93040c7720 con 0x7f93040cddc0 2023-12-12T10:13:28.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.469+0000 7f930c18d640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93040c6aa0 con 0x7f930415d0c0 2023-12-12T10:13:28.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.469+0000 7f930c18d640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93040c6d80 con 0x7f930406f660 2023-12-12T10:13:28.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.469+0000 7f9309728640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f93040cddc0 0x7f93041513a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:28.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.469+0000 7f9309728640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f93040cddc0 0x7f93041513a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50514/0 (socket says 172.21.15.78:50514) 2023-12-12T10:13:28.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.469+0000 7f9309728640 1 -- 172.21.15.78:0/2772267727 learned_addr learned my addr 172.21.15.78:0/2772267727 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:13:28.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.469+0000 7f9309f29640 1 --2- 172.21.15.78:0/2772267727 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f930406f660 0x7f93040c64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:28.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.469+0000 7f930a72a640 1 --2- 172.21.15.78:0/2772267727 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f930415d0c0 0x7f93040c4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:28.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.469+0000 7f9309728640 1 -- 172.21.15.78:0/2772267727 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f930406f660 msgr2=0x7f93040c64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:28.473 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.469+0000 7f9309728640 1 --2- 172.21.15.78:0/2772267727 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f930406f660 0x7f93040c64a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:28.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.469+0000 7f9309728640 1 -- 172.21.15.78:0/2772267727 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f930415d0c0 msgr2=0x7f93040c4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:28.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.469+0000 7f9309728640 1 --2- 172.21.15.78:0/2772267727 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f930415d0c0 0x7f93040c4940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:28.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.469+0000 7f9309728640 1 -- 172.21.15.78:0/2772267727 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92fc009b30 con 0x7f93040cddc0 2023-12-12T10:13:28.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.469+0000 7f9309728640 1 --2- 172.21.15.78:0/2772267727 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f93040cddc0 0x7f93041513a0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f92f400c490 tx=0x7f92f400c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:28.474 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.469+0000 7f92fa7fc640 1 -- 172.21.15.78:0/2772267727 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92f4007480 con 0x7f93040cddc0 2023-12-12T10:13:28.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.469+0000 7f92fa7fc640 1 -- 172.21.15.78:0/2772267727 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92f40075e0 con 0x7f93040cddc0 2023-12-12T10:13:28.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.469+0000 7f92fa7fc640 1 -- 172.21.15.78:0/2772267727 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92f4004a10 con 0x7f93040cddc0 2023-12-12T10:13:28.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.469+0000 7f930c18d640 1 -- 172.21.15.78:0/2772267727 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93040c7060 con 0x7f93040cddc0 2023-12-12T10:13:28.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.469+0000 7f930c18d640 1 -- 172.21.15.78:0/2772267727 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93041518e0 con 0x7f93040cddc0 2023-12-12T10:13:28.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.469+0000 7f930c18d640 1 -- 172.21.15.78:0/2772267727 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9304067530 con 0x7f93040cddc0 2023-12-12T10:13:28.475 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.473+0000 7f92fa7fc640 1 -- 172.21.15.78:0/2772267727 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f92f4004b70 con 0x7f93040cddc0 2023-12-12T10:13:28.476 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.473+0000 7f92fa7fc640 1 --2- 172.21.15.78:0/2772267727 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f92e8066470 0x7f92e8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:28.476 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.473+0000 7f92fa7fc640 1 -- 172.21.15.78:0/2772267727 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f92f4082d80 con 0x7f93040cddc0 2023-12-12T10:13:28.476 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.473+0000 7f9309f29640 1 --2- 172.21.15.78:0/2772267727 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f92e8066470 0x7f92e8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:28.477 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.473+0000 7f9309f29640 1 --2- 172.21.15.78:0/2772267727 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f92e8066470 0x7f92e8068930 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f93000079c0 tx=0x7f9300008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:28.480 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.477+0000 7f92fa7fc640 1 -- 172.21.15.78:0/2772267727 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f92f40504c0 con 0x7f93040cddc0 2023-12-12T10:13:28.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.625+0000 7f930c18d640 1 -- 172.21.15.78:0/2772267727 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f9304166f20 con 0x7f93040cddc0 2023-12-12T10:13:28.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.625+0000 7f92fa7fc640 1 -- 172.21.15.78:0/2772267727 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v35) v1 ==== 84+0+65 (secure 0 0 0) 0x7f92f4018090 con 0x7f93040cddc0 2023-12-12T10:13:28.631 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:13:28.631 INFO:teuthology.orchestra.run.smithi078.stdout:[ 2023-12-12T10:13:28.631 INFO:teuthology.orchestra.run.smithi078.stdout: { 2023-12-12T10:13:28.631 INFO:teuthology.orchestra.run.smithi078.stdout: "poolnum": 1, 2023-12-12T10:13:28.631 INFO:teuthology.orchestra.run.smithi078.stdout: "poolname": ".mgr" 2023-12-12T10:13:28.632 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-12-12T10:13:28.632 INFO:teuthology.orchestra.run.smithi078.stdout:] 2023-12-12T10:13:28.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.629+0000 7f930c18d640 1 -- 172.21.15.78:0/2772267727 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f92e8066470 msgr2=0x7f92e8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:28.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.629+0000 7f930c18d640 1 --2- 172.21.15.78:0/2772267727 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f92e8066470 0x7f92e8068930 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f93000079c0 tx=0x7f9300008040 comp rx=0 tx=0).stop 2023-12-12T10:13:28.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.629+0000 7f930c18d640 1 -- 172.21.15.78:0/2772267727 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f93040cddc0 msgr2=0x7f93041513a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:28.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.629+0000 7f930c18d640 1 --2- 172.21.15.78:0/2772267727 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f93040cddc0 0x7f93041513a0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f92f400c490 tx=0x7f92f400c950 comp rx=0 tx=0).stop 2023-12-12T10:13:28.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.629+0000 7f930c18d640 1 -- 172.21.15.78:0/2772267727 shutdown_connections 2023-12-12T10:13:28.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.629+0000 7f930c18d640 1 --2- 172.21.15.78:0/2772267727 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f92e8066470 0x7f92e8068930 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:28.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.629+0000 7f930c18d640 1 --2- 172.21.15.78:0/2772267727 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f930415d0c0 0x7f93040c4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:28.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.629+0000 7f930c18d640 1 --2- 172.21.15.78:0/2772267727 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f93040cddc0 0x7f93041513a0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:28.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.629+0000 7f930c18d640 1 --2- 172.21.15.78:0/2772267727 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f930406f660 0x7f93040c64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:28.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.629+0000 7f930c18d640 1 -- 172.21.15.78:0/2772267727 >> 172.21.15.78:0/2772267727 conn(0x7f93040d0e30 msgr2=0x7f93040ae5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:28.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.629+0000 7f930c18d640 1 -- 172.21.15.78:0/2772267727 shutdown_connections 2023-12-12T10:13:28.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.629+0000 7f930c18d640 1 -- 172.21.15.78:0/2772267727 wait complete. 2023-12-12T10:13:28.652 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-12T10:13:28.652 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-12T10:13:28.792 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.789+0000 7f8f1a206640 1 Processor -- start 2023-12-12T10:13:28.793 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.789+0000 7f8f1a206640 1 -- start start 2023-12-12T10:13:28.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.789+0000 7f8f1a206640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8f140cf6a0 0x7f8f14165ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:28.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.789+0000 7f8f1a206640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f140adc00 con 0x7f8f140d1210 2023-12-12T10:13:28.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.789+0000 7f8f1a206640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f140ad8b0 con 0x7f8f1415ae40 2023-12-12T10:13:28.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.789+0000 7f8f1a206640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f1406fbd0 con 0x7f8f140cf6a0 2023-12-12T10:13:28.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.789+0000 7f8f18a03640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f8f140d1210 0x7f8f140cef90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:38904/0 (socket says 172.21.15.78:38904) 2023-12-12T10:13:28.794 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.789+0000 7f8f18a03640 1 -- 172.21.15.78:0/1300803591 learned_addr learned my addr 172.21.15.78:0/1300803591 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-12-12T10:13:28.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.789+0000 7f8f19a05640 1 --2- 172.21.15.78:0/1300803591 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8f140cf6a0 0x7f8f14165ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:28.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.789+0000 7f8f0bfff640 1 -- 172.21.15.78:0/1300803591 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3387061084 0 0) 0x7f8f140adc00 con 0x7f8f140d1210 2023-12-12T10:13:28.795 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.789+0000 7f8f0bfff640 1 -- 172.21.15.78:0/1300803591 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f00003530 con 0x7f8f140d1210 2023-12-12T10:13:28.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.789+0000 7f8f0bfff640 1 -- 172.21.15.78:0/1300803591 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4207576091 0 0) 0x7f8f140ad8b0 con 0x7f8f1415ae40 2023-12-12T10:13:28.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.789+0000 7f8f0bfff640 1 -- 172.21.15.78:0/1300803591 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f140adc00 con 0x7f8f1415ae40 2023-12-12T10:13:28.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.789+0000 7f8f19a05640 1 -- 172.21.15.78:0/1300803591 >> v1:172.21.15.187:6789/0 conn(0x7f8f1415ae40 legacy=0x7f8f1406f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:28.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.789+0000 7f8f19a05640 1 -- 172.21.15.78:0/1300803591 >> v1:172.21.15.78:6789/0 conn(0x7f8f140d1210 legacy=0x7f8f140cef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:28.796 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.789+0000 7f8f19a05640 1 -- 172.21.15.78:0/1300803591 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f1406feb0 con 0x7f8f140cf6a0 2023-12-12T10:13:28.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.793+0000 7f8f19a05640 1 --2- 172.21.15.78:0/1300803591 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8f140cf6a0 0x7f8f14165ce0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8f0c009dc0 tx=0x7f8f0c01c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=114880ae98ced152 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:28.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.793+0000 7f8f0bfff640 1 -- 172.21.15.78:0/1300803591 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f0c0a58c0 con 0x7f8f140cf6a0 2023-12-12T10:13:28.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.793+0000 7f8f0bfff640 1 -- 172.21.15.78:0/1300803591 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f0c0a5a20 con 0x7f8f140cf6a0 2023-12-12T10:13:28.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.793+0000 7f8f0bfff640 1 -- 172.21.15.78:0/1300803591 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f0c0a5db0 con 0x7f8f140cf6a0 2023-12-12T10:13:28.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.793+0000 7f8f1a206640 1 -- 172.21.15.78:0/1300803591 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8f140cf6a0 msgr2=0x7f8f14165ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:28.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.793+0000 7f8f1a206640 1 --2- 172.21.15.78:0/1300803591 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8f140cf6a0 0x7f8f14165ce0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8f0c009dc0 tx=0x7f8f0c01c970 comp rx=0 tx=0).stop 2023-12-12T10:13:28.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.793+0000 7f8f1a206640 1 -- 172.21.15.78:0/1300803591 shutdown_connections 2023-12-12T10:13:28.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.793+0000 7f8f1a206640 1 --2- 172.21.15.78:0/1300803591 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8f140cf6a0 0x7f8f14165ce0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:28.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.793+0000 7f8f1a206640 1 -- 172.21.15.78:0/1300803591 >> 172.21.15.78:0/1300803591 conn(0x7f8f14099a10 msgr2=0x7f8f14099e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:28.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.797+0000 7f8f1a206640 1 -- 172.21.15.78:0/1300803591 shutdown_connections 2023-12-12T10:13:28.800 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.797+0000 7f8f1a206640 1 -- 172.21.15.78:0/1300803591 wait complete. 2023-12-12T10:13:28.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.797+0000 7f8f1a206640 1 Processor -- start 2023-12-12T10:13:28.801 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.797+0000 7f8f1a206640 1 -- start start 2023-12-12T10:13:28.803 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.797+0000 7f8f1a206640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8f140cf6a0 0x7f8f140c91d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:28.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.797+0000 7f8f1a206640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f140d1210 0x7f8f14154aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:28.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.797+0000 7f8f1a206640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8f1415ae40 0x7f8f140c6f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:28.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.797+0000 7f8f1a206640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f140c5be0 con 0x7f8f140d1210 2023-12-12T10:13:28.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.797+0000 7f8f1a206640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f140c5ec0 con 0x7f8f1415ae40 2023-12-12T10:13:28.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.797+0000 7f8f1a206640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f140c61a0 con 0x7f8f140cf6a0 2023-12-12T10:13:28.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.797+0000 7f8f18a03640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f140d1210 0x7f8f14154aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:28.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.797+0000 7f8f18a03640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f140d1210 0x7f8f14154aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:50530/0 (socket says 172.21.15.78:50530) 2023-12-12T10:13:28.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.797+0000 7f8f18a03640 1 -- 172.21.15.78:0/383009470 learned_addr learned my addr 172.21.15.78:0/383009470 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:13:28.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.797+0000 7f8f19a05640 1 --2- 172.21.15.78:0/383009470 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8f1415ae40 0x7f8f140c6f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:28.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.797+0000 7f8f19204640 1 --2- 172.21.15.78:0/383009470 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8f140cf6a0 0x7f8f140c91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:28.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.797+0000 7f8f18a03640 1 -- 172.21.15.78:0/383009470 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8f140cf6a0 msgr2=0x7f8f140c91d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:28.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.797+0000 7f8f18a03640 1 --2- 172.21.15.78:0/383009470 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8f140cf6a0 0x7f8f140c91d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:28.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.797+0000 7f8f18a03640 1 -- 172.21.15.78:0/383009470 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8f1415ae40 msgr2=0x7f8f140c6f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:28.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.797+0000 7f8f18a03640 1 --2- 172.21.15.78:0/383009470 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8f1415ae40 0x7f8f140c6f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:28.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.797+0000 7f8f18a03640 1 -- 172.21.15.78:0/383009470 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f0c009a70 con 0x7f8f140d1210 2023-12-12T10:13:28.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.797+0000 7f8f19a05640 1 --2- 172.21.15.78:0/383009470 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8f1415ae40 0x7f8f140c6f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T10:13:28.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.797+0000 7f8f19204640 1 --2- 172.21.15.78:0/383009470 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8f140cf6a0 0x7f8f140c91d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T10:13:28.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.797+0000 7f8f18a03640 1 --2- 172.21.15.78:0/383009470 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f140d1210 0x7f8f14154aa0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f8f04005890 tx=0x7f8f0400c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:28.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.801+0000 7f8f09ffb640 1 -- 172.21.15.78:0/383009470 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f04005cf0 con 0x7f8f140d1210 2023-12-12T10:13:28.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.801+0000 7f8f09ffb640 1 -- 172.21.15.78:0/383009470 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f04005e50 con 0x7f8f140d1210 2023-12-12T10:13:28.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.801+0000 7f8f09ffb640 1 -- 172.21.15.78:0/383009470 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f04007270 con 0x7f8f140d1210 2023-12-12T10:13:28.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.801+0000 7f8f1a206640 1 -- 172.21.15.78:0/383009470 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f140c6480 con 0x7f8f140d1210 2023-12-12T10:13:28.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.801+0000 7f8f1a206640 1 -- 172.21.15.78:0/383009470 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f140c6a40 con 0x7f8f140d1210 2023-12-12T10:13:28.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.801+0000 7f8f1a206640 1 -- 172.21.15.78:0/383009470 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f14074610 con 0x7f8f140d1210 2023-12-12T10:13:28.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.801+0000 7f8f09ffb640 1 -- 172.21.15.78:0/383009470 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f8f040073d0 con 0x7f8f140d1210 2023-12-12T10:13:28.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.801+0000 7f8f09ffb640 1 --2- 172.21.15.78:0/383009470 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f8ef8066470 0x7f8ef8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:28.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.801+0000 7f8f09ffb640 1 -- 172.21.15.78:0/383009470 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f8f04083140 con 0x7f8f140d1210 2023-12-12T10:13:28.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.801+0000 7f8f19204640 1 --2- 172.21.15.78:0/383009470 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f8ef8066470 0x7f8ef8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:28.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.805+0000 7f8f19204640 1 --2- 172.21.15.78:0/383009470 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f8ef8066470 0x7f8ef8068930 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f8f100011f0 tx=0x7f8f10009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:28.810 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.805+0000 7f8f09ffb640 1 -- 172.21.15.78:0/383009470 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8f04050870 con 0x7f8f140d1210 2023-12-12T10:13:28.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:28.957+0000 7f8f1a206640 1 -- 172.21.15.78:0/383009470 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f8f140cdea0 con 0x7f8f140d1210 2023-12-12T10:13:29.932 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:29.929+0000 7f8f09ffb640 1 -- 172.21.15.78:0/383009470 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v36) v1 ==== 138+0+0 (secure 0 0 0) 0x7f8f04053e90 con 0x7f8f140d1210 2023-12-12T10:13:29.932 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_metadata' created 2023-12-12T10:13:29.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:29.929+0000 7f8f1a206640 1 -- 172.21.15.78:0/383009470 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f8ef8066470 msgr2=0x7f8ef8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:29.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:29.929+0000 7f8f1a206640 1 --2- 172.21.15.78:0/383009470 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f8ef8066470 0x7f8ef8068930 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f8f100011f0 tx=0x7f8f10009040 comp rx=0 tx=0).stop 2023-12-12T10:13:29.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:29.929+0000 7f8f1a206640 1 -- 172.21.15.78:0/383009470 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f140d1210 msgr2=0x7f8f14154aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:29.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:29.929+0000 7f8f1a206640 1 --2- 172.21.15.78:0/383009470 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f140d1210 0x7f8f14154aa0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f8f04005890 tx=0x7f8f0400c980 comp rx=0 tx=0).stop 2023-12-12T10:13:29.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:29.929+0000 7f8f1a206640 1 -- 172.21.15.78:0/383009470 shutdown_connections 2023-12-12T10:13:29.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:29.929+0000 7f8f1a206640 1 --2- 172.21.15.78:0/383009470 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f8ef8066470 0x7f8ef8068930 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:29.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:29.929+0000 7f8f1a206640 1 --2- 172.21.15.78:0/383009470 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8f1415ae40 0x7f8f140c6f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:29.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:29.929+0000 7f8f1a206640 1 --2- 172.21.15.78:0/383009470 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8f140d1210 0x7f8f14154aa0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:29.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:29.929+0000 7f8f1a206640 1 --2- 172.21.15.78:0/383009470 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8f140cf6a0 0x7f8f140c91d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:29.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:29.929+0000 7f8f1a206640 1 -- 172.21.15.78:0/383009470 >> 172.21.15.78:0/383009470 conn(0x7f8f14099a10 msgr2=0x7f8f140b1df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:29.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:29.929+0000 7f8f1a206640 1 -- 172.21.15.78:0/383009470 shutdown_connections 2023-12-12T10:13:29.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:29.929+0000 7f8f1a206640 1 -- 172.21.15.78:0/383009470 wait complete. 2023-12-12T10:13:29.963 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-12T10:13:30.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:30.109+0000 7f063a1f5640 1 Processor -- start 2023-12-12T10:13:30.112 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:30.109+0000 7f063a1f5640 1 -- start start 2023-12-12T10:13:30.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:30.109+0000 7f063a1f5640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f063415aec0 0x7f063415e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:30.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:30.109+0000 7f063a1f5640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f063406afb0 0x7f06340cc410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:30.114 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:30.109+0000 7f063a1f5640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f063415d8a0 con 0x7f063406b460 2023-12-12T10:13:30.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:30.109+0000 7f063a1f5640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f063415daf0 con 0x7f063406afb0 2023-12-12T10:13:30.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:30.109+0000 7f063a1f5640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f063406b990 con 0x7f063415aec0 2023-12-12T10:13:30.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:30.109+0000 7f0632ffd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f063406afb0 0x7f06340cc410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:30.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:30.109+0000 7f0632ffd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f063406afb0 0x7f06340cc410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33458/0 (socket says 172.21.15.78:33458) 2023-12-12T10:13:30.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:30.109+0000 7f0632ffd640 1 -- 172.21.15.78:0/1093480497 learned_addr learned my addr 172.21.15.78:0/1093480497 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:13:30.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:30.109+0000 7f06337fe640 1 --2- 172.21.15.78:0/1093480497 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f063415aec0 0x7f063415e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:30.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:30.109+0000 7f0632ffd640 1 -- 172.21.15.78:0/1093480497 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f063415aec0 msgr2=0x7f063415e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:13:30.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:30.109+0000 7f0632ffd640 1 --2- 172.21.15.78:0/1093480497 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f063415aec0 0x7f063415e2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:30.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:30.109+0000 7f0632ffd640 1 -- 172.21.15.78:0/1093480497 >> v1:172.21.15.187:6789/0 conn(0x7f063406b460 legacy=0x7f063406d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:13:30.115 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:30.109+0000 7f0632ffd640 1 -- 172.21.15.78:0/1093480497 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f063406bc70 con 0x7f063406afb0 2023-12-12T10:13:30.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:30.113+0000 7f0632ffd640 1 --2- 172.21.15.78:0/1093480497 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f063406afb0 0x7f06340cc410 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f0628009870 tx=0x7f062801c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a86554ae87a658a server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:30.117 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:30.113+0000 7f06327fc640 1 -- 172.21.15.78:0/1093480497 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06280ac620 con 0x7f063406afb0 2023-12-12T10:13:30.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:30.113+0000 7f06327fc640 1 -- 172.21.15.78:0/1093480497 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06280ac780 con 0x7f063406afb0 2023-12-12T10:13:30.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:30.113+0000 7f06327fc640 1 -- 172.21.15.78:0/1093480497 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06280acb10 con 0x7f063406afb0 2023-12-12T10:13:30.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:30.113+0000 7f063a1f5640 1 -- 172.21.15.78:0/1093480497 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f063406afb0 msgr2=0x7f06340cc410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:30.118 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:30.113+0000 7f063a1f5640 1 --2- 172.21.15.78:0/1093480497 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f063406afb0 0x7f06340cc410 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f0628009870 tx=0x7f062801c4b0 comp rx=0 tx=0).stop 2023-12-12T10:13:30.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:30.113+0000 7f063a1f5640 1 -- 172.21.15.78:0/1093480497 shutdown_connections 2023-12-12T10:13:30.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:30.113+0000 7f063a1f5640 1 --2- 172.21.15.78:0/1093480497 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f063406afb0 0x7f06340cc410 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:30.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:30.113+0000 7f063a1f5640 1 --2- 172.21.15.78:0/1093480497 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f063415aec0 0x7f063415e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:30.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:30.113+0000 7f063a1f5640 1 -- 172.21.15.78:0/1093480497 >> 172.21.15.78:0/1093480497 conn(0x7f06340b1650 msgr2=0x7f06340b1a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:30.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:30.113+0000 7f063a1f5640 1 -- 172.21.15.78:0/1093480497 shutdown_connections 2023-12-12T10:13:30.119 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:30.113+0000 7f063a1f5640 1 -- 172.21.15.78:0/1093480497 wait complete. 2023-12-12T10:13:30.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:30.117+0000 7f063a1f5640 1 Processor -- start 2023-12-12T10:13:30.120 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:30.117+0000 7f063a1f5640 1 -- start start 2023-12-12T10:13:30.123 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:30.117+0000 7f063a1f5640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f063406afb0 0x7f06340b34c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:30.123 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:30.117+0000 7f063a1f5640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f063406b460 0x7f0634152bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:30.123 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:30.117+0000 7f063a1f5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f063415aec0 0x7f0634153100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:30.123 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:30.117+0000 7f063a1f5640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f063415a0f0 con 0x7f063415aec0 2023-12-12T10:13:30.123 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:30.117+0000 7f063a1f5640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0634153640 con 0x7f063406b460 2023-12-12T10:13:30.123 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:30.117+0000 7f063a1f5640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0634159470 con 0x7f063406afb0 2023-12-12T10:13:30.123 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:30.117+0000 7f0633fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f063415aec0 0x7f0634153100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:30.123 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:30.117+0000 7f0633fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f063415aec0 0x7f0634153100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33468/0 (socket says 172.21.15.78:33468) 2023-12-12T10:13:30.123 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:30.117+0000 7f0633fff640 1 -- 172.21.15.78:0/3112180913 learned_addr learned my addr 172.21.15.78:0/3112180913 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:13:30.124 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:30.117+0000 7f06337fe640 1 --2- 172.21.15.78:0/3112180913 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f063406afb0 0x7f06340b34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:30.124 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:30.117+0000 7f0632ffd640 1 --2- 172.21.15.78:0/3112180913 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f063406b460 0x7f0634152bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:30.124 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:30.117+0000 7f0633fff640 1 -- 172.21.15.78:0/3112180913 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f063406afb0 msgr2=0x7f06340b34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:30.124 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:30.117+0000 7f0633fff640 1 --2- 172.21.15.78:0/3112180913 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f063406afb0 0x7f06340b34c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:30.124 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:30.117+0000 7f0633fff640 1 -- 172.21.15.78:0/3112180913 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f063406b460 msgr2=0x7f0634152bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:30.124 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:30.117+0000 7f0633fff640 1 --2- 172.21.15.78:0/3112180913 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f063406b460 0x7f0634152bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:30.124 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:30.117+0000 7f0633fff640 1 -- 172.21.15.78:0/3112180913 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06280094d0 con 0x7f063415aec0 2023-12-12T10:13:30.124 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:30.117+0000 7f0633fff640 1 --2- 172.21.15.78:0/3112180913 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f063415aec0 0x7f0634153100 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f062c00c730 tx=0x7f062c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:30.124 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:30.117+0000 7f061bfff640 1 -- 172.21.15.78:0/3112180913 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f062c003b80 con 0x7f063415aec0 2023-12-12T10:13:30.124 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:30.117+0000 7f061bfff640 1 -- 172.21.15.78:0/3112180913 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f062c003ce0 con 0x7f063415aec0 2023-12-12T10:13:30.124 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:30.117+0000 7f061bfff640 1 -- 172.21.15.78:0/3112180913 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f062c00aa30 con 0x7f063415aec0 2023-12-12T10:13:30.124 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:30.117+0000 7f063a1f5640 1 -- 172.21.15.78:0/3112180913 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f063406e3e0 con 0x7f063415aec0 2023-12-12T10:13:30.124 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:30.117+0000 7f063a1f5640 1 -- 172.21.15.78:0/3112180913 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0634159a30 con 0x7f063415aec0 2023-12-12T10:13:30.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:30.121+0000 7f063a1f5640 1 -- 172.21.15.78:0/3112180913 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f063415a230 con 0x7f063415aec0 2023-12-12T10:13:30.125 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:30.121+0000 7f061bfff640 1 -- 172.21.15.78:0/3112180913 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f062c00ab90 con 0x7f063415aec0 2023-12-12T10:13:30.126 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:30.121+0000 7f061bfff640 1 --2- 172.21.15.78:0/3112180913 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f0620066470 0x7f0620068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:30.126 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:30.121+0000 7f061bfff640 1 -- 172.21.15.78:0/3112180913 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5547+0+0 (secure 0 0 0) 0x7f062c083ae0 con 0x7f063415aec0 2023-12-12T10:13:30.126 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:30.121+0000 7f06337fe640 1 --2- 172.21.15.78:0/3112180913 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f0620066470 0x7f0620068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:30.126 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:30.121+0000 7f06337fe640 1 --2- 172.21.15.78:0/3112180913 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f0620066470 0x7f0620068930 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f06340cc800 tx=0x7f0624008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:30.130 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:30.125+0000 7f061bfff640 1 -- 172.21.15.78:0/3112180913 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f063415a230 con 0x7f063415aec0 2023-12-12T10:13:30.279 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:30.277+0000 7f063a1f5640 1 -- 172.21.15.78:0/3112180913 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f063415a230 con 0x7f063415aec0 2023-12-12T10:13:30.935 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:30.929+0000 7f061bfff640 1 -- 172.21.15.78:0/3112180913 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v37) v1 ==== 170+0+0 (secure 0 0 0) 0x7f063415a230 con 0x7f063415aec0 2023-12-12T10:13:30.935 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_data' created 2023-12-12T10:13:30.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:30.933+0000 7f063a1f5640 1 -- 172.21.15.78:0/3112180913 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f0620066470 msgr2=0x7f0620068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:30.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:30.933+0000 7f063a1f5640 1 --2- 172.21.15.78:0/3112180913 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f0620066470 0x7f0620068930 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f06340cc800 tx=0x7f0624008040 comp rx=0 tx=0).stop 2023-12-12T10:13:30.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:30.933+0000 7f063a1f5640 1 -- 172.21.15.78:0/3112180913 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f063415aec0 msgr2=0x7f0634153100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:30.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:30.933+0000 7f063a1f5640 1 --2- 172.21.15.78:0/3112180913 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f063415aec0 0x7f0634153100 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f062c00c730 tx=0x7f062c00cbf0 comp rx=0 tx=0).stop 2023-12-12T10:13:30.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:30.933+0000 7f063a1f5640 1 -- 172.21.15.78:0/3112180913 shutdown_connections 2023-12-12T10:13:30.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:30.933+0000 7f063a1f5640 1 --2- 172.21.15.78:0/3112180913 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f0620066470 0x7f0620068930 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:30.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:30.933+0000 7f063a1f5640 1 --2- 172.21.15.78:0/3112180913 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f063415aec0 0x7f0634153100 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:30.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:30.933+0000 7f063a1f5640 1 --2- 172.21.15.78:0/3112180913 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f063406b460 0x7f0634152bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:30.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:30.933+0000 7f063a1f5640 1 --2- 172.21.15.78:0/3112180913 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f063406afb0 0x7f06340b34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:30.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:30.933+0000 7f063a1f5640 1 -- 172.21.15.78:0/3112180913 >> 172.21.15.78:0/3112180913 conn(0x7f06340b1650 msgr2=0x7f0634154060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:30.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:30.933+0000 7f063a1f5640 1 -- 172.21.15.78:0/3112180913 shutdown_connections 2023-12-12T10:13:30.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:30.937+0000 7f063a1f5640 1 -- 172.21.15.78:0/3112180913 wait complete. 2023-12-12T10:13:30.979 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-12T10:13:31.121 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:31.117+0000 7f85a1bf8640 1 Processor -- start 2023-12-12T10:13:31.121 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:31.117+0000 7f85a1bf8640 1 -- start start 2023-12-12T10:13:31.123 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:31.117+0000 7f85a1bf8640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f859c15d2f0 0x7f859c0722c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:31.123 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:31.117+0000 7f85a1bf8640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f859c06de70 0x7f859c0abe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:31.123 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:31.117+0000 7f85a1bf8640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f859c15d6d0 con 0x7f859c06d9f0 2023-12-12T10:13:31.123 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:31.117+0000 7f85a1bf8640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f859c070ea0 con 0x7f859c06de70 2023-12-12T10:13:31.123 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:31.117+0000 7f85a1bf8640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f859c070600 con 0x7f859c15d2f0 2023-12-12T10:13:31.123 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:31.117+0000 7f859bfff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f859c06de70 0x7f859c0abe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:31.123 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:31.117+0000 7f8593fff640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f859c06d9f0 0x7f859c0b36e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:33406/0 (socket says 172.21.15.78:33406) 2023-12-12T10:13:31.123 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:31.117+0000 7f859bfff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f859c06de70 0x7f859c0abe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33484/0 (socket says 172.21.15.78:33484) 2023-12-12T10:13:31.124 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:31.117+0000 7f8593fff640 1 -- 172.21.15.78:0/1119205370 learned_addr learned my addr 172.21.15.78:0/1119205370 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-12-12T10:13:31.124 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:31.117+0000 7f859b7fe640 1 --2- 172.21.15.78:0/1119205370 >> v2:172.21.15.187:3300/0 conn(0x7f859c15d2f0 0x7f859c0722c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:31.124 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:31.121+0000 7f859bfff640 1 -- 172.21.15.78:0/1119205370 >> v2:172.21.15.187:3300/0 conn(0x7f859c15d2f0 msgr2=0x7f859c0722c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:13:31.124 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:31.121+0000 7f859bfff640 1 --2- 172.21.15.78:0/1119205370 >> v2:172.21.15.187:3300/0 conn(0x7f859c15d2f0 0x7f859c0722c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:31.124 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:31.121+0000 7f859bfff640 1 -- 172.21.15.78:0/1119205370 >> v1:172.21.15.78:6789/0 conn(0x7f859c06d9f0 legacy=0x7f859c0b36e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:31.124 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:31.121+0000 7f859bfff640 1 -- 172.21.15.78:0/1119205370 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f859c0708e0 con 0x7f859c06de70 2023-12-12T10:13:31.126 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:31.121+0000 7f859bfff640 1 --2- 172.21.15.78:0/1119205370 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f859c06de70 0x7f859c0abe90 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f859c06f1b0 tx=0x7f859401c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c6d2f5376c9c439 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:31.126 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:31.121+0000 7f859affd640 1 -- 172.21.15.78:0/1119205370 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85940a5910 con 0x7f859c06de70 2023-12-12T10:13:31.127 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:31.121+0000 7f859affd640 1 -- 172.21.15.78:0/1119205370 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85940a5a70 con 0x7f859c06de70 2023-12-12T10:13:31.127 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:31.121+0000 7f859affd640 1 -- 172.21.15.78:0/1119205370 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85940a5e00 con 0x7f859c06de70 2023-12-12T10:13:31.127 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:31.121+0000 7f85a1bf8640 1 -- 172.21.15.78:0/1119205370 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f859c06de70 msgr2=0x7f859c0abe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:31.128 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:31.121+0000 7f85a1bf8640 1 --2- 172.21.15.78:0/1119205370 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f859c06de70 0x7f859c0abe90 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f859c06f1b0 tx=0x7f859401c850 comp rx=0 tx=0).stop 2023-12-12T10:13:31.128 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:31.121+0000 7f85a1bf8640 1 -- 172.21.15.78:0/1119205370 shutdown_connections 2023-12-12T10:13:31.128 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:31.121+0000 7f85a1bf8640 1 --2- 172.21.15.78:0/1119205370 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f859c06de70 0x7f859c0abe90 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:31.128 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:31.121+0000 7f85a1bf8640 1 --2- 172.21.15.78:0/1119205370 >> v2:172.21.15.187:3300/0 conn(0x7f859c15d2f0 0x7f859c0722c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:31.128 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:31.121+0000 7f85a1bf8640 1 -- 172.21.15.78:0/1119205370 >> 172.21.15.78:0/1119205370 conn(0x7f859c0b0bb0 msgr2=0x7f859c0b0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:31.128 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:31.125+0000 7f85a1bf8640 1 -- 172.21.15.78:0/1119205370 shutdown_connections 2023-12-12T10:13:31.128 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:31.125+0000 7f85a1bf8640 1 -- 172.21.15.78:0/1119205370 wait complete. 2023-12-12T10:13:31.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:31.125+0000 7f85a1bf8640 1 Processor -- start 2023-12-12T10:13:31.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:31.125+0000 7f85a1bf8640 1 -- start start 2023-12-12T10:13:31.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:31.125+0000 7f85a1bf8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f859c06d9f0 0x7f859c1518e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:31.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:31.125+0000 7f85a1bf8640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f859c06de70 0x7f859c156f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:31.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:31.125+0000 7f85a1bf8640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f859c15d2f0 0x7f859c0af0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:31.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:31.125+0000 7f85a1bf8640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f859c150840 con 0x7f859c06d9f0 2023-12-12T10:13:31.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:31.125+0000 7f85a1bf8640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f859c150b20 con 0x7f859c06de70 2023-12-12T10:13:31.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:31.125+0000 7f85a1bf8640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f859c150e00 con 0x7f859c15d2f0 2023-12-12T10:13:31.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:31.125+0000 7f859b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f859c06d9f0 0x7f859c1518e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:31.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:31.125+0000 7f859b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f859c06d9f0 0x7f859c1518e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33492/0 (socket says 172.21.15.78:33492) 2023-12-12T10:13:31.133 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:31.125+0000 7f859b7fe640 1 -- 172.21.15.78:0/3056373392 learned_addr learned my addr 172.21.15.78:0/3056373392 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:13:31.133 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:31.125+0000 7f859b7fe640 1 -- 172.21.15.78:0/3056373392 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f859c15d2f0 msgr2=0x7f859c0af0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:31.133 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:31.125+0000 7f859b7fe640 1 --2- 172.21.15.78:0/3056373392 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f859c15d2f0 0x7f859c0af0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:31.133 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:31.125+0000 7f859b7fe640 1 -- 172.21.15.78:0/3056373392 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f859c06de70 msgr2=0x7f859c156f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:31.133 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:31.125+0000 7f859b7fe640 1 --2- 172.21.15.78:0/3056373392 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f859c06de70 0x7f859c156f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:31.133 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:31.125+0000 7f859b7fe640 1 -- 172.21.15.78:0/3056373392 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8594009a70 con 0x7f859c06d9f0 2023-12-12T10:13:31.133 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:31.125+0000 7f859b7fe640 1 --2- 172.21.15.78:0/3056373392 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f859c06d9f0 0x7f859c1518e0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f858c00e870 tx=0x7f858c00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:31.133 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:31.125+0000 7f8598ff9640 1 -- 172.21.15.78:0/3056373392 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f858c00eec0 con 0x7f859c06d9f0 2023-12-12T10:13:31.133 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:31.125+0000 7f8598ff9640 1 -- 172.21.15.78:0/3056373392 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f858c00c940 con 0x7f859c06d9f0 2023-12-12T10:13:31.133 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:31.125+0000 7f8598ff9640 1 -- 172.21.15.78:0/3056373392 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f858c00ccb0 con 0x7f859c06d9f0 2023-12-12T10:13:31.133 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:31.125+0000 7f85a1bf8640 1 -- 172.21.15.78:0/3056373392 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f859c1510e0 con 0x7f859c06d9f0 2023-12-12T10:13:31.133 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:31.125+0000 7f85a1bf8640 1 -- 172.21.15.78:0/3056373392 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f859c157480 con 0x7f859c06d9f0 2023-12-12T10:13:31.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:31.129+0000 7f85a1bf8640 1 -- 172.21.15.78:0/3056373392 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f859c067530 con 0x7f859c06d9f0 2023-12-12T10:13:31.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:31.129+0000 7f8598ff9640 1 -- 172.21.15.78:0/3056373392 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f858c013470 con 0x7f859c06d9f0 2023-12-12T10:13:31.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:31.129+0000 7f8598ff9640 1 --2- 172.21.15.78:0/3056373392 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f857c066470 0x7f857c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:31.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:31.129+0000 7f8598ff9640 1 -- 172.21.15.78:0/3056373392 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5929+0+0 (secure 0 0 0) 0x7f858c084070 con 0x7f859c06d9f0 2023-12-12T10:13:31.134 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:31.129+0000 7f8593fff640 1 --2- 172.21.15.78:0/3056373392 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f857c066470 0x7f857c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:31.135 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:31.129+0000 7f8593fff640 1 --2- 172.21.15.78:0/3056373392 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f857c066470 0x7f857c068930 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f8584000f70 tx=0x7f8584007a90 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:31.139 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:31.133+0000 7f8598ff9640 1 -- 172.21.15.78:0/3056373392 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f858c0b5280 con 0x7f859c06d9f0 2023-12-12T10:13:31.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:31.317+0000 7f85a1bf8640 1 -- 172.21.15.78:0/3056373392 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f859c0ced80 con 0x7f859c06d9f0 2023-12-12T10:13:32.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.009+0000 7f8598ff9640 1 -- 172.21.15.78:0/3056373392 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v13) v1 ==== 172+0+0 (secure 0 0 0) 0x7f858c051400 con 0x7f859c06d9f0 2023-12-12T10:13:32.015 INFO:teuthology.orchestra.run.smithi078.stderr:new fs with metadata pool 5 and data pool 6 2023-12-12T10:13:32.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.013+0000 7f85a1bf8640 1 -- 172.21.15.78:0/3056373392 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f857c066470 msgr2=0x7f857c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:32.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.013+0000 7f85a1bf8640 1 --2- 172.21.15.78:0/3056373392 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f857c066470 0x7f857c068930 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f8584000f70 tx=0x7f8584007a90 comp rx=0 tx=0).stop 2023-12-12T10:13:32.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.013+0000 7f85a1bf8640 1 -- 172.21.15.78:0/3056373392 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f859c06d9f0 msgr2=0x7f859c1518e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:32.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.013+0000 7f85a1bf8640 1 --2- 172.21.15.78:0/3056373392 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f859c06d9f0 0x7f859c1518e0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f858c00e870 tx=0x7f858c00ec70 comp rx=0 tx=0).stop 2023-12-12T10:13:32.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.013+0000 7f85a1bf8640 1 -- 172.21.15.78:0/3056373392 shutdown_connections 2023-12-12T10:13:32.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.013+0000 7f85a1bf8640 1 --2- 172.21.15.78:0/3056373392 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f857c066470 0x7f857c068930 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:32.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.013+0000 7f85a1bf8640 1 --2- 172.21.15.78:0/3056373392 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f859c15d2f0 0x7f859c0af0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:32.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.013+0000 7f85a1bf8640 1 --2- 172.21.15.78:0/3056373392 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f859c06de70 0x7f859c156f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:32.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.013+0000 7f85a1bf8640 1 --2- 172.21.15.78:0/3056373392 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f859c06d9f0 0x7f859c1518e0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:32.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.013+0000 7f85a1bf8640 1 -- 172.21.15.78:0/3056373392 >> 172.21.15.78:0/3056373392 conn(0x7f859c0b0bb0 msgr2=0x7f859c0cf890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:32.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.013+0000 7f85a1bf8640 1 -- 172.21.15.78:0/3056373392 shutdown_connections 2023-12-12T10:13:32.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.013+0000 7f85a1bf8640 1 -- 172.21.15.78:0/3056373392 wait complete. 2023-12-12T10:13:32.047 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T10:13:32.186 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.181+0000 7f07ab1aa640 1 Processor -- start 2023-12-12T10:13:32.187 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.181+0000 7f07ab1aa640 1 -- start start 2023-12-12T10:13:32.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.185+0000 7f07ab1aa640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f07a4071bf0 0x7f07a4072030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:32.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.185+0000 7f07ab1aa640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07a40705a0 con 0x7f07a413ceb0 2023-12-12T10:13:32.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.185+0000 7f07ab1aa640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07a4140410 con 0x7f07a413f550 2023-12-12T10:13:32.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.185+0000 7f07ab1aa640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07a40cdc90 con 0x7f07a4071bf0 2023-12-12T10:13:32.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.185+0000 7f07a8f46640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f07a413ceb0 0x7f07a413d4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:33414/0 (socket says 172.21.15.78:33414) 2023-12-12T10:13:32.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.185+0000 7f07a8f46640 1 -- 172.21.15.78:0/3142829692 learned_addr learned my addr 172.21.15.78:0/3142829692 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-12-12T10:13:32.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.185+0000 7f07a3fff640 1 --2- 172.21.15.78:0/3142829692 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f07a4071bf0 0x7f07a4072030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:32.189 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.185+0000 7f07a37fe640 1 -- 172.21.15.78:0/3142829692 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2801854601 0 0) 0x7f07a40705a0 con 0x7f07a413ceb0 2023-12-12T10:13:32.189 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.185+0000 7f07a37fe640 1 -- 172.21.15.78:0/3142829692 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0794003530 con 0x7f07a413ceb0 2023-12-12T10:13:32.189 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.185+0000 7f07a37fe640 1 -- 172.21.15.78:0/3142829692 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1753447242 0 0) 0x7f07a4140410 con 0x7f07a413f550 2023-12-12T10:13:32.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.185+0000 7f07a37fe640 1 -- 172.21.15.78:0/3142829692 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07a40705a0 con 0x7f07a413f550 2023-12-12T10:13:32.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.185+0000 7f07a3fff640 1 -- 172.21.15.78:0/3142829692 >> v1:172.21.15.187:6789/0 conn(0x7f07a413f550 legacy=0x7f07a40ce120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:32.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.185+0000 7f07a3fff640 1 -- 172.21.15.78:0/3142829692 >> v1:172.21.15.78:6789/0 conn(0x7f07a413ceb0 legacy=0x7f07a413d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:32.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.185+0000 7f07a3fff640 1 -- 172.21.15.78:0/3142829692 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07a4072570 con 0x7f07a4071bf0 2023-12-12T10:13:32.192 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.189+0000 7f07a3fff640 1 --2- 172.21.15.78:0/3142829692 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f07a4071bf0 0x7f07a4072030 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f07900097f0 tx=0x7f079001c4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e8e39a7049d5b565 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:32.192 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.189+0000 7f07a37fe640 1 -- 172.21.15.78:0/3142829692 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07900ab600 con 0x7f07a4071bf0 2023-12-12T10:13:32.192 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.189+0000 7f07a37fe640 1 -- 172.21.15.78:0/3142829692 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07900a7050 con 0x7f07a4071bf0 2023-12-12T10:13:32.192 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.189+0000 7f07a37fe640 1 -- 172.21.15.78:0/3142829692 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07900ab980 con 0x7f07a4071bf0 2023-12-12T10:13:32.193 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.189+0000 7f07ab1aa640 1 -- 172.21.15.78:0/3142829692 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f07a4071bf0 msgr2=0x7f07a4072030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:32.193 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.189+0000 7f07ab1aa640 1 --2- 172.21.15.78:0/3142829692 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f07a4071bf0 0x7f07a4072030 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f07900097f0 tx=0x7f079001c4c0 comp rx=0 tx=0).stop 2023-12-12T10:13:32.193 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.189+0000 7f07ab1aa640 1 -- 172.21.15.78:0/3142829692 shutdown_connections 2023-12-12T10:13:32.193 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.189+0000 7f07ab1aa640 1 --2- 172.21.15.78:0/3142829692 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f07a4071bf0 0x7f07a4072030 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:32.193 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.189+0000 7f07ab1aa640 1 -- 172.21.15.78:0/3142829692 >> 172.21.15.78:0/3142829692 conn(0x7f07a406c5d0 msgr2=0x7f07a406c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:32.193 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.189+0000 7f07ab1aa640 1 -- 172.21.15.78:0/3142829692 shutdown_connections 2023-12-12T10:13:32.193 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.189+0000 7f07ab1aa640 1 -- 172.21.15.78:0/3142829692 wait complete. 2023-12-12T10:13:32.194 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.189+0000 7f07ab1aa640 1 Processor -- start 2023-12-12T10:13:32.194 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.189+0000 7f07ab1aa640 1 -- start start 2023-12-12T10:13:32.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.193+0000 7f07ab1aa640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f07a4071bf0 0x7f07a41f6170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:32.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.193+0000 7f07ab1aa640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f07a413ceb0 0x7f07a415d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:32.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.193+0000 7f07ab1aa640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f07a413f550 0x7f07a4140640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:32.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.193+0000 7f07ab1aa640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07a4152ee0 con 0x7f07a413f550 2023-12-12T10:13:32.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.193+0000 7f07ab1aa640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07a4142db0 con 0x7f07a4071bf0 2023-12-12T10:13:32.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.193+0000 7f07ab1aa640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07a41531a0 con 0x7f07a413ceb0 2023-12-12T10:13:32.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.193+0000 7f07a9747640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f07a413f550 0x7f07a4140640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:32.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.193+0000 7f07a9747640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f07a413f550 0x7f07a4140640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33496/0 (socket says 172.21.15.78:33496) 2023-12-12T10:13:32.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.193+0000 7f07a9747640 1 -- 172.21.15.78:0/3733485771 learned_addr learned my addr 172.21.15.78:0/3733485771 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:13:32.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.193+0000 7f07a8f46640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f07a4071bf0 0x7f07a41f6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:32.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.193+0000 7f07a3fff640 1 --2- 172.21.15.78:0/3733485771 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f07a413ceb0 0x7f07a415d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:32.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.193+0000 7f07a9747640 1 -- 172.21.15.78:0/3733485771 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f07a413ceb0 msgr2=0x7f07a415d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:32.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.193+0000 7f07a9747640 1 --2- 172.21.15.78:0/3733485771 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f07a413ceb0 0x7f07a415d030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:32.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.193+0000 7f07a9747640 1 -- 172.21.15.78:0/3733485771 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f07a4071bf0 msgr2=0x7f07a41f6170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:32.197 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.193+0000 7f07a9747640 1 --2- 172.21.15.78:0/3733485771 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f07a4071bf0 0x7f07a41f6170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:32.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.193+0000 7f07a9747640 1 -- 172.21.15.78:0/3733485771 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0790009420 con 0x7f07a413f550 2023-12-12T10:13:32.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.193+0000 7f07a9747640 1 --2- 172.21.15.78:0/3733485771 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f07a413f550 0x7f07a4140640 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f079c00c730 tx=0x7f079c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:32.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.193+0000 7f07a17fa640 1 -- 172.21.15.78:0/3733485771 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f079c003b80 con 0x7f07a413f550 2023-12-12T10:13:32.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.193+0000 7f07a17fa640 1 -- 172.21.15.78:0/3733485771 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f079c003ce0 con 0x7f07a413f550 2023-12-12T10:13:32.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.193+0000 7f07a17fa640 1 -- 172.21.15.78:0/3733485771 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f079c00aa90 con 0x7f07a413f550 2023-12-12T10:13:32.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.193+0000 7f07ab1aa640 1 -- 172.21.15.78:0/3733485771 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07a4153480 con 0x7f07a413f550 2023-12-12T10:13:32.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.193+0000 7f07ab1aa640 1 -- 172.21.15.78:0/3733485771 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07a4153a40 con 0x7f07a413f550 2023-12-12T10:13:32.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.193+0000 7f07ab1aa640 1 -- 172.21.15.78:0/3733485771 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07a40671f0 con 0x7f07a413f550 2023-12-12T10:13:32.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.193+0000 7f07a17fa640 1 -- 172.21.15.78:0/3733485771 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f079c00abf0 con 0x7f07a413f550 2023-12-12T10:13:32.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.197+0000 7f07a17fa640 1 --2- 172.21.15.78:0/3733485771 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f07880664c0 0x7f0788068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:32.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.197+0000 7f07a17fa640 1 -- 172.21.15.78:0/3733485771 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f079c083ca0 con 0x7f07a413f550 2023-12-12T10:13:32.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.197+0000 7f07a8f46640 1 --2- 172.21.15.78:0/3733485771 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f07880664c0 0x7f0788068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:32.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.197+0000 7f07a8f46640 1 --2- 172.21.15.78:0/3733485771 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f07880664c0 0x7f0788068980 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f0798007fd0 tx=0x7f0798007d60 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:32.204 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.201+0000 7f07a17fa640 1 -- 172.21.15.78:0/3733485771 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f079c051070 con 0x7f07a413f550 2023-12-12T10:13:32.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.349+0000 7f07ab1aa640 1 -- 172.21.15.78:0/3733485771 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f07a4067530 con 0x7f07a413f550 2023-12-12T10:13:32.357 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.353+0000 7f07a17fa640 1 -- 172.21.15.78:0/3733485771 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+16751 (secure 0 0 0) 0x7f079c054690 con 0x7f07a413f550 2023-12-12T10:13:32.357 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:13:32.357 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":38,"fsid":"fc81937c-bd26-483c-952b-d1324fcb0c9e","created":"2023-12-12T10:11:44.020214+0000","modified":"2023-12-12T10:13:31.319848+0000","last_up_change":"2023-12-12T10:11:56.278318+0000","last_in_change":"2023-12-12T10:11:46.553610+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T10:11:57.053584+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-12-12T10:13:29.004403+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-12-12T10:13:30.321623+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"22dfdedf-5f6c-4b20-9f6c-30517a1db70a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6809","nonce":3345683600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6811","nonce":3345683600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6815","nonce":3345683600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6813","nonce":3345683600}]},"public_addr":"172.21.15.78:6809/3345683600","cluster_addr":"172.21.15.78:6811/3345683600","heartbeat_back_addr":"172.21.15.78:6815/3345683600","heartbeat_front_addr":"172.21.15.78:6813/3345683600","state":["exists","up"]},{"osd":1,"uuid":"be34a7f3-a69a-462e-9ddf-5e537448dba2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6801","nonce":962652768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6803","nonce":962652768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6807","nonce":962652768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6805","nonce":962652768}]},"public_addr":"172.21.15.78:6801/962652768","cluster_addr":"172.21.15.78:6803/962652768","heartbeat_back_addr":"172.21.15.78:6807/962652768","heartbeat_front_addr":"172.21.15.78:6805/962652768","state":["exists","up"]},{"osd":2,"uuid":"55b381de-5f56-4b14-80f7-e6e41e084a13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6818","nonce":2910206054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6822","nonce":2910206054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6829","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6831","nonce":2910206054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6826","nonce":2910206054}]},"public_addr":"172.21.15.78:6818/2910206054","cluster_addr":"172.21.15.78:6822/2910206054","heartbeat_back_addr":"172.21.15.78:6831/2910206054","heartbeat_front_addr":"172.21.15.78:6826/2910206054","state":["exists","up"]},{"osd":3,"uuid":"d7682de1-25cb-4cec-869f-8851c28b0e6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6819","nonce":3750796703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6821","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6823","nonce":3750796703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6830","nonce":3750796703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6825","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6827","nonce":3750796703}]},"public_addr":"172.21.15.78:6819/3750796703","cluster_addr":"172.21.15.78:6823/3750796703","heartbeat_back_addr":"172.21.15.78:6830/3750796703","heartbeat_front_addr":"172.21.15.78:6827/3750796703","state":["exists","up"]},{"osd":4,"uuid":"8279815a-d6c7-4199-871e-d28971b9dc07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6809","nonce":2944277204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6811","nonce":2944277204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6815","nonce":2944277204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6813","nonce":2944277204}]},"public_addr":"172.21.15.187:6809/2944277204","cluster_addr":"172.21.15.187:6811/2944277204","heartbeat_back_addr":"172.21.15.187:6815/2944277204","heartbeat_front_addr":"172.21.15.187:6813/2944277204","state":["exists","up"]},{"osd":5,"uuid":"0a714c65-f8ce-4340-968f-11a799677ef3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6801","nonce":185858620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6803","nonce":185858620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6807","nonce":185858620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6805","nonce":185858620}]},"public_addr":"172.21.15.187:6801/185858620","cluster_addr":"172.21.15.187:6803/185858620","heartbeat_back_addr":"172.21.15.187:6807/185858620","heartbeat_front_addr":"172.21.15.187:6805/185858620","state":["exists","up"]},{"osd":6,"uuid":"d0bba9ab-f7ee-449e-8999-1c0cf7e6d53c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6817","nonce":4213392126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6819","nonce":4213392126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6824","nonce":4213392126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6821","nonce":4213392126}]},"public_addr":"172.21.15.187:6817/4213392126","cluster_addr":"172.21.15.187:6819/4213392126","heartbeat_back_addr":"172.21.15.187:6824/4213392126","heartbeat_front_addr":"172.21.15.187:6821/4213392126","state":["exists","up"]},{"osd":7,"uuid":"efe5e0d9-2f87-4889-a27a-e2a95a632302","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6823","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6825","nonce":85774004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6827","nonce":85774004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6831","nonce":85774004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6829","nonce":85774004}]},"public_addr":"172.21.15.187:6825/85774004","cluster_addr":"172.21.15.187:6827/85774004","heartbeat_back_addr":"172.21.15.187:6831/85774004","heartbeat_front_addr":"172.21.15.187:6829/85774004","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.214447+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.448899+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.293107+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.564184+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.175026+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.097717+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.261141+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.287681+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T10:13:32.358 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.353+0000 7f07ab1aa640 1 -- 172.21.15.78:0/3733485771 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f07880664c0 msgr2=0x7f0788068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:32.359 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.353+0000 7f07ab1aa640 1 --2- 172.21.15.78:0/3733485771 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f07880664c0 0x7f0788068980 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f0798007fd0 tx=0x7f0798007d60 comp rx=0 tx=0).stop 2023-12-12T10:13:32.359 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.353+0000 7f07ab1aa640 1 -- 172.21.15.78:0/3733485771 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f07a413f550 msgr2=0x7f07a4140640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:32.359 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.353+0000 7f07ab1aa640 1 --2- 172.21.15.78:0/3733485771 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f07a413f550 0x7f07a4140640 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f079c00c730 tx=0x7f079c00cbf0 comp rx=0 tx=0).stop 2023-12-12T10:13:32.359 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.353+0000 7f07ab1aa640 1 -- 172.21.15.78:0/3733485771 shutdown_connections 2023-12-12T10:13:32.359 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.353+0000 7f07ab1aa640 1 --2- 172.21.15.78:0/3733485771 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f07880664c0 0x7f0788068980 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:32.359 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.353+0000 7f07ab1aa640 1 --2- 172.21.15.78:0/3733485771 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f07a413f550 0x7f07a4140640 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:32.359 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.353+0000 7f07ab1aa640 1 --2- 172.21.15.78:0/3733485771 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f07a413ceb0 0x7f07a415d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:32.359 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.353+0000 7f07ab1aa640 1 --2- 172.21.15.78:0/3733485771 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f07a4071bf0 0x7f07a41f6170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:32.359 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.353+0000 7f07ab1aa640 1 -- 172.21.15.78:0/3733485771 >> 172.21.15.78:0/3733485771 conn(0x7f07a406c5d0 msgr2=0x7f07a4158e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:32.359 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.353+0000 7f07ab1aa640 1 -- 172.21.15.78:0/3733485771 shutdown_connections 2023-12-12T10:13:32.359 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.353+0000 7f07ab1aa640 1 -- 172.21.15.78:0/3733485771 wait complete. 2023-12-12T10:13:32.378 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T10:13:32.517 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.513+0000 7f2b7569c640 1 Processor -- start 2023-12-12T10:13:32.517 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.513+0000 7f2b7569c640 1 -- start start 2023-12-12T10:13:32.518 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.513+0000 7f2b7569c640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2b7015d3c0 0x7f2b700d3b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:32.518 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.513+0000 7f2b7569c640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f2b700ce670 0x7f2b700d15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:32.518 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.513+0000 7f2b7569c640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b700b3250 con 0x7f2b700d1ae0 2023-12-12T10:13:32.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.513+0000 7f2b7569c640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b700d1f70 con 0x7f2b700ce670 2023-12-12T10:13:32.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.513+0000 7f2b7569c640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b700cee50 con 0x7f2b7015d3c0 2023-12-12T10:13:32.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.513+0000 7f2b667fc640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f2b700ce670 0x7f2b700d15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:32.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.513+0000 7f2b667fc640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f2b700ce670 0x7f2b700d15a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33500/0 (socket says 172.21.15.78:33500) 2023-12-12T10:13:32.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.513+0000 7f2b6f7fe640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f2b700d1ae0 0x7f2b700cf680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:33418/0 (socket says 172.21.15.78:33418) 2023-12-12T10:13:32.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.513+0000 7f2b667fc640 1 -- 172.21.15.78:0/3144742581 learned_addr learned my addr 172.21.15.78:0/3144742581 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:13:32.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.513+0000 7f2b6effd640 1 --2- 172.21.15.78:0/3144742581 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2b7015d3c0 0x7f2b700d3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:32.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.513+0000 7f2b667fc640 1 -- 172.21.15.78:0/3144742581 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2b7015d3c0 msgr2=0x7f2b700d3b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:13:32.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.513+0000 7f2b667fc640 1 --2- 172.21.15.78:0/3144742581 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2b7015d3c0 0x7f2b700d3b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:32.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.513+0000 7f2b667fc640 1 -- 172.21.15.78:0/3144742581 >> v1:172.21.15.78:6789/0 conn(0x7f2b700d1ae0 legacy=0x7f2b700cf680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:32.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.513+0000 7f2b667fc640 1 -- 172.21.15.78:0/3144742581 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b700b2920 con 0x7f2b700ce670 2023-12-12T10:13:32.520 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.513+0000 7f2b6e7fc640 1 -- 172.21.15.78:0/3144742581 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4248373324 0 0) 0x7f2b700b3250 con 0x7f2b700d1ae0 2023-12-12T10:13:32.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.517+0000 7f2b667fc640 1 --2- 172.21.15.78:0/3144742581 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2b700ce670 0x7f2b700d15a0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f2b58009870 tx=0x7f2b5801ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=572ad5c49dc6b84f server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:32.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.517+0000 7f2b6e7fc640 1 -- 172.21.15.78:0/3144742581 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b580a8a30 con 0x7f2b700ce670 2023-12-12T10:13:32.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.517+0000 7f2b6e7fc640 1 -- 172.21.15.78:0/3144742581 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b580a8b90 con 0x7f2b700ce670 2023-12-12T10:13:32.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.517+0000 7f2b6e7fc640 1 -- 172.21.15.78:0/3144742581 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b580b0440 con 0x7f2b700ce670 2023-12-12T10:13:32.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.517+0000 7f2b7569c640 1 -- 172.21.15.78:0/3144742581 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2b700ce670 msgr2=0x7f2b700d15a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:32.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.517+0000 7f2b7569c640 1 --2- 172.21.15.78:0/3144742581 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2b700ce670 0x7f2b700d15a0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f2b58009870 tx=0x7f2b5801ed30 comp rx=0 tx=0).stop 2023-12-12T10:13:32.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.517+0000 7f2b7569c640 1 -- 172.21.15.78:0/3144742581 shutdown_connections 2023-12-12T10:13:32.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.517+0000 7f2b7569c640 1 --2- 172.21.15.78:0/3144742581 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2b700ce670 0x7f2b700d15a0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:32.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.517+0000 7f2b7569c640 1 --2- 172.21.15.78:0/3144742581 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2b7015d3c0 0x7f2b700d3b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:32.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.517+0000 7f2b7569c640 1 -- 172.21.15.78:0/3144742581 >> 172.21.15.78:0/3144742581 conn(0x7f2b7009c2a0 msgr2=0x7f2b700d2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:32.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.517+0000 7f2b7569c640 1 -- 172.21.15.78:0/3144742581 shutdown_connections 2023-12-12T10:13:32.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.517+0000 7f2b7569c640 1 -- 172.21.15.78:0/3144742581 wait complete. 2023-12-12T10:13:32.524 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.521+0000 7f2b7569c640 1 Processor -- start 2023-12-12T10:13:32.524 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.521+0000 7f2b7569c640 1 -- start start 2023-12-12T10:13:32.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.521+0000 7f2b7569c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2b700ce670 0x7f2b7015e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:32.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.521+0000 7f2b7569c640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2b700d1ae0 0x7f2b7015b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:32.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.521+0000 7f2b7569c640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2b7015d3c0 0x7f2b700b63d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:32.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.521+0000 7f2b7569c640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b7015de80 con 0x7f2b700ce670 2023-12-12T10:13:32.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.521+0000 7f2b7569c640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b700b6d90 con 0x7f2b700d1ae0 2023-12-12T10:13:32.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.521+0000 7f2b7569c640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b700b7070 con 0x7f2b7015d3c0 2023-12-12T10:13:32.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.521+0000 7f2b6effd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2b700ce670 0x7f2b7015e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:32.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.521+0000 7f2b6effd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2b700ce670 0x7f2b7015e2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33504/0 (socket says 172.21.15.78:33504) 2023-12-12T10:13:32.527 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.521+0000 7f2b6effd640 1 -- 172.21.15.78:0/1820439329 learned_addr learned my addr 172.21.15.78:0/1820439329 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:13:32.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.521+0000 7f2b667fc640 1 --2- 172.21.15.78:0/1820439329 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2b700d1ae0 0x7f2b7015b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:32.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.521+0000 7f2b6f7fe640 1 --2- 172.21.15.78:0/1820439329 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2b7015d3c0 0x7f2b700b63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:32.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.521+0000 7f2b6effd640 1 -- 172.21.15.78:0/1820439329 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2b7015d3c0 msgr2=0x7f2b700b63d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:32.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.521+0000 7f2b6effd640 1 --2- 172.21.15.78:0/1820439329 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2b7015d3c0 0x7f2b700b63d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:32.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.521+0000 7f2b6effd640 1 -- 172.21.15.78:0/1820439329 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2b700d1ae0 msgr2=0x7f2b7015b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:32.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.521+0000 7f2b6effd640 1 --2- 172.21.15.78:0/1820439329 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2b700d1ae0 0x7f2b7015b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:32.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.521+0000 7f2b6effd640 1 -- 172.21.15.78:0/1820439329 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b580094d0 con 0x7f2b700ce670 2023-12-12T10:13:32.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.521+0000 7f2b6effd640 1 --2- 172.21.15.78:0/1820439329 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2b700ce670 0x7f2b7015e2a0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f2b6000d5f0 tx=0x7f2b6000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:32.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.521+0000 7f2b67fff640 1 -- 172.21.15.78:0/1820439329 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b600125f0 con 0x7f2b700ce670 2023-12-12T10:13:32.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.521+0000 7f2b67fff640 1 -- 172.21.15.78:0/1820439329 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b60012750 con 0x7f2b700ce670 2023-12-12T10:13:32.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.521+0000 7f2b7569c640 1 -- 172.21.15.78:0/1820439329 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b7015daa0 con 0x7f2b700ce670 2023-12-12T10:13:32.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.521+0000 7f2b67fff640 1 -- 172.21.15.78:0/1820439329 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b60012ae0 con 0x7f2b700ce670 2023-12-12T10:13:32.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.521+0000 7f2b7569c640 1 -- 172.21.15.78:0/1820439329 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b7015e9b0 con 0x7f2b700ce670 2023-12-12T10:13:32.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.525+0000 7f2b7569c640 1 -- 172.21.15.78:0/1820439329 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b700b7290 con 0x7f2b700ce670 2023-12-12T10:13:32.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.525+0000 7f2b67fff640 1 -- 172.21.15.78:0/1820439329 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2b60012c40 con 0x7f2b700ce670 2023-12-12T10:13:32.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.525+0000 7f2b67fff640 1 --2- 172.21.15.78:0/1820439329 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f2b50066470 0x7f2b50068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:32.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.525+0000 7f2b67fff640 1 -- 172.21.15.78:0/1820439329 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f2b600844b0 con 0x7f2b700ce670 2023-12-12T10:13:32.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.525+0000 7f2b667fc640 1 --2- 172.21.15.78:0/1820439329 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f2b50066470 0x7f2b50068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:32.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.525+0000 7f2b667fc640 1 --2- 172.21.15.78:0/1820439329 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f2b50066470 0x7f2b50068930 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f2b580b2000 tx=0x7f2b580aa070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:32.534 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.529+0000 7f2b67fff640 1 -- 172.21.15.78:0/1820439329 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2b600517e0 con 0x7f2b700ce670 2023-12-12T10:13:32.686 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.681+0000 7f2b7569c640 1 -- 172.21.15.78:0/1820439329 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2b70067530 con 0x7f2b700ce670 2023-12-12T10:13:32.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.681+0000 7f2b67fff640 1 -- 172.21.15.78:0/1820439329 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+16751 (secure 0 0 0) 0x7f2b60007380 con 0x7f2b700ce670 2023-12-12T10:13:32.687 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:13:32.688 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":38,"fsid":"fc81937c-bd26-483c-952b-d1324fcb0c9e","created":"2023-12-12T10:11:44.020214+0000","modified":"2023-12-12T10:13:31.319848+0000","last_up_change":"2023-12-12T10:11:56.278318+0000","last_in_change":"2023-12-12T10:11:46.553610+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T10:11:57.053584+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-12-12T10:13:29.004403+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-12-12T10:13:30.321623+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"22dfdedf-5f6c-4b20-9f6c-30517a1db70a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6809","nonce":3345683600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6811","nonce":3345683600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6815","nonce":3345683600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6813","nonce":3345683600}]},"public_addr":"172.21.15.78:6809/3345683600","cluster_addr":"172.21.15.78:6811/3345683600","heartbeat_back_addr":"172.21.15.78:6815/3345683600","heartbeat_front_addr":"172.21.15.78:6813/3345683600","state":["exists","up"]},{"osd":1,"uuid":"be34a7f3-a69a-462e-9ddf-5e537448dba2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6801","nonce":962652768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6803","nonce":962652768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6807","nonce":962652768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6805","nonce":962652768}]},"public_addr":"172.21.15.78:6801/962652768","cluster_addr":"172.21.15.78:6803/962652768","heartbeat_back_addr":"172.21.15.78:6807/962652768","heartbeat_front_addr":"172.21.15.78:6805/962652768","state":["exists","up"]},{"osd":2,"uuid":"55b381de-5f56-4b14-80f7-e6e41e084a13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6818","nonce":2910206054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6822","nonce":2910206054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6829","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6831","nonce":2910206054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6826","nonce":2910206054}]},"public_addr":"172.21.15.78:6818/2910206054","cluster_addr":"172.21.15.78:6822/2910206054","heartbeat_back_addr":"172.21.15.78:6831/2910206054","heartbeat_front_addr":"172.21.15.78:6826/2910206054","state":["exists","up"]},{"osd":3,"uuid":"d7682de1-25cb-4cec-869f-8851c28b0e6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6819","nonce":3750796703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6821","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6823","nonce":3750796703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6830","nonce":3750796703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6825","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6827","nonce":3750796703}]},"public_addr":"172.21.15.78:6819/3750796703","cluster_addr":"172.21.15.78:6823/3750796703","heartbeat_back_addr":"172.21.15.78:6830/3750796703","heartbeat_front_addr":"172.21.15.78:6827/3750796703","state":["exists","up"]},{"osd":4,"uuid":"8279815a-d6c7-4199-871e-d28971b9dc07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6809","nonce":2944277204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6811","nonce":2944277204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6815","nonce":2944277204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6813","nonce":2944277204}]},"public_addr":"172.21.15.187:6809/2944277204","cluster_addr":"172.21.15.187:6811/2944277204","heartbeat_back_addr":"172.21.15.187:6815/2944277204","heartbeat_front_addr":"172.21.15.187:6813/2944277204","state":["exists","up"]},{"osd":5,"uuid":"0a714c65-f8ce-4340-968f-11a799677ef3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6801","nonce":185858620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6803","nonce":185858620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6807","nonce":185858620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6805","nonce":185858620}]},"public_addr":"172.21.15.187:6801/185858620","cluster_addr":"172.21.15.187:6803/185858620","heartbeat_back_addr":"172.21.15.187:6807/185858620","heartbeat_front_addr":"172.21.15.187:6805/185858620","state":["exists","up"]},{"osd":6,"uuid":"d0bba9ab-f7ee-449e-8999-1c0cf7e6d53c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6817","nonce":4213392126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6819","nonce":4213392126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6824","nonce":4213392126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6821","nonce":4213392126}]},"public_addr":"172.21.15.187:6817/4213392126","cluster_addr":"172.21.15.187:6819/4213392126","heartbeat_back_addr":"172.21.15.187:6824/4213392126","heartbeat_front_addr":"172.21.15.187:6821/4213392126","state":["exists","up"]},{"osd":7,"uuid":"efe5e0d9-2f87-4889-a27a-e2a95a632302","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6823","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6825","nonce":85774004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6827","nonce":85774004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6831","nonce":85774004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6829","nonce":85774004}]},"public_addr":"172.21.15.187:6825/85774004","cluster_addr":"172.21.15.187:6827/85774004","heartbeat_back_addr":"172.21.15.187:6831/85774004","heartbeat_front_addr":"172.21.15.187:6829/85774004","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.214447+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.448899+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.293107+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.564184+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.175026+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.097717+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.261141+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.287681+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T10:13:32.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.685+0000 7f2b7569c640 1 -- 172.21.15.78:0/1820439329 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f2b50066470 msgr2=0x7f2b50068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:32.689 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.685+0000 7f2b7569c640 1 --2- 172.21.15.78:0/1820439329 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f2b50066470 0x7f2b50068930 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f2b580b2000 tx=0x7f2b580aa070 comp rx=0 tx=0).stop 2023-12-12T10:13:32.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.685+0000 7f2b7569c640 1 -- 172.21.15.78:0/1820439329 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2b700ce670 msgr2=0x7f2b7015e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:32.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.685+0000 7f2b7569c640 1 --2- 172.21.15.78:0/1820439329 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2b700ce670 0x7f2b7015e2a0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f2b6000d5f0 tx=0x7f2b6000dab0 comp rx=0 tx=0).stop 2023-12-12T10:13:32.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.685+0000 7f2b7569c640 1 -- 172.21.15.78:0/1820439329 shutdown_connections 2023-12-12T10:13:32.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.685+0000 7f2b7569c640 1 --2- 172.21.15.78:0/1820439329 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f2b50066470 0x7f2b50068930 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:32.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.685+0000 7f2b7569c640 1 --2- 172.21.15.78:0/1820439329 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2b7015d3c0 0x7f2b700b63d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:32.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.685+0000 7f2b7569c640 1 --2- 172.21.15.78:0/1820439329 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2b700d1ae0 0x7f2b7015b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:32.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.685+0000 7f2b7569c640 1 --2- 172.21.15.78:0/1820439329 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2b700ce670 0x7f2b7015e2a0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:32.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.685+0000 7f2b7569c640 1 -- 172.21.15.78:0/1820439329 >> 172.21.15.78:0/1820439329 conn(0x7f2b7009c2a0 msgr2=0x7f2b70157fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:32.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.685+0000 7f2b7569c640 1 -- 172.21.15.78:0/1820439329 shutdown_connections 2023-12-12T10:13:32.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.685+0000 7f2b7569c640 1 -- 172.21.15.78:0/1820439329 wait complete. 2023-12-12T10:13:32.709 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-12T10:13:32.848 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.845+0000 7f9be7b0f640 1 Processor -- start 2023-12-12T10:13:32.848 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.845+0000 7f9be7b0f640 1 -- start start 2023-12-12T10:13:32.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.845+0000 7f9be7b0f640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9be0161410 0x7f9be0164fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:32.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.845+0000 7f9be7b0f640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f9be006de90 0x7f9be00cefc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:32.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.845+0000 7f9be7b0f640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9be01617f0 con 0x7f9be00cf500 2023-12-12T10:13:32.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.845+0000 7f9be7b0f640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9be00cf990 con 0x7f9be006de90 2023-12-12T10:13:32.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.845+0000 7f9be7b0f640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9be0165580 con 0x7f9be0161410 2023-12-12T10:13:32.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.845+0000 7f9be60ac640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f9be00cf500 0x7f9be0070200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:33420/0 (socket says 172.21.15.78:33420) 2023-12-12T10:13:32.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.845+0000 7f9be60ac640 1 -- 172.21.15.78:0/1439946149 learned_addr learned my addr 172.21.15.78:0/1439946149 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-12-12T10:13:32.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.845+0000 7f9be58ab640 1 --2- 172.21.15.78:0/1439946149 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9be0161410 0x7f9be0164fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:32.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.845+0000 7f9be50aa640 1 --2- 172.21.15.78:0/1439946149 >> v2:172.21.15.187:3300/0 conn(0x7f9be006de90 0x7f9be00cefc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:32.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.845+0000 7f9be48a9640 1 -- 172.21.15.78:0/1439946149 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 507414843 0 0) 0x7f9be01617f0 con 0x7f9be00cf500 2023-12-12T10:13:32.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.845+0000 7f9be48a9640 1 -- 172.21.15.78:0/1439946149 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9bcc003530 con 0x7f9be00cf500 2023-12-12T10:13:32.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.845+0000 7f9be58ab640 1 -- 172.21.15.78:0/1439946149 >> v2:172.21.15.187:3300/0 conn(0x7f9be006de90 msgr2=0x7f9be00cefc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:13:32.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.845+0000 7f9be58ab640 1 --2- 172.21.15.78:0/1439946149 >> v2:172.21.15.187:3300/0 conn(0x7f9be006de90 0x7f9be00cefc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:32.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.845+0000 7f9be58ab640 1 -- 172.21.15.78:0/1439946149 >> v1:172.21.15.78:6789/0 conn(0x7f9be00cf500 legacy=0x7f9be0070200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:32.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.845+0000 7f9be58ab640 1 -- 172.21.15.78:0/1439946149 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9be0165860 con 0x7f9be0161410 2023-12-12T10:13:32.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.845+0000 7f9be50aa640 1 --2- 172.21.15.78:0/1439946149 >> v2:172.21.15.187:3300/0 conn(0x7f9be006de90 0x7f9be00cefc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-12T10:13:32.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.849+0000 7f9be58ab640 1 --2- 172.21.15.78:0/1439946149 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9be0161410 0x7f9be0164fa0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9bdc0097c0 tx=0x7f9bdc01c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4b4e6235e0eb5974 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:32.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.849+0000 7f9be48a9640 1 -- 172.21.15.78:0/1439946149 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bdc0ab600 con 0x7f9be0161410 2023-12-12T10:13:32.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.849+0000 7f9be48a9640 1 -- 172.21.15.78:0/1439946149 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bdc0a7050 con 0x7f9be0161410 2023-12-12T10:13:32.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.849+0000 7f9be48a9640 1 -- 172.21.15.78:0/1439946149 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bdc0ab980 con 0x7f9be0161410 2023-12-12T10:13:32.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.849+0000 7f9be7b0f640 1 -- 172.21.15.78:0/1439946149 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9be0161410 msgr2=0x7f9be0164fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:32.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.849+0000 7f9be7b0f640 1 --2- 172.21.15.78:0/1439946149 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9be0161410 0x7f9be0164fa0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9bdc0097c0 tx=0x7f9bdc01c480 comp rx=0 tx=0).stop 2023-12-12T10:13:32.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.849+0000 7f9be7b0f640 1 -- 172.21.15.78:0/1439946149 shutdown_connections 2023-12-12T10:13:32.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.849+0000 7f9be7b0f640 1 --2- 172.21.15.78:0/1439946149 >> v2:172.21.15.187:3300/0 conn(0x7f9be006de90 0x7f9be00cefc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:32.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.849+0000 7f9be7b0f640 1 --2- 172.21.15.78:0/1439946149 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9be0161410 0x7f9be0164fa0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:32.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.849+0000 7f9be7b0f640 1 -- 172.21.15.78:0/1439946149 >> 172.21.15.78:0/1439946149 conn(0x7f9be006a940 msgr2=0x7f9be006ad50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:32.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.849+0000 7f9be7b0f640 1 -- 172.21.15.78:0/1439946149 shutdown_connections 2023-12-12T10:13:32.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.849+0000 7f9be7b0f640 1 -- 172.21.15.78:0/1439946149 wait complete. 2023-12-12T10:13:32.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.853+0000 7f9be7b0f640 1 Processor -- start 2023-12-12T10:13:32.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.853+0000 7f9be7b0f640 1 -- start start 2023-12-12T10:13:32.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.853+0000 7f9be7b0f640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9be006de90 0x7f9be0153bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:32.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.853+0000 7f9be7b0f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9be00cf500 0x7f9be0099a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:32.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.853+0000 7f9be7b0f640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9be0161410 0x7f9be0099f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:32.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.853+0000 7f9be7b0f640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9be0159650 con 0x7f9be00cf500 2023-12-12T10:13:32.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.853+0000 7f9be7b0f640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9be0158ad0 con 0x7f9be0161410 2023-12-12T10:13:32.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.853+0000 7f9be7b0f640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9be0158db0 con 0x7f9be006de90 2023-12-12T10:13:32.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.853+0000 7f9be50aa640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9be00cf500 0x7f9be0099a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:32.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.853+0000 7f9be50aa640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9be00cf500 0x7f9be0099a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33508/0 (socket says 172.21.15.78:33508) 2023-12-12T10:13:32.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.853+0000 7f9be50aa640 1 -- 172.21.15.78:0/697954509 learned_addr learned my addr 172.21.15.78:0/697954509 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:13:32.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.853+0000 7f9be58ab640 1 --2- 172.21.15.78:0/697954509 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9be006de90 0x7f9be0153bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:32.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.853+0000 7f9be60ac640 1 --2- 172.21.15.78:0/697954509 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9be0161410 0x7f9be0099f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:32.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.853+0000 7f9be50aa640 1 -- 172.21.15.78:0/697954509 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9be006de90 msgr2=0x7f9be0153bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:32.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.853+0000 7f9be50aa640 1 --2- 172.21.15.78:0/697954509 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9be006de90 0x7f9be0153bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:32.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.853+0000 7f9be50aa640 1 -- 172.21.15.78:0/697954509 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9be0161410 msgr2=0x7f9be0099f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:32.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.853+0000 7f9be50aa640 1 --2- 172.21.15.78:0/697954509 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9be0161410 0x7f9be0099f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:32.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.853+0000 7f9be50aa640 1 -- 172.21.15.78:0/697954509 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bd0009420 con 0x7f9be00cf500 2023-12-12T10:13:32.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.853+0000 7f9be58ab640 1 --2- 172.21.15.78:0/697954509 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9be006de90 0x7f9be0153bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T10:13:32.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.853+0000 7f9be60ac640 1 --2- 172.21.15.78:0/697954509 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9be0161410 0x7f9be0099f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T10:13:32.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.853+0000 7f9be50aa640 1 --2- 172.21.15.78:0/697954509 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9be00cf500 0x7f9be0099a10 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f9bd000ebe0 tx=0x7f9bd000c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:32.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.853+0000 7f9bd67fc640 1 -- 172.21.15.78:0/697954509 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bd000eee0 con 0x7f9be00cf500 2023-12-12T10:13:32.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.853+0000 7f9bd67fc640 1 -- 172.21.15.78:0/697954509 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bd000cc30 con 0x7f9be00cf500 2023-12-12T10:13:32.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.853+0000 7f9be7b0f640 1 -- 172.21.15.78:0/697954509 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bdc009420 con 0x7f9be00cf500 2023-12-12T10:13:32.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.853+0000 7f9bd67fc640 1 -- 172.21.15.78:0/697954509 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bd0013470 con 0x7f9be00cf500 2023-12-12T10:13:32.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.853+0000 7f9be7b0f640 1 -- 172.21.15.78:0/697954509 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9be0159370 con 0x7f9be00cf500 2023-12-12T10:13:32.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.857+0000 7f9be7b0f640 1 -- 172.21.15.78:0/697954509 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9be00671f0 con 0x7f9be00cf500 2023-12-12T10:13:32.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.857+0000 7f9bd67fc640 1 -- 172.21.15.78:0/697954509 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9bd00135d0 con 0x7f9be00cf500 2023-12-12T10:13:32.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.857+0000 7f9bd67fc640 1 --2- 172.21.15.78:0/697954509 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f9bc4066470 0x7f9bc4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:32.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.857+0000 7f9bd67fc640 1 -- 172.21.15.78:0/697954509 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f9bd00842d0 con 0x7f9be00cf500 2023-12-12T10:13:32.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.857+0000 7f9be58ab640 1 --2- 172.21.15.78:0/697954509 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f9bc4066470 0x7f9bc4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:32.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.857+0000 7f9be58ab640 1 --2- 172.21.15.78:0/697954509 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f9bc4066470 0x7f9bc4068930 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f9bdc0ad000 tx=0x7f9bdc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:32.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:32.861+0000 7f9bd67fc640 1 -- 172.21.15.78:0/697954509 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9bd0051600 con 0x7f9be00cf500 2023-12-12T10:13:33.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:33.045+0000 7f9be7b0f640 1 -- 172.21.15.78:0/697954509 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f9be0074610 con 0x7f9be00cf500 2023-12-12T10:13:33.958 INFO:tasks.ceph.mds.a.smithi078.stderr:2023-12-12T10:13:33.953+0000 7fd9e2256640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-12T10:13:34.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:34.033+0000 7f9bd67fc640 1 -- 172.21.15.78:0/697954509 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) v1 ==== 118+0+0 (secure 0 0 0) 0x7f9bd0054c20 con 0x7f9be00cf500 2023-12-12T10:13:34.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:34.037+0000 7f9be7b0f640 1 -- 172.21.15.78:0/697954509 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f9bc4066470 msgr2=0x7f9bc4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:34.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:34.037+0000 7f9be7b0f640 1 --2- 172.21.15.78:0/697954509 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f9bc4066470 0x7f9bc4068930 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f9bdc0ad000 tx=0x7f9bdc008040 comp rx=0 tx=0).stop 2023-12-12T10:13:34.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:34.037+0000 7f9be7b0f640 1 -- 172.21.15.78:0/697954509 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9be00cf500 msgr2=0x7f9be0099a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:34.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:34.037+0000 7f9be7b0f640 1 --2- 172.21.15.78:0/697954509 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9be00cf500 0x7f9be0099a10 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f9bd000ebe0 tx=0x7f9bd000c520 comp rx=0 tx=0).stop 2023-12-12T10:13:34.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:34.037+0000 7f9be7b0f640 1 -- 172.21.15.78:0/697954509 shutdown_connections 2023-12-12T10:13:34.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:34.037+0000 7f9be7b0f640 1 --2- 172.21.15.78:0/697954509 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f9bc4066470 0x7f9bc4068930 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:34.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:34.037+0000 7f9be7b0f640 1 --2- 172.21.15.78:0/697954509 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9be0161410 0x7f9be0099f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:34.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:34.037+0000 7f9be7b0f640 1 --2- 172.21.15.78:0/697954509 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9be00cf500 0x7f9be0099a10 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:34.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:34.037+0000 7f9be7b0f640 1 --2- 172.21.15.78:0/697954509 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9be006de90 0x7f9be0153bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:34.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:34.037+0000 7f9be7b0f640 1 -- 172.21.15.78:0/697954509 >> 172.21.15.78:0/697954509 conn(0x7f9be006a940 msgr2=0x7f9be015a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:34.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:34.037+0000 7f9be7b0f640 1 -- 172.21.15.78:0/697954509 shutdown_connections 2023-12-12T10:13:34.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:34.037+0000 7f9be7b0f640 1 -- 172.21.15.78:0/697954509 wait complete. 2023-12-12T10:13:34.064 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-12-12T10:13:34.065 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-12T10:13:34.210 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:34.205+0000 7fca71f3e640 1 Processor -- start 2023-12-12T10:13:34.210 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:34.205+0000 7fca71f3e640 1 -- start start 2023-12-12T10:13:34.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:34.205+0000 7fca71f3e640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fca6c143770 0x7fca6c0cdf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:34.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:34.205+0000 7fca71f3e640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fca6c0b1e20 0x7fca6c070f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:34.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:34.205+0000 7fca71f3e640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca6c070a70 con 0x7fca6c0b2280 2023-12-12T10:13:34.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:34.205+0000 7fca71f3e640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca6c15e920 con 0x7fca6c0b1e20 2023-12-12T10:13:34.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:34.205+0000 7fca71f3e640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca6c070440 con 0x7fca6c143770 2023-12-12T10:13:34.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:34.205+0000 7fca6affd640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fca6c0b1e20 0x7fca6c070f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:34.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:34.205+0000 7fca6bfff640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fca6c0b2280 0x7fca6c15a2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:33422/0 (socket says 172.21.15.78:33422) 2023-12-12T10:13:34.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:34.205+0000 7fca6bfff640 1 -- 172.21.15.78:0/3424942905 learned_addr learned my addr 172.21.15.78:0/3424942905 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-12-12T10:13:34.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:34.209+0000 7fca6b7fe640 1 --2- 172.21.15.78:0/3424942905 >> v2:172.21.15.187:3300/0 conn(0x7fca6c143770 0x7fca6c0cdf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:34.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:34.209+0000 7fca6affd640 1 -- 172.21.15.78:0/3424942905 >> v2:172.21.15.187:3300/0 conn(0x7fca6c143770 msgr2=0x7fca6c0cdf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:13:34.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:34.209+0000 7fca6affd640 1 --2- 172.21.15.78:0/3424942905 >> v2:172.21.15.187:3300/0 conn(0x7fca6c143770 0x7fca6c0cdf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:34.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:34.209+0000 7fca6affd640 1 -- 172.21.15.78:0/3424942905 >> v1:172.21.15.78:6789/0 conn(0x7fca6c0b2280 legacy=0x7fca6c15a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:34.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:34.209+0000 7fca6affd640 1 -- 172.21.15.78:0/3424942905 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca6c143b50 con 0x7fca6c0b1e20 2023-12-12T10:13:34.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:34.209+0000 7fca6a7fc640 1 -- 172.21.15.78:0/3424942905 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2454026371 0 0) 0x7fca6c070a70 con 0x7fca6c0b2280 2023-12-12T10:13:34.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:34.209+0000 7fca6affd640 1 --2- 172.21.15.78:0/3424942905 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca6c0b1e20 0x7fca6c070f00 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fca6c06b500 tx=0x7fca6001c340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=838898996b94b9b0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:34.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:34.209+0000 7fca6a7fc640 1 -- 172.21.15.78:0/3424942905 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca600ab600 con 0x7fca6c0b1e20 2023-12-12T10:13:34.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:34.209+0000 7fca6a7fc640 1 -- 172.21.15.78:0/3424942905 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca600a7050 con 0x7fca6c0b1e20 2023-12-12T10:13:34.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:34.209+0000 7fca6a7fc640 1 -- 172.21.15.78:0/3424942905 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca600ab980 con 0x7fca6c0b1e20 2023-12-12T10:13:34.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:34.213+0000 7fca71f3e640 1 -- 172.21.15.78:0/3424942905 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca6c0b1e20 msgr2=0x7fca6c070f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:34.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:34.213+0000 7fca71f3e640 1 --2- 172.21.15.78:0/3424942905 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca6c0b1e20 0x7fca6c070f00 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fca6c06b500 tx=0x7fca6001c340 comp rx=0 tx=0).stop 2023-12-12T10:13:34.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:34.213+0000 7fca71f3e640 1 -- 172.21.15.78:0/3424942905 shutdown_connections 2023-12-12T10:13:34.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:34.213+0000 7fca71f3e640 1 --2- 172.21.15.78:0/3424942905 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca6c0b1e20 0x7fca6c070f00 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:34.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:34.213+0000 7fca71f3e640 1 --2- 172.21.15.78:0/3424942905 >> v2:172.21.15.187:3300/0 conn(0x7fca6c143770 0x7fca6c0cdf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:34.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:34.213+0000 7fca71f3e640 1 -- 172.21.15.78:0/3424942905 >> 172.21.15.78:0/3424942905 conn(0x7fca6c06a710 msgr2=0x7fca6c06ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:34.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:34.213+0000 7fca71f3e640 1 -- 172.21.15.78:0/3424942905 shutdown_connections 2023-12-12T10:13:34.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:34.213+0000 7fca71f3e640 1 -- 172.21.15.78:0/3424942905 wait complete. 2023-12-12T10:13:34.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:34.213+0000 7fca71f3e640 1 Processor -- start 2023-12-12T10:13:34.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:34.213+0000 7fca71f3e640 1 -- start start 2023-12-12T10:13:34.219 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:34.213+0000 7fca71f3e640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fca6c0b1e20 0x7fca6c1f6f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:34.220 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:34.213+0000 7fca71f3e640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fca6c0b2280 0x7fca6c1592c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:34.220 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:34.213+0000 7fca71f3e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca6c143770 0x7fca6c1f50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:34.220 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:34.213+0000 7fca71f3e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca6c1f5e60 con 0x7fca6c143770 2023-12-12T10:13:34.220 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:34.213+0000 7fca71f3e640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca6c1f6140 con 0x7fca6c0b2280 2023-12-12T10:13:34.220 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:34.213+0000 7fca71f3e640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca6c1f6420 con 0x7fca6c0b1e20 2023-12-12T10:13:34.220 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:34.213+0000 7fca6bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca6c143770 0x7fca6c1f50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:34.220 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:34.213+0000 7fca6bfff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca6c143770 0x7fca6c1f50c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33526/0 (socket says 172.21.15.78:33526) 2023-12-12T10:13:34.220 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:34.213+0000 7fca6bfff640 1 -- 172.21.15.78:0/2518934158 learned_addr learned my addr 172.21.15.78:0/2518934158 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:13:34.220 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:34.213+0000 7fca6affd640 1 --2- 172.21.15.78:0/2518934158 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fca6c0b2280 0x7fca6c1592c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:34.221 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:34.213+0000 7fca6b7fe640 1 --2- 172.21.15.78:0/2518934158 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fca6c0b1e20 0x7fca6c1f6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:34.221 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:34.213+0000 7fca6bfff640 1 -- 172.21.15.78:0/2518934158 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fca6c0b1e20 msgr2=0x7fca6c1f6f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:34.221 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:34.213+0000 7fca6bfff640 1 --2- 172.21.15.78:0/2518934158 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fca6c0b1e20 0x7fca6c1f6f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:34.221 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:34.213+0000 7fca6bfff640 1 -- 172.21.15.78:0/2518934158 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fca6c0b2280 msgr2=0x7fca6c1592c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:34.221 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:34.213+0000 7fca6bfff640 1 --2- 172.21.15.78:0/2518934158 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fca6c0b2280 0x7fca6c1592c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:34.221 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:34.213+0000 7fca6bfff640 1 -- 172.21.15.78:0/2518934158 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca60009420 con 0x7fca6c143770 2023-12-12T10:13:34.221 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:34.213+0000 7fca6affd640 1 --2- 172.21.15.78:0/2518934158 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fca6c0b2280 0x7fca6c1592c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T10:13:34.221 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:34.217+0000 7fca6bfff640 1 --2- 172.21.15.78:0/2518934158 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca6c143770 0x7fca6c1f50c0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fca64001570 tx=0x7fca6400cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:34.221 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:34.217+0000 7fca53fff640 1 -- 172.21.15.78:0/2518934158 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca6400a640 con 0x7fca6c143770 2023-12-12T10:13:34.221 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:34.217+0000 7fca53fff640 1 -- 172.21.15.78:0/2518934158 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca6400a7c0 con 0x7fca6c143770 2023-12-12T10:13:34.221 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:34.217+0000 7fca71f3e640 1 -- 172.21.15.78:0/2518934158 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca6c1f6700 con 0x7fca6c143770 2023-12-12T10:13:34.221 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:34.217+0000 7fca53fff640 1 -- 172.21.15.78:0/2518934158 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca6400ab70 con 0x7fca6c143770 2023-12-12T10:13:34.222 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:34.217+0000 7fca71f3e640 1 -- 172.21.15.78:0/2518934158 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca6c1f7440 con 0x7fca6c143770 2023-12-12T10:13:34.222 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:34.217+0000 7fca71f3e640 1 -- 172.21.15.78:0/2518934158 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca6c0671f0 con 0x7fca6c143770 2023-12-12T10:13:34.222 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:34.217+0000 7fca53fff640 1 -- 172.21.15.78:0/2518934158 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fca6400acd0 con 0x7fca6c143770 2023-12-12T10:13:34.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:34.217+0000 7fca53fff640 1 --2- 172.21.15.78:0/2518934158 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fca58066470 0x7fca58068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:34.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:34.217+0000 7fca53fff640 1 -- 172.21.15.78:0/2518934158 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fca64083860 con 0x7fca6c143770 2023-12-12T10:13:34.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:34.217+0000 7fca6b7fe640 1 --2- 172.21.15.78:0/2518934158 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fca58066470 0x7fca58068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:34.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:34.221+0000 7fca6b7fe640 1 --2- 172.21.15.78:0/2518934158 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fca58066470 0x7fca58068930 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fca6c06d580 tx=0x7fca5c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:34.227 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:34.221+0000 7fca53fff640 1 -- 172.21.15.78:0/2518934158 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fca64050b00 con 0x7fca6c143770 2023-12-12T10:13:34.408 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:34.405+0000 7fca71f3e640 1 -- 172.21.15.78:0/2518934158 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fca6c1f6c20 con 0x7fca6c143770 2023-12-12T10:13:35.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.040+0000 7fca53fff640 1 -- 172.21.15.78:0/2518934158 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v17) v1 ==== 122+0+0 (secure 0 0 0) 0x7fca6c1f6c20 con 0x7fca6c143770 2023-12-12T10:13:35.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.044+0000 7fca71f3e640 1 -- 172.21.15.78:0/2518934158 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fca58066470 msgr2=0x7fca58068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:35.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.044+0000 7fca71f3e640 1 --2- 172.21.15.78:0/2518934158 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fca58066470 0x7fca58068930 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fca6c06d580 tx=0x7fca5c008040 comp rx=0 tx=0).stop 2023-12-12T10:13:35.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.044+0000 7fca71f3e640 1 -- 172.21.15.78:0/2518934158 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca6c143770 msgr2=0x7fca6c1f50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:35.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.044+0000 7fca71f3e640 1 --2- 172.21.15.78:0/2518934158 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca6c143770 0x7fca6c1f50c0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fca64001570 tx=0x7fca6400cca0 comp rx=0 tx=0).stop 2023-12-12T10:13:35.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.044+0000 7fca71f3e640 1 -- 172.21.15.78:0/2518934158 shutdown_connections 2023-12-12T10:13:35.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.044+0000 7fca71f3e640 1 --2- 172.21.15.78:0/2518934158 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fca58066470 0x7fca58068930 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:35.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.044+0000 7fca71f3e640 1 --2- 172.21.15.78:0/2518934158 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fca6c143770 0x7fca6c1f50c0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:35.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.044+0000 7fca71f3e640 1 --2- 172.21.15.78:0/2518934158 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fca6c0b2280 0x7fca6c1592c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:35.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.044+0000 7fca71f3e640 1 --2- 172.21.15.78:0/2518934158 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fca6c0b1e20 0x7fca6c1f6f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:35.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.044+0000 7fca71f3e640 1 -- 172.21.15.78:0/2518934158 >> 172.21.15.78:0/2518934158 conn(0x7fca6c06a710 msgr2=0x7fca6c0cd410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:35.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.044+0000 7fca71f3e640 1 -- 172.21.15.78:0/2518934158 shutdown_connections 2023-12-12T10:13:35.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.044+0000 7fca71f3e640 1 -- 172.21.15.78:0/2518934158 wait complete. 2023-12-12T10:13:35.070 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-12-12T10:13:35.070 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-12T10:13:35.210 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.204+0000 7fdc0632a640 1 Processor -- start 2023-12-12T10:13:35.210 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.204+0000 7fdc0632a640 1 -- start start 2023-12-12T10:13:35.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.204+0000 7fdc0632a640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdc000ade10 0x7fdc000ce5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:35.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.204+0000 7fdc0632a640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc000ae1f0 con 0x7fdc000b47d0 2023-12-12T10:13:35.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.204+0000 7fdc0632a640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc0015c410 con 0x7fdc000cb7e0 2023-12-12T10:13:35.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.204+0000 7fdc0632a640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc000ceb00 con 0x7fdc000ade10 2023-12-12T10:13:35.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.208+0000 7fdc048c7640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fdc000b47d0 0x7fdc001580a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:33432/0 (socket says 172.21.15.78:33432) 2023-12-12T10:13:35.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.208+0000 7fdc048c7640 1 -- 172.21.15.78:0/1650614079 learned_addr learned my addr 172.21.15.78:0/1650614079 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-12-12T10:13:35.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.208+0000 7fdbfffff640 1 --2- 172.21.15.78:0/1650614079 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdc000ade10 0x7fdc000ce5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:35.213 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.208+0000 7fdbfeffd640 1 -- 172.21.15.78:0/1650614079 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1753140489 0 0) 0x7fdc000ae1f0 con 0x7fdc000b47d0 2023-12-12T10:13:35.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.208+0000 7fdbfeffd640 1 -- 172.21.15.78:0/1650614079 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdbe8003530 con 0x7fdc000b47d0 2023-12-12T10:13:35.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.208+0000 7fdbfeffd640 1 -- 172.21.15.78:0/1650614079 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1193593296 0 0) 0x7fdbe8003530 con 0x7fdc000b47d0 2023-12-12T10:13:35.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.208+0000 7fdbfeffd640 1 -- 172.21.15.78:0/1650614079 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdc000ade10 msgr2=0x7fdc000ce5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:13:35.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.208+0000 7fdbfeffd640 1 --2- 172.21.15.78:0/1650614079 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdc000ade10 0x7fdc000ce5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:35.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.208+0000 7fdbfeffd640 1 -- 172.21.15.78:0/1650614079 >> v1:172.21.15.187:6789/0 conn(0x7fdc000cb7e0 legacy=0x7fdc000b40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:35.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.208+0000 7fdbfeffd640 1 -- 172.21.15.78:0/1650614079 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc0015b800 con 0x7fdc000b47d0 2023-12-12T10:13:35.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.208+0000 7fdbfeffd640 1 -- 172.21.15.78:0/1650614079 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 465499599 0 0) 0x7fdbf8001a00 con 0x7fdc000b47d0 2023-12-12T10:13:35.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.208+0000 7fdbfeffd640 1 -- 172.21.15.78:0/1650614079 >> v1:172.21.15.78:6789/0 conn(0x7fdc000b47d0 legacy=0x7fdc001580a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:35.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.208+0000 7fdbfeffd640 1 --2- 172.21.15.78:0/1650614079 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdc000ade10 0x7fdbe80039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:35.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.208+0000 7fdbfeffd640 1 --2- 172.21.15.78:0/1650614079 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdbe8003ef0 0x7fdbe80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:35.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.208+0000 7fdbfeffd640 1 --2- 172.21.15.78:0/1650614079 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdbe8004d10 0x7fdbe8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:35.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.208+0000 7fdbfeffd640 1 -- 172.21.15.78:0/1650614079 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc000ceb00 con 0x7fdbe8003ef0 2023-12-12T10:13:35.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.208+0000 7fdbfeffd640 1 -- 172.21.15.78:0/1650614079 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe800b9f0 con 0x7fdbe8004d10 2023-12-12T10:13:35.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.208+0000 7fdbfeffd640 1 -- 172.21.15.78:0/1650614079 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe800bbb0 con 0x7fdc000ade10 2023-12-12T10:13:35.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.208+0000 7fdbff7fe640 1 --2- 172.21.15.78:0/1650614079 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdbe8003ef0 0x7fdbe80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:35.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.208+0000 7fdbfffff640 1 --2- 172.21.15.78:0/1650614079 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdc000ade10 0x7fdbe80039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:35.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.208+0000 7fdc048c7640 1 --2- 172.21.15.78:0/1650614079 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdbe8004d10 0x7fdbe8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:35.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.208+0000 7fdbff7fe640 1 -- 172.21.15.78:0/1650614079 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdc000ade10 msgr2=0x7fdbe80039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:13:35.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.208+0000 7fdbff7fe640 1 --2- 172.21.15.78:0/1650614079 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdc000ade10 0x7fdbe80039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:35.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.208+0000 7fdbff7fe640 1 -- 172.21.15.78:0/1650614079 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdbe8004d10 msgr2=0x7fdbe8005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:13:35.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.208+0000 7fdbff7fe640 1 --2- 172.21.15.78:0/1650614079 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdbe8004d10 0x7fdbe8005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:35.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.208+0000 7fdbff7fe640 1 -- 172.21.15.78:0/1650614079 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbe8003530 con 0x7fdbe8003ef0 2023-12-12T10:13:35.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.212+0000 7fdbff7fe640 1 --2- 172.21.15.78:0/1650614079 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdbe8003ef0 0x7fdbe80047d0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fdc000cbc00 tx=0x7fdbf401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee6f5fe76a48f621 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:35.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.212+0000 7fdbfeffd640 1 -- 172.21.15.78:0/1650614079 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbf40ab600 con 0x7fdbe8003ef0 2023-12-12T10:13:35.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.212+0000 7fdbfeffd640 1 -- 172.21.15.78:0/1650614079 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbf40a7050 con 0x7fdbe8003ef0 2023-12-12T10:13:35.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.212+0000 7fdbfeffd640 1 -- 172.21.15.78:0/1650614079 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbf40ab9c0 con 0x7fdbe8003ef0 2023-12-12T10:13:35.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.212+0000 7fdc0632a640 1 -- 172.21.15.78:0/1650614079 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdbe8003ef0 msgr2=0x7fdbe80047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:35.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.212+0000 7fdc0632a640 1 --2- 172.21.15.78:0/1650614079 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdbe8003ef0 0x7fdbe80047d0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fdc000cbc00 tx=0x7fdbf401c460 comp rx=0 tx=0).stop 2023-12-12T10:13:35.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.212+0000 7fdc048c7640 1 -- 172.21.15.78:0/1650614079 reap_dead start 2023-12-12T10:13:35.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.212+0000 7fdc0632a640 1 -- 172.21.15.78:0/1650614079 shutdown_connections 2023-12-12T10:13:35.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.212+0000 7fdc0632a640 1 -- 172.21.15.78:0/1650614079 >> 172.21.15.78:0/1650614079 conn(0x7fdc0006c5d0 msgr2=0x7fdc0006c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:35.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.212+0000 7fdc0632a640 1 -- 172.21.15.78:0/1650614079 shutdown_connections 2023-12-12T10:13:35.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.212+0000 7fdc0632a640 1 -- 172.21.15.78:0/1650614079 wait complete. 2023-12-12T10:13:35.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.212+0000 7fdc0632a640 1 Processor -- start 2023-12-12T10:13:35.219 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.212+0000 7fdc0632a640 1 -- start start 2023-12-12T10:13:35.220 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.216+0000 7fdc0632a640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdbe8003ef0 0x7fdc0015f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:35.220 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.216+0000 7fdc0632a640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdc00162db0 0x7fdc001f6020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:35.221 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.216+0000 7fdc0632a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdc00156d10 0x7fdc000af970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:35.221 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.216+0000 7fdc0632a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc001571a0 con 0x7fdc00156d10 2023-12-12T10:13:35.221 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.216+0000 7fdc0632a640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc001632b0 con 0x7fdc00162db0 2023-12-12T10:13:35.221 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.216+0000 7fdc0632a640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc00163590 con 0x7fdbe8003ef0 2023-12-12T10:13:35.221 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.216+0000 7fdc048c7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdc00156d10 0x7fdc000af970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:35.221 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.216+0000 7fdc048c7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdc00156d10 0x7fdc000af970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33548/0 (socket says 172.21.15.78:33548) 2023-12-12T10:13:35.221 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.216+0000 7fdc048c7640 1 -- 172.21.15.78:0/867537270 learned_addr learned my addr 172.21.15.78:0/867537270 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:13:35.221 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.216+0000 7fdbff7fe640 1 --2- 172.21.15.78:0/867537270 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdc00162db0 0x7fdc001f6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:35.221 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.216+0000 7fdbfffff640 1 --2- 172.21.15.78:0/867537270 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdbe8003ef0 0x7fdc0015f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:35.221 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.216+0000 7fdc048c7640 1 -- 172.21.15.78:0/867537270 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdbe8003ef0 msgr2=0x7fdc0015f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:35.221 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.216+0000 7fdc048c7640 1 --2- 172.21.15.78:0/867537270 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdbe8003ef0 0x7fdc0015f780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:35.221 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.216+0000 7fdc048c7640 1 -- 172.21.15.78:0/867537270 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdc00162db0 msgr2=0x7fdc001f6020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:35.221 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.216+0000 7fdc048c7640 1 --2- 172.21.15.78:0/867537270 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdc00162db0 0x7fdc001f6020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:35.221 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.216+0000 7fdc048c7640 1 -- 172.21.15.78:0/867537270 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc00163870 con 0x7fdc00156d10 2023-12-12T10:13:35.222 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.216+0000 7fdc048c7640 1 --2- 172.21.15.78:0/867537270 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdc00156d10 0x7fdc000af970 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fdbf80013e0 tx=0x7fdbf8007b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:35.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.216+0000 7fdbfcff9640 1 -- 172.21.15.78:0/867537270 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbf800eb00 con 0x7fdc00156d10 2023-12-12T10:13:35.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.216+0000 7fdbfcff9640 1 -- 172.21.15.78:0/867537270 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbf800eca0 con 0x7fdc00156d10 2023-12-12T10:13:35.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.216+0000 7fdc0632a640 1 -- 172.21.15.78:0/867537270 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc00163b50 con 0x7fdc00156d10 2023-12-12T10:13:35.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.216+0000 7fdbfcff9640 1 -- 172.21.15.78:0/867537270 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbf8013420 con 0x7fdc00156d10 2023-12-12T10:13:35.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.216+0000 7fdc0632a640 1 -- 172.21.15.78:0/867537270 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc001579f0 con 0x7fdc00156d10 2023-12-12T10:13:35.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.216+0000 7fdc0632a640 1 -- 172.21.15.78:0/867537270 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc000671f0 con 0x7fdc00156d10 2023-12-12T10:13:35.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.216+0000 7fdbfcff9640 1 -- 172.21.15.78:0/867537270 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fdbf8013580 con 0x7fdc00156d10 2023-12-12T10:13:35.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.220+0000 7fdbfcff9640 1 --2- 172.21.15.78:0/867537270 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fdbec0664a0 0x7fdbec068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:35.225 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.220+0000 7fdbfcff9640 1 -- 172.21.15.78:0/867537270 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fdbf8084330 con 0x7fdc00156d10 2023-12-12T10:13:35.226 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.220+0000 7fdbfffff640 1 --2- 172.21.15.78:0/867537270 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fdbec0664a0 0x7fdbec068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:35.226 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.220+0000 7fdbfffff640 1 --2- 172.21.15.78:0/867537270 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fdbec0664a0 0x7fdbec068960 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fdc00157ed0 tx=0x7fdbf0009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:35.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.224+0000 7fdbfcff9640 1 -- 172.21.15.78:0/867537270 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fdbf80515d0 con 0x7fdc00156d10 2023-12-12T10:13:35.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.404+0000 7fdc0632a640 1 -- 172.21.15.78:0/867537270 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdc00157be0 con 0x7fdc00156d10 2023-12-12T10:13:35.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.404+0000 7fdbfcff9640 1 -- 172.21.15.78:0/867537270 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4913 (secure 0 0 0) 0x7fdbf8054bf0 con 0x7fdc00156d10 2023-12-12T10:13:35.410 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:13:35.410 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5024,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/142991070","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":142991070},{"type":"v1","addr":"172.21.15.187:6835","nonce":142991070}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5374,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/1159092364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":1159092364},{"type":"v1","addr":"172.21.15.187:6834","nonce":1159092364}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5469,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6836/314422656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":314422656},{"type":"v1","addr":"172.21.15.78:6836","nonce":314422656}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-12T10:13:31.320201+0000","modified":"2023-12-12T10:13:34.407772+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5472":{"gid":5472,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.78:6837/4134128104","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":4134128104},{"type":"v1","addr":"172.21.15.78:6837","nonce":4134128104}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-12T10:13:35.410 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 17 2023-12-12T10:13:35.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.408+0000 7fdc0632a640 1 -- 172.21.15.78:0/867537270 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fdbec0664a0 msgr2=0x7fdbec068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:35.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.408+0000 7fdc0632a640 1 --2- 172.21.15.78:0/867537270 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fdbec0664a0 0x7fdbec068960 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fdc00157ed0 tx=0x7fdbf0009190 comp rx=0 tx=0).stop 2023-12-12T10:13:35.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.408+0000 7fdc0632a640 1 -- 172.21.15.78:0/867537270 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdc00156d10 msgr2=0x7fdc000af970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:35.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.408+0000 7fdc0632a640 1 --2- 172.21.15.78:0/867537270 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdc00156d10 0x7fdc000af970 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fdbf80013e0 tx=0x7fdbf8007b20 comp rx=0 tx=0).stop 2023-12-12T10:13:35.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.408+0000 7fdc0632a640 1 -- 172.21.15.78:0/867537270 shutdown_connections 2023-12-12T10:13:35.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.408+0000 7fdc0632a640 1 --2- 172.21.15.78:0/867537270 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fdbec0664a0 0x7fdbec068960 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:35.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.408+0000 7fdc0632a640 1 --2- 172.21.15.78:0/867537270 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fdc00156d10 0x7fdc000af970 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:35.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.408+0000 7fdc0632a640 1 --2- 172.21.15.78:0/867537270 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdc00162db0 0x7fdc001f6020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:35.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.408+0000 7fdc0632a640 1 --2- 172.21.15.78:0/867537270 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdbe8003ef0 0x7fdc0015f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:35.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.408+0000 7fdc0632a640 1 -- 172.21.15.78:0/867537270 >> 172.21.15.78:0/867537270 conn(0x7fdc0006c5d0 msgr2=0x7fdc00157f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:35.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.408+0000 7fdc0632a640 1 -- 172.21.15.78:0/867537270 shutdown_connections 2023-12-12T10:13:35.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.408+0000 7fdc0632a640 1 -- 172.21.15.78:0/867537270 wait complete. 2023-12-12T10:13:35.432 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T10:13:35.569 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.564+0000 7fe2a7efe640 1 Processor -- start 2023-12-12T10:13:35.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.564+0000 7fe2a7efe640 1 -- start start 2023-12-12T10:13:35.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.564+0000 7fe2a7efe640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe2a00b3880 0x7fe2a00b3c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:35.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.564+0000 7fe2a7efe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe2a01621a0 0x7fe2a0162620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:35.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.564+0000 7fe2a7efe640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2a00b41a0 con 0x7fe2a0165070 2023-12-12T10:13:35.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.564+0000 7fe2a7efe640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2a00b20e0 con 0x7fe2a01621a0 2023-12-12T10:13:35.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.564+0000 7fe2a7efe640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2a00b23c0 con 0x7fe2a00b3880 2023-12-12T10:13:35.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.564+0000 7fe2a5499640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe2a01621a0 0x7fe2a0162620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:35.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.564+0000 7fe2a649b640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fe2a0165070 0x7fe2a0165500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:33444/0 (socket says 172.21.15.78:33444) 2023-12-12T10:13:35.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.564+0000 7fe2a649b640 1 -- 172.21.15.78:0/4067424287 learned_addr learned my addr 172.21.15.78:0/4067424287 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-12-12T10:13:35.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.568+0000 7fe2a5c9a640 1 --2- 172.21.15.78:0/4067424287 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe2a00b3880 0x7fe2a00b3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:35.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.568+0000 7fe2a5499640 1 -- 172.21.15.78:0/4067424287 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe2a00b3880 msgr2=0x7fe2a00b3c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:13:35.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.568+0000 7fe2a5499640 1 --2- 172.21.15.78:0/4067424287 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe2a00b3880 0x7fe2a00b3c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:35.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.568+0000 7fe2a5499640 1 -- 172.21.15.78:0/4067424287 >> v1:172.21.15.78:6789/0 conn(0x7fe2a0165070 legacy=0x7fe2a0165500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:35.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.568+0000 7fe2a5499640 1 -- 172.21.15.78:0/4067424287 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2a00b26a0 con 0x7fe2a01621a0 2023-12-12T10:13:35.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.568+0000 7fe2a5c9a640 1 --2- 172.21.15.78:0/4067424287 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe2a00b3880 0x7fe2a00b3c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T10:13:35.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.568+0000 7fe2a4c98640 1 -- 172.21.15.78:0/4067424287 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3482014827 0 0) 0x7fe2a00b41a0 con 0x7fe2a0165070 2023-12-12T10:13:35.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.568+0000 7fe2a5499640 1 --2- 172.21.15.78:0/4067424287 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe2a01621a0 0x7fe2a0162620 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fe2900097c0 tx=0x7fe29001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31bda64aeceb2900 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:35.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.568+0000 7fe2a4c98640 1 -- 172.21.15.78:0/4067424287 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2900ab600 con 0x7fe2a01621a0 2023-12-12T10:13:35.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.568+0000 7fe2a4c98640 1 -- 172.21.15.78:0/4067424287 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2900a7050 con 0x7fe2a01621a0 2023-12-12T10:13:35.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.568+0000 7fe2a4c98640 1 -- 172.21.15.78:0/4067424287 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2900ab980 con 0x7fe2a01621a0 2023-12-12T10:13:35.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.568+0000 7fe2a7efe640 1 -- 172.21.15.78:0/4067424287 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe2a01621a0 msgr2=0x7fe2a0162620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:35.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.568+0000 7fe2a7efe640 1 --2- 172.21.15.78:0/4067424287 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe2a01621a0 0x7fe2a0162620 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fe2900097c0 tx=0x7fe29001c480 comp rx=0 tx=0).stop 2023-12-12T10:13:35.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.572+0000 7fe2a7efe640 1 -- 172.21.15.78:0/4067424287 shutdown_connections 2023-12-12T10:13:35.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.572+0000 7fe2a7efe640 1 --2- 172.21.15.78:0/4067424287 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe2a01621a0 0x7fe2a0162620 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:35.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.572+0000 7fe2a7efe640 1 --2- 172.21.15.78:0/4067424287 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe2a00b3880 0x7fe2a00b3c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:35.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.572+0000 7fe2a7efe640 1 -- 172.21.15.78:0/4067424287 >> 172.21.15.78:0/4067424287 conn(0x7fe2a006c5d0 msgr2=0x7fe2a006c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:35.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.572+0000 7fe2a7efe640 1 -- 172.21.15.78:0/4067424287 shutdown_connections 2023-12-12T10:13:35.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.572+0000 7fe2a7efe640 1 -- 172.21.15.78:0/4067424287 wait complete. 2023-12-12T10:13:35.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.572+0000 7fe2a7efe640 1 Processor -- start 2023-12-12T10:13:35.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.572+0000 7fe2a7efe640 1 -- start start 2023-12-12T10:13:35.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.572+0000 7fe2a7efe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe2a00b3880 0x7fe2a0157f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:35.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.572+0000 7fe2a7efe640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe2a01621a0 0x7fe2a0158460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:35.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.572+0000 7fe2a7efe640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe2a0165070 0x7fe2a01513b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:35.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.572+0000 7fe2a7efe640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2a0164920 con 0x7fe2a00b3880 2023-12-12T10:13:35.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.572+0000 7fe2a7efe640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2a0152770 con 0x7fe2a0165070 2023-12-12T10:13:35.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.572+0000 7fe2a7efe640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2a0160c90 con 0x7fe2a01621a0 2023-12-12T10:13:35.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.572+0000 7fe2a5c9a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe2a00b3880 0x7fe2a0157f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:35.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.572+0000 7fe2a5c9a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe2a00b3880 0x7fe2a0157f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33572/0 (socket says 172.21.15.78:33572) 2023-12-12T10:13:35.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.572+0000 7fe2a5c9a640 1 -- 172.21.15.78:0/1847087225 learned_addr learned my addr 172.21.15.78:0/1847087225 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:13:35.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.572+0000 7fe2a5499640 1 --2- 172.21.15.78:0/1847087225 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe2a01621a0 0x7fe2a0158460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:35.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.572+0000 7fe2a649b640 1 --2- 172.21.15.78:0/1847087225 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe2a0165070 0x7fe2a01513b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:35.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.572+0000 7fe2a5c9a640 1 -- 172.21.15.78:0/1847087225 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe2a01621a0 msgr2=0x7fe2a0158460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:35.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.572+0000 7fe2a5c9a640 1 --2- 172.21.15.78:0/1847087225 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe2a01621a0 0x7fe2a0158460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:35.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.572+0000 7fe2a5c9a640 1 -- 172.21.15.78:0/1847087225 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe2a0165070 msgr2=0x7fe2a01513b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:35.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.572+0000 7fe2a5c9a640 1 --2- 172.21.15.78:0/1847087225 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe2a0165070 0x7fe2a01513b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:35.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.572+0000 7fe2a5c9a640 1 -- 172.21.15.78:0/1847087225 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe290009420 con 0x7fe2a00b3880 2023-12-12T10:13:35.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.572+0000 7fe2a5c9a640 1 --2- 172.21.15.78:0/1847087225 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe2a00b3880 0x7fe2a0157f20 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fe29c00d800 tx=0x7fe29c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:35.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.572+0000 7fe2967fc640 1 -- 172.21.15.78:0/1847087225 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe29c0096c0 con 0x7fe2a00b3880 2023-12-12T10:13:35.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.576+0000 7fe2967fc640 1 -- 172.21.15.78:0/1847087225 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe29c009820 con 0x7fe2a00b3880 2023-12-12T10:13:35.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.576+0000 7fe2967fc640 1 -- 172.21.15.78:0/1847087225 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe29c009bd0 con 0x7fe2a00b3880 2023-12-12T10:13:35.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.576+0000 7fe2a7efe640 1 -- 172.21.15.78:0/1847087225 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2a0160f70 con 0x7fe2a00b3880 2023-12-12T10:13:35.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.576+0000 7fe2a7efe640 1 -- 172.21.15.78:0/1847087225 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2a0152cf0 con 0x7fe2a00b3880 2023-12-12T10:13:35.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.576+0000 7fe2a7efe640 1 -- 172.21.15.78:0/1847087225 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2a00671f0 con 0x7fe2a00b3880 2023-12-12T10:13:35.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.576+0000 7fe2967fc640 1 -- 172.21.15.78:0/1847087225 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe29c009d30 con 0x7fe2a00b3880 2023-12-12T10:13:35.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.576+0000 7fe2967fc640 1 --2- 172.21.15.78:0/1847087225 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fe284066470 0x7fe284068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:35.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.576+0000 7fe2967fc640 1 -- 172.21.15.78:0/1847087225 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fe29c084750 con 0x7fe2a00b3880 2023-12-12T10:13:35.582 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.576+0000 7fe2a5499640 1 --2- 172.21.15.78:0/1847087225 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fe284066470 0x7fe284068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:35.583 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.576+0000 7fe2a5499640 1 --2- 172.21.15.78:0/1847087225 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fe284066470 0x7fe284068930 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fe2900ad000 tx=0x7fe290008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:35.586 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.580+0000 7fe2967fc640 1 -- 172.21.15.78:0/1847087225 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe29c051a90 con 0x7fe2a00b3880 2023-12-12T10:13:35.737 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.732+0000 7fe2a7efe640 1 -- 172.21.15.78:0/1847087225 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe2a0067530 con 0x7fe2a00b3880 2023-12-12T10:13:35.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.732+0000 7fe2967fc640 1 -- 172.21.15.78:0/1847087225 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+16738 (secure 0 0 0) 0x7fe29c0550b0 con 0x7fe2a00b3880 2023-12-12T10:13:35.738 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:13:35.738 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":39,"fsid":"fc81937c-bd26-483c-952b-d1324fcb0c9e","created":"2023-12-12T10:11:44.020214+0000","modified":"2023-12-12T10:13:32.936693+0000","last_up_change":"2023-12-12T10:11:56.278318+0000","last_in_change":"2023-12-12T10:11:46.553610+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T10:11:57.053584+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-12-12T10:13:29.004403+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-12-12T10:13:30.321623+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"22dfdedf-5f6c-4b20-9f6c-30517a1db70a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6809","nonce":3345683600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6811","nonce":3345683600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6815","nonce":3345683600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6813","nonce":3345683600}]},"public_addr":"172.21.15.78:6809/3345683600","cluster_addr":"172.21.15.78:6811/3345683600","heartbeat_back_addr":"172.21.15.78:6815/3345683600","heartbeat_front_addr":"172.21.15.78:6813/3345683600","state":["exists","up"]},{"osd":1,"uuid":"be34a7f3-a69a-462e-9ddf-5e537448dba2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6801","nonce":962652768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6803","nonce":962652768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6807","nonce":962652768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6805","nonce":962652768}]},"public_addr":"172.21.15.78:6801/962652768","cluster_addr":"172.21.15.78:6803/962652768","heartbeat_back_addr":"172.21.15.78:6807/962652768","heartbeat_front_addr":"172.21.15.78:6805/962652768","state":["exists","up"]},{"osd":2,"uuid":"55b381de-5f56-4b14-80f7-e6e41e084a13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6818","nonce":2910206054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6822","nonce":2910206054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6829","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6831","nonce":2910206054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6826","nonce":2910206054}]},"public_addr":"172.21.15.78:6818/2910206054","cluster_addr":"172.21.15.78:6822/2910206054","heartbeat_back_addr":"172.21.15.78:6831/2910206054","heartbeat_front_addr":"172.21.15.78:6826/2910206054","state":["exists","up"]},{"osd":3,"uuid":"d7682de1-25cb-4cec-869f-8851c28b0e6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6819","nonce":3750796703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6821","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6823","nonce":3750796703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6830","nonce":3750796703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6825","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6827","nonce":3750796703}]},"public_addr":"172.21.15.78:6819/3750796703","cluster_addr":"172.21.15.78:6823/3750796703","heartbeat_back_addr":"172.21.15.78:6830/3750796703","heartbeat_front_addr":"172.21.15.78:6827/3750796703","state":["exists","up"]},{"osd":4,"uuid":"8279815a-d6c7-4199-871e-d28971b9dc07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6809","nonce":2944277204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6811","nonce":2944277204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6815","nonce":2944277204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6813","nonce":2944277204}]},"public_addr":"172.21.15.187:6809/2944277204","cluster_addr":"172.21.15.187:6811/2944277204","heartbeat_back_addr":"172.21.15.187:6815/2944277204","heartbeat_front_addr":"172.21.15.187:6813/2944277204","state":["exists","up"]},{"osd":5,"uuid":"0a714c65-f8ce-4340-968f-11a799677ef3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6801","nonce":185858620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6803","nonce":185858620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6807","nonce":185858620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6805","nonce":185858620}]},"public_addr":"172.21.15.187:6801/185858620","cluster_addr":"172.21.15.187:6803/185858620","heartbeat_back_addr":"172.21.15.187:6807/185858620","heartbeat_front_addr":"172.21.15.187:6805/185858620","state":["exists","up"]},{"osd":6,"uuid":"d0bba9ab-f7ee-449e-8999-1c0cf7e6d53c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6817","nonce":4213392126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6819","nonce":4213392126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6824","nonce":4213392126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6821","nonce":4213392126}]},"public_addr":"172.21.15.187:6817/4213392126","cluster_addr":"172.21.15.187:6819/4213392126","heartbeat_back_addr":"172.21.15.187:6824/4213392126","heartbeat_front_addr":"172.21.15.187:6821/4213392126","state":["exists","up"]},{"osd":7,"uuid":"efe5e0d9-2f87-4889-a27a-e2a95a632302","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6823","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6825","nonce":85774004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6827","nonce":85774004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6831","nonce":85774004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6829","nonce":85774004}]},"public_addr":"172.21.15.187:6825/85774004","cluster_addr":"172.21.15.187:6827/85774004","heartbeat_back_addr":"172.21.15.187:6831/85774004","heartbeat_front_addr":"172.21.15.187:6829/85774004","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.214447+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.448899+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.293107+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.564184+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.175026+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.097717+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.261141+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.287681+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T10:13:35.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.736+0000 7fe2a7efe640 1 -- 172.21.15.78:0/1847087225 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fe284066470 msgr2=0x7fe284068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:35.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.736+0000 7fe2a7efe640 1 --2- 172.21.15.78:0/1847087225 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fe284066470 0x7fe284068930 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fe2900ad000 tx=0x7fe290008040 comp rx=0 tx=0).stop 2023-12-12T10:13:35.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.736+0000 7fe2a7efe640 1 -- 172.21.15.78:0/1847087225 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe2a00b3880 msgr2=0x7fe2a0157f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:35.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.736+0000 7fe2a7efe640 1 --2- 172.21.15.78:0/1847087225 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe2a00b3880 0x7fe2a0157f20 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fe29c00d800 tx=0x7fe29c00dcc0 comp rx=0 tx=0).stop 2023-12-12T10:13:35.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.736+0000 7fe2a7efe640 1 -- 172.21.15.78:0/1847087225 shutdown_connections 2023-12-12T10:13:35.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.736+0000 7fe2a7efe640 1 --2- 172.21.15.78:0/1847087225 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fe284066470 0x7fe284068930 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:35.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.736+0000 7fe2a7efe640 1 --2- 172.21.15.78:0/1847087225 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe2a0165070 0x7fe2a01513b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:35.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.736+0000 7fe2a7efe640 1 --2- 172.21.15.78:0/1847087225 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe2a01621a0 0x7fe2a0158460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:35.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.736+0000 7fe2a7efe640 1 --2- 172.21.15.78:0/1847087225 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe2a00b3880 0x7fe2a0157f20 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:35.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.736+0000 7fe2a7efe640 1 -- 172.21.15.78:0/1847087225 >> 172.21.15.78:0/1847087225 conn(0x7fe2a006c5d0 msgr2=0x7fe2a0072190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:35.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.736+0000 7fe2a7efe640 1 -- 172.21.15.78:0/1847087225 shutdown_connections 2023-12-12T10:13:35.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.736+0000 7fe2a7efe640 1 -- 172.21.15.78:0/1847087225 wait complete. 2023-12-12T10:13:35.759 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-12T10:13:35.760 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-12T10:13:35.896 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.892+0000 7f64624c9640 1 Processor -- start 2023-12-12T10:13:35.896 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.892+0000 7f64624c9640 1 -- start start 2023-12-12T10:13:35.898 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.892+0000 7f64624c9640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f645c071bf0 0x7f645c072030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:35.898 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.892+0000 7f64624c9640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f645c13f550 0x7f645c13f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:35.898 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.892+0000 7f64624c9640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f645c0705a0 con 0x7f645c13ceb0 2023-12-12T10:13:35.898 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.892+0000 7f64624c9640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f645c13ff20 con 0x7f645c071bf0 2023-12-12T10:13:35.898 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.892+0000 7f64624c9640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f645c140410 con 0x7f645c13f550 2023-12-12T10:13:35.898 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.892+0000 7f645bfff640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f645c13ceb0 0x7f645c13d4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:33458/0 (socket says 172.21.15.78:33458) 2023-12-12T10:13:35.898 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.892+0000 7f645bfff640 1 -- 172.21.15.78:0/414873526 learned_addr learned my addr 172.21.15.78:0/414873526 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-12-12T10:13:35.898 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.892+0000 7f645b7fe640 1 --2- 172.21.15.78:0/414873526 >> v2:172.21.15.187:3300/0 conn(0x7f645c071bf0 0x7f645c072030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:35.898 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.892+0000 7f6460a66640 1 --2- 172.21.15.78:0/414873526 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f645c13f550 0x7f645c13f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:35.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.892+0000 7f645affd640 1 -- 172.21.15.78:0/414873526 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 67025801 0 0) 0x7f645c0705a0 con 0x7f645c13ceb0 2023-12-12T10:13:35.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.892+0000 7f645affd640 1 -- 172.21.15.78:0/414873526 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6444003530 con 0x7f645c13ceb0 2023-12-12T10:13:35.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.892+0000 7f645b7fe640 1 -- 172.21.15.78:0/414873526 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f645c13f550 msgr2=0x7f645c13f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:13:35.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.892+0000 7f645b7fe640 1 --2- 172.21.15.78:0/414873526 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f645c13f550 0x7f645c13f9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:35.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.892+0000 7f645b7fe640 1 -- 172.21.15.78:0/414873526 >> v1:172.21.15.78:6789/0 conn(0x7f645c13ceb0 legacy=0x7f645c13d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:35.899 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.892+0000 7f645b7fe640 1 -- 172.21.15.78:0/414873526 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f645c0cdc90 con 0x7f645c071bf0 2023-12-12T10:13:35.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.896+0000 7f645b7fe640 1 --2- 172.21.15.78:0/414873526 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f645c071bf0 0x7f645c072030 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f64500097c0 tx=0x7f645001c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=352d0fe26e2838d1 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:35.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.896+0000 7f645affd640 1 -- 172.21.15.78:0/414873526 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64500ab600 con 0x7f645c071bf0 2023-12-12T10:13:35.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.896+0000 7f645affd640 1 -- 172.21.15.78:0/414873526 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64500a7050 con 0x7f645c071bf0 2023-12-12T10:13:35.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.896+0000 7f645affd640 1 -- 172.21.15.78:0/414873526 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64500ab980 con 0x7f645c071bf0 2023-12-12T10:13:35.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.896+0000 7f64624c9640 1 -- 172.21.15.78:0/414873526 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f645c071bf0 msgr2=0x7f645c072030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:35.902 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.896+0000 7f64624c9640 1 --2- 172.21.15.78:0/414873526 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f645c071bf0 0x7f645c072030 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f64500097c0 tx=0x7f645001c480 comp rx=0 tx=0).stop 2023-12-12T10:13:35.903 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.896+0000 7f64624c9640 1 -- 172.21.15.78:0/414873526 shutdown_connections 2023-12-12T10:13:35.903 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.896+0000 7f64624c9640 1 --2- 172.21.15.78:0/414873526 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f645c13f550 0x7f645c13f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:35.903 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.896+0000 7f64624c9640 1 --2- 172.21.15.78:0/414873526 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f645c071bf0 0x7f645c072030 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:35.903 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.896+0000 7f64624c9640 1 -- 172.21.15.78:0/414873526 >> 172.21.15.78:0/414873526 conn(0x7f645c06c5d0 msgr2=0x7f645c06c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:35.903 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.896+0000 7f64624c9640 1 -- 172.21.15.78:0/414873526 shutdown_connections 2023-12-12T10:13:35.903 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.896+0000 7f64624c9640 1 -- 172.21.15.78:0/414873526 wait complete. 2023-12-12T10:13:35.904 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.900+0000 7f64624c9640 1 Processor -- start 2023-12-12T10:13:35.904 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.900+0000 7f64624c9640 1 -- start start 2023-12-12T10:13:35.906 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.900+0000 7f64624c9640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f645c071bf0 0x7f645c1375f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:35.906 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.900+0000 7f64624c9640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f645c13ceb0 0x7f645c0b0190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:35.906 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.900+0000 7f64624c9640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f645c13f550 0x7f645c158e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:35.906 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.900+0000 7f64624c9640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f645c1355c0 con 0x7f645c13ceb0 2023-12-12T10:13:35.906 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.900+0000 7f64624c9640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f645c15bf60 con 0x7f645c13f550 2023-12-12T10:13:35.906 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.900+0000 7f64624c9640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f645c135e20 con 0x7f645c071bf0 2023-12-12T10:13:35.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.900+0000 7f645b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f645c13ceb0 0x7f645c0b0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:35.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.900+0000 7f645b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f645c13ceb0 0x7f645c0b0190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33586/0 (socket says 172.21.15.78:33586) 2023-12-12T10:13:35.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.900+0000 7f645b7fe640 1 -- 172.21.15.78:0/2086840757 learned_addr learned my addr 172.21.15.78:0/2086840757 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:13:35.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.900+0000 7f645bfff640 1 --2- 172.21.15.78:0/2086840757 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f645c071bf0 0x7f645c1375f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:35.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.900+0000 7f6460a66640 1 --2- 172.21.15.78:0/2086840757 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f645c13f550 0x7f645c158e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:35.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.900+0000 7f645b7fe640 1 -- 172.21.15.78:0/2086840757 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f645c071bf0 msgr2=0x7f645c1375f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:35.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.900+0000 7f645b7fe640 1 --2- 172.21.15.78:0/2086840757 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f645c071bf0 0x7f645c1375f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:35.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.900+0000 7f645b7fe640 1 -- 172.21.15.78:0/2086840757 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f645c13f550 msgr2=0x7f645c158e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:35.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.900+0000 7f645b7fe640 1 --2- 172.21.15.78:0/2086840757 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f645c13f550 0x7f645c158e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:35.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.900+0000 7f645b7fe640 1 -- 172.21.15.78:0/2086840757 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6450009420 con 0x7f645c13ceb0 2023-12-12T10:13:35.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.900+0000 7f645b7fe640 1 --2- 172.21.15.78:0/2086840757 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f645c13ceb0 0x7f645c0b0190 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f64500ae040 tx=0x7f6450019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:35.908 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.900+0000 7f6458ff9640 1 -- 172.21.15.78:0/2086840757 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64500b4430 con 0x7f645c13ceb0 2023-12-12T10:13:35.908 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.900+0000 7f6458ff9640 1 -- 172.21.15.78:0/2086840757 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64500b45b0 con 0x7f645c13ceb0 2023-12-12T10:13:35.908 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.900+0000 7f64624c9640 1 -- 172.21.15.78:0/2086840757 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f645c1506e0 con 0x7f645c13ceb0 2023-12-12T10:13:35.908 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.900+0000 7f6458ff9640 1 -- 172.21.15.78:0/2086840757 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64500b4960 con 0x7f645c13ceb0 2023-12-12T10:13:35.908 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.900+0000 7f64624c9640 1 -- 172.21.15.78:0/2086840757 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f645c150930 con 0x7f645c13ceb0 2023-12-12T10:13:35.908 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.904+0000 7f64624c9640 1 -- 172.21.15.78:0/2086840757 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f645c0671f0 con 0x7f645c13ceb0 2023-12-12T10:13:35.909 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.904+0000 7f6458ff9640 1 -- 172.21.15.78:0/2086840757 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f64500b2040 con 0x7f645c13ceb0 2023-12-12T10:13:35.910 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.904+0000 7f6458ff9640 1 --2- 172.21.15.78:0/2086840757 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f6448066470 0x7f6448068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:35.910 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.904+0000 7f6458ff9640 1 -- 172.21.15.78:0/2086840757 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f645011dd40 con 0x7f645c13ceb0 2023-12-12T10:13:35.910 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.904+0000 7f645bfff640 1 --2- 172.21.15.78:0/2086840757 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f6448066470 0x7f6448068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:35.910 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.904+0000 7f645bfff640 1 --2- 172.21.15.78:0/2086840757 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f6448066470 0x7f6448068930 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f644c0011f0 tx=0x7f644c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:35.913 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:35.908+0000 7f6458ff9640 1 -- 172.21.15.78:0/2086840757 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f64500eb080 con 0x7f645c13ceb0 2023-12-12T10:13:36.063 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.060+0000 7f64624c9640 1 -- 172.21.15.78:0/2086840757 --> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f645c13dbd0 con 0x7f6448066470 2023-12-12T10:13:36.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.068+0000 7f6458ff9640 1 -- 172.21.15.78:0/2086840757 <== mgr.4104 v2:172.21.15.78:6832/1725498448 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289176 (secure 0 0 0) 0x7f644c0013f0 con 0x7f6448066470 2023-12-12T10:13:36.075 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:13:36.077 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2023-12-12T10:13:36.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.072+0000 7f64624c9640 1 -- 172.21.15.78:0/2086840757 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f6448066470 msgr2=0x7f6448068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:36.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.072+0000 7f64624c9640 1 --2- 172.21.15.78:0/2086840757 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f6448066470 0x7f6448068930 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f644c0011f0 tx=0x7f644c009040 comp rx=0 tx=0).stop 2023-12-12T10:13:36.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.072+0000 7f64624c9640 1 -- 172.21.15.78:0/2086840757 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f645c13ceb0 msgr2=0x7f645c0b0190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:36.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.072+0000 7f64624c9640 1 --2- 172.21.15.78:0/2086840757 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f645c13ceb0 0x7f645c0b0190 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f64500ae040 tx=0x7f6450019220 comp rx=0 tx=0).stop 2023-12-12T10:13:36.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.072+0000 7f64624c9640 1 -- 172.21.15.78:0/2086840757 shutdown_connections 2023-12-12T10:13:36.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.072+0000 7f64624c9640 1 --2- 172.21.15.78:0/2086840757 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f6448066470 0x7f6448068930 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:36.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.072+0000 7f64624c9640 1 --2- 172.21.15.78:0/2086840757 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f645c13f550 0x7f645c158e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:36.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.072+0000 7f64624c9640 1 --2- 172.21.15.78:0/2086840757 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f645c13ceb0 0x7f645c0b0190 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:36.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.072+0000 7f64624c9640 1 --2- 172.21.15.78:0/2086840757 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f645c071bf0 0x7f645c1375f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:36.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.072+0000 7f64624c9640 1 -- 172.21.15.78:0/2086840757 >> 172.21.15.78:0/2086840757 conn(0x7f645c06c5d0 msgr2=0x7f645c15b520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:36.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.072+0000 7f64624c9640 1 -- 172.21.15.78:0/2086840757 shutdown_connections 2023-12-12T10:13:36.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.072+0000 7f64624c9640 1 -- 172.21.15.78:0/2086840757 wait complete. 2023-12-12T10:13:36.096 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":81,"stamp":"2023-12-12T10:13:35.007635+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591256,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":180,"num_write_kb":2428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":52,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220668,"kb_used_data":4496,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754052,"statfs":{"total":773094113280,"available":772868149248,"internally_reserved":0,"allocated":4603904,"data_stored":2630094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":41,"apply_latency_ms":41,"commit_latency_ns":41000000,"apply_latency_ns":41000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":888,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.076276"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.971588+0000","last_change":"2023-12-12T10:13:31.963011+0000","last_active":"2023-12-12T10:13:31.971588+0000","last_peered":"2023-12-12T10:13:31.971588+0000","last_clean":"2023-12-12T10:13:31.971588+0000","last_became_active":"2023-12-12T10:13:31.962738+0000","last_became_peered":"2023-12-12T10:13:31.962738+0000","last_unstale":"2023-12-12T10:13:31.971588+0000","last_undegraded":"2023-12-12T10:13:31.971588+0000","last_fullsized":"2023-12-12T10:13:31.971588+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_clean_scrub_stamp":"2023-12-12T10:13:30.930525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:46:59.123475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.971522+0000","last_change":"2023-12-12T10:13:31.963131+0000","last_active":"2023-12-12T10:13:31.971522+0000","last_peered":"2023-12-12T10:13:31.971522+0000","last_clean":"2023-12-12T10:13:31.971522+0000","last_became_active":"2023-12-12T10:13:31.955937+0000","last_became_peered":"2023-12-12T10:13:31.955937+0000","last_unstale":"2023-12-12T10:13:31.971522+0000","last_undegraded":"2023-12-12T10:13:31.971522+0000","last_fullsized":"2023-12-12T10:13:31.971522+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_clean_scrub_stamp":"2023-12-12T10:13:30.930525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:37:36.773954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.971875+0000","last_change":"2023-12-12T10:13:31.970522+0000","last_active":"2023-12-12T10:13:31.971875+0000","last_peered":"2023-12-12T10:13:31.971875+0000","last_clean":"2023-12-12T10:13:31.971875+0000","last_became_active":"2023-12-12T10:13:31.970192+0000","last_became_peered":"2023-12-12T10:13:31.970192+0000","last_unstale":"2023-12-12T10:13:31.971875+0000","last_undegraded":"2023-12-12T10:13:31.971875+0000","last_fullsized":"2023-12-12T10:13:31.971875+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_clean_scrub_stamp":"2023-12-12T10:13:30.930525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:33:49.629588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.969265+0000","last_change":"2023-12-12T10:13:31.965772+0000","last_active":"2023-12-12T10:13:31.969265+0000","last_peered":"2023-12-12T10:13:31.969265+0000","last_clean":"2023-12-12T10:13:31.969265+0000","last_became_active":"2023-12-12T10:13:31.965480+0000","last_became_peered":"2023-12-12T10:13:31.965480+0000","last_unstale":"2023-12-12T10:13:31.969265+0000","last_undegraded":"2023-12-12T10:13:31.969265+0000","last_fullsized":"2023-12-12T10:13:31.969265+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_clean_scrub_stamp":"2023-12-12T10:13:30.930525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T22:04:13.539201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.969227+0000","last_change":"2023-12-12T10:13:31.966112+0000","last_active":"2023-12-12T10:13:31.969227+0000","last_peered":"2023-12-12T10:13:31.969227+0000","last_clean":"2023-12-12T10:13:31.969227+0000","last_became_active":"2023-12-12T10:13:31.965303+0000","last_became_peered":"2023-12-12T10:13:31.965303+0000","last_unstale":"2023-12-12T10:13:31.969227+0000","last_undegraded":"2023-12-12T10:13:31.969227+0000","last_fullsized":"2023-12-12T10:13:31.969227+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_clean_scrub_stamp":"2023-12-12T10:13:30.930525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:10:34.199352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.969169+0000","last_change":"2023-12-12T10:13:31.958000+0000","last_active":"2023-12-12T10:13:31.969169+0000","last_peered":"2023-12-12T10:13:31.969169+0000","last_clean":"2023-12-12T10:13:31.969169+0000","last_became_active":"2023-12-12T10:13:31.957715+0000","last_became_peered":"2023-12-12T10:13:31.957715+0000","last_unstale":"2023-12-12T10:13:31.969169+0000","last_undegraded":"2023-12-12T10:13:31.969169+0000","last_fullsized":"2023-12-12T10:13:31.969169+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_clean_scrub_stamp":"2023-12-12T10:13:30.930525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:25:56.040481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.971728+0000","last_change":"2023-12-12T10:13:31.967197+0000","last_active":"2023-12-12T10:13:31.971728+0000","last_peered":"2023-12-12T10:13:31.971728+0000","last_clean":"2023-12-12T10:13:31.971728+0000","last_became_active":"2023-12-12T10:13:31.966889+0000","last_became_peered":"2023-12-12T10:13:31.966889+0000","last_unstale":"2023-12-12T10:13:31.971728+0000","last_undegraded":"2023-12-12T10:13:31.971728+0000","last_fullsized":"2023-12-12T10:13:31.971728+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_clean_scrub_stamp":"2023-12-12T10:13:30.930525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:25:56.040481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.971582+0000","last_change":"2023-12-12T10:13:31.966337+0000","last_active":"2023-12-12T10:13:31.971582+0000","last_peered":"2023-12-12T10:13:31.971582+0000","last_clean":"2023-12-12T10:13:31.971582+0000","last_became_active":"2023-12-12T10:13:31.966048+0000","last_became_peered":"2023-12-12T10:13:31.966048+0000","last_unstale":"2023-12-12T10:13:31.971582+0000","last_undegraded":"2023-12-12T10:13:31.971582+0000","last_fullsized":"2023-12-12T10:13:31.971582+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_clean_scrub_stamp":"2023-12-12T10:13:30.930525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:01:28.709905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.971865+0000","last_change":"2023-12-12T10:13:31.970440+0000","last_active":"2023-12-12T10:13:31.971865+0000","last_peered":"2023-12-12T10:13:31.971865+0000","last_clean":"2023-12-12T10:13:31.971865+0000","last_became_active":"2023-12-12T10:13:31.970140+0000","last_became_peered":"2023-12-12T10:13:31.970140+0000","last_unstale":"2023-12-12T10:13:31.971865+0000","last_undegraded":"2023-12-12T10:13:31.971865+0000","last_fullsized":"2023-12-12T10:13:31.971865+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_clean_scrub_stamp":"2023-12-12T10:13:30.930525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:47:34.197405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.975747+0000","last_change":"2023-12-12T10:13:31.973996+0000","last_active":"2023-12-12T10:13:31.975747+0000","last_peered":"2023-12-12T10:13:31.975747+0000","last_clean":"2023-12-12T10:13:31.975747+0000","last_became_active":"2023-12-12T10:13:31.973618+0000","last_became_peered":"2023-12-12T10:13:31.973618+0000","last_unstale":"2023-12-12T10:13:31.975747+0000","last_undegraded":"2023-12-12T10:13:31.975747+0000","last_fullsized":"2023-12-12T10:13:31.975747+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_clean_scrub_stamp":"2023-12-12T10:13:30.930525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:32:40.635434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.973199+0000","last_change":"2023-12-12T10:13:31.969188+0000","last_active":"2023-12-12T10:13:31.973199+0000","last_peered":"2023-12-12T10:13:31.973199+0000","last_clean":"2023-12-12T10:13:31.973199+0000","last_became_active":"2023-12-12T10:13:31.968353+0000","last_became_peered":"2023-12-12T10:13:31.968353+0000","last_unstale":"2023-12-12T10:13:31.973199+0000","last_undegraded":"2023-12-12T10:13:31.973199+0000","last_fullsized":"2023-12-12T10:13:31.973199+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_clean_scrub_stamp":"2023-12-12T10:13:30.930525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:46:59.123475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.968402+0000","last_change":"2023-12-12T10:13:31.962980+0000","last_active":"2023-12-12T10:13:31.968402+0000","last_peered":"2023-12-12T10:13:31.968402+0000","last_clean":"2023-12-12T10:13:31.968402+0000","last_became_active":"2023-12-12T10:13:31.962702+0000","last_became_peered":"2023-12-12T10:13:31.962702+0000","last_unstale":"2023-12-12T10:13:31.968402+0000","last_undegraded":"2023-12-12T10:13:31.968402+0000","last_fullsized":"2023-12-12T10:13:31.968402+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_clean_scrub_stamp":"2023-12-12T10:13:30.930525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:46:10.675029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.972611+0000","last_change":"2023-12-12T10:13:31.965438+0000","last_active":"2023-12-12T10:13:31.972611+0000","last_peered":"2023-12-12T10:13:31.972611+0000","last_clean":"2023-12-12T10:13:31.972611+0000","last_became_active":"2023-12-12T10:13:31.965124+0000","last_became_peered":"2023-12-12T10:13:31.965124+0000","last_unstale":"2023-12-12T10:13:31.972611+0000","last_undegraded":"2023-12-12T10:13:31.972611+0000","last_fullsized":"2023-12-12T10:13:31.972611+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_clean_scrub_stamp":"2023-12-12T10:13:30.930525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:49:44.296783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.969171+0000","last_change":"2023-12-12T10:13:31.961302+0000","last_active":"2023-12-12T10:13:31.969171+0000","last_peered":"2023-12-12T10:13:31.969171+0000","last_clean":"2023-12-12T10:13:31.969171+0000","last_became_active":"2023-12-12T10:13:31.960859+0000","last_became_peered":"2023-12-12T10:13:31.960859+0000","last_unstale":"2023-12-12T10:13:31.969171+0000","last_undegraded":"2023-12-12T10:13:31.969171+0000","last_fullsized":"2023-12-12T10:13:31.969171+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_clean_scrub_stamp":"2023-12-12T10:13:30.930525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:39:15.634500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.971768+0000","last_change":"2023-12-12T10:13:31.968188+0000","last_active":"2023-12-12T10:13:31.971768+0000","last_peered":"2023-12-12T10:13:31.971768+0000","last_clean":"2023-12-12T10:13:31.971768+0000","last_became_active":"2023-12-12T10:13:31.966060+0000","last_became_peered":"2023-12-12T10:13:31.966060+0000","last_unstale":"2023-12-12T10:13:31.971768+0000","last_undegraded":"2023-12-12T10:13:31.971768+0000","last_fullsized":"2023-12-12T10:13:31.971768+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_clean_scrub_stamp":"2023-12-12T10:13:30.930525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:31:47.721834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.969204+0000","last_change":"2023-12-12T10:13:31.966467+0000","last_active":"2023-12-12T10:13:31.969204+0000","last_peered":"2023-12-12T10:13:31.969204+0000","last_clean":"2023-12-12T10:13:31.969204+0000","last_became_active":"2023-12-12T10:13:31.966185+0000","last_became_peered":"2023-12-12T10:13:31.966185+0000","last_unstale":"2023-12-12T10:13:31.969204+0000","last_undegraded":"2023-12-12T10:13:31.969204+0000","last_fullsized":"2023-12-12T10:13:31.969204+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_clean_scrub_stamp":"2023-12-12T10:13:30.930525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:39:15.634500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.972758+0000","last_change":"2023-12-12T10:13:31.971226+0000","last_active":"2023-12-12T10:13:31.972758+0000","last_peered":"2023-12-12T10:13:31.972758+0000","last_clean":"2023-12-12T10:13:31.972758+0000","last_became_active":"2023-12-12T10:13:31.970914+0000","last_became_peered":"2023-12-12T10:13:31.970914+0000","last_unstale":"2023-12-12T10:13:31.972758+0000","last_undegraded":"2023-12-12T10:13:31.972758+0000","last_fullsized":"2023-12-12T10:13:31.972758+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_clean_scrub_stamp":"2023-12-12T10:13:30.930525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:33:49.629588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.969920+0000","last_change":"2023-12-12T10:13:31.964692+0000","last_active":"2023-12-12T10:13:31.969920+0000","last_peered":"2023-12-12T10:13:31.969920+0000","last_clean":"2023-12-12T10:13:31.969920+0000","last_became_active":"2023-12-12T10:13:31.964341+0000","last_became_peered":"2023-12-12T10:13:31.964341+0000","last_unstale":"2023-12-12T10:13:31.969920+0000","last_undegraded":"2023-12-12T10:13:31.969920+0000","last_fullsized":"2023-12-12T10:13:31.969920+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_clean_scrub_stamp":"2023-12-12T10:13:30.930525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:16:42.138651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.962838+0000","last_change":"2023-12-12T10:13:31.958226+0000","last_active":"2023-12-12T10:13:31.962838+0000","last_peered":"2023-12-12T10:13:31.962838+0000","last_clean":"2023-12-12T10:13:31.962838+0000","last_became_active":"2023-12-12T10:13:31.957363+0000","last_became_peered":"2023-12-12T10:13:31.957363+0000","last_unstale":"2023-12-12T10:13:31.962838+0000","last_undegraded":"2023-12-12T10:13:31.962838+0000","last_fullsized":"2023-12-12T10:13:31.962838+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_clean_scrub_stamp":"2023-12-12T10:13:30.930525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:27:59.402764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.971316+0000","last_change":"2023-12-12T10:13:31.966618+0000","last_active":"2023-12-12T10:13:31.971316+0000","last_peered":"2023-12-12T10:13:31.971316+0000","last_clean":"2023-12-12T10:13:31.971316+0000","last_became_active":"2023-12-12T10:13:31.964114+0000","last_became_peered":"2023-12-12T10:13:31.964114+0000","last_unstale":"2023-12-12T10:13:31.971316+0000","last_undegraded":"2023-12-12T10:13:31.971316+0000","last_fullsized":"2023-12-12T10:13:31.971316+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_clean_scrub_stamp":"2023-12-12T10:13:30.930525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:47:34.197405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.974722+0000","last_change":"2023-12-12T10:13:31.971788+0000","last_active":"2023-12-12T10:13:31.974722+0000","last_peered":"2023-12-12T10:13:31.974722+0000","last_clean":"2023-12-12T10:13:31.974722+0000","last_became_active":"2023-12-12T10:13:31.969990+0000","last_became_peered":"2023-12-12T10:13:31.969990+0000","last_unstale":"2023-12-12T10:13:31.974722+0000","last_undegraded":"2023-12-12T10:13:31.974722+0000","last_fullsized":"2023-12-12T10:13:31.974722+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_clean_scrub_stamp":"2023-12-12T10:13:30.930525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:09:04.975169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.969187+0000","last_change":"2023-12-12T10:13:31.961831+0000","last_active":"2023-12-12T10:13:31.969187+0000","last_peered":"2023-12-12T10:13:31.969187+0000","last_clean":"2023-12-12T10:13:31.969187+0000","last_became_active":"2023-12-12T10:13:31.961569+0000","last_became_peered":"2023-12-12T10:13:31.961569+0000","last_unstale":"2023-12-12T10:13:31.969187+0000","last_undegraded":"2023-12-12T10:13:31.969187+0000","last_fullsized":"2023-12-12T10:13:31.969187+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_clean_scrub_stamp":"2023-12-12T10:13:30.930525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:47:34.197405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.960227+0000","last_change":"2023-12-12T10:13:31.952764+0000","last_active":"2023-12-12T10:13:31.960227+0000","last_peered":"2023-12-12T10:13:31.960227+0000","last_clean":"2023-12-12T10:13:31.960227+0000","last_became_active":"2023-12-12T10:13:31.952202+0000","last_became_peered":"2023-12-12T10:13:31.952202+0000","last_unstale":"2023-12-12T10:13:31.960227+0000","last_undegraded":"2023-12-12T10:13:31.960227+0000","last_fullsized":"2023-12-12T10:13:31.960227+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_clean_scrub_stamp":"2023-12-12T10:13:30.930525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:31:47.721834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.961265+0000","last_change":"2023-12-12T10:13:31.951321+0000","last_active":"2023-12-12T10:13:31.961265+0000","last_peered":"2023-12-12T10:13:31.961265+0000","last_clean":"2023-12-12T10:13:31.961265+0000","last_became_active":"2023-12-12T10:13:31.951001+0000","last_became_peered":"2023-12-12T10:13:31.951001+0000","last_unstale":"2023-12-12T10:13:31.961265+0000","last_undegraded":"2023-12-12T10:13:31.961265+0000","last_fullsized":"2023-12-12T10:13:31.961265+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_clean_scrub_stamp":"2023-12-12T10:13:30.930525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:23:17.616897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.970157+0000","last_change":"2023-12-12T10:13:31.965619+0000","last_active":"2023-12-12T10:13:31.970157+0000","last_peered":"2023-12-12T10:13:31.970157+0000","last_clean":"2023-12-12T10:13:31.970157+0000","last_became_active":"2023-12-12T10:13:31.963025+0000","last_became_peered":"2023-12-12T10:13:31.963025+0000","last_unstale":"2023-12-12T10:13:31.970157+0000","last_undegraded":"2023-12-12T10:13:31.970157+0000","last_fullsized":"2023-12-12T10:13:31.970157+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_clean_scrub_stamp":"2023-12-12T10:13:30.930525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:39:15.634500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.971123+0000","last_change":"2023-12-12T10:13:31.968209+0000","last_active":"2023-12-12T10:13:31.971123+0000","last_peered":"2023-12-12T10:13:31.971123+0000","last_clean":"2023-12-12T10:13:31.971123+0000","last_became_active":"2023-12-12T10:13:31.967843+0000","last_became_peered":"2023-12-12T10:13:31.967843+0000","last_unstale":"2023-12-12T10:13:31.971123+0000","last_undegraded":"2023-12-12T10:13:31.971123+0000","last_fullsized":"2023-12-12T10:13:31.971123+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_clean_scrub_stamp":"2023-12-12T10:13:30.930525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:46:10.675029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.955531+0000","last_change":"2023-12-12T10:13:31.951234+0000","last_active":"2023-12-12T10:13:31.955531+0000","last_peered":"2023-12-12T10:13:31.955531+0000","last_clean":"2023-12-12T10:13:31.955531+0000","last_became_active":"2023-12-12T10:13:31.950893+0000","last_became_peered":"2023-12-12T10:13:31.950893+0000","last_unstale":"2023-12-12T10:13:31.955531+0000","last_undegraded":"2023-12-12T10:13:31.955531+0000","last_fullsized":"2023-12-12T10:13:31.955531+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_clean_scrub_stamp":"2023-12-12T10:13:30.930525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:23:57.472966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.967416+0000","last_change":"2023-12-12T10:13:31.965517+0000","last_active":"2023-12-12T10:13:31.967416+0000","last_peered":"2023-12-12T10:13:31.967416+0000","last_clean":"2023-12-12T10:13:31.967416+0000","last_became_active":"2023-12-12T10:13:31.965224+0000","last_became_peered":"2023-12-12T10:13:31.965224+0000","last_unstale":"2023-12-12T10:13:31.967416+0000","last_undegraded":"2023-12-12T10:13:31.967416+0000","last_fullsized":"2023-12-12T10:13:31.967416+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_clean_scrub_stamp":"2023-12-12T10:13:30.930525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:01:28.709905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.963039+0000","last_change":"2023-12-12T10:13:31.958510+0000","last_active":"2023-12-12T10:13:31.963039+0000","last_peered":"2023-12-12T10:13:31.963039+0000","last_clean":"2023-12-12T10:13:31.963039+0000","last_became_active":"2023-12-12T10:13:31.958227+0000","last_became_peered":"2023-12-12T10:13:31.958227+0000","last_unstale":"2023-12-12T10:13:31.963039+0000","last_undegraded":"2023-12-12T10:13:31.963039+0000","last_fullsized":"2023-12-12T10:13:31.963039+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_clean_scrub_stamp":"2023-12-12T10:13:30.930525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:18:46.522714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.964891+0000","last_change":"2023-12-12T10:13:31.956633+0000","last_active":"2023-12-12T10:13:31.964891+0000","last_peered":"2023-12-12T10:13:31.964891+0000","last_clean":"2023-12-12T10:13:31.964891+0000","last_became_active":"2023-12-12T10:13:31.956283+0000","last_became_peered":"2023-12-12T10:13:31.956283+0000","last_unstale":"2023-12-12T10:13:31.964891+0000","last_undegraded":"2023-12-12T10:13:31.964891+0000","last_fullsized":"2023-12-12T10:13:31.964891+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_clean_scrub_stamp":"2023-12-12T10:13:30.930525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:37:08.558357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.961611+0000","last_change":"2023-12-12T10:13:31.953799+0000","last_active":"2023-12-12T10:13:31.961611+0000","last_peered":"2023-12-12T10:13:31.961611+0000","last_clean":"2023-12-12T10:13:31.961611+0000","last_became_active":"2023-12-12T10:13:31.953469+0000","last_became_peered":"2023-12-12T10:13:31.953469+0000","last_unstale":"2023-12-12T10:13:31.961611+0000","last_undegraded":"2023-12-12T10:13:31.961611+0000","last_fullsized":"2023-12-12T10:13:31.961611+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_clean_scrub_stamp":"2023-12-12T10:13:30.930525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:01:28.709905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.969362+0000","last_change":"2023-12-12T10:13:31.963470+0000","last_active":"2023-12-12T10:13:31.969362+0000","last_peered":"2023-12-12T10:13:31.969362+0000","last_clean":"2023-12-12T10:13:31.969362+0000","last_became_active":"2023-12-12T10:13:31.963190+0000","last_became_peered":"2023-12-12T10:13:31.963190+0000","last_unstale":"2023-12-12T10:13:31.969362+0000","last_undegraded":"2023-12-12T10:13:31.969362+0000","last_fullsized":"2023-12-12T10:13:31.969362+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_clean_scrub_stamp":"2023-12-12T10:13:30.930525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:23:57.472966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.973157+0000","last_change":"2023-12-12T10:13:31.968460+0000","last_active":"2023-12-12T10:13:31.973157+0000","last_peered":"2023-12-12T10:13:31.973157+0000","last_clean":"2023-12-12T10:13:31.973157+0000","last_became_active":"2023-12-12T10:13:31.968157+0000","last_became_peered":"2023-12-12T10:13:31.968157+0000","last_unstale":"2023-12-12T10:13:31.973157+0000","last_undegraded":"2023-12-12T10:13:31.973157+0000","last_fullsized":"2023-12-12T10:13:31.973157+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_clean_scrub_stamp":"2023-12-12T10:13:30.930525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:25:56.040481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.944088+0000","last_change":"2023-12-12T10:13:30.950982+0000","last_active":"2023-12-12T10:13:31.944088+0000","last_peered":"2023-12-12T10:13:31.944088+0000","last_clean":"2023-12-12T10:13:31.944088+0000","last_became_active":"2023-12-12T10:13:30.950562+0000","last_became_peered":"2023-12-12T10:13:30.950562+0000","last_unstale":"2023-12-12T10:13:31.944088+0000","last_undegraded":"2023-12-12T10:13:31.944088+0000","last_fullsized":"2023-12-12T10:13:31.944088+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:29.923090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:29.923090+0000","last_clean_scrub_stamp":"2023-12-12T10:13:29.923090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:46:09.667594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.971076+0000","last_change":"2023-12-12T10:13:31.967617+0000","last_active":"2023-12-12T10:13:31.971076+0000","last_peered":"2023-12-12T10:13:31.971076+0000","last_clean":"2023-12-12T10:13:31.971076+0000","last_became_active":"2023-12-12T10:13:31.967292+0000","last_became_peered":"2023-12-12T10:13:31.967292+0000","last_unstale":"2023-12-12T10:13:31.971076+0000","last_undegraded":"2023-12-12T10:13:31.971076+0000","last_fullsized":"2023-12-12T10:13:31.971076+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_clean_scrub_stamp":"2023-12-12T10:13:30.930525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:09:04.975169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"38'1","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:32.027595+0000","last_change":"2023-12-12T10:13:30.961592+0000","last_active":"2023-12-12T10:13:32.027595+0000","last_peered":"2023-12-12T10:13:32.027595+0000","last_clean":"2023-12-12T10:13:32.027595+0000","last_became_active":"2023-12-12T10:13:30.961365+0000","last_became_peered":"2023-12-12T10:13:30.961365+0000","last_unstale":"2023-12-12T10:13:32.027595+0000","last_undegraded":"2023-12-12T10:13:32.027595+0000","last_fullsized":"2023-12-12T10:13:32.027595+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:29.923090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:29.923090+0000","last_clean_scrub_stamp":"2023-12-12T10:13:29.923090+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:25:55.033047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.972905+0000","last_change":"2023-12-12T10:13:31.962515+0000","last_active":"2023-12-12T10:13:31.972905+0000","last_peered":"2023-12-12T10:13:31.972905+0000","last_clean":"2023-12-12T10:13:31.972905+0000","last_became_active":"2023-12-12T10:13:31.962207+0000","last_became_peered":"2023-12-12T10:13:31.962207+0000","last_unstale":"2023-12-12T10:13:31.972905+0000","last_undegraded":"2023-12-12T10:13:31.972905+0000","last_fullsized":"2023-12-12T10:13:31.972905+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_clean_scrub_stamp":"2023-12-12T10:13:30.930525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:51:42.232761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"38'2","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:32.028256+0000","last_change":"2023-12-12T10:13:30.957754+0000","last_active":"2023-12-12T10:13:32.028256+0000","last_peered":"2023-12-12T10:13:32.028256+0000","last_clean":"2023-12-12T10:13:32.028256+0000","last_became_active":"2023-12-12T10:13:30.957249+0000","last_became_peered":"2023-12-12T10:13:30.957249+0000","last_unstale":"2023-12-12T10:13:32.028256+0000","last_undegraded":"2023-12-12T10:13:32.028256+0000","last_fullsized":"2023-12-12T10:13:32.028256+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:29.923090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:29.923090+0000","last_clean_scrub_stamp":"2023-12-12T10:13:29.923090+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:49:43.289349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.968630+0000","last_change":"2023-12-12T10:13:31.958023+0000","last_active":"2023-12-12T10:13:31.968630+0000","last_peered":"2023-12-12T10:13:31.968630+0000","last_clean":"2023-12-12T10:13:31.968630+0000","last_became_active":"2023-12-12T10:13:31.957703+0000","last_became_peered":"2023-12-12T10:13:31.957703+0000","last_unstale":"2023-12-12T10:13:31.968630+0000","last_undegraded":"2023-12-12T10:13:31.968630+0000","last_fullsized":"2023-12-12T10:13:31.968630+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_clean_scrub_stamp":"2023-12-12T10:13:30.930525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:01:05.027866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.958642+0000","last_change":"2023-12-12T10:13:30.962848+0000","last_active":"2023-12-12T10:13:31.958642+0000","last_peered":"2023-12-12T10:13:31.958642+0000","last_clean":"2023-12-12T10:13:31.958642+0000","last_became_active":"2023-12-12T10:13:30.962498+0000","last_became_peered":"2023-12-12T10:13:30.962498+0000","last_unstale":"2023-12-12T10:13:31.958642+0000","last_undegraded":"2023-12-12T10:13:31.958642+0000","last_fullsized":"2023-12-12T10:13:31.958642+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:29.923090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:29.923090+0000","last_clean_scrub_stamp":"2023-12-12T10:13:29.923090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:09:03.967735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.966602+0000","last_change":"2023-12-12T10:13:31.962063+0000","last_active":"2023-12-12T10:13:31.966602+0000","last_peered":"2023-12-12T10:13:31.966602+0000","last_clean":"2023-12-12T10:13:31.966602+0000","last_became_active":"2023-12-12T10:13:31.960741+0000","last_became_peered":"2023-12-12T10:13:31.960741+0000","last_unstale":"2023-12-12T10:13:31.966602+0000","last_undegraded":"2023-12-12T10:13:31.966602+0000","last_fullsized":"2023-12-12T10:13:31.966602+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_clean_scrub_stamp":"2023-12-12T10:13:30.930525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:16:42.138651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"38'1","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:32.026941+0000","last_change":"2023-12-12T10:13:30.963202+0000","last_active":"2023-12-12T10:13:32.026941+0000","last_peered":"2023-12-12T10:13:32.026941+0000","last_clean":"2023-12-12T10:13:32.026941+0000","last_became_active":"2023-12-12T10:13:30.962798+0000","last_became_peered":"2023-12-12T10:13:30.962798+0000","last_unstale":"2023-12-12T10:13:32.026941+0000","last_undegraded":"2023-12-12T10:13:32.026941+0000","last_fullsized":"2023-12-12T10:13:32.026941+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:29.923090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:29.923090+0000","last_clean_scrub_stamp":"2023-12-12T10:13:29.923090+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:10:50.706784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.974500+0000","last_change":"2023-12-12T10:13:31.970145+0000","last_active":"2023-12-12T10:13:31.974500+0000","last_peered":"2023-12-12T10:13:31.974500+0000","last_clean":"2023-12-12T10:13:31.974500+0000","last_became_active":"2023-12-12T10:13:31.968499+0000","last_became_peered":"2023-12-12T10:13:31.968499+0000","last_unstale":"2023-12-12T10:13:31.974500+0000","last_undegraded":"2023-12-12T10:13:31.974500+0000","last_fullsized":"2023-12-12T10:13:31.974500+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_clean_scrub_stamp":"2023-12-12T10:13:30.930525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:46:10.675029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.943530+0000","last_change":"2023-12-12T10:13:30.966219+0000","last_active":"2023-12-12T10:13:31.943530+0000","last_peered":"2023-12-12T10:13:31.943530+0000","last_clean":"2023-12-12T10:13:31.943530+0000","last_became_active":"2023-12-12T10:13:30.965580+0000","last_became_peered":"2023-12-12T10:13:30.965580+0000","last_unstale":"2023-12-12T10:13:31.943530+0000","last_undegraded":"2023-12-12T10:13:31.943530+0000","last_fullsized":"2023-12-12T10:13:31.943530+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:29.923090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:29.923090+0000","last_clean_scrub_stamp":"2023-12-12T10:13:29.923090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:44:54.080621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.973094+0000","last_change":"2023-12-12T10:13:31.969053+0000","last_active":"2023-12-12T10:13:31.973094+0000","last_peered":"2023-12-12T10:13:31.973094+0000","last_clean":"2023-12-12T10:13:31.973094+0000","last_became_active":"2023-12-12T10:13:31.968771+0000","last_became_peered":"2023-12-12T10:13:31.968771+0000","last_unstale":"2023-12-12T10:13:31.973094+0000","last_undegraded":"2023-12-12T10:13:31.973094+0000","last_fullsized":"2023-12-12T10:13:31.973094+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_clean_scrub_stamp":"2023-12-12T10:13:30.930525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:37:08.558357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.946608+0000","last_change":"2023-12-12T10:13:30.960943+0000","last_active":"2023-12-12T10:13:31.946608+0000","last_peered":"2023-12-12T10:13:31.946608+0000","last_clean":"2023-12-12T10:13:31.946608+0000","last_became_active":"2023-12-12T10:13:30.960679+0000","last_became_peered":"2023-12-12T10:13:30.960679+0000","last_unstale":"2023-12-12T10:13:31.946608+0000","last_undegraded":"2023-12-12T10:13:31.946608+0000","last_fullsized":"2023-12-12T10:13:31.946608+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:29.923090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:29.923090+0000","last_clean_scrub_stamp":"2023-12-12T10:13:29.923090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:51:41.225326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.961346+0000","last_change":"2023-12-12T10:13:31.956585+0000","last_active":"2023-12-12T10:13:31.961346+0000","last_peered":"2023-12-12T10:13:31.961346+0000","last_clean":"2023-12-12T10:13:31.961346+0000","last_became_active":"2023-12-12T10:13:31.956294+0000","last_became_peered":"2023-12-12T10:13:31.956294+0000","last_unstale":"2023-12-12T10:13:31.961346+0000","last_undegraded":"2023-12-12T10:13:31.961346+0000","last_fullsized":"2023-12-12T10:13:31.961346+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_clean_scrub_stamp":"2023-12-12T10:13:30.930525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:41:48.610201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.950373+0000","last_change":"2023-12-12T10:13:30.946938+0000","last_active":"2023-12-12T10:13:31.950373+0000","last_peered":"2023-12-12T10:13:31.950373+0000","last_clean":"2023-12-12T10:13:31.950373+0000","last_became_active":"2023-12-12T10:13:30.946517+0000","last_became_peered":"2023-12-12T10:13:30.946517+0000","last_unstale":"2023-12-12T10:13:31.950373+0000","last_undegraded":"2023-12-12T10:13:31.950373+0000","last_fullsized":"2023-12-12T10:13:31.950373+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:29.923090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:29.923090+0000","last_clean_scrub_stamp":"2023-12-12T10:13:29.923090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:46:09.667594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.969281+0000","last_change":"2023-12-12T10:13:31.965912+0000","last_active":"2023-12-12T10:13:31.969281+0000","last_peered":"2023-12-12T10:13:31.969281+0000","last_clean":"2023-12-12T10:13:31.969281+0000","last_became_active":"2023-12-12T10:13:31.965651+0000","last_became_peered":"2023-12-12T10:13:31.965651+0000","last_unstale":"2023-12-12T10:13:31.969281+0000","last_undegraded":"2023-12-12T10:13:31.969281+0000","last_fullsized":"2023-12-12T10:13:31.969281+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_clean_scrub_stamp":"2023-12-12T10:13:30.930525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:24:02.702980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.946339+0000","last_change":"2023-12-12T10:13:30.961399+0000","last_active":"2023-12-12T10:13:31.946339+0000","last_peered":"2023-12-12T10:13:31.946339+0000","last_clean":"2023-12-12T10:13:31.946339+0000","last_became_active":"2023-12-12T10:13:30.961090+0000","last_became_peered":"2023-12-12T10:13:30.961090+0000","last_unstale":"2023-12-12T10:13:31.946339+0000","last_undegraded":"2023-12-12T10:13:31.946339+0000","last_fullsized":"2023-12-12T10:13:31.946339+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:29.923090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:29.923090+0000","last_clean_scrub_stamp":"2023-12-12T10:13:29.923090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:53:19.343833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.960148+0000","last_change":"2023-12-12T10:13:31.952549+0000","last_active":"2023-12-12T10:13:31.960148+0000","last_peered":"2023-12-12T10:13:31.960148+0000","last_clean":"2023-12-12T10:13:31.960148+0000","last_became_active":"2023-12-12T10:13:31.952264+0000","last_became_peered":"2023-12-12T10:13:31.952264+0000","last_unstale":"2023-12-12T10:13:31.960148+0000","last_undegraded":"2023-12-12T10:13:31.960148+0000","last_fullsized":"2023-12-12T10:13:31.960148+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_clean_scrub_stamp":"2023-12-12T10:13:30.930525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:32:40.635434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.958882+0000","last_change":"2023-12-12T10:13:30.964892+0000","last_active":"2023-12-12T10:13:31.958882+0000","last_peered":"2023-12-12T10:13:31.958882+0000","last_clean":"2023-12-12T10:13:31.958882+0000","last_became_active":"2023-12-12T10:13:30.964591+0000","last_became_peered":"2023-12-12T10:13:30.964591+0000","last_unstale":"2023-12-12T10:13:31.958882+0000","last_undegraded":"2023-12-12T10:13:31.958882+0000","last_fullsized":"2023-12-12T10:13:31.958882+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:29.923090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:29.923090+0000","last_clean_scrub_stamp":"2023-12-12T10:13:29.923090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:30:09.728391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.962706+0000","last_change":"2023-12-12T10:13:31.959535+0000","last_active":"2023-12-12T10:13:31.962706+0000","last_peered":"2023-12-12T10:13:31.962706+0000","last_clean":"2023-12-12T10:13:31.962706+0000","last_became_active":"2023-12-12T10:13:31.959264+0000","last_became_peered":"2023-12-12T10:13:31.959264+0000","last_unstale":"2023-12-12T10:13:31.962706+0000","last_undegraded":"2023-12-12T10:13:31.962706+0000","last_fullsized":"2023-12-12T10:13:31.962706+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_clean_scrub_stamp":"2023-12-12T10:13:30.930525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:37:08.558357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"38'3","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.958869+0000","last_change":"2023-12-12T10:13:30.959208+0000","last_active":"2023-12-12T10:13:31.958869+0000","last_peered":"2023-12-12T10:13:31.958869+0000","last_clean":"2023-12-12T10:13:31.958869+0000","last_became_active":"2023-12-12T10:13:30.958872+0000","last_became_peered":"2023-12-12T10:13:30.958872+0000","last_unstale":"2023-12-12T10:13:31.958869+0000","last_undegraded":"2023-12-12T10:13:31.958869+0000","last_fullsized":"2023-12-12T10:13:31.958869+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:29.923090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:29.923090+0000","last_clean_scrub_stamp":"2023-12-12T10:13:29.923090+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:38:50.871593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.968641+0000","last_change":"2023-12-12T10:13:31.962170+0000","last_active":"2023-12-12T10:13:31.968641+0000","last_peered":"2023-12-12T10:13:31.968641+0000","last_clean":"2023-12-12T10:13:31.968641+0000","last_became_active":"2023-12-12T10:13:31.961870+0000","last_became_peered":"2023-12-12T10:13:31.961870+0000","last_unstale":"2023-12-12T10:13:31.968641+0000","last_undegraded":"2023-12-12T10:13:31.968641+0000","last_fullsized":"2023-12-12T10:13:31.968641+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_clean_scrub_stamp":"2023-12-12T10:13:30.930525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:33:49.629588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"38'5","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.946376+0000","last_change":"2023-12-12T10:13:30.961032+0000","last_active":"2023-12-12T10:13:31.946376+0000","last_peered":"2023-12-12T10:13:31.946376+0000","last_clean":"2023-12-12T10:13:31.946376+0000","last_became_active":"2023-12-12T10:13:30.960658+0000","last_became_peered":"2023-12-12T10:13:30.960658+0000","last_unstale":"2023-12-12T10:13:31.946376+0000","last_undegraded":"2023-12-12T10:13:31.946376+0000","last_fullsized":"2023-12-12T10:13:31.946376+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:29.923090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:29.923090+0000","last_clean_scrub_stamp":"2023-12-12T10:13:29.923090+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:11:40.001970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.968875+0000","last_change":"2023-12-12T10:13:31.965151+0000","last_active":"2023-12-12T10:13:31.968875+0000","last_peered":"2023-12-12T10:13:31.968875+0000","last_clean":"2023-12-12T10:13:31.968875+0000","last_became_active":"2023-12-12T10:13:31.964846+0000","last_became_peered":"2023-12-12T10:13:31.964846+0000","last_unstale":"2023-12-12T10:13:31.968875+0000","last_undegraded":"2023-12-12T10:13:31.968875+0000","last_fullsized":"2023-12-12T10:13:31.968875+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_clean_scrub_stamp":"2023-12-12T10:13:30.930525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:39:15.634500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"38'2","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.946295+0000","last_change":"2023-12-12T10:13:30.958546+0000","last_active":"2023-12-12T10:13:31.946295+0000","last_peered":"2023-12-12T10:13:31.946295+0000","last_clean":"2023-12-12T10:13:31.946295+0000","last_became_active":"2023-12-12T10:13:30.958239+0000","last_became_peered":"2023-12-12T10:13:30.958239+0000","last_unstale":"2023-12-12T10:13:31.946295+0000","last_undegraded":"2023-12-12T10:13:31.946295+0000","last_fullsized":"2023-12-12T10:13:31.946295+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:29.923090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:29.923090+0000","last_clean_scrub_stamp":"2023-12-12T10:13:29.923090+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:50:46.051110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.971472+0000","last_change":"2023-12-12T10:13:31.963029+0000","last_active":"2023-12-12T10:13:31.971472+0000","last_peered":"2023-12-12T10:13:31.971472+0000","last_clean":"2023-12-12T10:13:31.971472+0000","last_became_active":"2023-12-12T10:13:31.962713+0000","last_became_peered":"2023-12-12T10:13:31.962713+0000","last_unstale":"2023-12-12T10:13:31.971472+0000","last_undegraded":"2023-12-12T10:13:31.971472+0000","last_fullsized":"2023-12-12T10:13:31.971472+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_clean_scrub_stamp":"2023-12-12T10:13:30.930525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:44:55.088056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.947327+0000","last_change":"2023-12-12T10:13:30.959108+0000","last_active":"2023-12-12T10:13:31.947327+0000","last_peered":"2023-12-12T10:13:31.947327+0000","last_clean":"2023-12-12T10:13:31.947327+0000","last_became_active":"2023-12-12T10:13:30.958896+0000","last_became_peered":"2023-12-12T10:13:30.958896+0000","last_unstale":"2023-12-12T10:13:31.947327+0000","last_undegraded":"2023-12-12T10:13:31.947327+0000","last_fullsized":"2023-12-12T10:13:31.947327+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:29.923090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:29.923090+0000","last_clean_scrub_stamp":"2023-12-12T10:13:29.923090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:31:46.714399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.961595+0000","last_change":"2023-12-12T10:13:31.953632+0000","last_active":"2023-12-12T10:13:31.961595+0000","last_peered":"2023-12-12T10:13:31.961595+0000","last_clean":"2023-12-12T10:13:31.961595+0000","last_became_active":"2023-12-12T10:13:31.951993+0000","last_became_peered":"2023-12-12T10:13:31.951993+0000","last_unstale":"2023-12-12T10:13:31.961595+0000","last_undegraded":"2023-12-12T10:13:31.961595+0000","last_fullsized":"2023-12-12T10:13:31.961595+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_clean_scrub_stamp":"2023-12-12T10:13:30.930525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:51:42.232761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.942678+0000","last_change":"2023-12-12T10:13:30.954138+0000","last_active":"2023-12-12T10:13:31.942678+0000","last_peered":"2023-12-12T10:13:31.942678+0000","last_clean":"2023-12-12T10:13:31.942678+0000","last_became_active":"2023-12-12T10:13:30.953867+0000","last_became_peered":"2023-12-12T10:13:30.953867+0000","last_unstale":"2023-12-12T10:13:31.942678+0000","last_undegraded":"2023-12-12T10:13:31.942678+0000","last_fullsized":"2023-12-12T10:13:31.942678+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:29.923090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:29.923090+0000","last_clean_scrub_stamp":"2023-12-12T10:13:29.923090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:51:41.225326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.961327+0000","last_change":"2023-12-12T10:13:31.952191+0000","last_active":"2023-12-12T10:13:31.961327+0000","last_peered":"2023-12-12T10:13:31.961327+0000","last_clean":"2023-12-12T10:13:31.961327+0000","last_became_active":"2023-12-12T10:13:31.951860+0000","last_became_peered":"2023-12-12T10:13:31.951860+0000","last_unstale":"2023-12-12T10:13:31.961327+0000","last_undegraded":"2023-12-12T10:13:31.961327+0000","last_fullsized":"2023-12-12T10:13:31.961327+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_clean_scrub_stamp":"2023-12-12T10:13:30.930525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:32:40.635434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.942884+0000","last_change":"2023-12-12T10:13:30.964109+0000","last_active":"2023-12-12T10:13:31.942884+0000","last_peered":"2023-12-12T10:13:31.942884+0000","last_clean":"2023-12-12T10:13:31.942884+0000","last_became_active":"2023-12-12T10:13:30.963813+0000","last_became_peered":"2023-12-12T10:13:30.963813+0000","last_unstale":"2023-12-12T10:13:31.942884+0000","last_undegraded":"2023-12-12T10:13:31.942884+0000","last_fullsized":"2023-12-12T10:13:31.942884+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:29.923090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:29.923090+0000","last_clean_scrub_stamp":"2023-12-12T10:13:29.923090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:46:09.667594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.964463+0000","last_change":"2023-12-12T10:13:31.959106+0000","last_active":"2023-12-12T10:13:31.964463+0000","last_peered":"2023-12-12T10:13:31.964463+0000","last_clean":"2023-12-12T10:13:31.964463+0000","last_became_active":"2023-12-12T10:13:31.958830+0000","last_became_peered":"2023-12-12T10:13:31.958830+0000","last_unstale":"2023-12-12T10:13:31.964463+0000","last_undegraded":"2023-12-12T10:13:31.964463+0000","last_fullsized":"2023-12-12T10:13:31.964463+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_clean_scrub_stamp":"2023-12-12T10:13:30.930525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:10:51.714219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"38'1","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.958360+0000","last_change":"2023-12-12T10:13:30.960227+0000","last_active":"2023-12-12T10:13:31.958360+0000","last_peered":"2023-12-12T10:13:31.958360+0000","last_clean":"2023-12-12T10:13:31.958360+0000","last_became_active":"2023-12-12T10:13:30.959934+0000","last_became_peered":"2023-12-12T10:13:30.959934+0000","last_unstale":"2023-12-12T10:13:31.958360+0000","last_undegraded":"2023-12-12T10:13:31.958360+0000","last_fullsized":"2023-12-12T10:13:31.958360+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:29.923090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:29.923090+0000","last_clean_scrub_stamp":"2023-12-12T10:13:29.923090+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:41:47.602766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.974507+0000","last_change":"2023-12-12T10:13:31.970206+0000","last_active":"2023-12-12T10:13:31.974507+0000","last_peered":"2023-12-12T10:13:31.974507+0000","last_clean":"2023-12-12T10:13:31.974507+0000","last_became_active":"2023-12-12T10:13:31.968699+0000","last_became_peered":"2023-12-12T10:13:31.968699+0000","last_unstale":"2023-12-12T10:13:31.974507+0000","last_undegraded":"2023-12-12T10:13:31.974507+0000","last_fullsized":"2023-12-12T10:13:31.974507+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_clean_scrub_stamp":"2023-12-12T10:13:30.930525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:44:55.088056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.958581+0000","last_change":"2023-12-12T10:13:30.960842+0000","last_active":"2023-12-12T10:13:31.958581+0000","last_peered":"2023-12-12T10:13:31.958581+0000","last_clean":"2023-12-12T10:13:31.958581+0000","last_became_active":"2023-12-12T10:13:30.960564+0000","last_became_peered":"2023-12-12T10:13:30.960564+0000","last_unstale":"2023-12-12T10:13:31.958581+0000","last_undegraded":"2023-12-12T10:13:31.958581+0000","last_fullsized":"2023-12-12T10:13:31.958581+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:29.923090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:29.923090+0000","last_clean_scrub_stamp":"2023-12-12T10:13:29.923090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:31:46.714399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.972920+0000","last_change":"2023-12-12T10:13:31.962924+0000","last_active":"2023-12-12T10:13:31.972920+0000","last_peered":"2023-12-12T10:13:31.972920+0000","last_clean":"2023-12-12T10:13:31.972920+0000","last_became_active":"2023-12-12T10:13:31.962658+0000","last_became_peered":"2023-12-12T10:13:31.962658+0000","last_unstale":"2023-12-12T10:13:31.972920+0000","last_undegraded":"2023-12-12T10:13:31.972920+0000","last_fullsized":"2023-12-12T10:13:31.972920+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_clean_scrub_stamp":"2023-12-12T10:13:30.930525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:16:42.138651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"38'1","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.939844+0000","last_change":"2023-12-12T10:13:30.960419+0000","last_active":"2023-12-12T10:13:31.939844+0000","last_peered":"2023-12-12T10:13:31.939844+0000","last_clean":"2023-12-12T10:13:31.939844+0000","last_became_active":"2023-12-12T10:13:30.960156+0000","last_became_peered":"2023-12-12T10:13:30.960156+0000","last_unstale":"2023-12-12T10:13:31.939844+0000","last_undegraded":"2023-12-12T10:13:31.939844+0000","last_fullsized":"2023-12-12T10:13:31.939844+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:29.923090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:29.923090+0000","last_clean_scrub_stamp":"2023-12-12T10:13:29.923090+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:06:03.884942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.962949+0000","last_change":"2023-12-12T10:13:31.958947+0000","last_active":"2023-12-12T10:13:31.962949+0000","last_peered":"2023-12-12T10:13:31.962949+0000","last_clean":"2023-12-12T10:13:31.962949+0000","last_became_active":"2023-12-12T10:13:31.958564+0000","last_became_peered":"2023-12-12T10:13:31.958564+0000","last_unstale":"2023-12-12T10:13:31.962949+0000","last_undegraded":"2023-12-12T10:13:31.962949+0000","last_fullsized":"2023-12-12T10:13:31.962949+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_clean_scrub_stamp":"2023-12-12T10:13:30.930525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:53:26.274851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.946803+0000","last_change":"2023-12-12T10:13:30.957980+0000","last_active":"2023-12-12T10:13:31.946803+0000","last_peered":"2023-12-12T10:13:31.946803+0000","last_clean":"2023-12-12T10:13:31.946803+0000","last_became_active":"2023-12-12T10:13:30.957727+0000","last_became_peered":"2023-12-12T10:13:30.957727+0000","last_unstale":"2023-12-12T10:13:31.946803+0000","last_undegraded":"2023-12-12T10:13:31.946803+0000","last_fullsized":"2023-12-12T10:13:31.946803+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:29.923090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:29.923090+0000","last_clean_scrub_stamp":"2023-12-12T10:13:29.923090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:33:48.622153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.962570+0000","last_change":"2023-12-12T10:13:31.954761+0000","last_active":"2023-12-12T10:13:31.962570+0000","last_peered":"2023-12-12T10:13:31.962570+0000","last_clean":"2023-12-12T10:13:31.962570+0000","last_became_active":"2023-12-12T10:13:31.954428+0000","last_became_peered":"2023-12-12T10:13:31.954428+0000","last_unstale":"2023-12-12T10:13:31.962570+0000","last_undegraded":"2023-12-12T10:13:31.962570+0000","last_fullsized":"2023-12-12T10:13:31.962570+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_clean_scrub_stamp":"2023-12-12T10:13:30.930525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:09:04.975169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"38'2","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.939898+0000","last_change":"2023-12-12T10:13:30.956870+0000","last_active":"2023-12-12T10:13:31.939898+0000","last_peered":"2023-12-12T10:13:31.939898+0000","last_clean":"2023-12-12T10:13:31.939898+0000","last_became_active":"2023-12-12T10:13:30.956590+0000","last_became_peered":"2023-12-12T10:13:30.956590+0000","last_unstale":"2023-12-12T10:13:31.939898+0000","last_undegraded":"2023-12-12T10:13:31.939898+0000","last_fullsized":"2023-12-12T10:13:31.939898+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:29.923090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:29.923090+0000","last_clean_scrub_stamp":"2023-12-12T10:13:29.923090+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:08:19.409816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.966502+0000","last_change":"2023-12-12T10:13:31.961554+0000","last_active":"2023-12-12T10:13:31.966502+0000","last_peered":"2023-12-12T10:13:31.966502+0000","last_clean":"2023-12-12T10:13:31.966502+0000","last_became_active":"2023-12-12T10:13:31.961239+0000","last_became_peered":"2023-12-12T10:13:31.961239+0000","last_unstale":"2023-12-12T10:13:31.966502+0000","last_undegraded":"2023-12-12T10:13:31.966502+0000","last_fullsized":"2023-12-12T10:13:31.966502+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_clean_scrub_stamp":"2023-12-12T10:13:30.930525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:51:42.232761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.939670+0000","last_change":"2023-12-12T10:13:30.952636+0000","last_active":"2023-12-12T10:13:31.939670+0000","last_peered":"2023-12-12T10:13:31.939670+0000","last_clean":"2023-12-12T10:13:31.939670+0000","last_became_active":"2023-12-12T10:13:30.952350+0000","last_became_peered":"2023-12-12T10:13:30.952350+0000","last_unstale":"2023-12-12T10:13:31.939670+0000","last_undegraded":"2023-12-12T10:13:31.939670+0000","last_fullsized":"2023-12-12T10:13:31.939670+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:29.923090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:29.923090+0000","last_clean_scrub_stamp":"2023-12-12T10:13:29.923090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:29:39.862901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.971743+0000","last_change":"2023-12-12T10:13:31.967555+0000","last_active":"2023-12-12T10:13:31.971743+0000","last_peered":"2023-12-12T10:13:31.971743+0000","last_clean":"2023-12-12T10:13:31.971743+0000","last_became_active":"2023-12-12T10:13:31.966502+0000","last_became_peered":"2023-12-12T10:13:31.966502+0000","last_unstale":"2023-12-12T10:13:31.971743+0000","last_undegraded":"2023-12-12T10:13:31.971743+0000","last_fullsized":"2023-12-12T10:13:31.971743+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_clean_scrub_stamp":"2023-12-12T10:13:30.930525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T22:04:14.045112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.943349+0000","last_change":"2023-12-12T10:13:30.964332+0000","last_active":"2023-12-12T10:13:31.943349+0000","last_peered":"2023-12-12T10:13:31.943349+0000","last_clean":"2023-12-12T10:13:31.943349+0000","last_became_active":"2023-12-12T10:13:30.964061+0000","last_became_peered":"2023-12-12T10:13:30.964061+0000","last_unstale":"2023-12-12T10:13:31.943349+0000","last_undegraded":"2023-12-12T10:13:31.943349+0000","last_fullsized":"2023-12-12T10:13:31.943349+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:29.923090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:29.923090+0000","last_clean_scrub_stamp":"2023-12-12T10:13:29.923090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:49:43.289349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.961387+0000","last_change":"2023-12-12T10:13:31.957083+0000","last_active":"2023-12-12T10:13:31.961387+0000","last_peered":"2023-12-12T10:13:31.961387+0000","last_clean":"2023-12-12T10:13:31.961387+0000","last_became_active":"2023-12-12T10:13:31.956814+0000","last_became_peered":"2023-12-12T10:13:31.956814+0000","last_unstale":"2023-12-12T10:13:31.961387+0000","last_undegraded":"2023-12-12T10:13:31.961387+0000","last_fullsized":"2023-12-12T10:13:31.961387+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_clean_scrub_stamp":"2023-12-12T10:13:30.930525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:38:51.879028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.939733+0000","last_change":"2023-12-12T10:13:30.954045+0000","last_active":"2023-12-12T10:13:31.939733+0000","last_peered":"2023-12-12T10:13:31.939733+0000","last_clean":"2023-12-12T10:13:31.939733+0000","last_became_active":"2023-12-12T10:13:30.953642+0000","last_became_peered":"2023-12-12T10:13:30.953642+0000","last_unstale":"2023-12-12T10:13:31.939733+0000","last_undegraded":"2023-12-12T10:13:31.939733+0000","last_fullsized":"2023-12-12T10:13:31.939733+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:29.923090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:29.923090+0000","last_clean_scrub_stamp":"2023-12-12T10:13:29.923090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:18:26.061610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.971030+0000","last_change":"2023-12-12T10:13:31.967459+0000","last_active":"2023-12-12T10:13:31.971030+0000","last_peered":"2023-12-12T10:13:31.971030+0000","last_clean":"2023-12-12T10:13:31.971030+0000","last_became_active":"2023-12-12T10:13:31.967192+0000","last_became_peered":"2023-12-12T10:13:31.967192+0000","last_unstale":"2023-12-12T10:13:31.971030+0000","last_undegraded":"2023-12-12T10:13:31.971030+0000","last_fullsized":"2023-12-12T10:13:31.971030+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_clean_scrub_stamp":"2023-12-12T10:13:30.930525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:16:42.138651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"38'2","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.958558+0000","last_change":"2023-12-12T10:13:30.959720+0000","last_active":"2023-12-12T10:13:31.958558+0000","last_peered":"2023-12-12T10:13:31.958558+0000","last_clean":"2023-12-12T10:13:31.958558+0000","last_became_active":"2023-12-12T10:13:30.959430+0000","last_became_peered":"2023-12-12T10:13:30.959430+0000","last_unstale":"2023-12-12T10:13:31.958558+0000","last_undegraded":"2023-12-12T10:13:31.958558+0000","last_fullsized":"2023-12-12T10:13:31.958558+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:29.923090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:29.923090+0000","last_clean_scrub_stamp":"2023-12-12T10:13:29.923090+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:37:35.766519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.961466+0000","last_change":"2023-12-12T10:13:31.953531+0000","last_active":"2023-12-12T10:13:31.961466+0000","last_peered":"2023-12-12T10:13:31.961466+0000","last_clean":"2023-12-12T10:13:31.961466+0000","last_became_active":"2023-12-12T10:13:31.953210+0000","last_became_peered":"2023-12-12T10:13:31.953210+0000","last_unstale":"2023-12-12T10:13:31.961466+0000","last_undegraded":"2023-12-12T10:13:31.961466+0000","last_fullsized":"2023-12-12T10:13:31.961466+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_clean_scrub_stamp":"2023-12-12T10:13:30.930525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T22:04:14.045112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.939923+0000","last_change":"2023-12-12T10:13:30.958892+0000","last_active":"2023-12-12T10:13:31.939923+0000","last_peered":"2023-12-12T10:13:31.939923+0000","last_clean":"2023-12-12T10:13:31.939923+0000","last_became_active":"2023-12-12T10:13:30.958589+0000","last_became_peered":"2023-12-12T10:13:30.958589+0000","last_unstale":"2023-12-12T10:13:31.939923+0000","last_undegraded":"2023-12-12T10:13:31.939923+0000","last_fullsized":"2023-12-12T10:13:31.939923+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:29.923090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:29.923090+0000","last_clean_scrub_stamp":"2023-12-12T10:13:29.923090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:55:00.196669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.971538+0000","last_change":"2023-12-12T10:13:31.965301+0000","last_active":"2023-12-12T10:13:31.971538+0000","last_peered":"2023-12-12T10:13:31.971538+0000","last_clean":"2023-12-12T10:13:31.971538+0000","last_became_active":"2023-12-12T10:13:31.965005+0000","last_became_peered":"2023-12-12T10:13:31.965005+0000","last_unstale":"2023-12-12T10:13:31.971538+0000","last_undegraded":"2023-12-12T10:13:31.971538+0000","last_fullsized":"2023-12-12T10:13:31.971538+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_clean_scrub_stamp":"2023-12-12T10:13:30.930525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:41:29.667201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.953341+0000","last_change":"2023-12-12T10:13:30.961434+0000","last_active":"2023-12-12T10:13:31.953341+0000","last_peered":"2023-12-12T10:13:31.953341+0000","last_clean":"2023-12-12T10:13:31.953341+0000","last_became_active":"2023-12-12T10:13:30.960429+0000","last_became_peered":"2023-12-12T10:13:30.960429+0000","last_unstale":"2023-12-12T10:13:31.953341+0000","last_undegraded":"2023-12-12T10:13:31.953341+0000","last_fullsized":"2023-12-12T10:13:31.953341+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:29.923090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:29.923090+0000","last_clean_scrub_stamp":"2023-12-12T10:13:29.923090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:09:03.967735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.968790+0000","last_change":"2023-12-12T10:13:31.964056+0000","last_active":"2023-12-12T10:13:31.968790+0000","last_peered":"2023-12-12T10:13:31.968790+0000","last_clean":"2023-12-12T10:13:31.968790+0000","last_became_active":"2023-12-12T10:13:31.963732+0000","last_became_peered":"2023-12-12T10:13:31.963732+0000","last_unstale":"2023-12-12T10:13:31.968790+0000","last_undegraded":"2023-12-12T10:13:31.968790+0000","last_fullsized":"2023-12-12T10:13:31.968790+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_clean_scrub_stamp":"2023-12-12T10:13:30.930525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:23:57.472966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.953182+0000","last_change":"2023-12-12T10:13:30.956747+0000","last_active":"2023-12-12T10:13:31.953182+0000","last_peered":"2023-12-12T10:13:31.953182+0000","last_clean":"2023-12-12T10:13:31.953182+0000","last_became_active":"2023-12-12T10:13:30.956481+0000","last_became_peered":"2023-12-12T10:13:30.956481+0000","last_unstale":"2023-12-12T10:13:31.953182+0000","last_undegraded":"2023-12-12T10:13:31.953182+0000","last_fullsized":"2023-12-12T10:13:31.953182+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:29.923090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:29.923090+0000","last_clean_scrub_stamp":"2023-12-12T10:13:29.923090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:31:46.714399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.966553+0000","last_change":"2023-12-12T10:13:31.957604+0000","last_active":"2023-12-12T10:13:31.966553+0000","last_peered":"2023-12-12T10:13:31.966553+0000","last_clean":"2023-12-12T10:13:31.966553+0000","last_became_active":"2023-12-12T10:13:31.956660+0000","last_became_peered":"2023-12-12T10:13:31.956660+0000","last_unstale":"2023-12-12T10:13:31.966553+0000","last_undegraded":"2023-12-12T10:13:31.966553+0000","last_fullsized":"2023-12-12T10:13:31.966553+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_clean_scrub_stamp":"2023-12-12T10:13:30.930525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:39:15.634500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.942808+0000","last_change":"2023-12-12T10:13:30.953009+0000","last_active":"2023-12-12T10:13:31.942808+0000","last_peered":"2023-12-12T10:13:31.942808+0000","last_clean":"2023-12-12T10:13:31.942808+0000","last_became_active":"2023-12-12T10:13:30.952374+0000","last_became_peered":"2023-12-12T10:13:30.952374+0000","last_unstale":"2023-12-12T10:13:31.942808+0000","last_undegraded":"2023-12-12T10:13:31.942808+0000","last_fullsized":"2023-12-12T10:13:31.942808+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:29.923090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:29.923090+0000","last_clean_scrub_stamp":"2023-12-12T10:13:29.923090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:33:48.622153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.969153+0000","last_change":"2023-12-12T10:13:31.961120+0000","last_active":"2023-12-12T10:13:31.969153+0000","last_peered":"2023-12-12T10:13:31.969153+0000","last_clean":"2023-12-12T10:13:31.969153+0000","last_became_active":"2023-12-12T10:13:31.960547+0000","last_became_peered":"2023-12-12T10:13:31.960547+0000","last_unstale":"2023-12-12T10:13:31.969153+0000","last_undegraded":"2023-12-12T10:13:31.969153+0000","last_fullsized":"2023-12-12T10:13:31.969153+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_clean_scrub_stamp":"2023-12-12T10:13:30.930525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:23:57.472966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.951239+0000","last_change":"2023-12-12T10:13:30.962974+0000","last_active":"2023-12-12T10:13:31.951239+0000","last_peered":"2023-12-12T10:13:31.951239+0000","last_clean":"2023-12-12T10:13:31.951239+0000","last_became_active":"2023-12-12T10:13:30.962664+0000","last_became_peered":"2023-12-12T10:13:30.962664+0000","last_unstale":"2023-12-12T10:13:31.951239+0000","last_undegraded":"2023-12-12T10:13:31.951239+0000","last_fullsized":"2023-12-12T10:13:31.951239+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:29.923090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:29.923090+0000","last_clean_scrub_stamp":"2023-12-12T10:13:29.923090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:25:55.033047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.962674+0000","last_change":"2023-12-12T10:13:31.958291+0000","last_active":"2023-12-12T10:13:31.962674+0000","last_peered":"2023-12-12T10:13:31.962674+0000","last_clean":"2023-12-12T10:13:31.962674+0000","last_became_active":"2023-12-12T10:13:31.954271+0000","last_became_peered":"2023-12-12T10:13:31.954271+0000","last_unstale":"2023-12-12T10:13:31.962674+0000","last_undegraded":"2023-12-12T10:13:31.962674+0000","last_fullsized":"2023-12-12T10:13:31.962674+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_clean_scrub_stamp":"2023-12-12T10:13:30.930525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:16:42.138651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.946150+0000","last_change":"2023-12-12T10:13:30.955570+0000","last_active":"2023-12-12T10:13:31.946150+0000","last_peered":"2023-12-12T10:13:31.946150+0000","last_clean":"2023-12-12T10:13:31.946150+0000","last_became_active":"2023-12-12T10:13:30.955187+0000","last_became_peered":"2023-12-12T10:13:30.955187+0000","last_unstale":"2023-12-12T10:13:31.946150+0000","last_undegraded":"2023-12-12T10:13:31.946150+0000","last_fullsized":"2023-12-12T10:13:31.946150+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:29.923090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:29.923090+0000","last_clean_scrub_stamp":"2023-12-12T10:13:29.923090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:30:09.728391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.974442+0000","last_change":"2023-12-12T10:13:31.969978+0000","last_active":"2023-12-12T10:13:31.974442+0000","last_peered":"2023-12-12T10:13:31.974442+0000","last_clean":"2023-12-12T10:13:31.974442+0000","last_became_active":"2023-12-12T10:13:31.969686+0000","last_became_peered":"2023-12-12T10:13:31.969686+0000","last_unstale":"2023-12-12T10:13:31.974442+0000","last_undegraded":"2023-12-12T10:13:31.974442+0000","last_fullsized":"2023-12-12T10:13:31.974442+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_clean_scrub_stamp":"2023-12-12T10:13:30.930525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:01:05.027866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.943936+0000","last_change":"2023-12-12T10:13:30.966192+0000","last_active":"2023-12-12T10:13:31.943936+0000","last_peered":"2023-12-12T10:13:31.943936+0000","last_clean":"2023-12-12T10:13:31.943936+0000","last_became_active":"2023-12-12T10:13:30.965653+0000","last_became_peered":"2023-12-12T10:13:30.965653+0000","last_unstale":"2023-12-12T10:13:31.943936+0000","last_undegraded":"2023-12-12T10:13:31.943936+0000","last_fullsized":"2023-12-12T10:13:31.943936+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:29.923090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:29.923090+0000","last_clean_scrub_stamp":"2023-12-12T10:13:29.923090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:46:58.116041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":180,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-12T10:13:30.957424+0000","last_change":"2023-12-12T10:11:58.492812+0000","last_active":"2023-12-12T10:13:30.957424+0000","last_peered":"2023-12-12T10:13:30.957424+0000","last_clean":"2023-12-12T10:13:30.957424+0000","last_became_active":"2023-12-12T10:11:58.491470+0000","last_became_peered":"2023-12-12T10:11:58.491470+0000","last_unstale":"2023-12-12T10:13:30.957424+0000","last_undegraded":"2023-12-12T10:13:30.957424+0000","last_fullsized":"2023-12-12T10:13:30.957424+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:11:57.289641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:11:57.289641+0000","last_clean_scrub_stamp":"2023-12-12T10:11:57.289641+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:10:37.809139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":888,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":20,"ondisk_log_size":20,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574870,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28016,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343824,"statfs":{"total":96636764160,"available":96608075776,"internally_reserved":0,"allocated":1019904,"data_stored":770772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 10:12:58 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.52300000000000002}]},{"osd":1,"last update":"Tue Dec 12 10:12:58 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.48799999999999999}]},{"osd":2,"last update":"Tue Dec 12 10:12:58 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.624}]},{"osd":3,"last update":"Tue Dec 12 10:12:58 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.61299999999999999}]},{"osd":4,"last update":"Tue Dec 12 10:12:58 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.751}]},{"osd":5,"last update":"Tue Dec 12 10:12:58 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.70799999999999996}]},{"osd":6,"last update":"Tue Dec 12 10:12:58 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.69199999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574870,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":425984,"data_stored":180404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 10:12:56 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.61799999999999999}]},{"osd":1,"last update":"Tue Dec 12 10:12:56 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":2.3119999999999998,"5min":2.3119999999999998,"15min":2.3119999999999998},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":2.8759999999999999,"5min":2.8759999999999999,"15min":2.8759999999999999},"last":0.66400000000000003}]},{"osd":2,"last update":"Tue Dec 12 10:12:56 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.53200000000000003}]},{"osd":3,"last update":"Tue Dec 12 10:12:56 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.57999999999999996}]},{"osd":4,"last update":"Tue Dec 12 10:12:56 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.54300000000000004}]},{"osd":5,"last update":"Tue Dec 12 10:12:56 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.70799999999999996}]},{"osd":7,"last update":"Tue Dec 12 10:12:56 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.50900000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":425984,"data_stored":180404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 10:12:57 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.91000000000000003}]},{"osd":1,"last update":"Tue Dec 12 10:12:57 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.85099999999999998}]},{"osd":2,"last update":"Tue Dec 12 10:12:57 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.875},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.387,"5min":1.387,"15min":1.387},"last":0.78200000000000003}]},{"osd":3,"last update":"Tue Dec 12 10:12:57 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.80300000000000005}]},{"osd":4,"last update":"Tue Dec 12 10:12:57 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.57099999999999995}]},{"osd":6,"last update":"Tue Dec 12 10:12:57 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.373,"5min":1.373,"15min":1.373},"last":0.60499999999999998}]},{"osd":7,"last update":"Tue Dec 12 10:12:57 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.70999999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574871,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":425984,"data_stored":180404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 10:12:58 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":2.8570000000000002,"5min":2.8570000000000002,"15min":2.8570000000000002},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.748}]},{"osd":1,"last update":"Tue Dec 12 10:12:58 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":2.9209999999999998,"5min":2.9209999999999998,"15min":2.9209999999999998},"last":0.69899999999999995}]},{"osd":2,"last update":"Tue Dec 12 10:12:58 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":3.141,"5min":3.141,"15min":3.141},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.66700000000000004}]},{"osd":3,"last update":"Tue Dec 12 10:12:58 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.70999999999999996}]},{"osd":5,"last update":"Tue Dec 12 10:12:58 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.623}]},{"osd":6,"last update":"Tue Dec 12 10:12:58 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.54800000000000004}]},{"osd":7,"last update":"Tue Dec 12 10:12:58 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.82399999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27456,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344384,"statfs":{"total":96636764160,"available":96608649216,"internally_reserved":0,"allocated":438272,"data_stored":187499,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 10:12:57 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.42299999999999999}]},{"osd":1,"last update":"Tue Dec 12 10:12:57 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.621}]},{"osd":2,"last update":"Tue Dec 12 10:12:57 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.379},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.5}]},{"osd":4,"last update":"Tue Dec 12 10:12:57 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.657,"5min":1.657,"15min":1.657},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.59099999999999997}]},{"osd":5,"last update":"Tue Dec 12 10:12:57 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.762,"5min":1.762,"15min":1.762},"last":0.53600000000000003}]},{"osd":6,"last update":"Tue Dec 12 10:12:57 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.4690000000000001,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.286,"5min":1.286,"15min":1.286},"last":0.71299999999999997}]},{"osd":7,"last update":"Tue Dec 12 10:12:57 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.8029999999999999,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.546,"5min":1.546,"15min":1.546},"last":0.65500000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574872,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":425984,"data_stored":180404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 10:13:00 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":4.1779999999999999,"5min":4.1779999999999999,"15min":4.1779999999999999},"last":0.44},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.35399999999999998}]},{"osd":1,"last update":"Tue Dec 12 10:13:00 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":4.4829999999999997,"5min":4.4829999999999997,"15min":4.4829999999999997},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":4.1349999999999998,"5min":4.1349999999999998,"15min":4.1349999999999998},"last":0.41299999999999998}]},{"osd":3,"last update":"Tue Dec 12 10:13:00 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":4.3410000000000002,"5min":4.3410000000000002,"15min":4.3410000000000002},"last":0.624},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.46200000000000002}]},{"osd":4,"last update":"Tue Dec 12 10:13:00 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":4.6449999999999996,"5min":4.6449999999999996,"15min":4.6449999999999996},"last":0.67400000000000004}]},{"osd":5,"last update":"Tue Dec 12 10:13:00 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.65300000000000002}]},{"osd":6,"last update":"Tue Dec 12 10:13:00 2023","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":4.6020000000000003,"5min":4.6020000000000003,"15min":4.6020000000000003},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.54400000000000004}]},{"osd":7,"last update":"Tue Dec 12 10:13:00 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":4.6840000000000002,"5min":4.6840000000000002,"15min":4.6840000000000002},"last":0.75600000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":425984,"data_stored":180404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 10:13:00 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.433,"15min":0.433},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.3180000000000001,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":0.40200000000000002}]},{"osd":2,"last update":"Tue Dec 12 10:13:00 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.309},{"interface":"front","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":4.0069999999999997,"5min":4.0069999999999997,"15min":4.0069999999999997},"last":0.44400000000000001}]},{"osd":3,"last update":"Tue Dec 12 10:13:00 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":4.0460000000000003,"5min":4.0460000000000003,"15min":4.0460000000000003},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.34799999999999998}]},{"osd":4,"last update":"Tue Dec 12 10:13:00 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":4.3620000000000001,"5min":4.3620000000000001,"15min":4.3620000000000001},"last":0.79000000000000004}]},{"osd":5,"last update":"Tue Dec 12 10:13:00 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.60999999999999999}]},{"osd":6,"last update":"Tue Dec 12 10:13:00 2023","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.6850000000000001,"5min":1.6850000000000001,"15min":1.6850000000000001},"last":0.754},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.6319999999999999,"5min":1.6319999999999999,"15min":1.6319999999999999},"last":0.76800000000000002}]},{"osd":7,"last update":"Tue Dec 12 10:13:00 2023","interfaces":[{"interface":"back","average":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":4.4059999999999997,"5min":4.4059999999999997,"15min":4.4059999999999997},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.875,"5min":0.875,"15min":0.875},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.7370000000000001,"5min":1.7370000000000001,"15min":1.7370000000000001},"last":0.80500000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574871,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28016,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343824,"statfs":{"total":96636764160,"available":96608075776,"internally_reserved":0,"allocated":1015808,"data_stored":769803,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 12 10:12:59 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.439,"5min":0.439,"15min":0.439},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.628,"5min":0.628,"15min":0.628},"last":0.40100000000000002}]},{"osd":2,"last update":"Tue Dec 12 10:12:59 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"last":0.502},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.48299999999999998}]},{"osd":3,"last update":"Tue Dec 12 10:12:59 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.623,"5min":0.623,"15min":0.623},"last":0.46300000000000002}]},{"osd":4,"last update":"Tue Dec 12 10:12:59 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.91400000000000003}]},{"osd":5,"last update":"Tue Dec 12 10:12:59 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.85199999999999998}]},{"osd":6,"last update":"Tue Dec 12 10:12:59 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.92600000000000005},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.75600000000000001}]},{"osd":7,"last update":"Tue Dec 12 10:12:59 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.87},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.97699999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-12T10:13:36.102 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-12T10:13:36.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.276+0000 7f89d2479640 1 Processor -- start 2023-12-12T10:13:36.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.276+0000 7f89d2479640 1 -- start start 2023-12-12T10:13:36.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.276+0000 7f89d2479640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f89cc15d3c0 0x7f89cc0d3b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:36.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.276+0000 7f89d2479640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89cc0b3250 con 0x7f89cc0d1cb0 2023-12-12T10:13:36.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.276+0000 7f89d2479640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89cc0cee50 con 0x7f89cc0ce670 2023-12-12T10:13:36.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.276+0000 7f89d2479640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89cc0b2920 con 0x7f89cc15d3c0 2023-12-12T10:13:36.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.276+0000 7f89cbfff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f89cc15d3c0 0x7f89cc0d3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:36.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.276+0000 7f89cbfff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f89cc15d3c0 0x7f89cc0d3b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33596/0 (socket says 172.21.15.78:33596) 2023-12-12T10:13:36.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.276+0000 7f89cbfff640 1 -- 172.21.15.78:0/1100671187 learned_addr learned my addr 172.21.15.78:0/1100671187 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:13:36.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.276+0000 7f89cbfff640 1 -- 172.21.15.78:0/1100671187 >> v1:172.21.15.187:6789/0 conn(0x7f89cc0ce670 legacy=0x7f89cc0d15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:13:36.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.276+0000 7f89caffd640 1 -- 172.21.15.78:0/1100671187 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1430954740 0 0) 0x7f89cc0b3250 con 0x7f89cc0d1cb0 2023-12-12T10:13:36.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.276+0000 7f89cbfff640 1 -- 172.21.15.78:0/1100671187 >> v1:172.21.15.78:6789/0 conn(0x7f89cc0d1cb0 legacy=0x7f89cc0b36e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:36.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.276+0000 7f89cbfff640 1 -- 172.21.15.78:0/1100671187 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89cc0b2c00 con 0x7f89cc15d3c0 2023-12-12T10:13:36.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.280+0000 7f89cbfff640 1 --2- 172.21.15.78:0/1100671187 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f89cc15d3c0 0x7f89cc0d3b10 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f89bc009870 tx=0x7f89bc01ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afac503574dd515a server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:36.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.280+0000 7f89caffd640 1 -- 172.21.15.78:0/1100671187 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89bc0a8a30 con 0x7f89cc15d3c0 2023-12-12T10:13:36.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.280+0000 7f89caffd640 1 -- 172.21.15.78:0/1100671187 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89bc0a8b90 con 0x7f89cc15d3c0 2023-12-12T10:13:36.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.280+0000 7f89caffd640 1 -- 172.21.15.78:0/1100671187 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89bc0b0440 con 0x7f89cc15d3c0 2023-12-12T10:13:36.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.280+0000 7f89d2479640 1 -- 172.21.15.78:0/1100671187 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f89cc15d3c0 msgr2=0x7f89cc0d3b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:36.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.280+0000 7f89d2479640 1 --2- 172.21.15.78:0/1100671187 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f89cc15d3c0 0x7f89cc0d3b10 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f89bc009870 tx=0x7f89bc01ed30 comp rx=0 tx=0).stop 2023-12-12T10:13:36.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.280+0000 7f89d2479640 1 -- 172.21.15.78:0/1100671187 shutdown_connections 2023-12-12T10:13:36.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.280+0000 7f89d2479640 1 --2- 172.21.15.78:0/1100671187 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f89cc15d3c0 0x7f89cc0d3b10 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:36.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.280+0000 7f89d2479640 1 -- 172.21.15.78:0/1100671187 >> 172.21.15.78:0/1100671187 conn(0x7f89cc09c2a0 msgr2=0x7f89cc0d2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:36.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.280+0000 7f89d2479640 1 -- 172.21.15.78:0/1100671187 shutdown_connections 2023-12-12T10:13:36.287 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.280+0000 7f89d2479640 1 -- 172.21.15.78:0/1100671187 wait complete. 2023-12-12T10:13:36.288 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.284+0000 7f89d2479640 1 Processor -- start 2023-12-12T10:13:36.288 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.284+0000 7f89d2479640 1 -- start start 2023-12-12T10:13:36.290 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.284+0000 7f89d2479640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f89cc0ce670 0x7f89cc0c75d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:36.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.284+0000 7f89d2479640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f89cc0d1cb0 0x7f89cc15e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:36.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.284+0000 7f89d2479640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f89cc15d3c0 0x7f89cc0cb850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:36.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.284+0000 7f89d2479640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89cc0c7140 con 0x7f89cc0d1cb0 2023-12-12T10:13:36.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.284+0000 7f89d2479640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89cc0c6b30 con 0x7f89cc15d3c0 2023-12-12T10:13:36.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.284+0000 7f89d2479640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89cc15e8a0 con 0x7f89cc0ce670 2023-12-12T10:13:36.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.284+0000 7f89cb7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f89cc0d1cb0 0x7f89cc15e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:36.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.284+0000 7f89cb7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f89cc0d1cb0 0x7f89cc15e360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33612/0 (socket says 172.21.15.78:33612) 2023-12-12T10:13:36.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.284+0000 7f89cb7fe640 1 -- 172.21.15.78:0/2803432879 learned_addr learned my addr 172.21.15.78:0/2803432879 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:13:36.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.284+0000 7f89cbfff640 1 --2- 172.21.15.78:0/2803432879 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f89cc0ce670 0x7f89cc0c75d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:36.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.284+0000 7f89d0a16640 1 --2- 172.21.15.78:0/2803432879 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f89cc15d3c0 0x7f89cc0cb850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:36.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.284+0000 7f89cb7fe640 1 -- 172.21.15.78:0/2803432879 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f89cc0ce670 msgr2=0x7f89cc0c75d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:36.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.284+0000 7f89cb7fe640 1 --2- 172.21.15.78:0/2803432879 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f89cc0ce670 0x7f89cc0c75d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:36.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.284+0000 7f89cb7fe640 1 -- 172.21.15.78:0/2803432879 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f89cc15d3c0 msgr2=0x7f89cc0cb850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:36.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.284+0000 7f89cb7fe640 1 --2- 172.21.15.78:0/2803432879 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f89cc15d3c0 0x7f89cc0cb850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:36.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.284+0000 7f89cb7fe640 1 -- 172.21.15.78:0/2803432879 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89bc0094d0 con 0x7f89cc0d1cb0 2023-12-12T10:13:36.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.284+0000 7f89cb7fe640 1 --2- 172.21.15.78:0/2803432879 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f89cc0d1cb0 0x7f89cc15e360 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f89c000c420 tx=0x7f89c000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:36.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.284+0000 7f89c8ff9640 1 -- 172.21.15.78:0/2803432879 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89c00052d0 con 0x7f89cc0d1cb0 2023-12-12T10:13:36.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.284+0000 7f89c8ff9640 1 -- 172.21.15.78:0/2803432879 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89c0005430 con 0x7f89cc0d1cb0 2023-12-12T10:13:36.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.284+0000 7f89c8ff9640 1 -- 172.21.15.78:0/2803432879 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89c0007260 con 0x7f89cc0d1cb0 2023-12-12T10:13:36.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.284+0000 7f89d2479640 1 -- 172.21.15.78:0/2803432879 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89cc15eb70 con 0x7f89cc0d1cb0 2023-12-12T10:13:36.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.284+0000 7f89d2479640 1 -- 172.21.15.78:0/2803432879 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89cc15ee50 con 0x7f89cc0d1cb0 2023-12-12T10:13:36.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.288+0000 7f89d2479640 1 -- 172.21.15.78:0/2803432879 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89cc0c72f0 con 0x7f89cc0d1cb0 2023-12-12T10:13:36.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.288+0000 7f89c8ff9640 1 -- 172.21.15.78:0/2803432879 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f89c00073c0 con 0x7f89cc0d1cb0 2023-12-12T10:13:36.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.288+0000 7f89c8ff9640 1 --2- 172.21.15.78:0/2803432879 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f89b8066470 0x7f89b8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:36.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.288+0000 7f89c8ff9640 1 -- 172.21.15.78:0/2803432879 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f89c0083330 con 0x7f89cc0d1cb0 2023-12-12T10:13:36.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.288+0000 7f89cbfff640 1 --2- 172.21.15.78:0/2803432879 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f89b8066470 0x7f89b8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:36.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.288+0000 7f89cbfff640 1 --2- 172.21.15.78:0/2803432879 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f89b8066470 0x7f89b8068930 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f89bc0b2000 tx=0x7f89bc0aa070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:36.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.292+0000 7f89c8ff9640 1 -- 172.21.15.78:0/2803432879 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f89cc0c72f0 con 0x7f89cc0d1cb0 2023-12-12T10:13:36.444 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.440+0000 7f89d2479640 1 -- 172.21.15.78:0/2803432879 --> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f89cc0ceb00 con 0x7f89b8066470 2023-12-12T10:13:36.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.448+0000 7f89c8ff9640 1 -- 172.21.15.78:0/2803432879 <== mgr.4104 v2:172.21.15.78:6832/1725498448 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289176 (secure 0 0 0) 0x7f89bc0b0440 con 0x7f89b8066470 2023-12-12T10:13:36.455 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:13:36.457 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2023-12-12T10:13:36.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.452+0000 7f89d2479640 1 -- 172.21.15.78:0/2803432879 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f89b8066470 msgr2=0x7f89b8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:36.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.452+0000 7f89d2479640 1 --2- 172.21.15.78:0/2803432879 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f89b8066470 0x7f89b8068930 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f89bc0b2000 tx=0x7f89bc0aa070 comp rx=0 tx=0).stop 2023-12-12T10:13:36.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.452+0000 7f89d2479640 1 -- 172.21.15.78:0/2803432879 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f89cc0d1cb0 msgr2=0x7f89cc15e360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:36.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.452+0000 7f89d2479640 1 --2- 172.21.15.78:0/2803432879 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f89cc0d1cb0 0x7f89cc15e360 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f89c000c420 tx=0x7f89c000c8e0 comp rx=0 tx=0).stop 2023-12-12T10:13:36.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.452+0000 7f89d2479640 1 -- 172.21.15.78:0/2803432879 shutdown_connections 2023-12-12T10:13:36.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.452+0000 7f89d2479640 1 --2- 172.21.15.78:0/2803432879 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f89b8066470 0x7f89b8068930 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:36.458 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.452+0000 7f89d2479640 1 --2- 172.21.15.78:0/2803432879 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f89cc15d3c0 0x7f89cc0cb850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:36.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.452+0000 7f89d2479640 1 --2- 172.21.15.78:0/2803432879 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f89cc0d1cb0 0x7f89cc15e360 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:36.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.452+0000 7f89d2479640 1 --2- 172.21.15.78:0/2803432879 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f89cc0ce670 0x7f89cc0c75d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:36.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.452+0000 7f89d2479640 1 -- 172.21.15.78:0/2803432879 >> 172.21.15.78:0/2803432879 conn(0x7f89cc09c2a0 msgr2=0x7f89cc0b36e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:36.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.452+0000 7f89d2479640 1 -- 172.21.15.78:0/2803432879 shutdown_connections 2023-12-12T10:13:36.459 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.452+0000 7f89d2479640 1 -- 172.21.15.78:0/2803432879 wait complete. 2023-12-12T10:13:36.477 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":81,"stamp":"2023-12-12T10:13:35.007635+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591256,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":180,"num_write_kb":2428,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":52,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220668,"kb_used_data":4496,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754052,"statfs":{"total":773094113280,"available":772868149248,"internally_reserved":0,"allocated":4603904,"data_stored":2630094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12749,"internal_metadata":221236787},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":41,"apply_latency_ms":41,"commit_latency_ns":41000000,"apply_latency_ns":41000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":888,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.076276"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.971588+0000","last_change":"2023-12-12T10:13:31.963011+0000","last_active":"2023-12-12T10:13:31.971588+0000","last_peered":"2023-12-12T10:13:31.971588+0000","last_clean":"2023-12-12T10:13:31.971588+0000","last_became_active":"2023-12-12T10:13:31.962738+0000","last_became_peered":"2023-12-12T10:13:31.962738+0000","last_unstale":"2023-12-12T10:13:31.971588+0000","last_undegraded":"2023-12-12T10:13:31.971588+0000","last_fullsized":"2023-12-12T10:13:31.971588+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_clean_scrub_stamp":"2023-12-12T10:13:30.930525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:46:59.123475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.971522+0000","last_change":"2023-12-12T10:13:31.963131+0000","last_active":"2023-12-12T10:13:31.971522+0000","last_peered":"2023-12-12T10:13:31.971522+0000","last_clean":"2023-12-12T10:13:31.971522+0000","last_became_active":"2023-12-12T10:13:31.955937+0000","last_became_peered":"2023-12-12T10:13:31.955937+0000","last_unstale":"2023-12-12T10:13:31.971522+0000","last_undegraded":"2023-12-12T10:13:31.971522+0000","last_fullsized":"2023-12-12T10:13:31.971522+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_clean_scrub_stamp":"2023-12-12T10:13:30.930525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:37:36.773954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.971875+0000","last_change":"2023-12-12T10:13:31.970522+0000","last_active":"2023-12-12T10:13:31.971875+0000","last_peered":"2023-12-12T10:13:31.971875+0000","last_clean":"2023-12-12T10:13:31.971875+0000","last_became_active":"2023-12-12T10:13:31.970192+0000","last_became_peered":"2023-12-12T10:13:31.970192+0000","last_unstale":"2023-12-12T10:13:31.971875+0000","last_undegraded":"2023-12-12T10:13:31.971875+0000","last_fullsized":"2023-12-12T10:13:31.971875+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_clean_scrub_stamp":"2023-12-12T10:13:30.930525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:33:49.629588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.969265+0000","last_change":"2023-12-12T10:13:31.965772+0000","last_active":"2023-12-12T10:13:31.969265+0000","last_peered":"2023-12-12T10:13:31.969265+0000","last_clean":"2023-12-12T10:13:31.969265+0000","last_became_active":"2023-12-12T10:13:31.965480+0000","last_became_peered":"2023-12-12T10:13:31.965480+0000","last_unstale":"2023-12-12T10:13:31.969265+0000","last_undegraded":"2023-12-12T10:13:31.969265+0000","last_fullsized":"2023-12-12T10:13:31.969265+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_clean_scrub_stamp":"2023-12-12T10:13:30.930525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T22:04:13.539201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.969227+0000","last_change":"2023-12-12T10:13:31.966112+0000","last_active":"2023-12-12T10:13:31.969227+0000","last_peered":"2023-12-12T10:13:31.969227+0000","last_clean":"2023-12-12T10:13:31.969227+0000","last_became_active":"2023-12-12T10:13:31.965303+0000","last_became_peered":"2023-12-12T10:13:31.965303+0000","last_unstale":"2023-12-12T10:13:31.969227+0000","last_undegraded":"2023-12-12T10:13:31.969227+0000","last_fullsized":"2023-12-12T10:13:31.969227+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_clean_scrub_stamp":"2023-12-12T10:13:30.930525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:10:34.199352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.969169+0000","last_change":"2023-12-12T10:13:31.958000+0000","last_active":"2023-12-12T10:13:31.969169+0000","last_peered":"2023-12-12T10:13:31.969169+0000","last_clean":"2023-12-12T10:13:31.969169+0000","last_became_active":"2023-12-12T10:13:31.957715+0000","last_became_peered":"2023-12-12T10:13:31.957715+0000","last_unstale":"2023-12-12T10:13:31.969169+0000","last_undegraded":"2023-12-12T10:13:31.969169+0000","last_fullsized":"2023-12-12T10:13:31.969169+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_clean_scrub_stamp":"2023-12-12T10:13:30.930525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:25:56.040481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.971728+0000","last_change":"2023-12-12T10:13:31.967197+0000","last_active":"2023-12-12T10:13:31.971728+0000","last_peered":"2023-12-12T10:13:31.971728+0000","last_clean":"2023-12-12T10:13:31.971728+0000","last_became_active":"2023-12-12T10:13:31.966889+0000","last_became_peered":"2023-12-12T10:13:31.966889+0000","last_unstale":"2023-12-12T10:13:31.971728+0000","last_undegraded":"2023-12-12T10:13:31.971728+0000","last_fullsized":"2023-12-12T10:13:31.971728+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_clean_scrub_stamp":"2023-12-12T10:13:30.930525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:25:56.040481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.971582+0000","last_change":"2023-12-12T10:13:31.966337+0000","last_active":"2023-12-12T10:13:31.971582+0000","last_peered":"2023-12-12T10:13:31.971582+0000","last_clean":"2023-12-12T10:13:31.971582+0000","last_became_active":"2023-12-12T10:13:31.966048+0000","last_became_peered":"2023-12-12T10:13:31.966048+0000","last_unstale":"2023-12-12T10:13:31.971582+0000","last_undegraded":"2023-12-12T10:13:31.971582+0000","last_fullsized":"2023-12-12T10:13:31.971582+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_clean_scrub_stamp":"2023-12-12T10:13:30.930525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:01:28.709905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.971865+0000","last_change":"2023-12-12T10:13:31.970440+0000","last_active":"2023-12-12T10:13:31.971865+0000","last_peered":"2023-12-12T10:13:31.971865+0000","last_clean":"2023-12-12T10:13:31.971865+0000","last_became_active":"2023-12-12T10:13:31.970140+0000","last_became_peered":"2023-12-12T10:13:31.970140+0000","last_unstale":"2023-12-12T10:13:31.971865+0000","last_undegraded":"2023-12-12T10:13:31.971865+0000","last_fullsized":"2023-12-12T10:13:31.971865+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_clean_scrub_stamp":"2023-12-12T10:13:30.930525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:47:34.197405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.975747+0000","last_change":"2023-12-12T10:13:31.973996+0000","last_active":"2023-12-12T10:13:31.975747+0000","last_peered":"2023-12-12T10:13:31.975747+0000","last_clean":"2023-12-12T10:13:31.975747+0000","last_became_active":"2023-12-12T10:13:31.973618+0000","last_became_peered":"2023-12-12T10:13:31.973618+0000","last_unstale":"2023-12-12T10:13:31.975747+0000","last_undegraded":"2023-12-12T10:13:31.975747+0000","last_fullsized":"2023-12-12T10:13:31.975747+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_clean_scrub_stamp":"2023-12-12T10:13:30.930525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:32:40.635434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.973199+0000","last_change":"2023-12-12T10:13:31.969188+0000","last_active":"2023-12-12T10:13:31.973199+0000","last_peered":"2023-12-12T10:13:31.973199+0000","last_clean":"2023-12-12T10:13:31.973199+0000","last_became_active":"2023-12-12T10:13:31.968353+0000","last_became_peered":"2023-12-12T10:13:31.968353+0000","last_unstale":"2023-12-12T10:13:31.973199+0000","last_undegraded":"2023-12-12T10:13:31.973199+0000","last_fullsized":"2023-12-12T10:13:31.973199+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_clean_scrub_stamp":"2023-12-12T10:13:30.930525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:46:59.123475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.968402+0000","last_change":"2023-12-12T10:13:31.962980+0000","last_active":"2023-12-12T10:13:31.968402+0000","last_peered":"2023-12-12T10:13:31.968402+0000","last_clean":"2023-12-12T10:13:31.968402+0000","last_became_active":"2023-12-12T10:13:31.962702+0000","last_became_peered":"2023-12-12T10:13:31.962702+0000","last_unstale":"2023-12-12T10:13:31.968402+0000","last_undegraded":"2023-12-12T10:13:31.968402+0000","last_fullsized":"2023-12-12T10:13:31.968402+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_clean_scrub_stamp":"2023-12-12T10:13:30.930525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:46:10.675029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.972611+0000","last_change":"2023-12-12T10:13:31.965438+0000","last_active":"2023-12-12T10:13:31.972611+0000","last_peered":"2023-12-12T10:13:31.972611+0000","last_clean":"2023-12-12T10:13:31.972611+0000","last_became_active":"2023-12-12T10:13:31.965124+0000","last_became_peered":"2023-12-12T10:13:31.965124+0000","last_unstale":"2023-12-12T10:13:31.972611+0000","last_undegraded":"2023-12-12T10:13:31.972611+0000","last_fullsized":"2023-12-12T10:13:31.972611+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_clean_scrub_stamp":"2023-12-12T10:13:30.930525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:49:44.296783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.969171+0000","last_change":"2023-12-12T10:13:31.961302+0000","last_active":"2023-12-12T10:13:31.969171+0000","last_peered":"2023-12-12T10:13:31.969171+0000","last_clean":"2023-12-12T10:13:31.969171+0000","last_became_active":"2023-12-12T10:13:31.960859+0000","last_became_peered":"2023-12-12T10:13:31.960859+0000","last_unstale":"2023-12-12T10:13:31.969171+0000","last_undegraded":"2023-12-12T10:13:31.969171+0000","last_fullsized":"2023-12-12T10:13:31.969171+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_clean_scrub_stamp":"2023-12-12T10:13:30.930525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:39:15.634500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.971768+0000","last_change":"2023-12-12T10:13:31.968188+0000","last_active":"2023-12-12T10:13:31.971768+0000","last_peered":"2023-12-12T10:13:31.971768+0000","last_clean":"2023-12-12T10:13:31.971768+0000","last_became_active":"2023-12-12T10:13:31.966060+0000","last_became_peered":"2023-12-12T10:13:31.966060+0000","last_unstale":"2023-12-12T10:13:31.971768+0000","last_undegraded":"2023-12-12T10:13:31.971768+0000","last_fullsized":"2023-12-12T10:13:31.971768+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_clean_scrub_stamp":"2023-12-12T10:13:30.930525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:31:47.721834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.969204+0000","last_change":"2023-12-12T10:13:31.966467+0000","last_active":"2023-12-12T10:13:31.969204+0000","last_peered":"2023-12-12T10:13:31.969204+0000","last_clean":"2023-12-12T10:13:31.969204+0000","last_became_active":"2023-12-12T10:13:31.966185+0000","last_became_peered":"2023-12-12T10:13:31.966185+0000","last_unstale":"2023-12-12T10:13:31.969204+0000","last_undegraded":"2023-12-12T10:13:31.969204+0000","last_fullsized":"2023-12-12T10:13:31.969204+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_clean_scrub_stamp":"2023-12-12T10:13:30.930525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:39:15.634500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.972758+0000","last_change":"2023-12-12T10:13:31.971226+0000","last_active":"2023-12-12T10:13:31.972758+0000","last_peered":"2023-12-12T10:13:31.972758+0000","last_clean":"2023-12-12T10:13:31.972758+0000","last_became_active":"2023-12-12T10:13:31.970914+0000","last_became_peered":"2023-12-12T10:13:31.970914+0000","last_unstale":"2023-12-12T10:13:31.972758+0000","last_undegraded":"2023-12-12T10:13:31.972758+0000","last_fullsized":"2023-12-12T10:13:31.972758+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_clean_scrub_stamp":"2023-12-12T10:13:30.930525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:33:49.629588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.969920+0000","last_change":"2023-12-12T10:13:31.964692+0000","last_active":"2023-12-12T10:13:31.969920+0000","last_peered":"2023-12-12T10:13:31.969920+0000","last_clean":"2023-12-12T10:13:31.969920+0000","last_became_active":"2023-12-12T10:13:31.964341+0000","last_became_peered":"2023-12-12T10:13:31.964341+0000","last_unstale":"2023-12-12T10:13:31.969920+0000","last_undegraded":"2023-12-12T10:13:31.969920+0000","last_fullsized":"2023-12-12T10:13:31.969920+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_clean_scrub_stamp":"2023-12-12T10:13:30.930525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:16:42.138651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.962838+0000","last_change":"2023-12-12T10:13:31.958226+0000","last_active":"2023-12-12T10:13:31.962838+0000","last_peered":"2023-12-12T10:13:31.962838+0000","last_clean":"2023-12-12T10:13:31.962838+0000","last_became_active":"2023-12-12T10:13:31.957363+0000","last_became_peered":"2023-12-12T10:13:31.957363+0000","last_unstale":"2023-12-12T10:13:31.962838+0000","last_undegraded":"2023-12-12T10:13:31.962838+0000","last_fullsized":"2023-12-12T10:13:31.962838+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_clean_scrub_stamp":"2023-12-12T10:13:30.930525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:27:59.402764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.971316+0000","last_change":"2023-12-12T10:13:31.966618+0000","last_active":"2023-12-12T10:13:31.971316+0000","last_peered":"2023-12-12T10:13:31.971316+0000","last_clean":"2023-12-12T10:13:31.971316+0000","last_became_active":"2023-12-12T10:13:31.964114+0000","last_became_peered":"2023-12-12T10:13:31.964114+0000","last_unstale":"2023-12-12T10:13:31.971316+0000","last_undegraded":"2023-12-12T10:13:31.971316+0000","last_fullsized":"2023-12-12T10:13:31.971316+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_clean_scrub_stamp":"2023-12-12T10:13:30.930525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:47:34.197405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.974722+0000","last_change":"2023-12-12T10:13:31.971788+0000","last_active":"2023-12-12T10:13:31.974722+0000","last_peered":"2023-12-12T10:13:31.974722+0000","last_clean":"2023-12-12T10:13:31.974722+0000","last_became_active":"2023-12-12T10:13:31.969990+0000","last_became_peered":"2023-12-12T10:13:31.969990+0000","last_unstale":"2023-12-12T10:13:31.974722+0000","last_undegraded":"2023-12-12T10:13:31.974722+0000","last_fullsized":"2023-12-12T10:13:31.974722+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_clean_scrub_stamp":"2023-12-12T10:13:30.930525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:09:04.975169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.969187+0000","last_change":"2023-12-12T10:13:31.961831+0000","last_active":"2023-12-12T10:13:31.969187+0000","last_peered":"2023-12-12T10:13:31.969187+0000","last_clean":"2023-12-12T10:13:31.969187+0000","last_became_active":"2023-12-12T10:13:31.961569+0000","last_became_peered":"2023-12-12T10:13:31.961569+0000","last_unstale":"2023-12-12T10:13:31.969187+0000","last_undegraded":"2023-12-12T10:13:31.969187+0000","last_fullsized":"2023-12-12T10:13:31.969187+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_clean_scrub_stamp":"2023-12-12T10:13:30.930525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:47:34.197405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.960227+0000","last_change":"2023-12-12T10:13:31.952764+0000","last_active":"2023-12-12T10:13:31.960227+0000","last_peered":"2023-12-12T10:13:31.960227+0000","last_clean":"2023-12-12T10:13:31.960227+0000","last_became_active":"2023-12-12T10:13:31.952202+0000","last_became_peered":"2023-12-12T10:13:31.952202+0000","last_unstale":"2023-12-12T10:13:31.960227+0000","last_undegraded":"2023-12-12T10:13:31.960227+0000","last_fullsized":"2023-12-12T10:13:31.960227+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_clean_scrub_stamp":"2023-12-12T10:13:30.930525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:31:47.721834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.961265+0000","last_change":"2023-12-12T10:13:31.951321+0000","last_active":"2023-12-12T10:13:31.961265+0000","last_peered":"2023-12-12T10:13:31.961265+0000","last_clean":"2023-12-12T10:13:31.961265+0000","last_became_active":"2023-12-12T10:13:31.951001+0000","last_became_peered":"2023-12-12T10:13:31.951001+0000","last_unstale":"2023-12-12T10:13:31.961265+0000","last_undegraded":"2023-12-12T10:13:31.961265+0000","last_fullsized":"2023-12-12T10:13:31.961265+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_clean_scrub_stamp":"2023-12-12T10:13:30.930525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:23:17.616897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.970157+0000","last_change":"2023-12-12T10:13:31.965619+0000","last_active":"2023-12-12T10:13:31.970157+0000","last_peered":"2023-12-12T10:13:31.970157+0000","last_clean":"2023-12-12T10:13:31.970157+0000","last_became_active":"2023-12-12T10:13:31.963025+0000","last_became_peered":"2023-12-12T10:13:31.963025+0000","last_unstale":"2023-12-12T10:13:31.970157+0000","last_undegraded":"2023-12-12T10:13:31.970157+0000","last_fullsized":"2023-12-12T10:13:31.970157+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_clean_scrub_stamp":"2023-12-12T10:13:30.930525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:39:15.634500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.971123+0000","last_change":"2023-12-12T10:13:31.968209+0000","last_active":"2023-12-12T10:13:31.971123+0000","last_peered":"2023-12-12T10:13:31.971123+0000","last_clean":"2023-12-12T10:13:31.971123+0000","last_became_active":"2023-12-12T10:13:31.967843+0000","last_became_peered":"2023-12-12T10:13:31.967843+0000","last_unstale":"2023-12-12T10:13:31.971123+0000","last_undegraded":"2023-12-12T10:13:31.971123+0000","last_fullsized":"2023-12-12T10:13:31.971123+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_clean_scrub_stamp":"2023-12-12T10:13:30.930525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:46:10.675029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.955531+0000","last_change":"2023-12-12T10:13:31.951234+0000","last_active":"2023-12-12T10:13:31.955531+0000","last_peered":"2023-12-12T10:13:31.955531+0000","last_clean":"2023-12-12T10:13:31.955531+0000","last_became_active":"2023-12-12T10:13:31.950893+0000","last_became_peered":"2023-12-12T10:13:31.950893+0000","last_unstale":"2023-12-12T10:13:31.955531+0000","last_undegraded":"2023-12-12T10:13:31.955531+0000","last_fullsized":"2023-12-12T10:13:31.955531+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_clean_scrub_stamp":"2023-12-12T10:13:30.930525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:23:57.472966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.967416+0000","last_change":"2023-12-12T10:13:31.965517+0000","last_active":"2023-12-12T10:13:31.967416+0000","last_peered":"2023-12-12T10:13:31.967416+0000","last_clean":"2023-12-12T10:13:31.967416+0000","last_became_active":"2023-12-12T10:13:31.965224+0000","last_became_peered":"2023-12-12T10:13:31.965224+0000","last_unstale":"2023-12-12T10:13:31.967416+0000","last_undegraded":"2023-12-12T10:13:31.967416+0000","last_fullsized":"2023-12-12T10:13:31.967416+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_clean_scrub_stamp":"2023-12-12T10:13:30.930525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:01:28.709905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.963039+0000","last_change":"2023-12-12T10:13:31.958510+0000","last_active":"2023-12-12T10:13:31.963039+0000","last_peered":"2023-12-12T10:13:31.963039+0000","last_clean":"2023-12-12T10:13:31.963039+0000","last_became_active":"2023-12-12T10:13:31.958227+0000","last_became_peered":"2023-12-12T10:13:31.958227+0000","last_unstale":"2023-12-12T10:13:31.963039+0000","last_undegraded":"2023-12-12T10:13:31.963039+0000","last_fullsized":"2023-12-12T10:13:31.963039+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_clean_scrub_stamp":"2023-12-12T10:13:30.930525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:18:46.522714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.964891+0000","last_change":"2023-12-12T10:13:31.956633+0000","last_active":"2023-12-12T10:13:31.964891+0000","last_peered":"2023-12-12T10:13:31.964891+0000","last_clean":"2023-12-12T10:13:31.964891+0000","last_became_active":"2023-12-12T10:13:31.956283+0000","last_became_peered":"2023-12-12T10:13:31.956283+0000","last_unstale":"2023-12-12T10:13:31.964891+0000","last_undegraded":"2023-12-12T10:13:31.964891+0000","last_fullsized":"2023-12-12T10:13:31.964891+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_clean_scrub_stamp":"2023-12-12T10:13:30.930525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:37:08.558357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.961611+0000","last_change":"2023-12-12T10:13:31.953799+0000","last_active":"2023-12-12T10:13:31.961611+0000","last_peered":"2023-12-12T10:13:31.961611+0000","last_clean":"2023-12-12T10:13:31.961611+0000","last_became_active":"2023-12-12T10:13:31.953469+0000","last_became_peered":"2023-12-12T10:13:31.953469+0000","last_unstale":"2023-12-12T10:13:31.961611+0000","last_undegraded":"2023-12-12T10:13:31.961611+0000","last_fullsized":"2023-12-12T10:13:31.961611+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_clean_scrub_stamp":"2023-12-12T10:13:30.930525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:01:28.709905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.969362+0000","last_change":"2023-12-12T10:13:31.963470+0000","last_active":"2023-12-12T10:13:31.969362+0000","last_peered":"2023-12-12T10:13:31.969362+0000","last_clean":"2023-12-12T10:13:31.969362+0000","last_became_active":"2023-12-12T10:13:31.963190+0000","last_became_peered":"2023-12-12T10:13:31.963190+0000","last_unstale":"2023-12-12T10:13:31.969362+0000","last_undegraded":"2023-12-12T10:13:31.969362+0000","last_fullsized":"2023-12-12T10:13:31.969362+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_clean_scrub_stamp":"2023-12-12T10:13:30.930525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:23:57.472966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.973157+0000","last_change":"2023-12-12T10:13:31.968460+0000","last_active":"2023-12-12T10:13:31.973157+0000","last_peered":"2023-12-12T10:13:31.973157+0000","last_clean":"2023-12-12T10:13:31.973157+0000","last_became_active":"2023-12-12T10:13:31.968157+0000","last_became_peered":"2023-12-12T10:13:31.968157+0000","last_unstale":"2023-12-12T10:13:31.973157+0000","last_undegraded":"2023-12-12T10:13:31.973157+0000","last_fullsized":"2023-12-12T10:13:31.973157+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_clean_scrub_stamp":"2023-12-12T10:13:30.930525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:25:56.040481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.944088+0000","last_change":"2023-12-12T10:13:30.950982+0000","last_active":"2023-12-12T10:13:31.944088+0000","last_peered":"2023-12-12T10:13:31.944088+0000","last_clean":"2023-12-12T10:13:31.944088+0000","last_became_active":"2023-12-12T10:13:30.950562+0000","last_became_peered":"2023-12-12T10:13:30.950562+0000","last_unstale":"2023-12-12T10:13:31.944088+0000","last_undegraded":"2023-12-12T10:13:31.944088+0000","last_fullsized":"2023-12-12T10:13:31.944088+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:29.923090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:29.923090+0000","last_clean_scrub_stamp":"2023-12-12T10:13:29.923090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:46:09.667594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.971076+0000","last_change":"2023-12-12T10:13:31.967617+0000","last_active":"2023-12-12T10:13:31.971076+0000","last_peered":"2023-12-12T10:13:31.971076+0000","last_clean":"2023-12-12T10:13:31.971076+0000","last_became_active":"2023-12-12T10:13:31.967292+0000","last_became_peered":"2023-12-12T10:13:31.967292+0000","last_unstale":"2023-12-12T10:13:31.971076+0000","last_undegraded":"2023-12-12T10:13:31.971076+0000","last_fullsized":"2023-12-12T10:13:31.971076+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_clean_scrub_stamp":"2023-12-12T10:13:30.930525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:09:04.975169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"38'1","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:32.027595+0000","last_change":"2023-12-12T10:13:30.961592+0000","last_active":"2023-12-12T10:13:32.027595+0000","last_peered":"2023-12-12T10:13:32.027595+0000","last_clean":"2023-12-12T10:13:32.027595+0000","last_became_active":"2023-12-12T10:13:30.961365+0000","last_became_peered":"2023-12-12T10:13:30.961365+0000","last_unstale":"2023-12-12T10:13:32.027595+0000","last_undegraded":"2023-12-12T10:13:32.027595+0000","last_fullsized":"2023-12-12T10:13:32.027595+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:29.923090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:29.923090+0000","last_clean_scrub_stamp":"2023-12-12T10:13:29.923090+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:25:55.033047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.972905+0000","last_change":"2023-12-12T10:13:31.962515+0000","last_active":"2023-12-12T10:13:31.972905+0000","last_peered":"2023-12-12T10:13:31.972905+0000","last_clean":"2023-12-12T10:13:31.972905+0000","last_became_active":"2023-12-12T10:13:31.962207+0000","last_became_peered":"2023-12-12T10:13:31.962207+0000","last_unstale":"2023-12-12T10:13:31.972905+0000","last_undegraded":"2023-12-12T10:13:31.972905+0000","last_fullsized":"2023-12-12T10:13:31.972905+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_clean_scrub_stamp":"2023-12-12T10:13:30.930525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:51:42.232761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"38'2","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:32.028256+0000","last_change":"2023-12-12T10:13:30.957754+0000","last_active":"2023-12-12T10:13:32.028256+0000","last_peered":"2023-12-12T10:13:32.028256+0000","last_clean":"2023-12-12T10:13:32.028256+0000","last_became_active":"2023-12-12T10:13:30.957249+0000","last_became_peered":"2023-12-12T10:13:30.957249+0000","last_unstale":"2023-12-12T10:13:32.028256+0000","last_undegraded":"2023-12-12T10:13:32.028256+0000","last_fullsized":"2023-12-12T10:13:32.028256+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:29.923090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:29.923090+0000","last_clean_scrub_stamp":"2023-12-12T10:13:29.923090+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:49:43.289349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.968630+0000","last_change":"2023-12-12T10:13:31.958023+0000","last_active":"2023-12-12T10:13:31.968630+0000","last_peered":"2023-12-12T10:13:31.968630+0000","last_clean":"2023-12-12T10:13:31.968630+0000","last_became_active":"2023-12-12T10:13:31.957703+0000","last_became_peered":"2023-12-12T10:13:31.957703+0000","last_unstale":"2023-12-12T10:13:31.968630+0000","last_undegraded":"2023-12-12T10:13:31.968630+0000","last_fullsized":"2023-12-12T10:13:31.968630+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_clean_scrub_stamp":"2023-12-12T10:13:30.930525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:01:05.027866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.958642+0000","last_change":"2023-12-12T10:13:30.962848+0000","last_active":"2023-12-12T10:13:31.958642+0000","last_peered":"2023-12-12T10:13:31.958642+0000","last_clean":"2023-12-12T10:13:31.958642+0000","last_became_active":"2023-12-12T10:13:30.962498+0000","last_became_peered":"2023-12-12T10:13:30.962498+0000","last_unstale":"2023-12-12T10:13:31.958642+0000","last_undegraded":"2023-12-12T10:13:31.958642+0000","last_fullsized":"2023-12-12T10:13:31.958642+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:29.923090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:29.923090+0000","last_clean_scrub_stamp":"2023-12-12T10:13:29.923090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:09:03.967735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.966602+0000","last_change":"2023-12-12T10:13:31.962063+0000","last_active":"2023-12-12T10:13:31.966602+0000","last_peered":"2023-12-12T10:13:31.966602+0000","last_clean":"2023-12-12T10:13:31.966602+0000","last_became_active":"2023-12-12T10:13:31.960741+0000","last_became_peered":"2023-12-12T10:13:31.960741+0000","last_unstale":"2023-12-12T10:13:31.966602+0000","last_undegraded":"2023-12-12T10:13:31.966602+0000","last_fullsized":"2023-12-12T10:13:31.966602+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_clean_scrub_stamp":"2023-12-12T10:13:30.930525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:16:42.138651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"38'1","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:32.026941+0000","last_change":"2023-12-12T10:13:30.963202+0000","last_active":"2023-12-12T10:13:32.026941+0000","last_peered":"2023-12-12T10:13:32.026941+0000","last_clean":"2023-12-12T10:13:32.026941+0000","last_became_active":"2023-12-12T10:13:30.962798+0000","last_became_peered":"2023-12-12T10:13:30.962798+0000","last_unstale":"2023-12-12T10:13:32.026941+0000","last_undegraded":"2023-12-12T10:13:32.026941+0000","last_fullsized":"2023-12-12T10:13:32.026941+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:29.923090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:29.923090+0000","last_clean_scrub_stamp":"2023-12-12T10:13:29.923090+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:10:50.706784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.974500+0000","last_change":"2023-12-12T10:13:31.970145+0000","last_active":"2023-12-12T10:13:31.974500+0000","last_peered":"2023-12-12T10:13:31.974500+0000","last_clean":"2023-12-12T10:13:31.974500+0000","last_became_active":"2023-12-12T10:13:31.968499+0000","last_became_peered":"2023-12-12T10:13:31.968499+0000","last_unstale":"2023-12-12T10:13:31.974500+0000","last_undegraded":"2023-12-12T10:13:31.974500+0000","last_fullsized":"2023-12-12T10:13:31.974500+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_clean_scrub_stamp":"2023-12-12T10:13:30.930525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:46:10.675029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.943530+0000","last_change":"2023-12-12T10:13:30.966219+0000","last_active":"2023-12-12T10:13:31.943530+0000","last_peered":"2023-12-12T10:13:31.943530+0000","last_clean":"2023-12-12T10:13:31.943530+0000","last_became_active":"2023-12-12T10:13:30.965580+0000","last_became_peered":"2023-12-12T10:13:30.965580+0000","last_unstale":"2023-12-12T10:13:31.943530+0000","last_undegraded":"2023-12-12T10:13:31.943530+0000","last_fullsized":"2023-12-12T10:13:31.943530+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:29.923090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:29.923090+0000","last_clean_scrub_stamp":"2023-12-12T10:13:29.923090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:44:54.080621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.973094+0000","last_change":"2023-12-12T10:13:31.969053+0000","last_active":"2023-12-12T10:13:31.973094+0000","last_peered":"2023-12-12T10:13:31.973094+0000","last_clean":"2023-12-12T10:13:31.973094+0000","last_became_active":"2023-12-12T10:13:31.968771+0000","last_became_peered":"2023-12-12T10:13:31.968771+0000","last_unstale":"2023-12-12T10:13:31.973094+0000","last_undegraded":"2023-12-12T10:13:31.973094+0000","last_fullsized":"2023-12-12T10:13:31.973094+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_clean_scrub_stamp":"2023-12-12T10:13:30.930525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:37:08.558357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.946608+0000","last_change":"2023-12-12T10:13:30.960943+0000","last_active":"2023-12-12T10:13:31.946608+0000","last_peered":"2023-12-12T10:13:31.946608+0000","last_clean":"2023-12-12T10:13:31.946608+0000","last_became_active":"2023-12-12T10:13:30.960679+0000","last_became_peered":"2023-12-12T10:13:30.960679+0000","last_unstale":"2023-12-12T10:13:31.946608+0000","last_undegraded":"2023-12-12T10:13:31.946608+0000","last_fullsized":"2023-12-12T10:13:31.946608+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:29.923090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:29.923090+0000","last_clean_scrub_stamp":"2023-12-12T10:13:29.923090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:51:41.225326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.961346+0000","last_change":"2023-12-12T10:13:31.956585+0000","last_active":"2023-12-12T10:13:31.961346+0000","last_peered":"2023-12-12T10:13:31.961346+0000","last_clean":"2023-12-12T10:13:31.961346+0000","last_became_active":"2023-12-12T10:13:31.956294+0000","last_became_peered":"2023-12-12T10:13:31.956294+0000","last_unstale":"2023-12-12T10:13:31.961346+0000","last_undegraded":"2023-12-12T10:13:31.961346+0000","last_fullsized":"2023-12-12T10:13:31.961346+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_clean_scrub_stamp":"2023-12-12T10:13:30.930525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:41:48.610201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.950373+0000","last_change":"2023-12-12T10:13:30.946938+0000","last_active":"2023-12-12T10:13:31.950373+0000","last_peered":"2023-12-12T10:13:31.950373+0000","last_clean":"2023-12-12T10:13:31.950373+0000","last_became_active":"2023-12-12T10:13:30.946517+0000","last_became_peered":"2023-12-12T10:13:30.946517+0000","last_unstale":"2023-12-12T10:13:31.950373+0000","last_undegraded":"2023-12-12T10:13:31.950373+0000","last_fullsized":"2023-12-12T10:13:31.950373+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:29.923090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:29.923090+0000","last_clean_scrub_stamp":"2023-12-12T10:13:29.923090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:46:09.667594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.969281+0000","last_change":"2023-12-12T10:13:31.965912+0000","last_active":"2023-12-12T10:13:31.969281+0000","last_peered":"2023-12-12T10:13:31.969281+0000","last_clean":"2023-12-12T10:13:31.969281+0000","last_became_active":"2023-12-12T10:13:31.965651+0000","last_became_peered":"2023-12-12T10:13:31.965651+0000","last_unstale":"2023-12-12T10:13:31.969281+0000","last_undegraded":"2023-12-12T10:13:31.969281+0000","last_fullsized":"2023-12-12T10:13:31.969281+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_clean_scrub_stamp":"2023-12-12T10:13:30.930525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:24:02.702980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.946339+0000","last_change":"2023-12-12T10:13:30.961399+0000","last_active":"2023-12-12T10:13:31.946339+0000","last_peered":"2023-12-12T10:13:31.946339+0000","last_clean":"2023-12-12T10:13:31.946339+0000","last_became_active":"2023-12-12T10:13:30.961090+0000","last_became_peered":"2023-12-12T10:13:30.961090+0000","last_unstale":"2023-12-12T10:13:31.946339+0000","last_undegraded":"2023-12-12T10:13:31.946339+0000","last_fullsized":"2023-12-12T10:13:31.946339+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:29.923090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:29.923090+0000","last_clean_scrub_stamp":"2023-12-12T10:13:29.923090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T18:53:19.343833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.960148+0000","last_change":"2023-12-12T10:13:31.952549+0000","last_active":"2023-12-12T10:13:31.960148+0000","last_peered":"2023-12-12T10:13:31.960148+0000","last_clean":"2023-12-12T10:13:31.960148+0000","last_became_active":"2023-12-12T10:13:31.952264+0000","last_became_peered":"2023-12-12T10:13:31.952264+0000","last_unstale":"2023-12-12T10:13:31.960148+0000","last_undegraded":"2023-12-12T10:13:31.960148+0000","last_fullsized":"2023-12-12T10:13:31.960148+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_clean_scrub_stamp":"2023-12-12T10:13:30.930525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:32:40.635434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.958882+0000","last_change":"2023-12-12T10:13:30.964892+0000","last_active":"2023-12-12T10:13:31.958882+0000","last_peered":"2023-12-12T10:13:31.958882+0000","last_clean":"2023-12-12T10:13:31.958882+0000","last_became_active":"2023-12-12T10:13:30.964591+0000","last_became_peered":"2023-12-12T10:13:30.964591+0000","last_unstale":"2023-12-12T10:13:31.958882+0000","last_undegraded":"2023-12-12T10:13:31.958882+0000","last_fullsized":"2023-12-12T10:13:31.958882+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:29.923090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:29.923090+0000","last_clean_scrub_stamp":"2023-12-12T10:13:29.923090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:30:09.728391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.962706+0000","last_change":"2023-12-12T10:13:31.959535+0000","last_active":"2023-12-12T10:13:31.962706+0000","last_peered":"2023-12-12T10:13:31.962706+0000","last_clean":"2023-12-12T10:13:31.962706+0000","last_became_active":"2023-12-12T10:13:31.959264+0000","last_became_peered":"2023-12-12T10:13:31.959264+0000","last_unstale":"2023-12-12T10:13:31.962706+0000","last_undegraded":"2023-12-12T10:13:31.962706+0000","last_fullsized":"2023-12-12T10:13:31.962706+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_clean_scrub_stamp":"2023-12-12T10:13:30.930525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:37:08.558357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"38'3","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.958869+0000","last_change":"2023-12-12T10:13:30.959208+0000","last_active":"2023-12-12T10:13:31.958869+0000","last_peered":"2023-12-12T10:13:31.958869+0000","last_clean":"2023-12-12T10:13:31.958869+0000","last_became_active":"2023-12-12T10:13:30.958872+0000","last_became_peered":"2023-12-12T10:13:30.958872+0000","last_unstale":"2023-12-12T10:13:31.958869+0000","last_undegraded":"2023-12-12T10:13:31.958869+0000","last_fullsized":"2023-12-12T10:13:31.958869+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:29.923090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:29.923090+0000","last_clean_scrub_stamp":"2023-12-12T10:13:29.923090+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:38:50.871593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.968641+0000","last_change":"2023-12-12T10:13:31.962170+0000","last_active":"2023-12-12T10:13:31.968641+0000","last_peered":"2023-12-12T10:13:31.968641+0000","last_clean":"2023-12-12T10:13:31.968641+0000","last_became_active":"2023-12-12T10:13:31.961870+0000","last_became_peered":"2023-12-12T10:13:31.961870+0000","last_unstale":"2023-12-12T10:13:31.968641+0000","last_undegraded":"2023-12-12T10:13:31.968641+0000","last_fullsized":"2023-12-12T10:13:31.968641+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_clean_scrub_stamp":"2023-12-12T10:13:30.930525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:33:49.629588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"38'5","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.946376+0000","last_change":"2023-12-12T10:13:30.961032+0000","last_active":"2023-12-12T10:13:31.946376+0000","last_peered":"2023-12-12T10:13:31.946376+0000","last_clean":"2023-12-12T10:13:31.946376+0000","last_became_active":"2023-12-12T10:13:30.960658+0000","last_became_peered":"2023-12-12T10:13:30.960658+0000","last_unstale":"2023-12-12T10:13:31.946376+0000","last_undegraded":"2023-12-12T10:13:31.946376+0000","last_fullsized":"2023-12-12T10:13:31.946376+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:29.923090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:29.923090+0000","last_clean_scrub_stamp":"2023-12-12T10:13:29.923090+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:11:40.001970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.968875+0000","last_change":"2023-12-12T10:13:31.965151+0000","last_active":"2023-12-12T10:13:31.968875+0000","last_peered":"2023-12-12T10:13:31.968875+0000","last_clean":"2023-12-12T10:13:31.968875+0000","last_became_active":"2023-12-12T10:13:31.964846+0000","last_became_peered":"2023-12-12T10:13:31.964846+0000","last_unstale":"2023-12-12T10:13:31.968875+0000","last_undegraded":"2023-12-12T10:13:31.968875+0000","last_fullsized":"2023-12-12T10:13:31.968875+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_clean_scrub_stamp":"2023-12-12T10:13:30.930525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:39:15.634500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"38'2","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.946295+0000","last_change":"2023-12-12T10:13:30.958546+0000","last_active":"2023-12-12T10:13:31.946295+0000","last_peered":"2023-12-12T10:13:31.946295+0000","last_clean":"2023-12-12T10:13:31.946295+0000","last_became_active":"2023-12-12T10:13:30.958239+0000","last_became_peered":"2023-12-12T10:13:30.958239+0000","last_unstale":"2023-12-12T10:13:31.946295+0000","last_undegraded":"2023-12-12T10:13:31.946295+0000","last_fullsized":"2023-12-12T10:13:31.946295+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:29.923090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:29.923090+0000","last_clean_scrub_stamp":"2023-12-12T10:13:29.923090+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:50:46.051110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.971472+0000","last_change":"2023-12-12T10:13:31.963029+0000","last_active":"2023-12-12T10:13:31.971472+0000","last_peered":"2023-12-12T10:13:31.971472+0000","last_clean":"2023-12-12T10:13:31.971472+0000","last_became_active":"2023-12-12T10:13:31.962713+0000","last_became_peered":"2023-12-12T10:13:31.962713+0000","last_unstale":"2023-12-12T10:13:31.971472+0000","last_undegraded":"2023-12-12T10:13:31.971472+0000","last_fullsized":"2023-12-12T10:13:31.971472+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_clean_scrub_stamp":"2023-12-12T10:13:30.930525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:44:55.088056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.947327+0000","last_change":"2023-12-12T10:13:30.959108+0000","last_active":"2023-12-12T10:13:31.947327+0000","last_peered":"2023-12-12T10:13:31.947327+0000","last_clean":"2023-12-12T10:13:31.947327+0000","last_became_active":"2023-12-12T10:13:30.958896+0000","last_became_peered":"2023-12-12T10:13:30.958896+0000","last_unstale":"2023-12-12T10:13:31.947327+0000","last_undegraded":"2023-12-12T10:13:31.947327+0000","last_fullsized":"2023-12-12T10:13:31.947327+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:29.923090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:29.923090+0000","last_clean_scrub_stamp":"2023-12-12T10:13:29.923090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:31:46.714399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.961595+0000","last_change":"2023-12-12T10:13:31.953632+0000","last_active":"2023-12-12T10:13:31.961595+0000","last_peered":"2023-12-12T10:13:31.961595+0000","last_clean":"2023-12-12T10:13:31.961595+0000","last_became_active":"2023-12-12T10:13:31.951993+0000","last_became_peered":"2023-12-12T10:13:31.951993+0000","last_unstale":"2023-12-12T10:13:31.961595+0000","last_undegraded":"2023-12-12T10:13:31.961595+0000","last_fullsized":"2023-12-12T10:13:31.961595+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_clean_scrub_stamp":"2023-12-12T10:13:30.930525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:51:42.232761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.942678+0000","last_change":"2023-12-12T10:13:30.954138+0000","last_active":"2023-12-12T10:13:31.942678+0000","last_peered":"2023-12-12T10:13:31.942678+0000","last_clean":"2023-12-12T10:13:31.942678+0000","last_became_active":"2023-12-12T10:13:30.953867+0000","last_became_peered":"2023-12-12T10:13:30.953867+0000","last_unstale":"2023-12-12T10:13:31.942678+0000","last_undegraded":"2023-12-12T10:13:31.942678+0000","last_fullsized":"2023-12-12T10:13:31.942678+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:29.923090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:29.923090+0000","last_clean_scrub_stamp":"2023-12-12T10:13:29.923090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:51:41.225326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.961327+0000","last_change":"2023-12-12T10:13:31.952191+0000","last_active":"2023-12-12T10:13:31.961327+0000","last_peered":"2023-12-12T10:13:31.961327+0000","last_clean":"2023-12-12T10:13:31.961327+0000","last_became_active":"2023-12-12T10:13:31.951860+0000","last_became_peered":"2023-12-12T10:13:31.951860+0000","last_unstale":"2023-12-12T10:13:31.961327+0000","last_undegraded":"2023-12-12T10:13:31.961327+0000","last_fullsized":"2023-12-12T10:13:31.961327+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_clean_scrub_stamp":"2023-12-12T10:13:30.930525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:32:40.635434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.942884+0000","last_change":"2023-12-12T10:13:30.964109+0000","last_active":"2023-12-12T10:13:31.942884+0000","last_peered":"2023-12-12T10:13:31.942884+0000","last_clean":"2023-12-12T10:13:31.942884+0000","last_became_active":"2023-12-12T10:13:30.963813+0000","last_became_peered":"2023-12-12T10:13:30.963813+0000","last_unstale":"2023-12-12T10:13:31.942884+0000","last_undegraded":"2023-12-12T10:13:31.942884+0000","last_fullsized":"2023-12-12T10:13:31.942884+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:29.923090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:29.923090+0000","last_clean_scrub_stamp":"2023-12-12T10:13:29.923090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:46:09.667594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.964463+0000","last_change":"2023-12-12T10:13:31.959106+0000","last_active":"2023-12-12T10:13:31.964463+0000","last_peered":"2023-12-12T10:13:31.964463+0000","last_clean":"2023-12-12T10:13:31.964463+0000","last_became_active":"2023-12-12T10:13:31.958830+0000","last_became_peered":"2023-12-12T10:13:31.958830+0000","last_unstale":"2023-12-12T10:13:31.964463+0000","last_undegraded":"2023-12-12T10:13:31.964463+0000","last_fullsized":"2023-12-12T10:13:31.964463+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_clean_scrub_stamp":"2023-12-12T10:13:30.930525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:10:51.714219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"38'1","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.958360+0000","last_change":"2023-12-12T10:13:30.960227+0000","last_active":"2023-12-12T10:13:31.958360+0000","last_peered":"2023-12-12T10:13:31.958360+0000","last_clean":"2023-12-12T10:13:31.958360+0000","last_became_active":"2023-12-12T10:13:30.959934+0000","last_became_peered":"2023-12-12T10:13:30.959934+0000","last_unstale":"2023-12-12T10:13:31.958360+0000","last_undegraded":"2023-12-12T10:13:31.958360+0000","last_fullsized":"2023-12-12T10:13:31.958360+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:29.923090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:29.923090+0000","last_clean_scrub_stamp":"2023-12-12T10:13:29.923090+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:41:47.602766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.974507+0000","last_change":"2023-12-12T10:13:31.970206+0000","last_active":"2023-12-12T10:13:31.974507+0000","last_peered":"2023-12-12T10:13:31.974507+0000","last_clean":"2023-12-12T10:13:31.974507+0000","last_became_active":"2023-12-12T10:13:31.968699+0000","last_became_peered":"2023-12-12T10:13:31.968699+0000","last_unstale":"2023-12-12T10:13:31.974507+0000","last_undegraded":"2023-12-12T10:13:31.974507+0000","last_fullsized":"2023-12-12T10:13:31.974507+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_clean_scrub_stamp":"2023-12-12T10:13:30.930525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:44:55.088056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.958581+0000","last_change":"2023-12-12T10:13:30.960842+0000","last_active":"2023-12-12T10:13:31.958581+0000","last_peered":"2023-12-12T10:13:31.958581+0000","last_clean":"2023-12-12T10:13:31.958581+0000","last_became_active":"2023-12-12T10:13:30.960564+0000","last_became_peered":"2023-12-12T10:13:30.960564+0000","last_unstale":"2023-12-12T10:13:31.958581+0000","last_undegraded":"2023-12-12T10:13:31.958581+0000","last_fullsized":"2023-12-12T10:13:31.958581+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:29.923090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:29.923090+0000","last_clean_scrub_stamp":"2023-12-12T10:13:29.923090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:31:46.714399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.972920+0000","last_change":"2023-12-12T10:13:31.962924+0000","last_active":"2023-12-12T10:13:31.972920+0000","last_peered":"2023-12-12T10:13:31.972920+0000","last_clean":"2023-12-12T10:13:31.972920+0000","last_became_active":"2023-12-12T10:13:31.962658+0000","last_became_peered":"2023-12-12T10:13:31.962658+0000","last_unstale":"2023-12-12T10:13:31.972920+0000","last_undegraded":"2023-12-12T10:13:31.972920+0000","last_fullsized":"2023-12-12T10:13:31.972920+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_clean_scrub_stamp":"2023-12-12T10:13:30.930525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:16:42.138651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"38'1","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.939844+0000","last_change":"2023-12-12T10:13:30.960419+0000","last_active":"2023-12-12T10:13:31.939844+0000","last_peered":"2023-12-12T10:13:31.939844+0000","last_clean":"2023-12-12T10:13:31.939844+0000","last_became_active":"2023-12-12T10:13:30.960156+0000","last_became_peered":"2023-12-12T10:13:30.960156+0000","last_unstale":"2023-12-12T10:13:31.939844+0000","last_undegraded":"2023-12-12T10:13:31.939844+0000","last_fullsized":"2023-12-12T10:13:31.939844+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:29.923090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:29.923090+0000","last_clean_scrub_stamp":"2023-12-12T10:13:29.923090+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:06:03.884942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.962949+0000","last_change":"2023-12-12T10:13:31.958947+0000","last_active":"2023-12-12T10:13:31.962949+0000","last_peered":"2023-12-12T10:13:31.962949+0000","last_clean":"2023-12-12T10:13:31.962949+0000","last_became_active":"2023-12-12T10:13:31.958564+0000","last_became_peered":"2023-12-12T10:13:31.958564+0000","last_unstale":"2023-12-12T10:13:31.962949+0000","last_undegraded":"2023-12-12T10:13:31.962949+0000","last_fullsized":"2023-12-12T10:13:31.962949+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_clean_scrub_stamp":"2023-12-12T10:13:30.930525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T13:53:26.274851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.946803+0000","last_change":"2023-12-12T10:13:30.957980+0000","last_active":"2023-12-12T10:13:31.946803+0000","last_peered":"2023-12-12T10:13:31.946803+0000","last_clean":"2023-12-12T10:13:31.946803+0000","last_became_active":"2023-12-12T10:13:30.957727+0000","last_became_peered":"2023-12-12T10:13:30.957727+0000","last_unstale":"2023-12-12T10:13:31.946803+0000","last_undegraded":"2023-12-12T10:13:31.946803+0000","last_fullsized":"2023-12-12T10:13:31.946803+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:29.923090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:29.923090+0000","last_clean_scrub_stamp":"2023-12-12T10:13:29.923090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:33:48.622153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.962570+0000","last_change":"2023-12-12T10:13:31.954761+0000","last_active":"2023-12-12T10:13:31.962570+0000","last_peered":"2023-12-12T10:13:31.962570+0000","last_clean":"2023-12-12T10:13:31.962570+0000","last_became_active":"2023-12-12T10:13:31.954428+0000","last_became_peered":"2023-12-12T10:13:31.954428+0000","last_unstale":"2023-12-12T10:13:31.962570+0000","last_undegraded":"2023-12-12T10:13:31.962570+0000","last_fullsized":"2023-12-12T10:13:31.962570+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_clean_scrub_stamp":"2023-12-12T10:13:30.930525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:09:04.975169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"38'2","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.939898+0000","last_change":"2023-12-12T10:13:30.956870+0000","last_active":"2023-12-12T10:13:31.939898+0000","last_peered":"2023-12-12T10:13:31.939898+0000","last_clean":"2023-12-12T10:13:31.939898+0000","last_became_active":"2023-12-12T10:13:30.956590+0000","last_became_peered":"2023-12-12T10:13:30.956590+0000","last_unstale":"2023-12-12T10:13:31.939898+0000","last_undegraded":"2023-12-12T10:13:31.939898+0000","last_fullsized":"2023-12-12T10:13:31.939898+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:29.923090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:29.923090+0000","last_clean_scrub_stamp":"2023-12-12T10:13:29.923090+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T11:08:19.409816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.966502+0000","last_change":"2023-12-12T10:13:31.961554+0000","last_active":"2023-12-12T10:13:31.966502+0000","last_peered":"2023-12-12T10:13:31.966502+0000","last_clean":"2023-12-12T10:13:31.966502+0000","last_became_active":"2023-12-12T10:13:31.961239+0000","last_became_peered":"2023-12-12T10:13:31.961239+0000","last_unstale":"2023-12-12T10:13:31.966502+0000","last_undegraded":"2023-12-12T10:13:31.966502+0000","last_fullsized":"2023-12-12T10:13:31.966502+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_clean_scrub_stamp":"2023-12-12T10:13:30.930525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T17:51:42.232761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.939670+0000","last_change":"2023-12-12T10:13:30.952636+0000","last_active":"2023-12-12T10:13:31.939670+0000","last_peered":"2023-12-12T10:13:31.939670+0000","last_clean":"2023-12-12T10:13:31.939670+0000","last_became_active":"2023-12-12T10:13:30.952350+0000","last_became_peered":"2023-12-12T10:13:30.952350+0000","last_unstale":"2023-12-12T10:13:31.939670+0000","last_undegraded":"2023-12-12T10:13:31.939670+0000","last_fullsized":"2023-12-12T10:13:31.939670+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:29.923090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:29.923090+0000","last_clean_scrub_stamp":"2023-12-12T10:13:29.923090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:29:39.862901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.971743+0000","last_change":"2023-12-12T10:13:31.967555+0000","last_active":"2023-12-12T10:13:31.971743+0000","last_peered":"2023-12-12T10:13:31.971743+0000","last_clean":"2023-12-12T10:13:31.971743+0000","last_became_active":"2023-12-12T10:13:31.966502+0000","last_became_peered":"2023-12-12T10:13:31.966502+0000","last_unstale":"2023-12-12T10:13:31.971743+0000","last_undegraded":"2023-12-12T10:13:31.971743+0000","last_fullsized":"2023-12-12T10:13:31.971743+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_clean_scrub_stamp":"2023-12-12T10:13:30.930525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T22:04:14.045112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.943349+0000","last_change":"2023-12-12T10:13:30.964332+0000","last_active":"2023-12-12T10:13:31.943349+0000","last_peered":"2023-12-12T10:13:31.943349+0000","last_clean":"2023-12-12T10:13:31.943349+0000","last_became_active":"2023-12-12T10:13:30.964061+0000","last_became_peered":"2023-12-12T10:13:30.964061+0000","last_unstale":"2023-12-12T10:13:31.943349+0000","last_undegraded":"2023-12-12T10:13:31.943349+0000","last_fullsized":"2023-12-12T10:13:31.943349+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:29.923090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:29.923090+0000","last_clean_scrub_stamp":"2023-12-12T10:13:29.923090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:49:43.289349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.961387+0000","last_change":"2023-12-12T10:13:31.957083+0000","last_active":"2023-12-12T10:13:31.961387+0000","last_peered":"2023-12-12T10:13:31.961387+0000","last_clean":"2023-12-12T10:13:31.961387+0000","last_became_active":"2023-12-12T10:13:31.956814+0000","last_became_peered":"2023-12-12T10:13:31.956814+0000","last_unstale":"2023-12-12T10:13:31.961387+0000","last_undegraded":"2023-12-12T10:13:31.961387+0000","last_fullsized":"2023-12-12T10:13:31.961387+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_clean_scrub_stamp":"2023-12-12T10:13:30.930525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T20:38:51.879028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.939733+0000","last_change":"2023-12-12T10:13:30.954045+0000","last_active":"2023-12-12T10:13:31.939733+0000","last_peered":"2023-12-12T10:13:31.939733+0000","last_clean":"2023-12-12T10:13:31.939733+0000","last_became_active":"2023-12-12T10:13:30.953642+0000","last_became_peered":"2023-12-12T10:13:30.953642+0000","last_unstale":"2023-12-12T10:13:31.939733+0000","last_undegraded":"2023-12-12T10:13:31.939733+0000","last_fullsized":"2023-12-12T10:13:31.939733+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:29.923090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:29.923090+0000","last_clean_scrub_stamp":"2023-12-12T10:13:29.923090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:18:26.061610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.971030+0000","last_change":"2023-12-12T10:13:31.967459+0000","last_active":"2023-12-12T10:13:31.971030+0000","last_peered":"2023-12-12T10:13:31.971030+0000","last_clean":"2023-12-12T10:13:31.971030+0000","last_became_active":"2023-12-12T10:13:31.967192+0000","last_became_peered":"2023-12-12T10:13:31.967192+0000","last_unstale":"2023-12-12T10:13:31.971030+0000","last_undegraded":"2023-12-12T10:13:31.971030+0000","last_fullsized":"2023-12-12T10:13:31.971030+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_clean_scrub_stamp":"2023-12-12T10:13:30.930525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:16:42.138651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"38'2","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.958558+0000","last_change":"2023-12-12T10:13:30.959720+0000","last_active":"2023-12-12T10:13:31.958558+0000","last_peered":"2023-12-12T10:13:31.958558+0000","last_clean":"2023-12-12T10:13:31.958558+0000","last_became_active":"2023-12-12T10:13:30.959430+0000","last_became_peered":"2023-12-12T10:13:30.959430+0000","last_unstale":"2023-12-12T10:13:31.958558+0000","last_undegraded":"2023-12-12T10:13:31.958558+0000","last_fullsized":"2023-12-12T10:13:31.958558+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:29.923090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:29.923090+0000","last_clean_scrub_stamp":"2023-12-12T10:13:29.923090+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:37:35.766519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.961466+0000","last_change":"2023-12-12T10:13:31.953531+0000","last_active":"2023-12-12T10:13:31.961466+0000","last_peered":"2023-12-12T10:13:31.961466+0000","last_clean":"2023-12-12T10:13:31.961466+0000","last_became_active":"2023-12-12T10:13:31.953210+0000","last_became_peered":"2023-12-12T10:13:31.953210+0000","last_unstale":"2023-12-12T10:13:31.961466+0000","last_undegraded":"2023-12-12T10:13:31.961466+0000","last_fullsized":"2023-12-12T10:13:31.961466+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_clean_scrub_stamp":"2023-12-12T10:13:30.930525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T22:04:14.045112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.939923+0000","last_change":"2023-12-12T10:13:30.958892+0000","last_active":"2023-12-12T10:13:31.939923+0000","last_peered":"2023-12-12T10:13:31.939923+0000","last_clean":"2023-12-12T10:13:31.939923+0000","last_became_active":"2023-12-12T10:13:30.958589+0000","last_became_peered":"2023-12-12T10:13:30.958589+0000","last_unstale":"2023-12-12T10:13:31.939923+0000","last_undegraded":"2023-12-12T10:13:31.939923+0000","last_fullsized":"2023-12-12T10:13:31.939923+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:29.923090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:29.923090+0000","last_clean_scrub_stamp":"2023-12-12T10:13:29.923090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:55:00.196669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.971538+0000","last_change":"2023-12-12T10:13:31.965301+0000","last_active":"2023-12-12T10:13:31.971538+0000","last_peered":"2023-12-12T10:13:31.971538+0000","last_clean":"2023-12-12T10:13:31.971538+0000","last_became_active":"2023-12-12T10:13:31.965005+0000","last_became_peered":"2023-12-12T10:13:31.965005+0000","last_unstale":"2023-12-12T10:13:31.971538+0000","last_undegraded":"2023-12-12T10:13:31.971538+0000","last_fullsized":"2023-12-12T10:13:31.971538+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_clean_scrub_stamp":"2023-12-12T10:13:30.930525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:41:29.667201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.953341+0000","last_change":"2023-12-12T10:13:30.961434+0000","last_active":"2023-12-12T10:13:31.953341+0000","last_peered":"2023-12-12T10:13:31.953341+0000","last_clean":"2023-12-12T10:13:31.953341+0000","last_became_active":"2023-12-12T10:13:30.960429+0000","last_became_peered":"2023-12-12T10:13:30.960429+0000","last_unstale":"2023-12-12T10:13:31.953341+0000","last_undegraded":"2023-12-12T10:13:31.953341+0000","last_fullsized":"2023-12-12T10:13:31.953341+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:29.923090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:29.923090+0000","last_clean_scrub_stamp":"2023-12-12T10:13:29.923090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T21:09:03.967735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.968790+0000","last_change":"2023-12-12T10:13:31.964056+0000","last_active":"2023-12-12T10:13:31.968790+0000","last_peered":"2023-12-12T10:13:31.968790+0000","last_clean":"2023-12-12T10:13:31.968790+0000","last_became_active":"2023-12-12T10:13:31.963732+0000","last_became_peered":"2023-12-12T10:13:31.963732+0000","last_unstale":"2023-12-12T10:13:31.968790+0000","last_undegraded":"2023-12-12T10:13:31.968790+0000","last_fullsized":"2023-12-12T10:13:31.968790+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_clean_scrub_stamp":"2023-12-12T10:13:30.930525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:23:57.472966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.953182+0000","last_change":"2023-12-12T10:13:30.956747+0000","last_active":"2023-12-12T10:13:31.953182+0000","last_peered":"2023-12-12T10:13:31.953182+0000","last_clean":"2023-12-12T10:13:31.953182+0000","last_became_active":"2023-12-12T10:13:30.956481+0000","last_became_peered":"2023-12-12T10:13:30.956481+0000","last_unstale":"2023-12-12T10:13:31.953182+0000","last_undegraded":"2023-12-12T10:13:31.953182+0000","last_fullsized":"2023-12-12T10:13:31.953182+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:29.923090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:29.923090+0000","last_clean_scrub_stamp":"2023-12-12T10:13:29.923090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:31:46.714399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.966553+0000","last_change":"2023-12-12T10:13:31.957604+0000","last_active":"2023-12-12T10:13:31.966553+0000","last_peered":"2023-12-12T10:13:31.966553+0000","last_clean":"2023-12-12T10:13:31.966553+0000","last_became_active":"2023-12-12T10:13:31.956660+0000","last_became_peered":"2023-12-12T10:13:31.956660+0000","last_unstale":"2023-12-12T10:13:31.966553+0000","last_undegraded":"2023-12-12T10:13:31.966553+0000","last_fullsized":"2023-12-12T10:13:31.966553+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_clean_scrub_stamp":"2023-12-12T10:13:30.930525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:39:15.634500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.942808+0000","last_change":"2023-12-12T10:13:30.953009+0000","last_active":"2023-12-12T10:13:31.942808+0000","last_peered":"2023-12-12T10:13:31.942808+0000","last_clean":"2023-12-12T10:13:31.942808+0000","last_became_active":"2023-12-12T10:13:30.952374+0000","last_became_peered":"2023-12-12T10:13:30.952374+0000","last_unstale":"2023-12-12T10:13:31.942808+0000","last_undegraded":"2023-12-12T10:13:31.942808+0000","last_fullsized":"2023-12-12T10:13:31.942808+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:29.923090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:29.923090+0000","last_clean_scrub_stamp":"2023-12-12T10:13:29.923090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:33:48.622153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.969153+0000","last_change":"2023-12-12T10:13:31.961120+0000","last_active":"2023-12-12T10:13:31.969153+0000","last_peered":"2023-12-12T10:13:31.969153+0000","last_clean":"2023-12-12T10:13:31.969153+0000","last_became_active":"2023-12-12T10:13:31.960547+0000","last_became_peered":"2023-12-12T10:13:31.960547+0000","last_unstale":"2023-12-12T10:13:31.969153+0000","last_undegraded":"2023-12-12T10:13:31.969153+0000","last_fullsized":"2023-12-12T10:13:31.969153+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_clean_scrub_stamp":"2023-12-12T10:13:30.930525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T14:23:57.472966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.951239+0000","last_change":"2023-12-12T10:13:30.962974+0000","last_active":"2023-12-12T10:13:31.951239+0000","last_peered":"2023-12-12T10:13:31.951239+0000","last_clean":"2023-12-12T10:13:31.951239+0000","last_became_active":"2023-12-12T10:13:30.962664+0000","last_became_peered":"2023-12-12T10:13:30.962664+0000","last_unstale":"2023-12-12T10:13:31.951239+0000","last_undegraded":"2023-12-12T10:13:31.951239+0000","last_fullsized":"2023-12-12T10:13:31.951239+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:29.923090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:29.923090+0000","last_clean_scrub_stamp":"2023-12-12T10:13:29.923090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:25:55.033047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.962674+0000","last_change":"2023-12-12T10:13:31.958291+0000","last_active":"2023-12-12T10:13:31.962674+0000","last_peered":"2023-12-12T10:13:31.962674+0000","last_clean":"2023-12-12T10:13:31.962674+0000","last_became_active":"2023-12-12T10:13:31.954271+0000","last_became_peered":"2023-12-12T10:13:31.954271+0000","last_unstale":"2023-12-12T10:13:31.962674+0000","last_undegraded":"2023-12-12T10:13:31.962674+0000","last_fullsized":"2023-12-12T10:13:31.962674+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_clean_scrub_stamp":"2023-12-12T10:13:30.930525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T16:16:42.138651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.946150+0000","last_change":"2023-12-12T10:13:30.955570+0000","last_active":"2023-12-12T10:13:31.946150+0000","last_peered":"2023-12-12T10:13:31.946150+0000","last_clean":"2023-12-12T10:13:31.946150+0000","last_became_active":"2023-12-12T10:13:30.955187+0000","last_became_peered":"2023-12-12T10:13:30.955187+0000","last_unstale":"2023-12-12T10:13:31.946150+0000","last_undegraded":"2023-12-12T10:13:31.946150+0000","last_fullsized":"2023-12-12T10:13:31.946150+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:29.923090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:29.923090+0000","last_clean_scrub_stamp":"2023-12-12T10:13:29.923090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T15:30:09.728391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.974442+0000","last_change":"2023-12-12T10:13:31.969978+0000","last_active":"2023-12-12T10:13:31.974442+0000","last_peered":"2023-12-12T10:13:31.974442+0000","last_clean":"2023-12-12T10:13:31.974442+0000","last_became_active":"2023-12-12T10:13:31.969686+0000","last_became_peered":"2023-12-12T10:13:31.969686+0000","last_unstale":"2023-12-12T10:13:31.974442+0000","last_undegraded":"2023-12-12T10:13:31.974442+0000","last_fullsized":"2023-12-12T10:13:31.974442+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:30.930525+0000","last_clean_scrub_stamp":"2023-12-12T10:13:30.930525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T19:01:05.027866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-12T10:13:31.943936+0000","last_change":"2023-12-12T10:13:30.966192+0000","last_active":"2023-12-12T10:13:31.943936+0000","last_peered":"2023-12-12T10:13:31.943936+0000","last_clean":"2023-12-12T10:13:31.943936+0000","last_became_active":"2023-12-12T10:13:30.965653+0000","last_became_peered":"2023-12-12T10:13:30.965653+0000","last_unstale":"2023-12-12T10:13:31.943936+0000","last_undegraded":"2023-12-12T10:13:31.943936+0000","last_fullsized":"2023-12-12T10:13:31.943936+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:13:29.923090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:13:29.923090+0000","last_clean_scrub_stamp":"2023-12-12T10:13:29.923090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T10:46:58.116041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":180,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-12T10:13:30.957424+0000","last_change":"2023-12-12T10:11:58.492812+0000","last_active":"2023-12-12T10:13:30.957424+0000","last_peered":"2023-12-12T10:13:30.957424+0000","last_clean":"2023-12-12T10:13:30.957424+0000","last_became_active":"2023-12-12T10:11:58.491470+0000","last_became_peered":"2023-12-12T10:11:58.491470+0000","last_unstale":"2023-12-12T10:13:30.957424+0000","last_undegraded":"2023-12-12T10:13:30.957424+0000","last_fullsized":"2023-12-12T10:13:30.957424+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:11:57.289641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:11:57.289641+0000","last_clean_scrub_stamp":"2023-12-12T10:11:57.289641+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:10:37.809139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":888,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":20,"ondisk_log_size":20,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574870,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28016,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343824,"statfs":{"total":96636764160,"available":96608075776,"internally_reserved":0,"allocated":1019904,"data_stored":770772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 10:12:58 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.52300000000000002}]},{"osd":1,"last update":"Tue Dec 12 10:12:58 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.48799999999999999}]},{"osd":2,"last update":"Tue Dec 12 10:12:58 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.624}]},{"osd":3,"last update":"Tue Dec 12 10:12:58 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.61299999999999999}]},{"osd":4,"last update":"Tue Dec 12 10:12:58 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.751}]},{"osd":5,"last update":"Tue Dec 12 10:12:58 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.70799999999999996}]},{"osd":6,"last update":"Tue Dec 12 10:12:58 2023","interfaces":[{"interface":"back","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.76700000000000002},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.69199999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574870,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":425984,"data_stored":180404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 10:12:56 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.61799999999999999}]},{"osd":1,"last update":"Tue Dec 12 10:12:56 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":2.3119999999999998,"5min":2.3119999999999998,"15min":2.3119999999999998},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":2.8759999999999999,"5min":2.8759999999999999,"15min":2.8759999999999999},"last":0.66400000000000003}]},{"osd":2,"last update":"Tue Dec 12 10:12:56 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.53200000000000003}]},{"osd":3,"last update":"Tue Dec 12 10:12:56 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.57999999999999996}]},{"osd":4,"last update":"Tue Dec 12 10:12:56 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.54300000000000004}]},{"osd":5,"last update":"Tue Dec 12 10:12:56 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.70799999999999996}]},{"osd":7,"last update":"Tue Dec 12 10:12:56 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.252,"5min":1.252,"15min":1.252},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":0.50900000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":425984,"data_stored":180404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 10:12:57 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.91000000000000003}]},{"osd":1,"last update":"Tue Dec 12 10:12:57 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.85099999999999998}]},{"osd":2,"last update":"Tue Dec 12 10:12:57 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.3640000000000001,"5min":1.3640000000000001,"15min":1.3640000000000001},"last":0.875},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.387,"5min":1.387,"15min":1.387},"last":0.78200000000000003}]},{"osd":3,"last update":"Tue Dec 12 10:12:57 2023","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.80300000000000005}]},{"osd":4,"last update":"Tue Dec 12 10:12:57 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.57099999999999995}]},{"osd":6,"last update":"Tue Dec 12 10:12:57 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.373,"5min":1.373,"15min":1.373},"last":0.60499999999999998}]},{"osd":7,"last update":"Tue Dec 12 10:12:57 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.70999999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574871,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":425984,"data_stored":180404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 10:12:58 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":2.8570000000000002,"5min":2.8570000000000002,"15min":2.8570000000000002},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.748}]},{"osd":1,"last update":"Tue Dec 12 10:12:58 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":2.9209999999999998,"5min":2.9209999999999998,"15min":2.9209999999999998},"last":0.69899999999999995}]},{"osd":2,"last update":"Tue Dec 12 10:12:58 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":3.141,"5min":3.141,"15min":3.141},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.66700000000000004}]},{"osd":3,"last update":"Tue Dec 12 10:12:58 2023","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.70999999999999996}]},{"osd":5,"last update":"Tue Dec 12 10:12:58 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.623}]},{"osd":6,"last update":"Tue Dec 12 10:12:58 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.54800000000000004}]},{"osd":7,"last update":"Tue Dec 12 10:12:58 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.82399999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27456,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344384,"statfs":{"total":96636764160,"available":96608649216,"internally_reserved":0,"allocated":438272,"data_stored":187499,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 10:12:57 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.42299999999999999}]},{"osd":1,"last update":"Tue Dec 12 10:12:57 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":1.3080000000000001,"5min":1.3080000000000001,"15min":1.3080000000000001},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":1.266,"5min":1.266,"15min":1.266},"last":0.621}]},{"osd":2,"last update":"Tue Dec 12 10:12:57 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.379},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.5}]},{"osd":4,"last update":"Tue Dec 12 10:12:57 2023","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.657,"5min":1.657,"15min":1.657},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.59099999999999997}]},{"osd":5,"last update":"Tue Dec 12 10:12:57 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.762,"5min":1.762,"15min":1.762},"last":0.53600000000000003}]},{"osd":6,"last update":"Tue Dec 12 10:12:57 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.4690000000000001,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.286,"5min":1.286,"15min":1.286},"last":0.71299999999999997}]},{"osd":7,"last update":"Tue Dec 12 10:12:57 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.8029999999999999,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.546,"5min":1.546,"15min":1.546},"last":0.65500000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574872,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":425984,"data_stored":180404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 10:13:00 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":4.1779999999999999,"5min":4.1779999999999999,"15min":4.1779999999999999},"last":0.44},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.35399999999999998}]},{"osd":1,"last update":"Tue Dec 12 10:13:00 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":4.4829999999999997,"5min":4.4829999999999997,"15min":4.4829999999999997},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":4.1349999999999998,"5min":4.1349999999999998,"15min":4.1349999999999998},"last":0.41299999999999998}]},{"osd":3,"last update":"Tue Dec 12 10:13:00 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":4.3410000000000002,"5min":4.3410000000000002,"15min":4.3410000000000002},"last":0.624},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.46200000000000002}]},{"osd":4,"last update":"Tue Dec 12 10:13:00 2023","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":4.6449999999999996,"5min":4.6449999999999996,"15min":4.6449999999999996},"last":0.67400000000000004}]},{"osd":5,"last update":"Tue Dec 12 10:13:00 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.65300000000000002}]},{"osd":6,"last update":"Tue Dec 12 10:13:00 2023","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":4.6020000000000003,"5min":4.6020000000000003,"15min":4.6020000000000003},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.54400000000000004}]},{"osd":7,"last update":"Tue Dec 12 10:13:00 2023","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.0429999999999999,"5min":1.0429999999999999,"15min":1.0429999999999999},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":4.6840000000000002,"5min":4.6840000000000002,"15min":4.6840000000000002},"last":0.75600000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":416,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":425984,"data_stored":180404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 10:13:00 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.433,"15min":0.433},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.3180000000000001,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":0.40200000000000002}]},{"osd":2,"last update":"Tue Dec 12 10:13:00 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.309},{"interface":"front","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":4.0069999999999997,"5min":4.0069999999999997,"15min":4.0069999999999997},"last":0.44400000000000001}]},{"osd":3,"last update":"Tue Dec 12 10:13:00 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":4.0460000000000003,"5min":4.0460000000000003,"15min":4.0460000000000003},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.34799999999999998}]},{"osd":4,"last update":"Tue Dec 12 10:13:00 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":4.3620000000000001,"5min":4.3620000000000001,"15min":4.3620000000000001},"last":0.79000000000000004}]},{"osd":5,"last update":"Tue Dec 12 10:13:00 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.60999999999999999}]},{"osd":6,"last update":"Tue Dec 12 10:13:00 2023","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.6850000000000001,"5min":1.6850000000000001,"15min":1.6850000000000001},"last":0.754},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.6319999999999999,"5min":1.6319999999999999,"15min":1.6319999999999999},"last":0.76800000000000002}]},{"osd":7,"last update":"Tue Dec 12 10:13:00 2023","interfaces":[{"interface":"back","average":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":4.4059999999999997,"5min":4.4059999999999997,"15min":4.4059999999999997},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.875,"5min":0.875,"15min":0.875},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.7370000000000001,"5min":1.7370000000000001,"15min":1.7370000000000001},"last":0.80500000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574871,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28016,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343824,"statfs":{"total":96636764160,"available":96608075776,"internally_reserved":0,"allocated":1015808,"data_stored":769803,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 12 10:12:59 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.439,"5min":0.439,"15min":0.439},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.628,"5min":0.628,"15min":0.628},"last":0.40100000000000002}]},{"osd":2,"last update":"Tue Dec 12 10:12:59 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"last":0.502},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.48299999999999998}]},{"osd":3,"last update":"Tue Dec 12 10:12:59 2023","interfaces":[{"interface":"back","average":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.623,"5min":0.623,"15min":0.623},"last":0.46300000000000002}]},{"osd":4,"last update":"Tue Dec 12 10:12:59 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.034,"5min":1.034,"15min":1.034},"last":0.90300000000000002},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.91400000000000003}]},{"osd":5,"last update":"Tue Dec 12 10:12:59 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.85199999999999998}]},{"osd":6,"last update":"Tue Dec 12 10:12:59 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.92600000000000005},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"last":0.75600000000000001}]},{"osd":7,"last update":"Tue Dec 12 10:12:59 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.749,"15min":0.749},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.01,"5min":1.01,"15min":1.01},"last":0.87},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"last":0.97699999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-12T10:13:36.483 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-12T10:13:36.483 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-12-12T10:13:36.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.660+0000 7f652bf72640 1 Processor -- start 2023-12-12T10:13:36.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.664+0000 7f652bf72640 1 -- start start 2023-12-12T10:13:36.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.664+0000 7f652bf72640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f652415d080 0x7f652406ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:36.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.664+0000 7f652bf72640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f6524160da0 0x7f65241611e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:36.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.664+0000 7f652bf72640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f65240cc370 0x7f65240cc800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:36.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.664+0000 7f652bf72640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65240ccd40 con 0x7f652415d080 2023-12-12T10:13:36.670 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.664+0000 7f652bf72640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f652406bf50 con 0x7f6524160da0 2023-12-12T10:13:36.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.664+0000 7f652bf72640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f652406b580 con 0x7f65240cc370 2023-12-12T10:13:36.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.664+0000 7f6529d0e640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f652415d080 0x7f652406ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:36.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.664+0000 7f6529d0e640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f652415d080 0x7f652406ba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33620/0 (socket says 172.21.15.78:33620) 2023-12-12T10:13:36.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.664+0000 7f6529d0e640 1 -- 172.21.15.78:0/3951892054 learned_addr learned my addr 172.21.15.78:0/3951892054 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:13:36.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.664+0000 7f652a50f640 1 --2- 172.21.15.78:0/3951892054 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f65240cc370 0x7f65240cc800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:36.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.664+0000 7f652950d640 1 --2- 172.21.15.78:0/3951892054 >> v2:172.21.15.187:3300/0 conn(0x7f6524160da0 0x7f65241611e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:36.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.664+0000 7f6529d0e640 1 -- 172.21.15.78:0/3951892054 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f65240cc370 msgr2=0x7f65240cc800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:13:36.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.664+0000 7f6529d0e640 1 --2- 172.21.15.78:0/3951892054 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f65240cc370 0x7f65240cc800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:36.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.664+0000 7f6529d0e640 1 -- 172.21.15.78:0/3951892054 >> v2:172.21.15.187:3300/0 conn(0x7f6524160da0 msgr2=0x7f65241611e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:13:36.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.664+0000 7f6529d0e640 1 --2- 172.21.15.78:0/3951892054 >> v2:172.21.15.187:3300/0 conn(0x7f6524160da0 0x7f65241611e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:36.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.664+0000 7f6529d0e640 1 -- 172.21.15.78:0/3951892054 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f652406af50 con 0x7f652415d080 2023-12-12T10:13:36.672 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.668+0000 7f6529d0e640 1 --2- 172.21.15.78:0/3951892054 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f652415d080 0x7f652406ba10 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f65240ce260 tx=0x7f652001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86c8ae53a739746f server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:36.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.668+0000 7f6528d0c640 1 -- 172.21.15.78:0/3951892054 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65200ac410 con 0x7f652415d080 2023-12-12T10:13:36.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.668+0000 7f6528d0c640 1 -- 172.21.15.78:0/3951892054 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65200ac570 con 0x7f652415d080 2023-12-12T10:13:36.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.668+0000 7f6528d0c640 1 -- 172.21.15.78:0/3951892054 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65200ac900 con 0x7f652415d080 2023-12-12T10:13:36.673 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.668+0000 7f652bf72640 1 -- 172.21.15.78:0/3951892054 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f652415d080 msgr2=0x7f652406ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:36.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.668+0000 7f652bf72640 1 --2- 172.21.15.78:0/3951892054 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f652415d080 0x7f652406ba10 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f65240ce260 tx=0x7f652001c500 comp rx=0 tx=0).stop 2023-12-12T10:13:36.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.668+0000 7f652bf72640 1 -- 172.21.15.78:0/3951892054 shutdown_connections 2023-12-12T10:13:36.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.668+0000 7f652bf72640 1 --2- 172.21.15.78:0/3951892054 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f65240cc370 0x7f65240cc800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:36.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.668+0000 7f652bf72640 1 --2- 172.21.15.78:0/3951892054 >> v2:172.21.15.187:3300/0 conn(0x7f6524160da0 0x7f65241611e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:36.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.668+0000 7f652bf72640 1 --2- 172.21.15.78:0/3951892054 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f652415d080 0x7f652406ba10 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:36.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.668+0000 7f652bf72640 1 -- 172.21.15.78:0/3951892054 >> 172.21.15.78:0/3951892054 conn(0x7f65240b1650 msgr2=0x7f65240b1a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:36.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.668+0000 7f652bf72640 1 -- 172.21.15.78:0/3951892054 shutdown_connections 2023-12-12T10:13:36.674 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.668+0000 7f652bf72640 1 -- 172.21.15.78:0/3951892054 wait complete. 2023-12-12T10:13:36.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.668+0000 7f652bf72640 1 Processor -- start 2023-12-12T10:13:36.675 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.668+0000 7f652bf72640 1 -- start start 2023-12-12T10:13:36.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.672+0000 7f652bf72640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f65240cc370 0x7f65241410c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:36.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.672+0000 7f652bf72640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f652415d080 0x7f65241527d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:36.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.672+0000 7f652bf72640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6524160da0 0x7f6524152d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:36.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.672+0000 7f652bf72640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65241549d0 con 0x7f6524160da0 2023-12-12T10:13:36.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.672+0000 7f652bf72640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6524154c20 con 0x7f652415d080 2023-12-12T10:13:36.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.672+0000 7f652bf72640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6524154f00 con 0x7f65240cc370 2023-12-12T10:13:36.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.672+0000 7f652a50f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6524160da0 0x7f6524152d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:36.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.672+0000 7f652a50f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6524160da0 0x7f6524152d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33624/0 (socket says 172.21.15.78:33624) 2023-12-12T10:13:36.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.672+0000 7f6529d0e640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f65240cc370 0x7f65241410c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:36.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.672+0000 7f652a50f640 1 -- 172.21.15.78:0/644767919 learned_addr learned my addr 172.21.15.78:0/644767919 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:13:36.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.672+0000 7f652950d640 1 --2- 172.21.15.78:0/644767919 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f652415d080 0x7f65241527d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:36.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.672+0000 7f652a50f640 1 -- 172.21.15.78:0/644767919 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f65240cc370 msgr2=0x7f65241410c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:36.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.672+0000 7f652a50f640 1 --2- 172.21.15.78:0/644767919 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f65240cc370 0x7f65241410c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:36.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.672+0000 7f652a50f640 1 -- 172.21.15.78:0/644767919 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f652415d080 msgr2=0x7f65241527d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:36.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.672+0000 7f652a50f640 1 --2- 172.21.15.78:0/644767919 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f652415d080 0x7f65241527d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:36.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.672+0000 7f652a50f640 1 -- 172.21.15.78:0/644767919 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65200094d0 con 0x7f6524160da0 2023-12-12T10:13:36.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.672+0000 7f652a50f640 1 --2- 172.21.15.78:0/644767919 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6524160da0 0x7f6524152d10 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f651c00cc30 tx=0x7f651c00a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:36.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.672+0000 7f651a7fc640 1 -- 172.21.15.78:0/644767919 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f651c00ce40 con 0x7f6524160da0 2023-12-12T10:13:36.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.672+0000 7f651a7fc640 1 -- 172.21.15.78:0/644767919 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f651c0039a0 con 0x7f6524160da0 2023-12-12T10:13:36.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.672+0000 7f652bf72640 1 -- 172.21.15.78:0/644767919 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65241551e0 con 0x7f6524160da0 2023-12-12T10:13:36.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.672+0000 7f651a7fc640 1 -- 172.21.15.78:0/644767919 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f651c003d30 con 0x7f6524160da0 2023-12-12T10:13:36.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.672+0000 7f652bf72640 1 -- 172.21.15.78:0/644767919 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6524141600 con 0x7f6524160da0 2023-12-12T10:13:36.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.672+0000 7f652bf72640 1 -- 172.21.15.78:0/644767919 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6524155700 con 0x7f6524160da0 2023-12-12T10:13:36.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.676+0000 7f651a7fc640 1 -- 172.21.15.78:0/644767919 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f651c003e90 con 0x7f6524160da0 2023-12-12T10:13:36.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.676+0000 7f651a7fc640 1 --2- 172.21.15.78:0/644767919 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f6508066470 0x7f6508068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:36.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.676+0000 7f651a7fc640 1 -- 172.21.15.78:0/644767919 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f651c0842f0 con 0x7f6524160da0 2023-12-12T10:13:36.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.676+0000 7f6529d0e640 1 --2- 172.21.15.78:0/644767919 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f6508066470 0x7f6508068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:36.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.676+0000 7f6529d0e640 1 --2- 172.21.15.78:0/644767919 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f6508066470 0x7f6508068930 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f65200ae000 tx=0x7f6520009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:36.684 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.680+0000 7f651a7fc640 1 -- 172.21.15.78:0/644767919 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6524155700 con 0x7f6524160da0 2023-12-12T10:13:36.886 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.880+0000 7f652bf72640 1 -- 172.21.15.78:0/644767919 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f6524155700 con 0x7f6524160da0 2023-12-12T10:13:36.891 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.884+0000 7f651a7fc640 1 -- 172.21.15.78:0/644767919 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 190+0+147 (secure 0 0 0) 0x7f6524155700 con 0x7f6524160da0 2023-12-12T10:13:36.891 INFO:teuthology.orchestra.run.smithi078.stdout:[client.0] 2023-12-12T10:13:36.891 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQC9MXhlbW+PKhAAckuiPNqUk5U7bz+jhw/xLA== 2023-12-12T10:13:36.891 INFO:teuthology.orchestra.run.smithi078.stdout: caps mds = "allow" 2023-12-12T10:13:36.892 INFO:teuthology.orchestra.run.smithi078.stdout: caps mon = "allow r" 2023-12-12T10:13:36.892 INFO:teuthology.orchestra.run.smithi078.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-12-12T10:13:36.892 INFO:teuthology.orchestra.run.smithi078.stderr:updated caps for client.0 2023-12-12T10:13:36.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.884+0000 7f652bf72640 1 -- 172.21.15.78:0/644767919 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f6508066470 msgr2=0x7f6508068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:36.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.884+0000 7f652bf72640 1 --2- 172.21.15.78:0/644767919 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f6508066470 0x7f6508068930 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f65200ae000 tx=0x7f6520009040 comp rx=0 tx=0).stop 2023-12-12T10:13:36.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.884+0000 7f652bf72640 1 -- 172.21.15.78:0/644767919 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6524160da0 msgr2=0x7f6524152d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:36.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.884+0000 7f652bf72640 1 --2- 172.21.15.78:0/644767919 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6524160da0 0x7f6524152d10 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f651c00cc30 tx=0x7f651c00a5c0 comp rx=0 tx=0).stop 2023-12-12T10:13:36.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.888+0000 7f652bf72640 1 -- 172.21.15.78:0/644767919 shutdown_connections 2023-12-12T10:13:36.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.888+0000 7f652bf72640 1 --2- 172.21.15.78:0/644767919 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f6508066470 0x7f6508068930 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:36.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.888+0000 7f652bf72640 1 --2- 172.21.15.78:0/644767919 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6524160da0 0x7f6524152d10 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:36.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.888+0000 7f652bf72640 1 --2- 172.21.15.78:0/644767919 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f652415d080 0x7f65241527d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:36.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.888+0000 7f652bf72640 1 --2- 172.21.15.78:0/644767919 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f65240cc370 0x7f65241410c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:36.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.888+0000 7f652bf72640 1 -- 172.21.15.78:0/644767919 >> 172.21.15.78:0/644767919 conn(0x7f65240b1650 msgr2=0x7f6524167700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:36.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.888+0000 7f652bf72640 1 -- 172.21.15.78:0/644767919 shutdown_connections 2023-12-12T10:13:36.893 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:36.888+0000 7f652bf72640 1 -- 172.21.15.78:0/644767919 wait complete. 2023-12-12T10:13:36.911 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-12T10:13:37.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.044+0000 7f5fb689c640 1 Processor -- start 2023-12-12T10:13:37.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.044+0000 7f5fb689c640 1 -- start start 2023-12-12T10:13:37.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.044+0000 7f5fb689c640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5fb00d3b10 0x7f5fb00d15a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:37.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.044+0000 7f5fb689c640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f5fb00d1ae0 0x7f5fb00b36e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:37.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.044+0000 7f5fb689c640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fb00b3250 con 0x7f5fb015d3c0 2023-12-12T10:13:37.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.044+0000 7f5fb689c640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fb00d1f70 con 0x7f5fb00d1ae0 2023-12-12T10:13:37.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.044+0000 7f5fb689c640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb00cee50 con 0x7f5fb00d3b10 2023-12-12T10:13:37.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.044+0000 7f5fb4e39640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f5fb00d1ae0 0x7f5fb00b36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:37.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.044+0000 7f5fb4e39640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f5fb00d1ae0 0x7f5fb00b36e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33628/0 (socket says 172.21.15.78:33628) 2023-12-12T10:13:37.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.044+0000 7f5fb4e39640 1 -- 172.21.15.78:0/488211148 learned_addr learned my addr 172.21.15.78:0/488211148 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:13:37.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.044+0000 7f5faf7fe640 1 --2- 172.21.15.78:0/488211148 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5fb00d3b10 0x7f5fb00d15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:37.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.044+0000 7f5fb4e39640 1 -- 172.21.15.78:0/488211148 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5fb00d3b10 msgr2=0x7f5fb00d15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:13:37.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.044+0000 7f5fb4e39640 1 --2- 172.21.15.78:0/488211148 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5fb00d3b10 0x7f5fb00d15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:37.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.044+0000 7f5fb4e39640 1 -- 172.21.15.78:0/488211148 >> v1:172.21.15.187:6789/0 conn(0x7f5fb015d3c0 legacy=0x7f5fb00ce670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:37.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.044+0000 7f5fb4e39640 1 -- 172.21.15.78:0/488211148 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fb00b2920 con 0x7f5fb00d1ae0 2023-12-12T10:13:37.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.044+0000 7f5faf7fe640 1 --2- 172.21.15.78:0/488211148 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5fb00d3b10 0x7f5fb00d15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T10:13:37.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.048+0000 7f5fb4e39640 1 --2- 172.21.15.78:0/488211148 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5fb00d1ae0 0x7f5fb00b36e0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f5fa8009e50 tx=0x7f5fa801f1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23f91ba05f258472 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:37.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.048+0000 7f5faeffd640 1 -- 172.21.15.78:0/488211148 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fa80af400 con 0x7f5fb00d1ae0 2023-12-12T10:13:37.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.048+0000 7f5faeffd640 1 -- 172.21.15.78:0/488211148 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fa80ab050 con 0x7f5fb00d1ae0 2023-12-12T10:13:37.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.048+0000 7f5faeffd640 1 -- 172.21.15.78:0/488211148 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fa80af780 con 0x7f5fb00d1ae0 2023-12-12T10:13:37.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.048+0000 7f5fb689c640 1 -- 172.21.15.78:0/488211148 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5fb00d1ae0 msgr2=0x7f5fb00b36e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:37.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.048+0000 7f5fb689c640 1 --2- 172.21.15.78:0/488211148 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5fb00d1ae0 0x7f5fb00b36e0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f5fa8009e50 tx=0x7f5fa801f1f0 comp rx=0 tx=0).stop 2023-12-12T10:13:37.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.048+0000 7f5fb689c640 1 -- 172.21.15.78:0/488211148 shutdown_connections 2023-12-12T10:13:37.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.048+0000 7f5fb689c640 1 --2- 172.21.15.78:0/488211148 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5fb00d1ae0 0x7f5fb00b36e0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:37.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.048+0000 7f5fb689c640 1 --2- 172.21.15.78:0/488211148 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5fb00d3b10 0x7f5fb00d15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:37.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.048+0000 7f5fb689c640 1 -- 172.21.15.78:0/488211148 >> 172.21.15.78:0/488211148 conn(0x7f5fb009c2a0 msgr2=0x7f5fb00d2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:37.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.048+0000 7f5fb689c640 1 -- 172.21.15.78:0/488211148 shutdown_connections 2023-12-12T10:13:37.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.048+0000 7f5fb689c640 1 -- 172.21.15.78:0/488211148 wait complete. 2023-12-12T10:13:37.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.052+0000 7f5fb689c640 1 Processor -- start 2023-12-12T10:13:37.057 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.052+0000 7f5fb689c640 1 -- start start 2023-12-12T10:13:37.059 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.052+0000 7f5fb689c640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5fb00d1ae0 0x7f5fb00b7600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:37.059 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.052+0000 7f5fb689c640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5fb00d3b10 0x7f5fb00b7b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:37.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.052+0000 7f5fb689c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5fb015d3c0 0x7f5fb00b5be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:37.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.052+0000 7f5fb689c640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb00cae60 con 0x7f5fb015d3c0 2023-12-12T10:13:37.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.052+0000 7f5fb689c640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb00cb140 con 0x7f5fb00d1ae0 2023-12-12T10:13:37.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.052+0000 7f5fb689c640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb00cb420 con 0x7f5fb00d3b10 2023-12-12T10:13:37.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.052+0000 7f5fb4e39640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5fb015d3c0 0x7f5fb00b5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:37.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.052+0000 7f5fb4e39640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5fb015d3c0 0x7f5fb00b5be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33642/0 (socket says 172.21.15.78:33642) 2023-12-12T10:13:37.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.052+0000 7f5fb4e39640 1 -- 172.21.15.78:0/2159768211 learned_addr learned my addr 172.21.15.78:0/2159768211 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:13:37.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.052+0000 7f5faffff640 1 --2- 172.21.15.78:0/2159768211 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5fb00d1ae0 0x7f5fb00b7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:37.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.052+0000 7f5fb4e39640 1 -- 172.21.15.78:0/2159768211 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5fb00d3b10 msgr2=0x7f5fb00b7b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:37.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.052+0000 7f5faf7fe640 1 --2- 172.21.15.78:0/2159768211 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5fb00d3b10 0x7f5fb00b7b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:37.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.052+0000 7f5fb4e39640 1 --2- 172.21.15.78:0/2159768211 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5fb00d3b10 0x7f5fb00b7b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:37.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.052+0000 7f5fb4e39640 1 -- 172.21.15.78:0/2159768211 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5fb00d1ae0 msgr2=0x7f5fb00b7600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:37.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.052+0000 7f5fb4e39640 1 --2- 172.21.15.78:0/2159768211 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5fb00d1ae0 0x7f5fb00b7600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:37.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.052+0000 7f5fb4e39640 1 -- 172.21.15.78:0/2159768211 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fa8009b30 con 0x7f5fb015d3c0 2023-12-12T10:13:37.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.052+0000 7f5faffff640 1 --2- 172.21.15.78:0/2159768211 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5fb00d1ae0 0x7f5fb00b7600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T10:13:37.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.052+0000 7f5fb4e39640 1 --2- 172.21.15.78:0/2159768211 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5fb015d3c0 0x7f5fb00b5be0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f5fa801ce20 tx=0x7f5fa801bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:37.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.052+0000 7f5facff9640 1 -- 172.21.15.78:0/2159768211 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fa80afde0 con 0x7f5fb015d3c0 2023-12-12T10:13:37.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.056+0000 7f5facff9640 1 -- 172.21.15.78:0/2159768211 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fa8009510 con 0x7f5fb015d3c0 2023-12-12T10:13:37.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.056+0000 7f5facff9640 1 -- 172.21.15.78:0/2159768211 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fa80ba660 con 0x7f5fb015d3c0 2023-12-12T10:13:37.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.056+0000 7f5fb689c640 1 -- 172.21.15.78:0/2159768211 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fb00cb700 con 0x7f5fb015d3c0 2023-12-12T10:13:37.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.056+0000 7f5fb689c640 1 -- 172.21.15.78:0/2159768211 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fb00caaa0 con 0x7f5fb015d3c0 2023-12-12T10:13:37.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.056+0000 7f5fb689c640 1 -- 172.21.15.78:0/2159768211 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fb00cbbb0 con 0x7f5fb015d3c0 2023-12-12T10:13:37.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.056+0000 7f5facff9640 1 -- 172.21.15.78:0/2159768211 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5fa80b6040 con 0x7f5fb015d3c0 2023-12-12T10:13:37.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.056+0000 7f5facff9640 1 --2- 172.21.15.78:0/2159768211 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f5f9c066470 0x7f5f9c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:37.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.056+0000 7f5facff9640 1 -- 172.21.15.78:0/2159768211 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f5fa81222c0 con 0x7f5fb015d3c0 2023-12-12T10:13:37.062 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.056+0000 7f5faffff640 1 --2- 172.21.15.78:0/2159768211 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f5f9c066470 0x7f5f9c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:37.063 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.056+0000 7f5faffff640 1 --2- 172.21.15.78:0/2159768211 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f5f9c066470 0x7f5f9c068930 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f5fa0000f70 tx=0x7f5fa0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:37.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.060+0000 7f5facff9640 1 -- 172.21.15.78:0/2159768211 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5fb00cbbb0 con 0x7f5fb015d3c0 2023-12-12T10:13:37.201 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T10:13:37.207 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T10:13:37.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.244+0000 7f5fb689c640 1 -- 172.21.15.78:0/2159768211 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5fb00cbbb0 con 0x7f5fb015d3c0 2023-12-12T10:13:37.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.248+0000 7f5facff9640 1 -- 172.21.15.78:0/2159768211 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4913 (secure 0 0 0) 0x7f5fb00cbbb0 con 0x7f5fb015d3c0 2023-12-12T10:13:37.252 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:13:37.252 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5024,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/142991070","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":142991070},{"type":"v1","addr":"172.21.15.187:6835","nonce":142991070}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5374,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/1159092364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":1159092364},{"type":"v1","addr":"172.21.15.187:6834","nonce":1159092364}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5469,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6836/314422656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":314422656},{"type":"v1","addr":"172.21.15.78:6836","nonce":314422656}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-12T10:13:31.320201+0000","modified":"2023-12-12T10:13:34.407772+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5472":{"gid":5472,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.78:6837/4134128104","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":4134128104},{"type":"v1","addr":"172.21.15.78:6837","nonce":4134128104}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-12T10:13:37.252 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 17 2023-12-12T10:13:37.253 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.248+0000 7f5fb689c640 1 -- 172.21.15.78:0/2159768211 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f5f9c066470 msgr2=0x7f5f9c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:37.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.248+0000 7f5fb689c640 1 --2- 172.21.15.78:0/2159768211 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f5f9c066470 0x7f5f9c068930 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f5fa0000f70 tx=0x7f5fa0009040 comp rx=0 tx=0).stop 2023-12-12T10:13:37.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.248+0000 7f5fb689c640 1 -- 172.21.15.78:0/2159768211 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5fb015d3c0 msgr2=0x7f5fb00b5be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:37.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.248+0000 7f5fb689c640 1 --2- 172.21.15.78:0/2159768211 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5fb015d3c0 0x7f5fb00b5be0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f5fa801ce20 tx=0x7f5fa801bf90 comp rx=0 tx=0).stop 2023-12-12T10:13:37.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.248+0000 7f5fb689c640 1 -- 172.21.15.78:0/2159768211 shutdown_connections 2023-12-12T10:13:37.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.248+0000 7f5fb689c640 1 --2- 172.21.15.78:0/2159768211 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f5f9c066470 0x7f5f9c068930 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:37.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.248+0000 7f5fb689c640 1 --2- 172.21.15.78:0/2159768211 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5fb015d3c0 0x7f5fb00b5be0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:37.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.248+0000 7f5fb689c640 1 --2- 172.21.15.78:0/2159768211 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5fb00d3b10 0x7f5fb00b7b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:37.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.248+0000 7f5fb689c640 1 --2- 172.21.15.78:0/2159768211 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5fb00d1ae0 0x7f5fb00b7600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:37.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.248+0000 7f5fb689c640 1 -- 172.21.15.78:0/2159768211 >> 172.21.15.78:0/2159768211 conn(0x7f5fb009c2a0 msgr2=0x7f5fb00d2f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:37.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.248+0000 7f5fb689c640 1 -- 172.21.15.78:0/2159768211 shutdown_connections 2023-12-12T10:13:37.254 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.248+0000 7f5fb689c640 1 -- 172.21.15.78:0/2159768211 wait complete. 2023-12-12T10:13:37.675 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-12T10:13:31.320201+0000', 'modified': '2023-12-12T10:13:34.407772+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5472}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5472': {'gid': 5472, 'name': 'a', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.78:6837/4134128104', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.78:6835', 'nonce': 4134128104}, {'type': 'v1', 'addr': '172.21.15.78:6837', 'nonce': 4134128104}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-12T10:13:37.675 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-12T10:13:37.676 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-12-12T10:13:37.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.808+0000 7f404bc9c640 1 Processor -- start 2023-12-12T10:13:37.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.812+0000 7f404bc9c640 1 -- start start 2023-12-12T10:13:37.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.812+0000 7f404bc9c640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4044071610 0x7f4044164ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:37.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.812+0000 7f404bc9c640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4044070a70 con 0x7f40440cdf60 2023-12-12T10:13:37.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.812+0000 7f404bc9c640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40440ce3c0 con 0x7f4044143770 2023-12-12T10:13:37.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.812+0000 7f404bc9c640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f404415e920 con 0x7f4044071610 2023-12-12T10:13:37.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.812+0000 7f4049237640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f40440cdf60 0x7f4044070f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:33470/0 (socket says 172.21.15.78:33470) 2023-12-12T10:13:37.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.812+0000 7f4049237640 1 -- 172.21.15.78:0/4224321194 learned_addr learned my addr 172.21.15.78:0/4224321194 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-12-12T10:13:37.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.812+0000 7f404a239640 1 --2- 172.21.15.78:0/4224321194 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4044071610 0x7f4044164ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:37.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.812+0000 7f4048a36640 1 -- 172.21.15.78:0/4224321194 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4242653964 0 0) 0x7f4044070a70 con 0x7f40440cdf60 2023-12-12T10:13:37.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.812+0000 7f4048a36640 1 -- 172.21.15.78:0/4224321194 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4030003530 con 0x7f40440cdf60 2023-12-12T10:13:37.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.812+0000 7f4048a36640 1 -- 172.21.15.78:0/4224321194 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3413254870 0 0) 0x7f40440ce3c0 con 0x7f4044143770 2023-12-12T10:13:37.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.812+0000 7f4048a36640 1 -- 172.21.15.78:0/4224321194 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4044070a70 con 0x7f4044143770 2023-12-12T10:13:37.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.812+0000 7f4048a36640 1 -- 172.21.15.78:0/4224321194 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 585389741 0 0) 0x7f4030003530 con 0x7f40440cdf60 2023-12-12T10:13:37.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.812+0000 7f4048a36640 1 -- 172.21.15.78:0/4224321194 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4044071610 msgr2=0x7f4044164ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:13:37.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.812+0000 7f4048a36640 1 --2- 172.21.15.78:0/4224321194 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4044071610 0x7f4044164ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:37.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.812+0000 7f4048a36640 1 -- 172.21.15.78:0/4224321194 >> v1:172.21.15.187:6789/0 conn(0x7f4044143770 legacy=0x7f40440b1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:37.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.812+0000 7f4048a36640 1 -- 172.21.15.78:0/4224321194 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4044070440 con 0x7f40440cdf60 2023-12-12T10:13:37.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.812+0000 7f4048a36640 1 -- 172.21.15.78:0/4224321194 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 465499599 0 0) 0x7f4034001680 con 0x7f40440cdf60 2023-12-12T10:13:37.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.812+0000 7f4048a36640 1 -- 172.21.15.78:0/4224321194 >> v1:172.21.15.78:6789/0 conn(0x7f40440cdf60 legacy=0x7f4044070f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:37.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.812+0000 7f4048a36640 1 --2- 172.21.15.78:0/4224321194 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4030003b40 0x7f4030003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:37.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.812+0000 7f4048a36640 1 --2- 172.21.15.78:0/4224321194 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4044071610 0x7f40300047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:37.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.812+0000 7f4048a36640 1 --2- 172.21.15.78:0/4224321194 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4030004d10 0x7f4030005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:37.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.812+0000 7f4048a36640 1 -- 172.21.15.78:0/4224321194 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f404415e920 con 0x7f4030003b40 2023-12-12T10:13:37.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.812+0000 7f4048a36640 1 -- 172.21.15.78:0/4224321194 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f403000dca0 con 0x7f4030004d10 2023-12-12T10:13:37.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.812+0000 7f4048a36640 1 -- 172.21.15.78:0/4224321194 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f403000de60 con 0x7f4044071610 2023-12-12T10:13:37.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.812+0000 7f4049a38640 1 --2- 172.21.15.78:0/4224321194 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4030003b40 0x7f4030003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:37.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.812+0000 7f4049237640 1 --2- 172.21.15.78:0/4224321194 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4044071610 0x7f40300047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:37.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.812+0000 7f404a239640 1 --2- 172.21.15.78:0/4224321194 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4030004d10 0x7f4030005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:37.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.812+0000 7f4049a38640 1 -- 172.21.15.78:0/4224321194 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4044071610 msgr2=0x7f40300047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:13:37.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.812+0000 7f4049a38640 1 --2- 172.21.15.78:0/4224321194 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4044071610 0x7f40300047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:37.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.812+0000 7f4049a38640 1 -- 172.21.15.78:0/4224321194 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4030004d10 msgr2=0x7f4030005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:13:37.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.812+0000 7f4049a38640 1 --2- 172.21.15.78:0/4224321194 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4030004d10 0x7f4030005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:37.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.812+0000 7f4049a38640 1 -- 172.21.15.78:0/4224321194 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4030003530 con 0x7f4030003b40 2023-12-12T10:13:37.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.816+0000 7f4049a38640 1 --2- 172.21.15.78:0/4224321194 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4030003b40 0x7f4030003f40 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f40440ce550 tx=0x7f404001c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ba58d17750f965e server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:37.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.816+0000 7f4048a36640 1 -- 172.21.15.78:0/4224321194 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40400052d0 con 0x7f4030003b40 2023-12-12T10:13:37.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.816+0000 7f4048a36640 1 -- 172.21.15.78:0/4224321194 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4040005430 con 0x7f4030003b40 2023-12-12T10:13:37.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.816+0000 7f4048a36640 1 -- 172.21.15.78:0/4224321194 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4040003800 con 0x7f4030003b40 2023-12-12T10:13:37.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.816+0000 7f404bc9c640 1 -- 172.21.15.78:0/4224321194 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4030003b40 msgr2=0x7f4030003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:37.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.816+0000 7f404bc9c640 1 --2- 172.21.15.78:0/4224321194 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4030003b40 0x7f4030003f40 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f40440ce550 tx=0x7f404001c540 comp rx=0 tx=0).stop 2023-12-12T10:13:37.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.816+0000 7f404a239640 1 -- 172.21.15.78:0/4224321194 reap_dead start 2023-12-12T10:13:37.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.816+0000 7f404bc9c640 1 -- 172.21.15.78:0/4224321194 shutdown_connections 2023-12-12T10:13:37.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.816+0000 7f404bc9c640 1 -- 172.21.15.78:0/4224321194 >> 172.21.15.78:0/4224321194 conn(0x7f404406a710 msgr2=0x7f404406ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:37.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.816+0000 7f404bc9c640 1 -- 172.21.15.78:0/4224321194 shutdown_connections 2023-12-12T10:13:37.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.816+0000 7f404bc9c640 1 -- 172.21.15.78:0/4224321194 wait complete. 2023-12-12T10:13:37.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.820+0000 7f404bc9c640 1 Processor -- start 2023-12-12T10:13:37.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.820+0000 7f404bc9c640 1 -- start start 2023-12-12T10:13:37.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.820+0000 7f404bc9c640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4030003b40 0x7f4044159930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:37.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.820+0000 7f404bc9c640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4044140d80 0x7f40441411e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:37.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.820+0000 7f404bc9c640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f404415c5c0 0x7f404415ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:37.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.820+0000 7f404bc9c640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f404415d2f0 con 0x7f4030003b40 2023-12-12T10:13:37.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.820+0000 7f404bc9c640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4044141720 con 0x7f4044140d80 2023-12-12T10:13:37.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.820+0000 7f404bc9c640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40441f92c0 con 0x7f404415c5c0 2023-12-12T10:13:37.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.820+0000 7f4049a38640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4030003b40 0x7f4044159930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:37.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.820+0000 7f4049a38640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4030003b40 0x7f4044159930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33662/0 (socket says 172.21.15.78:33662) 2023-12-12T10:13:37.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.820+0000 7f4049a38640 1 -- 172.21.15.78:0/3346724869 learned_addr learned my addr 172.21.15.78:0/3346724869 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:13:37.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.820+0000 7f4049237640 1 --2- 172.21.15.78:0/3346724869 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4044140d80 0x7f40441411e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:37.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.820+0000 7f404a239640 1 --2- 172.21.15.78:0/3346724869 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f404415c5c0 0x7f404415ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:37.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.820+0000 7f4049a38640 1 -- 172.21.15.78:0/3346724869 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f404415c5c0 msgr2=0x7f404415ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:37.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.820+0000 7f4049a38640 1 --2- 172.21.15.78:0/3346724869 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f404415c5c0 0x7f404415ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:37.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.820+0000 7f4049a38640 1 -- 172.21.15.78:0/3346724869 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4044140d80 msgr2=0x7f40441411e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:37.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.820+0000 7f4049a38640 1 --2- 172.21.15.78:0/3346724869 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4044140d80 0x7f40441411e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:37.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.820+0000 7f4049a38640 1 -- 172.21.15.78:0/3346724869 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40441f95a0 con 0x7f4030003b40 2023-12-12T10:13:37.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.820+0000 7f4049a38640 1 --2- 172.21.15.78:0/3346724869 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4030003b40 0x7f4044159930 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f4040005040 tx=0x7f4030005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:37.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.820+0000 7f403a7fc640 1 -- 172.21.15.78:0/3346724869 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4040007a60 con 0x7f4030003b40 2023-12-12T10:13:37.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.820+0000 7f403a7fc640 1 -- 172.21.15.78:0/3346724869 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40400050d0 con 0x7f4030003b40 2023-12-12T10:13:37.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.820+0000 7f403a7fc640 1 -- 172.21.15.78:0/3346724869 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4040007260 con 0x7f4030003b40 2023-12-12T10:13:37.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.820+0000 7f404bc9c640 1 -- 172.21.15.78:0/3346724869 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40441f9880 con 0x7f4030003b40 2023-12-12T10:13:37.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.820+0000 7f404bc9c640 1 -- 172.21.15.78:0/3346724869 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f404415cfb0 con 0x7f4030003b40 2023-12-12T10:13:37.828 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.824+0000 7f403a7fc640 1 -- 172.21.15.78:0/3346724869 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f40400073c0 con 0x7f4030003b40 2023-12-12T10:13:37.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.824+0000 7f403a7fc640 1 --2- 172.21.15.78:0/3346724869 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f40280664a0 0x7f4028068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:37.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.824+0000 7f403a7fc640 1 -- 172.21.15.78:0/3346724869 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f404011d600 con 0x7f4030003b40 2023-12-12T10:13:37.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.824+0000 7f4049237640 1 --2- 172.21.15.78:0/3346724869 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f40280664a0 0x7f4028068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:37.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.824+0000 7f404f016000 1 Processor -- start 2023-12-12T10:13:37.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.824+0000 7f404f016000 1 -- start start 2023-12-12T10:13:37.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.824+0000 7f4049237640 1 --2- 172.21.15.78:0/3346724869 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f40280664a0 0x7f4028068960 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f4044142530 tx=0x7f4034007040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:37.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.824+0000 7f404f016000 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5558163756b0 0x555816375a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:37.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.824+0000 7f404f016000 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555816375fd0 0x555816328b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:37.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.824+0000 7f404f016000 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555816329050 0x555816329430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:37.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.824+0000 7f404f016000 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x555816195250 con 0x555816375fd0 2023-12-12T10:13:37.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.824+0000 7f404f016000 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x555816182d60 con 0x555816329050 2023-12-12T10:13:37.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.824+0000 7f404f016000 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x555816180290 con 0x5558163756b0 2023-12-12T10:13:37.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.824+0000 7f4049237640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555816375fd0 0x555816328b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:37.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.824+0000 7f4049237640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555816375fd0 0x555816328b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33668/0 (socket says 172.21.15.78:33668) 2023-12-12T10:13:37.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.824+0000 7f4049237640 1 -- 172.21.15.78:0/2896891117 learned_addr learned my addr 172.21.15.78:0/2896891117 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:13:37.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.828+0000 7f4049a38640 1 --2- 172.21.15.78:0/2896891117 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5558163756b0 0x555816375a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:37.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.828+0000 7f404a239640 1 --2- 172.21.15.78:0/2896891117 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555816329050 0x555816329430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:37.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.828+0000 7f4049237640 1 -- 172.21.15.78:0/2896891117 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5558163756b0 msgr2=0x555816375a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:13:37.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.828+0000 7f4049237640 1 --2- 172.21.15.78:0/2896891117 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5558163756b0 0x555816375a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:37.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.828+0000 7f4049237640 1 -- 172.21.15.78:0/2896891117 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555816329050 msgr2=0x555816329430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:13:37.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.828+0000 7f4049237640 1 --2- 172.21.15.78:0/2896891117 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555816329050 0x555816329430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:37.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.828+0000 7f4049237640 1 -- 172.21.15.78:0/2896891117 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555815e73890 con 0x555816375fd0 2023-12-12T10:13:37.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.828+0000 7f404a239640 1 --2- 172.21.15.78:0/2896891117 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555816329050 0x555816329430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T10:13:37.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.828+0000 7f4049237640 1 --2- 172.21.15.78:0/2896891117 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555816375fd0 0x555816328b10 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f4034011c40 tx=0x7f4034014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=646917c5cd8c9ed4 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:37.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.828+0000 7f40277fe640 1 -- 172.21.15.78:0/2896891117 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4034005260 con 0x555816375fd0 2023-12-12T10:13:37.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.828+0000 7f40277fe640 1 -- 172.21.15.78:0/2896891117 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40340053c0 con 0x555816375fd0 2023-12-12T10:13:37.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.828+0000 7f40277fe640 1 -- 172.21.15.78:0/2896891117 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4034005750 con 0x555816375fd0 2023-12-12T10:13:37.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.828+0000 7f404f016000 1 -- 172.21.15.78:0/2896891117 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555816375fd0 msgr2=0x555816328b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:37.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.828+0000 7f404f016000 1 --2- 172.21.15.78:0/2896891117 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555816375fd0 0x555816328b10 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f4034011c40 tx=0x7f4034014000 comp rx=0 tx=0).stop 2023-12-12T10:13:37.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.828+0000 7f404f016000 1 -- 172.21.15.78:0/2896891117 shutdown_connections 2023-12-12T10:13:37.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.828+0000 7f404f016000 1 --2- 172.21.15.78:0/2896891117 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555816329050 0x555816329430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:37.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.828+0000 7f404f016000 1 --2- 172.21.15.78:0/2896891117 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555816375fd0 0x555816328b10 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:37.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.828+0000 7f404f016000 1 --2- 172.21.15.78:0/2896891117 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5558163756b0 0x555816375a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:37.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.828+0000 7f404f016000 1 -- 172.21.15.78:0/2896891117 >> 172.21.15.78:0/2896891117 conn(0x555816356240 msgr2=0x555816358630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:37.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.828+0000 7f404f016000 1 -- 172.21.15.78:0/2896891117 shutdown_connections 2023-12-12T10:13:37.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.828+0000 7f404f016000 1 -- 172.21.15.78:0/2896891117 wait complete. 2023-12-12T10:13:37.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.828+0000 7f404f016000 1 -- start start 2023-12-12T10:13:37.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.828+0000 7f404f016000 1 Processor -- start 2023-12-12T10:13:37.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.828+0000 7f404f016000 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555816329050 0x55581632f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:37.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.828+0000 7f404f016000 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5558163756b0 0x55581632f620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:37.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.828+0000 7f404f016000 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555816375fd0 0x55581632fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:37.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.828+0000 7f404f016000 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x55581617bb80 con 0x555816375fd0 2023-12-12T10:13:37.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.828+0000 7f404f016000 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x555816133bf0 con 0x555816329050 2023-12-12T10:13:37.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.828+0000 7f404f016000 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x555816139a90 con 0x5558163756b0 2023-12-12T10:13:37.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.828+0000 7f404f016000 10 client.0 _ll_register_callbacks cb 0x555816316970 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-12T10:13:37.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.828+0000 7f404a239640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555816375fd0 0x55581632fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:37.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.828+0000 7f404a239640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555816375fd0 0x55581632fb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33684/0 (socket says 172.21.15.78:33684) 2023-12-12T10:13:37.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.828+0000 7f404a239640 1 -- 172.21.15.78:0/1722911980 learned_addr learned my addr 172.21.15.78:0/1722911980 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:13:37.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.832+0000 7f4049237640 1 --2- 172.21.15.78:0/1722911980 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5558163756b0 0x55581632f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:37.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.832+0000 7f4049a38640 1 --2- 172.21.15.78:0/1722911980 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555816329050 0x55581632f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:37.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.832+0000 7f404a239640 1 -- 172.21.15.78:0/1722911980 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5558163756b0 msgr2=0x55581632f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:13:37.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.832+0000 7f404a239640 1 --2- 172.21.15.78:0/1722911980 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5558163756b0 0x55581632f620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:37.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.832+0000 7f404a239640 1 -- 172.21.15.78:0/1722911980 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555816329050 msgr2=0x55581632f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:13:37.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.832+0000 7f404a239640 1 --2- 172.21.15.78:0/1722911980 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555816329050 0x55581632f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:37.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.832+0000 7f404a239640 1 -- 172.21.15.78:0/1722911980 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f403400f040 con 0x555816375fd0 2023-12-12T10:13:37.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.832+0000 7f4049a38640 1 --2- 172.21.15.78:0/1722911980 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555816329050 0x55581632f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T10:13:37.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.832+0000 7f404a239640 1 --2- 172.21.15.78:0/1722911980 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555816375fd0 0x55581632fb60 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f404406cb50 tx=0x7f403c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e07dbef33d38f60 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:37.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.832+0000 7f4024ff9640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2023-12-12T10:13:37.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.832+0000 7f4024ff9640 1 -- 172.21.15.78:0/1722911980 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f403c00e030 con 0x555816375fd0 2023-12-12T10:13:37.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.832+0000 7f4024ff9640 1 -- 172.21.15.78:0/1722911980 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f403c007a70 con 0x555816375fd0 2023-12-12T10:13:37.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.832+0000 7f404f016000 1 -- 172.21.15.78:0/1722911980 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555816139420 con 0x555816375fd0 2023-12-12T10:13:37.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.832+0000 7f4024ff9640 1 -- 172.21.15.78:0/1722911980 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f403c007c30 con 0x555816375fd0 2023-12-12T10:13:37.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.832+0000 7f404f016000 10 client.5658 fetch_fsmap learned FSMap version 17 2023-12-12T10:13:37.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.832+0000 7f404f016000 1 -- 172.21.15.78:0/1722911980 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55581613c190 con 0x555816375fd0 2023-12-12T10:13:37.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.832+0000 7f4024ff9640 1 -- 172.21.15.78:0/1722911980 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555816139420 con 0x555816375fd0 2023-12-12T10:13:37.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.832+0000 7f4024ff9640 1 -- 172.21.15.78:0/1722911980 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 17) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f403c018450 con 0x555816375fd0 2023-12-12T10:13:37.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.832+0000 7f404f016000 10 client.5658 fetch_fsmap finished waiting for FSMap version 17 2023-12-12T10:13:37.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.832+0000 7f404f016000 10 client.5658 resolve_mds: resolved name 'a' to daemon mds.a 2023-12-12T10:13:37.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.832+0000 7f404f016000 20 client.5658 populate_metadata read hostname 'smithi078' 2023-12-12T10:13:37.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.832+0000 7f404f016000 1 --2- 172.21.15.78:0/1722911980 >> [v2:172.21.15.78:6835/4134128104,v1:172.21.15.78:6837/4134128104] conn(0x555816330570 0x555816387970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:37.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.832+0000 7f404f016000 4 client.5658 mds_command: new command op to 5472 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-12T10:13:37.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.832+0000 7f404f016000 1 -- 172.21.15.78:0/1722911980 --> [v2:172.21.15.78:6835/4134128104,v1:172.21.15.78:6837/4134128104] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55581617a4d0 con 0x555816330570 2023-12-12T10:13:37.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.832+0000 7f4049a38640 1 --2- 172.21.15.78:0/1722911980 >> [v2:172.21.15.78:6835/4134128104,v1:172.21.15.78:6837/4134128104] conn(0x555816330570 0x555816387970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:37.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.832+0000 7f4049a38640 1 --2- 172.21.15.78:0/1722911980 >> [v2:172.21.15.78:6835/4134128104,v1:172.21.15.78:6837/4134128104] conn(0x555816330570 0x555816387970 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e7d88d66d50256 server_cookie=d0de598ea81d356d in_seq=0 out_seq=0 2023-12-12T10:13:37.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.832+0000 7f4024ff9640 10 client.5658 ms_handle_connect on v2:172.21.15.78:6835/4134128104 2023-12-12T10:13:37.841 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.832+0000 7f4024ff9640 1 -- 172.21.15.78:0/1722911980 <== mds.0 v2:172.21.15.78:6835/4134128104 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55581617a4d0 con 0x555816330570 2023-12-12T10:13:37.841 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.832+0000 7f4024ff9640 10 client.5658 handle_command_reply: tid=0 2023-12-12T10:13:37.841 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.832+0000 7f404f016000 1 client.5658 shutdown 2023-12-12T10:13:37.841 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.832+0000 7f404f016000 1 -- 172.21.15.78:0/1722911980 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555816375fd0 msgr2=0x55581632fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:37.841 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.832+0000 7f404f016000 1 --2- 172.21.15.78:0/1722911980 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555816375fd0 0x55581632fb60 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f404406cb50 tx=0x7f403c004750 comp rx=0 tx=0).stop 2023-12-12T10:13:37.842 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.832+0000 7f404f016000 1 -- 172.21.15.78:0/1722911980 shutdown_connections 2023-12-12T10:13:37.842 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.832+0000 7f404f016000 1 --2- 172.21.15.78:0/1722911980 >> [v2:172.21.15.78:6835/4134128104,v1:172.21.15.78:6837/4134128104] conn(0x555816330570 0x555816387970 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:37.842 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.832+0000 7f404f016000 1 --2- 172.21.15.78:0/1722911980 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x555816375fd0 0x55581632fb60 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:37.842 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.832+0000 7f404f016000 1 --2- 172.21.15.78:0/1722911980 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5558163756b0 0x55581632f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:37.842 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.832+0000 7f404f016000 1 --2- 172.21.15.78:0/1722911980 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555816329050 0x55581632f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:37.842 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.832+0000 7f404f016000 1 -- 172.21.15.78:0/1722911980 >> 172.21.15.78:0/1722911980 conn(0x555816356240 msgr2=0x555816328200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:37.842 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.832+0000 7f4024ff9640 0 client.5658 ms_handle_reset on v2:172.21.15.78:6835/4134128104 2023-12-12T10:13:37.842 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.832+0000 7f404f016000 1 -- 172.21.15.78:0/1722911980 shutdown_connections 2023-12-12T10:13:37.842 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.832+0000 7f404f016000 1 -- 172.21.15.78:0/1722911980 wait complete. 2023-12-12T10:13:37.842 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.836+0000 7f404f016000 20 client.5658 trim_cache size 0 max 16384 2023-12-12T10:13:37.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.848+0000 7f404f016000 1 Processor -- start 2023-12-12T10:13:37.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.848+0000 7f404f016000 1 -- start start 2023-12-12T10:13:37.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.852+0000 7f404f016000 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555816329050 0x555816389db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:37.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.852+0000 7f404f016000 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5558163756b0 0x555816354d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:37.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.852+0000 7f404f016000 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x555816375fd0 0x555816355260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:37.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.852+0000 7f404f016000 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x555815e34940 con 0x5558163756b0 2023-12-12T10:13:37.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.852+0000 7f404f016000 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558161168a0 con 0x555816329050 2023-12-12T10:13:37.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.852+0000 7f404f016000 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x555816178f80 con 0x555816375fd0 2023-12-12T10:13:37.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.852+0000 7f4049237640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5558163756b0 0x555816354d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:37.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.852+0000 7f4049237640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5558163756b0 0x555816354d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33700/0 (socket says 172.21.15.78:33700) 2023-12-12T10:13:37.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.852+0000 7f4049237640 1 -- 172.21.15.78:0/2112170499 learned_addr learned my addr 172.21.15.78:0/2112170499 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:13:37.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.852+0000 7f404a239640 1 --2- 172.21.15.78:0/2112170499 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x555816375fd0 0x555816355260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:37.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.852+0000 7f4049237640 1 -- 172.21.15.78:0/2112170499 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x555816375fd0 msgr2=0x555816355260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:13:37.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.852+0000 7f4049a38640 1 --2- 172.21.15.78:0/2112170499 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555816329050 0x555816389db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:37.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.852+0000 7f4049237640 1 --2- 172.21.15.78:0/2112170499 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x555816375fd0 0x555816355260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:37.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.852+0000 7f4049237640 1 -- 172.21.15.78:0/2112170499 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555816329050 msgr2=0x555816389db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:13:37.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.852+0000 7f4049237640 1 --2- 172.21.15.78:0/2112170499 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555816329050 0x555816389db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:37.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.852+0000 7f4049237640 1 -- 172.21.15.78:0/2112170499 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555816122490 con 0x5558163756b0 2023-12-12T10:13:37.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.852+0000 7f404a239640 1 --2- 172.21.15.78:0/2112170499 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x555816375fd0 0x555816355260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T10:13:37.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.852+0000 7f4049a38640 1 --2- 172.21.15.78:0/2112170499 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555816329050 0x555816389db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T10:13:37.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.852+0000 7f4049237640 1 --2- 172.21.15.78:0/2112170499 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5558163756b0 0x555816354d20 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f4034000c10 tx=0x7f4034016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19ec51e86c3a02f3 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:37.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.852+0000 7f4027fff640 1 -- 172.21.15.78:0/2112170499 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40340013a0 con 0x5558163756b0 2023-12-12T10:13:37.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.852+0000 7f4027fff640 1 -- 172.21.15.78:0/2112170499 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4034005260 con 0x5558163756b0 2023-12-12T10:13:37.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.852+0000 7f4027fff640 1 -- 172.21.15.78:0/2112170499 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40340055d0 con 0x5558163756b0 2023-12-12T10:13:37.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.852+0000 7f404f016000 1 -- 172.21.15.78:0/2112170499 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5558163756b0 msgr2=0x555816354d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:37.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.852+0000 7f404f016000 1 --2- 172.21.15.78:0/2112170499 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5558163756b0 0x555816354d20 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f4034000c10 tx=0x7f4034016000 comp rx=0 tx=0).stop 2023-12-12T10:13:37.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.852+0000 7f404f016000 1 -- 172.21.15.78:0/2112170499 shutdown_connections 2023-12-12T10:13:37.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.852+0000 7f404f016000 1 --2- 172.21.15.78:0/2112170499 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x555816375fd0 0x555816355260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:37.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.852+0000 7f404f016000 1 --2- 172.21.15.78:0/2112170499 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5558163756b0 0x555816354d20 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:37.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.852+0000 7f404f016000 1 --2- 172.21.15.78:0/2112170499 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555816329050 0x555816389db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:37.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.852+0000 7f404f016000 1 -- 172.21.15.78:0/2112170499 >> 172.21.15.78:0/2112170499 conn(0x555816356240 msgr2=0x555816327270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:37.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.852+0000 7f404f016000 1 -- 172.21.15.78:0/2112170499 shutdown_connections 2023-12-12T10:13:37.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.852+0000 7f404f016000 1 -- 172.21.15.78:0/2112170499 wait complete. 2023-12-12T10:13:37.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.852+0000 7f404f016000 1 -- start start 2023-12-12T10:13:37.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.852+0000 7f404f016000 1 Processor -- start 2023-12-12T10:13:37.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.856+0000 7f404f016000 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555816329050 0x5558163d5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:37.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.856+0000 7f404f016000 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5558163756b0 0x5558163d64c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:37.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.856+0000 7f404f016000 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x555816375fd0 0x5558163913f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:37.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.856+0000 7f404f016000 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x555816175e80 con 0x5558163756b0 2023-12-12T10:13:37.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.856+0000 7f404f016000 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55581632c9d0 con 0x555816329050 2023-12-12T10:13:37.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.856+0000 7f404f016000 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x555816330b80 con 0x555816375fd0 2023-12-12T10:13:37.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.856+0000 7f404f016000 10 client.0 _ll_register_callbacks cb 0x5558161951a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-12T10:13:37.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.856+0000 7f4049237640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5558163756b0 0x5558163d64c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:37.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.856+0000 7f4049237640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5558163756b0 0x5558163d64c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33702/0 (socket says 172.21.15.78:33702) 2023-12-12T10:13:37.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.856+0000 7f4049237640 1 -- 172.21.15.78:0/345579813 learned_addr learned my addr 172.21.15.78:0/345579813 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:13:37.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.856+0000 7f4049a38640 1 --2- 172.21.15.78:0/345579813 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555816329050 0x5558163d5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:37.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.856+0000 7f404a239640 1 --2- 172.21.15.78:0/345579813 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x555816375fd0 0x5558163913f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:37.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.856+0000 7f4049237640 1 -- 172.21.15.78:0/345579813 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x555816375fd0 msgr2=0x5558163913f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:13:37.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.856+0000 7f4049237640 1 --2- 172.21.15.78:0/345579813 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x555816375fd0 0x5558163913f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:37.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.856+0000 7f4049237640 1 -- 172.21.15.78:0/345579813 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555816329050 msgr2=0x5558163d5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:13:37.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.856+0000 7f4049237640 1 --2- 172.21.15.78:0/345579813 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555816329050 0x5558163d5f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:37.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.856+0000 7f4049237640 1 -- 172.21.15.78:0/345579813 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555815e73890 con 0x5558163756b0 2023-12-12T10:13:37.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.856+0000 7f4049237640 1 --2- 172.21.15.78:0/345579813 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5558163756b0 0x5558163d64c0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f4034011c40 tx=0x7f4034001990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2460a005f5d1fc59 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:37.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.856+0000 7f4024ff9640 10 client.0 ms_handle_connect on v2:172.21.15.78:3300/0 2023-12-12T10:13:37.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.856+0000 7f4024ff9640 1 -- 172.21.15.78:0/345579813 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40340013a0 con 0x5558163756b0 2023-12-12T10:13:37.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.856+0000 7f4024ff9640 1 -- 172.21.15.78:0/345579813 <== mon.0 v2:172.21.15.78:3300/0 2 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f403401d050 con 0x5558163756b0 2023-12-12T10:13:37.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.856+0000 7f404f016000 1 -- 172.21.15.78:0/345579813 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55581632daf0 con 0x5558163756b0 2023-12-12T10:13:37.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.856+0000 7f4024ff9640 1 -- 172.21.15.78:0/345579813 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4034016a40 con 0x5558163756b0 2023-12-12T10:13:37.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.856+0000 7f404f016000 10 client.5664 fetch_fsmap learned FSMap version 17 2023-12-12T10:13:37.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.856+0000 7f404f016000 1 -- 172.21.15.78:0/345579813 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x555815e73cc0 con 0x5558163756b0 2023-12-12T10:13:37.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.856+0000 7f4024ff9640 1 -- 172.21.15.78:0/345579813 <== mon.0 v2:172.21.15.78:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55581632daf0 con 0x5558163756b0 2023-12-12T10:13:37.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.856+0000 7f4024ff9640 1 -- 172.21.15.78:0/345579813 <== mon.0 v2:172.21.15.78:3300/0 5 ==== fsmap(e 17) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f4034041020 con 0x5558163756b0 2023-12-12T10:13:37.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.856+0000 7f404f016000 10 client.5664 fetch_fsmap finished waiting for FSMap version 17 2023-12-12T10:13:37.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.856+0000 7f404f016000 10 client.5664 resolve_mds: resolved name 'a' to daemon mds.a 2023-12-12T10:13:37.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.856+0000 7f404f016000 20 client.5664 populate_metadata read hostname 'smithi078' 2023-12-12T10:13:37.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.856+0000 7f404f016000 1 --2- 172.21.15.78:0/345579813 >> [v2:172.21.15.78:6835/4134128104,v1:172.21.15.78:6837/4134128104] conn(0x555816391db0 0x555816392190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:37.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.856+0000 7f404f016000 4 client.5664 mds_command: new command op to 5472 tid=0 multi_id=0 [{"prefix": "status"}] 2023-12-12T10:13:37.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.856+0000 7f404f016000 1 -- 172.21.15.78:0/345579813 --> [v2:172.21.15.78:6835/4134128104,v1:172.21.15.78:6837/4134128104] -- command(tid 0: {"prefix": "status"}) v1 -- 0x555816116f90 con 0x555816391db0 2023-12-12T10:13:37.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.856+0000 7f4049a38640 1 --2- 172.21.15.78:0/345579813 >> [v2:172.21.15.78:6835/4134128104,v1:172.21.15.78:6837/4134128104] conn(0x555816391db0 0x555816392190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:37.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.856+0000 7f4049a38640 1 --2- 172.21.15.78:0/345579813 >> [v2:172.21.15.78:6835/4134128104,v1:172.21.15.78:6837/4134128104] conn(0x555816391db0 0x555816392190 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ccd6ba3917606214 server_cookie=4574ad8c488a1c4f in_seq=0 out_seq=0 2023-12-12T10:13:37.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.856+0000 7f4024ff9640 10 client.5664 ms_handle_connect on v2:172.21.15.78:6835/4134128104 2023-12-12T10:13:37.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.856+0000 7f4024ff9640 1 -- 172.21.15.78:0/345579813 <== mds.0 v2:172.21.15.78:6835/4134128104 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x555816116f90 con 0x555816391db0 2023-12-12T10:13:37.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.856+0000 7f4024ff9640 10 client.5664 handle_command_reply: tid=0 2023-12-12T10:13:37.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.856+0000 7f404f016000 1 client.5664 shutdown 2023-12-12T10:13:37.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.856+0000 7f404f016000 1 -- 172.21.15.78:0/345579813 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5558163756b0 msgr2=0x5558163d64c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:37.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.856+0000 7f404f016000 1 --2- 172.21.15.78:0/345579813 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5558163756b0 0x5558163d64c0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f4034011c40 tx=0x7f4034001990 comp rx=0 tx=0).stop 2023-12-12T10:13:37.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.856+0000 7f404f016000 1 -- 172.21.15.78:0/345579813 shutdown_connections 2023-12-12T10:13:37.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.856+0000 7f404f016000 1 --2- 172.21.15.78:0/345579813 >> [v2:172.21.15.78:6835/4134128104,v1:172.21.15.78:6837/4134128104] conn(0x555816391db0 0x555816392190 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:37.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.856+0000 7f404f016000 1 --2- 172.21.15.78:0/345579813 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x555816375fd0 0x5558163913f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:37.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.856+0000 7f404f016000 1 --2- 172.21.15.78:0/345579813 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x5558163756b0 0x5558163d64c0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:37.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.856+0000 7f404f016000 1 --2- 172.21.15.78:0/345579813 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555816329050 0x5558163d5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:37.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.856+0000 7f404f016000 1 -- 172.21.15.78:0/345579813 >> 172.21.15.78:0/345579813 conn(0x555816356240 msgr2=0x555816327b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:37.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.856+0000 7f4024ff9640 0 client.5664 ms_handle_reset on v2:172.21.15.78:6835/4134128104 2023-12-12T10:13:37.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.856+0000 7f404f016000 1 -- 172.21.15.78:0/345579813 shutdown_connections 2023-12-12T10:13:37.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.856+0000 7f404f016000 1 -- 172.21.15.78:0/345579813 wait complete. 2023-12-12T10:13:37.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.856+0000 7f404f016000 20 client.5664 trim_cache size 0 max 16384 2023-12-12T10:13:37.867 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2023-12-12T10:13:37.867 INFO:teuthology.orchestra.run.smithi078.stdout: "cluster_fsid": "fc81937c-bd26-483c-952b-d1324fcb0c9e", 2023-12-12T10:13:37.867 INFO:teuthology.orchestra.run.smithi078.stdout: "whoami": 0, 2023-12-12T10:13:37.867 INFO:teuthology.orchestra.run.smithi078.stdout: "id": 5472, 2023-12-12T10:13:37.867 INFO:teuthology.orchestra.run.smithi078.stdout: "want_state": "up:active", 2023-12-12T10:13:37.867 INFO:teuthology.orchestra.run.smithi078.stdout: "state": "up:active", 2023-12-12T10:13:37.867 INFO:teuthology.orchestra.run.smithi078.stdout: "fs_name": "cephfs", 2023-12-12T10:13:37.867 INFO:teuthology.orchestra.run.smithi078.stdout: "rank_uptime": 5.8468173109999997, 2023-12-12T10:13:37.867 INFO:teuthology.orchestra.run.smithi078.stdout: "mdsmap_epoch": 17, 2023-12-12T10:13:37.867 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_epoch": 39, 2023-12-12T10:13:37.867 INFO:teuthology.orchestra.run.smithi078.stdout: "osdmap_epoch_barrier": 39, 2023-12-12T10:13:37.867 INFO:teuthology.orchestra.run.smithi078.stdout: "uptime": 14.726187491999999 2023-12-12T10:13:37.868 INFO:teuthology.orchestra.run.smithi078.stdout:} 2023-12-12T10:13:37.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.860+0000 7f404bc9c640 1 -- 172.21.15.78:0/3346724869 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f40280664a0 msgr2=0x7f4028068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:37.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.860+0000 7f404bc9c640 1 --2- 172.21.15.78:0/3346724869 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f40280664a0 0x7f4028068960 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f4044142530 tx=0x7f4034007040 comp rx=0 tx=0).stop 2023-12-12T10:13:37.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.860+0000 7f404bc9c640 1 -- 172.21.15.78:0/3346724869 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4030003b40 msgr2=0x7f4044159930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:37.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.860+0000 7f404bc9c640 1 --2- 172.21.15.78:0/3346724869 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4030003b40 0x7f4044159930 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f4040005040 tx=0x7f4030005800 comp rx=0 tx=0).stop 2023-12-12T10:13:37.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.860+0000 7f404bc9c640 1 -- 172.21.15.78:0/3346724869 shutdown_connections 2023-12-12T10:13:37.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.860+0000 7f404bc9c640 1 --2- 172.21.15.78:0/3346724869 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f40280664a0 0x7f4028068960 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:37.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.860+0000 7f404bc9c640 1 --2- 172.21.15.78:0/3346724869 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f404415c5c0 0x7f404415ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:37.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.860+0000 7f404bc9c640 1 --2- 172.21.15.78:0/3346724869 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4044140d80 0x7f40441411e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:37.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.860+0000 7f404bc9c640 1 --2- 172.21.15.78:0/3346724869 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4030003b40 0x7f4044159930 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:37.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.860+0000 7f404bc9c640 1 -- 172.21.15.78:0/3346724869 >> 172.21.15.78:0/3346724869 conn(0x7f404406a710 msgr2=0x7f4044142580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:37.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.860+0000 7f404bc9c640 1 -- 172.21.15.78:0/3346724869 shutdown_connections 2023-12-12T10:13:37.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:37.860+0000 7f404bc9c640 1 -- 172.21.15.78:0/3346724869 wait complete. 2023-12-12T10:13:37.882 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-12T10:13:38.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:38.016+0000 7f7ca3f1d640 1 Processor -- start 2023-12-12T10:13:38.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:38.016+0000 7f7ca3f1d640 1 -- start start 2023-12-12T10:13:38.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:38.016+0000 7f7ca3f1d640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f7c9c0ade10 0x7f7c9c0ce5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:38.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:38.016+0000 7f7ca3f1d640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f7c9c0cb7e0 0x7f7c9c0b40c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:38.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:38.016+0000 7f7ca3f1d640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c9c0b4a50 con 0x7f7c9c0b4600 2023-12-12T10:13:38.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:38.016+0000 7f7ca3f1d640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c9c0ae1f0 con 0x7f7c9c0ade10 2023-12-12T10:13:38.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:38.016+0000 7f7ca3f1d640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c9c15c410 con 0x7f7c9c0cb7e0 2023-12-12T10:13:38.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:38.016+0000 7f7ca1cb9640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f7c9c0ade10 0x7f7c9c0ce5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:38.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:38.016+0000 7f7ca1cb9640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f7c9c0ade10 0x7f7c9c0ce5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33712/0 (socket says 172.21.15.78:33712) 2023-12-12T10:13:38.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:38.016+0000 7f7ca1cb9640 1 -- 172.21.15.78:0/2905869683 learned_addr learned my addr 172.21.15.78:0/2905869683 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:13:38.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:38.016+0000 7f7ca1cb9640 1 -- 172.21.15.78:0/2905869683 >> v2:172.21.15.187:3300/0 conn(0x7f7c9c0cb7e0 msgr2=0x7f7c9c0b40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:13:38.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:38.016+0000 7f7ca1cb9640 1 --2- 172.21.15.78:0/2905869683 >> v2:172.21.15.187:3300/0 conn(0x7f7c9c0cb7e0 0x7f7c9c0b40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:38.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:38.016+0000 7f7ca1cb9640 1 -- 172.21.15.78:0/2905869683 >> v1:172.21.15.187:6789/0 conn(0x7f7c9c0b4600 legacy=0x7f7c9c1580a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:13:38.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:38.016+0000 7f7ca1cb9640 1 -- 172.21.15.78:0/2905869683 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c9c0ceb00 con 0x7f7c9c0ade10 2023-12-12T10:13:38.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:38.020+0000 7f7ca1cb9640 1 --2- 172.21.15.78:0/2905869683 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7c9c0ade10 0x7f7c9c0ce5c0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f7c9c072d90 tx=0x7f7c9801c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3ebdea51520869f server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:38.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:38.020+0000 7f7ca0cb7640 1 -- 172.21.15.78:0/2905869683 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c980ac410 con 0x7f7c9c0ade10 2023-12-12T10:13:38.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:38.020+0000 7f7ca0cb7640 1 -- 172.21.15.78:0/2905869683 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c980ac570 con 0x7f7c9c0ade10 2023-12-12T10:13:38.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:38.020+0000 7f7ca0cb7640 1 -- 172.21.15.78:0/2905869683 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c980ac900 con 0x7f7c9c0ade10 2023-12-12T10:13:38.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:38.020+0000 7f7ca3f1d640 1 -- 172.21.15.78:0/2905869683 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7c9c0ade10 msgr2=0x7f7c9c0ce5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:38.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:38.020+0000 7f7ca3f1d640 1 --2- 172.21.15.78:0/2905869683 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7c9c0ade10 0x7f7c9c0ce5c0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f7c9c072d90 tx=0x7f7c9801c4c0 comp rx=0 tx=0).stop 2023-12-12T10:13:38.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:38.020+0000 7f7ca3f1d640 1 -- 172.21.15.78:0/2905869683 shutdown_connections 2023-12-12T10:13:38.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:38.020+0000 7f7ca3f1d640 1 --2- 172.21.15.78:0/2905869683 >> v2:172.21.15.187:3300/0 conn(0x7f7c9c0cb7e0 0x7f7c9c0b40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:38.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:38.020+0000 7f7ca3f1d640 1 --2- 172.21.15.78:0/2905869683 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7c9c0ade10 0x7f7c9c0ce5c0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:38.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:38.020+0000 7f7ca3f1d640 1 -- 172.21.15.78:0/2905869683 >> 172.21.15.78:0/2905869683 conn(0x7f7c9c06c5d0 msgr2=0x7f7c9c06c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:38.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:38.020+0000 7f7ca3f1d640 1 -- 172.21.15.78:0/2905869683 shutdown_connections 2023-12-12T10:13:38.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:38.020+0000 7f7ca3f1d640 1 -- 172.21.15.78:0/2905869683 wait complete. 2023-12-12T10:13:38.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:38.024+0000 7f7ca3f1d640 1 Processor -- start 2023-12-12T10:13:38.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:38.024+0000 7f7ca3f1d640 1 -- start start 2023-12-12T10:13:38.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:38.024+0000 7f7ca3f1d640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7c9c0ade10 0x7f7c9c0ac880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:38.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:38.024+0000 7f7ca3f1d640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7c9c0b4600 0x7f7c9c0acdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:38.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:38.024+0000 7f7ca3f1d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7c9c0cb7e0 0x7f7c9c14d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:38.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:38.024+0000 7f7ca3f1d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c9c150890 con 0x7f7c9c0cb7e0 2023-12-12T10:13:38.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:38.024+0000 7f7ca3f1d640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c9c150b50 con 0x7f7c9c0ade10 2023-12-12T10:13:38.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:38.024+0000 7f7ca3f1d640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c9c154e50 con 0x7f7c9c0b4600 2023-12-12T10:13:38.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:38.024+0000 7f7ca24ba640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7c9c0cb7e0 0x7f7c9c14d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:38.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:38.024+0000 7f7ca24ba640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7c9c0cb7e0 0x7f7c9c14d610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:33724/0 (socket says 172.21.15.78:33724) 2023-12-12T10:13:38.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:38.024+0000 7f7ca24ba640 1 -- 172.21.15.78:0/3320787404 learned_addr learned my addr 172.21.15.78:0/3320787404 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:13:38.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:38.024+0000 7f7ca1cb9640 1 --2- 172.21.15.78:0/3320787404 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7c9c0ade10 0x7f7c9c0ac880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:38.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:38.024+0000 7f7ca14b8640 1 --2- 172.21.15.78:0/3320787404 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7c9c0b4600 0x7f7c9c0acdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:38.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:38.024+0000 7f7ca24ba640 1 -- 172.21.15.78:0/3320787404 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7c9c0b4600 msgr2=0x7f7c9c0acdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:38.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:38.024+0000 7f7ca24ba640 1 --2- 172.21.15.78:0/3320787404 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7c9c0b4600 0x7f7c9c0acdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:38.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:38.024+0000 7f7ca24ba640 1 -- 172.21.15.78:0/3320787404 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7c9c0ade10 msgr2=0x7f7c9c0ac880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:38.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:38.024+0000 7f7ca24ba640 1 --2- 172.21.15.78:0/3320787404 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7c9c0ade10 0x7f7c9c0ac880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:38.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:38.024+0000 7f7ca24ba640 1 -- 172.21.15.78:0/3320787404 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c980094d0 con 0x7f7c9c0cb7e0 2023-12-12T10:13:38.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:38.024+0000 7f7ca24ba640 1 --2- 172.21.15.78:0/3320787404 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7c9c0cb7e0 0x7f7c9c14d610 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f7c9400c780 tx=0x7f7c9400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:38.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:38.024+0000 7f7c927fc640 1 -- 172.21.15.78:0/3320787404 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c94003d90 con 0x7f7c9c0cb7e0 2023-12-12T10:13:38.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:38.024+0000 7f7c927fc640 1 -- 172.21.15.78:0/3320787404 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c9400ce90 con 0x7f7c9c0cb7e0 2023-12-12T10:13:38.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:38.024+0000 7f7c927fc640 1 -- 172.21.15.78:0/3320787404 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c940052b0 con 0x7f7c9c0cb7e0 2023-12-12T10:13:38.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:38.024+0000 7f7ca3f1d640 1 -- 172.21.15.78:0/3320787404 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c9c155130 con 0x7f7c9c0cb7e0 2023-12-12T10:13:38.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:38.024+0000 7f7ca3f1d640 1 -- 172.21.15.78:0/3320787404 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c9c155410 con 0x7f7c9c0cb7e0 2023-12-12T10:13:38.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:38.028+0000 7f7ca3f1d640 1 -- 172.21.15.78:0/3320787404 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c9c0671f0 con 0x7f7c9c0cb7e0 2023-12-12T10:13:38.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:38.028+0000 7f7c927fc640 1 -- 172.21.15.78:0/3320787404 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7c94005410 con 0x7f7c9c0cb7e0 2023-12-12T10:13:38.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:38.028+0000 7f7c927fc640 1 --2- 172.21.15.78:0/3320787404 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f7c80066470 0x7f7c80068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:13:38.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:38.028+0000 7f7c927fc640 1 -- 172.21.15.78:0/3320787404 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f7c94083300 con 0x7f7c9c0cb7e0 2023-12-12T10:13:38.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:38.028+0000 7f7ca1cb9640 1 --2- 172.21.15.78:0/3320787404 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f7c80066470 0x7f7c80068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:13:38.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:38.028+0000 7f7ca1cb9640 1 --2- 172.21.15.78:0/3320787404 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f7c80066470 0x7f7c80068930 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f7c980ae000 tx=0x7f7c98008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:13:38.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:38.032+0000 7f7c927fc640 1 -- 172.21.15.78:0/3320787404 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7c940506f0 con 0x7f7c9c0cb7e0 2023-12-12T10:13:38.220 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:38.216+0000 7f7ca3f1d640 1 -- 172.21.15.78:0/3320787404 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f7c9c067530 con 0x7f7c9c0cb7e0 2023-12-12T10:13:38.220 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:38.216+0000 7f7c927fc640 1 -- 172.21.15.78:0/3320787404 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+73 (secure 0 0 0) 0x7f7c94053d10 con 0x7f7c9c0cb7e0 2023-12-12T10:13:38.220 INFO:teuthology.orchestra.run.smithi078.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-12T10:13:38.222 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:38.216+0000 7f7ca3f1d640 1 -- 172.21.15.78:0/3320787404 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f7c80066470 msgr2=0x7f7c80068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:38.222 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:38.216+0000 7f7ca3f1d640 1 --2- 172.21.15.78:0/3320787404 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f7c80066470 0x7f7c80068930 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f7c980ae000 tx=0x7f7c98008040 comp rx=0 tx=0).stop 2023-12-12T10:13:38.222 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:38.216+0000 7f7ca3f1d640 1 -- 172.21.15.78:0/3320787404 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7c9c0cb7e0 msgr2=0x7f7c9c14d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:13:38.222 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:38.216+0000 7f7ca3f1d640 1 --2- 172.21.15.78:0/3320787404 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7c9c0cb7e0 0x7f7c9c14d610 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f7c9400c780 tx=0x7f7c9400cc40 comp rx=0 tx=0).stop 2023-12-12T10:13:38.222 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:38.216+0000 7f7ca3f1d640 1 -- 172.21.15.78:0/3320787404 shutdown_connections 2023-12-12T10:13:38.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:38.216+0000 7f7ca3f1d640 1 --2- 172.21.15.78:0/3320787404 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f7c80066470 0x7f7c80068930 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:38.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:38.216+0000 7f7ca3f1d640 1 --2- 172.21.15.78:0/3320787404 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f7c9c0cb7e0 0x7f7c9c14d610 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:38.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:38.216+0000 7f7ca3f1d640 1 --2- 172.21.15.78:0/3320787404 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7c9c0b4600 0x7f7c9c0acdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:38.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:38.216+0000 7f7ca3f1d640 1 --2- 172.21.15.78:0/3320787404 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7c9c0ade10 0x7f7c9c0ac880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:13:38.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:38.216+0000 7f7ca3f1d640 1 -- 172.21.15.78:0/3320787404 >> 172.21.15.78:0/3320787404 conn(0x7f7c9c06c5d0 msgr2=0x7f7c9c159a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:13:38.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:38.216+0000 7f7ca3f1d640 1 -- 172.21.15.78:0/3320787404 shutdown_connections 2023-12-12T10:13:38.223 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:38.216+0000 7f7ca3f1d640 1 -- 172.21.15.78:0/3320787404 wait complete. 2023-12-12T10:13:38.241 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-12T10:13:38.241 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-12T10:13:38.241 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi078.front.sepia.ceph.com 2023-12-12T10:13:38.241 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-12T10:13:38.241 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-12T10:13:38.241 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-12T10:13:38.241 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-12T10:13:38.242 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-12T10:13:38.242 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-12T10:13:38.242 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T10:13:38.243 DEBUG:teuthology.orchestra.run.smithi078:> ip addr 2023-12-12T10:13:38.252 INFO:teuthology.orchestra.run.smithi078.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-12T10:13:38.253 INFO:teuthology.orchestra.run.smithi078.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-12T10:13:38.253 INFO:teuthology.orchestra.run.smithi078.stdout: inet 127.0.0.1/8 scope host lo 2023-12-12T10:13:38.253 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-12-12T10:13:38.253 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 ::1/128 scope host 2023-12-12T10:13:38.253 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-12-12T10:13:38.253 INFO:teuthology.orchestra.run.smithi078.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-12T10:13:38.253 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:d8:a1:22 brd ff:ff:ff:ff:ff:ff 2023-12-12T10:13:38.253 INFO:teuthology.orchestra.run.smithi078.stdout: altname enp7s0f0 2023-12-12T10:13:38.253 INFO:teuthology.orchestra.run.smithi078.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-12T10:13:38.253 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:d8:a1:23 brd ff:ff:ff:ff:ff:ff 2023-12-12T10:13:38.254 INFO:teuthology.orchestra.run.smithi078.stdout: altname enp7s0f1 2023-12-12T10:13:38.254 INFO:teuthology.orchestra.run.smithi078.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-12-12T10:13:38.254 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:8f:d4:dc brd ff:ff:ff:ff:ff:ff 2023-12-12T10:13:38.254 INFO:teuthology.orchestra.run.smithi078.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-12T10:13:38.254 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0c:c4:7a:8f:d4:dd brd ff:ff:ff:ff:ff:ff 2023-12-12T10:13:38.254 INFO:teuthology.orchestra.run.smithi078.stdout: inet 172.21.15.78/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-12-12T10:13:38.254 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft 42313sec preferred_lft 42313sec 2023-12-12T10:13:38.254 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 fe80::ec4:7aff:fe8f:d4dd/64 scope link 2023-12-12T10:13:38.254 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-12-12T10:13:38.254 INFO:teuthology.orchestra.run.smithi078.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-12-12T10:13:38.254 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 02:42:b6:5e:55:45 brd ff:ff:ff:ff:ff:ff 2023-12-12T10:13:38.254 INFO:teuthology.orchestra.run.smithi078.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-12-12T10:13:38.254 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-12-12T10:13:38.254 INFO:teuthology.orchestra.run.smithi078.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-12T10:13:38.254 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-12-12T10:13:38.255 INFO:teuthology.orchestra.run.smithi078.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-12T10:13:38.255 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-12-12T10:13:38.255 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-12-12T10:13:38.255 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-12-12T10:13:38.255 INFO:teuthology.orchestra.run.smithi078.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-12T10:13:38.255 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-12T10:13:38.255 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-12-12T10:13:38.255 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-12-12T10:13:38.255 INFO:teuthology.orchestra.run.smithi078.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-12T10:13:38.255 INFO:teuthology.orchestra.run.smithi078.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-12T10:13:38.255 INFO:teuthology.orchestra.run.smithi078.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2023-12-12T10:13:38.255 INFO:teuthology.orchestra.run.smithi078.stdout: valid_lft forever preferred_lft forever 2023-12-12T10:13:38.256 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T10:13:38.256 DEBUG:teuthology.orchestra.run.smithi078:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-12T10:13:38.314 INFO:teuthology.orchestra.run.smithi078.stdout:1 2023-12-12T10:13:38.316 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T10:13:38.316 DEBUG:teuthology.orchestra.run.smithi078:> route 2023-12-12T10:13:38.371 INFO:teuthology.orchestra.run.smithi078.stdout:Kernel IP routing table 2023-12-12T10:13:38.371 INFO:teuthology.orchestra.run.smithi078.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-12T10:13:38.371 INFO:teuthology.orchestra.run.smithi078.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-12-12T10:13:38.371 INFO:teuthology.orchestra.run.smithi078.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-12T10:13:38.371 INFO:teuthology.orchestra.run.smithi078.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-12-12T10:13:38.371 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-12T10:13:38.371 INFO:teuthology.orchestra.run.smithi078.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-12T10:13:38.372 INFO:teuthology.orchestra.run.smithi078.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-12T10:13:38.372 INFO:teuthology.orchestra.run.smithi078.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-12-12T10:13:38.372 INFO:teuthology.orchestra.run.smithi078.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-12T10:13:38.372 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T10:13:38.372 DEBUG:teuthology.orchestra.run.smithi078:> (cd / && exec bash -c ' 2023-12-12T10:13:38.372 DEBUG:teuthology.orchestra.run.smithi078:> set -e 2023-12-12T10:13:38.372 DEBUG:teuthology.orchestra.run.smithi078:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-12T10:13:38.372 DEBUG:teuthology.orchestra.run.smithi078:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-12T10:13:38.372 DEBUG:teuthology.orchestra.run.smithi078:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-12T10:13:38.372 DEBUG:teuthology.orchestra.run.smithi078:> ') 2023-12-12T10:13:38.467 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T10:13:38.467 DEBUG:teuthology.orchestra.run.smithi078:> ip netns list 2023-12-12T10:13:38.476 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-12T10:13:38.476 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-12-12T10:13:38.477 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-12T10:13:38.477 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T10:13:38.478 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link set brx.0 up 2023-12-12T10:13:38.540 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-12-12T10:13:38.540 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-12T10:13:38.541 DEBUG:teuthology.orchestra.run.smithi078:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-12T10:13:38.592 INFO:teuthology.orchestra.run.smithi078.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-12T10:13:38.592 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-12T10:13:38.592 DEBUG:teuthology.orchestra.run.smithi078:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-12T10:13:38.644 DEBUG:teuthology.orchestra.run.smithi078:> sudo modprobe fuse 2023-12-12T10:13:38.713 DEBUG:teuthology.orchestra.run.smithi078:> cat /proc/self/mounts | awk '{print $2}' 2023-12-12T10:13:38.765 INFO:teuthology.orchestra.run.smithi078.stdout:/sys 2023-12-12T10:13:38.765 INFO:teuthology.orchestra.run.smithi078.stdout:/proc 2023-12-12T10:13:38.765 INFO:teuthology.orchestra.run.smithi078.stdout:/dev 2023-12-12T10:13:38.765 INFO:teuthology.orchestra.run.smithi078.stdout:/dev/pts 2023-12-12T10:13:38.765 INFO:teuthology.orchestra.run.smithi078.stdout:/run 2023-12-12T10:13:38.765 INFO:teuthology.orchestra.run.smithi078.stdout:/ 2023-12-12T10:13:38.766 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/kernel/security 2023-12-12T10:13:38.766 INFO:teuthology.orchestra.run.smithi078.stdout:/dev/shm 2023-12-12T10:13:38.766 INFO:teuthology.orchestra.run.smithi078.stdout:/run/lock 2023-12-12T10:13:38.766 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/fs/cgroup 2023-12-12T10:13:38.766 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/fs/pstore 2023-12-12T10:13:38.766 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/fs/bpf 2023-12-12T10:13:38.766 INFO:teuthology.orchestra.run.smithi078.stdout:/proc/sys/fs/binfmt_misc 2023-12-12T10:13:38.766 INFO:teuthology.orchestra.run.smithi078.stdout:/dev/hugepages 2023-12-12T10:13:38.766 INFO:teuthology.orchestra.run.smithi078.stdout:/dev/mqueue 2023-12-12T10:13:38.766 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/kernel/debug 2023-12-12T10:13:38.766 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/kernel/tracing 2023-12-12T10:13:38.766 INFO:teuthology.orchestra.run.smithi078.stdout:/proc/fs/nfsd 2023-12-12T10:13:38.766 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/fs/fuse/connections 2023-12-12T10:13:38.766 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/kernel/config 2023-12-12T10:13:38.767 INFO:teuthology.orchestra.run.smithi078.stdout:/run/credentials/systemd-sysusers.service 2023-12-12T10:13:38.767 INFO:teuthology.orchestra.run.smithi078.stdout:/run/rpc_pipefs 2023-12-12T10:13:38.767 INFO:teuthology.orchestra.run.smithi078.stdout:/run/user/1000 2023-12-12T10:13:38.767 INFO:teuthology.orchestra.run.smithi078.stdout:/var/lib/ceph 2023-12-12T10:13:38.767 INFO:teuthology.orchestra.run.smithi078.stdout:/var/lib/ceph/osd/ceph-0 2023-12-12T10:13:38.767 INFO:teuthology.orchestra.run.smithi078.stdout:/var/lib/ceph/osd/ceph-1 2023-12-12T10:13:38.767 INFO:teuthology.orchestra.run.smithi078.stdout:/var/lib/ceph/osd/ceph-2 2023-12-12T10:13:38.767 INFO:teuthology.orchestra.run.smithi078.stdout:/var/lib/ceph/osd/ceph-3 2023-12-12T10:13:38.767 INFO:teuthology.orchestra.run.smithi078.stdout:/run/netns 2023-12-12T10:13:38.767 INFO:teuthology.orchestra.run.smithi078.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-12T10:13:38.767 INFO:teuthology.orchestra.run.smithi078.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-12T10:13:38.767 INFO:teuthology.orchestra.run.smithi078.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-12T10:13:38.767 INFO:teuthology.orchestra.run.smithi078.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-12T10:13:38.768 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T10:13:38.768 DEBUG:teuthology.orchestra.run.smithi078:> ls /sys/fs/fuse/connections 2023-12-12T10:13:38.819 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-12-12T10:13:38.819 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-12-12T10:13:38.870 DEBUG:teuthology.orchestra.run.smithi078:> sudo modprobe fuse 2023-12-12T10:13:38.892 DEBUG:teuthology.orchestra.run.smithi078:> cat /proc/self/mounts | awk '{print $2}' 2023-12-12T10:13:38.947 INFO:teuthology.orchestra.run.smithi078.stdout:/sys 2023-12-12T10:13:38.947 INFO:teuthology.orchestra.run.smithi078.stdout:/proc 2023-12-12T10:13:38.947 INFO:teuthology.orchestra.run.smithi078.stdout:/dev 2023-12-12T10:13:38.947 INFO:teuthology.orchestra.run.smithi078.stdout:/dev/pts 2023-12-12T10:13:38.947 INFO:teuthology.orchestra.run.smithi078.stdout:/run 2023-12-12T10:13:38.947 INFO:teuthology.orchestra.run.smithi078.stdout:/ 2023-12-12T10:13:38.947 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/kernel/security 2023-12-12T10:13:38.947 INFO:teuthology.orchestra.run.smithi078.stdout:/dev/shm 2023-12-12T10:13:38.947 INFO:teuthology.orchestra.run.smithi078.stdout:/run/lock 2023-12-12T10:13:38.947 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/fs/cgroup 2023-12-12T10:13:38.947 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/fs/pstore 2023-12-12T10:13:38.948 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/fs/bpf 2023-12-12T10:13:38.948 INFO:teuthology.orchestra.run.smithi078.stdout:/proc/sys/fs/binfmt_misc 2023-12-12T10:13:38.948 INFO:teuthology.orchestra.run.smithi078.stdout:/dev/hugepages 2023-12-12T10:13:38.948 INFO:teuthology.orchestra.run.smithi078.stdout:/dev/mqueue 2023-12-12T10:13:38.948 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/kernel/debug 2023-12-12T10:13:38.948 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/kernel/tracing 2023-12-12T10:13:38.948 INFO:teuthology.orchestra.run.smithi078.stdout:/proc/fs/nfsd 2023-12-12T10:13:38.948 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/fs/fuse/connections 2023-12-12T10:13:38.948 INFO:teuthology.orchestra.run.smithi078.stdout:/sys/kernel/config 2023-12-12T10:13:38.948 INFO:teuthology.orchestra.run.smithi078.stdout:/run/credentials/systemd-sysusers.service 2023-12-12T10:13:38.948 INFO:teuthology.orchestra.run.smithi078.stdout:/run/rpc_pipefs 2023-12-12T10:13:38.948 INFO:teuthology.orchestra.run.smithi078.stdout:/run/user/1000 2023-12-12T10:13:38.948 INFO:teuthology.orchestra.run.smithi078.stdout:/var/lib/ceph 2023-12-12T10:13:38.948 INFO:teuthology.orchestra.run.smithi078.stdout:/var/lib/ceph/osd/ceph-0 2023-12-12T10:13:38.948 INFO:teuthology.orchestra.run.smithi078.stdout:/var/lib/ceph/osd/ceph-1 2023-12-12T10:13:38.949 INFO:teuthology.orchestra.run.smithi078.stdout:/var/lib/ceph/osd/ceph-2 2023-12-12T10:13:38.949 INFO:teuthology.orchestra.run.smithi078.stdout:/var/lib/ceph/osd/ceph-3 2023-12-12T10:13:38.949 INFO:teuthology.orchestra.run.smithi078.stdout:/run/netns 2023-12-12T10:13:38.949 INFO:teuthology.orchestra.run.smithi078.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-12T10:13:38.949 INFO:teuthology.orchestra.run.smithi078.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-12T10:13:38.949 INFO:teuthology.orchestra.run.smithi078.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-12T10:13:38.949 INFO:teuthology.orchestra.run.smithi078.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-12T10:13:38.950 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T10:13:38.950 DEBUG:teuthology.orchestra.run.smithi078:> ls /sys/fs/fuse/connections 2023-12-12T10:13:38.969 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi078.stderr:2023-12-12T10:13:38.964+0000 7f4c67b2b580 -1 init, newargv = 0x55b2d7845300 newargc=15 2023-12-12T10:13:38.970 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi078.stderr:ceph-fuse[50160]: starting ceph client 2023-12-12T10:13:38.977 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi078.stderr:ceph-fuse[50160]: starting fuse 2023-12-12T10:13:38.979 INFO:teuthology.orchestra.run.smithi078.stdout:43 2023-12-12T10:13:38.979 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2023-12-12T10:13:38.980 DEBUG:teuthology.orchestra.run.smithi078:> sudo stdin-killer -- python3 -c ' 2023-12-12T10:13:38.980 DEBUG:teuthology.orchestra.run.smithi078:> import glob 2023-12-12T10:13:38.980 DEBUG:teuthology.orchestra.run.smithi078:> import re 2023-12-12T10:13:38.980 DEBUG:teuthology.orchestra.run.smithi078:> import os 2023-12-12T10:13:38.980 DEBUG:teuthology.orchestra.run.smithi078:> import subprocess 2023-12-12T10:13:38.980 DEBUG:teuthology.orchestra.run.smithi078:> 2023-12-12T10:13:38.980 DEBUG:teuthology.orchestra.run.smithi078:> def _find_admin_socket(client_name): 2023-12-12T10:13:38.980 DEBUG:teuthology.orchestra.run.smithi078:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-12-12T10:13:38.980 DEBUG:teuthology.orchestra.run.smithi078:> files = glob.glob(asok_path) 2023-12-12T10:13:38.980 DEBUG:teuthology.orchestra.run.smithi078:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-12-12T10:13:38.980 DEBUG:teuthology.orchestra.run.smithi078:> 2023-12-12T10:13:38.980 DEBUG:teuthology.orchestra.run.smithi078:> # Given a non-glob path, it better be there 2023-12-12T10:13:38.980 DEBUG:teuthology.orchestra.run.smithi078:> if "*" not in asok_path: 2023-12-12T10:13:38.981 DEBUG:teuthology.orchestra.run.smithi078:> assert(len(files) == 1) 2023-12-12T10:13:38.981 DEBUG:teuthology.orchestra.run.smithi078:> return files[0] 2023-12-12T10:13:38.981 DEBUG:teuthology.orchestra.run.smithi078:> 2023-12-12T10:13:38.981 DEBUG:teuthology.orchestra.run.smithi078:> for f in files: 2023-12-12T10:13:38.981 DEBUG:teuthology.orchestra.run.smithi078:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-12T10:13:38.981 DEBUG:teuthology.orchestra.run.smithi078:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-12T10:13:38.981 DEBUG:teuthology.orchestra.run.smithi078:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-12T10:13:38.981 DEBUG:teuthology.orchestra.run.smithi078:> contents = proc_f.read() 2023-12-12T10:13:38.981 DEBUG:teuthology.orchestra.run.smithi078:> if mountpoint in contents: 2023-12-12T10:13:38.981 DEBUG:teuthology.orchestra.run.smithi078:> return f 2023-12-12T10:13:38.981 DEBUG:teuthology.orchestra.run.smithi078:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-12T10:13:38.981 DEBUG:teuthology.orchestra.run.smithi078:> 2023-12-12T10:13:38.981 DEBUG:teuthology.orchestra.run.smithi078:> print(_find_admin_socket("client.0")) 2023-12-12T10:13:38.981 DEBUG:teuthology.orchestra.run.smithi078:> ' 2023-12-12T10:13:39.110 INFO:teuthology.orchestra.run.smithi078.stdout:/var/run/ceph/ceph-client.0.50160.asok 2023-12-12T10:13:39.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:13:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-12-12T10:13:39.305 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.50160.asok 2023-12-12T10:13:39.305 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T10:13:39.306 DEBUG:teuthology.orchestra.run.smithi078:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.50160.asok status 2023-12-12T10:13:39.477 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2023-12-12T10:13:39.477 INFO:teuthology.orchestra.run.smithi078.stdout: "metadata": { 2023-12-12T10:13:39.478 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph_sha1": "f1fbf3c583d03e19f5e58eb618e78d8e10d075f9", 2023-12-12T10:13:39.478 INFO:teuthology.orchestra.run.smithi078.stdout: "ceph_version": "ceph version 19.0.0-96-gf1fbf3c5 (f1fbf3c583d03e19f5e58eb618e78d8e10d075f9) reef (dev)", 2023-12-12T10:13:39.478 INFO:teuthology.orchestra.run.smithi078.stdout: "entity_id": "0", 2023-12-12T10:13:39.478 INFO:teuthology.orchestra.run.smithi078.stdout: "hostname": "smithi078", 2023-12-12T10:13:39.478 INFO:teuthology.orchestra.run.smithi078.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-12-12T10:13:39.478 INFO:teuthology.orchestra.run.smithi078.stdout: "pid": "50160", 2023-12-12T10:13:39.478 INFO:teuthology.orchestra.run.smithi078.stdout: "root": "/" 2023-12-12T10:13:39.478 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-12-12T10:13:39.478 INFO:teuthology.orchestra.run.smithi078.stdout: "dentry_count": 0, 2023-12-12T10:13:39.478 INFO:teuthology.orchestra.run.smithi078.stdout: "dentry_pinned_count": 0, 2023-12-12T10:13:39.478 INFO:teuthology.orchestra.run.smithi078.stdout: "id": 5676, 2023-12-12T10:13:39.478 INFO:teuthology.orchestra.run.smithi078.stdout: "inst": { 2023-12-12T10:13:39.478 INFO:teuthology.orchestra.run.smithi078.stdout: "name": { 2023-12-12T10:13:39.479 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "client", 2023-12-12T10:13:39.479 INFO:teuthology.orchestra.run.smithi078.stdout: "num": 5676 2023-12-12T10:13:39.479 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-12-12T10:13:39.479 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": { 2023-12-12T10:13:39.479 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v1", 2023-12-12T10:13:39.479 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "192.168.0.1:0", 2023-12-12T10:13:39.479 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 3604108592 2023-12-12T10:13:39.479 INFO:teuthology.orchestra.run.smithi078.stdout: } 2023-12-12T10:13:39.479 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-12-12T10:13:39.479 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": { 2023-12-12T10:13:39.479 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "v1", 2023-12-12T10:13:39.479 INFO:teuthology.orchestra.run.smithi078.stdout: "addr": "192.168.0.1:0", 2023-12-12T10:13:39.479 INFO:teuthology.orchestra.run.smithi078.stdout: "nonce": 3604108592 2023-12-12T10:13:39.479 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2023-12-12T10:13:39.480 INFO:teuthology.orchestra.run.smithi078.stdout: "inst_str": "client.5676 192.168.0.1:0/3604108592", 2023-12-12T10:13:39.480 INFO:teuthology.orchestra.run.smithi078.stdout: "addr_str": "192.168.0.1:0/3604108592", 2023-12-12T10:13:39.480 INFO:teuthology.orchestra.run.smithi078.stdout: "inode_count": 1, 2023-12-12T10:13:39.480 INFO:teuthology.orchestra.run.smithi078.stdout: "mds_epoch": 17, 2023-12-12T10:13:39.480 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_epoch": 39, 2023-12-12T10:13:39.480 INFO:teuthology.orchestra.run.smithi078.stdout: "osd_epoch_barrier": 0, 2023-12-12T10:13:39.480 INFO:teuthology.orchestra.run.smithi078.stdout: "blocklisted": false, 2023-12-12T10:13:39.480 INFO:teuthology.orchestra.run.smithi078.stdout: "fs_name": "cephfs" 2023-12-12T10:13:39.480 INFO:teuthology.orchestra.run.smithi078.stdout:} 2023-12-12T10:13:39.493 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T10:13:39.493 DEBUG:teuthology.orchestra.run.smithi078:> stat --file-system '--printf=%T 2023-12-12T10:13:39.493 DEBUG:teuthology.orchestra.run.smithi078:> ' -- /home/ubuntu/cephtest/mnt.0 2023-12-12T10:13:39.504 INFO:teuthology.orchestra.run.smithi078.stdout:fuseblk 2023-12-12T10:13:39.504 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-12-12T10:13:39.505 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T10:13:39.505 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-12T10:13:39.572 DEBUG:teuthology.orchestra.run.smithi078:> mktemp -d --suffix=xfstests-dev 2023-12-12T10:13:39.627 INFO:teuthology.orchestra.run.smithi078.stdout:/tmp/tmp.GmWnCxuSqIxfstests-dev 2023-12-12T10:13:39.627 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T10:13:39.627 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo chmod a+rx /tmp/tmp.GmWnCxuSqIxfstests-dev) 2023-12-12T10:13:39.697 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T10:13:39.697 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone https://git.ceph.com/xfstests-dev.git --depth 1 /tmp/tmp.GmWnCxuSqIxfstests-dev) 2023-12-12T10:13:39.757 INFO:teuthology.orchestra.run.smithi078.stderr:Cloning into '/tmp/tmp.GmWnCxuSqIxfstests-dev'... 2023-12-12T10:13:40.582 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T10:13:40.583 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir test) 2023-12-12T10:13:40.645 DEBUG:teuthology.orchestra.run.smithi078:> mktemp -d --suffix=test 2023-12-12T10:13:40.695 INFO:teuthology.orchestra.run.smithi078.stdout:/tmp/tmp.Rxjq0xhkP8test 2023-12-12T10:13:40.695 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T10:13:40.696 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir scratch) 2023-12-12T10:13:40.751 DEBUG:teuthology.orchestra.run.smithi078:> mktemp -d --suffix=scratch 2023-12-12T10:13:40.803 INFO:teuthology.orchestra.run.smithi078.stdout:/tmp/tmp.iBdkoSgoqVscratch 2023-12-12T10:13:40.804 INFO:tasks.cephfs.xfstests_dev:distro and version detected is "ubuntu" and "22.04". 2023-12-12T10:13:40.804 DEBUG:teuthology.orchestra.run.smithi078:> sudo apt-get install -y acl attr automake bc dbench dump e2fsprogs fio gawk gcc git indent libacl1-dev libaio-dev libcap-dev libgdbm-dev libtool libtool-bin liburing-dev libuuid1 lvm2 make psmisc python3 quota sed uuid-dev uuid-runtime xfsprogs sqlite3 exfatprogs f2fs-tools ocfs2-tools udftools xfsdump xfslibs-dev 2023-12-12T10:13:40.921 INFO:teuthology.orchestra.run.smithi078.stdout:Reading package lists... 2023-12-12T10:13:41.097 INFO:teuthology.orchestra.run.smithi078.stdout:Building dependency tree... 2023-12-12T10:13:41.097 INFO:teuthology.orchestra.run.smithi078.stdout:Reading state information... 2023-12-12T10:13:41.252 INFO:teuthology.orchestra.run.smithi078.stdout:acl is already the newest version (2.3.1-1). 2023-12-12T10:13:41.252 INFO:teuthology.orchestra.run.smithi078.stdout:acl set to manually installed. 2023-12-12T10:13:41.252 INFO:teuthology.orchestra.run.smithi078.stdout:attr is already the newest version (1:2.5.1-1build1). 2023-12-12T10:13:41.252 INFO:teuthology.orchestra.run.smithi078.stdout:automake is already the newest version (1:1.16.5-1.3). 2023-12-12T10:13:41.253 INFO:teuthology.orchestra.run.smithi078.stdout:bc is already the newest version (1.07.1-3build1). 2023-12-12T10:13:41.253 INFO:teuthology.orchestra.run.smithi078.stdout:gcc is already the newest version (4:11.2.0-1ubuntu1). 2023-12-12T10:13:41.253 INFO:teuthology.orchestra.run.smithi078.stdout:gcc set to manually installed. 2023-12-12T10:13:41.253 INFO:teuthology.orchestra.run.smithi078.stdout:libacl1-dev is already the newest version (2.3.1-1). 2023-12-12T10:13:41.253 INFO:teuthology.orchestra.run.smithi078.stdout:libaio-dev is already the newest version (0.3.112-13build1). 2023-12-12T10:13:41.253 INFO:teuthology.orchestra.run.smithi078.stdout:libtool is already the newest version (2.4.6-15build2). 2023-12-12T10:13:41.253 INFO:teuthology.orchestra.run.smithi078.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-12-12T10:13:41.253 INFO:teuthology.orchestra.run.smithi078.stdout:libuuid1 is already the newest version (2.37.2-4ubuntu3). 2023-12-12T10:13:41.253 INFO:teuthology.orchestra.run.smithi078.stdout:lvm2 is already the newest version (2.03.11-2.1ubuntu4). 2023-12-12T10:13:41.253 INFO:teuthology.orchestra.run.smithi078.stdout:make is already the newest version (4.3-4.1build1). 2023-12-12T10:13:41.253 INFO:teuthology.orchestra.run.smithi078.stdout:make set to manually installed. 2023-12-12T10:13:41.253 INFO:teuthology.orchestra.run.smithi078.stdout:psmisc is already the newest version (23.4-2build3). 2023-12-12T10:13:41.253 INFO:teuthology.orchestra.run.smithi078.stdout:quota is already the newest version (4.06-1build2). 2023-12-12T10:13:41.253 INFO:teuthology.orchestra.run.smithi078.stdout:sed is already the newest version (4.8-1ubuntu2). 2023-12-12T10:13:41.254 INFO:teuthology.orchestra.run.smithi078.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-12-12T10:13:41.254 INFO:teuthology.orchestra.run.smithi078.stdout:uuid-runtime is already the newest version (2.37.2-4ubuntu3). 2023-12-12T10:13:41.254 INFO:teuthology.orchestra.run.smithi078.stdout:xfsdump is already the newest version (3.1.9+0+nmu2). 2023-12-12T10:13:41.254 INFO:teuthology.orchestra.run.smithi078.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-12-12T10:13:41.254 INFO:teuthology.orchestra.run.smithi078.stdout:xfsprogs is already the newest version (5.13.0-1ubuntu2). 2023-12-12T10:13:41.254 INFO:teuthology.orchestra.run.smithi078.stdout:dbench is already the newest version (4.0-2build1). 2023-12-12T10:13:41.254 INFO:teuthology.orchestra.run.smithi078.stdout:dump is already the newest version (0.4b47-3). 2023-12-12T10:13:41.254 INFO:teuthology.orchestra.run.smithi078.stdout:e2fsprogs is already the newest version (1.46.5-2ubuntu1.1). 2023-12-12T10:13:41.254 INFO:teuthology.orchestra.run.smithi078.stdout:git is already the newest version (1:2.34.1-1ubuntu1.10). 2023-12-12T10:13:41.254 INFO:teuthology.orchestra.run.smithi078.stdout:indent is already the newest version (2.2.12-1ubuntu0.22.04.1). 2023-12-12T10:13:41.254 INFO:teuthology.orchestra.run.smithi078.stdout:python3 is already the newest version (3.10.6-1~22.04). 2023-12-12T10:13:41.254 INFO:teuthology.orchestra.run.smithi078.stdout:The following packages were automatically installed and are no longer required: 2023-12-12T10:13:41.254 INFO:teuthology.orchestra.run.smithi078.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libiscsi7 libpmemobj1 2023-12-12T10:13:41.254 INFO:teuthology.orchestra.run.smithi078.stdout: libpython2-dev libpython2-stdlib libpython2.7 libpython2.7-dev 2023-12-12T10:13:41.255 INFO:teuthology.orchestra.run.smithi078.stdout: libpython2.7-minimal libpython2.7-stdlib linux-image-5.4.0-135-generic 2023-12-12T10:13:41.255 INFO:teuthology.orchestra.run.smithi078.stdout: linux-modules-5.4.0-135-generic python2 python2-dev python2-minimal 2023-12-12T10:13:41.255 INFO:teuthology.orchestra.run.smithi078.stdout: python2.7 python2.7-dev python2.7-minimal 2023-12-12T10:13:41.255 INFO:teuthology.orchestra.run.smithi078.stdout:Use 'sudo apt autoremove' to remove them. 2023-12-12T10:13:41.256 INFO:teuthology.orchestra.run.smithi078.stdout:The following additional packages will be installed: 2023-12-12T10:13:41.256 INFO:teuthology.orchestra.run.smithi078.stdout: libcap2 libcmap4 libcorosync-common4 libdlm3 libpmemblk1 libqb100 2023-12-12T10:13:41.256 INFO:teuthology.orchestra.run.smithi078.stdout:Suggested packages: 2023-12-12T10:13:41.256 INFO:teuthology.orchestra.run.smithi078.stdout: gnuplot gfio python-scipy gawk-doc sqlite3-doc dvd+rw-tools udfclient 2023-12-12T10:13:41.295 INFO:teuthology.orchestra.run.smithi078.stdout:The following NEW packages will be installed: 2023-12-12T10:13:41.295 INFO:teuthology.orchestra.run.smithi078.stdout: exfatprogs f2fs-tools fio libcap-dev libcmap4 libcorosync-common4 libdlm3 2023-12-12T10:13:41.296 INFO:teuthology.orchestra.run.smithi078.stdout: libgdbm-dev libpmemblk1 libqb100 liburing-dev ocfs2-tools sqlite3 udftools 2023-12-12T10:13:41.297 INFO:teuthology.orchestra.run.smithi078.stdout:The following packages will be upgraded: 2023-12-12T10:13:41.298 INFO:teuthology.orchestra.run.smithi078.stdout: gawk libcap2 2023-12-12T10:13:41.397 INFO:teuthology.orchestra.run.smithi078.stdout:2 upgraded, 14 newly installed, 0 to remove and 263 not upgraded. 2023-12-12T10:13:41.397 INFO:teuthology.orchestra.run.smithi078.stdout:Need to get 6,641 kB of archives. 2023-12-12T10:13:41.397 INFO:teuthology.orchestra.run.smithi078.stdout:After this operation, 14.2 MB of additional disk space will be used. 2023-12-12T10:13:41.397 INFO:teuthology.orchestra.run.smithi078.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 gawk amd64 1:5.1.0-1ubuntu0.1 [447 kB] 2023-12-12T10:13:41.509 INFO:teuthology.orchestra.run.smithi078.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 libcorosync-common4 amd64 3.1.6-1ubuntu1 [7,322 B] 2023-12-12T10:13:41.509 INFO:teuthology.orchestra.run.smithi078.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqb100 amd64 2.0.4-1ubuntu0.2 [74.2 kB] 2023-12-12T10:13:41.511 INFO:teuthology.orchestra.run.smithi078.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 libcmap4 amd64 3.1.6-1ubuntu1 [10.4 kB] 2023-12-12T10:13:41.511 INFO:teuthology.orchestra.run.smithi078.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 libdlm3 amd64 4.1.1-1build1 [14.4 kB] 2023-12-12T10:13:41.512 INFO:teuthology.orchestra.run.smithi078.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 ocfs2-tools amd64 1.8.7-1build1 [646 kB] 2023-12-12T10:13:41.534 INFO:teuthology.orchestra.run.smithi078.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libcap2 amd64 1:2.44-1ubuntu0.22.04.1 [18.3 kB] 2023-12-12T10:13:41.534 INFO:teuthology.orchestra.run.smithi078.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 exfatprogs amd64 1.1.3-1 [40.3 kB] 2023-12-12T10:13:41.535 INFO:teuthology.orchestra.run.smithi078.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/universe amd64 f2fs-tools amd64 1.14.0-2build1 [169 kB] 2023-12-12T10:13:41.539 INFO:teuthology.orchestra.run.smithi078.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libpmemblk1 amd64 1.11.1-3build1 [65.6 kB] 2023-12-12T10:13:41.541 INFO:teuthology.orchestra.run.smithi078.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 fio amd64 3.28-1 [4,047 kB] 2023-12-12T10:13:41.586 INFO:teuthology.orchestra.run.smithi078.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libcap-dev amd64 1:2.44-1ubuntu0.22.04.1 [39.4 kB] 2023-12-12T10:13:41.587 INFO:teuthology.orchestra.run.smithi078.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libgdbm-dev amd64 1.23-1 [117 kB] 2023-12-12T10:13:41.588 INFO:teuthology.orchestra.run.smithi078.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 liburing-dev amd64 2.1-2build1 [51.8 kB] 2023-12-12T10:13:41.589 INFO:teuthology.orchestra.run.smithi078.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 sqlite3 amd64 3.37.2-2ubuntu0.1 [768 kB] 2023-12-12T10:13:41.596 INFO:teuthology.orchestra.run.smithi078.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 udftools amd64 2.3-1 [125 kB] 2023-12-12T10:13:41.857 INFO:teuthology.orchestra.run.smithi078.stderr:debconf: unable to initialize frontend: Dialog 2023-12-12T10:13:41.857 INFO:teuthology.orchestra.run.smithi078.stderr:debconf: (Dialog frontend will not work on a dumb terminal, an emacs shell buffer, or without a controlling terminal.) 2023-12-12T10:13:41.857 INFO:teuthology.orchestra.run.smithi078.stderr:debconf: falling back to frontend: Readline 2023-12-12T10:13:41.872 INFO:teuthology.orchestra.run.smithi078.stderr:debconf: unable to initialize frontend: Readline 2023-12-12T10:13:41.872 INFO:teuthology.orchestra.run.smithi078.stderr:debconf: (This frontend requires a controlling tty.) 2023-12-12T10:13:41.872 INFO:teuthology.orchestra.run.smithi078.stderr:debconf: falling back to frontend: Teletype 2023-12-12T10:13:41.879 INFO:teuthology.orchestra.run.smithi078.stderr:dpkg-preconfigure: unable to re-open stdin: 2023-12-12T10:13:41.917 INFO:teuthology.orchestra.run.smithi078.stdout:Fetched 6,641 kB in 0s (22.7 MB/s) 2023-12-12T10:13:42.182 INFO:teuthology.orchestra.run.smithi078.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 143366 files and directories currently installed.) 2023-12-12T10:13:42.186 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../0-gawk_1%3a5.1.0-1ubuntu0.1_amd64.deb ... 2023-12-12T10:13:42.322 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking gawk (1:5.1.0-1ubuntu0.1) over (1:5.1.0-1build3) ... 2023-12-12T10:13:42.917 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libcorosync-common4:amd64. 2023-12-12T10:13:42.932 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../1-libcorosync-common4_3.1.6-1ubuntu1_amd64.deb ... 2023-12-12T10:13:43.018 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libcorosync-common4:amd64 (3.1.6-1ubuntu1) ... 2023-12-12T10:13:43.368 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libqb100:amd64. 2023-12-12T10:13:43.383 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../2-libqb100_2.0.4-1ubuntu0.2_amd64.deb ... 2023-12-12T10:13:43.429 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libqb100:amd64 (2.0.4-1ubuntu0.2) ... 2023-12-12T10:13:43.724 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libcmap4:amd64. 2023-12-12T10:13:43.739 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../3-libcmap4_3.1.6-1ubuntu1_amd64.deb ... 2023-12-12T10:13:43.774 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libcmap4:amd64 (3.1.6-1ubuntu1) ... 2023-12-12T10:13:44.128 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libdlm3:amd64. 2023-12-12T10:13:44.143 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../4-libdlm3_4.1.1-1build1_amd64.deb ... 2023-12-12T10:13:44.186 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libdlm3:amd64 (4.1.1-1build1) ... 2023-12-12T10:13:44.624 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ocfs2-tools. 2023-12-12T10:13:44.640 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../5-ocfs2-tools_1.8.7-1build1_amd64.deb ... 2023-12-12T10:13:44.682 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ocfs2-tools (1.8.7-1build1) ... 2023-12-12T10:13:45.128 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../6-libcap2_1%3a2.44-1ubuntu0.22.04.1_amd64.deb ... 2023-12-12T10:13:45.263 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libcap2:amd64 (1:2.44-1ubuntu0.22.04.1) over (1:2.44-1build3) ... 2023-12-12T10:13:45.614 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libcap2:amd64 (1:2.44-1ubuntu0.22.04.1) ... 2023-12-12T10:13:45.930 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package exfatprogs. 2023-12-12T10:13:46.012 INFO:teuthology.orchestra.run.smithi078.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 143440 files and directories currently installed.) 2023-12-12T10:13:46.016 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../0-exfatprogs_1.1.3-1_amd64.deb ... 2023-12-12T10:13:46.062 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking exfatprogs (1.1.3-1) ... 2023-12-12T10:13:46.375 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package f2fs-tools. 2023-12-12T10:13:46.390 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../1-f2fs-tools_1.14.0-2build1_amd64.deb ... 2023-12-12T10:13:46.475 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking f2fs-tools (1.14.0-2build1) ... 2023-12-12T10:13:46.862 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libpmemblk1:amd64. 2023-12-12T10:13:46.878 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../2-libpmemblk1_1.11.1-3build1_amd64.deb ... 2023-12-12T10:13:46.920 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libpmemblk1:amd64 (1.11.1-3build1) ... 2023-12-12T10:13:47.299 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package fio. 2023-12-12T10:13:47.315 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../3-fio_3.28-1_amd64.deb ... 2023-12-12T10:13:47.357 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking fio (3.28-1) ... 2023-12-12T10:13:47.795 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libcap-dev:amd64. 2023-12-12T10:13:47.810 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../4-libcap-dev_1%3a2.44-1ubuntu0.22.04.1_amd64.deb ... 2023-12-12T10:13:47.853 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libcap-dev:amd64 (1:2.44-1ubuntu0.22.04.1) ... 2023-12-12T10:13:48.267 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libgdbm-dev:amd64. 2023-12-12T10:13:48.283 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../5-libgdbm-dev_1.23-1_amd64.deb ... 2023-12-12T10:13:48.325 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libgdbm-dev:amd64 (1.23-1) ... 2023-12-12T10:13:48.629 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package liburing-dev:amd64. 2023-12-12T10:13:48.645 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../6-liburing-dev_2.1-2build1_amd64.deb ... 2023-12-12T10:13:48.714 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking liburing-dev:amd64 (2.1-2build1) ... 2023-12-12T10:13:48.966 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package sqlite3. 2023-12-12T10:13:48.982 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../7-sqlite3_3.37.2-2ubuntu0.1_amd64.deb ... 2023-12-12T10:13:49.024 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking sqlite3 (3.37.2-2ubuntu0.1) ... 2023-12-12T10:13:49.436 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package udftools. 2023-12-12T10:13:49.452 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../8-udftools_2.3-1_amd64.deb ... 2023-12-12T10:13:49.508 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking udftools (2.3-1) ... 2023-12-12T10:13:49.837 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up exfatprogs (1.1.3-1) ... 2023-12-12T10:13:49.966 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up gawk (1:5.1.0-1ubuntu0.1) ... 2023-12-12T10:13:50.218 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up f2fs-tools (1.14.0-2build1) ... 2023-12-12T10:13:50.344 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libqb100:amd64 (2.0.4-1ubuntu0.2) ... 2023-12-12T10:13:50.470 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libcorosync-common4:amd64 (3.1.6-1ubuntu1) ... 2023-12-12T10:13:50.597 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libpmemblk1:amd64 (1.11.1-3build1) ... 2023-12-12T10:13:50.748 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up udftools (2.3-1) ... 2023-12-12T10:13:50.899 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libdlm3:amd64 (4.1.1-1build1) ... 2023-12-12T10:13:51.025 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libgdbm-dev:amd64 (1.23-1) ... 2023-12-12T10:13:51.185 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libcap-dev:amd64 (1:2.44-1ubuntu0.22.04.1) ... 2023-12-12T10:13:51.311 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up sqlite3 (3.37.2-2ubuntu0.1) ... 2023-12-12T10:13:51.454 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up liburing-dev:amd64 (2.1-2build1) ... 2023-12-12T10:13:51.613 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libcmap4:amd64 (3.1.6-1ubuntu1) ... 2023-12-12T10:13:51.740 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up fio (3.28-1) ... 2023-12-12T10:13:52.300 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ocfs2-tools (1.8.7-1build1) ... 2023-12-12T10:13:52.543 INFO:teuthology.orchestra.run.smithi078.stdout:debconf: unable to initialize frontend: Dialog 2023-12-12T10:13:52.544 INFO:teuthology.orchestra.run.smithi078.stdout:debconf: (Dialog frontend will not work on a dumb terminal, an emacs shell buffer, or without a controlling terminal.) 2023-12-12T10:13:52.544 INFO:teuthology.orchestra.run.smithi078.stdout:debconf: falling back to frontend: Readline 2023-12-12T10:13:53.595 INFO:teuthology.orchestra.run.smithi078.stdout:Processing triggers for initramfs-tools (0.140ubuntu13.1) ... 2023-12-12T10:13:53.687 INFO:teuthology.orchestra.run.smithi078.stdout:update-initramfs: Generating /boot/initrd.img-6.6.0-gcd68252d7b4d 2023-12-12T10:14:07.258 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T10:14:07.264 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T10:14:08.694 INFO:teuthology.orchestra.run.smithi078.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-12-12T10:14:08.845 INFO:teuthology.orchestra.run.smithi078.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-12-12T10:14:10.298 INFO:teuthology.orchestra.run.smithi078.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-12-12T10:14:10.855 DEBUG:teuthology.orchestra.run.smithi078:> sudo useradd -m fsgqa 2023-12-12T10:14:10.875 INFO:teuthology.orchestra.run.smithi078.stderr:useradd: user 'fsgqa' already exists 2023-12-12T10:14:10.877 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-12-12T10:14:10.877 DEBUG:teuthology.orchestra.run.smithi078:> sudo groupadd fsgqa 2023-12-12T10:14:10.937 INFO:teuthology.orchestra.run.smithi078.stderr:groupadd: group 'fsgqa' already exists 2023-12-12T10:14:10.939 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-12-12T10:14:10.939 DEBUG:teuthology.orchestra.run.smithi078:> sudo useradd fsgqa2 2023-12-12T10:14:11.397 DEBUG:teuthology.orchestra.run.smithi078:> sudo useradd 123456-fsgqa 2023-12-12T10:14:11.801 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json mon dump 2023-12-12T10:14:11.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:11.932+0000 7f3b08c79640 1 Processor -- start 2023-12-12T10:14:11.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:11.932+0000 7f3b08c79640 1 -- start start 2023-12-12T10:14:11.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:11.932+0000 7f3b08c79640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3b040cb7e0 0x7f3b040b40c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:14:11.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:11.932+0000 7f3b08c79640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f3b040b4600 0x7f3b041580a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:14:11.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:11.932+0000 7f3b08c79640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b040ae1f0 con 0x7f3b040ade10 2023-12-12T10:14:11.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:11.932+0000 7f3b08c79640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b040b4a80 con 0x7f3b040b4600 2023-12-12T10:14:11.940 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:11.932+0000 7f3b08c79640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b0415c410 con 0x7f3b040cb7e0 2023-12-12T10:14:11.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:11.936+0000 7f3af9d9b640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3b040cb7e0 0x7f3b040b40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:14:11.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:11.936+0000 7f3b02d9d640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f3b040b4600 0x7f3b041580a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:14:11.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:11.936+0000 7f3af9d9b640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3b040cb7e0 0x7f3b040b40c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.78:38288/0 (socket says 172.21.15.78:38288) 2023-12-12T10:14:11.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:11.936+0000 7f3b0259c640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f3b040ade10 0x7f3b040ce5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.78:45068/0 (socket says 172.21.15.78:45068) 2023-12-12T10:14:11.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:11.936+0000 7f3af9d9b640 1 -- 172.21.15.78:0/2731332340 learned_addr learned my addr 172.21.15.78:0/2731332340 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:14:11.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:11.936+0000 7f3af9d9b640 1 -- 172.21.15.78:0/2731332340 >> v2:172.21.15.187:3300/0 conn(0x7f3b040b4600 msgr2=0x7f3b041580a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:14:11.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:11.936+0000 7f3af9d9b640 1 --2- 172.21.15.78:0/2731332340 >> v2:172.21.15.187:3300/0 conn(0x7f3b040b4600 0x7f3b041580a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:14:11.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:11.936+0000 7f3af9d9b640 1 -- 172.21.15.78:0/2731332340 >> v1:172.21.15.187:6789/0 conn(0x7f3b040ade10 legacy=0x7f3b040ce5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:14:11.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:11.936+0000 7f3af9d9b640 1 -- 172.21.15.78:0/2731332340 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b0415b800 con 0x7f3b040cb7e0 2023-12-12T10:14:11.941 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:11.936+0000 7f3b02d9d640 1 --2- 172.21.15.78:0/2731332340 >> v2:172.21.15.187:3300/0 conn(0x7f3b040b4600 0x7f3b041580a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-12T10:14:11.943 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:11.940+0000 7f3af9d9b640 1 --2- 172.21.15.78:0/2731332340 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3b040cb7e0 0x7f3b040b40c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3aec009870 tx=0x7f3aec01c360 comp rx=0 tx=0).ready entity=mon.2 client_cookie=912ee37df5f99ce3 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:14:11.944 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:11.940+0000 7f3b01d9b640 1 -- 172.21.15.78:0/2731332340 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aec0ab600 con 0x7f3b040cb7e0 2023-12-12T10:14:11.944 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:11.940+0000 7f3b01d9b640 1 -- 172.21.15.78:0/2731332340 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3aec0a7050 con 0x7f3b040cb7e0 2023-12-12T10:14:11.944 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:11.940+0000 7f3b01d9b640 1 -- 172.21.15.78:0/2731332340 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aec0ab980 con 0x7f3b040cb7e0 2023-12-12T10:14:11.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:11.940+0000 7f3b08c79640 1 -- 172.21.15.78:0/2731332340 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3b040cb7e0 msgr2=0x7f3b040b40c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:14:11.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:11.940+0000 7f3b08c79640 1 --2- 172.21.15.78:0/2731332340 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3b040cb7e0 0x7f3b040b40c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3aec009870 tx=0x7f3aec01c360 comp rx=0 tx=0).stop 2023-12-12T10:14:11.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:11.940+0000 7f3b08c79640 1 -- 172.21.15.78:0/2731332340 shutdown_connections 2023-12-12T10:14:11.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:11.940+0000 7f3b08c79640 1 --2- 172.21.15.78:0/2731332340 >> v2:172.21.15.187:3300/0 conn(0x7f3b040b4600 0x7f3b041580a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:14:11.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:11.940+0000 7f3b08c79640 1 --2- 172.21.15.78:0/2731332340 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3b040cb7e0 0x7f3b040b40c0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:14:11.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:11.940+0000 7f3b08c79640 1 -- 172.21.15.78:0/2731332340 >> 172.21.15.78:0/2731332340 conn(0x7f3b0406c5d0 msgr2=0x7f3b0406c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:14:11.946 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:11.940+0000 7f3b08c79640 1 -- 172.21.15.78:0/2731332340 shutdown_connections 2023-12-12T10:14:11.946 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:11.940+0000 7f3b08c79640 1 -- 172.21.15.78:0/2731332340 wait complete. 2023-12-12T10:14:11.946 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:11.940+0000 7f3b08c79640 1 Processor -- start 2023-12-12T10:14:11.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:11.940+0000 7f3b08c79640 1 -- start start 2023-12-12T10:14:11.949 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:11.940+0000 7f3b08c79640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3b040ade10 0x7f3b041577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:14:11.949 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:11.940+0000 7f3b08c79640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3b040b4600 0x7f3b041f4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:14:11.949 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:11.944+0000 7f3b08c79640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b040cb7e0 0x7f3b041f5500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:14:11.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:11.944+0000 7f3b08c79640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b0414d8f0 con 0x7f3b040cb7e0 2023-12-12T10:14:11.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:11.944+0000 7f3b08c79640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b0414eae0 con 0x7f3b040ade10 2023-12-12T10:14:11.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:11.944+0000 7f3b08c79640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b0414edc0 con 0x7f3b040b4600 2023-12-12T10:14:11.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:11.944+0000 7f3b02d9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b040cb7e0 0x7f3b041f5500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:14:11.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:11.944+0000 7f3b0259c640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3b040ade10 0x7f3b041577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:14:11.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:11.944+0000 7f3af9d9b640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3b040b4600 0x7f3b041f4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:14:11.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:11.944+0000 7f3b02d9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b040cb7e0 0x7f3b041f5500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47144/0 (socket says 172.21.15.78:47144) 2023-12-12T10:14:11.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:11.944+0000 7f3b02d9d640 1 -- 172.21.15.78:0/1117975858 learned_addr learned my addr 172.21.15.78:0/1117975858 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:14:11.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:11.944+0000 7f3b0259c640 1 -- 172.21.15.78:0/1117975858 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3b040b4600 msgr2=0x7f3b041f4fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:14:11.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:11.944+0000 7f3b0259c640 1 --2- 172.21.15.78:0/1117975858 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3b040b4600 0x7f3b041f4fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:14:11.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:11.944+0000 7f3b0259c640 1 -- 172.21.15.78:0/1117975858 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b040cb7e0 msgr2=0x7f3b041f5500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:14:11.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:11.944+0000 7f3b0259c640 1 --2- 172.21.15.78:0/1117975858 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b040cb7e0 0x7f3b041f5500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:14:11.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:11.944+0000 7f3b0259c640 1 -- 172.21.15.78:0/1117975858 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3afc009a70 con 0x7f3b040ade10 2023-12-12T10:14:11.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:11.944+0000 7f3b0259c640 1 --2- 172.21.15.78:0/1117975858 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3b040ade10 0x7f3b041577f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f3af400c430 tx=0x7f3af400c8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:14:11.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:11.944+0000 7f3afb7fe640 1 -- 172.21.15.78:0/1117975858 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af40074e0 con 0x7f3b040ade10 2023-12-12T10:14:11.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:11.944+0000 7f3afb7fe640 1 -- 172.21.15.78:0/1117975858 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3af4007640 con 0x7f3b040ade10 2023-12-12T10:14:11.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:11.944+0000 7f3b08c79640 1 -- 172.21.15.78:0/1117975858 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3aec0094d0 con 0x7f3b040ade10 2023-12-12T10:14:11.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:11.944+0000 7f3afb7fe640 1 -- 172.21.15.78:0/1117975858 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af4004a10 con 0x7f3b040ade10 2023-12-12T10:14:11.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:11.944+0000 7f3b08c79640 1 -- 172.21.15.78:0/1117975858 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b0414f380 con 0x7f3b040ade10 2023-12-12T10:14:11.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:11.944+0000 7f3b08c79640 1 -- 172.21.15.78:0/1117975858 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b040671f0 con 0x7f3b040ade10 2023-12-12T10:14:11.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:11.944+0000 7f3afb7fe640 1 -- 172.21.15.78:0/1117975858 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3af4004b70 con 0x7f3b040ade10 2023-12-12T10:14:11.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:11.948+0000 7f3afb7fe640 1 --2- 172.21.15.78:0/1117975858 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f3ae4066470 0x7f3ae4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:14:11.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:11.948+0000 7f3afb7fe640 1 -- 172.21.15.78:0/1117975858 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f3af4083870 con 0x7f3b040ade10 2023-12-12T10:14:11.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:11.948+0000 7f3af9d9b640 1 --2- 172.21.15.78:0/1117975858 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f3ae4066470 0x7f3ae4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:14:11.953 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:11.948+0000 7f3af9d9b640 1 --2- 172.21.15.78:0/1117975858 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f3ae4066470 0x7f3ae4068930 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f3aec0ad000 tx=0x7f3aec0a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:14:11.958 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:11.952+0000 7f3afb7fe640 1 -- 172.21.15.78:0/1117975858 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3af4050c40 con 0x7f3b040ade10 2023-12-12T10:14:12.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:12.164+0000 7f3b08c79640 1 -- 172.21.15.78:0/1117975858 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f3b04067530 con 0x7f3b040ade10 2023-12-12T10:14:12.169 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:12.164+0000 7f3afb7fe640 1 -- 172.21.15.78:0/1117975858 <== mon.1 v2:172.21.15.187:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+1276 (secure 0 0 0) 0x7f3af4054260 con 0x7f3b040ade10 2023-12-12T10:14:12.169 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:14:12.169 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":1,"fsid":"fc81937c-bd26-483c-952b-d1324fcb0c9e","modified":"2023-12-12T10:11:08.616259Z","created":"2023-12-12T10:11:08.616259Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:3300","nonce":0},{"type":"v1","addr":"172.21.15.78:6789","nonce":0}]},"addr":"172.21.15.78:6789/0","public_addr":"172.21.15.78:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:3300","nonce":0},{"type":"v1","addr":"172.21.15.187:6789","nonce":0}]},"addr":"172.21.15.187:6789/0","public_addr":"172.21.15.187:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:3301","nonce":0},{"type":"v1","addr":"172.21.15.187:6790","nonce":0}]},"addr":"172.21.15.187:6790/0","public_addr":"172.21.15.187:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2023-12-12T10:14:12.169 INFO:teuthology.orchestra.run.smithi078.stderr:dumped monmap epoch 1 2023-12-12T10:14:12.171 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:12.164+0000 7f3b08c79640 1 -- 172.21.15.78:0/1117975858 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f3ae4066470 msgr2=0x7f3ae4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:14:12.171 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:12.164+0000 7f3b08c79640 1 --2- 172.21.15.78:0/1117975858 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f3ae4066470 0x7f3ae4068930 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f3aec0ad000 tx=0x7f3aec0a6000 comp rx=0 tx=0).stop 2023-12-12T10:14:12.171 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:12.164+0000 7f3b08c79640 1 -- 172.21.15.78:0/1117975858 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3b040ade10 msgr2=0x7f3b041577f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:14:12.171 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:12.164+0000 7f3b08c79640 1 --2- 172.21.15.78:0/1117975858 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3b040ade10 0x7f3b041577f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f3af400c430 tx=0x7f3af400c8f0 comp rx=0 tx=0).stop 2023-12-12T10:14:12.171 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:12.164+0000 7f3b08c79640 1 -- 172.21.15.78:0/1117975858 shutdown_connections 2023-12-12T10:14:12.171 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:12.164+0000 7f3b08c79640 1 --2- 172.21.15.78:0/1117975858 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f3ae4066470 0x7f3ae4068930 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:14:12.171 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:12.164+0000 7f3b08c79640 1 --2- 172.21.15.78:0/1117975858 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3b040cb7e0 0x7f3b041f5500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:14:12.171 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:12.164+0000 7f3b08c79640 1 --2- 172.21.15.78:0/1117975858 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3b040b4600 0x7f3b041f4fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:14:12.171 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:12.164+0000 7f3b08c79640 1 --2- 172.21.15.78:0/1117975858 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3b040ade10 0x7f3b041577f0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:14:12.172 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:12.164+0000 7f3b08c79640 1 -- 172.21.15.78:0/1117975858 >> 172.21.15.78:0/1117975858 conn(0x7f3b0406c5d0 msgr2=0x7f3b040af1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:14:12.172 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:12.164+0000 7f3b08c79640 1 -- 172.21.15.78:0/1117975858 shutdown_connections 2023-12-12T10:14:12.172 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:12.164+0000 7f3b08c79640 1 -- 172.21.15.78:0/1117975858 wait complete. 2023-12-12T10:14:12.190 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get client.admin 2023-12-12T10:14:12.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:12.324+0000 7f10aa52a640 1 Processor -- start 2023-12-12T10:14:12.329 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:12.324+0000 7f10aa52a640 1 -- start start 2023-12-12T10:14:12.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:12.324+0000 7f10aa52a640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f10a4143770 0x7f10a40cdf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:14:12.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:12.324+0000 7f10aa52a640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f10a40b1e20 0x7f10a4070f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:14:12.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:12.324+0000 7f10aa52a640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10a4070a70 con 0x7f10a40b2280 2023-12-12T10:14:12.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:12.324+0000 7f10aa52a640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10a415e920 con 0x7f10a40b1e20 2023-12-12T10:14:12.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:12.324+0000 7f10aa52a640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10a4070440 con 0x7f10a4143770 2023-12-12T10:14:12.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:12.324+0000 7f10a37fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f10a40b1e20 0x7f10a4070f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:14:12.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:12.324+0000 7f10a37fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f10a40b1e20 0x7f10a4070f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47154/0 (socket says 172.21.15.78:47154) 2023-12-12T10:14:12.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:12.324+0000 7f10a37fe640 1 -- 172.21.15.78:0/394492360 learned_addr learned my addr 172.21.15.78:0/394492360 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:14:12.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:12.324+0000 7f10a8ac7640 1 --1- 172.21.15.78:0/394492360 >> v1:172.21.15.78:6789/0 conn(0x7f10a40b2280 0x7f10a415a2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:53500/0 (socket says 172.21.15.78:53500) 2023-12-12T10:14:12.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:12.324+0000 7f10a3fff640 1 --2- 172.21.15.78:0/394492360 >> v2:172.21.15.187:3300/0 conn(0x7f10a4143770 0x7f10a40cdf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:14:12.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:12.324+0000 7f10a37fe640 1 -- 172.21.15.78:0/394492360 >> v2:172.21.15.187:3300/0 conn(0x7f10a4143770 msgr2=0x7f10a40cdf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T10:14:12.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:12.324+0000 7f10a37fe640 1 --2- 172.21.15.78:0/394492360 >> v2:172.21.15.187:3300/0 conn(0x7f10a4143770 0x7f10a40cdf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:14:12.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:12.324+0000 7f10a37fe640 1 -- 172.21.15.78:0/394492360 >> v1:172.21.15.78:6789/0 conn(0x7f10a40b2280 legacy=0x7f10a415a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:14:12.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:12.324+0000 7f10a37fe640 1 -- 172.21.15.78:0/394492360 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10a4143b50 con 0x7f10a40b1e20 2023-12-12T10:14:12.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:12.324+0000 7f10a2ffd640 1 -- 172.21.15.78:0/394492360 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2341348019 0 0) 0x7f10a4070a70 con 0x7f10a40b2280 2023-12-12T10:14:12.333 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:12.328+0000 7f10a37fe640 1 --2- 172.21.15.78:0/394492360 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f10a40b1e20 0x7f10a4070f00 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f10a406b500 tx=0x7f109801c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=216047db6a9a7bd6 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:14:12.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:12.328+0000 7f10a2ffd640 1 -- 172.21.15.78:0/394492360 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10980ac640 con 0x7f10a40b1e20 2023-12-12T10:14:12.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:12.328+0000 7f10a2ffd640 1 -- 172.21.15.78:0/394492360 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10980ac7a0 con 0x7f10a40b1e20 2023-12-12T10:14:12.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:12.328+0000 7f10a2ffd640 1 -- 172.21.15.78:0/394492360 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10980acb30 con 0x7f10a40b1e20 2023-12-12T10:14:12.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:12.328+0000 7f10aa52a640 1 -- 172.21.15.78:0/394492360 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f10a40b1e20 msgr2=0x7f10a4070f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:14:12.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:12.328+0000 7f10aa52a640 1 --2- 172.21.15.78:0/394492360 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f10a40b1e20 0x7f10a4070f00 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f10a406b500 tx=0x7f109801c3e0 comp rx=0 tx=0).stop 2023-12-12T10:14:12.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:12.328+0000 7f10aa52a640 1 -- 172.21.15.78:0/394492360 shutdown_connections 2023-12-12T10:14:12.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:12.328+0000 7f10aa52a640 1 --2- 172.21.15.78:0/394492360 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f10a40b1e20 0x7f10a4070f00 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:14:12.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:12.328+0000 7f10aa52a640 1 --2- 172.21.15.78:0/394492360 >> v2:172.21.15.187:3300/0 conn(0x7f10a4143770 0x7f10a40cdf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:14:12.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:12.328+0000 7f10aa52a640 1 -- 172.21.15.78:0/394492360 >> 172.21.15.78:0/394492360 conn(0x7f10a406a710 msgr2=0x7f10a406ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:14:12.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:12.328+0000 7f10aa52a640 1 -- 172.21.15.78:0/394492360 shutdown_connections 2023-12-12T10:14:12.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:12.328+0000 7f10aa52a640 1 -- 172.21.15.78:0/394492360 wait complete. 2023-12-12T10:14:12.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:12.332+0000 7f10aa52a640 1 Processor -- start 2023-12-12T10:14:12.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:12.332+0000 7f10aa52a640 1 -- start start 2023-12-12T10:14:12.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:12.332+0000 7f10aa52a640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f10a40b1e20 0x7f10a41f6f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:14:12.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:12.332+0000 7f10aa52a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f10a40b2280 0x7f10a41592c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:14:12.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:12.332+0000 7f10aa52a640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f10a4143770 0x7f10a41f50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:14:12.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:12.332+0000 7f10aa52a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10a41f5e60 con 0x7f10a40b2280 2023-12-12T10:14:12.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:12.332+0000 7f10aa52a640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10a41f6140 con 0x7f10a4143770 2023-12-12T10:14:12.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:12.332+0000 7f10aa52a640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10a41f6420 con 0x7f10a40b1e20 2023-12-12T10:14:12.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:12.332+0000 7f10a37fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f10a40b2280 0x7f10a41592c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:14:12.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:12.332+0000 7f10a37fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f10a40b2280 0x7f10a41592c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:47166/0 (socket says 172.21.15.78:47166) 2023-12-12T10:14:12.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:12.332+0000 7f10a37fe640 1 -- 172.21.15.78:0/2727451114 learned_addr learned my addr 172.21.15.78:0/2727451114 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T10:14:12.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:12.332+0000 7f10a8ac7640 1 --2- 172.21.15.78:0/2727451114 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f10a4143770 0x7f10a41f50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:14:12.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:12.332+0000 7f10a3fff640 1 --2- 172.21.15.78:0/2727451114 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f10a40b1e20 0x7f10a41f6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:14:12.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:12.332+0000 7f10a37fe640 1 -- 172.21.15.78:0/2727451114 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f10a40b1e20 msgr2=0x7f10a41f6f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:14:12.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:12.332+0000 7f10a37fe640 1 --2- 172.21.15.78:0/2727451114 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f10a40b1e20 0x7f10a41f6f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:14:12.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:12.332+0000 7f10a37fe640 1 -- 172.21.15.78:0/2727451114 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f10a4143770 msgr2=0x7f10a41f50c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:14:12.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:12.332+0000 7f10a37fe640 1 --2- 172.21.15.78:0/2727451114 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f10a4143770 0x7f10a41f50c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:14:12.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:12.332+0000 7f10a37fe640 1 -- 172.21.15.78:0/2727451114 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10980094d0 con 0x7f10a40b2280 2023-12-12T10:14:12.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:12.332+0000 7f10a3fff640 1 --2- 172.21.15.78:0/2727451114 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f10a40b1e20 0x7f10a41f6f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T10:14:12.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:12.332+0000 7f10a8ac7640 1 --2- 172.21.15.78:0/2727451114 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f10a4143770 0x7f10a41f50c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T10:14:12.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:12.332+0000 7f10a37fe640 1 --2- 172.21.15.78:0/2727451114 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f10a40b2280 0x7f10a41592c0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f10980af040 tx=0x7f1098019180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:14:12.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:12.332+0000 7f10a0ff9640 1 -- 172.21.15.78:0/2727451114 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10980b7670 con 0x7f10a40b2280 2023-12-12T10:14:12.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:12.332+0000 7f10a0ff9640 1 -- 172.21.15.78:0/2727451114 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10980b77d0 con 0x7f10a40b2280 2023-12-12T10:14:12.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:12.332+0000 7f10a0ff9640 1 -- 172.21.15.78:0/2727451114 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10980b7b60 con 0x7f10a40b2280 2023-12-12T10:14:12.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:12.332+0000 7f10aa52a640 1 -- 172.21.15.78:0/2727451114 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10a41f6700 con 0x7f10a40b2280 2023-12-12T10:14:12.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:12.332+0000 7f10aa52a640 1 -- 172.21.15.78:0/2727451114 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10a41f7440 con 0x7f10a40b2280 2023-12-12T10:14:12.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:12.336+0000 7f10aa52a640 1 -- 172.21.15.78:0/2727451114 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10a40671f0 con 0x7f10a40b2280 2023-12-12T10:14:12.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:12.336+0000 7f10a0ff9640 1 -- 172.21.15.78:0/2727451114 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f10980b3070 con 0x7f10a40b2280 2023-12-12T10:14:12.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:12.336+0000 7f10a0ff9640 1 --2- 172.21.15.78:0/2727451114 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f1090066470 0x7f1090068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T10:14:12.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:12.336+0000 7f10a0ff9640 1 -- 172.21.15.78:0/2727451114 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f109811e930 con 0x7f10a40b2280 2023-12-12T10:14:12.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:12.336+0000 7f10a3fff640 1 --2- 172.21.15.78:0/2727451114 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f1090066470 0x7f1090068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T10:14:12.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:12.336+0000 7f10a3fff640 1 --2- 172.21.15.78:0/2727451114 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f1090066470 0x7f1090068930 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f10a406d580 tx=0x7f1094008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T10:14:12.346 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:12.340+0000 7f10a0ff9640 1 -- 172.21.15.78:0/2727451114 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f10980ebcd0 con 0x7f10a40b2280 2023-12-12T10:14:12.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:12.540+0000 7f10aa52a640 1 -- 172.21.15.78:0/2727451114 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "auth get", "entity": "client.admin"} v 0) v1 -- 0x7f10a4067530 con 0x7f10a40b2280 2023-12-12T10:14:12.548 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:12.544+0000 7f10a0ff9640 1 -- 172.21.15.78:0/2727451114 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "auth get", "entity": "client.admin"}]=0 v13) v1 ==== 82+0+151 (secure 0 0 0) 0x7f10980b1020 con 0x7f10a40b2280 2023-12-12T10:14:12.548 INFO:teuthology.orchestra.run.smithi078.stdout:[client.admin] 2023-12-12T10:14:12.548 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQC8MXhlGNj4MRAAyhNfkejCH0AJOmIYX6KUZg== 2023-12-12T10:14:12.548 INFO:teuthology.orchestra.run.smithi078.stdout: caps mds = "allow *" 2023-12-12T10:14:12.548 INFO:teuthology.orchestra.run.smithi078.stdout: caps mgr = "allow *" 2023-12-12T10:14:12.548 INFO:teuthology.orchestra.run.smithi078.stdout: caps mon = "allow *" 2023-12-12T10:14:12.548 INFO:teuthology.orchestra.run.smithi078.stdout: caps osd = "allow *" 2023-12-12T10:14:12.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:12.544+0000 7f10aa52a640 1 -- 172.21.15.78:0/2727451114 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f1090066470 msgr2=0x7f1090068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:14:12.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:12.544+0000 7f10aa52a640 1 --2- 172.21.15.78:0/2727451114 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f1090066470 0x7f1090068930 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f10a406d580 tx=0x7f1094008040 comp rx=0 tx=0).stop 2023-12-12T10:14:12.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:12.544+0000 7f10aa52a640 1 -- 172.21.15.78:0/2727451114 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f10a40b2280 msgr2=0x7f10a41592c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T10:14:12.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:12.544+0000 7f10aa52a640 1 --2- 172.21.15.78:0/2727451114 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f10a40b2280 0x7f10a41592c0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f10980af040 tx=0x7f1098019180 comp rx=0 tx=0).stop 2023-12-12T10:14:12.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:12.544+0000 7f10aa52a640 1 -- 172.21.15.78:0/2727451114 shutdown_connections 2023-12-12T10:14:12.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:12.544+0000 7f10aa52a640 1 --2- 172.21.15.78:0/2727451114 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f1090066470 0x7f1090068930 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:14:12.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:12.544+0000 7f10aa52a640 1 --2- 172.21.15.78:0/2727451114 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f10a4143770 0x7f10a41f50c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:14:12.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:12.544+0000 7f10aa52a640 1 --2- 172.21.15.78:0/2727451114 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f10a40b2280 0x7f10a41592c0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:14:12.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:12.544+0000 7f10aa52a640 1 --2- 172.21.15.78:0/2727451114 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f10a40b1e20 0x7f10a41f6f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T10:14:12.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:12.544+0000 7f10aa52a640 1 -- 172.21.15.78:0/2727451114 >> 172.21.15.78:0/2727451114 conn(0x7f10a406a710 msgr2=0x7f10a40cd410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T10:14:12.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:12.544+0000 7f10aa52a640 1 -- 172.21.15.78:0/2727451114 shutdown_connections 2023-12-12T10:14:12.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T10:14:12.544+0000 7f10aa52a640 1 -- 172.21.15.78:0/2727451114 wait complete. 2023-12-12T10:14:12.569 DEBUG:teuthology.orchestra.run.smithi078:> mktemp 2023-12-12T10:14:12.578 INFO:teuthology.orchestra.run.smithi078.stdout:/tmp/tmp.BtsAZDmJwe 2023-12-12T10:14:12.579 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-12-12T10:14:12.579 DEBUG:teuthology.orchestra.run.smithi078:> dd of=/tmp/tmp.BtsAZDmJwe 2023-12-12T10:14:12.632 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-12-12T10:14:12.632 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/tmp/tmp.GmWnCxuSqIxfstests-dev/local.config 2023-12-12T10:14:12.699 INFO:tasks.cephfs.xfstests_dev:local.config's contents - export FSTYP=ceph-fuse export CEPH_FUSE_BIN_PATH=ceph-fuse export TEST_DEV=ceph-fuse # without this tests won't get started export TEST_DIR=/tmp/tmp.Rxjq0xhkP8test export SCRATCH_DEV= export SCRATCH_MNT=/tmp/tmp.iBdkoSgoqVscratch export CEPHFS_MOUNT_OPTIONS="-m 172.21.15.78:6789 -k /tmp/tmp.BtsAZDmJwe --client_mountpoint /test" 2023-12-12T10:14:12.699 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-12-12T10:14:12.699 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/tmp/tmp.GmWnCxuSqIxfstests-dev/ceph.exclude 2023-12-12T10:14:12.759 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo make) 2023-12-12T10:14:12.824 INFO:teuthology.orchestra.run.smithi078.stdout:libtoolize -cfi 2023-12-12T10:14:13.174 INFO:teuthology.orchestra.run.smithi078.stdout:libtoolize: putting auxiliary files in '.'. 2023-12-12T10:14:13.175 INFO:teuthology.orchestra.run.smithi078.stdout:libtoolize: copying file './config.guess' 2023-12-12T10:14:13.184 INFO:teuthology.orchestra.run.smithi078.stdout:libtoolize: copying file './config.sub' 2023-12-12T10:14:13.202 INFO:teuthology.orchestra.run.smithi078.stdout:libtoolize: copying file './install-sh' 2023-12-12T10:14:13.213 INFO:teuthology.orchestra.run.smithi078.stdout:libtoolize: copying file './ltmain.sh' 2023-12-12T10:14:13.263 INFO:teuthology.orchestra.run.smithi078.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2023-12-12T10:14:13.263 INFO:teuthology.orchestra.run.smithi078.stdout:libtoolize: copying file 'm4/libtool.m4' 2023-12-12T10:14:13.276 INFO:teuthology.orchestra.run.smithi078.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2023-12-12T10:14:13.287 INFO:teuthology.orchestra.run.smithi078.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2023-12-12T10:14:13.298 INFO:teuthology.orchestra.run.smithi078.stdout:libtoolize: copying file 'm4/ltversion.m4' 2023-12-12T10:14:13.308 INFO:teuthology.orchestra.run.smithi078.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2023-12-12T10:14:13.319 INFO:teuthology.orchestra.run.smithi078.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2023-12-12T10:14:13.321 INFO:teuthology.orchestra.run.smithi078.stdout:cp include/install-sh . 2023-12-12T10:14:13.323 INFO:teuthology.orchestra.run.smithi078.stdout:aclocal -I m4 2023-12-12T10:14:14.368 INFO:teuthology.orchestra.run.smithi078.stdout:autoheader 2023-12-12T10:14:14.727 INFO:teuthology.orchestra.run.smithi078.stdout:autoconf 2023-12-12T10:14:15.133 INFO:teuthology.orchestra.run.smithi078.stdout:./configure \ 2023-12-12T10:14:15.134 INFO:teuthology.orchestra.run.smithi078.stdout: --libexecdir=/usr/lib \ 2023-12-12T10:14:15.134 INFO:teuthology.orchestra.run.smithi078.stdout: --exec_prefix=/var/lib 2023-12-12T10:14:15.662 INFO:teuthology.orchestra.run.smithi078.stdout:checking build system type... x86_64-pc-linux-gnu 2023-12-12T10:14:15.663 INFO:teuthology.orchestra.run.smithi078.stdout:checking host system type... x86_64-pc-linux-gnu 2023-12-12T10:14:15.717 INFO:teuthology.orchestra.run.smithi078.stdout:checking how to print strings... printf 2023-12-12T10:14:15.717 INFO:teuthology.orchestra.run.smithi078.stdout:checking for gcc... gcc 2023-12-12T10:14:15.956 INFO:teuthology.orchestra.run.smithi078.stdout:checking whether the C compiler works... yes 2023-12-12T10:14:15.956 INFO:teuthology.orchestra.run.smithi078.stdout:checking for C compiler default output file name... a.out 2023-12-12T10:14:15.998 INFO:teuthology.orchestra.run.smithi078.stdout:checking for suffix of executables... 2023-12-12T10:14:16.081 INFO:teuthology.orchestra.run.smithi078.stdout:checking whether we are cross compiling... no 2023-12-12T10:14:16.109 INFO:teuthology.orchestra.run.smithi078.stdout:checking for suffix of object files... o 2023-12-12T10:14:16.133 INFO:teuthology.orchestra.run.smithi078.stdout:checking whether the compiler supports GNU C... yes 2023-12-12T10:14:16.156 INFO:teuthology.orchestra.run.smithi078.stdout:checking whether gcc accepts -g... yes 2023-12-12T10:14:16.265 INFO:teuthology.orchestra.run.smithi078.stdout:checking for gcc option to enable C11 features... none needed 2023-12-12T10:14:16.271 INFO:teuthology.orchestra.run.smithi078.stdout:checking for a sed that does not truncate output... /usr/bin/sed 2023-12-12T10:14:16.279 INFO:teuthology.orchestra.run.smithi078.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2023-12-12T10:14:16.279 INFO:teuthology.orchestra.run.smithi078.stdout:checking for egrep... /usr/bin/grep -E 2023-12-12T10:14:16.281 INFO:teuthology.orchestra.run.smithi078.stdout:checking for fgrep... /usr/bin/grep -F 2023-12-12T10:14:16.289 INFO:teuthology.orchestra.run.smithi078.stdout:checking for ld used by gcc... /usr/bin/ld 2023-12-12T10:14:16.293 INFO:teuthology.orchestra.run.smithi078.stdout:checking if the linker (/usr/bin/ld) is GNU ld... yes 2023-12-12T10:14:16.302 INFO:teuthology.orchestra.run.smithi078.stdout:checking for BSD- or MS-compatible name lister (nm)... /usr/bin/nm -B 2023-12-12T10:14:16.333 INFO:teuthology.orchestra.run.smithi078.stdout:checking the name lister (/usr/bin/nm -B) interface... BSD nm 2023-12-12T10:14:16.334 INFO:teuthology.orchestra.run.smithi078.stdout:checking whether ln -s works... yes 2023-12-12T10:14:16.361 INFO:teuthology.orchestra.run.smithi078.stdout:checking the maximum length of command line arguments... 1572864 2023-12-12T10:14:16.369 INFO:teuthology.orchestra.run.smithi078.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2023-12-12T10:14:16.369 INFO:teuthology.orchestra.run.smithi078.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2023-12-12T10:14:16.369 INFO:teuthology.orchestra.run.smithi078.stdout:checking for /usr/bin/ld option to reload object files... -r 2023-12-12T10:14:16.369 INFO:teuthology.orchestra.run.smithi078.stdout:checking for objdump... objdump 2023-12-12T10:14:16.369 INFO:teuthology.orchestra.run.smithi078.stdout:checking how to recognize dependent libraries... pass_all 2023-12-12T10:14:16.370 INFO:teuthology.orchestra.run.smithi078.stdout:checking for dlltool... no 2023-12-12T10:14:16.370 INFO:teuthology.orchestra.run.smithi078.stdout:checking how to associate runtime and link libraries... printf %s\n 2023-12-12T10:14:16.370 INFO:teuthology.orchestra.run.smithi078.stdout:checking for ar... ar 2023-12-12T10:14:16.436 INFO:teuthology.orchestra.run.smithi078.stdout:checking for archiver @FILE support... @ 2023-12-12T10:14:16.436 INFO:teuthology.orchestra.run.smithi078.stdout:checking for strip... strip 2023-12-12T10:14:16.437 INFO:teuthology.orchestra.run.smithi078.stdout:checking for ranlib... ranlib 2023-12-12T10:14:16.437 INFO:teuthology.orchestra.run.smithi078.stdout:checking for gawk... gawk 2023-12-12T10:14:16.526 INFO:teuthology.orchestra.run.smithi078.stdout:checking command to parse /usr/bin/nm -B output from gcc object... ok 2023-12-12T10:14:16.529 INFO:teuthology.orchestra.run.smithi078.stdout:checking for sysroot... no 2023-12-12T10:14:16.536 INFO:teuthology.orchestra.run.smithi078.stdout:checking for a working dd... /usr/bin/dd 2023-12-12T10:14:16.543 INFO:teuthology.orchestra.run.smithi078.stdout:checking how to truncate binary pipes... /usr/bin/dd bs=4096 count=1 2023-12-12T10:14:16.563 INFO:teuthology.orchestra.run.smithi078.stdout:checking for mt... mt 2023-12-12T10:14:16.583 INFO:teuthology.orchestra.run.smithi078.stdout:checking if mt is a manifest tool... no 2023-12-12T10:14:16.610 INFO:teuthology.orchestra.run.smithi078.stdout:checking for stdio.h... yes 2023-12-12T10:14:16.665 INFO:teuthology.orchestra.run.smithi078.stdout:checking for stdlib.h... yes 2023-12-12T10:14:16.702 INFO:teuthology.orchestra.run.smithi078.stdout:checking for string.h... yes 2023-12-12T10:14:16.743 INFO:teuthology.orchestra.run.smithi078.stdout:checking for inttypes.h... yes 2023-12-12T10:14:16.776 INFO:teuthology.orchestra.run.smithi078.stdout:checking for stdint.h... yes 2023-12-12T10:14:16.809 INFO:teuthology.orchestra.run.smithi078.stdout:checking for strings.h... yes 2023-12-12T10:14:16.844 INFO:teuthology.orchestra.run.smithi078.stdout:checking for sys/stat.h... yes 2023-12-12T10:14:16.877 INFO:teuthology.orchestra.run.smithi078.stdout:checking for sys/types.h... yes 2023-12-12T10:14:16.921 INFO:teuthology.orchestra.run.smithi078.stdout:checking for unistd.h... yes 2023-12-12T10:14:16.960 INFO:teuthology.orchestra.run.smithi078.stdout:checking for dlfcn.h... yes 2023-12-12T10:14:16.965 INFO:teuthology.orchestra.run.smithi078.stdout:checking for objdir... .libs 2023-12-12T10:14:17.081 INFO:teuthology.orchestra.run.smithi078.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2023-12-12T10:14:17.082 INFO:teuthology.orchestra.run.smithi078.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2023-12-12T10:14:17.111 INFO:teuthology.orchestra.run.smithi078.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2023-12-12T10:14:17.326 INFO:teuthology.orchestra.run.smithi078.stdout:checking if gcc static flag -static works... yes 2023-12-12T10:14:17.368 INFO:teuthology.orchestra.run.smithi078.stdout:checking if gcc supports -c -o file.o... yes 2023-12-12T10:14:17.368 INFO:teuthology.orchestra.run.smithi078.stdout:checking if gcc supports -c -o file.o... (cached) yes 2023-12-12T10:14:17.383 INFO:teuthology.orchestra.run.smithi078.stdout:checking whether the gcc linker (/usr/bin/ld -m elf_x86_64) supports shared libraries... yes 2023-12-12T10:14:17.418 INFO:teuthology.orchestra.run.smithi078.stdout:checking whether -lc should be explicitly linked in... no 2023-12-12T10:14:17.514 INFO:teuthology.orchestra.run.smithi078.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2023-12-12T10:14:17.514 INFO:teuthology.orchestra.run.smithi078.stdout:checking how to hardcode library paths into programs... immediate 2023-12-12T10:14:17.523 INFO:teuthology.orchestra.run.smithi078.stdout:checking whether stripping libraries is possible... yes 2023-12-12T10:14:17.523 INFO:teuthology.orchestra.run.smithi078.stdout:checking if libtool supports shared libraries... yes 2023-12-12T10:14:17.523 INFO:teuthology.orchestra.run.smithi078.stdout:checking whether to build shared libraries... yes 2023-12-12T10:14:17.523 INFO:teuthology.orchestra.run.smithi078.stdout:checking whether to build static libraries... yes 2023-12-12T10:14:17.538 INFO:teuthology.orchestra.run.smithi078.stdout:checking for gcc... (cached) gcc 2023-12-12T10:14:17.582 INFO:teuthology.orchestra.run.smithi078.stdout:checking whether the compiler supports GNU C... (cached) yes 2023-12-12T10:14:17.582 INFO:teuthology.orchestra.run.smithi078.stdout:checking whether gcc accepts -g... (cached) yes 2023-12-12T10:14:17.582 INFO:teuthology.orchestra.run.smithi078.stdout:checking for gcc option to enable C11 features... (cached) none needed 2023-12-12T10:14:17.582 INFO:teuthology.orchestra.run.smithi078.stdout:checking for gmake... /usr/bin/gmake 2023-12-12T10:14:17.582 INFO:teuthology.orchestra.run.smithi078.stderr:./configure: line 12754: test: $(SHELL): binary operator expected 2023-12-12T10:14:17.583 INFO:teuthology.orchestra.run.smithi078.stdout:checking for tar... /bin/tar 2023-12-12T10:14:17.583 INFO:teuthology.orchestra.run.smithi078.stdout:checking for gzip... /bin/gzip 2023-12-12T10:14:17.608 INFO:teuthology.orchestra.run.smithi078.stdout:checking whether gcc -MM is supported... yes 2023-12-12T10:14:17.608 INFO:teuthology.orchestra.run.smithi078.stdout:checking for sort... /bin/sort 2023-12-12T10:14:17.608 INFO:teuthology.orchestra.run.smithi078.stdout:checking whether ln -s works... yes 2023-12-12T10:14:17.608 INFO:teuthology.orchestra.run.smithi078.stdout:checking for rpm... no 2023-12-12T10:14:17.645 INFO:teuthology.orchestra.run.smithi078.stdout:checking for assert.h... yes 2023-12-12T10:14:17.687 INFO:teuthology.orchestra.run.smithi078.stdout:checking for bstring.h... no 2023-12-12T10:14:17.725 INFO:teuthology.orchestra.run.smithi078.stdout:checking for libgen.h... yes 2023-12-12T10:14:17.788 INFO:teuthology.orchestra.run.smithi078.stdout:checking for dirent.h... yes 2023-12-12T10:14:17.902 INFO:teuthology.orchestra.run.smithi078.stdout:checking for errno.h... yes 2023-12-12T10:14:17.941 INFO:teuthology.orchestra.run.smithi078.stdout:checking for malloc.h... yes 2023-12-12T10:14:17.983 INFO:teuthology.orchestra.run.smithi078.stdout:checking for uuid.h... no 2023-12-12T10:14:18.040 INFO:teuthology.orchestra.run.smithi078.stdout:checking for uuid/uuid.h... yes 2023-12-12T10:14:18.081 INFO:teuthology.orchestra.run.smithi078.stdout:checking for sys/uuid.h... no 2023-12-12T10:14:18.123 INFO:teuthology.orchestra.run.smithi078.stdout:checking for sys/file.h... yes 2023-12-12T10:14:18.162 INFO:teuthology.orchestra.run.smithi078.stdout:checking for sys/fcntl.h... yes 2023-12-12T10:14:18.205 INFO:teuthology.orchestra.run.smithi078.stdout:checking for sys/syssgi.h... no 2023-12-12T10:14:18.270 INFO:teuthology.orchestra.run.smithi078.stdout:checking for sys/param.h... yes 2023-12-12T10:14:18.271 INFO:teuthology.orchestra.run.smithi078.stdout:checking for sys/stat.h... (cached) yes 2023-12-12T10:14:18.309 INFO:teuthology.orchestra.run.smithi078.stdout:checking for sys/statvfs.h... yes 2023-12-12T10:14:18.346 INFO:teuthology.orchestra.run.smithi078.stdout:checking for sys/time.h... yes 2023-12-12T10:14:18.398 INFO:teuthology.orchestra.run.smithi078.stdout:checking for sys/ioctl.h... yes 2023-12-12T10:14:18.439 INFO:teuthology.orchestra.run.smithi078.stdout:checking for sys/wait.h... yes 2023-12-12T10:14:18.440 INFO:teuthology.orchestra.run.smithi078.stdout:checking for sys/types.h... (cached) yes 2023-12-12T10:14:18.440 INFO:teuthology.orchestra.run.smithi078.stdout:checking for strings.h... (cached) yes 2023-12-12T10:14:18.478 INFO:teuthology.orchestra.run.smithi078.stdout:checking for err.h... yes 2023-12-12T10:14:18.516 INFO:teuthology.orchestra.run.smithi078.stdout:checking for linux/falloc.h... yes 2023-12-12T10:14:18.558 INFO:teuthology.orchestra.run.smithi078.stdout:checking for sys/fs/xfs_fsops.h... no 2023-12-12T10:14:18.599 INFO:teuthology.orchestra.run.smithi078.stdout:checking for sys/fs/xfs_itable.h... no 2023-12-12T10:14:18.641 INFO:teuthology.orchestra.run.smithi078.stdout:checking for xfs/platform_defs.h... no 2023-12-12T10:14:18.683 INFO:teuthology.orchestra.run.smithi078.stdout:checking for btrfs/ioctl.h... no 2023-12-12T10:14:18.724 INFO:teuthology.orchestra.run.smithi078.stdout:checking for cifs/ioctl.h... no 2023-12-12T10:14:18.764 INFO:teuthology.orchestra.run.smithi078.stdout:checking for sys/mman.h... yes 2023-12-12T10:14:18.788 INFO:teuthology.orchestra.run.smithi078.stdout:checking for xfs/xfs_log_format.h... no 2023-12-12T10:14:18.846 INFO:teuthology.orchestra.run.smithi078.stdout:checking for uuid_compare... no 2023-12-12T10:14:18.895 INFO:teuthology.orchestra.run.smithi078.stdout:checking for uuid_compare in -luuid... yes 2023-12-12T10:14:19.019 INFO:teuthology.orchestra.run.smithi078.stdout:checking for xfs/xfs.h... yes 2023-12-12T10:14:19.043 INFO:teuthology.orchestra.run.smithi078.stdout:checking for xfs/libxfs.h... no 2023-12-12T10:14:19.092 INFO:teuthology.orchestra.run.smithi078.stdout:checking for gcc options needed to detect all undeclared functions... none needed 2023-12-12T10:14:19.125 INFO:teuthology.orchestra.run.smithi078.stdout:checking whether xlog_assign_lsn is declared... no 2023-12-12T10:14:19.173 INFO:teuthology.orchestra.run.smithi078.stdout:checking for xfs/xqm.h... yes 2023-12-12T10:14:19.246 INFO:teuthology.orchestra.run.smithi078.stdout:checking xfsctl from xfs/xfs.h... ok 2023-12-12T10:14:19.286 INFO:teuthology.orchestra.run.smithi078.stdout:checking for xfs/handle.h... yes 2023-12-12T10:14:19.336 INFO:teuthology.orchestra.run.smithi078.stdout:checking for attr_list_by_handle in -lhandle... yes 2023-12-12T10:14:19.382 INFO:teuthology.orchestra.run.smithi078.stdout:checking for sys/acl.h... yes 2023-12-12T10:14:19.423 INFO:teuthology.orchestra.run.smithi078.stdout:checking for acl/libacl.h... yes 2023-12-12T10:14:19.473 INFO:teuthology.orchestra.run.smithi078.stdout:checking for acl_init in -lacl... yes 2023-12-12T10:14:19.515 INFO:teuthology.orchestra.run.smithi078.stdout:checking for gdbm-ndbm.h... no 2023-12-12T10:14:19.557 INFO:teuthology.orchestra.run.smithi078.stdout:checking for gdbm/ndbm.h... no 2023-12-12T10:14:19.597 INFO:teuthology.orchestra.run.smithi078.stdout:checking for ndbm.h... no 2023-12-12T10:14:19.639 INFO:teuthology.orchestra.run.smithi078.stdout:checking for libaio.h... yes 2023-12-12T10:14:19.706 INFO:teuthology.orchestra.run.smithi078.stdout:checking for liburing.h... yes 2023-12-12T10:14:19.746 INFO:teuthology.orchestra.run.smithi078.stdout:checking for sys/capability.h... yes 2023-12-12T10:14:19.785 INFO:teuthology.orchestra.run.smithi078.stdout:checking for linux/fiemap.h... yes 2023-12-12T10:14:19.836 INFO:teuthology.orchestra.run.smithi078.stdout:checking for fallocate... yes 2023-12-12T10:14:19.888 INFO:teuthology.orchestra.run.smithi078.stdout:checking for open_by_handle_at... yes 2023-12-12T10:14:19.930 INFO:teuthology.orchestra.run.smithi078.stdout:checking for sys/prctl.h... yes 2023-12-12T10:14:19.973 INFO:teuthology.orchestra.run.smithi078.stdout:checking for linux/fs.h... yes 2023-12-12T10:14:20.015 INFO:teuthology.orchestra.run.smithi078.stdout:checking for btrfsutil.h... no 2023-12-12T10:14:20.074 INFO:teuthology.orchestra.run.smithi078.stdout:checking for copy_file_range... yes 2023-12-12T10:14:20.132 INFO:teuthology.orchestra.run.smithi078.stdout:checking for SEEK_DATA... yes 2023-12-12T10:14:20.206 INFO:teuthology.orchestra.run.smithi078.stdout:checking for BMV_OF_SHARED... yes 2023-12-12T10:14:20.273 INFO:teuthology.orchestra.run.smithi078.stdout:checking for nftw... yes 2023-12-12T10:14:20.327 INFO:teuthology.orchestra.run.smithi078.stdout:checking for RLIMIT_NOFILE... yes 2023-12-12T10:14:20.381 INFO:teuthology.orchestra.run.smithi078.stdout:checking for XFS_IOC_EXCHANGE_RANGE... no 2023-12-12T10:14:20.433 INFO:teuthology.orchestra.run.smithi078.stdout:checking for FICLONE... yes 2023-12-12T10:14:20.485 INFO:teuthology.orchestra.run.smithi078.stdout:checking for renameat2... yes 2023-12-12T10:14:20.536 INFO:teuthology.orchestra.run.smithi078.stdout:checking for reallocarray... yes 2023-12-12T10:14:20.587 INFO:teuthology.orchestra.run.smithi078.stdout:checking for struct mount_attr... yes 2023-12-12T10:14:20.642 INFO:teuthology.orchestra.run.smithi078.stdout:checking for struct btrfs_qgroup_limit... yes 2023-12-12T10:14:20.695 INFO:teuthology.orchestra.run.smithi078.stdout:checking for struct btrfs_qgroup_inherit... yes 2023-12-12T10:14:20.749 INFO:teuthology.orchestra.run.smithi078.stdout:checking for struct btrfs_ioctl_vol_args... yes 2023-12-12T10:14:20.802 INFO:teuthology.orchestra.run.smithi078.stdout:checking for struct btrfs_ioctl_vol_args_v2... yes 2023-12-12T10:14:20.855 INFO:teuthology.orchestra.run.smithi078.stdout:checking for struct btrfs_ioctl_ino_lookup_args... yes 2023-12-12T10:14:20.908 INFO:teuthology.orchestra.run.smithi078.stdout:checking for struct btrfs_ioctl_ino_lookup_user_args... yes 2023-12-12T10:14:20.961 INFO:teuthology.orchestra.run.smithi078.stdout:checking for struct btrfs_ioctl_get_subvol_rootref_args... yes 2023-12-12T10:14:21.001 INFO:teuthology.orchestra.run.smithi078.stdout:checking for linux/btrfs.h... yes 2023-12-12T10:14:21.042 INFO:teuthology.orchestra.run.smithi078.stdout:checking for linux/btrfs_tree.h... yes 2023-12-12T10:14:21.071 INFO:teuthology.orchestra.run.smithi078.stdout:checking for struct btrfs_ioctl_vol_args_v2.subvolid... yes 2023-12-12T10:14:21.099 INFO:teuthology.orchestra.run.smithi078.stdout:configure: creating ./config.status 2023-12-12T10:14:21.932 INFO:teuthology.orchestra.run.smithi078.stdout:config.status: creating include/builddefs 2023-12-12T10:14:21.960 INFO:teuthology.orchestra.run.smithi078.stdout:config.status: creating include/config.h 2023-12-12T10:14:21.982 INFO:teuthology.orchestra.run.smithi078.stdout:config.status: executing libtool commands 2023-12-12T10:14:22.052 INFO:teuthology.orchestra.run.smithi078.stdout:Building include 2023-12-12T10:14:22.058 INFO:teuthology.orchestra.run.smithi078.stdout:Building lib 2023-12-12T10:14:22.064 INFO:teuthology.orchestra.run.smithi078.stdout: [LTDEP] 2023-12-12T10:14:22.270 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] dataascii.lo 2023-12-12T10:14:22.416 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] databin.lo 2023-12-12T10:14:22.603 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] datapid.lo 2023-12-12T10:14:22.742 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] file_lock.lo 2023-12-12T10:14:22.933 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] forker.lo 2023-12-12T10:14:23.118 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] pattern.lo 2023-12-12T10:14:23.264 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] open_flags.lo 2023-12-12T10:14:23.442 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] random_range.lo 2023-12-12T10:14:23.700 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] string_to_tokens.lo 2023-12-12T10:14:23.829 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] str_to_bytes.lo 2023-12-12T10:14:24.000 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] tlibio.lo 2023-12-12T10:14:24.290 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] write_log.lo 2023-12-12T10:14:24.377 INFO:teuthology.orchestra.run.smithi078.stderr:write_log.c: In function 'wlog_record_write': 2023-12-12T10:14:24.377 INFO:teuthology.orchestra.run.smithi078.stderr:write_log.c:205:13: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-12-12T10:14:24.377 INFO:teuthology.orchestra.run.smithi078.stderr: 205 | write(wfile->w_afd, wbuf, reclen); 2023-12-12T10:14:24.377 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-12-12T10:14:24.378 INFO:teuthology.orchestra.run.smithi078.stderr:write_log.c:209:13: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-12-12T10:14:24.378 INFO:teuthology.orchestra.run.smithi078.stderr: 209 | write(wfile->w_rfd, wbuf, reclen); 2023-12-12T10:14:24.378 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-12-12T10:14:24.568 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] random.lo 2023-12-12T10:14:24.697 INFO:teuthology.orchestra.run.smithi078.stdout: [LD] 2023-12-12T10:14:24.816 INFO:teuthology.orchestra.run.smithi078.stdout:Building ltp 2023-12-12T10:14:24.823 INFO:teuthology.orchestra.run.smithi078.stdout: [DEP] 2023-12-12T10:14:25.017 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] doio 2023-12-12T10:14:25.774 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] fsstress 2023-12-12T10:14:27.367 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] fsx 2023-12-12T10:14:28.196 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] growfiles 2023-12-12T10:14:28.778 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] iogen 2023-12-12T10:14:28.946 INFO:teuthology.orchestra.run.smithi078.stderr:iogen.c: In function 'main': 2023-12-12T10:14:28.946 INFO:teuthology.orchestra.run.smithi078.stderr:iogen.c:280:9: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-12-12T10:14:28.946 INFO:teuthology.orchestra.run.smithi078.stderr: 280 | write(outfd, (char *)&req, sizeof(req)); 2023-12-12T10:14:28.946 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-12-12T10:14:28.948 INFO:teuthology.orchestra.run.smithi078.stderr:iogen.c: In function 'parse_cmdline': 2023-12-12T10:14:28.948 INFO:teuthology.orchestra.run.smithi078.stderr:iogen.c:1535:17: warning: ignoring return value of 'getcwd' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-12-12T10:14:28.949 INFO:teuthology.orchestra.run.smithi078.stderr: 1535 | getcwd(fptr->f_path, 2023-12-12T10:14:28.949 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~ 2023-12-12T10:14:28.949 INFO:teuthology.orchestra.run.smithi078.stderr: 1536 | sizeof(fptr->f_path)-1); 2023-12-12T10:14:28.949 INFO:teuthology.orchestra.run.smithi078.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~ 2023-12-12T10:14:29.224 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] aio-stress 2023-12-12T10:14:29.387 INFO:teuthology.orchestra.run.smithi078.stderr:aio-stress.c: In function 'setup_shared_mem': 2023-12-12T10:14:29.387 INFO:teuthology.orchestra.run.smithi078.stderr:aio-stress.c:1013:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-12-12T10:14:29.387 INFO:teuthology.orchestra.run.smithi078.stderr: 1013 | ftruncate(fd, total_ram); 2023-12-12T10:14:29.387 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~ 2023-12-12T10:14:29.715 INFO:teuthology.orchestra.run.smithi078.stdout:Building src 2023-12-12T10:14:29.723 INFO:teuthology.orchestra.run.smithi078.stdout: [DEP] 2023-12-12T10:14:32.213 INFO:teuthology.orchestra.run.smithi078.stdout: [DEP] 2023-12-12T10:14:32.260 INFO:teuthology.orchestra.run.smithi078.stdout: [DEP] 2023-12-12T10:14:32.275 INFO:teuthology.orchestra.run.smithi078.stdout: [DEP] 2023-12-12T10:14:32.605 INFO:teuthology.orchestra.run.smithi078.stdout: [DEP] 2023-12-12T10:14:32.641 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] dirstress 2023-12-12T10:14:32.938 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] fill 2023-12-12T10:14:33.133 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] fill2 2023-12-12T10:14:33.411 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] getpagesize 2023-12-12T10:14:33.587 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] holes 2023-12-12T10:14:33.830 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] lstat64 2023-12-12T10:14:34.060 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] nametest 2023-12-12T10:14:34.226 INFO:teuthology.orchestra.run.smithi078.stderr:nametest.c: In function 'main': 2023-12-12T10:14:34.226 INFO:teuthology.orchestra.run.smithi078.stderr:nametest.c:236:33: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-12-12T10:14:34.226 INFO:teuthology.orchestra.run.smithi078.stderr: 236 | write(1, "\n", 1); 2023-12-12T10:14:34.226 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~ 2023-12-12T10:14:34.226 INFO:teuthology.orchestra.run.smithi078.stderr:nametest.c:238:25: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-12-12T10:14:34.226 INFO:teuthology.orchestra.run.smithi078.stderr: 238 | write(1, ".", 1); 2023-12-12T10:14:34.226 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~ 2023-12-12T10:14:34.226 INFO:teuthology.orchestra.run.smithi078.stderr:nametest.c:288:33: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-12-12T10:14:34.226 INFO:teuthology.orchestra.run.smithi078.stderr: 288 | write(1, ".", 1); 2023-12-12T10:14:34.227 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~ 2023-12-12T10:14:34.350 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] permname 2023-12-12T10:14:34.596 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] randholes 2023-12-12T10:14:34.896 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] runas 2023-12-12T10:14:35.120 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] truncfile 2023-12-12T10:14:35.346 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] usemem 2023-12-12T10:14:35.540 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] mmapcat 2023-12-12T10:14:35.688 INFO:teuthology.orchestra.run.smithi078.stderr:mmapcat.c: In function 'main': 2023-12-12T10:14:35.688 INFO:teuthology.orchestra.run.smithi078.stderr:mmapcat.c:29:9: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-12-12T10:14:35.688 INFO:teuthology.orchestra.run.smithi078.stderr: 29 | write(1,ptr2,ptr - ptr2); 2023-12-12T10:14:35.688 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~ 2023-12-12T10:14:35.731 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] append_reader 2023-12-12T10:14:35.928 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] append_writer 2023-12-12T10:14:36.126 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] dirperf 2023-12-12T10:14:36.398 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] metaperf 2023-12-12T10:14:36.555 INFO:teuthology.orchestra.run.smithi078.stderr:metaperf.c: In function 'crfiles': 2023-12-12T10:14:36.555 INFO:teuthology.orchestra.run.smithi078.stderr:metaperf.c:166:25: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-12-12T10:14:36.555 INFO:teuthology.orchestra.run.smithi078.stderr: 166 | write(fd, buf, fsize); 2023-12-12T10:14:36.555 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2023-12-12T10:14:36.556 INFO:teuthology.orchestra.run.smithi078.stderr:metaperf.c: In function 't_linkun': 2023-12-12T10:14:36.556 INFO:teuthology.orchestra.run.smithi078.stderr:metaperf.c:454:25: warning: ignoring return value of 'link' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-12-12T10:14:36.556 INFO:teuthology.orchestra.run.smithi078.stderr: 454 | link("a", *fnp); 2023-12-12T10:14:36.556 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~ 2023-12-12T10:14:36.556 INFO:teuthology.orchestra.run.smithi078.stderr:metaperf.c: In function 't_chown': 2023-12-12T10:14:36.556 INFO:teuthology.orchestra.run.smithi078.stderr:metaperf.c:404:33: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-12-12T10:14:36.556 INFO:teuthology.orchestra.run.smithi078.stderr: 404 | chown(*fnp, 2, -1); 2023-12-12T10:14:36.556 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~ 2023-12-12T10:14:36.556 INFO:teuthology.orchestra.run.smithi078.stderr:metaperf.c:406:33: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-12-12T10:14:36.556 INFO:teuthology.orchestra.run.smithi078.stderr: 406 | chown(*fnp, 1, -1); 2023-12-12T10:14:36.556 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~ 2023-12-12T10:14:36.556 INFO:teuthology.orchestra.run.smithi078.stderr:metaperf.c: In function 'i_chown': 2023-12-12T10:14:36.556 INFO:teuthology.orchestra.run.smithi078.stderr:metaperf.c:291:17: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-12-12T10:14:36.556 INFO:teuthology.orchestra.run.smithi078.stderr: 291 | chown(*fnp, 1, -1); 2023-12-12T10:14:36.556 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~ 2023-12-12T10:14:36.557 INFO:teuthology.orchestra.run.smithi078.stderr:metaperf.c: In function 'main': 2023-12-12T10:14:36.557 INFO:teuthology.orchestra.run.smithi078.stderr:metaperf.c:152:9: warning: ignoring return value of 'chdir' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-12-12T10:14:36.557 INFO:teuthology.orchestra.run.smithi078.stderr: 152 | chdir(".."); 2023-12-12T10:14:36.557 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~ 2023-12-12T10:14:36.726 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] devzero 2023-12-12T10:14:36.950 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] feature 2023-12-12T10:14:37.227 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] alloc 2023-12-12T10:14:37.390 INFO:teuthology.orchestra.run.smithi078.stderr:alloc.c: In function 'main': 2023-12-12T10:14:37.391 INFO:teuthology.orchestra.run.smithi078.stderr:alloc.c:247:17: warning: ignoring return value of 'mkstemp' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-12-12T10:14:37.391 INFO:teuthology.orchestra.run.smithi078.stderr: 247 | mkstemp(tmpfile); 2023-12-12T10:14:37.391 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~ 2023-12-12T10:14:37.487 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] fault 2023-12-12T10:14:37.653 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T10:14:37.657 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T10:14:37.697 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] fstest 2023-12-12T10:14:37.984 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] t_access_root 2023-12-12T10:14:38.135 INFO:teuthology.orchestra.run.smithi078.stderr:t_access_root.c: In function 'main': 2023-12-12T10:14:38.135 INFO:teuthology.orchestra.run.smithi078.stderr:t_access_root.c:55:5: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-12-12T10:14:38.135 INFO:teuthology.orchestra.run.smithi078.stderr: 55 | system(cmd); 2023-12-12T10:14:38.135 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~ 2023-12-12T10:14:38.185 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] godown 2023-12-12T10:14:38.406 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] resvtest 2023-12-12T10:14:38.638 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] writemod 2023-12-12T10:14:38.827 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] writev_on_pagefault 2023-12-12T10:14:39.036 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] makeextents 2023-12-12T10:14:39.264 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] itrash 2023-12-12T10:14:39.459 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] rename 2023-12-12T10:14:39.637 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] multi_open_unlink 2023-12-12T10:14:39.848 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] unwritten_sync 2023-12-12T10:14:40.077 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] genhashnames 2023-12-12T10:14:40.309 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] t_holes 2023-12-12T10:14:40.499 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] t_mmap_writev 2023-12-12T10:14:40.691 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] t_truncate_cmtime 2023-12-12T10:14:40.893 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] dirhash_collide 2023-12-12T10:14:41.121 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] t_rename_overwrite 2023-12-12T10:14:41.301 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] holetest 2023-12-12T10:14:41.457 INFO:teuthology.orchestra.run.smithi078.stderr:holetest.c: In function 'pt_write_marker': 2023-12-12T10:14:41.457 INFO:teuthology.orchestra.run.smithi078.stderr:holetest.c:140:17: warning: ignoring return value of 'pwrite' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-12-12T10:14:41.457 INFO:teuthology.orchestra.run.smithi078.stderr: 140 | pwrite(fd, &tid, sizeof(tid), i * page_size + pgoff); 2023-12-12T10:14:41.457 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-12-12T10:14:41.573 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] t_truncate_self 2023-12-12T10:14:41.755 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] af_unix 2023-12-12T10:14:41.952 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] t_mmap_stale_pmd 2023-12-12T10:14:42.107 INFO:teuthology.orchestra.run.smithi078.stderr:t_mmap_stale_pmd.c: In function 'main': 2023-12-12T10:14:42.107 INFO:teuthology.orchestra.run.smithi078.stderr:t_mmap_stale_pmd.c:42:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-12-12T10:14:42.107 INFO:teuthology.orchestra.run.smithi078.stderr: 42 | ftruncate(fd, 0); 2023-12-12T10:14:42.107 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~ 2023-12-12T10:14:42.107 INFO:teuthology.orchestra.run.smithi078.stderr:t_mmap_stale_pmd.c:43:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-12-12T10:14:42.107 INFO:teuthology.orchestra.run.smithi078.stderr: 43 | ftruncate(fd, MiB(4)); 2023-12-12T10:14:42.107 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2023-12-12T10:14:42.107 INFO:teuthology.orchestra.run.smithi078.stderr:t_mmap_stale_pmd.c:55:9: warning: ignoring return value of 'pwrite' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-12-12T10:14:42.107 INFO:teuthology.orchestra.run.smithi078.stderr: 55 | pwrite(fd, buffer, strlen(buffer), MiB(2)); 2023-12-12T10:14:42.107 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-12-12T10:14:42.153 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] t_mmap_cow_race 2023-12-12T10:14:42.308 INFO:teuthology.orchestra.run.smithi078.stderr:t_mmap_cow_race.c: In function 'main': 2023-12-12T10:14:42.308 INFO:teuthology.orchestra.run.smithi078.stderr:t_mmap_cow_race.c:61:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-12-12T10:14:42.309 INFO:teuthology.orchestra.run.smithi078.stderr: 61 | ftruncate(fd, 0); 2023-12-12T10:14:42.309 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~ 2023-12-12T10:14:42.309 INFO:teuthology.orchestra.run.smithi078.stderr:t_mmap_cow_race.c:62:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-12-12T10:14:42.309 INFO:teuthology.orchestra.run.smithi078.stderr: 62 | ftruncate(fd, MiB(2)); 2023-12-12T10:14:42.309 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2023-12-12T10:14:42.364 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] t_mmap_fallocate 2023-12-12T10:14:42.557 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] fsync-err 2023-12-12T10:14:42.789 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] t_mmap_write_ro 2023-12-12T10:14:42.988 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] t_ext4_dax_journal_corruption 2023-12-12T10:14:43.141 INFO:teuthology.orchestra.run.smithi078.stderr:t_ext4_dax_journal_corruption.c: In function 'main': 2023-12-12T10:14:43.141 INFO:teuthology.orchestra.run.smithi078.stderr:t_ext4_dax_journal_corruption.c:61:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-12-12T10:14:43.141 INFO:teuthology.orchestra.run.smithi078.stderr: 61 | ftruncate(fd, 0); 2023-12-12T10:14:43.141 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~ 2023-12-12T10:14:43.194 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] t_ext4_dax_inline_corruption 2023-12-12T10:14:43.394 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] t_ofd_locks 2023-12-12T10:14:43.638 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] t_mmap_collision 2023-12-12T10:14:43.883 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] mmap-write-concurrent 2023-12-12T10:14:44.103 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] t_get_file_time 2023-12-12T10:14:44.412 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] t_create_short_dirs 2023-12-12T10:14:44.625 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] t_create_long_dirs 2023-12-12T10:14:44.834 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] t_enospc 2023-12-12T10:14:45.087 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] t_mmap_writev_overlap 2023-12-12T10:14:45.303 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] checkpoint_journal 2023-12-12T10:14:45.504 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] mmap-rw-fault 2023-12-12T10:14:45.735 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] allocstale 2023-12-12T10:14:45.950 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] t_mmap_cow_memory_failure 2023-12-12T10:14:46.168 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] fake-dump-rootino 2023-12-12T10:14:46.362 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] dio-buf-fault 2023-12-12T10:14:46.559 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] rewinddir-test 2023-12-12T10:14:46.775 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] xfsctl 2023-12-12T10:14:47.013 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] bstat 2023-12-12T10:14:47.273 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] t_mtab 2023-12-12T10:14:47.427 INFO:teuthology.orchestra.run.smithi078.stderr:t_mtab.c: In function 'update_mtab': 2023-12-12T10:14:47.427 INFO:teuthology.orchestra.run.smithi078.stderr:t_mtab.c:256:17: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-12-12T10:14:47.427 INFO:teuthology.orchestra.run.smithi078.stderr: 256 | chown (mounted_temp, sbuf.st_uid, sbuf.st_gid); 2023-12-12T10:14:47.427 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-12-12T10:14:47.507 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] getdevicesize 2023-12-12T10:14:47.692 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] preallo_rw_pattern_reader 2023-12-12T10:14:47.853 INFO:teuthology.orchestra.run.smithi078.stderr:In file included from preallo_rw_pattern_reader.c:2: 2023-12-12T10:14:47.853 INFO:teuthology.orchestra.run.smithi078.stderr:iopat.c: In function 'main': 2023-12-12T10:14:47.853 INFO:teuthology.orchestra.run.smithi078.stderr:iopat.c:38:4: warning: ignoring return value of 'read' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-12-12T10:14:47.853 INFO:teuthology.orchestra.run.smithi078.stderr: 38 | read(fd, &x, 1048576); 2023-12-12T10:14:47.853 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2023-12-12T10:14:47.896 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] preallo_rw_pattern_writer 2023-12-12T10:14:48.058 INFO:teuthology.orchestra.run.smithi078.stderr:In file included from preallo_rw_pattern_writer.c:2: 2023-12-12T10:14:48.058 INFO:teuthology.orchestra.run.smithi078.stderr:iopat.c: In function 'main': 2023-12-12T10:14:48.058 INFO:teuthology.orchestra.run.smithi078.stderr:iopat.c:34:4: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-12-12T10:14:48.058 INFO:teuthology.orchestra.run.smithi078.stderr: 34 | write(fd, &x, 1048576); 2023-12-12T10:14:48.059 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~~ 2023-12-12T10:14:48.101 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] ftrunc 2023-12-12T10:14:48.295 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] trunc 2023-12-12T10:14:48.504 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] fs_perms 2023-12-12T10:14:48.657 INFO:teuthology.orchestra.run.smithi078.stderr:fs_perms.c: In function 'main': 2023-12-12T10:14:48.657 INFO:teuthology.orchestra.run.smithi078.stderr:fs_perms.c:54:4: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-12-12T10:14:48.657 INFO:teuthology.orchestra.run.smithi078.stderr: 54 | system("rm -f test.file"); 2023-12-12T10:14:48.657 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~ 2023-12-12T10:14:48.657 INFO:teuthology.orchestra.run.smithi078.stderr:fs_perms.c: In function 'testsetup': 2023-12-12T10:14:48.657 INFO:teuthology.orchestra.run.smithi078.stderr:fs_perms.c:67:4: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-12-12T10:14:48.657 INFO:teuthology.orchestra.run.smithi078.stderr: 67 | system("cp testx.file test.file"); 2023-12-12T10:14:48.657 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-12-12T10:14:48.658 INFO:teuthology.orchestra.run.smithi078.stderr:fs_perms.c:69:4: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-12-12T10:14:48.658 INFO:teuthology.orchestra.run.smithi078.stderr: 69 | chown("test.file",cuserId,cgroupId); 2023-12-12T10:14:48.658 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-12-12T10:14:48.658 INFO:teuthology.orchestra.run.smithi078.stderr:fs_perms.c: In function 'testfperm': 2023-12-12T10:14:48.658 INFO:teuthology.orchestra.run.smithi078.stderr:fs_perms.c:123:5: warning: ignoring return value of 'seteuid' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-12-12T10:14:48.658 INFO:teuthology.orchestra.run.smithi078.stderr: 123 | seteuid(0); 2023-12-12T10:14:48.658 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~ 2023-12-12T10:14:48.658 INFO:teuthology.orchestra.run.smithi078.stderr:fs_perms.c:124:5: warning: ignoring return value of 'setegid' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-12-12T10:14:48.658 INFO:teuthology.orchestra.run.smithi078.stderr: 124 | setegid(0); 2023-12-12T10:14:48.658 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~ 2023-12-12T10:14:48.711 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] testx 2023-12-12T10:14:48.883 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] looptest 2023-12-12T10:14:49.127 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] locktest 2023-12-12T10:14:49.491 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] unwritten_mmap 2023-12-12T10:14:49.700 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] bulkstat_unlink_test 2023-12-12T10:14:49.864 INFO:teuthology.orchestra.run.smithi078.stderr:bulkstat_unlink_test.c: In function 'main': 2023-12-12T10:14:49.864 INFO:teuthology.orchestra.run.smithi078.stderr:bulkstat_unlink_test.c:106:25: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-12-12T10:14:49.864 INFO:teuthology.orchestra.run.smithi078.stderr: 106 | write(fd[i], fname, sizeof(fname)); 2023-12-12T10:14:49.864 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-12-12T10:14:49.864 INFO:teuthology.orchestra.run.smithi078.stderr:bulkstat_unlink_test.c:178:17: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-12-12T10:14:49.864 INFO:teuthology.orchestra.run.smithi078.stderr: 178 | system(fname); 2023-12-12T10:14:49.864 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~ 2023-12-12T10:14:49.954 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] deduperace 2023-12-12T10:14:50.211 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] bulkstat_unlink_test_modified 2023-12-12T10:14:50.394 INFO:teuthology.orchestra.run.smithi078.stderr:bulkstat_unlink_test_modified.c: In function 'main': 2023-12-12T10:14:50.395 INFO:teuthology.orchestra.run.smithi078.stderr:bulkstat_unlink_test_modified.c:83:13: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-12-12T10:14:50.395 INFO:teuthology.orchestra.run.smithi078.stderr: 83 | write(fd, fname, sizeof(fname)); 2023-12-12T10:14:50.395 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-12-12T10:14:50.395 INFO:teuthology.orchestra.run.smithi078.stderr:bulkstat_unlink_test_modified.c:139:13: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-12-12T10:14:50.395 INFO:teuthology.orchestra.run.smithi078.stderr: 139 | write(fd, fname, sizeof(fname)); 2023-12-12T10:14:50.396 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-12-12T10:14:50.396 INFO:teuthology.orchestra.run.smithi078.stderr:bulkstat_unlink_test_modified.c:185:9: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-12-12T10:14:50.396 INFO:teuthology.orchestra.run.smithi078.stderr: 185 | system(fname); 2023-12-12T10:14:50.396 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~ 2023-12-12T10:14:50.479 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] t_dir_offset 2023-12-12T10:14:50.673 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] t_futimens 2023-12-12T10:14:50.855 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] t_immutable 2023-12-12T10:14:51.032 INFO:teuthology.orchestra.run.smithi078.stderr:t_immutable.c: In function 'create_test_area': 2023-12-12T10:14:51.032 INFO:teuthology.orchestra.run.smithi078.stderr:t_immutable.c:2061:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-12-12T10:14:51.032 INFO:teuthology.orchestra.run.smithi078.stderr: 2061 | asprintf(&path, "%s/immutable.d", dir); 2023-12-12T10:14:51.032 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-12-12T10:14:51.032 INFO:teuthology.orchestra.run.smithi078.stderr:t_immutable.c:2096:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-12-12T10:14:51.032 INFO:teuthology.orchestra.run.smithi078.stderr: 2096 | asprintf(&path, "%s/append-only.d", dir); 2023-12-12T10:14:51.033 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-12-12T10:14:51.033 INFO:teuthology.orchestra.run.smithi078.stderr:t_immutable.c: In function 'remove_test_area': 2023-12-12T10:14:51.033 INFO:teuthology.orchestra.run.smithi078.stderr:t_immutable.c:2152:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-12-12T10:14:51.033 INFO:teuthology.orchestra.run.smithi078.stderr: 2152 | asprintf(&path, "%s/immutable.d", dir); 2023-12-12T10:14:51.033 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-12-12T10:14:51.034 INFO:teuthology.orchestra.run.smithi078.stderr:t_immutable.c:2163:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-12-12T10:14:51.034 INFO:teuthology.orchestra.run.smithi078.stderr: 2163 | asprintf(&path, "%s/empty-immutable.d", dir); 2023-12-12T10:14:51.034 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-12-12T10:14:51.034 INFO:teuthology.orchestra.run.smithi078.stderr:t_immutable.c:2175:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-12-12T10:14:51.034 INFO:teuthology.orchestra.run.smithi078.stderr: 2175 | asprintf(&path, "%s/append-only.d", dir); 2023-12-12T10:14:51.034 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-12-12T10:14:51.035 INFO:teuthology.orchestra.run.smithi078.stderr:t_immutable.c:2186:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-12-12T10:14:51.035 INFO:teuthology.orchestra.run.smithi078.stderr: 2186 | asprintf(&path, "%s/empty-append-only.d", dir); 2023-12-12T10:14:51.036 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-12-12T10:14:51.036 INFO:teuthology.orchestra.run.smithi078.stderr:t_immutable.c:2197:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-12-12T10:14:51.036 INFO:teuthology.orchestra.run.smithi078.stderr: 2197 | asprintf(&path, "%s/append-only.f", dir); 2023-12-12T10:14:51.036 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-12-12T10:14:51.036 INFO:teuthology.orchestra.run.smithi078.stderr:t_immutable.c:2209:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-12-12T10:14:51.036 INFO:teuthology.orchestra.run.smithi078.stderr: 2209 | asprintf(&path, "%s/immutable.f", dir); 2023-12-12T10:14:51.036 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-12-12T10:14:51.036 INFO:teuthology.orchestra.run.smithi078.stderr:t_immutable.c: In function 'check_test_area': 2023-12-12T10:14:51.036 INFO:teuthology.orchestra.run.smithi078.stderr:t_immutable.c:1788:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-12-12T10:14:51.036 INFO:teuthology.orchestra.run.smithi078.stderr: 1788 | asprintf(&path, "%s/", dir); 2023-12-12T10:14:51.036 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-12-12T10:14:51.036 INFO:teuthology.orchestra.run.smithi078.stderr:t_immutable.c:1800:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-12-12T10:14:51.036 INFO:teuthology.orchestra.run.smithi078.stderr: 1800 | asprintf(&path, "%s/immutable.f", dir); 2023-12-12T10:14:51.036 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-12-12T10:14:51.037 INFO:teuthology.orchestra.run.smithi078.stderr:t_immutable.c:1812:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-12-12T10:14:51.037 INFO:teuthology.orchestra.run.smithi078.stderr: 1812 | asprintf(&path, "%s/append-only.f", dir); 2023-12-12T10:14:51.037 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-12-12T10:14:51.037 INFO:teuthology.orchestra.run.smithi078.stderr:t_immutable.c:1824:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-12-12T10:14:51.037 INFO:teuthology.orchestra.run.smithi078.stderr: 1824 | asprintf(&path, "%s/immutable.d", dir); 2023-12-12T10:14:51.037 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-12-12T10:14:51.037 INFO:teuthology.orchestra.run.smithi078.stderr:t_immutable.c:1837:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-12-12T10:14:51.037 INFO:teuthology.orchestra.run.smithi078.stderr: 1837 | asprintf(&path, "%s/append-only.d", dir); 2023-12-12T10:14:51.037 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-12-12T10:14:51.037 INFO:teuthology.orchestra.run.smithi078.stderr:t_immutable.c:1850:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-12-12T10:14:51.037 INFO:teuthology.orchestra.run.smithi078.stderr: 1850 | asprintf(&path, "%s/immutable.d/file", dir); 2023-12-12T10:14:51.037 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-12-12T10:14:51.037 INFO:teuthology.orchestra.run.smithi078.stderr:t_immutable.c:1862:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-12-12T10:14:51.037 INFO:teuthology.orchestra.run.smithi078.stderr: 1862 | asprintf(&path, "%s/append-only.d/file", dir); 2023-12-12T10:14:51.038 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-12-12T10:14:51.038 INFO:teuthology.orchestra.run.smithi078.stderr:t_immutable.c:1874:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-12-12T10:14:51.038 INFO:teuthology.orchestra.run.smithi078.stderr: 1874 | asprintf(&path, "%s/immutable.d/dir", dir); 2023-12-12T10:14:51.038 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-12-12T10:14:51.038 INFO:teuthology.orchestra.run.smithi078.stderr:t_immutable.c:1887:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-12-12T10:14:51.039 INFO:teuthology.orchestra.run.smithi078.stderr: 1887 | asprintf(&path, "%s/append-only.d/dir", dir); 2023-12-12T10:14:51.039 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-12-12T10:14:51.040 INFO:teuthology.orchestra.run.smithi078.stderr:t_immutable.c: In function 'test_immutable': 2023-12-12T10:14:51.041 INFO:teuthology.orchestra.run.smithi078.stderr:t_immutable.c:151:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-12-12T10:14:51.041 INFO:teuthology.orchestra.run.smithi078.stderr: 151 | asprintf(&path, "%s/immutable.f", dir); 2023-12-12T10:14:51.041 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-12-12T10:14:51.041 INFO:teuthology.orchestra.run.smithi078.stderr:t_immutable.c:381:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-12-12T10:14:51.041 INFO:teuthology.orchestra.run.smithi078.stderr: 381 | asprintf(&linkpath, "%s/immutable.f.hardlink", dir); 2023-12-12T10:14:51.041 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-12-12T10:14:51.041 INFO:teuthology.orchestra.run.smithi078.stderr:t_immutable.c:408:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-12-12T10:14:51.041 INFO:teuthology.orchestra.run.smithi078.stderr: 408 | chown(path, 0, 0); 2023-12-12T10:14:51.041 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~ 2023-12-12T10:14:51.041 INFO:teuthology.orchestra.run.smithi078.stderr:t_immutable.c:485:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-12-12T10:14:51.041 INFO:teuthology.orchestra.run.smithi078.stderr: 485 | asprintf(&linkpath, "%s/immutable.f.newname", dir); 2023-12-12T10:14:51.041 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-12-12T10:14:51.041 INFO:teuthology.orchestra.run.smithi078.stderr:t_immutable.c:532:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-12-12T10:14:51.041 INFO:teuthology.orchestra.run.smithi078.stderr: 532 | asprintf(&path, "%s/immutable.d/file", dir); 2023-12-12T10:14:51.042 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-12-12T10:14:51.042 INFO:teuthology.orchestra.run.smithi078.stderr:t_immutable.c:553:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-12-12T10:14:51.042 INFO:teuthology.orchestra.run.smithi078.stderr: 553 | chown(path, 0, 0); 2023-12-12T10:14:51.042 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~ 2023-12-12T10:14:51.042 INFO:teuthology.orchestra.run.smithi078.stderr:t_immutable.c:556:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-12-12T10:14:51.042 INFO:teuthology.orchestra.run.smithi078.stderr: 556 | asprintf(&linkpath, "%s/immutable.d/file.link", dir); 2023-12-12T10:14:51.042 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-12-12T10:14:51.042 INFO:teuthology.orchestra.run.smithi078.stderr:t_immutable.c:575:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-12-12T10:14:51.042 INFO:teuthology.orchestra.run.smithi078.stderr: 575 | asprintf(&linkpath, "%s/immutable.d/file.newname", dir); 2023-12-12T10:14:51.042 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-12-12T10:14:51.042 INFO:teuthology.orchestra.run.smithi078.stderr:t_immutable.c:595:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-12-12T10:14:51.042 INFO:teuthology.orchestra.run.smithi078.stderr: 595 | asprintf(&path, "%s/immutable.d/newfile", dir); 2023-12-12T10:14:51.042 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-12-12T10:14:51.042 INFO:teuthology.orchestra.run.smithi078.stderr:t_immutable.c:619:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-12-12T10:14:51.043 INFO:teuthology.orchestra.run.smithi078.stderr: 619 | asprintf(&path, "%s/immutable.d/newdir", dir); 2023-12-12T10:14:51.043 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-12-12T10:14:51.043 INFO:teuthology.orchestra.run.smithi078.stderr:t_immutable.c:631:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-12-12T10:14:51.043 INFO:teuthology.orchestra.run.smithi078.stderr: 631 | asprintf(&path, "%s/immutable.d/dir/newfile-%d", dir, getuid()); 2023-12-12T10:14:51.043 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-12-12T10:14:51.043 INFO:teuthology.orchestra.run.smithi078.stderr:t_immutable.c:653:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-12-12T10:14:51.043 INFO:teuthology.orchestra.run.smithi078.stderr: 653 | chown(path, 0, 0); 2023-12-12T10:14:51.043 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~ 2023-12-12T10:14:51.043 INFO:teuthology.orchestra.run.smithi078.stderr:t_immutable.c:657:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-12-12T10:14:51.043 INFO:teuthology.orchestra.run.smithi078.stderr: 657 | asprintf(&path, "%s/immutable.d/dir", dir); 2023-12-12T10:14:51.043 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-12-12T10:14:51.043 INFO:teuthology.orchestra.run.smithi078.stderr:t_immutable.c:668:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-12-12T10:14:51.043 INFO:teuthology.orchestra.run.smithi078.stderr: 668 | asprintf(&path, "%s/immutable.d", dir); 2023-12-12T10:14:51.043 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-12-12T10:14:51.043 INFO:teuthology.orchestra.run.smithi078.stderr:t_immutable.c:705:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-12-12T10:14:51.044 INFO:teuthology.orchestra.run.smithi078.stderr: 705 | chown(path, 0, 0); 2023-12-12T10:14:51.044 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~ 2023-12-12T10:14:51.044 INFO:teuthology.orchestra.run.smithi078.stderr:t_immutable.c:782:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-12-12T10:14:51.044 INFO:teuthology.orchestra.run.smithi078.stderr: 782 | asprintf(&path, "%s/empty-immutable.d", dir); 2023-12-12T10:14:51.044 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-12-12T10:14:51.047 INFO:teuthology.orchestra.run.smithi078.stderr:t_immutable.c: In function 'test_append': 2023-12-12T10:14:51.047 INFO:teuthology.orchestra.run.smithi078.stderr:t_immutable.c:822:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-12-12T10:14:51.047 INFO:teuthology.orchestra.run.smithi078.stderr: 822 | asprintf(&path, "%s/append-only.f", dir); 2023-12-12T10:14:51.047 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-12-12T10:14:51.047 INFO:teuthology.orchestra.run.smithi078.stderr:t_immutable.c:1024:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-12-12T10:14:51.047 INFO:teuthology.orchestra.run.smithi078.stderr: 1024 | asprintf(&linkpath, "%s/append-only.f.hardlink", dir); 2023-12-12T10:14:51.047 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-12-12T10:14:51.047 INFO:teuthology.orchestra.run.smithi078.stderr:t_immutable.c:1051:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-12-12T10:14:51.047 INFO:teuthology.orchestra.run.smithi078.stderr: 1051 | chown(path, 0, 0); 2023-12-12T10:14:51.047 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~ 2023-12-12T10:14:51.047 INFO:teuthology.orchestra.run.smithi078.stderr:t_immutable.c:1126:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-12-12T10:14:51.048 INFO:teuthology.orchestra.run.smithi078.stderr: 1126 | asprintf(&linkpath, "%s/append-only.f.newname", dir); 2023-12-12T10:14:51.048 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-12-12T10:14:51.048 INFO:teuthology.orchestra.run.smithi078.stderr:t_immutable.c:1495:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-12-12T10:14:51.048 INFO:teuthology.orchestra.run.smithi078.stderr: 1495 | asprintf(&path, "%s/append-only.d/file", dir); 2023-12-12T10:14:51.048 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-12-12T10:14:51.048 INFO:teuthology.orchestra.run.smithi078.stderr:t_immutable.c:1516:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-12-12T10:14:51.048 INFO:teuthology.orchestra.run.smithi078.stderr: 1516 | chown(path, 0, 0); 2023-12-12T10:14:51.048 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~ 2023-12-12T10:14:51.048 INFO:teuthology.orchestra.run.smithi078.stderr:t_immutable.c:1519:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-12-12T10:14:51.048 INFO:teuthology.orchestra.run.smithi078.stderr: 1519 | asprintf(&linkpath, "%s/append-only.d/file.link-%d", dir, getuid()); 2023-12-12T10:14:51.048 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-12-12T10:14:51.048 INFO:teuthology.orchestra.run.smithi078.stderr:t_immutable.c:1529:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-12-12T10:14:51.048 INFO:teuthology.orchestra.run.smithi078.stderr: 1529 | asprintf(&linkpath, "%s/append-only.d/file.symlink-%d", dir, getuid()); 2023-12-12T10:14:51.048 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-12-12T10:14:51.049 INFO:teuthology.orchestra.run.smithi078.stderr:t_immutable.c:1539:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-12-12T10:14:51.049 INFO:teuthology.orchestra.run.smithi078.stderr: 1539 | asprintf(&linkpath, "%s/append-only.d/file.newname", dir); 2023-12-12T10:14:51.049 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-12-12T10:14:51.049 INFO:teuthology.orchestra.run.smithi078.stderr:t_immutable.c:1559:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-12-12T10:14:51.049 INFO:teuthology.orchestra.run.smithi078.stderr: 1559 | asprintf(&path, "%s/append-only.d/newfile-%d", dir, getuid()); 2023-12-12T10:14:51.049 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-12-12T10:14:51.049 INFO:teuthology.orchestra.run.smithi078.stderr:t_immutable.c:1573:11: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-12-12T10:14:51.049 INFO:teuthology.orchestra.run.smithi078.stderr: 1573 | asprintf(&path, "%s/append-only.d/newdev-%d", dir, getuid()); 2023-12-12T10:14:51.049 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-12-12T10:14:51.049 INFO:teuthology.orchestra.run.smithi078.stderr:t_immutable.c:1586:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-12-12T10:14:51.049 INFO:teuthology.orchestra.run.smithi078.stderr: 1586 | asprintf(&path, "%s/append-only.d/newdir-%d", dir, getuid()); 2023-12-12T10:14:51.049 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-12-12T10:14:51.049 INFO:teuthology.orchestra.run.smithi078.stderr:t_immutable.c:1596:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-12-12T10:14:51.049 INFO:teuthology.orchestra.run.smithi078.stderr: 1596 | asprintf(&path, "%s/append-only.d/newdir-%d/newfile-%d", dir, getuid(), getuid()); 2023-12-12T10:14:51.049 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-12-12T10:14:51.050 INFO:teuthology.orchestra.run.smithi078.stderr:t_immutable.c:1618:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-12-12T10:14:51.050 INFO:teuthology.orchestra.run.smithi078.stderr: 1618 | chown(path, 0, 0); 2023-12-12T10:14:51.050 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~ 2023-12-12T10:14:51.050 INFO:teuthology.orchestra.run.smithi078.stderr:t_immutable.c:1622:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-12-12T10:14:51.050 INFO:teuthology.orchestra.run.smithi078.stderr: 1622 | asprintf(&path, "%s/append-only.d/dir/newfile-%d", dir, getuid()); 2023-12-12T10:14:51.050 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-12-12T10:14:51.050 INFO:teuthology.orchestra.run.smithi078.stderr:t_immutable.c:1644:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-12-12T10:14:51.050 INFO:teuthology.orchestra.run.smithi078.stderr: 1644 | chown(path, 0, 0); 2023-12-12T10:14:51.050 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~ 2023-12-12T10:14:51.050 INFO:teuthology.orchestra.run.smithi078.stderr:t_immutable.c:1648:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-12-12T10:14:51.050 INFO:teuthology.orchestra.run.smithi078.stderr: 1648 | asprintf(&path, "%s/append-only.d/dir", dir); 2023-12-12T10:14:51.050 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-12-12T10:14:51.050 INFO:teuthology.orchestra.run.smithi078.stderr:t_immutable.c:1659:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-12-12T10:14:51.050 INFO:teuthology.orchestra.run.smithi078.stderr: 1659 | asprintf(&path, "%s/append-only.d", dir); 2023-12-12T10:14:51.051 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-12-12T10:14:51.051 INFO:teuthology.orchestra.run.smithi078.stderr:t_immutable.c:1692:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-12-12T10:14:51.051 INFO:teuthology.orchestra.run.smithi078.stderr: 1692 | chown(path, 0, 0); 2023-12-12T10:14:51.051 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~ 2023-12-12T10:14:51.051 INFO:teuthology.orchestra.run.smithi078.stderr:t_immutable.c:1769:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-12-12T10:14:51.051 INFO:teuthology.orchestra.run.smithi078.stderr: 1769 | asprintf(&path, "%s/empty-append-only.d", dir); 2023-12-12T10:14:51.051 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-12-12T10:14:51.606 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] stale_handle 2023-12-12T10:14:51.767 INFO:teuthology.orchestra.run.smithi078.stderr:stale_handle.c: In function 'main': 2023-12-12T10:14:51.767 INFO:teuthology.orchestra.run.smithi078.stderr:stale_handle.c:102:9: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-12-12T10:14:51.767 INFO:teuthology.orchestra.run.smithi078.stderr: 102 | system("echo 3 > /proc/sys/vm/drop_caches"); 2023-12-12T10:14:51.767 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-12-12T10:14:51.823 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] pwrite_mmap_blocked 2023-12-12T10:14:52.024 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] t_dir_offset2 2023-12-12T10:14:52.265 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] seek_sanity_test 2023-12-12T10:14:52.434 INFO:teuthology.orchestra.run.smithi078.stderr:seek_sanity_test.c: In function 'test18': 2023-12-12T10:14:52.434 INFO:teuthology.orchestra.run.smithi078.stderr:seek_sanity_test.c:460:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-12-12T10:14:52.434 INFO:teuthology.orchestra.run.smithi078.stderr: 460 | ftruncate(fd, 0); 2023-12-12T10:14:52.434 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~ 2023-12-12T10:14:52.437 INFO:teuthology.orchestra.run.smithi078.stderr:seek_sanity_test.c: In function 'test_basic_support': 2023-12-12T10:14:52.437 INFO:teuthology.orchestra.run.smithi078.stderr:seek_sanity_test.c:1207:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-12-12T10:14:52.437 INFO:teuthology.orchestra.run.smithi078.stderr: 1207 | ftruncate(fd, 0); 2023-12-12T10:14:52.437 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~ 2023-12-12T10:14:52.437 INFO:teuthology.orchestra.run.smithi078.stderr:seek_sanity_test.c:1256:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-12-12T10:14:52.437 INFO:teuthology.orchestra.run.smithi078.stderr: 1256 | ftruncate(fd, 0); 2023-12-12T10:14:52.437 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~ 2023-12-12T10:14:52.438 INFO:teuthology.orchestra.run.smithi078.stderr:seek_sanity_test.c: In function 'get_io_sizes': 2023-12-12T10:14:52.438 INFO:teuthology.orchestra.run.smithi078.stderr:seek_sanity_test.c:88:17: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-12-12T10:14:52.438 INFO:teuthology.orchestra.run.smithi078.stderr: 88 | ftruncate(fd, 0); 2023-12-12T10:14:52.438 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~ 2023-12-12T10:14:52.438 INFO:teuthology.orchestra.run.smithi078.stderr:seek_sanity_test.c:89:17: warning: ignoring return value of 'pwrite' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-12-12T10:14:52.438 INFO:teuthology.orchestra.run.smithi078.stderr: 89 | pwrite(fd, "a", 1, offset); 2023-12-12T10:14:52.438 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-12-12T10:14:52.438 INFO:teuthology.orchestra.run.smithi078.stderr:seek_sanity_test.c:98:17: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-12-12T10:14:52.438 INFO:teuthology.orchestra.run.smithi078.stderr: 98 | ftruncate(fd, 0); 2023-12-12T10:14:52.438 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~ 2023-12-12T10:14:52.438 INFO:teuthology.orchestra.run.smithi078.stderr:seek_sanity_test.c:99:17: warning: ignoring return value of 'pwrite' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-12-12T10:14:52.438 INFO:teuthology.orchestra.run.smithi078.stderr: 99 | pwrite(fd, "a", 1, offset); 2023-12-12T10:14:52.439 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-12-12T10:14:52.760 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] seek_copy_test 2023-12-12T10:14:52.984 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] t_readdir_1 2023-12-12T10:14:53.136 INFO:teuthology.orchestra.run.smithi078.stderr:t_readdir_1.c: In function 'main': 2023-12-12T10:14:53.136 INFO:teuthology.orchestra.run.smithi078.stderr:t_readdir_1.c:30:25: warning: ignoring return value of 'read' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-12-12T10:14:53.136 INFO:teuthology.orchestra.run.smithi078.stderr: 30 | read(fd, buf, 100); 2023-12-12T10:14:53.136 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~ 2023-12-12T10:14:53.179 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] t_readdir_2 2023-12-12T10:14:53.373 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] fsync-tester 2023-12-12T10:14:53.525 INFO:teuthology.orchestra.run.smithi078.stderr:fsync-tester.c: In function 'main': 2023-12-12T10:14:53.525 INFO:teuthology.orchestra.run.smithi078.stderr:fsync-tester.c:391:17: warning: ignoring return value of 'read' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-12-12T10:14:53.525 INFO:teuthology.orchestra.run.smithi078.stderr: 391 | read(fd, &seed, sizeof(seed)); 2023-12-12T10:14:53.525 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-12-12T10:14:53.526 INFO:teuthology.orchestra.run.smithi078.stderr:fsync-tester.c:541:17: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-12-12T10:14:53.526 INFO:teuthology.orchestra.run.smithi078.stderr: 541 | system("reboot -fn"); 2023-12-12T10:14:53.526 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~ 2023-12-12T10:14:53.526 INFO:teuthology.orchestra.run.smithi078.stderr:fsync-tester.c: In function 'drop_all_caches': 2023-12-12T10:14:53.526 INFO:teuthology.orchestra.run.smithi078.stderr:fsync-tester.c:90:9: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-12-12T10:14:53.526 INFO:teuthology.orchestra.run.smithi078.stderr: 90 | write(fd, value, sizeof(value)-1); 2023-12-12T10:14:53.526 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-12-12T10:14:53.675 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] nsexec 2023-12-12T10:14:53.901 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] cloner 2023-12-12T10:14:54.128 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] renameat2 2023-12-12T10:14:54.340 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] t_getcwd 2023-12-12T10:14:54.491 INFO:teuthology.orchestra.run.smithi078.stderr:t_getcwd.c: In function 'test_getcwd': 2023-12-12T10:14:54.492 INFO:teuthology.orchestra.run.smithi078.stderr:t_getcwd.c:21:17: warning: ignoring return value of 'getcwd' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-12-12T10:14:54.492 INFO:teuthology.orchestra.run.smithi078.stderr: 21 | getcwd(cur_cwd, BUF_SIZE); 2023-12-12T10:14:54.492 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~ 2023-12-12T10:14:54.546 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] e4compact 2023-12-12T10:14:54.797 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] test-nextquota 2023-12-12T10:14:55.018 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] punch-alternating 2023-12-12T10:14:55.238 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] attr-list-by-handle-cursor-test 2023-12-12T10:14:55.452 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] listxattr 2023-12-12T10:14:55.640 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] dio-interleaved 2023-12-12T10:14:55.846 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] t_dir_type 2023-12-12T10:14:56.750 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] dio-invalidate-cache 2023-12-12T10:14:56.750 INFO:teuthology.orchestra.run.smithi078.stderr:dio-invalidate-cache.c: In function 'main': 2023-12-12T10:14:56.750 INFO:teuthology.orchestra.run.smithi078.stderr:dio-invalidate-cache.c:286:17: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-12-12T10:14:56.750 INFO:teuthology.orchestra.run.smithi078.stderr: 286 | write(fd, buf, blksz * nr_child); 2023-12-12T10:14:56.750 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-12-12T10:14:56.751 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] stat_test 2023-12-12T10:14:56.751 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] t_encrypted_d_revalidate 2023-12-12T10:14:56.849 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] attr_replace_test 2023-12-12T10:14:57.060 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] swapon 2023-12-12T10:14:57.272 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] mkswap 2023-12-12T10:14:57.468 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] t_attr_corruption 2023-12-12T10:14:57.662 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] t_open_tmpfiles 2023-12-12T10:14:57.889 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] fscrypt-crypt-util 2023-12-12T10:14:58.597 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] bulkstat_null_ocount 2023-12-12T10:14:58.800 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] splice-test 2023-12-12T10:14:59.031 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] chprojid_fail 2023-12-12T10:14:59.241 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] detached_mounts_propagation 2023-12-12T10:14:59.473 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] ext4_resize 2023-12-12T10:14:59.668 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] t_readdir_3 2023-12-12T10:14:59.912 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] splice2pipe 2023-12-12T10:15:00.067 INFO:teuthology.orchestra.run.smithi078.stderr:splice2pipe.c: In function 'prepare_pipe': 2023-12-12T10:15:00.067 INFO:teuthology.orchestra.run.smithi078.stderr:splice2pipe.c:57:17: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-12-12T10:15:00.068 INFO:teuthology.orchestra.run.smithi078.stderr: 57 | write(p[1], buffer, n); 2023-12-12T10:15:00.068 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~~ 2023-12-12T10:15:00.068 INFO:teuthology.orchestra.run.smithi078.stderr:splice2pipe.c:65:17: warning: ignoring return value of 'read' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-12-12T10:15:00.068 INFO:teuthology.orchestra.run.smithi078.stderr: 65 | read(p[0], buffer, n); 2023-12-12T10:15:00.068 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2023-12-12T10:15:00.126 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] uuid_ioctl 2023-12-12T10:15:00.329 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] fiemap-tester 2023-12-12T10:15:00.639 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] t_stripealign 2023-12-12T10:15:00.840 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] open_by_handle 2023-12-12T10:15:01.136 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] t_mmap_dio 2023-12-12T10:15:01.345 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] uring_read_fault 2023-12-12T10:15:01.576 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] xfsfind 2023-12-12T10:15:01.819 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] t_reflink_read_race 2023-12-12T10:15:02.063 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] fssum 2023-12-12T10:15:02.558 INFO:teuthology.orchestra.run.smithi078.stdout:Building log-writes 2023-12-12T10:15:02.567 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] replay-log 2023-12-12T10:15:02.952 INFO:teuthology.orchestra.run.smithi078.stdout:Building perf 2023-12-12T10:15:02.958 INFO:teuthology.orchestra.run.smithi078.stdout:Building aio-dio-regress 2023-12-12T10:15:02.968 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] aiocp 2023-12-12T10:15:03.254 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] aio-dio-append-write-fallocate-race 2023-12-12T10:15:03.475 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] aio-dio-append-write-read-race 2023-12-12T10:15:03.703 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] aio-dio-cow-race 2023-12-12T10:15:03.908 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] aio-dio-cycle-write 2023-12-12T10:15:04.059 INFO:teuthology.orchestra.run.smithi078.stderr:aio-dio-cycle-write.c: In function 'init_test': 2023-12-12T10:15:04.059 INFO:teuthology.orchestra.run.smithi078.stderr:aio-dio-cycle-write.c:83:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-12-12T10:15:04.059 INFO:teuthology.orchestra.run.smithi078.stderr: 83 | ftruncate(fd, buf_size); 2023-12-12T10:15:04.059 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~ 2023-12-12T10:15:04.151 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] aio-dio-eof-race 2023-12-12T10:15:04.387 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] aio-dio-extend-stat 2023-12-12T10:15:04.603 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] aio-dio-fcntl-race 2023-12-12T10:15:04.817 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] aio-dio-hole-filling-race 2023-12-12T10:15:05.018 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] aio-dio-invalidate-failure 2023-12-12T10:15:05.231 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] aio-dio-invalidate-readahead 2023-12-12T10:15:05.449 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] aiodio_sparse2 2023-12-12T10:15:05.597 INFO:teuthology.orchestra.run.smithi078.stderr:aiodio_sparse2.c: In function 'aiodio_sparse': 2023-12-12T10:15:05.597 INFO:teuthology.orchestra.run.smithi078.stderr:aiodio_sparse2.c:111:17: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-12-12T10:15:05.597 INFO:teuthology.orchestra.run.smithi078.stderr: 111 | ftruncate(fd, filesize); 2023-12-12T10:15:05.597 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~ 2023-12-12T10:15:05.598 INFO:teuthology.orchestra.run.smithi078.stderr:aiodio_sparse2.c: In function 'dirty_freeblocks': 2023-12-12T10:15:05.598 INFO:teuthology.orchestra.run.smithi078.stderr:aiodio_sparse2.c:274:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-12-12T10:15:05.598 INFO:teuthology.orchestra.run.smithi078.stderr: 274 | ftruncate(fd, size); 2023-12-12T10:15:05.598 INFO:teuthology.orchestra.run.smithi078.stderr: | ^~~~~~~~~~~~~~~~~~~ 2023-12-12T10:15:05.720 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] aio-dio-subblock-eof-read 2023-12-12T10:15:05.914 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] aio-dio-write-verify 2023-12-12T10:15:06.165 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] aio-free-ring-with-bogus-nr-pages 2023-12-12T10:15:06.347 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] aio-io-setup-with-nonwritable-context-pointer 2023-12-12T10:15:06.528 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] aio-last-ref-held-by-io 2023-12-12T10:15:06.757 INFO:teuthology.orchestra.run.smithi078.stdout:Building vfs 2023-12-12T10:15:06.766 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] vfstest 2023-12-12T10:15:07.710 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T10:15:07.714 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T10:15:11.086 INFO:teuthology.orchestra.run.smithi078.stdout: [CC] mount-idmapped 2023-12-12T10:15:11.574 INFO:teuthology.orchestra.run.smithi078.stdout:Building m4 2023-12-12T10:15:11.581 INFO:teuthology.orchestra.run.smithi078.stdout:Building common 2023-12-12T10:15:11.587 INFO:teuthology.orchestra.run.smithi078.stdout:Building tests 2023-12-12T10:15:11.596 INFO:teuthology.orchestra.run.smithi078.stdout:Building btrfs 2023-12-12T10:15:11.606 INFO:teuthology.orchestra.run.smithi078.stdout: [GROUP] /tmp/tmp.GmWnCxuSqIxfstests-dev/tests/btrfs/group.list 2023-12-12T10:15:11.737 INFO:teuthology.orchestra.run.smithi078.stdout:Building ceph 2023-12-12T10:15:11.745 INFO:teuthology.orchestra.run.smithi078.stdout: [GROUP] /tmp/tmp.GmWnCxuSqIxfstests-dev/tests/ceph/group.list 2023-12-12T10:15:11.778 INFO:teuthology.orchestra.run.smithi078.stdout:Building cifs 2023-12-12T10:15:11.787 INFO:teuthology.orchestra.run.smithi078.stdout: [GROUP] /tmp/tmp.GmWnCxuSqIxfstests-dev/tests/cifs/group.list 2023-12-12T10:15:11.815 INFO:teuthology.orchestra.run.smithi078.stdout:Building ext4 2023-12-12T10:15:11.824 INFO:teuthology.orchestra.run.smithi078.stdout: [GROUP] /tmp/tmp.GmWnCxuSqIxfstests-dev/tests/ext4/group.list 2023-12-12T10:15:11.908 INFO:teuthology.orchestra.run.smithi078.stdout:Building f2fs 2023-12-12T10:15:11.917 INFO:teuthology.orchestra.run.smithi078.stdout: [GROUP] /tmp/tmp.GmWnCxuSqIxfstests-dev/tests/f2fs/group.list 2023-12-12T10:15:11.956 INFO:teuthology.orchestra.run.smithi078.stdout:Building generic 2023-12-12T10:15:11.967 INFO:teuthology.orchestra.run.smithi078.stdout: [GROUP] /tmp/tmp.GmWnCxuSqIxfstests-dev/tests/generic/group.list 2023-12-12T10:15:12.185 INFO:teuthology.orchestra.run.smithi078.stdout:Building nfs 2023-12-12T10:15:12.194 INFO:teuthology.orchestra.run.smithi078.stdout: [GROUP] /tmp/tmp.GmWnCxuSqIxfstests-dev/tests/nfs/group.list 2023-12-12T10:15:12.226 INFO:teuthology.orchestra.run.smithi078.stdout:Building ocfs2 2023-12-12T10:15:12.235 INFO:teuthology.orchestra.run.smithi078.stdout: [GROUP] /tmp/tmp.GmWnCxuSqIxfstests-dev/tests/ocfs2/group.list 2023-12-12T10:15:12.265 INFO:teuthology.orchestra.run.smithi078.stdout:Building overlay 2023-12-12T10:15:12.274 INFO:teuthology.orchestra.run.smithi078.stdout: [GROUP] /tmp/tmp.GmWnCxuSqIxfstests-dev/tests/overlay/group.list 2023-12-12T10:15:12.364 INFO:teuthology.orchestra.run.smithi078.stdout:Building perf 2023-12-12T10:15:12.373 INFO:teuthology.orchestra.run.smithi078.stdout: [GROUP] /tmp/tmp.GmWnCxuSqIxfstests-dev/tests/perf/group.list 2023-12-12T10:15:12.399 INFO:teuthology.orchestra.run.smithi078.stdout:Building selftest 2023-12-12T10:15:12.407 INFO:teuthology.orchestra.run.smithi078.stdout: [GROUP] /tmp/tmp.GmWnCxuSqIxfstests-dev/tests/selftest/group.list 2023-12-12T10:15:12.435 INFO:teuthology.orchestra.run.smithi078.stdout:Building shared 2023-12-12T10:15:12.444 INFO:teuthology.orchestra.run.smithi078.stdout: [GROUP] /tmp/tmp.GmWnCxuSqIxfstests-dev/tests/shared/group.list 2023-12-12T10:15:12.482 INFO:teuthology.orchestra.run.smithi078.stdout:Building tmpfs 2023-12-12T10:15:12.491 INFO:teuthology.orchestra.run.smithi078.stdout: [GROUP] /tmp/tmp.GmWnCxuSqIxfstests-dev/tests/tmpfs/group.list 2023-12-12T10:15:12.521 INFO:teuthology.orchestra.run.smithi078.stdout:Building udf 2023-12-12T10:15:12.530 INFO:teuthology.orchestra.run.smithi078.stdout: [GROUP] /tmp/tmp.GmWnCxuSqIxfstests-dev/tests/udf/group.list 2023-12-12T10:15:12.555 INFO:teuthology.orchestra.run.smithi078.stdout:Building xfs 2023-12-12T10:15:12.566 INFO:teuthology.orchestra.run.smithi078.stdout: [GROUP] /tmp/tmp.GmWnCxuSqIxfstests-dev/tests/xfs/group.list 2023-12-12T10:15:12.783 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo make install) 2023-12-12T10:15:12.825 INFO:teuthology.orchestra.run.smithi078.stdout:Building include 2023-12-12T10:15:12.832 INFO:teuthology.orchestra.run.smithi078.stdout:Building lib 2023-12-12T10:15:12.838 INFO:teuthology.orchestra.run.smithi078.stdout:Building ltp 2023-12-12T10:15:12.845 INFO:teuthology.orchestra.run.smithi078.stdout:Building src 2023-12-12T10:15:12.901 INFO:teuthology.orchestra.run.smithi078.stdout:Building log-writes 2023-12-12T10:15:12.907 INFO:teuthology.orchestra.run.smithi078.stdout:Building perf 2023-12-12T10:15:12.913 INFO:teuthology.orchestra.run.smithi078.stdout:Building aio-dio-regress 2023-12-12T10:15:12.920 INFO:teuthology.orchestra.run.smithi078.stdout:Building vfs 2023-12-12T10:15:12.927 INFO:teuthology.orchestra.run.smithi078.stdout:Building m4 2023-12-12T10:15:12.934 INFO:teuthology.orchestra.run.smithi078.stdout:Building common 2023-12-12T10:15:12.940 INFO:teuthology.orchestra.run.smithi078.stdout:Building tests 2023-12-12T10:15:12.949 INFO:teuthology.orchestra.run.smithi078.stdout:Building btrfs 2023-12-12T10:15:12.958 INFO:teuthology.orchestra.run.smithi078.stdout: [GROUP] /tmp/tmp.GmWnCxuSqIxfstests-dev/tests/btrfs/group.list 2023-12-12T10:15:13.088 INFO:teuthology.orchestra.run.smithi078.stdout:Building ceph 2023-12-12T10:15:13.097 INFO:teuthology.orchestra.run.smithi078.stdout: [GROUP] /tmp/tmp.GmWnCxuSqIxfstests-dev/tests/ceph/group.list 2023-12-12T10:15:13.130 INFO:teuthology.orchestra.run.smithi078.stdout:Building cifs 2023-12-12T10:15:13.139 INFO:teuthology.orchestra.run.smithi078.stdout: [GROUP] /tmp/tmp.GmWnCxuSqIxfstests-dev/tests/cifs/group.list 2023-12-12T10:15:13.167 INFO:teuthology.orchestra.run.smithi078.stdout:Building ext4 2023-12-12T10:15:13.176 INFO:teuthology.orchestra.run.smithi078.stdout: [GROUP] /tmp/tmp.GmWnCxuSqIxfstests-dev/tests/ext4/group.list 2023-12-12T10:15:13.261 INFO:teuthology.orchestra.run.smithi078.stdout:Building f2fs 2023-12-12T10:15:13.269 INFO:teuthology.orchestra.run.smithi078.stdout: [GROUP] /tmp/tmp.GmWnCxuSqIxfstests-dev/tests/f2fs/group.list 2023-12-12T10:15:13.308 INFO:teuthology.orchestra.run.smithi078.stdout:Building generic 2023-12-12T10:15:13.319 INFO:teuthology.orchestra.run.smithi078.stdout: [GROUP] /tmp/tmp.GmWnCxuSqIxfstests-dev/tests/generic/group.list 2023-12-12T10:15:13.528 INFO:teuthology.orchestra.run.smithi078.stdout:Building nfs 2023-12-12T10:15:13.537 INFO:teuthology.orchestra.run.smithi078.stdout: [GROUP] /tmp/tmp.GmWnCxuSqIxfstests-dev/tests/nfs/group.list 2023-12-12T10:15:13.569 INFO:teuthology.orchestra.run.smithi078.stdout:Building ocfs2 2023-12-12T10:15:13.578 INFO:teuthology.orchestra.run.smithi078.stdout: [GROUP] /tmp/tmp.GmWnCxuSqIxfstests-dev/tests/ocfs2/group.list 2023-12-12T10:15:13.609 INFO:teuthology.orchestra.run.smithi078.stdout:Building overlay 2023-12-12T10:15:13.617 INFO:teuthology.orchestra.run.smithi078.stdout: [GROUP] /tmp/tmp.GmWnCxuSqIxfstests-dev/tests/overlay/group.list 2023-12-12T10:15:13.707 INFO:teuthology.orchestra.run.smithi078.stdout:Building perf 2023-12-12T10:15:13.716 INFO:teuthology.orchestra.run.smithi078.stdout: [GROUP] /tmp/tmp.GmWnCxuSqIxfstests-dev/tests/perf/group.list 2023-12-12T10:15:13.742 INFO:teuthology.orchestra.run.smithi078.stdout:Building selftest 2023-12-12T10:15:13.750 INFO:teuthology.orchestra.run.smithi078.stdout: [GROUP] /tmp/tmp.GmWnCxuSqIxfstests-dev/tests/selftest/group.list 2023-12-12T10:15:13.779 INFO:teuthology.orchestra.run.smithi078.stdout:Building shared 2023-12-12T10:15:13.787 INFO:teuthology.orchestra.run.smithi078.stdout: [GROUP] /tmp/tmp.GmWnCxuSqIxfstests-dev/tests/shared/group.list 2023-12-12T10:15:13.826 INFO:teuthology.orchestra.run.smithi078.stdout:Building tmpfs 2023-12-12T10:15:13.835 INFO:teuthology.orchestra.run.smithi078.stdout: [GROUP] /tmp/tmp.GmWnCxuSqIxfstests-dev/tests/tmpfs/group.list 2023-12-12T10:15:13.865 INFO:teuthology.orchestra.run.smithi078.stdout:Building udf 2023-12-12T10:15:13.874 INFO:teuthology.orchestra.run.smithi078.stdout: [GROUP] /tmp/tmp.GmWnCxuSqIxfstests-dev/tests/udf/group.list 2023-12-12T10:15:13.899 INFO:teuthology.orchestra.run.smithi078.stdout:Building xfs 2023-12-12T10:15:13.910 INFO:teuthology.orchestra.run.smithi078.stdout: [GROUP] /tmp/tmp.GmWnCxuSqIxfstests-dev/tests/xfs/group.list 2023-12-12T10:15:14.124 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/gmake --no-print-directory Q=@ -C include install 2023-12-12T10:15:14.128 INFO:teuthology.orchestra.run.smithi078.stdout:gmake[1]: Nothing to be done for 'install'. 2023-12-12T10:15:14.128 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/gmake --no-print-directory Q=@ -C lib install 2023-12-12T10:15:14.133 INFO:teuthology.orchestra.run.smithi078.stdout:gmake[1]: Nothing to be done for 'install'. 2023-12-12T10:15:14.133 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/gmake --no-print-directory Q=@ -C ltp install 2023-12-12T10:15:14.138 INFO:teuthology.orchestra.run.smithi078.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/ltp 2023-12-12T10:15:14.158 INFO:teuthology.orchestra.run.smithi078.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 doio fsstress fsx growfiles iogen aio-stress /var/lib/xfstests/ltp 2023-12-12T10:15:14.319 INFO:teuthology.orchestra.run.smithi078.stdout:../install-sh -o root -g root -m 755 rwtest.sh /var/lib/xfstests/ltp 2023-12-12T10:15:14.339 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/gmake --no-print-directory Q=@ -C src install 2023-12-12T10:15:14.368 INFO:teuthology.orchestra.run.smithi078.stdout:Building log-writes 2023-12-12T10:15:14.374 INFO:teuthology.orchestra.run.smithi078.stdout:Building perf 2023-12-12T10:15:14.381 INFO:teuthology.orchestra.run.smithi078.stdout:Building aio-dio-regress 2023-12-12T10:15:14.388 INFO:teuthology.orchestra.run.smithi078.stdout:Building vfs 2023-12-12T10:15:14.393 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/gmake -C log-writes install 2023-12-12T10:15:14.397 INFO:teuthology.orchestra.run.smithi078.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/log-writes 2023-12-12T10:15:14.417 INFO:teuthology.orchestra.run.smithi078.stdout:../../install-sh -o root -g root -m 755 replay-log /var/lib/xfstests/src/log-writes 2023-12-12T10:15:14.438 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/gmake -C perf install 2023-12-12T10:15:14.442 INFO:teuthology.orchestra.run.smithi078.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/perf 2023-12-12T10:15:14.462 INFO:teuthology.orchestra.run.smithi078.stdout:../../install-sh -o root -g root -m 755 FioCompare.py fio-insert-and-compare.py FioResultDecoder.py generate-schema.py ResultData.py fio-results.sql /var/lib/xfstests/src/perf 2023-12-12T10:15:14.511 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/gmake -C aio-dio-regress install 2023-12-12T10:15:14.515 INFO:teuthology.orchestra.run.smithi078.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/aio-dio-regress 2023-12-12T10:15:14.535 INFO:teuthology.orchestra.run.smithi078.stdout:../../install-sh -o root -g root -m 755 aiocp aio-dio-append-write-fallocate-race aio-dio-append-write-read-race aio-dio-cow-race aio-dio-cycle-write aio-dio-eof-race aio-dio-extend-stat aio-dio-fcntl-race aio-dio-hole-filling-race aio-dio-invalidate-failure aio-dio-invalidate-readahead aiodio_sparse2 aio-dio-subblock-eof-read aio-dio-write-verify aio-free-ring-with-bogus-nr-pages aio-io-setup-with-nonwritable-context-pointer aio-last-ref-held-by-io /var/lib/xfstests/src/aio-dio-regress 2023-12-12T10:15:14.649 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/gmake -C vfs install 2023-12-12T10:15:14.653 INFO:teuthology.orchestra.run.smithi078.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/vfs 2023-12-12T10:15:14.673 INFO:teuthology.orchestra.run.smithi078.stdout:../../install-sh -o root -g root -m 755 vfstest mount-idmapped /var/lib/xfstests/src/vfs 2023-12-12T10:15:14.702 INFO:teuthology.orchestra.run.smithi078.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src 2023-12-12T10:15:14.722 INFO:teuthology.orchestra.run.smithi078.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dirstress fill fill2 getpagesize holes lstat64 nametest permname randholes runas truncfile usemem mmapcat append_reader append_writer dirperf metaperf devzero feature alloc fault fstest t_access_root godown resvtest writemod writev_on_pagefault makeextents itrash rename multi_open_unlink unwritten_sync genhashnames t_holes t_mmap_writev t_truncate_cmtime dirhash_collide t_rename_overwrite holetest t_truncate_self af_unix t_mmap_stale_pmd t_mmap_cow_race t_mmap_fallocate fsync-err t_mmap_write_ro t_ext4_dax_journal_corruption t_ext4_dax_inline_corruption t_ofd_locks t_mmap_collision mmap-write-concurrent t_get_file_time t_create_short_dirs t_create_long_dirs t_enospc t_mmap_writev_overlap checkpoint_journal mmap-rw-fault allocstale t_mmap_cow_memory_failure fake-dump-rootino dio-buf-fault rewinddir-test xfsctl bstat t_mtab getdevicesize preallo_rw_pattern_reader preallo_rw_pattern_writer ftrunc trunc fs_perms testx looptest locktest unwritten_mmap bulkstat_unlink_test deduperace bulkstat_unlink_test_modified t_dir_offset t_futimens t_immutable stale_handle pwrite_mmap_blocked t_dir_offset2 seek_sanity_test seek_copy_test t_readdir_1 t_readdir_2 fsync-tester nsexec cloner renameat2 t_getcwd e4compact test-nextquota punch-alternating attr-list-by-handle-cursor-test listxattr dio-interleaved t_dir_type dio-invalidate-cache stat_test t_encrypted_d_revalidate attr_replace_test swapon mkswap t_attr_corruption t_open_tmpfiles fscrypt-crypt-util bulkstat_null_ocount splice-test chprojid_fail detached_mounts_propagation ext4_resize t_readdir_3 splice2pipe uuid_ioctl fiemap-tester t_stripealign open_by_handle t_mmap_dio uring_read_fault xfsfind t_reflink_read_race fssum /var/lib/xfstests/src 2023-12-12T10:15:17.548 INFO:teuthology.orchestra.run.smithi078.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dmerror fill2attr fill2fs fill2fs_check scaleread.sh btrfs_crc32c_forged_name.py popdir.pl popattr.py soak_duration.awk /var/lib/xfstests/src 2023-12-12T10:15:17.770 INFO:teuthology.orchestra.run.smithi078.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 644 dumpfile /var/lib/xfstests/src 2023-12-12T10:15:17.817 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/gmake --no-print-directory Q=@ -C m4 install 2023-12-12T10:15:17.821 INFO:teuthology.orchestra.run.smithi078.stdout:gmake[1]: Nothing to be done for 'install'. 2023-12-12T10:15:17.822 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/gmake --no-print-directory Q=@ -C common install 2023-12-12T10:15:17.825 INFO:teuthology.orchestra.run.smithi078.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/common 2023-12-12T10:15:17.846 INFO:teuthology.orchestra.run.smithi078.stdout:../install-sh -o root -g root -m 644 * /var/lib/xfstests/common 2023-12-12T10:15:18.129 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/gmake --no-print-directory Q=@ -C tests install 2023-12-12T10:15:18.133 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.GmWnCxuSqIxfstests-dev/tests/btrfs/ install 2023-12-12T10:15:18.138 INFO:teuthology.orchestra.run.smithi078.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/btrfs 2023-12-12T10:15:18.159 INFO:teuthology.orchestra.run.smithi078.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 /var/lib/xfstests/tests/btrfs 2023-12-12T10:15:19.910 INFO:teuthology.orchestra.run.smithi078.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/btrfs 2023-12-12T10:15:19.931 INFO:teuthology.orchestra.run.smithi078.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 096.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 216.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out /var/lib/xfstests/tests/btrfs 2023-12-12T10:15:21.683 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.GmWnCxuSqIxfstests-dev/tests/ceph/ install 2023-12-12T10:15:21.687 INFO:teuthology.orchestra.run.smithi078.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ceph 2023-12-12T10:15:21.707 INFO:teuthology.orchestra.run.smithi078.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 /var/lib/xfstests/tests/ceph 2023-12-12T10:15:21.750 INFO:teuthology.orchestra.run.smithi078.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ceph 2023-12-12T10:15:21.771 INFO:teuthology.orchestra.run.smithi078.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out /var/lib/xfstests/tests/ceph 2023-12-12T10:15:21.814 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.GmWnCxuSqIxfstests-dev/tests/cifs/ install 2023-12-12T10:15:21.818 INFO:teuthology.orchestra.run.smithi078.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/cifs 2023-12-12T10:15:21.838 INFO:teuthology.orchestra.run.smithi078.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/cifs 2023-12-12T10:15:21.859 INFO:teuthology.orchestra.run.smithi078.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/cifs 2023-12-12T10:15:21.879 INFO:teuthology.orchestra.run.smithi078.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/cifs 2023-12-12T10:15:21.900 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.GmWnCxuSqIxfstests-dev/tests/ext4/ install 2023-12-12T10:15:21.904 INFO:teuthology.orchestra.run.smithi078.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ext4 2023-12-12T10:15:21.924 INFO:teuthology.orchestra.run.smithi078.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 271 301 302 303 304 305 306 307 308 /var/lib/xfstests/tests/ext4 2023-12-12T10:15:22.327 INFO:teuthology.orchestra.run.smithi078.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ext4 2023-12-12T10:15:22.347 INFO:teuthology.orchestra.run.smithi078.stdout:../../install-sh -o root -g root -m 644 001.out.default 001.out.nodelalloc 001.out.nozero 001.cfg 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 271.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out /var/lib/xfstests/tests/ext4 2023-12-12T10:15:22.770 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.GmWnCxuSqIxfstests-dev/tests/f2fs/ install 2023-12-12T10:15:22.774 INFO:teuthology.orchestra.run.smithi078.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/f2fs 2023-12-12T10:15:22.794 INFO:teuthology.orchestra.run.smithi078.stdout:../../install-sh -o root -g root -m 755 001 002 /var/lib/xfstests/tests/f2fs 2023-12-12T10:15:22.821 INFO:teuthology.orchestra.run.smithi078.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/f2fs 2023-12-12T10:15:22.841 INFO:teuthology.orchestra.run.smithi078.stdout:../../install-sh -o root -g root -m 644 001.out 002.out /var/lib/xfstests/tests/f2fs 2023-12-12T10:15:22.867 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.GmWnCxuSqIxfstests-dev/tests/generic/ install 2023-12-12T10:15:22.874 INFO:teuthology.orchestra.run.smithi078.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/generic 2023-12-12T10:15:22.895 INFO:teuthology.orchestra.run.smithi078.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 608 609 610 611 612 613 614 615 616 617 618 619 620 621 622 623 624 625 626 627 628 629 630 631 632 633 634 635 636 637 638 639 640 641 642 643 644 645 646 647 648 649 650 651 652 653 654 655 656 657 658 659 660 661 662 663 664 665 666 667 668 669 670 671 672 673 674 675 676 677 678 679 680 681 682 683 684 685 686 687 688 689 690 691 692 693 694 695 696 697 698 699 700 701 702 703 704 705 706 707 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 /var/lib/xfstests/tests/generic 2023-12-12T10:15:27.123 INFO:teuthology.orchestra.run.smithi078.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/generic 2023-12-12T10:15:27.259 INFO:teuthology.orchestra.run.smithi078.stdout:../../install-sh -o root -g root -m 644 035.out.default 035.out.nfs 050.out.default 050.out.nojournal 050.out.xfsquota 035.cfg 050.cfg 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 096.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 216.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out 310.out 311.out 312.out 313.out 314.out 315.out 316.out 317.out 318.out 319.out 320.out 321.out 322.out 323.out 324.out 325.out 326.out 327.out 328.out 329.out 330.out 331.out 332.out 333.out 334.out 335.out 336.out 337.out 338.out 339.out 340.out 341.out 342.out 343.out 344.out 345.out 346.out 347.out 348.out 349.out 350.out 351.out 352.out 353.out 354.out 355.out 356.out 357.out 358.out 359.out 360.out 361.out 362.out 363.out 364.out 365.out 366.out 367.out 368.out 369.out 370.out 371.out 372.out 373.out 374.out 375.out 376.out 377.out 378.out 379.out 380.out 381.out 382.out 383.out 384.out 385.out 386.out 387.out 388.out 389.out 390.out 391.out 392.out 393.out 394.out 395.out 396.out 397.out 398.out 399.out 400.out 401.out 402.out 403.out 404.out 405.out 406.out 407.out 408.out 409.out 410.out 411.out 412.out 413.out 414.out 415.out 416.out 417.out 418.out 419.out 420.out 421.out 422.out 423.out 424.out 425.out 426.out 427.out 428.out 429.out 430.out 431.out 432.out 433.out 434.out 435.out 436.out 437.out 438.out 439.out 440.out 441.out 442.out 443.out 444.out 445.out 446.out 447.out 448.out 449.out 450.out 451.out 452.out 453.out 454.out 455.out 456.out 457.out 458.out 459.out 460.out 461.out 462.out 463.out 464.out 465.out 466.out 467.out 468.out 469.out 470.out 471.out 472.out 473.out 474.out 475.out 476.out 477.out 478.out 479.out 480.out 481.out 482.out 483.out 484.out 485.out 486.out 487.out 488.out 489.out 490.out 491.out 492.out 493.out 494.out 495.out 496.out 497.out 498.out 499.out 500.out 501.out 502.out 503.out 504.out 505.out 506.out 507.out 508.out 509.out 510.out 511.out 512.out 513.out 514.out 515.out 516.out 517.out 518.out 519.out 520.out 521.out 522.out 523.out 524.out 525.out 526.out 527.out 528.out 529.out 530.out 531.out 532.out 533.out 534.out 535.out 536.out 537.out 538.out 539.out 540.out 541.out 542.out 543.out 544.out 545.out 546.out 547.out 548.out 549.out 550.out 551.out 552.out 553.out 554.out 555.out 556.out 557.out 558.out 559.out 560.out 561.out 562.out 563.out 564.out 565.out 566.out 567.out 568.out 569.out 570.out 571.out 572.out 573.out 574.out 575.out 576.out 577.out 578.out 579.out 580.out 581.out 582.out 583.out 584.out 585.out 586.out 587.out 588.out 589.out 590.out 591.out 592.out 593.out 594.out 595.out 596.out 597.out 598.out 599.out 600.out 601.out 602.out 603.out 604.out 605.out 606.out 607.out 608.out 609.out 610.out 611.out 612.out 613.out 614.out 615.out 616.out 617.out 618.out 619.out 620.out 621.out 622.out 623.out 624.out 625.out 626.out 627.out 628.out 629.out 630.out 631.out 632.out 633.out 634.out 635.out 636.out 637.out 638.out 639.out 640.out 641.out 642.out 643.out 644.out 645.out 646.out 647.out 648.out 649.out 650.out 651.out 652.out 653.out 654.out 655.out 656.out 657.out 658.out 659.out 660.out 661.out 662.out 663.out 664.out 665.out 666.out 667.out 668.out 669.out 670.out 671.out 672.out 673.out 674.out 675.out 676.out 677.out 678.out 679.out 680.out 681.out 682.out 683.out 684.out 685.out 686.out 687.out 688.out 689.out 690.out 691.out 692.out 693.out 694.out 695.out 696.out 697.out 698.out 699.out 700.out 701.out 702.out 703.out 704.out 705.out 706.out 707.out 708.out 709.out 710.out 711.out 712.out 713.out 714.out 715.out 716.out 717.out 718.out 719.out 720.out 721.out 722.out 723.out 724.out 725.out 726.out 727.out 728.out 729.out 730.out 731.out 732.out 733.out /var/lib/xfstests/tests/generic 2023-12-12T10:15:31.405 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.GmWnCxuSqIxfstests-dev/tests/nfs/ install 2023-12-12T10:15:31.409 INFO:teuthology.orchestra.run.smithi078.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/nfs 2023-12-12T10:15:31.429 INFO:teuthology.orchestra.run.smithi078.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/nfs 2023-12-12T10:15:31.450 INFO:teuthology.orchestra.run.smithi078.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/nfs 2023-12-12T10:15:31.470 INFO:teuthology.orchestra.run.smithi078.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/nfs 2023-12-12T10:15:31.490 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.GmWnCxuSqIxfstests-dev/tests/ocfs2/ install 2023-12-12T10:15:31.494 INFO:teuthology.orchestra.run.smithi078.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ocfs2 2023-12-12T10:15:31.514 INFO:teuthology.orchestra.run.smithi078.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/ocfs2 2023-12-12T10:15:31.535 INFO:teuthology.orchestra.run.smithi078.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ocfs2 2023-12-12T10:15:31.555 INFO:teuthology.orchestra.run.smithi078.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/ocfs2 2023-12-12T10:15:31.576 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.GmWnCxuSqIxfstests-dev/tests/overlay/ install 2023-12-12T10:15:31.580 INFO:teuthology.orchestra.run.smithi078.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/overlay 2023-12-12T10:15:31.600 INFO:teuthology.orchestra.run.smithi078.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 /var/lib/xfstests/tests/overlay 2023-12-12T10:15:32.196 INFO:teuthology.orchestra.run.smithi078.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/overlay 2023-12-12T10:15:32.216 INFO:teuthology.orchestra.run.smithi078.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out /var/lib/xfstests/tests/overlay 2023-12-12T10:15:32.810 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.GmWnCxuSqIxfstests-dev/tests/perf/ install 2023-12-12T10:15:32.814 INFO:teuthology.orchestra.run.smithi078.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/perf 2023-12-12T10:15:32.834 INFO:teuthology.orchestra.run.smithi078.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/perf 2023-12-12T10:15:32.854 INFO:teuthology.orchestra.run.smithi078.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/perf 2023-12-12T10:15:32.874 INFO:teuthology.orchestra.run.smithi078.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/perf 2023-12-12T10:15:32.895 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.GmWnCxuSqIxfstests-dev/tests/selftest/ install 2023-12-12T10:15:32.899 INFO:teuthology.orchestra.run.smithi078.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/selftest 2023-12-12T10:15:32.919 INFO:teuthology.orchestra.run.smithi078.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 /var/lib/xfstests/tests/selftest 2023-12-12T10:15:32.968 INFO:teuthology.orchestra.run.smithi078.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/selftest 2023-12-12T10:15:32.988 INFO:teuthology.orchestra.run.smithi078.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out /var/lib/xfstests/tests/selftest 2023-12-12T10:15:33.037 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.GmWnCxuSqIxfstests-dev/tests/shared/ install 2023-12-12T10:15:33.041 INFO:teuthology.orchestra.run.smithi078.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/shared 2023-12-12T10:15:33.062 INFO:teuthology.orchestra.run.smithi078.stdout:../../install-sh -o root -g root -m 755 002 032 298 /var/lib/xfstests/tests/shared 2023-12-12T10:15:33.094 INFO:teuthology.orchestra.run.smithi078.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/shared 2023-12-12T10:15:33.115 INFO:teuthology.orchestra.run.smithi078.stdout:../../install-sh -o root -g root -m 644 002.out 032.out 298.out /var/lib/xfstests/tests/shared 2023-12-12T10:15:33.147 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.GmWnCxuSqIxfstests-dev/tests/tmpfs/ install 2023-12-12T10:15:33.151 INFO:teuthology.orchestra.run.smithi078.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/tmpfs 2023-12-12T10:15:33.171 INFO:teuthology.orchestra.run.smithi078.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/tmpfs 2023-12-12T10:15:33.192 INFO:teuthology.orchestra.run.smithi078.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/tmpfs 2023-12-12T10:15:33.213 INFO:teuthology.orchestra.run.smithi078.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/tmpfs 2023-12-12T10:15:33.233 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.GmWnCxuSqIxfstests-dev/tests/udf/ install 2023-12-12T10:15:33.237 INFO:teuthology.orchestra.run.smithi078.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/udf 2023-12-12T10:15:33.257 INFO:teuthology.orchestra.run.smithi078.stdout:../../install-sh -o root -g root -m 755 102 /var/lib/xfstests/tests/udf 2023-12-12T10:15:33.278 INFO:teuthology.orchestra.run.smithi078.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/udf 2023-12-12T10:15:33.298 INFO:teuthology.orchestra.run.smithi078.stdout:../../install-sh -o root -g root -m 644 102.out /var/lib/xfstests/tests/udf 2023-12-12T10:15:33.319 INFO:teuthology.orchestra.run.smithi078.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.GmWnCxuSqIxfstests-dev/tests/xfs/ install 2023-12-12T10:15:33.326 INFO:teuthology.orchestra.run.smithi078.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/xfs 2023-12-12T10:15:33.346 INFO:teuthology.orchestra.run.smithi078.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 740 741 742 743 744 745 746 747 748 749 750 751 752 753 754 755 756 757 758 759 760 761 762 763 764 765 766 767 768 769 770 771 772 773 774 775 776 777 778 779 780 781 782 783 784 785 786 787 788 789 790 791 792 793 794 795 796 797 798 799 800 /var/lib/xfstests/tests/xfs 2023-12-12T10:15:37.353 INFO:teuthology.orchestra.run.smithi078.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/xfs 2023-12-12T10:15:37.374 INFO:teuthology.orchestra.run.smithi078.stdout:../../install-sh -o root -g root -m 644 033.out.crc 033.out.default 071.out.32 071.out.64 096.out.external 096.out.internal 216.out.64mblog 216.out.classic 033.cfg 216.cfg 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out 310.out 311.out 312.out 313.out 314.out 315.out 316.out 317.out 318.out 319.out 320.out 321.out 322.out 323.out 324.out 325.out 326.out 327.out 328.out 329.out 330.out 331.out 332.out 333.out 334.out 335.out 336.out 337.out 338.out 339.out 340.out 341.out 342.out 343.out 344.out 345.out 346.out 347.out 348.out 349.out 350.out 351.out 352.out 353.out 354.out 355.out 356.out 357.out 358.out 359.out 360.out 361.out 362.out 363.out 364.out 365.out 366.out 367.out 368.out 369.out 370.out 371.out 372.out 373.out 374.out 375.out 376.out 377.out 378.out 379.out 380.out 381.out 382.out 383.out 384.out 385.out 386.out 387.out 388.out 389.out 390.out 391.out 392.out 393.out 394.out 395.out 396.out 397.out 398.out 399.out 400.out 401.out 402.out 403.out 404.out 405.out 406.out 407.out 408.out 409.out 410.out 411.out 412.out 413.out 414.out 415.out 416.out 417.out 418.out 419.out 420.out 421.out 422.out 423.out 424.out 425.out 426.out 427.out 428.out 429.out 430.out 431.out 432.out 433.out 434.out 435.out 436.out 437.out 438.out 439.out 440.out 441.out 442.out 443.out 444.out 445.out 446.out 447.out 448.out 449.out 450.out 451.out 452.out 453.out 454.out 455.out 456.out 457.out 458.out 459.out 460.out 461.out 462.out 463.out 464.out 465.out 466.out 467.out 468.out 469.out 470.out 471.out 472.out 473.out 474.out 475.out 476.out 477.out 478.out 479.out 480.out 481.out 482.out 483.out 484.out 485.out 486.out 487.out 488.out 489.out 490.out 491.out 492.out 493.out 494.out 495.out 496.out 497.out 498.out 499.out 500.out 501.out 502.out 503.out 504.out 505.out 506.out 507.out 508.out 509.out 510.out 511.out 512.out 513.out 514.out 515.out 516.out 517.out 518.out 519.out 520.out 521.out 522.out 523.out 524.out 525.out 526.out 527.out 528.out 529.out 530.out 531.out 532.out 533.out 534.out 535.out 536.out 537.out 538.out 539.out 540.out 541.out 542.out 543.out 544.out 545.out 546.out 547.out 548.out 549.out 550.out 551.out 552.out 553.out 554.out 555.out 556.out 557.out 558.out 559.out 560.out 561.out 562.out 563.out 564.out 565.out 566.out 567.out 568.out 569.out 570.out 571.out 572.out 573.out 574.out 575.out 576.out 577.out 578.out 579.out 580.out 581.out 582.out 583.out 584.out 585.out 586.out 587.out 588.out 589.out 590.out 591.out 592.out 593.out 594.out 595.out 596.out 597.out 598.out 599.out 600.out 601.out 602.out 603.out 604.out 708.out 709.out 710.out 711.out 712.out 713.out 714.out 715.out 716.out 717.out 718.out 719.out 720.out 721.out 722.out 723.out 724.out 725.out 726.out 727.out 728.out 729.out 730.out 731.out 732.out 733.out 734.out 735.out 736.out 737.out 738.out 739.out 740.out 741.out 742.out 743.out 744.out 745.out 746.out 747.out 748.out 749.out 750.out 751.out 752.out 753.out 754.out 755.out 756.out 757.out 758.out 759.out 760.out 761.out 762.out 763.out 764.out 765.out 766.out 767.out 768.out 769.out 770.out 771.out 772.out 773.out 774.out 775.out 776.out 777.out 778.out 779.out 780.out 781.out 782.out 783.out 784.out 785.out 786.out 787.out 788.out 789.out 790.out 791.out 792.out 793.out 794.out 795.out 796.out 797.out 798.out 799.out 800.out /var/lib/xfstests/tests/xfs 2023-12-12T10:15:37.772 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T10:15:37.776 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T10:15:41.438 INFO:teuthology.orchestra.run.smithi078.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests 2023-12-12T10:15:41.458 INFO:teuthology.orchestra.run.smithi078.stdout:./install-sh -o root -g root -m 755 -d /var/lib/xfstests 2023-12-12T10:15:41.478 INFO:teuthology.orchestra.run.smithi078.stdout:./install-sh -o root -g root -m 755 check /var/lib/xfstests 2023-12-12T10:15:41.499 INFO:teuthology.orchestra.run.smithi078.stdout:./install-sh -o root -g root -m 644 randomize.awk /var/lib/xfstests 2023-12-12T10:15:41.522 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T10:15:41.522 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec ls tests/generic) 2023-12-12T10:15:41.533 INFO:teuthology.orchestra.run.smithi078.stdout:001 2023-12-12T10:15:41.533 INFO:teuthology.orchestra.run.smithi078.stdout:001.out 2023-12-12T10:15:41.534 INFO:teuthology.orchestra.run.smithi078.stdout:002 2023-12-12T10:15:41.534 INFO:teuthology.orchestra.run.smithi078.stdout:002.out 2023-12-12T10:15:41.534 INFO:teuthology.orchestra.run.smithi078.stdout:003 2023-12-12T10:15:41.534 INFO:teuthology.orchestra.run.smithi078.stdout:003.out 2023-12-12T10:15:41.534 INFO:teuthology.orchestra.run.smithi078.stdout:004 2023-12-12T10:15:41.534 INFO:teuthology.orchestra.run.smithi078.stdout:004.out 2023-12-12T10:15:41.534 INFO:teuthology.orchestra.run.smithi078.stdout:005 2023-12-12T10:15:41.534 INFO:teuthology.orchestra.run.smithi078.stdout:005.out 2023-12-12T10:15:41.534 INFO:teuthology.orchestra.run.smithi078.stdout:006 2023-12-12T10:15:41.534 INFO:teuthology.orchestra.run.smithi078.stdout:006.out 2023-12-12T10:15:41.534 INFO:teuthology.orchestra.run.smithi078.stdout:007 2023-12-12T10:15:41.534 INFO:teuthology.orchestra.run.smithi078.stdout:007.out 2023-12-12T10:15:41.534 INFO:teuthology.orchestra.run.smithi078.stdout:008 2023-12-12T10:15:41.535 INFO:teuthology.orchestra.run.smithi078.stdout:008.out 2023-12-12T10:15:41.535 INFO:teuthology.orchestra.run.smithi078.stdout:009 2023-12-12T10:15:41.535 INFO:teuthology.orchestra.run.smithi078.stdout:009.out 2023-12-12T10:15:41.535 INFO:teuthology.orchestra.run.smithi078.stdout:010 2023-12-12T10:15:41.535 INFO:teuthology.orchestra.run.smithi078.stdout:010.out 2023-12-12T10:15:41.535 INFO:teuthology.orchestra.run.smithi078.stdout:011 2023-12-12T10:15:41.535 INFO:teuthology.orchestra.run.smithi078.stdout:011.out 2023-12-12T10:15:41.535 INFO:teuthology.orchestra.run.smithi078.stdout:012 2023-12-12T10:15:41.535 INFO:teuthology.orchestra.run.smithi078.stdout:012.out 2023-12-12T10:15:41.535 INFO:teuthology.orchestra.run.smithi078.stdout:013 2023-12-12T10:15:41.535 INFO:teuthology.orchestra.run.smithi078.stdout:013.out 2023-12-12T10:15:41.535 INFO:teuthology.orchestra.run.smithi078.stdout:014 2023-12-12T10:15:41.535 INFO:teuthology.orchestra.run.smithi078.stdout:014.out 2023-12-12T10:15:41.535 INFO:teuthology.orchestra.run.smithi078.stdout:015 2023-12-12T10:15:41.535 INFO:teuthology.orchestra.run.smithi078.stdout:015.out 2023-12-12T10:15:41.536 INFO:teuthology.orchestra.run.smithi078.stdout:016 2023-12-12T10:15:41.536 INFO:teuthology.orchestra.run.smithi078.stdout:016.out 2023-12-12T10:15:41.536 INFO:teuthology.orchestra.run.smithi078.stdout:017 2023-12-12T10:15:41.536 INFO:teuthology.orchestra.run.smithi078.stdout:017.out 2023-12-12T10:15:41.536 INFO:teuthology.orchestra.run.smithi078.stdout:018 2023-12-12T10:15:41.536 INFO:teuthology.orchestra.run.smithi078.stdout:018.out 2023-12-12T10:15:41.536 INFO:teuthology.orchestra.run.smithi078.stdout:019 2023-12-12T10:15:41.536 INFO:teuthology.orchestra.run.smithi078.stdout:019.out 2023-12-12T10:15:41.536 INFO:teuthology.orchestra.run.smithi078.stdout:020 2023-12-12T10:15:41.536 INFO:teuthology.orchestra.run.smithi078.stdout:020.out 2023-12-12T10:15:41.536 INFO:teuthology.orchestra.run.smithi078.stdout:021 2023-12-12T10:15:41.536 INFO:teuthology.orchestra.run.smithi078.stdout:021.out 2023-12-12T10:15:41.537 INFO:teuthology.orchestra.run.smithi078.stdout:022 2023-12-12T10:15:41.537 INFO:teuthology.orchestra.run.smithi078.stdout:022.out 2023-12-12T10:15:41.537 INFO:teuthology.orchestra.run.smithi078.stdout:023 2023-12-12T10:15:41.537 INFO:teuthology.orchestra.run.smithi078.stdout:023.out 2023-12-12T10:15:41.537 INFO:teuthology.orchestra.run.smithi078.stdout:024 2023-12-12T10:15:41.537 INFO:teuthology.orchestra.run.smithi078.stdout:024.out 2023-12-12T10:15:41.537 INFO:teuthology.orchestra.run.smithi078.stdout:025 2023-12-12T10:15:41.537 INFO:teuthology.orchestra.run.smithi078.stdout:025.out 2023-12-12T10:15:41.537 INFO:teuthology.orchestra.run.smithi078.stdout:026 2023-12-12T10:15:41.537 INFO:teuthology.orchestra.run.smithi078.stdout:026.out 2023-12-12T10:15:41.537 INFO:teuthology.orchestra.run.smithi078.stdout:027 2023-12-12T10:15:41.537 INFO:teuthology.orchestra.run.smithi078.stdout:027.out 2023-12-12T10:15:41.538 INFO:teuthology.orchestra.run.smithi078.stdout:028 2023-12-12T10:15:41.538 INFO:teuthology.orchestra.run.smithi078.stdout:028.out 2023-12-12T10:15:41.538 INFO:teuthology.orchestra.run.smithi078.stdout:029 2023-12-12T10:15:41.538 INFO:teuthology.orchestra.run.smithi078.stdout:029.out 2023-12-12T10:15:41.538 INFO:teuthology.orchestra.run.smithi078.stdout:030 2023-12-12T10:15:41.538 INFO:teuthology.orchestra.run.smithi078.stdout:030.out 2023-12-12T10:15:41.538 INFO:teuthology.orchestra.run.smithi078.stdout:031 2023-12-12T10:15:41.538 INFO:teuthology.orchestra.run.smithi078.stdout:031.out 2023-12-12T10:15:41.538 INFO:teuthology.orchestra.run.smithi078.stdout:032 2023-12-12T10:15:41.538 INFO:teuthology.orchestra.run.smithi078.stdout:032.out 2023-12-12T10:15:41.539 INFO:teuthology.orchestra.run.smithi078.stdout:033 2023-12-12T10:15:41.539 INFO:teuthology.orchestra.run.smithi078.stdout:033.out 2023-12-12T10:15:41.539 INFO:teuthology.orchestra.run.smithi078.stdout:034 2023-12-12T10:15:41.539 INFO:teuthology.orchestra.run.smithi078.stdout:034.out 2023-12-12T10:15:41.539 INFO:teuthology.orchestra.run.smithi078.stdout:035 2023-12-12T10:15:41.539 INFO:teuthology.orchestra.run.smithi078.stdout:035.cfg 2023-12-12T10:15:41.539 INFO:teuthology.orchestra.run.smithi078.stdout:035.out.default 2023-12-12T10:15:41.539 INFO:teuthology.orchestra.run.smithi078.stdout:035.out.nfs 2023-12-12T10:15:41.539 INFO:teuthology.orchestra.run.smithi078.stdout:036 2023-12-12T10:15:41.539 INFO:teuthology.orchestra.run.smithi078.stdout:036.out 2023-12-12T10:15:41.539 INFO:teuthology.orchestra.run.smithi078.stdout:037 2023-12-12T10:15:41.539 INFO:teuthology.orchestra.run.smithi078.stdout:037.out 2023-12-12T10:15:41.539 INFO:teuthology.orchestra.run.smithi078.stdout:038 2023-12-12T10:15:41.539 INFO:teuthology.orchestra.run.smithi078.stdout:038.out 2023-12-12T10:15:41.539 INFO:teuthology.orchestra.run.smithi078.stdout:039 2023-12-12T10:15:41.540 INFO:teuthology.orchestra.run.smithi078.stdout:039.out 2023-12-12T10:15:41.540 INFO:teuthology.orchestra.run.smithi078.stdout:040 2023-12-12T10:15:41.540 INFO:teuthology.orchestra.run.smithi078.stdout:040.out 2023-12-12T10:15:41.540 INFO:teuthology.orchestra.run.smithi078.stdout:041 2023-12-12T10:15:41.540 INFO:teuthology.orchestra.run.smithi078.stdout:041.out 2023-12-12T10:15:41.540 INFO:teuthology.orchestra.run.smithi078.stdout:042 2023-12-12T10:15:41.540 INFO:teuthology.orchestra.run.smithi078.stdout:042.out 2023-12-12T10:15:41.540 INFO:teuthology.orchestra.run.smithi078.stdout:043 2023-12-12T10:15:41.540 INFO:teuthology.orchestra.run.smithi078.stdout:043.out 2023-12-12T10:15:41.540 INFO:teuthology.orchestra.run.smithi078.stdout:044 2023-12-12T10:15:41.541 INFO:teuthology.orchestra.run.smithi078.stdout:044.out 2023-12-12T10:15:41.541 INFO:teuthology.orchestra.run.smithi078.stdout:045 2023-12-12T10:15:41.541 INFO:teuthology.orchestra.run.smithi078.stdout:045.out 2023-12-12T10:15:41.541 INFO:teuthology.orchestra.run.smithi078.stdout:046 2023-12-12T10:15:41.541 INFO:teuthology.orchestra.run.smithi078.stdout:046.out 2023-12-12T10:15:41.541 INFO:teuthology.orchestra.run.smithi078.stdout:047 2023-12-12T10:15:41.541 INFO:teuthology.orchestra.run.smithi078.stdout:047.out 2023-12-12T10:15:41.541 INFO:teuthology.orchestra.run.smithi078.stdout:048 2023-12-12T10:15:41.541 INFO:teuthology.orchestra.run.smithi078.stdout:048.out 2023-12-12T10:15:41.541 INFO:teuthology.orchestra.run.smithi078.stdout:049 2023-12-12T10:15:41.541 INFO:teuthology.orchestra.run.smithi078.stdout:049.out 2023-12-12T10:15:41.541 INFO:teuthology.orchestra.run.smithi078.stdout:050 2023-12-12T10:15:41.541 INFO:teuthology.orchestra.run.smithi078.stdout:050.cfg 2023-12-12T10:15:41.541 INFO:teuthology.orchestra.run.smithi078.stdout:050.out.default 2023-12-12T10:15:41.541 INFO:teuthology.orchestra.run.smithi078.stdout:050.out.nojournal 2023-12-12T10:15:41.542 INFO:teuthology.orchestra.run.smithi078.stdout:050.out.xfsquota 2023-12-12T10:15:41.542 INFO:teuthology.orchestra.run.smithi078.stdout:051 2023-12-12T10:15:41.542 INFO:teuthology.orchestra.run.smithi078.stdout:051.out 2023-12-12T10:15:41.542 INFO:teuthology.orchestra.run.smithi078.stdout:052 2023-12-12T10:15:41.542 INFO:teuthology.orchestra.run.smithi078.stdout:052.out 2023-12-12T10:15:41.542 INFO:teuthology.orchestra.run.smithi078.stdout:053 2023-12-12T10:15:41.542 INFO:teuthology.orchestra.run.smithi078.stdout:053.out 2023-12-12T10:15:41.542 INFO:teuthology.orchestra.run.smithi078.stdout:054 2023-12-12T10:15:41.542 INFO:teuthology.orchestra.run.smithi078.stdout:054.out 2023-12-12T10:15:41.542 INFO:teuthology.orchestra.run.smithi078.stdout:055 2023-12-12T10:15:41.542 INFO:teuthology.orchestra.run.smithi078.stdout:055.out 2023-12-12T10:15:41.542 INFO:teuthology.orchestra.run.smithi078.stdout:056 2023-12-12T10:15:41.542 INFO:teuthology.orchestra.run.smithi078.stdout:056.out 2023-12-12T10:15:41.542 INFO:teuthology.orchestra.run.smithi078.stdout:057 2023-12-12T10:15:41.543 INFO:teuthology.orchestra.run.smithi078.stdout:057.out 2023-12-12T10:15:41.543 INFO:teuthology.orchestra.run.smithi078.stdout:058 2023-12-12T10:15:41.543 INFO:teuthology.orchestra.run.smithi078.stdout:058.out 2023-12-12T10:15:41.543 INFO:teuthology.orchestra.run.smithi078.stdout:059 2023-12-12T10:15:41.543 INFO:teuthology.orchestra.run.smithi078.stdout:059.out 2023-12-12T10:15:41.543 INFO:teuthology.orchestra.run.smithi078.stdout:060 2023-12-12T10:15:41.543 INFO:teuthology.orchestra.run.smithi078.stdout:060.out 2023-12-12T10:15:41.543 INFO:teuthology.orchestra.run.smithi078.stdout:061 2023-12-12T10:15:41.543 INFO:teuthology.orchestra.run.smithi078.stdout:061.out 2023-12-12T10:15:41.543 INFO:teuthology.orchestra.run.smithi078.stdout:062 2023-12-12T10:15:41.543 INFO:teuthology.orchestra.run.smithi078.stdout:062.out 2023-12-12T10:15:41.543 INFO:teuthology.orchestra.run.smithi078.stdout:063 2023-12-12T10:15:41.543 INFO:teuthology.orchestra.run.smithi078.stdout:063.out 2023-12-12T10:15:41.543 INFO:teuthology.orchestra.run.smithi078.stdout:064 2023-12-12T10:15:41.544 INFO:teuthology.orchestra.run.smithi078.stdout:064.out 2023-12-12T10:15:41.544 INFO:teuthology.orchestra.run.smithi078.stdout:065 2023-12-12T10:15:41.544 INFO:teuthology.orchestra.run.smithi078.stdout:065.out 2023-12-12T10:15:41.544 INFO:teuthology.orchestra.run.smithi078.stdout:066 2023-12-12T10:15:41.544 INFO:teuthology.orchestra.run.smithi078.stdout:066.out 2023-12-12T10:15:41.544 INFO:teuthology.orchestra.run.smithi078.stdout:067 2023-12-12T10:15:41.544 INFO:teuthology.orchestra.run.smithi078.stdout:067.out 2023-12-12T10:15:41.544 INFO:teuthology.orchestra.run.smithi078.stdout:068 2023-12-12T10:15:41.544 INFO:teuthology.orchestra.run.smithi078.stdout:068.out 2023-12-12T10:15:41.544 INFO:teuthology.orchestra.run.smithi078.stdout:069 2023-12-12T10:15:41.544 INFO:teuthology.orchestra.run.smithi078.stdout:069.out 2023-12-12T10:15:41.544 INFO:teuthology.orchestra.run.smithi078.stdout:070 2023-12-12T10:15:41.544 INFO:teuthology.orchestra.run.smithi078.stdout:070.out 2023-12-12T10:15:41.544 INFO:teuthology.orchestra.run.smithi078.stdout:071 2023-12-12T10:15:41.544 INFO:teuthology.orchestra.run.smithi078.stdout:071.out 2023-12-12T10:15:41.545 INFO:teuthology.orchestra.run.smithi078.stdout:072 2023-12-12T10:15:41.545 INFO:teuthology.orchestra.run.smithi078.stdout:072.out 2023-12-12T10:15:41.545 INFO:teuthology.orchestra.run.smithi078.stdout:073 2023-12-12T10:15:41.545 INFO:teuthology.orchestra.run.smithi078.stdout:073.out 2023-12-12T10:15:41.545 INFO:teuthology.orchestra.run.smithi078.stdout:074 2023-12-12T10:15:41.545 INFO:teuthology.orchestra.run.smithi078.stdout:074.out 2023-12-12T10:15:41.545 INFO:teuthology.orchestra.run.smithi078.stdout:075 2023-12-12T10:15:41.545 INFO:teuthology.orchestra.run.smithi078.stdout:075.out 2023-12-12T10:15:41.545 INFO:teuthology.orchestra.run.smithi078.stdout:076 2023-12-12T10:15:41.545 INFO:teuthology.orchestra.run.smithi078.stdout:076.out 2023-12-12T10:15:41.545 INFO:teuthology.orchestra.run.smithi078.stdout:077 2023-12-12T10:15:41.545 INFO:teuthology.orchestra.run.smithi078.stdout:077.out 2023-12-12T10:15:41.545 INFO:teuthology.orchestra.run.smithi078.stdout:078 2023-12-12T10:15:41.545 INFO:teuthology.orchestra.run.smithi078.stdout:078.out 2023-12-12T10:15:41.545 INFO:teuthology.orchestra.run.smithi078.stdout:079 2023-12-12T10:15:41.546 INFO:teuthology.orchestra.run.smithi078.stdout:079.out 2023-12-12T10:15:41.546 INFO:teuthology.orchestra.run.smithi078.stdout:080 2023-12-12T10:15:41.546 INFO:teuthology.orchestra.run.smithi078.stdout:080.out 2023-12-12T10:15:41.546 INFO:teuthology.orchestra.run.smithi078.stdout:081 2023-12-12T10:15:41.546 INFO:teuthology.orchestra.run.smithi078.stdout:081.out 2023-12-12T10:15:41.546 INFO:teuthology.orchestra.run.smithi078.stdout:082 2023-12-12T10:15:41.546 INFO:teuthology.orchestra.run.smithi078.stdout:082.out 2023-12-12T10:15:41.546 INFO:teuthology.orchestra.run.smithi078.stdout:083 2023-12-12T10:15:41.546 INFO:teuthology.orchestra.run.smithi078.stdout:083.out 2023-12-12T10:15:41.546 INFO:teuthology.orchestra.run.smithi078.stdout:084 2023-12-12T10:15:41.547 INFO:teuthology.orchestra.run.smithi078.stdout:084.out 2023-12-12T10:15:41.547 INFO:teuthology.orchestra.run.smithi078.stdout:085 2023-12-12T10:15:41.547 INFO:teuthology.orchestra.run.smithi078.stdout:085.out 2023-12-12T10:15:41.547 INFO:teuthology.orchestra.run.smithi078.stdout:086 2023-12-12T10:15:41.547 INFO:teuthology.orchestra.run.smithi078.stdout:086.out 2023-12-12T10:15:41.547 INFO:teuthology.orchestra.run.smithi078.stdout:087 2023-12-12T10:15:41.547 INFO:teuthology.orchestra.run.smithi078.stdout:087.out 2023-12-12T10:15:41.547 INFO:teuthology.orchestra.run.smithi078.stdout:088 2023-12-12T10:15:41.547 INFO:teuthology.orchestra.run.smithi078.stdout:088.out 2023-12-12T10:15:41.547 INFO:teuthology.orchestra.run.smithi078.stdout:089 2023-12-12T10:15:41.547 INFO:teuthology.orchestra.run.smithi078.stdout:089.out 2023-12-12T10:15:41.547 INFO:teuthology.orchestra.run.smithi078.stdout:090 2023-12-12T10:15:41.547 INFO:teuthology.orchestra.run.smithi078.stdout:090.out 2023-12-12T10:15:41.547 INFO:teuthology.orchestra.run.smithi078.stdout:091 2023-12-12T10:15:41.548 INFO:teuthology.orchestra.run.smithi078.stdout:091.out 2023-12-12T10:15:41.548 INFO:teuthology.orchestra.run.smithi078.stdout:092 2023-12-12T10:15:41.548 INFO:teuthology.orchestra.run.smithi078.stdout:092.out 2023-12-12T10:15:41.548 INFO:teuthology.orchestra.run.smithi078.stdout:093 2023-12-12T10:15:41.548 INFO:teuthology.orchestra.run.smithi078.stdout:093.out 2023-12-12T10:15:41.548 INFO:teuthology.orchestra.run.smithi078.stdout:094 2023-12-12T10:15:41.548 INFO:teuthology.orchestra.run.smithi078.stdout:094.out 2023-12-12T10:15:41.548 INFO:teuthology.orchestra.run.smithi078.stdout:095 2023-12-12T10:15:41.548 INFO:teuthology.orchestra.run.smithi078.stdout:095.out 2023-12-12T10:15:41.548 INFO:teuthology.orchestra.run.smithi078.stdout:096 2023-12-12T10:15:41.548 INFO:teuthology.orchestra.run.smithi078.stdout:096.out 2023-12-12T10:15:41.548 INFO:teuthology.orchestra.run.smithi078.stdout:097 2023-12-12T10:15:41.548 INFO:teuthology.orchestra.run.smithi078.stdout:097.out 2023-12-12T10:15:41.548 INFO:teuthology.orchestra.run.smithi078.stdout:098 2023-12-12T10:15:41.548 INFO:teuthology.orchestra.run.smithi078.stdout:098.out 2023-12-12T10:15:41.549 INFO:teuthology.orchestra.run.smithi078.stdout:099 2023-12-12T10:15:41.549 INFO:teuthology.orchestra.run.smithi078.stdout:099.out 2023-12-12T10:15:41.549 INFO:teuthology.orchestra.run.smithi078.stdout:100 2023-12-12T10:15:41.549 INFO:teuthology.orchestra.run.smithi078.stdout:100.out 2023-12-12T10:15:41.549 INFO:teuthology.orchestra.run.smithi078.stdout:101 2023-12-12T10:15:41.549 INFO:teuthology.orchestra.run.smithi078.stdout:101.out 2023-12-12T10:15:41.549 INFO:teuthology.orchestra.run.smithi078.stdout:102 2023-12-12T10:15:41.549 INFO:teuthology.orchestra.run.smithi078.stdout:102.out 2023-12-12T10:15:41.549 INFO:teuthology.orchestra.run.smithi078.stdout:103 2023-12-12T10:15:41.549 INFO:teuthology.orchestra.run.smithi078.stdout:103.out 2023-12-12T10:15:41.549 INFO:teuthology.orchestra.run.smithi078.stdout:104 2023-12-12T10:15:41.549 INFO:teuthology.orchestra.run.smithi078.stdout:104.out 2023-12-12T10:15:41.549 INFO:teuthology.orchestra.run.smithi078.stdout:105 2023-12-12T10:15:41.549 INFO:teuthology.orchestra.run.smithi078.stdout:105.out 2023-12-12T10:15:41.549 INFO:teuthology.orchestra.run.smithi078.stdout:106 2023-12-12T10:15:41.550 INFO:teuthology.orchestra.run.smithi078.stdout:106.out 2023-12-12T10:15:41.550 INFO:teuthology.orchestra.run.smithi078.stdout:107 2023-12-12T10:15:41.550 INFO:teuthology.orchestra.run.smithi078.stdout:107.out 2023-12-12T10:15:41.550 INFO:teuthology.orchestra.run.smithi078.stdout:108 2023-12-12T10:15:41.550 INFO:teuthology.orchestra.run.smithi078.stdout:108.out 2023-12-12T10:15:41.550 INFO:teuthology.orchestra.run.smithi078.stdout:109 2023-12-12T10:15:41.550 INFO:teuthology.orchestra.run.smithi078.stdout:109.out 2023-12-12T10:15:41.550 INFO:teuthology.orchestra.run.smithi078.stdout:110 2023-12-12T10:15:41.550 INFO:teuthology.orchestra.run.smithi078.stdout:110.out 2023-12-12T10:15:41.550 INFO:teuthology.orchestra.run.smithi078.stdout:111 2023-12-12T10:15:41.550 INFO:teuthology.orchestra.run.smithi078.stdout:111.out 2023-12-12T10:15:41.550 INFO:teuthology.orchestra.run.smithi078.stdout:112 2023-12-12T10:15:41.550 INFO:teuthology.orchestra.run.smithi078.stdout:112.out 2023-12-12T10:15:41.550 INFO:teuthology.orchestra.run.smithi078.stdout:113 2023-12-12T10:15:41.550 INFO:teuthology.orchestra.run.smithi078.stdout:113.out 2023-12-12T10:15:41.551 INFO:teuthology.orchestra.run.smithi078.stdout:114 2023-12-12T10:15:41.551 INFO:teuthology.orchestra.run.smithi078.stdout:114.out 2023-12-12T10:15:41.551 INFO:teuthology.orchestra.run.smithi078.stdout:115 2023-12-12T10:15:41.551 INFO:teuthology.orchestra.run.smithi078.stdout:115.out 2023-12-12T10:15:41.551 INFO:teuthology.orchestra.run.smithi078.stdout:116 2023-12-12T10:15:41.551 INFO:teuthology.orchestra.run.smithi078.stdout:116.out 2023-12-12T10:15:41.551 INFO:teuthology.orchestra.run.smithi078.stdout:117 2023-12-12T10:15:41.551 INFO:teuthology.orchestra.run.smithi078.stdout:117.out 2023-12-12T10:15:41.551 INFO:teuthology.orchestra.run.smithi078.stdout:118 2023-12-12T10:15:41.551 INFO:teuthology.orchestra.run.smithi078.stdout:118.out 2023-12-12T10:15:41.551 INFO:teuthology.orchestra.run.smithi078.stdout:119 2023-12-12T10:15:41.551 INFO:teuthology.orchestra.run.smithi078.stdout:119.out 2023-12-12T10:15:41.551 INFO:teuthology.orchestra.run.smithi078.stdout:120 2023-12-12T10:15:41.551 INFO:teuthology.orchestra.run.smithi078.stdout:120.out 2023-12-12T10:15:41.551 INFO:teuthology.orchestra.run.smithi078.stdout:121 2023-12-12T10:15:41.552 INFO:teuthology.orchestra.run.smithi078.stdout:121.out 2023-12-12T10:15:41.552 INFO:teuthology.orchestra.run.smithi078.stdout:122 2023-12-12T10:15:41.552 INFO:teuthology.orchestra.run.smithi078.stdout:122.out 2023-12-12T10:15:41.552 INFO:teuthology.orchestra.run.smithi078.stdout:123 2023-12-12T10:15:41.552 INFO:teuthology.orchestra.run.smithi078.stdout:123.out 2023-12-12T10:15:41.552 INFO:teuthology.orchestra.run.smithi078.stdout:124 2023-12-12T10:15:41.552 INFO:teuthology.orchestra.run.smithi078.stdout:124.out 2023-12-12T10:15:41.552 INFO:teuthology.orchestra.run.smithi078.stdout:125 2023-12-12T10:15:41.552 INFO:teuthology.orchestra.run.smithi078.stdout:125.out 2023-12-12T10:15:41.552 INFO:teuthology.orchestra.run.smithi078.stdout:126 2023-12-12T10:15:41.552 INFO:teuthology.orchestra.run.smithi078.stdout:126.out 2023-12-12T10:15:41.552 INFO:teuthology.orchestra.run.smithi078.stdout:127 2023-12-12T10:15:41.552 INFO:teuthology.orchestra.run.smithi078.stdout:127.out 2023-12-12T10:15:41.552 INFO:teuthology.orchestra.run.smithi078.stdout:128 2023-12-12T10:15:41.552 INFO:teuthology.orchestra.run.smithi078.stdout:128.out 2023-12-12T10:15:41.553 INFO:teuthology.orchestra.run.smithi078.stdout:129 2023-12-12T10:15:41.553 INFO:teuthology.orchestra.run.smithi078.stdout:129.out 2023-12-12T10:15:41.553 INFO:teuthology.orchestra.run.smithi078.stdout:130 2023-12-12T10:15:41.553 INFO:teuthology.orchestra.run.smithi078.stdout:130.out 2023-12-12T10:15:41.553 INFO:teuthology.orchestra.run.smithi078.stdout:131 2023-12-12T10:15:41.553 INFO:teuthology.orchestra.run.smithi078.stdout:131.out 2023-12-12T10:15:41.553 INFO:teuthology.orchestra.run.smithi078.stdout:132 2023-12-12T10:15:41.553 INFO:teuthology.orchestra.run.smithi078.stdout:132.out 2023-12-12T10:15:41.553 INFO:teuthology.orchestra.run.smithi078.stdout:133 2023-12-12T10:15:41.553 INFO:teuthology.orchestra.run.smithi078.stdout:133.out 2023-12-12T10:15:41.553 INFO:teuthology.orchestra.run.smithi078.stdout:134 2023-12-12T10:15:41.553 INFO:teuthology.orchestra.run.smithi078.stdout:134.out 2023-12-12T10:15:41.553 INFO:teuthology.orchestra.run.smithi078.stdout:135 2023-12-12T10:15:41.553 INFO:teuthology.orchestra.run.smithi078.stdout:135.out 2023-12-12T10:15:41.553 INFO:teuthology.orchestra.run.smithi078.stdout:136 2023-12-12T10:15:41.554 INFO:teuthology.orchestra.run.smithi078.stdout:136.out 2023-12-12T10:15:41.554 INFO:teuthology.orchestra.run.smithi078.stdout:137 2023-12-12T10:15:41.554 INFO:teuthology.orchestra.run.smithi078.stdout:137.out 2023-12-12T10:15:41.554 INFO:teuthology.orchestra.run.smithi078.stdout:138 2023-12-12T10:15:41.554 INFO:teuthology.orchestra.run.smithi078.stdout:138.out 2023-12-12T10:15:41.554 INFO:teuthology.orchestra.run.smithi078.stdout:139 2023-12-12T10:15:41.554 INFO:teuthology.orchestra.run.smithi078.stdout:139.out 2023-12-12T10:15:41.554 INFO:teuthology.orchestra.run.smithi078.stdout:140 2023-12-12T10:15:41.554 INFO:teuthology.orchestra.run.smithi078.stdout:140.out 2023-12-12T10:15:41.554 INFO:teuthology.orchestra.run.smithi078.stdout:141 2023-12-12T10:15:41.554 INFO:teuthology.orchestra.run.smithi078.stdout:141.out 2023-12-12T10:15:41.554 INFO:teuthology.orchestra.run.smithi078.stdout:142 2023-12-12T10:15:41.554 INFO:teuthology.orchestra.run.smithi078.stdout:142.out 2023-12-12T10:15:41.554 INFO:teuthology.orchestra.run.smithi078.stdout:143 2023-12-12T10:15:41.555 INFO:teuthology.orchestra.run.smithi078.stdout:143.out 2023-12-12T10:15:41.555 INFO:teuthology.orchestra.run.smithi078.stdout:144 2023-12-12T10:15:41.555 INFO:teuthology.orchestra.run.smithi078.stdout:144.out 2023-12-12T10:15:41.555 INFO:teuthology.orchestra.run.smithi078.stdout:145 2023-12-12T10:15:41.555 INFO:teuthology.orchestra.run.smithi078.stdout:145.out 2023-12-12T10:15:41.555 INFO:teuthology.orchestra.run.smithi078.stdout:146 2023-12-12T10:15:41.555 INFO:teuthology.orchestra.run.smithi078.stdout:146.out 2023-12-12T10:15:41.555 INFO:teuthology.orchestra.run.smithi078.stdout:147 2023-12-12T10:15:41.555 INFO:teuthology.orchestra.run.smithi078.stdout:147.out 2023-12-12T10:15:41.555 INFO:teuthology.orchestra.run.smithi078.stdout:148 2023-12-12T10:15:41.555 INFO:teuthology.orchestra.run.smithi078.stdout:148.out 2023-12-12T10:15:41.555 INFO:teuthology.orchestra.run.smithi078.stdout:149 2023-12-12T10:15:41.555 INFO:teuthology.orchestra.run.smithi078.stdout:149.out 2023-12-12T10:15:41.555 INFO:teuthology.orchestra.run.smithi078.stdout:150 2023-12-12T10:15:41.555 INFO:teuthology.orchestra.run.smithi078.stdout:150.out 2023-12-12T10:15:41.556 INFO:teuthology.orchestra.run.smithi078.stdout:151 2023-12-12T10:15:41.556 INFO:teuthology.orchestra.run.smithi078.stdout:151.out 2023-12-12T10:15:41.556 INFO:teuthology.orchestra.run.smithi078.stdout:152 2023-12-12T10:15:41.556 INFO:teuthology.orchestra.run.smithi078.stdout:152.out 2023-12-12T10:15:41.556 INFO:teuthology.orchestra.run.smithi078.stdout:153 2023-12-12T10:15:41.556 INFO:teuthology.orchestra.run.smithi078.stdout:153.out 2023-12-12T10:15:41.556 INFO:teuthology.orchestra.run.smithi078.stdout:154 2023-12-12T10:15:41.556 INFO:teuthology.orchestra.run.smithi078.stdout:154.out 2023-12-12T10:15:41.556 INFO:teuthology.orchestra.run.smithi078.stdout:155 2023-12-12T10:15:41.556 INFO:teuthology.orchestra.run.smithi078.stdout:155.out 2023-12-12T10:15:41.556 INFO:teuthology.orchestra.run.smithi078.stdout:156 2023-12-12T10:15:41.556 INFO:teuthology.orchestra.run.smithi078.stdout:156.out 2023-12-12T10:15:41.556 INFO:teuthology.orchestra.run.smithi078.stdout:157 2023-12-12T10:15:41.556 INFO:teuthology.orchestra.run.smithi078.stdout:157.out 2023-12-12T10:15:41.556 INFO:teuthology.orchestra.run.smithi078.stdout:158 2023-12-12T10:15:41.557 INFO:teuthology.orchestra.run.smithi078.stdout:158.out 2023-12-12T10:15:41.557 INFO:teuthology.orchestra.run.smithi078.stdout:159 2023-12-12T10:15:41.557 INFO:teuthology.orchestra.run.smithi078.stdout:159.out 2023-12-12T10:15:41.557 INFO:teuthology.orchestra.run.smithi078.stdout:160 2023-12-12T10:15:41.557 INFO:teuthology.orchestra.run.smithi078.stdout:160.out 2023-12-12T10:15:41.557 INFO:teuthology.orchestra.run.smithi078.stdout:161 2023-12-12T10:15:41.557 INFO:teuthology.orchestra.run.smithi078.stdout:161.out 2023-12-12T10:15:41.557 INFO:teuthology.orchestra.run.smithi078.stdout:162 2023-12-12T10:15:41.557 INFO:teuthology.orchestra.run.smithi078.stdout:162.out 2023-12-12T10:15:41.557 INFO:teuthology.orchestra.run.smithi078.stdout:163 2023-12-12T10:15:41.557 INFO:teuthology.orchestra.run.smithi078.stdout:163.out 2023-12-12T10:15:41.557 INFO:teuthology.orchestra.run.smithi078.stdout:164 2023-12-12T10:15:41.557 INFO:teuthology.orchestra.run.smithi078.stdout:164.out 2023-12-12T10:15:41.557 INFO:teuthology.orchestra.run.smithi078.stdout:165 2023-12-12T10:15:41.557 INFO:teuthology.orchestra.run.smithi078.stdout:165.out 2023-12-12T10:15:41.558 INFO:teuthology.orchestra.run.smithi078.stdout:166 2023-12-12T10:15:41.558 INFO:teuthology.orchestra.run.smithi078.stdout:166.out 2023-12-12T10:15:41.558 INFO:teuthology.orchestra.run.smithi078.stdout:167 2023-12-12T10:15:41.558 INFO:teuthology.orchestra.run.smithi078.stdout:167.out 2023-12-12T10:15:41.558 INFO:teuthology.orchestra.run.smithi078.stdout:168 2023-12-12T10:15:41.558 INFO:teuthology.orchestra.run.smithi078.stdout:168.out 2023-12-12T10:15:41.558 INFO:teuthology.orchestra.run.smithi078.stdout:169 2023-12-12T10:15:41.558 INFO:teuthology.orchestra.run.smithi078.stdout:169.out 2023-12-12T10:15:41.558 INFO:teuthology.orchestra.run.smithi078.stdout:170 2023-12-12T10:15:41.558 INFO:teuthology.orchestra.run.smithi078.stdout:170.out 2023-12-12T10:15:41.558 INFO:teuthology.orchestra.run.smithi078.stdout:171 2023-12-12T10:15:41.558 INFO:teuthology.orchestra.run.smithi078.stdout:171.out 2023-12-12T10:15:41.558 INFO:teuthology.orchestra.run.smithi078.stdout:172 2023-12-12T10:15:41.558 INFO:teuthology.orchestra.run.smithi078.stdout:172.out 2023-12-12T10:15:41.559 INFO:teuthology.orchestra.run.smithi078.stdout:173 2023-12-12T10:15:41.559 INFO:teuthology.orchestra.run.smithi078.stdout:173.out 2023-12-12T10:15:41.559 INFO:teuthology.orchestra.run.smithi078.stdout:174 2023-12-12T10:15:41.559 INFO:teuthology.orchestra.run.smithi078.stdout:174.out 2023-12-12T10:15:41.559 INFO:teuthology.orchestra.run.smithi078.stdout:175 2023-12-12T10:15:41.559 INFO:teuthology.orchestra.run.smithi078.stdout:175.out 2023-12-12T10:15:41.559 INFO:teuthology.orchestra.run.smithi078.stdout:176 2023-12-12T10:15:41.559 INFO:teuthology.orchestra.run.smithi078.stdout:176.out 2023-12-12T10:15:41.559 INFO:teuthology.orchestra.run.smithi078.stdout:177 2023-12-12T10:15:41.559 INFO:teuthology.orchestra.run.smithi078.stdout:177.out 2023-12-12T10:15:41.559 INFO:teuthology.orchestra.run.smithi078.stdout:178 2023-12-12T10:15:41.559 INFO:teuthology.orchestra.run.smithi078.stdout:178.out 2023-12-12T10:15:41.559 INFO:teuthology.orchestra.run.smithi078.stdout:179 2023-12-12T10:15:41.559 INFO:teuthology.orchestra.run.smithi078.stdout:179.out 2023-12-12T10:15:41.559 INFO:teuthology.orchestra.run.smithi078.stdout:180 2023-12-12T10:15:41.560 INFO:teuthology.orchestra.run.smithi078.stdout:180.out 2023-12-12T10:15:41.560 INFO:teuthology.orchestra.run.smithi078.stdout:181 2023-12-12T10:15:41.560 INFO:teuthology.orchestra.run.smithi078.stdout:181.out 2023-12-12T10:15:41.560 INFO:teuthology.orchestra.run.smithi078.stdout:182 2023-12-12T10:15:41.560 INFO:teuthology.orchestra.run.smithi078.stdout:182.out 2023-12-12T10:15:41.560 INFO:teuthology.orchestra.run.smithi078.stdout:183 2023-12-12T10:15:41.560 INFO:teuthology.orchestra.run.smithi078.stdout:183.out 2023-12-12T10:15:41.560 INFO:teuthology.orchestra.run.smithi078.stdout:184 2023-12-12T10:15:41.560 INFO:teuthology.orchestra.run.smithi078.stdout:184.out 2023-12-12T10:15:41.560 INFO:teuthology.orchestra.run.smithi078.stdout:185 2023-12-12T10:15:41.560 INFO:teuthology.orchestra.run.smithi078.stdout:185.out 2023-12-12T10:15:41.560 INFO:teuthology.orchestra.run.smithi078.stdout:186 2023-12-12T10:15:41.560 INFO:teuthology.orchestra.run.smithi078.stdout:186.out 2023-12-12T10:15:41.560 INFO:teuthology.orchestra.run.smithi078.stdout:187 2023-12-12T10:15:41.560 INFO:teuthology.orchestra.run.smithi078.stdout:187.out 2023-12-12T10:15:41.560 INFO:teuthology.orchestra.run.smithi078.stdout:188 2023-12-12T10:15:41.561 INFO:teuthology.orchestra.run.smithi078.stdout:188.out 2023-12-12T10:15:41.561 INFO:teuthology.orchestra.run.smithi078.stdout:189 2023-12-12T10:15:41.561 INFO:teuthology.orchestra.run.smithi078.stdout:189.out 2023-12-12T10:15:41.561 INFO:teuthology.orchestra.run.smithi078.stdout:190 2023-12-12T10:15:41.561 INFO:teuthology.orchestra.run.smithi078.stdout:190.out 2023-12-12T10:15:41.561 INFO:teuthology.orchestra.run.smithi078.stdout:191 2023-12-12T10:15:41.561 INFO:teuthology.orchestra.run.smithi078.stdout:191.out 2023-12-12T10:15:41.561 INFO:teuthology.orchestra.run.smithi078.stdout:192 2023-12-12T10:15:41.561 INFO:teuthology.orchestra.run.smithi078.stdout:192.out 2023-12-12T10:15:41.561 INFO:teuthology.orchestra.run.smithi078.stdout:193 2023-12-12T10:15:41.561 INFO:teuthology.orchestra.run.smithi078.stdout:193.out 2023-12-12T10:15:41.561 INFO:teuthology.orchestra.run.smithi078.stdout:194 2023-12-12T10:15:41.561 INFO:teuthology.orchestra.run.smithi078.stdout:194.out 2023-12-12T10:15:41.561 INFO:teuthology.orchestra.run.smithi078.stdout:195 2023-12-12T10:15:41.561 INFO:teuthology.orchestra.run.smithi078.stdout:195.out 2023-12-12T10:15:41.562 INFO:teuthology.orchestra.run.smithi078.stdout:196 2023-12-12T10:15:41.562 INFO:teuthology.orchestra.run.smithi078.stdout:196.out 2023-12-12T10:15:41.562 INFO:teuthology.orchestra.run.smithi078.stdout:197 2023-12-12T10:15:41.562 INFO:teuthology.orchestra.run.smithi078.stdout:197.out 2023-12-12T10:15:41.562 INFO:teuthology.orchestra.run.smithi078.stdout:198 2023-12-12T10:15:41.562 INFO:teuthology.orchestra.run.smithi078.stdout:198.out 2023-12-12T10:15:41.562 INFO:teuthology.orchestra.run.smithi078.stdout:199 2023-12-12T10:15:41.562 INFO:teuthology.orchestra.run.smithi078.stdout:199.out 2023-12-12T10:15:41.562 INFO:teuthology.orchestra.run.smithi078.stdout:200 2023-12-12T10:15:41.562 INFO:teuthology.orchestra.run.smithi078.stdout:200.out 2023-12-12T10:15:41.562 INFO:teuthology.orchestra.run.smithi078.stdout:201 2023-12-12T10:15:41.562 INFO:teuthology.orchestra.run.smithi078.stdout:201.out 2023-12-12T10:15:41.562 INFO:teuthology.orchestra.run.smithi078.stdout:202 2023-12-12T10:15:41.562 INFO:teuthology.orchestra.run.smithi078.stdout:202.out 2023-12-12T10:15:41.563 INFO:teuthology.orchestra.run.smithi078.stdout:203 2023-12-12T10:15:41.563 INFO:teuthology.orchestra.run.smithi078.stdout:203.out 2023-12-12T10:15:41.563 INFO:teuthology.orchestra.run.smithi078.stdout:204 2023-12-12T10:15:41.563 INFO:teuthology.orchestra.run.smithi078.stdout:204.out 2023-12-12T10:15:41.563 INFO:teuthology.orchestra.run.smithi078.stdout:205 2023-12-12T10:15:41.563 INFO:teuthology.orchestra.run.smithi078.stdout:205.out 2023-12-12T10:15:41.563 INFO:teuthology.orchestra.run.smithi078.stdout:206 2023-12-12T10:15:41.563 INFO:teuthology.orchestra.run.smithi078.stdout:206.out 2023-12-12T10:15:41.563 INFO:teuthology.orchestra.run.smithi078.stdout:207 2023-12-12T10:15:41.563 INFO:teuthology.orchestra.run.smithi078.stdout:207.out 2023-12-12T10:15:41.563 INFO:teuthology.orchestra.run.smithi078.stdout:208 2023-12-12T10:15:41.563 INFO:teuthology.orchestra.run.smithi078.stdout:208.out 2023-12-12T10:15:41.563 INFO:teuthology.orchestra.run.smithi078.stdout:209 2023-12-12T10:15:41.563 INFO:teuthology.orchestra.run.smithi078.stdout:209.out 2023-12-12T10:15:41.563 INFO:teuthology.orchestra.run.smithi078.stdout:210 2023-12-12T10:15:41.564 INFO:teuthology.orchestra.run.smithi078.stdout:210.out 2023-12-12T10:15:41.564 INFO:teuthology.orchestra.run.smithi078.stdout:211 2023-12-12T10:15:41.564 INFO:teuthology.orchestra.run.smithi078.stdout:211.out 2023-12-12T10:15:41.564 INFO:teuthology.orchestra.run.smithi078.stdout:212 2023-12-12T10:15:41.564 INFO:teuthology.orchestra.run.smithi078.stdout:212.out 2023-12-12T10:15:41.564 INFO:teuthology.orchestra.run.smithi078.stdout:213 2023-12-12T10:15:41.564 INFO:teuthology.orchestra.run.smithi078.stdout:213.out 2023-12-12T10:15:41.564 INFO:teuthology.orchestra.run.smithi078.stdout:214 2023-12-12T10:15:41.564 INFO:teuthology.orchestra.run.smithi078.stdout:214.out 2023-12-12T10:15:41.564 INFO:teuthology.orchestra.run.smithi078.stdout:215 2023-12-12T10:15:41.564 INFO:teuthology.orchestra.run.smithi078.stdout:215.out 2023-12-12T10:15:41.564 INFO:teuthology.orchestra.run.smithi078.stdout:216 2023-12-12T10:15:41.564 INFO:teuthology.orchestra.run.smithi078.stdout:216.out 2023-12-12T10:15:41.564 INFO:teuthology.orchestra.run.smithi078.stdout:217 2023-12-12T10:15:41.564 INFO:teuthology.orchestra.run.smithi078.stdout:217.out 2023-12-12T10:15:41.565 INFO:teuthology.orchestra.run.smithi078.stdout:218 2023-12-12T10:15:41.565 INFO:teuthology.orchestra.run.smithi078.stdout:218.out 2023-12-12T10:15:41.565 INFO:teuthology.orchestra.run.smithi078.stdout:219 2023-12-12T10:15:41.565 INFO:teuthology.orchestra.run.smithi078.stdout:219.out 2023-12-12T10:15:41.565 INFO:teuthology.orchestra.run.smithi078.stdout:220 2023-12-12T10:15:41.565 INFO:teuthology.orchestra.run.smithi078.stdout:220.out 2023-12-12T10:15:41.565 INFO:teuthology.orchestra.run.smithi078.stdout:221 2023-12-12T10:15:41.565 INFO:teuthology.orchestra.run.smithi078.stdout:221.out 2023-12-12T10:15:41.565 INFO:teuthology.orchestra.run.smithi078.stdout:222 2023-12-12T10:15:41.565 INFO:teuthology.orchestra.run.smithi078.stdout:222.out 2023-12-12T10:15:41.565 INFO:teuthology.orchestra.run.smithi078.stdout:223 2023-12-12T10:15:41.565 INFO:teuthology.orchestra.run.smithi078.stdout:223.out 2023-12-12T10:15:41.565 INFO:teuthology.orchestra.run.smithi078.stdout:224 2023-12-12T10:15:41.565 INFO:teuthology.orchestra.run.smithi078.stdout:224.out 2023-12-12T10:15:41.565 INFO:teuthology.orchestra.run.smithi078.stdout:225 2023-12-12T10:15:41.566 INFO:teuthology.orchestra.run.smithi078.stdout:225.out 2023-12-12T10:15:41.566 INFO:teuthology.orchestra.run.smithi078.stdout:226 2023-12-12T10:15:41.566 INFO:teuthology.orchestra.run.smithi078.stdout:226.out 2023-12-12T10:15:41.566 INFO:teuthology.orchestra.run.smithi078.stdout:227 2023-12-12T10:15:41.566 INFO:teuthology.orchestra.run.smithi078.stdout:227.out 2023-12-12T10:15:41.566 INFO:teuthology.orchestra.run.smithi078.stdout:228 2023-12-12T10:15:41.566 INFO:teuthology.orchestra.run.smithi078.stdout:228.out 2023-12-12T10:15:41.566 INFO:teuthology.orchestra.run.smithi078.stdout:229 2023-12-12T10:15:41.566 INFO:teuthology.orchestra.run.smithi078.stdout:229.out 2023-12-12T10:15:41.566 INFO:teuthology.orchestra.run.smithi078.stdout:230 2023-12-12T10:15:41.566 INFO:teuthology.orchestra.run.smithi078.stdout:230.out 2023-12-12T10:15:41.566 INFO:teuthology.orchestra.run.smithi078.stdout:231 2023-12-12T10:15:41.566 INFO:teuthology.orchestra.run.smithi078.stdout:231.out 2023-12-12T10:15:41.566 INFO:teuthology.orchestra.run.smithi078.stdout:232 2023-12-12T10:15:41.566 INFO:teuthology.orchestra.run.smithi078.stdout:232.out 2023-12-12T10:15:41.567 INFO:teuthology.orchestra.run.smithi078.stdout:233 2023-12-12T10:15:41.567 INFO:teuthology.orchestra.run.smithi078.stdout:233.out 2023-12-12T10:15:41.567 INFO:teuthology.orchestra.run.smithi078.stdout:234 2023-12-12T10:15:41.567 INFO:teuthology.orchestra.run.smithi078.stdout:234.out 2023-12-12T10:15:41.567 INFO:teuthology.orchestra.run.smithi078.stdout:235 2023-12-12T10:15:41.567 INFO:teuthology.orchestra.run.smithi078.stdout:235.out 2023-12-12T10:15:41.567 INFO:teuthology.orchestra.run.smithi078.stdout:236 2023-12-12T10:15:41.567 INFO:teuthology.orchestra.run.smithi078.stdout:236.out 2023-12-12T10:15:41.567 INFO:teuthology.orchestra.run.smithi078.stdout:237 2023-12-12T10:15:41.567 INFO:teuthology.orchestra.run.smithi078.stdout:237.out 2023-12-12T10:15:41.567 INFO:teuthology.orchestra.run.smithi078.stdout:238 2023-12-12T10:15:41.567 INFO:teuthology.orchestra.run.smithi078.stdout:238.out 2023-12-12T10:15:41.567 INFO:teuthology.orchestra.run.smithi078.stdout:239 2023-12-12T10:15:41.567 INFO:teuthology.orchestra.run.smithi078.stdout:239.out 2023-12-12T10:15:41.567 INFO:teuthology.orchestra.run.smithi078.stdout:240 2023-12-12T10:15:41.568 INFO:teuthology.orchestra.run.smithi078.stdout:240.out 2023-12-12T10:15:41.568 INFO:teuthology.orchestra.run.smithi078.stdout:241 2023-12-12T10:15:41.568 INFO:teuthology.orchestra.run.smithi078.stdout:241.out 2023-12-12T10:15:41.568 INFO:teuthology.orchestra.run.smithi078.stdout:242 2023-12-12T10:15:41.568 INFO:teuthology.orchestra.run.smithi078.stdout:242.out 2023-12-12T10:15:41.568 INFO:teuthology.orchestra.run.smithi078.stdout:243 2023-12-12T10:15:41.568 INFO:teuthology.orchestra.run.smithi078.stdout:243.out 2023-12-12T10:15:41.568 INFO:teuthology.orchestra.run.smithi078.stdout:244 2023-12-12T10:15:41.568 INFO:teuthology.orchestra.run.smithi078.stdout:244.out 2023-12-12T10:15:41.568 INFO:teuthology.orchestra.run.smithi078.stdout:245 2023-12-12T10:15:41.568 INFO:teuthology.orchestra.run.smithi078.stdout:245.out 2023-12-12T10:15:41.568 INFO:teuthology.orchestra.run.smithi078.stdout:246 2023-12-12T10:15:41.568 INFO:teuthology.orchestra.run.smithi078.stdout:246.out 2023-12-12T10:15:41.568 INFO:teuthology.orchestra.run.smithi078.stdout:247 2023-12-12T10:15:41.568 INFO:teuthology.orchestra.run.smithi078.stdout:247.out 2023-12-12T10:15:41.568 INFO:teuthology.orchestra.run.smithi078.stdout:248 2023-12-12T10:15:41.569 INFO:teuthology.orchestra.run.smithi078.stdout:248.out 2023-12-12T10:15:41.569 INFO:teuthology.orchestra.run.smithi078.stdout:249 2023-12-12T10:15:41.569 INFO:teuthology.orchestra.run.smithi078.stdout:249.out 2023-12-12T10:15:41.569 INFO:teuthology.orchestra.run.smithi078.stdout:250 2023-12-12T10:15:41.569 INFO:teuthology.orchestra.run.smithi078.stdout:250.out 2023-12-12T10:15:41.569 INFO:teuthology.orchestra.run.smithi078.stdout:251 2023-12-12T10:15:41.569 INFO:teuthology.orchestra.run.smithi078.stdout:251.out 2023-12-12T10:15:41.569 INFO:teuthology.orchestra.run.smithi078.stdout:252 2023-12-12T10:15:41.569 INFO:teuthology.orchestra.run.smithi078.stdout:252.out 2023-12-12T10:15:41.569 INFO:teuthology.orchestra.run.smithi078.stdout:253 2023-12-12T10:15:41.569 INFO:teuthology.orchestra.run.smithi078.stdout:253.out 2023-12-12T10:15:41.569 INFO:teuthology.orchestra.run.smithi078.stdout:254 2023-12-12T10:15:41.569 INFO:teuthology.orchestra.run.smithi078.stdout:254.out 2023-12-12T10:15:41.569 INFO:teuthology.orchestra.run.smithi078.stdout:255 2023-12-12T10:15:41.570 INFO:teuthology.orchestra.run.smithi078.stdout:255.out 2023-12-12T10:15:41.570 INFO:teuthology.orchestra.run.smithi078.stdout:256 2023-12-12T10:15:41.570 INFO:teuthology.orchestra.run.smithi078.stdout:256.out 2023-12-12T10:15:41.570 INFO:teuthology.orchestra.run.smithi078.stdout:257 2023-12-12T10:15:41.570 INFO:teuthology.orchestra.run.smithi078.stdout:257.out 2023-12-12T10:15:41.570 INFO:teuthology.orchestra.run.smithi078.stdout:258 2023-12-12T10:15:41.570 INFO:teuthology.orchestra.run.smithi078.stdout:258.out 2023-12-12T10:15:41.570 INFO:teuthology.orchestra.run.smithi078.stdout:259 2023-12-12T10:15:41.570 INFO:teuthology.orchestra.run.smithi078.stdout:259.out 2023-12-12T10:15:41.570 INFO:teuthology.orchestra.run.smithi078.stdout:260 2023-12-12T10:15:41.570 INFO:teuthology.orchestra.run.smithi078.stdout:260.out 2023-12-12T10:15:41.570 INFO:teuthology.orchestra.run.smithi078.stdout:261 2023-12-12T10:15:41.570 INFO:teuthology.orchestra.run.smithi078.stdout:261.out 2023-12-12T10:15:41.570 INFO:teuthology.orchestra.run.smithi078.stdout:262 2023-12-12T10:15:41.570 INFO:teuthology.orchestra.run.smithi078.stdout:262.out 2023-12-12T10:15:41.571 INFO:teuthology.orchestra.run.smithi078.stdout:263 2023-12-12T10:15:41.571 INFO:teuthology.orchestra.run.smithi078.stdout:263.out 2023-12-12T10:15:41.571 INFO:teuthology.orchestra.run.smithi078.stdout:264 2023-12-12T10:15:41.571 INFO:teuthology.orchestra.run.smithi078.stdout:264.out 2023-12-12T10:15:41.571 INFO:teuthology.orchestra.run.smithi078.stdout:265 2023-12-12T10:15:41.571 INFO:teuthology.orchestra.run.smithi078.stdout:265.out 2023-12-12T10:15:41.571 INFO:teuthology.orchestra.run.smithi078.stdout:266 2023-12-12T10:15:41.571 INFO:teuthology.orchestra.run.smithi078.stdout:266.out 2023-12-12T10:15:41.571 INFO:teuthology.orchestra.run.smithi078.stdout:267 2023-12-12T10:15:41.571 INFO:teuthology.orchestra.run.smithi078.stdout:267.out 2023-12-12T10:15:41.571 INFO:teuthology.orchestra.run.smithi078.stdout:268 2023-12-12T10:15:41.571 INFO:teuthology.orchestra.run.smithi078.stdout:268.out 2023-12-12T10:15:41.571 INFO:teuthology.orchestra.run.smithi078.stdout:269 2023-12-12T10:15:41.571 INFO:teuthology.orchestra.run.smithi078.stdout:269.out 2023-12-12T10:15:41.571 INFO:teuthology.orchestra.run.smithi078.stdout:270 2023-12-12T10:15:41.572 INFO:teuthology.orchestra.run.smithi078.stdout:270.out 2023-12-12T10:15:41.572 INFO:teuthology.orchestra.run.smithi078.stdout:271 2023-12-12T10:15:41.572 INFO:teuthology.orchestra.run.smithi078.stdout:271.out 2023-12-12T10:15:41.572 INFO:teuthology.orchestra.run.smithi078.stdout:272 2023-12-12T10:15:41.572 INFO:teuthology.orchestra.run.smithi078.stdout:272.out 2023-12-12T10:15:41.572 INFO:teuthology.orchestra.run.smithi078.stdout:273 2023-12-12T10:15:41.572 INFO:teuthology.orchestra.run.smithi078.stdout:273.out 2023-12-12T10:15:41.572 INFO:teuthology.orchestra.run.smithi078.stdout:274 2023-12-12T10:15:41.572 INFO:teuthology.orchestra.run.smithi078.stdout:274.out 2023-12-12T10:15:41.572 INFO:teuthology.orchestra.run.smithi078.stdout:275 2023-12-12T10:15:41.572 INFO:teuthology.orchestra.run.smithi078.stdout:275.out 2023-12-12T10:15:41.572 INFO:teuthology.orchestra.run.smithi078.stdout:276 2023-12-12T10:15:41.572 INFO:teuthology.orchestra.run.smithi078.stdout:276.out 2023-12-12T10:15:41.572 INFO:teuthology.orchestra.run.smithi078.stdout:277 2023-12-12T10:15:41.572 INFO:teuthology.orchestra.run.smithi078.stdout:277.out 2023-12-12T10:15:41.573 INFO:teuthology.orchestra.run.smithi078.stdout:278 2023-12-12T10:15:41.573 INFO:teuthology.orchestra.run.smithi078.stdout:278.out 2023-12-12T10:15:41.573 INFO:teuthology.orchestra.run.smithi078.stdout:279 2023-12-12T10:15:41.573 INFO:teuthology.orchestra.run.smithi078.stdout:279.out 2023-12-12T10:15:41.573 INFO:teuthology.orchestra.run.smithi078.stdout:280 2023-12-12T10:15:41.573 INFO:teuthology.orchestra.run.smithi078.stdout:280.out 2023-12-12T10:15:41.573 INFO:teuthology.orchestra.run.smithi078.stdout:281 2023-12-12T10:15:41.573 INFO:teuthology.orchestra.run.smithi078.stdout:281.out 2023-12-12T10:15:41.573 INFO:teuthology.orchestra.run.smithi078.stdout:282 2023-12-12T10:15:41.573 INFO:teuthology.orchestra.run.smithi078.stdout:282.out 2023-12-12T10:15:41.573 INFO:teuthology.orchestra.run.smithi078.stdout:283 2023-12-12T10:15:41.573 INFO:teuthology.orchestra.run.smithi078.stdout:283.out 2023-12-12T10:15:41.573 INFO:teuthology.orchestra.run.smithi078.stdout:284 2023-12-12T10:15:41.573 INFO:teuthology.orchestra.run.smithi078.stdout:284.out 2023-12-12T10:15:41.573 INFO:teuthology.orchestra.run.smithi078.stdout:285 2023-12-12T10:15:41.574 INFO:teuthology.orchestra.run.smithi078.stdout:285.out 2023-12-12T10:15:41.574 INFO:teuthology.orchestra.run.smithi078.stdout:286 2023-12-12T10:15:41.574 INFO:teuthology.orchestra.run.smithi078.stdout:286.out 2023-12-12T10:15:41.574 INFO:teuthology.orchestra.run.smithi078.stdout:287 2023-12-12T10:15:41.574 INFO:teuthology.orchestra.run.smithi078.stdout:287.out 2023-12-12T10:15:41.574 INFO:teuthology.orchestra.run.smithi078.stdout:288 2023-12-12T10:15:41.574 INFO:teuthology.orchestra.run.smithi078.stdout:288.out 2023-12-12T10:15:41.574 INFO:teuthology.orchestra.run.smithi078.stdout:289 2023-12-12T10:15:41.574 INFO:teuthology.orchestra.run.smithi078.stdout:289.out 2023-12-12T10:15:41.574 INFO:teuthology.orchestra.run.smithi078.stdout:290 2023-12-12T10:15:41.574 INFO:teuthology.orchestra.run.smithi078.stdout:290.out 2023-12-12T10:15:41.575 INFO:teuthology.orchestra.run.smithi078.stdout:291 2023-12-12T10:15:41.575 INFO:teuthology.orchestra.run.smithi078.stdout:291.out 2023-12-12T10:15:41.575 INFO:teuthology.orchestra.run.smithi078.stdout:292 2023-12-12T10:15:41.575 INFO:teuthology.orchestra.run.smithi078.stdout:292.out 2023-12-12T10:15:41.575 INFO:teuthology.orchestra.run.smithi078.stdout:293 2023-12-12T10:15:41.575 INFO:teuthology.orchestra.run.smithi078.stdout:293.out 2023-12-12T10:15:41.575 INFO:teuthology.orchestra.run.smithi078.stdout:294 2023-12-12T10:15:41.575 INFO:teuthology.orchestra.run.smithi078.stdout:294.out 2023-12-12T10:15:41.575 INFO:teuthology.orchestra.run.smithi078.stdout:295 2023-12-12T10:15:41.575 INFO:teuthology.orchestra.run.smithi078.stdout:295.out 2023-12-12T10:15:41.575 INFO:teuthology.orchestra.run.smithi078.stdout:296 2023-12-12T10:15:41.575 INFO:teuthology.orchestra.run.smithi078.stdout:296.out 2023-12-12T10:15:41.575 INFO:teuthology.orchestra.run.smithi078.stdout:297 2023-12-12T10:15:41.575 INFO:teuthology.orchestra.run.smithi078.stdout:297.out 2023-12-12T10:15:41.575 INFO:teuthology.orchestra.run.smithi078.stdout:298 2023-12-12T10:15:41.576 INFO:teuthology.orchestra.run.smithi078.stdout:298.out 2023-12-12T10:15:41.576 INFO:teuthology.orchestra.run.smithi078.stdout:299 2023-12-12T10:15:41.576 INFO:teuthology.orchestra.run.smithi078.stdout:299.out 2023-12-12T10:15:41.576 INFO:teuthology.orchestra.run.smithi078.stdout:300 2023-12-12T10:15:41.576 INFO:teuthology.orchestra.run.smithi078.stdout:300.out 2023-12-12T10:15:41.576 INFO:teuthology.orchestra.run.smithi078.stdout:301 2023-12-12T10:15:41.576 INFO:teuthology.orchestra.run.smithi078.stdout:301.out 2023-12-12T10:15:41.576 INFO:teuthology.orchestra.run.smithi078.stdout:302 2023-12-12T10:15:41.576 INFO:teuthology.orchestra.run.smithi078.stdout:302.out 2023-12-12T10:15:41.576 INFO:teuthology.orchestra.run.smithi078.stdout:303 2023-12-12T10:15:41.576 INFO:teuthology.orchestra.run.smithi078.stdout:303.out 2023-12-12T10:15:41.576 INFO:teuthology.orchestra.run.smithi078.stdout:304 2023-12-12T10:15:41.576 INFO:teuthology.orchestra.run.smithi078.stdout:304.out 2023-12-12T10:15:41.576 INFO:teuthology.orchestra.run.smithi078.stdout:305 2023-12-12T10:15:41.577 INFO:teuthology.orchestra.run.smithi078.stdout:305.out 2023-12-12T10:15:41.577 INFO:teuthology.orchestra.run.smithi078.stdout:306 2023-12-12T10:15:41.577 INFO:teuthology.orchestra.run.smithi078.stdout:306.out 2023-12-12T10:15:41.577 INFO:teuthology.orchestra.run.smithi078.stdout:307 2023-12-12T10:15:41.577 INFO:teuthology.orchestra.run.smithi078.stdout:307.out 2023-12-12T10:15:41.577 INFO:teuthology.orchestra.run.smithi078.stdout:308 2023-12-12T10:15:41.577 INFO:teuthology.orchestra.run.smithi078.stdout:308.out 2023-12-12T10:15:41.577 INFO:teuthology.orchestra.run.smithi078.stdout:309 2023-12-12T10:15:41.577 INFO:teuthology.orchestra.run.smithi078.stdout:309.out 2023-12-12T10:15:41.577 INFO:teuthology.orchestra.run.smithi078.stdout:310 2023-12-12T10:15:41.577 INFO:teuthology.orchestra.run.smithi078.stdout:310.out 2023-12-12T10:15:41.577 INFO:teuthology.orchestra.run.smithi078.stdout:311 2023-12-12T10:15:41.577 INFO:teuthology.orchestra.run.smithi078.stdout:311.out 2023-12-12T10:15:41.577 INFO:teuthology.orchestra.run.smithi078.stdout:312 2023-12-12T10:15:41.577 INFO:teuthology.orchestra.run.smithi078.stdout:312.out 2023-12-12T10:15:41.577 INFO:teuthology.orchestra.run.smithi078.stdout:313 2023-12-12T10:15:41.578 INFO:teuthology.orchestra.run.smithi078.stdout:313.out 2023-12-12T10:15:41.578 INFO:teuthology.orchestra.run.smithi078.stdout:314 2023-12-12T10:15:41.578 INFO:teuthology.orchestra.run.smithi078.stdout:314.out 2023-12-12T10:15:41.578 INFO:teuthology.orchestra.run.smithi078.stdout:315 2023-12-12T10:15:41.578 INFO:teuthology.orchestra.run.smithi078.stdout:315.out 2023-12-12T10:15:41.578 INFO:teuthology.orchestra.run.smithi078.stdout:316 2023-12-12T10:15:41.578 INFO:teuthology.orchestra.run.smithi078.stdout:316.out 2023-12-12T10:15:41.578 INFO:teuthology.orchestra.run.smithi078.stdout:317 2023-12-12T10:15:41.578 INFO:teuthology.orchestra.run.smithi078.stdout:317.out 2023-12-12T10:15:41.578 INFO:teuthology.orchestra.run.smithi078.stdout:318 2023-12-12T10:15:41.578 INFO:teuthology.orchestra.run.smithi078.stdout:318.out 2023-12-12T10:15:41.578 INFO:teuthology.orchestra.run.smithi078.stdout:319 2023-12-12T10:15:41.578 INFO:teuthology.orchestra.run.smithi078.stdout:319.out 2023-12-12T10:15:41.578 INFO:teuthology.orchestra.run.smithi078.stdout:320 2023-12-12T10:15:41.579 INFO:teuthology.orchestra.run.smithi078.stdout:320.out 2023-12-12T10:15:41.579 INFO:teuthology.orchestra.run.smithi078.stdout:321 2023-12-12T10:15:41.579 INFO:teuthology.orchestra.run.smithi078.stdout:321.out 2023-12-12T10:15:41.579 INFO:teuthology.orchestra.run.smithi078.stdout:322 2023-12-12T10:15:41.579 INFO:teuthology.orchestra.run.smithi078.stdout:322.out 2023-12-12T10:15:41.579 INFO:teuthology.orchestra.run.smithi078.stdout:323 2023-12-12T10:15:41.579 INFO:teuthology.orchestra.run.smithi078.stdout:323.out 2023-12-12T10:15:41.579 INFO:teuthology.orchestra.run.smithi078.stdout:324 2023-12-12T10:15:41.579 INFO:teuthology.orchestra.run.smithi078.stdout:324.out 2023-12-12T10:15:41.579 INFO:teuthology.orchestra.run.smithi078.stdout:325 2023-12-12T10:15:41.579 INFO:teuthology.orchestra.run.smithi078.stdout:325.out 2023-12-12T10:15:41.579 INFO:teuthology.orchestra.run.smithi078.stdout:326 2023-12-12T10:15:41.579 INFO:teuthology.orchestra.run.smithi078.stdout:326.out 2023-12-12T10:15:41.579 INFO:teuthology.orchestra.run.smithi078.stdout:327 2023-12-12T10:15:41.579 INFO:teuthology.orchestra.run.smithi078.stdout:327.out 2023-12-12T10:15:41.579 INFO:teuthology.orchestra.run.smithi078.stdout:328 2023-12-12T10:15:41.580 INFO:teuthology.orchestra.run.smithi078.stdout:328.out 2023-12-12T10:15:41.580 INFO:teuthology.orchestra.run.smithi078.stdout:329 2023-12-12T10:15:41.580 INFO:teuthology.orchestra.run.smithi078.stdout:329.out 2023-12-12T10:15:41.580 INFO:teuthology.orchestra.run.smithi078.stdout:330 2023-12-12T10:15:41.580 INFO:teuthology.orchestra.run.smithi078.stdout:330.out 2023-12-12T10:15:41.580 INFO:teuthology.orchestra.run.smithi078.stdout:331 2023-12-12T10:15:41.580 INFO:teuthology.orchestra.run.smithi078.stdout:331.out 2023-12-12T10:15:41.580 INFO:teuthology.orchestra.run.smithi078.stdout:332 2023-12-12T10:15:41.580 INFO:teuthology.orchestra.run.smithi078.stdout:332.out 2023-12-12T10:15:41.580 INFO:teuthology.orchestra.run.smithi078.stdout:333 2023-12-12T10:15:41.580 INFO:teuthology.orchestra.run.smithi078.stdout:333.out 2023-12-12T10:15:41.580 INFO:teuthology.orchestra.run.smithi078.stdout:334 2023-12-12T10:15:41.580 INFO:teuthology.orchestra.run.smithi078.stdout:334.out 2023-12-12T10:15:41.580 INFO:teuthology.orchestra.run.smithi078.stdout:335 2023-12-12T10:15:41.581 INFO:teuthology.orchestra.run.smithi078.stdout:335.out 2023-12-12T10:15:41.581 INFO:teuthology.orchestra.run.smithi078.stdout:336 2023-12-12T10:15:41.581 INFO:teuthology.orchestra.run.smithi078.stdout:336.out 2023-12-12T10:15:41.581 INFO:teuthology.orchestra.run.smithi078.stdout:337 2023-12-12T10:15:41.581 INFO:teuthology.orchestra.run.smithi078.stdout:337.out 2023-12-12T10:15:41.581 INFO:teuthology.orchestra.run.smithi078.stdout:338 2023-12-12T10:15:41.581 INFO:teuthology.orchestra.run.smithi078.stdout:338.out 2023-12-12T10:15:41.581 INFO:teuthology.orchestra.run.smithi078.stdout:339 2023-12-12T10:15:41.581 INFO:teuthology.orchestra.run.smithi078.stdout:339.out 2023-12-12T10:15:41.581 INFO:teuthology.orchestra.run.smithi078.stdout:340 2023-12-12T10:15:41.581 INFO:teuthology.orchestra.run.smithi078.stdout:340.out 2023-12-12T10:15:41.581 INFO:teuthology.orchestra.run.smithi078.stdout:341 2023-12-12T10:15:41.581 INFO:teuthology.orchestra.run.smithi078.stdout:341.out 2023-12-12T10:15:41.581 INFO:teuthology.orchestra.run.smithi078.stdout:342 2023-12-12T10:15:41.581 INFO:teuthology.orchestra.run.smithi078.stdout:342.out 2023-12-12T10:15:41.582 INFO:teuthology.orchestra.run.smithi078.stdout:343 2023-12-12T10:15:41.582 INFO:teuthology.orchestra.run.smithi078.stdout:343.out 2023-12-12T10:15:41.582 INFO:teuthology.orchestra.run.smithi078.stdout:344 2023-12-12T10:15:41.582 INFO:teuthology.orchestra.run.smithi078.stdout:344.out 2023-12-12T10:15:41.582 INFO:teuthology.orchestra.run.smithi078.stdout:345 2023-12-12T10:15:41.582 INFO:teuthology.orchestra.run.smithi078.stdout:345.out 2023-12-12T10:15:41.582 INFO:teuthology.orchestra.run.smithi078.stdout:346 2023-12-12T10:15:41.582 INFO:teuthology.orchestra.run.smithi078.stdout:346.out 2023-12-12T10:15:41.582 INFO:teuthology.orchestra.run.smithi078.stdout:347 2023-12-12T10:15:41.582 INFO:teuthology.orchestra.run.smithi078.stdout:347.out 2023-12-12T10:15:41.582 INFO:teuthology.orchestra.run.smithi078.stdout:348 2023-12-12T10:15:41.582 INFO:teuthology.orchestra.run.smithi078.stdout:348.out 2023-12-12T10:15:41.582 INFO:teuthology.orchestra.run.smithi078.stdout:349 2023-12-12T10:15:41.582 INFO:teuthology.orchestra.run.smithi078.stdout:349.out 2023-12-12T10:15:41.583 INFO:teuthology.orchestra.run.smithi078.stdout:350 2023-12-12T10:15:41.583 INFO:teuthology.orchestra.run.smithi078.stdout:350.out 2023-12-12T10:15:41.583 INFO:teuthology.orchestra.run.smithi078.stdout:351 2023-12-12T10:15:41.583 INFO:teuthology.orchestra.run.smithi078.stdout:351.out 2023-12-12T10:15:41.583 INFO:teuthology.orchestra.run.smithi078.stdout:352 2023-12-12T10:15:41.583 INFO:teuthology.orchestra.run.smithi078.stdout:352.out 2023-12-12T10:15:41.583 INFO:teuthology.orchestra.run.smithi078.stdout:353 2023-12-12T10:15:41.583 INFO:teuthology.orchestra.run.smithi078.stdout:353.out 2023-12-12T10:15:41.583 INFO:teuthology.orchestra.run.smithi078.stdout:354 2023-12-12T10:15:41.583 INFO:teuthology.orchestra.run.smithi078.stdout:354.out 2023-12-12T10:15:41.583 INFO:teuthology.orchestra.run.smithi078.stdout:355 2023-12-12T10:15:41.583 INFO:teuthology.orchestra.run.smithi078.stdout:355.out 2023-12-12T10:15:41.583 INFO:teuthology.orchestra.run.smithi078.stdout:356 2023-12-12T10:15:41.583 INFO:teuthology.orchestra.run.smithi078.stdout:356.out 2023-12-12T10:15:41.583 INFO:teuthology.orchestra.run.smithi078.stdout:357 2023-12-12T10:15:41.584 INFO:teuthology.orchestra.run.smithi078.stdout:357.out 2023-12-12T10:15:41.584 INFO:teuthology.orchestra.run.smithi078.stdout:358 2023-12-12T10:15:41.584 INFO:teuthology.orchestra.run.smithi078.stdout:358.out 2023-12-12T10:15:41.584 INFO:teuthology.orchestra.run.smithi078.stdout:359 2023-12-12T10:15:41.584 INFO:teuthology.orchestra.run.smithi078.stdout:359.out 2023-12-12T10:15:41.584 INFO:teuthology.orchestra.run.smithi078.stdout:360 2023-12-12T10:15:41.584 INFO:teuthology.orchestra.run.smithi078.stdout:360.out 2023-12-12T10:15:41.584 INFO:teuthology.orchestra.run.smithi078.stdout:361 2023-12-12T10:15:41.584 INFO:teuthology.orchestra.run.smithi078.stdout:361.out 2023-12-12T10:15:41.584 INFO:teuthology.orchestra.run.smithi078.stdout:362 2023-12-12T10:15:41.584 INFO:teuthology.orchestra.run.smithi078.stdout:362.out 2023-12-12T10:15:41.584 INFO:teuthology.orchestra.run.smithi078.stdout:363 2023-12-12T10:15:41.584 INFO:teuthology.orchestra.run.smithi078.stdout:363.out 2023-12-12T10:15:41.584 INFO:teuthology.orchestra.run.smithi078.stdout:364 2023-12-12T10:15:41.584 INFO:teuthology.orchestra.run.smithi078.stdout:364.out 2023-12-12T10:15:41.585 INFO:teuthology.orchestra.run.smithi078.stdout:365 2023-12-12T10:15:41.585 INFO:teuthology.orchestra.run.smithi078.stdout:365.out 2023-12-12T10:15:41.585 INFO:teuthology.orchestra.run.smithi078.stdout:366 2023-12-12T10:15:41.585 INFO:teuthology.orchestra.run.smithi078.stdout:366.out 2023-12-12T10:15:41.585 INFO:teuthology.orchestra.run.smithi078.stdout:367 2023-12-12T10:15:41.585 INFO:teuthology.orchestra.run.smithi078.stdout:367.out 2023-12-12T10:15:41.585 INFO:teuthology.orchestra.run.smithi078.stdout:368 2023-12-12T10:15:41.585 INFO:teuthology.orchestra.run.smithi078.stdout:368.out 2023-12-12T10:15:41.585 INFO:teuthology.orchestra.run.smithi078.stdout:369 2023-12-12T10:15:41.585 INFO:teuthology.orchestra.run.smithi078.stdout:369.out 2023-12-12T10:15:41.585 INFO:teuthology.orchestra.run.smithi078.stdout:370 2023-12-12T10:15:41.585 INFO:teuthology.orchestra.run.smithi078.stdout:370.out 2023-12-12T10:15:41.585 INFO:teuthology.orchestra.run.smithi078.stdout:371 2023-12-12T10:15:41.586 INFO:teuthology.orchestra.run.smithi078.stdout:371.out 2023-12-12T10:15:41.587 INFO:teuthology.orchestra.run.smithi078.stdout:372 2023-12-12T10:15:41.587 INFO:teuthology.orchestra.run.smithi078.stdout:372.out 2023-12-12T10:15:41.587 INFO:teuthology.orchestra.run.smithi078.stdout:373 2023-12-12T10:15:41.587 INFO:teuthology.orchestra.run.smithi078.stdout:373.out 2023-12-12T10:15:41.587 INFO:teuthology.orchestra.run.smithi078.stdout:374 2023-12-12T10:15:41.587 INFO:teuthology.orchestra.run.smithi078.stdout:374.out 2023-12-12T10:15:41.587 INFO:teuthology.orchestra.run.smithi078.stdout:375 2023-12-12T10:15:41.587 INFO:teuthology.orchestra.run.smithi078.stdout:375.out 2023-12-12T10:15:41.587 INFO:teuthology.orchestra.run.smithi078.stdout:376 2023-12-12T10:15:41.587 INFO:teuthology.orchestra.run.smithi078.stdout:376.out 2023-12-12T10:15:41.587 INFO:teuthology.orchestra.run.smithi078.stdout:377 2023-12-12T10:15:41.588 INFO:teuthology.orchestra.run.smithi078.stdout:377.out 2023-12-12T10:15:41.588 INFO:teuthology.orchestra.run.smithi078.stdout:378 2023-12-12T10:15:41.588 INFO:teuthology.orchestra.run.smithi078.stdout:378.out 2023-12-12T10:15:41.588 INFO:teuthology.orchestra.run.smithi078.stdout:379 2023-12-12T10:15:41.588 INFO:teuthology.orchestra.run.smithi078.stdout:379.out 2023-12-12T10:15:41.588 INFO:teuthology.orchestra.run.smithi078.stdout:380 2023-12-12T10:15:41.588 INFO:teuthology.orchestra.run.smithi078.stdout:380.out 2023-12-12T10:15:41.588 INFO:teuthology.orchestra.run.smithi078.stdout:381 2023-12-12T10:15:41.588 INFO:teuthology.orchestra.run.smithi078.stdout:381.out 2023-12-12T10:15:41.588 INFO:teuthology.orchestra.run.smithi078.stdout:382 2023-12-12T10:15:41.588 INFO:teuthology.orchestra.run.smithi078.stdout:382.out 2023-12-12T10:15:41.588 INFO:teuthology.orchestra.run.smithi078.stdout:383 2023-12-12T10:15:41.588 INFO:teuthology.orchestra.run.smithi078.stdout:383.out 2023-12-12T10:15:41.588 INFO:teuthology.orchestra.run.smithi078.stdout:384 2023-12-12T10:15:41.588 INFO:teuthology.orchestra.run.smithi078.stdout:384.out 2023-12-12T10:15:41.589 INFO:teuthology.orchestra.run.smithi078.stdout:385 2023-12-12T10:15:41.589 INFO:teuthology.orchestra.run.smithi078.stdout:385.out 2023-12-12T10:15:41.589 INFO:teuthology.orchestra.run.smithi078.stdout:386 2023-12-12T10:15:41.589 INFO:teuthology.orchestra.run.smithi078.stdout:386.out 2023-12-12T10:15:41.589 INFO:teuthology.orchestra.run.smithi078.stdout:387 2023-12-12T10:15:41.589 INFO:teuthology.orchestra.run.smithi078.stdout:387.out 2023-12-12T10:15:41.589 INFO:teuthology.orchestra.run.smithi078.stdout:388 2023-12-12T10:15:41.589 INFO:teuthology.orchestra.run.smithi078.stdout:388.out 2023-12-12T10:15:41.589 INFO:teuthology.orchestra.run.smithi078.stdout:389 2023-12-12T10:15:41.589 INFO:teuthology.orchestra.run.smithi078.stdout:389.out 2023-12-12T10:15:41.589 INFO:teuthology.orchestra.run.smithi078.stdout:390 2023-12-12T10:15:41.589 INFO:teuthology.orchestra.run.smithi078.stdout:390.out 2023-12-12T10:15:41.589 INFO:teuthology.orchestra.run.smithi078.stdout:391 2023-12-12T10:15:41.589 INFO:teuthology.orchestra.run.smithi078.stdout:391.out 2023-12-12T10:15:41.589 INFO:teuthology.orchestra.run.smithi078.stdout:392 2023-12-12T10:15:41.590 INFO:teuthology.orchestra.run.smithi078.stdout:392.out 2023-12-12T10:15:41.590 INFO:teuthology.orchestra.run.smithi078.stdout:393 2023-12-12T10:15:41.590 INFO:teuthology.orchestra.run.smithi078.stdout:393.out 2023-12-12T10:15:41.590 INFO:teuthology.orchestra.run.smithi078.stdout:394 2023-12-12T10:15:41.590 INFO:teuthology.orchestra.run.smithi078.stdout:394.out 2023-12-12T10:15:41.590 INFO:teuthology.orchestra.run.smithi078.stdout:395 2023-12-12T10:15:41.590 INFO:teuthology.orchestra.run.smithi078.stdout:395.out 2023-12-12T10:15:41.590 INFO:teuthology.orchestra.run.smithi078.stdout:396 2023-12-12T10:15:41.590 INFO:teuthology.orchestra.run.smithi078.stdout:396.out 2023-12-12T10:15:41.590 INFO:teuthology.orchestra.run.smithi078.stdout:397 2023-12-12T10:15:41.590 INFO:teuthology.orchestra.run.smithi078.stdout:397.out 2023-12-12T10:15:41.590 INFO:teuthology.orchestra.run.smithi078.stdout:398 2023-12-12T10:15:41.590 INFO:teuthology.orchestra.run.smithi078.stdout:398.out 2023-12-12T10:15:41.590 INFO:teuthology.orchestra.run.smithi078.stdout:399 2023-12-12T10:15:41.591 INFO:teuthology.orchestra.run.smithi078.stdout:399.out 2023-12-12T10:15:41.591 INFO:teuthology.orchestra.run.smithi078.stdout:400 2023-12-12T10:15:41.591 INFO:teuthology.orchestra.run.smithi078.stdout:400.out 2023-12-12T10:15:41.591 INFO:teuthology.orchestra.run.smithi078.stdout:401 2023-12-12T10:15:41.591 INFO:teuthology.orchestra.run.smithi078.stdout:401.out 2023-12-12T10:15:41.591 INFO:teuthology.orchestra.run.smithi078.stdout:402 2023-12-12T10:15:41.591 INFO:teuthology.orchestra.run.smithi078.stdout:402.out 2023-12-12T10:15:41.591 INFO:teuthology.orchestra.run.smithi078.stdout:403 2023-12-12T10:15:41.591 INFO:teuthology.orchestra.run.smithi078.stdout:403.out 2023-12-12T10:15:41.591 INFO:teuthology.orchestra.run.smithi078.stdout:404 2023-12-12T10:15:41.591 INFO:teuthology.orchestra.run.smithi078.stdout:404.out 2023-12-12T10:15:41.591 INFO:teuthology.orchestra.run.smithi078.stdout:405 2023-12-12T10:15:41.591 INFO:teuthology.orchestra.run.smithi078.stdout:405.out 2023-12-12T10:15:41.591 INFO:teuthology.orchestra.run.smithi078.stdout:406 2023-12-12T10:15:41.591 INFO:teuthology.orchestra.run.smithi078.stdout:406.out 2023-12-12T10:15:41.592 INFO:teuthology.orchestra.run.smithi078.stdout:407 2023-12-12T10:15:41.592 INFO:teuthology.orchestra.run.smithi078.stdout:407.out 2023-12-12T10:15:41.592 INFO:teuthology.orchestra.run.smithi078.stdout:408 2023-12-12T10:15:41.592 INFO:teuthology.orchestra.run.smithi078.stdout:408.out 2023-12-12T10:15:41.592 INFO:teuthology.orchestra.run.smithi078.stdout:409 2023-12-12T10:15:41.592 INFO:teuthology.orchestra.run.smithi078.stdout:409.out 2023-12-12T10:15:41.592 INFO:teuthology.orchestra.run.smithi078.stdout:410 2023-12-12T10:15:41.592 INFO:teuthology.orchestra.run.smithi078.stdout:410.out 2023-12-12T10:15:41.592 INFO:teuthology.orchestra.run.smithi078.stdout:411 2023-12-12T10:15:41.592 INFO:teuthology.orchestra.run.smithi078.stdout:411.out 2023-12-12T10:15:41.592 INFO:teuthology.orchestra.run.smithi078.stdout:412 2023-12-12T10:15:41.592 INFO:teuthology.orchestra.run.smithi078.stdout:412.out 2023-12-12T10:15:41.592 INFO:teuthology.orchestra.run.smithi078.stdout:413 2023-12-12T10:15:41.592 INFO:teuthology.orchestra.run.smithi078.stdout:413.out 2023-12-12T10:15:41.592 INFO:teuthology.orchestra.run.smithi078.stdout:414 2023-12-12T10:15:41.593 INFO:teuthology.orchestra.run.smithi078.stdout:414.out 2023-12-12T10:15:41.593 INFO:teuthology.orchestra.run.smithi078.stdout:415 2023-12-12T10:15:41.593 INFO:teuthology.orchestra.run.smithi078.stdout:415.out 2023-12-12T10:15:41.593 INFO:teuthology.orchestra.run.smithi078.stdout:416 2023-12-12T10:15:41.593 INFO:teuthology.orchestra.run.smithi078.stdout:416.out 2023-12-12T10:15:41.593 INFO:teuthology.orchestra.run.smithi078.stdout:417 2023-12-12T10:15:41.593 INFO:teuthology.orchestra.run.smithi078.stdout:417.out 2023-12-12T10:15:41.593 INFO:teuthology.orchestra.run.smithi078.stdout:418 2023-12-12T10:15:41.593 INFO:teuthology.orchestra.run.smithi078.stdout:418.out 2023-12-12T10:15:41.593 INFO:teuthology.orchestra.run.smithi078.stdout:419 2023-12-12T10:15:41.593 INFO:teuthology.orchestra.run.smithi078.stdout:419.out 2023-12-12T10:15:41.593 INFO:teuthology.orchestra.run.smithi078.stdout:420 2023-12-12T10:15:41.593 INFO:teuthology.orchestra.run.smithi078.stdout:420.out 2023-12-12T10:15:41.593 INFO:teuthology.orchestra.run.smithi078.stdout:421 2023-12-12T10:15:41.593 INFO:teuthology.orchestra.run.smithi078.stdout:421.out 2023-12-12T10:15:41.594 INFO:teuthology.orchestra.run.smithi078.stdout:422 2023-12-12T10:15:41.594 INFO:teuthology.orchestra.run.smithi078.stdout:422.out 2023-12-12T10:15:41.594 INFO:teuthology.orchestra.run.smithi078.stdout:423 2023-12-12T10:15:41.594 INFO:teuthology.orchestra.run.smithi078.stdout:423.out 2023-12-12T10:15:41.594 INFO:teuthology.orchestra.run.smithi078.stdout:424 2023-12-12T10:15:41.594 INFO:teuthology.orchestra.run.smithi078.stdout:424.out 2023-12-12T10:15:41.594 INFO:teuthology.orchestra.run.smithi078.stdout:425 2023-12-12T10:15:41.594 INFO:teuthology.orchestra.run.smithi078.stdout:425.out 2023-12-12T10:15:41.594 INFO:teuthology.orchestra.run.smithi078.stdout:426 2023-12-12T10:15:41.594 INFO:teuthology.orchestra.run.smithi078.stdout:426.out 2023-12-12T10:15:41.594 INFO:teuthology.orchestra.run.smithi078.stdout:427 2023-12-12T10:15:41.594 INFO:teuthology.orchestra.run.smithi078.stdout:427.out 2023-12-12T10:15:41.594 INFO:teuthology.orchestra.run.smithi078.stdout:428 2023-12-12T10:15:41.594 INFO:teuthology.orchestra.run.smithi078.stdout:428.out 2023-12-12T10:15:41.594 INFO:teuthology.orchestra.run.smithi078.stdout:429 2023-12-12T10:15:41.595 INFO:teuthology.orchestra.run.smithi078.stdout:429.out 2023-12-12T10:15:41.595 INFO:teuthology.orchestra.run.smithi078.stdout:430 2023-12-12T10:15:41.595 INFO:teuthology.orchestra.run.smithi078.stdout:430.out 2023-12-12T10:15:41.595 INFO:teuthology.orchestra.run.smithi078.stdout:431 2023-12-12T10:15:41.595 INFO:teuthology.orchestra.run.smithi078.stdout:431.out 2023-12-12T10:15:41.595 INFO:teuthology.orchestra.run.smithi078.stdout:432 2023-12-12T10:15:41.595 INFO:teuthology.orchestra.run.smithi078.stdout:432.out 2023-12-12T10:15:41.595 INFO:teuthology.orchestra.run.smithi078.stdout:433 2023-12-12T10:15:41.595 INFO:teuthology.orchestra.run.smithi078.stdout:433.out 2023-12-12T10:15:41.595 INFO:teuthology.orchestra.run.smithi078.stdout:434 2023-12-12T10:15:41.595 INFO:teuthology.orchestra.run.smithi078.stdout:434.out 2023-12-12T10:15:41.595 INFO:teuthology.orchestra.run.smithi078.stdout:435 2023-12-12T10:15:41.596 INFO:teuthology.orchestra.run.smithi078.stdout:435.out 2023-12-12T10:15:41.596 INFO:teuthology.orchestra.run.smithi078.stdout:436 2023-12-12T10:15:41.596 INFO:teuthology.orchestra.run.smithi078.stdout:436.out 2023-12-12T10:15:41.596 INFO:teuthology.orchestra.run.smithi078.stdout:437 2023-12-12T10:15:41.596 INFO:teuthology.orchestra.run.smithi078.stdout:437.out 2023-12-12T10:15:41.596 INFO:teuthology.orchestra.run.smithi078.stdout:438 2023-12-12T10:15:41.596 INFO:teuthology.orchestra.run.smithi078.stdout:438.out 2023-12-12T10:15:41.596 INFO:teuthology.orchestra.run.smithi078.stdout:439 2023-12-12T10:15:41.596 INFO:teuthology.orchestra.run.smithi078.stdout:439.out 2023-12-12T10:15:41.596 INFO:teuthology.orchestra.run.smithi078.stdout:440 2023-12-12T10:15:41.596 INFO:teuthology.orchestra.run.smithi078.stdout:440.out 2023-12-12T10:15:41.596 INFO:teuthology.orchestra.run.smithi078.stdout:441 2023-12-12T10:15:41.597 INFO:teuthology.orchestra.run.smithi078.stdout:441.out 2023-12-12T10:15:41.597 INFO:teuthology.orchestra.run.smithi078.stdout:442 2023-12-12T10:15:41.597 INFO:teuthology.orchestra.run.smithi078.stdout:442.out 2023-12-12T10:15:41.597 INFO:teuthology.orchestra.run.smithi078.stdout:443 2023-12-12T10:15:41.597 INFO:teuthology.orchestra.run.smithi078.stdout:443.out 2023-12-12T10:15:41.597 INFO:teuthology.orchestra.run.smithi078.stdout:444 2023-12-12T10:15:41.597 INFO:teuthology.orchestra.run.smithi078.stdout:444.out 2023-12-12T10:15:41.597 INFO:teuthology.orchestra.run.smithi078.stdout:445 2023-12-12T10:15:41.597 INFO:teuthology.orchestra.run.smithi078.stdout:445.out 2023-12-12T10:15:41.597 INFO:teuthology.orchestra.run.smithi078.stdout:446 2023-12-12T10:15:41.597 INFO:teuthology.orchestra.run.smithi078.stdout:446.out 2023-12-12T10:15:41.597 INFO:teuthology.orchestra.run.smithi078.stdout:447 2023-12-12T10:15:41.597 INFO:teuthology.orchestra.run.smithi078.stdout:447.out 2023-12-12T10:15:41.597 INFO:teuthology.orchestra.run.smithi078.stdout:448 2023-12-12T10:15:41.597 INFO:teuthology.orchestra.run.smithi078.stdout:448.out 2023-12-12T10:15:41.598 INFO:teuthology.orchestra.run.smithi078.stdout:449 2023-12-12T10:15:41.598 INFO:teuthology.orchestra.run.smithi078.stdout:449.out 2023-12-12T10:15:41.598 INFO:teuthology.orchestra.run.smithi078.stdout:450 2023-12-12T10:15:41.598 INFO:teuthology.orchestra.run.smithi078.stdout:450.out 2023-12-12T10:15:41.598 INFO:teuthology.orchestra.run.smithi078.stdout:451 2023-12-12T10:15:41.598 INFO:teuthology.orchestra.run.smithi078.stdout:451.out 2023-12-12T10:15:41.598 INFO:teuthology.orchestra.run.smithi078.stdout:452 2023-12-12T10:15:41.598 INFO:teuthology.orchestra.run.smithi078.stdout:452.out 2023-12-12T10:15:41.598 INFO:teuthology.orchestra.run.smithi078.stdout:453 2023-12-12T10:15:41.598 INFO:teuthology.orchestra.run.smithi078.stdout:453.out 2023-12-12T10:15:41.598 INFO:teuthology.orchestra.run.smithi078.stdout:454 2023-12-12T10:15:41.598 INFO:teuthology.orchestra.run.smithi078.stdout:454.out 2023-12-12T10:15:41.598 INFO:teuthology.orchestra.run.smithi078.stdout:455 2023-12-12T10:15:41.598 INFO:teuthology.orchestra.run.smithi078.stdout:455.out 2023-12-12T10:15:41.598 INFO:teuthology.orchestra.run.smithi078.stdout:456 2023-12-12T10:15:41.599 INFO:teuthology.orchestra.run.smithi078.stdout:456.out 2023-12-12T10:15:41.599 INFO:teuthology.orchestra.run.smithi078.stdout:457 2023-12-12T10:15:41.599 INFO:teuthology.orchestra.run.smithi078.stdout:457.out 2023-12-12T10:15:41.599 INFO:teuthology.orchestra.run.smithi078.stdout:458 2023-12-12T10:15:41.599 INFO:teuthology.orchestra.run.smithi078.stdout:458.out 2023-12-12T10:15:41.599 INFO:teuthology.orchestra.run.smithi078.stdout:459 2023-12-12T10:15:41.599 INFO:teuthology.orchestra.run.smithi078.stdout:459.out 2023-12-12T10:15:41.599 INFO:teuthology.orchestra.run.smithi078.stdout:460 2023-12-12T10:15:41.599 INFO:teuthology.orchestra.run.smithi078.stdout:460.out 2023-12-12T10:15:41.599 INFO:teuthology.orchestra.run.smithi078.stdout:461 2023-12-12T10:15:41.599 INFO:teuthology.orchestra.run.smithi078.stdout:461.out 2023-12-12T10:15:41.599 INFO:teuthology.orchestra.run.smithi078.stdout:462 2023-12-12T10:15:41.599 INFO:teuthology.orchestra.run.smithi078.stdout:462.out 2023-12-12T10:15:41.599 INFO:teuthology.orchestra.run.smithi078.stdout:463 2023-12-12T10:15:41.599 INFO:teuthology.orchestra.run.smithi078.stdout:463.out 2023-12-12T10:15:41.600 INFO:teuthology.orchestra.run.smithi078.stdout:464 2023-12-12T10:15:41.600 INFO:teuthology.orchestra.run.smithi078.stdout:464.out 2023-12-12T10:15:41.600 INFO:teuthology.orchestra.run.smithi078.stdout:465 2023-12-12T10:15:41.600 INFO:teuthology.orchestra.run.smithi078.stdout:465.out 2023-12-12T10:15:41.600 INFO:teuthology.orchestra.run.smithi078.stdout:466 2023-12-12T10:15:41.600 INFO:teuthology.orchestra.run.smithi078.stdout:466.out 2023-12-12T10:15:41.600 INFO:teuthology.orchestra.run.smithi078.stdout:467 2023-12-12T10:15:41.600 INFO:teuthology.orchestra.run.smithi078.stdout:467.out 2023-12-12T10:15:41.600 INFO:teuthology.orchestra.run.smithi078.stdout:468 2023-12-12T10:15:41.600 INFO:teuthology.orchestra.run.smithi078.stdout:468.out 2023-12-12T10:15:41.600 INFO:teuthology.orchestra.run.smithi078.stdout:469 2023-12-12T10:15:41.600 INFO:teuthology.orchestra.run.smithi078.stdout:469.out 2023-12-12T10:15:41.600 INFO:teuthology.orchestra.run.smithi078.stdout:470 2023-12-12T10:15:41.600 INFO:teuthology.orchestra.run.smithi078.stdout:470.out 2023-12-12T10:15:41.600 INFO:teuthology.orchestra.run.smithi078.stdout:471 2023-12-12T10:15:41.601 INFO:teuthology.orchestra.run.smithi078.stdout:471.out 2023-12-12T10:15:41.601 INFO:teuthology.orchestra.run.smithi078.stdout:472 2023-12-12T10:15:41.601 INFO:teuthology.orchestra.run.smithi078.stdout:472.out 2023-12-12T10:15:41.601 INFO:teuthology.orchestra.run.smithi078.stdout:473 2023-12-12T10:15:41.601 INFO:teuthology.orchestra.run.smithi078.stdout:473.out 2023-12-12T10:15:41.601 INFO:teuthology.orchestra.run.smithi078.stdout:474 2023-12-12T10:15:41.601 INFO:teuthology.orchestra.run.smithi078.stdout:474.out 2023-12-12T10:15:41.601 INFO:teuthology.orchestra.run.smithi078.stdout:475 2023-12-12T10:15:41.601 INFO:teuthology.orchestra.run.smithi078.stdout:475.out 2023-12-12T10:15:41.601 INFO:teuthology.orchestra.run.smithi078.stdout:476 2023-12-12T10:15:41.601 INFO:teuthology.orchestra.run.smithi078.stdout:476.out 2023-12-12T10:15:41.601 INFO:teuthology.orchestra.run.smithi078.stdout:477 2023-12-12T10:15:41.601 INFO:teuthology.orchestra.run.smithi078.stdout:477.out 2023-12-12T10:15:41.601 INFO:teuthology.orchestra.run.smithi078.stdout:478 2023-12-12T10:15:41.601 INFO:teuthology.orchestra.run.smithi078.stdout:478.out 2023-12-12T10:15:41.602 INFO:teuthology.orchestra.run.smithi078.stdout:479 2023-12-12T10:15:41.602 INFO:teuthology.orchestra.run.smithi078.stdout:479.out 2023-12-12T10:15:41.602 INFO:teuthology.orchestra.run.smithi078.stdout:480 2023-12-12T10:15:41.602 INFO:teuthology.orchestra.run.smithi078.stdout:480.out 2023-12-12T10:15:41.602 INFO:teuthology.orchestra.run.smithi078.stdout:481 2023-12-12T10:15:41.602 INFO:teuthology.orchestra.run.smithi078.stdout:481.out 2023-12-12T10:15:41.602 INFO:teuthology.orchestra.run.smithi078.stdout:482 2023-12-12T10:15:41.602 INFO:teuthology.orchestra.run.smithi078.stdout:482.out 2023-12-12T10:15:41.602 INFO:teuthology.orchestra.run.smithi078.stdout:483 2023-12-12T10:15:41.602 INFO:teuthology.orchestra.run.smithi078.stdout:483.out 2023-12-12T10:15:41.602 INFO:teuthology.orchestra.run.smithi078.stdout:484 2023-12-12T10:15:41.602 INFO:teuthology.orchestra.run.smithi078.stdout:484.out 2023-12-12T10:15:41.602 INFO:teuthology.orchestra.run.smithi078.stdout:485 2023-12-12T10:15:41.602 INFO:teuthology.orchestra.run.smithi078.stdout:485.out 2023-12-12T10:15:41.603 INFO:teuthology.orchestra.run.smithi078.stdout:486 2023-12-12T10:15:41.603 INFO:teuthology.orchestra.run.smithi078.stdout:486.out 2023-12-12T10:15:41.603 INFO:teuthology.orchestra.run.smithi078.stdout:487 2023-12-12T10:15:41.603 INFO:teuthology.orchestra.run.smithi078.stdout:487.out 2023-12-12T10:15:41.603 INFO:teuthology.orchestra.run.smithi078.stdout:488 2023-12-12T10:15:41.603 INFO:teuthology.orchestra.run.smithi078.stdout:488.out 2023-12-12T10:15:41.603 INFO:teuthology.orchestra.run.smithi078.stdout:489 2023-12-12T10:15:41.603 INFO:teuthology.orchestra.run.smithi078.stdout:489.out 2023-12-12T10:15:41.603 INFO:teuthology.orchestra.run.smithi078.stdout:490 2023-12-12T10:15:41.603 INFO:teuthology.orchestra.run.smithi078.stdout:490.out 2023-12-12T10:15:41.603 INFO:teuthology.orchestra.run.smithi078.stdout:491 2023-12-12T10:15:41.603 INFO:teuthology.orchestra.run.smithi078.stdout:491.out 2023-12-12T10:15:41.603 INFO:teuthology.orchestra.run.smithi078.stdout:492 2023-12-12T10:15:41.603 INFO:teuthology.orchestra.run.smithi078.stdout:492.out 2023-12-12T10:15:41.603 INFO:teuthology.orchestra.run.smithi078.stdout:493 2023-12-12T10:15:41.604 INFO:teuthology.orchestra.run.smithi078.stdout:493.out 2023-12-12T10:15:41.604 INFO:teuthology.orchestra.run.smithi078.stdout:494 2023-12-12T10:15:41.604 INFO:teuthology.orchestra.run.smithi078.stdout:494.out 2023-12-12T10:15:41.604 INFO:teuthology.orchestra.run.smithi078.stdout:495 2023-12-12T10:15:41.604 INFO:teuthology.orchestra.run.smithi078.stdout:495.out 2023-12-12T10:15:41.604 INFO:teuthology.orchestra.run.smithi078.stdout:496 2023-12-12T10:15:41.604 INFO:teuthology.orchestra.run.smithi078.stdout:496.out 2023-12-12T10:15:41.604 INFO:teuthology.orchestra.run.smithi078.stdout:497 2023-12-12T10:15:41.604 INFO:teuthology.orchestra.run.smithi078.stdout:497.out 2023-12-12T10:15:41.604 INFO:teuthology.orchestra.run.smithi078.stdout:498 2023-12-12T10:15:41.604 INFO:teuthology.orchestra.run.smithi078.stdout:498.out 2023-12-12T10:15:41.604 INFO:teuthology.orchestra.run.smithi078.stdout:499 2023-12-12T10:15:41.604 INFO:teuthology.orchestra.run.smithi078.stdout:499.out 2023-12-12T10:15:41.604 INFO:teuthology.orchestra.run.smithi078.stdout:500 2023-12-12T10:15:41.604 INFO:teuthology.orchestra.run.smithi078.stdout:500.out 2023-12-12T10:15:41.604 INFO:teuthology.orchestra.run.smithi078.stdout:501 2023-12-12T10:15:41.605 INFO:teuthology.orchestra.run.smithi078.stdout:501.out 2023-12-12T10:15:41.605 INFO:teuthology.orchestra.run.smithi078.stdout:502 2023-12-12T10:15:41.605 INFO:teuthology.orchestra.run.smithi078.stdout:502.out 2023-12-12T10:15:41.605 INFO:teuthology.orchestra.run.smithi078.stdout:503 2023-12-12T10:15:41.605 INFO:teuthology.orchestra.run.smithi078.stdout:503.out 2023-12-12T10:15:41.605 INFO:teuthology.orchestra.run.smithi078.stdout:504 2023-12-12T10:15:41.605 INFO:teuthology.orchestra.run.smithi078.stdout:504.out 2023-12-12T10:15:41.605 INFO:teuthology.orchestra.run.smithi078.stdout:505 2023-12-12T10:15:41.605 INFO:teuthology.orchestra.run.smithi078.stdout:505.out 2023-12-12T10:15:41.605 INFO:teuthology.orchestra.run.smithi078.stdout:506 2023-12-12T10:15:41.605 INFO:teuthology.orchestra.run.smithi078.stdout:506.out 2023-12-12T10:15:41.605 INFO:teuthology.orchestra.run.smithi078.stdout:507 2023-12-12T10:15:41.605 INFO:teuthology.orchestra.run.smithi078.stdout:507.out 2023-12-12T10:15:41.605 INFO:teuthology.orchestra.run.smithi078.stdout:508 2023-12-12T10:15:41.605 INFO:teuthology.orchestra.run.smithi078.stdout:508.out 2023-12-12T10:15:41.606 INFO:teuthology.orchestra.run.smithi078.stdout:509 2023-12-12T10:15:41.606 INFO:teuthology.orchestra.run.smithi078.stdout:509.out 2023-12-12T10:15:41.606 INFO:teuthology.orchestra.run.smithi078.stdout:510 2023-12-12T10:15:41.606 INFO:teuthology.orchestra.run.smithi078.stdout:510.out 2023-12-12T10:15:41.606 INFO:teuthology.orchestra.run.smithi078.stdout:511 2023-12-12T10:15:41.606 INFO:teuthology.orchestra.run.smithi078.stdout:511.out 2023-12-12T10:15:41.606 INFO:teuthology.orchestra.run.smithi078.stdout:512 2023-12-12T10:15:41.606 INFO:teuthology.orchestra.run.smithi078.stdout:512.out 2023-12-12T10:15:41.606 INFO:teuthology.orchestra.run.smithi078.stdout:513 2023-12-12T10:15:41.606 INFO:teuthology.orchestra.run.smithi078.stdout:513.out 2023-12-12T10:15:41.606 INFO:teuthology.orchestra.run.smithi078.stdout:514 2023-12-12T10:15:41.606 INFO:teuthology.orchestra.run.smithi078.stdout:514.out 2023-12-12T10:15:41.606 INFO:teuthology.orchestra.run.smithi078.stdout:515 2023-12-12T10:15:41.606 INFO:teuthology.orchestra.run.smithi078.stdout:515.out 2023-12-12T10:15:41.606 INFO:teuthology.orchestra.run.smithi078.stdout:516 2023-12-12T10:15:41.607 INFO:teuthology.orchestra.run.smithi078.stdout:516.out 2023-12-12T10:15:41.607 INFO:teuthology.orchestra.run.smithi078.stdout:517 2023-12-12T10:15:41.607 INFO:teuthology.orchestra.run.smithi078.stdout:517.out 2023-12-12T10:15:41.607 INFO:teuthology.orchestra.run.smithi078.stdout:518 2023-12-12T10:15:41.607 INFO:teuthology.orchestra.run.smithi078.stdout:518.out 2023-12-12T10:15:41.607 INFO:teuthology.orchestra.run.smithi078.stdout:519 2023-12-12T10:15:41.607 INFO:teuthology.orchestra.run.smithi078.stdout:519.out 2023-12-12T10:15:41.607 INFO:teuthology.orchestra.run.smithi078.stdout:520 2023-12-12T10:15:41.607 INFO:teuthology.orchestra.run.smithi078.stdout:520.out 2023-12-12T10:15:41.607 INFO:teuthology.orchestra.run.smithi078.stdout:521 2023-12-12T10:15:41.607 INFO:teuthology.orchestra.run.smithi078.stdout:521.out 2023-12-12T10:15:41.607 INFO:teuthology.orchestra.run.smithi078.stdout:522 2023-12-12T10:15:41.607 INFO:teuthology.orchestra.run.smithi078.stdout:522.out 2023-12-12T10:15:41.607 INFO:teuthology.orchestra.run.smithi078.stdout:523 2023-12-12T10:15:41.607 INFO:teuthology.orchestra.run.smithi078.stdout:523.out 2023-12-12T10:15:41.608 INFO:teuthology.orchestra.run.smithi078.stdout:524 2023-12-12T10:15:41.608 INFO:teuthology.orchestra.run.smithi078.stdout:524.out 2023-12-12T10:15:41.608 INFO:teuthology.orchestra.run.smithi078.stdout:525 2023-12-12T10:15:41.608 INFO:teuthology.orchestra.run.smithi078.stdout:525.out 2023-12-12T10:15:41.608 INFO:teuthology.orchestra.run.smithi078.stdout:526 2023-12-12T10:15:41.608 INFO:teuthology.orchestra.run.smithi078.stdout:526.out 2023-12-12T10:15:41.608 INFO:teuthology.orchestra.run.smithi078.stdout:527 2023-12-12T10:15:41.608 INFO:teuthology.orchestra.run.smithi078.stdout:527.out 2023-12-12T10:15:41.608 INFO:teuthology.orchestra.run.smithi078.stdout:528 2023-12-12T10:15:41.608 INFO:teuthology.orchestra.run.smithi078.stdout:528.out 2023-12-12T10:15:41.608 INFO:teuthology.orchestra.run.smithi078.stdout:529 2023-12-12T10:15:41.608 INFO:teuthology.orchestra.run.smithi078.stdout:529.out 2023-12-12T10:15:41.608 INFO:teuthology.orchestra.run.smithi078.stdout:530 2023-12-12T10:15:41.608 INFO:teuthology.orchestra.run.smithi078.stdout:530.out 2023-12-12T10:15:41.608 INFO:teuthology.orchestra.run.smithi078.stdout:531 2023-12-12T10:15:41.609 INFO:teuthology.orchestra.run.smithi078.stdout:531.out 2023-12-12T10:15:41.609 INFO:teuthology.orchestra.run.smithi078.stdout:532 2023-12-12T10:15:41.609 INFO:teuthology.orchestra.run.smithi078.stdout:532.out 2023-12-12T10:15:41.609 INFO:teuthology.orchestra.run.smithi078.stdout:533 2023-12-12T10:15:41.609 INFO:teuthology.orchestra.run.smithi078.stdout:533.out 2023-12-12T10:15:41.609 INFO:teuthology.orchestra.run.smithi078.stdout:534 2023-12-12T10:15:41.609 INFO:teuthology.orchestra.run.smithi078.stdout:534.out 2023-12-12T10:15:41.609 INFO:teuthology.orchestra.run.smithi078.stdout:535 2023-12-12T10:15:41.609 INFO:teuthology.orchestra.run.smithi078.stdout:535.out 2023-12-12T10:15:41.609 INFO:teuthology.orchestra.run.smithi078.stdout:536 2023-12-12T10:15:41.609 INFO:teuthology.orchestra.run.smithi078.stdout:536.out 2023-12-12T10:15:41.609 INFO:teuthology.orchestra.run.smithi078.stdout:537 2023-12-12T10:15:41.609 INFO:teuthology.orchestra.run.smithi078.stdout:537.out 2023-12-12T10:15:41.609 INFO:teuthology.orchestra.run.smithi078.stdout:538 2023-12-12T10:15:41.609 INFO:teuthology.orchestra.run.smithi078.stdout:538.out 2023-12-12T10:15:41.610 INFO:teuthology.orchestra.run.smithi078.stdout:539 2023-12-12T10:15:41.610 INFO:teuthology.orchestra.run.smithi078.stdout:539.out 2023-12-12T10:15:41.610 INFO:teuthology.orchestra.run.smithi078.stdout:540 2023-12-12T10:15:41.610 INFO:teuthology.orchestra.run.smithi078.stdout:540.out 2023-12-12T10:15:41.610 INFO:teuthology.orchestra.run.smithi078.stdout:541 2023-12-12T10:15:41.610 INFO:teuthology.orchestra.run.smithi078.stdout:541.out 2023-12-12T10:15:41.610 INFO:teuthology.orchestra.run.smithi078.stdout:542 2023-12-12T10:15:41.610 INFO:teuthology.orchestra.run.smithi078.stdout:542.out 2023-12-12T10:15:41.610 INFO:teuthology.orchestra.run.smithi078.stdout:543 2023-12-12T10:15:41.610 INFO:teuthology.orchestra.run.smithi078.stdout:543.out 2023-12-12T10:15:41.610 INFO:teuthology.orchestra.run.smithi078.stdout:544 2023-12-12T10:15:41.610 INFO:teuthology.orchestra.run.smithi078.stdout:544.out 2023-12-12T10:15:41.610 INFO:teuthology.orchestra.run.smithi078.stdout:545 2023-12-12T10:15:41.610 INFO:teuthology.orchestra.run.smithi078.stdout:545.out 2023-12-12T10:15:41.610 INFO:teuthology.orchestra.run.smithi078.stdout:546 2023-12-12T10:15:41.611 INFO:teuthology.orchestra.run.smithi078.stdout:546.out 2023-12-12T10:15:41.611 INFO:teuthology.orchestra.run.smithi078.stdout:547 2023-12-12T10:15:41.611 INFO:teuthology.orchestra.run.smithi078.stdout:547.out 2023-12-12T10:15:41.611 INFO:teuthology.orchestra.run.smithi078.stdout:548 2023-12-12T10:15:41.611 INFO:teuthology.orchestra.run.smithi078.stdout:548.out 2023-12-12T10:15:41.611 INFO:teuthology.orchestra.run.smithi078.stdout:549 2023-12-12T10:15:41.611 INFO:teuthology.orchestra.run.smithi078.stdout:549.out 2023-12-12T10:15:41.611 INFO:teuthology.orchestra.run.smithi078.stdout:550 2023-12-12T10:15:41.611 INFO:teuthology.orchestra.run.smithi078.stdout:550.out 2023-12-12T10:15:41.611 INFO:teuthology.orchestra.run.smithi078.stdout:551 2023-12-12T10:15:41.611 INFO:teuthology.orchestra.run.smithi078.stdout:551.out 2023-12-12T10:15:41.611 INFO:teuthology.orchestra.run.smithi078.stdout:552 2023-12-12T10:15:41.611 INFO:teuthology.orchestra.run.smithi078.stdout:552.out 2023-12-12T10:15:41.611 INFO:teuthology.orchestra.run.smithi078.stdout:553 2023-12-12T10:15:41.611 INFO:teuthology.orchestra.run.smithi078.stdout:553.out 2023-12-12T10:15:41.612 INFO:teuthology.orchestra.run.smithi078.stdout:554 2023-12-12T10:15:41.612 INFO:teuthology.orchestra.run.smithi078.stdout:554.out 2023-12-12T10:15:41.612 INFO:teuthology.orchestra.run.smithi078.stdout:555 2023-12-12T10:15:41.612 INFO:teuthology.orchestra.run.smithi078.stdout:555.out 2023-12-12T10:15:41.612 INFO:teuthology.orchestra.run.smithi078.stdout:556 2023-12-12T10:15:41.612 INFO:teuthology.orchestra.run.smithi078.stdout:556.out 2023-12-12T10:15:41.612 INFO:teuthology.orchestra.run.smithi078.stdout:557 2023-12-12T10:15:41.612 INFO:teuthology.orchestra.run.smithi078.stdout:557.out 2023-12-12T10:15:41.612 INFO:teuthology.orchestra.run.smithi078.stdout:558 2023-12-12T10:15:41.612 INFO:teuthology.orchestra.run.smithi078.stdout:558.out 2023-12-12T10:15:41.612 INFO:teuthology.orchestra.run.smithi078.stdout:559 2023-12-12T10:15:41.612 INFO:teuthology.orchestra.run.smithi078.stdout:559.out 2023-12-12T10:15:41.612 INFO:teuthology.orchestra.run.smithi078.stdout:560 2023-12-12T10:15:41.612 INFO:teuthology.orchestra.run.smithi078.stdout:560.out 2023-12-12T10:15:41.612 INFO:teuthology.orchestra.run.smithi078.stdout:561 2023-12-12T10:15:41.612 INFO:teuthology.orchestra.run.smithi078.stdout:561.out 2023-12-12T10:15:41.613 INFO:teuthology.orchestra.run.smithi078.stdout:562 2023-12-12T10:15:41.613 INFO:teuthology.orchestra.run.smithi078.stdout:562.out 2023-12-12T10:15:41.613 INFO:teuthology.orchestra.run.smithi078.stdout:563 2023-12-12T10:15:41.613 INFO:teuthology.orchestra.run.smithi078.stdout:563.out 2023-12-12T10:15:41.613 INFO:teuthology.orchestra.run.smithi078.stdout:564 2023-12-12T10:15:41.613 INFO:teuthology.orchestra.run.smithi078.stdout:564.out 2023-12-12T10:15:41.613 INFO:teuthology.orchestra.run.smithi078.stdout:565 2023-12-12T10:15:41.613 INFO:teuthology.orchestra.run.smithi078.stdout:565.out 2023-12-12T10:15:41.613 INFO:teuthology.orchestra.run.smithi078.stdout:566 2023-12-12T10:15:41.613 INFO:teuthology.orchestra.run.smithi078.stdout:566.out 2023-12-12T10:15:41.613 INFO:teuthology.orchestra.run.smithi078.stdout:567 2023-12-12T10:15:41.613 INFO:teuthology.orchestra.run.smithi078.stdout:567.out 2023-12-12T10:15:41.613 INFO:teuthology.orchestra.run.smithi078.stdout:568 2023-12-12T10:15:41.613 INFO:teuthology.orchestra.run.smithi078.stdout:568.out 2023-12-12T10:15:41.613 INFO:teuthology.orchestra.run.smithi078.stdout:569 2023-12-12T10:15:41.613 INFO:teuthology.orchestra.run.smithi078.stdout:569.out 2023-12-12T10:15:41.614 INFO:teuthology.orchestra.run.smithi078.stdout:570 2023-12-12T10:15:41.614 INFO:teuthology.orchestra.run.smithi078.stdout:570.out 2023-12-12T10:15:41.614 INFO:teuthology.orchestra.run.smithi078.stdout:571 2023-12-12T10:15:41.614 INFO:teuthology.orchestra.run.smithi078.stdout:571.out 2023-12-12T10:15:41.614 INFO:teuthology.orchestra.run.smithi078.stdout:572 2023-12-12T10:15:41.614 INFO:teuthology.orchestra.run.smithi078.stdout:572.out 2023-12-12T10:15:41.614 INFO:teuthology.orchestra.run.smithi078.stdout:573 2023-12-12T10:15:41.614 INFO:teuthology.orchestra.run.smithi078.stdout:573.out 2023-12-12T10:15:41.614 INFO:teuthology.orchestra.run.smithi078.stdout:574 2023-12-12T10:15:41.614 INFO:teuthology.orchestra.run.smithi078.stdout:574.out 2023-12-12T10:15:41.614 INFO:teuthology.orchestra.run.smithi078.stdout:575 2023-12-12T10:15:41.614 INFO:teuthology.orchestra.run.smithi078.stdout:575.out 2023-12-12T10:15:41.614 INFO:teuthology.orchestra.run.smithi078.stdout:576 2023-12-12T10:15:41.614 INFO:teuthology.orchestra.run.smithi078.stdout:576.out 2023-12-12T10:15:41.615 INFO:teuthology.orchestra.run.smithi078.stdout:577 2023-12-12T10:15:41.615 INFO:teuthology.orchestra.run.smithi078.stdout:577.out 2023-12-12T10:15:41.615 INFO:teuthology.orchestra.run.smithi078.stdout:578 2023-12-12T10:15:41.615 INFO:teuthology.orchestra.run.smithi078.stdout:578.out 2023-12-12T10:15:41.615 INFO:teuthology.orchestra.run.smithi078.stdout:579 2023-12-12T10:15:41.615 INFO:teuthology.orchestra.run.smithi078.stdout:579.out 2023-12-12T10:15:41.615 INFO:teuthology.orchestra.run.smithi078.stdout:580 2023-12-12T10:15:41.615 INFO:teuthology.orchestra.run.smithi078.stdout:580.out 2023-12-12T10:15:41.615 INFO:teuthology.orchestra.run.smithi078.stdout:581 2023-12-12T10:15:41.615 INFO:teuthology.orchestra.run.smithi078.stdout:581.out 2023-12-12T10:15:41.615 INFO:teuthology.orchestra.run.smithi078.stdout:582 2023-12-12T10:15:41.615 INFO:teuthology.orchestra.run.smithi078.stdout:582.out 2023-12-12T10:15:41.615 INFO:teuthology.orchestra.run.smithi078.stdout:583 2023-12-12T10:15:41.615 INFO:teuthology.orchestra.run.smithi078.stdout:583.out 2023-12-12T10:15:41.615 INFO:teuthology.orchestra.run.smithi078.stdout:584 2023-12-12T10:15:41.616 INFO:teuthology.orchestra.run.smithi078.stdout:584.out 2023-12-12T10:15:41.616 INFO:teuthology.orchestra.run.smithi078.stdout:585 2023-12-12T10:15:41.616 INFO:teuthology.orchestra.run.smithi078.stdout:585.out 2023-12-12T10:15:41.616 INFO:teuthology.orchestra.run.smithi078.stdout:586 2023-12-12T10:15:41.616 INFO:teuthology.orchestra.run.smithi078.stdout:586.out 2023-12-12T10:15:41.616 INFO:teuthology.orchestra.run.smithi078.stdout:587 2023-12-12T10:15:41.616 INFO:teuthology.orchestra.run.smithi078.stdout:587.out 2023-12-12T10:15:41.616 INFO:teuthology.orchestra.run.smithi078.stdout:588 2023-12-12T10:15:41.616 INFO:teuthology.orchestra.run.smithi078.stdout:588.out 2023-12-12T10:15:41.616 INFO:teuthology.orchestra.run.smithi078.stdout:589 2023-12-12T10:15:41.616 INFO:teuthology.orchestra.run.smithi078.stdout:589.out 2023-12-12T10:15:41.616 INFO:teuthology.orchestra.run.smithi078.stdout:590 2023-12-12T10:15:41.616 INFO:teuthology.orchestra.run.smithi078.stdout:590.out 2023-12-12T10:15:41.616 INFO:teuthology.orchestra.run.smithi078.stdout:591 2023-12-12T10:15:41.616 INFO:teuthology.orchestra.run.smithi078.stdout:591.out 2023-12-12T10:15:41.616 INFO:teuthology.orchestra.run.smithi078.stdout:592 2023-12-12T10:15:41.617 INFO:teuthology.orchestra.run.smithi078.stdout:592.out 2023-12-12T10:15:41.617 INFO:teuthology.orchestra.run.smithi078.stdout:593 2023-12-12T10:15:41.617 INFO:teuthology.orchestra.run.smithi078.stdout:593.out 2023-12-12T10:15:41.617 INFO:teuthology.orchestra.run.smithi078.stdout:594 2023-12-12T10:15:41.617 INFO:teuthology.orchestra.run.smithi078.stdout:594.out 2023-12-12T10:15:41.617 INFO:teuthology.orchestra.run.smithi078.stdout:595 2023-12-12T10:15:41.617 INFO:teuthology.orchestra.run.smithi078.stdout:595.out 2023-12-12T10:15:41.617 INFO:teuthology.orchestra.run.smithi078.stdout:596 2023-12-12T10:15:41.617 INFO:teuthology.orchestra.run.smithi078.stdout:596.out 2023-12-12T10:15:41.617 INFO:teuthology.orchestra.run.smithi078.stdout:597 2023-12-12T10:15:41.617 INFO:teuthology.orchestra.run.smithi078.stdout:597.out 2023-12-12T10:15:41.617 INFO:teuthology.orchestra.run.smithi078.stdout:598 2023-12-12T10:15:41.617 INFO:teuthology.orchestra.run.smithi078.stdout:598.out 2023-12-12T10:15:41.617 INFO:teuthology.orchestra.run.smithi078.stdout:599 2023-12-12T10:15:41.618 INFO:teuthology.orchestra.run.smithi078.stdout:599.out 2023-12-12T10:15:41.618 INFO:teuthology.orchestra.run.smithi078.stdout:600 2023-12-12T10:15:41.618 INFO:teuthology.orchestra.run.smithi078.stdout:600.out 2023-12-12T10:15:41.618 INFO:teuthology.orchestra.run.smithi078.stdout:601 2023-12-12T10:15:41.618 INFO:teuthology.orchestra.run.smithi078.stdout:601.out 2023-12-12T10:15:41.618 INFO:teuthology.orchestra.run.smithi078.stdout:602 2023-12-12T10:15:41.618 INFO:teuthology.orchestra.run.smithi078.stdout:602.out 2023-12-12T10:15:41.618 INFO:teuthology.orchestra.run.smithi078.stdout:603 2023-12-12T10:15:41.618 INFO:teuthology.orchestra.run.smithi078.stdout:603.out 2023-12-12T10:15:41.618 INFO:teuthology.orchestra.run.smithi078.stdout:604 2023-12-12T10:15:41.618 INFO:teuthology.orchestra.run.smithi078.stdout:604.out 2023-12-12T10:15:41.618 INFO:teuthology.orchestra.run.smithi078.stdout:605 2023-12-12T10:15:41.618 INFO:teuthology.orchestra.run.smithi078.stdout:605.out 2023-12-12T10:15:41.618 INFO:teuthology.orchestra.run.smithi078.stdout:606 2023-12-12T10:15:41.618 INFO:teuthology.orchestra.run.smithi078.stdout:606.out 2023-12-12T10:15:41.619 INFO:teuthology.orchestra.run.smithi078.stdout:607 2023-12-12T10:15:41.619 INFO:teuthology.orchestra.run.smithi078.stdout:607.out 2023-12-12T10:15:41.619 INFO:teuthology.orchestra.run.smithi078.stdout:608 2023-12-12T10:15:41.619 INFO:teuthology.orchestra.run.smithi078.stdout:608.out 2023-12-12T10:15:41.619 INFO:teuthology.orchestra.run.smithi078.stdout:609 2023-12-12T10:15:41.619 INFO:teuthology.orchestra.run.smithi078.stdout:609.out 2023-12-12T10:15:41.619 INFO:teuthology.orchestra.run.smithi078.stdout:610 2023-12-12T10:15:41.619 INFO:teuthology.orchestra.run.smithi078.stdout:610.out 2023-12-12T10:15:41.619 INFO:teuthology.orchestra.run.smithi078.stdout:611 2023-12-12T10:15:41.619 INFO:teuthology.orchestra.run.smithi078.stdout:611.out 2023-12-12T10:15:41.619 INFO:teuthology.orchestra.run.smithi078.stdout:612 2023-12-12T10:15:41.619 INFO:teuthology.orchestra.run.smithi078.stdout:612.out 2023-12-12T10:15:41.619 INFO:teuthology.orchestra.run.smithi078.stdout:613 2023-12-12T10:15:41.619 INFO:teuthology.orchestra.run.smithi078.stdout:613.out 2023-12-12T10:15:41.619 INFO:teuthology.orchestra.run.smithi078.stdout:614 2023-12-12T10:15:41.620 INFO:teuthology.orchestra.run.smithi078.stdout:614.out 2023-12-12T10:15:41.620 INFO:teuthology.orchestra.run.smithi078.stdout:615 2023-12-12T10:15:41.620 INFO:teuthology.orchestra.run.smithi078.stdout:615.out 2023-12-12T10:15:41.620 INFO:teuthology.orchestra.run.smithi078.stdout:616 2023-12-12T10:15:41.620 INFO:teuthology.orchestra.run.smithi078.stdout:616.out 2023-12-12T10:15:41.620 INFO:teuthology.orchestra.run.smithi078.stdout:617 2023-12-12T10:15:41.620 INFO:teuthology.orchestra.run.smithi078.stdout:617.out 2023-12-12T10:15:41.620 INFO:teuthology.orchestra.run.smithi078.stdout:618 2023-12-12T10:15:41.620 INFO:teuthology.orchestra.run.smithi078.stdout:618.out 2023-12-12T10:15:41.620 INFO:teuthology.orchestra.run.smithi078.stdout:619 2023-12-12T10:15:41.620 INFO:teuthology.orchestra.run.smithi078.stdout:619.out 2023-12-12T10:15:41.620 INFO:teuthology.orchestra.run.smithi078.stdout:620 2023-12-12T10:15:41.620 INFO:teuthology.orchestra.run.smithi078.stdout:620.out 2023-12-12T10:15:41.620 INFO:teuthology.orchestra.run.smithi078.stdout:621 2023-12-12T10:15:41.620 INFO:teuthology.orchestra.run.smithi078.stdout:621.out 2023-12-12T10:15:41.621 INFO:teuthology.orchestra.run.smithi078.stdout:622 2023-12-12T10:15:41.621 INFO:teuthology.orchestra.run.smithi078.stdout:622.out 2023-12-12T10:15:41.621 INFO:teuthology.orchestra.run.smithi078.stdout:623 2023-12-12T10:15:41.621 INFO:teuthology.orchestra.run.smithi078.stdout:623.out 2023-12-12T10:15:41.621 INFO:teuthology.orchestra.run.smithi078.stdout:624 2023-12-12T10:15:41.621 INFO:teuthology.orchestra.run.smithi078.stdout:624.out 2023-12-12T10:15:41.621 INFO:teuthology.orchestra.run.smithi078.stdout:625 2023-12-12T10:15:41.621 INFO:teuthology.orchestra.run.smithi078.stdout:625.out 2023-12-12T10:15:41.621 INFO:teuthology.orchestra.run.smithi078.stdout:626 2023-12-12T10:15:41.621 INFO:teuthology.orchestra.run.smithi078.stdout:626.out 2023-12-12T10:15:41.621 INFO:teuthology.orchestra.run.smithi078.stdout:627 2023-12-12T10:15:41.621 INFO:teuthology.orchestra.run.smithi078.stdout:627.out 2023-12-12T10:15:41.621 INFO:teuthology.orchestra.run.smithi078.stdout:628 2023-12-12T10:15:41.621 INFO:teuthology.orchestra.run.smithi078.stdout:628.out 2023-12-12T10:15:41.622 INFO:teuthology.orchestra.run.smithi078.stdout:629 2023-12-12T10:15:41.622 INFO:teuthology.orchestra.run.smithi078.stdout:629.out 2023-12-12T10:15:41.622 INFO:teuthology.orchestra.run.smithi078.stdout:630 2023-12-12T10:15:41.622 INFO:teuthology.orchestra.run.smithi078.stdout:630.out 2023-12-12T10:15:41.622 INFO:teuthology.orchestra.run.smithi078.stdout:631 2023-12-12T10:15:41.622 INFO:teuthology.orchestra.run.smithi078.stdout:631.out 2023-12-12T10:15:41.622 INFO:teuthology.orchestra.run.smithi078.stdout:632 2023-12-12T10:15:41.622 INFO:teuthology.orchestra.run.smithi078.stdout:632.out 2023-12-12T10:15:41.622 INFO:teuthology.orchestra.run.smithi078.stdout:633 2023-12-12T10:15:41.622 INFO:teuthology.orchestra.run.smithi078.stdout:633.out 2023-12-12T10:15:41.622 INFO:teuthology.orchestra.run.smithi078.stdout:634 2023-12-12T10:15:41.622 INFO:teuthology.orchestra.run.smithi078.stdout:634.out 2023-12-12T10:15:41.622 INFO:teuthology.orchestra.run.smithi078.stdout:635 2023-12-12T10:15:41.622 INFO:teuthology.orchestra.run.smithi078.stdout:635.out 2023-12-12T10:15:41.622 INFO:teuthology.orchestra.run.smithi078.stdout:636 2023-12-12T10:15:41.623 INFO:teuthology.orchestra.run.smithi078.stdout:636.out 2023-12-12T10:15:41.623 INFO:teuthology.orchestra.run.smithi078.stdout:637 2023-12-12T10:15:41.623 INFO:teuthology.orchestra.run.smithi078.stdout:637.out 2023-12-12T10:15:41.623 INFO:teuthology.orchestra.run.smithi078.stdout:638 2023-12-12T10:15:41.623 INFO:teuthology.orchestra.run.smithi078.stdout:638.out 2023-12-12T10:15:41.623 INFO:teuthology.orchestra.run.smithi078.stdout:639 2023-12-12T10:15:41.623 INFO:teuthology.orchestra.run.smithi078.stdout:639.out 2023-12-12T10:15:41.623 INFO:teuthology.orchestra.run.smithi078.stdout:640 2023-12-12T10:15:41.623 INFO:teuthology.orchestra.run.smithi078.stdout:640.out 2023-12-12T10:15:41.623 INFO:teuthology.orchestra.run.smithi078.stdout:641 2023-12-12T10:15:41.623 INFO:teuthology.orchestra.run.smithi078.stdout:641.out 2023-12-12T10:15:41.623 INFO:teuthology.orchestra.run.smithi078.stdout:642 2023-12-12T10:15:41.623 INFO:teuthology.orchestra.run.smithi078.stdout:642.out 2023-12-12T10:15:41.623 INFO:teuthology.orchestra.run.smithi078.stdout:643 2023-12-12T10:15:41.623 INFO:teuthology.orchestra.run.smithi078.stdout:643.out 2023-12-12T10:15:41.623 INFO:teuthology.orchestra.run.smithi078.stdout:644 2023-12-12T10:15:41.624 INFO:teuthology.orchestra.run.smithi078.stdout:644.out 2023-12-12T10:15:41.624 INFO:teuthology.orchestra.run.smithi078.stdout:645 2023-12-12T10:15:41.624 INFO:teuthology.orchestra.run.smithi078.stdout:645.out 2023-12-12T10:15:41.624 INFO:teuthology.orchestra.run.smithi078.stdout:646 2023-12-12T10:15:41.624 INFO:teuthology.orchestra.run.smithi078.stdout:646.out 2023-12-12T10:15:41.624 INFO:teuthology.orchestra.run.smithi078.stdout:647 2023-12-12T10:15:41.624 INFO:teuthology.orchestra.run.smithi078.stdout:647.out 2023-12-12T10:15:41.624 INFO:teuthology.orchestra.run.smithi078.stdout:648 2023-12-12T10:15:41.624 INFO:teuthology.orchestra.run.smithi078.stdout:648.out 2023-12-12T10:15:41.624 INFO:teuthology.orchestra.run.smithi078.stdout:649 2023-12-12T10:15:41.624 INFO:teuthology.orchestra.run.smithi078.stdout:649.out 2023-12-12T10:15:41.624 INFO:teuthology.orchestra.run.smithi078.stdout:650 2023-12-12T10:15:41.624 INFO:teuthology.orchestra.run.smithi078.stdout:650.out 2023-12-12T10:15:41.624 INFO:teuthology.orchestra.run.smithi078.stdout:651 2023-12-12T10:15:41.624 INFO:teuthology.orchestra.run.smithi078.stdout:651.out 2023-12-12T10:15:41.625 INFO:teuthology.orchestra.run.smithi078.stdout:652 2023-12-12T10:15:41.625 INFO:teuthology.orchestra.run.smithi078.stdout:652.out 2023-12-12T10:15:41.625 INFO:teuthology.orchestra.run.smithi078.stdout:653 2023-12-12T10:15:41.625 INFO:teuthology.orchestra.run.smithi078.stdout:653.out 2023-12-12T10:15:41.625 INFO:teuthology.orchestra.run.smithi078.stdout:654 2023-12-12T10:15:41.625 INFO:teuthology.orchestra.run.smithi078.stdout:654.out 2023-12-12T10:15:41.625 INFO:teuthology.orchestra.run.smithi078.stdout:655 2023-12-12T10:15:41.625 INFO:teuthology.orchestra.run.smithi078.stdout:655.out 2023-12-12T10:15:41.626 INFO:teuthology.orchestra.run.smithi078.stdout:656 2023-12-12T10:15:41.626 INFO:teuthology.orchestra.run.smithi078.stdout:656.out 2023-12-12T10:15:41.626 INFO:teuthology.orchestra.run.smithi078.stdout:657 2023-12-12T10:15:41.626 INFO:teuthology.orchestra.run.smithi078.stdout:657.out 2023-12-12T10:15:41.626 INFO:teuthology.orchestra.run.smithi078.stdout:658 2023-12-12T10:15:41.626 INFO:teuthology.orchestra.run.smithi078.stdout:658.out 2023-12-12T10:15:41.626 INFO:teuthology.orchestra.run.smithi078.stdout:659 2023-12-12T10:15:41.626 INFO:teuthology.orchestra.run.smithi078.stdout:659.out 2023-12-12T10:15:41.626 INFO:teuthology.orchestra.run.smithi078.stdout:660 2023-12-12T10:15:41.626 INFO:teuthology.orchestra.run.smithi078.stdout:660.out 2023-12-12T10:15:41.627 INFO:teuthology.orchestra.run.smithi078.stdout:661 2023-12-12T10:15:41.627 INFO:teuthology.orchestra.run.smithi078.stdout:661.out 2023-12-12T10:15:41.627 INFO:teuthology.orchestra.run.smithi078.stdout:662 2023-12-12T10:15:41.627 INFO:teuthology.orchestra.run.smithi078.stdout:662.out 2023-12-12T10:15:41.627 INFO:teuthology.orchestra.run.smithi078.stdout:663 2023-12-12T10:15:41.627 INFO:teuthology.orchestra.run.smithi078.stdout:663.out 2023-12-12T10:15:41.627 INFO:teuthology.orchestra.run.smithi078.stdout:664 2023-12-12T10:15:41.627 INFO:teuthology.orchestra.run.smithi078.stdout:664.out 2023-12-12T10:15:41.627 INFO:teuthology.orchestra.run.smithi078.stdout:665 2023-12-12T10:15:41.627 INFO:teuthology.orchestra.run.smithi078.stdout:665.out 2023-12-12T10:15:41.627 INFO:teuthology.orchestra.run.smithi078.stdout:666 2023-12-12T10:15:41.627 INFO:teuthology.orchestra.run.smithi078.stdout:666.out 2023-12-12T10:15:41.627 INFO:teuthology.orchestra.run.smithi078.stdout:667 2023-12-12T10:15:41.627 INFO:teuthology.orchestra.run.smithi078.stdout:667.out 2023-12-12T10:15:41.627 INFO:teuthology.orchestra.run.smithi078.stdout:668 2023-12-12T10:15:41.628 INFO:teuthology.orchestra.run.smithi078.stdout:668.out 2023-12-12T10:15:41.628 INFO:teuthology.orchestra.run.smithi078.stdout:669 2023-12-12T10:15:41.628 INFO:teuthology.orchestra.run.smithi078.stdout:669.out 2023-12-12T10:15:41.628 INFO:teuthology.orchestra.run.smithi078.stdout:670 2023-12-12T10:15:41.628 INFO:teuthology.orchestra.run.smithi078.stdout:670.out 2023-12-12T10:15:41.628 INFO:teuthology.orchestra.run.smithi078.stdout:671 2023-12-12T10:15:41.628 INFO:teuthology.orchestra.run.smithi078.stdout:671.out 2023-12-12T10:15:41.628 INFO:teuthology.orchestra.run.smithi078.stdout:672 2023-12-12T10:15:41.628 INFO:teuthology.orchestra.run.smithi078.stdout:672.out 2023-12-12T10:15:41.628 INFO:teuthology.orchestra.run.smithi078.stdout:673 2023-12-12T10:15:41.628 INFO:teuthology.orchestra.run.smithi078.stdout:673.out 2023-12-12T10:15:41.628 INFO:teuthology.orchestra.run.smithi078.stdout:674 2023-12-12T10:15:41.628 INFO:teuthology.orchestra.run.smithi078.stdout:674.out 2023-12-12T10:15:41.628 INFO:teuthology.orchestra.run.smithi078.stdout:675 2023-12-12T10:15:41.628 INFO:teuthology.orchestra.run.smithi078.stdout:675.out 2023-12-12T10:15:41.629 INFO:teuthology.orchestra.run.smithi078.stdout:676 2023-12-12T10:15:41.629 INFO:teuthology.orchestra.run.smithi078.stdout:676.out 2023-12-12T10:15:41.629 INFO:teuthology.orchestra.run.smithi078.stdout:677 2023-12-12T10:15:41.629 INFO:teuthology.orchestra.run.smithi078.stdout:677.out 2023-12-12T10:15:41.629 INFO:teuthology.orchestra.run.smithi078.stdout:678 2023-12-12T10:15:41.629 INFO:teuthology.orchestra.run.smithi078.stdout:678.out 2023-12-12T10:15:41.629 INFO:teuthology.orchestra.run.smithi078.stdout:679 2023-12-12T10:15:41.629 INFO:teuthology.orchestra.run.smithi078.stdout:679.out 2023-12-12T10:15:41.629 INFO:teuthology.orchestra.run.smithi078.stdout:680 2023-12-12T10:15:41.629 INFO:teuthology.orchestra.run.smithi078.stdout:680.out 2023-12-12T10:15:41.629 INFO:teuthology.orchestra.run.smithi078.stdout:681 2023-12-12T10:15:41.629 INFO:teuthology.orchestra.run.smithi078.stdout:681.out 2023-12-12T10:15:41.629 INFO:teuthology.orchestra.run.smithi078.stdout:682 2023-12-12T10:15:41.629 INFO:teuthology.orchestra.run.smithi078.stdout:682.out 2023-12-12T10:15:41.629 INFO:teuthology.orchestra.run.smithi078.stdout:683 2023-12-12T10:15:41.630 INFO:teuthology.orchestra.run.smithi078.stdout:683.out 2023-12-12T10:15:41.630 INFO:teuthology.orchestra.run.smithi078.stdout:684 2023-12-12T10:15:41.630 INFO:teuthology.orchestra.run.smithi078.stdout:684.out 2023-12-12T10:15:41.630 INFO:teuthology.orchestra.run.smithi078.stdout:685 2023-12-12T10:15:41.630 INFO:teuthology.orchestra.run.smithi078.stdout:685.out 2023-12-12T10:15:41.630 INFO:teuthology.orchestra.run.smithi078.stdout:686 2023-12-12T10:15:41.630 INFO:teuthology.orchestra.run.smithi078.stdout:686.out 2023-12-12T10:15:41.630 INFO:teuthology.orchestra.run.smithi078.stdout:687 2023-12-12T10:15:41.630 INFO:teuthology.orchestra.run.smithi078.stdout:687.out 2023-12-12T10:15:41.630 INFO:teuthology.orchestra.run.smithi078.stdout:688 2023-12-12T10:15:41.630 INFO:teuthology.orchestra.run.smithi078.stdout:688.out 2023-12-12T10:15:41.630 INFO:teuthology.orchestra.run.smithi078.stdout:689 2023-12-12T10:15:41.630 INFO:teuthology.orchestra.run.smithi078.stdout:689.out 2023-12-12T10:15:41.630 INFO:teuthology.orchestra.run.smithi078.stdout:690 2023-12-12T10:15:41.631 INFO:teuthology.orchestra.run.smithi078.stdout:690.out 2023-12-12T10:15:41.631 INFO:teuthology.orchestra.run.smithi078.stdout:691 2023-12-12T10:15:41.631 INFO:teuthology.orchestra.run.smithi078.stdout:691.out 2023-12-12T10:15:41.631 INFO:teuthology.orchestra.run.smithi078.stdout:692 2023-12-12T10:15:41.631 INFO:teuthology.orchestra.run.smithi078.stdout:692.out 2023-12-12T10:15:41.631 INFO:teuthology.orchestra.run.smithi078.stdout:693 2023-12-12T10:15:41.631 INFO:teuthology.orchestra.run.smithi078.stdout:693.out 2023-12-12T10:15:41.631 INFO:teuthology.orchestra.run.smithi078.stdout:694 2023-12-12T10:15:41.631 INFO:teuthology.orchestra.run.smithi078.stdout:694.out 2023-12-12T10:15:41.631 INFO:teuthology.orchestra.run.smithi078.stdout:695 2023-12-12T10:15:41.631 INFO:teuthology.orchestra.run.smithi078.stdout:695.out 2023-12-12T10:15:41.631 INFO:teuthology.orchestra.run.smithi078.stdout:696 2023-12-12T10:15:41.631 INFO:teuthology.orchestra.run.smithi078.stdout:696.out 2023-12-12T10:15:41.631 INFO:teuthology.orchestra.run.smithi078.stdout:697 2023-12-12T10:15:41.631 INFO:teuthology.orchestra.run.smithi078.stdout:697.out 2023-12-12T10:15:41.631 INFO:teuthology.orchestra.run.smithi078.stdout:698 2023-12-12T10:15:41.632 INFO:teuthology.orchestra.run.smithi078.stdout:698.out 2023-12-12T10:15:41.632 INFO:teuthology.orchestra.run.smithi078.stdout:699 2023-12-12T10:15:41.632 INFO:teuthology.orchestra.run.smithi078.stdout:699.out 2023-12-12T10:15:41.632 INFO:teuthology.orchestra.run.smithi078.stdout:700 2023-12-12T10:15:41.632 INFO:teuthology.orchestra.run.smithi078.stdout:700.out 2023-12-12T10:15:41.632 INFO:teuthology.orchestra.run.smithi078.stdout:701 2023-12-12T10:15:41.632 INFO:teuthology.orchestra.run.smithi078.stdout:701.out 2023-12-12T10:15:41.632 INFO:teuthology.orchestra.run.smithi078.stdout:702 2023-12-12T10:15:41.632 INFO:teuthology.orchestra.run.smithi078.stdout:702.out 2023-12-12T10:15:41.632 INFO:teuthology.orchestra.run.smithi078.stdout:703 2023-12-12T10:15:41.632 INFO:teuthology.orchestra.run.smithi078.stdout:703.out 2023-12-12T10:15:41.632 INFO:teuthology.orchestra.run.smithi078.stdout:704 2023-12-12T10:15:41.632 INFO:teuthology.orchestra.run.smithi078.stdout:704.out 2023-12-12T10:15:41.632 INFO:teuthology.orchestra.run.smithi078.stdout:705 2023-12-12T10:15:41.632 INFO:teuthology.orchestra.run.smithi078.stdout:705.out 2023-12-12T10:15:41.633 INFO:teuthology.orchestra.run.smithi078.stdout:706 2023-12-12T10:15:41.633 INFO:teuthology.orchestra.run.smithi078.stdout:706.out 2023-12-12T10:15:41.633 INFO:teuthology.orchestra.run.smithi078.stdout:707 2023-12-12T10:15:41.633 INFO:teuthology.orchestra.run.smithi078.stdout:707.out 2023-12-12T10:15:41.633 INFO:teuthology.orchestra.run.smithi078.stdout:708 2023-12-12T10:15:41.633 INFO:teuthology.orchestra.run.smithi078.stdout:708.out 2023-12-12T10:15:41.633 INFO:teuthology.orchestra.run.smithi078.stdout:709 2023-12-12T10:15:41.633 INFO:teuthology.orchestra.run.smithi078.stdout:709.out 2023-12-12T10:15:41.633 INFO:teuthology.orchestra.run.smithi078.stdout:710 2023-12-12T10:15:41.633 INFO:teuthology.orchestra.run.smithi078.stdout:710.out 2023-12-12T10:15:41.633 INFO:teuthology.orchestra.run.smithi078.stdout:711 2023-12-12T10:15:41.633 INFO:teuthology.orchestra.run.smithi078.stdout:711.out 2023-12-12T10:15:41.633 INFO:teuthology.orchestra.run.smithi078.stdout:712 2023-12-12T10:15:41.633 INFO:teuthology.orchestra.run.smithi078.stdout:712.out 2023-12-12T10:15:41.633 INFO:teuthology.orchestra.run.smithi078.stdout:713 2023-12-12T10:15:41.634 INFO:teuthology.orchestra.run.smithi078.stdout:713.out 2023-12-12T10:15:41.634 INFO:teuthology.orchestra.run.smithi078.stdout:714 2023-12-12T10:15:41.634 INFO:teuthology.orchestra.run.smithi078.stdout:714.out 2023-12-12T10:15:41.634 INFO:teuthology.orchestra.run.smithi078.stdout:715 2023-12-12T10:15:41.634 INFO:teuthology.orchestra.run.smithi078.stdout:715.out 2023-12-12T10:15:41.634 INFO:teuthology.orchestra.run.smithi078.stdout:716 2023-12-12T10:15:41.634 INFO:teuthology.orchestra.run.smithi078.stdout:716.out 2023-12-12T10:15:41.634 INFO:teuthology.orchestra.run.smithi078.stdout:717 2023-12-12T10:15:41.634 INFO:teuthology.orchestra.run.smithi078.stdout:717.out 2023-12-12T10:15:41.634 INFO:teuthology.orchestra.run.smithi078.stdout:718 2023-12-12T10:15:41.634 INFO:teuthology.orchestra.run.smithi078.stdout:718.out 2023-12-12T10:15:41.634 INFO:teuthology.orchestra.run.smithi078.stdout:719 2023-12-12T10:15:41.634 INFO:teuthology.orchestra.run.smithi078.stdout:719.out 2023-12-12T10:15:41.634 INFO:teuthology.orchestra.run.smithi078.stdout:720 2023-12-12T10:15:41.635 INFO:teuthology.orchestra.run.smithi078.stdout:720.out 2023-12-12T10:15:41.635 INFO:teuthology.orchestra.run.smithi078.stdout:721 2023-12-12T10:15:41.635 INFO:teuthology.orchestra.run.smithi078.stdout:721.out 2023-12-12T10:15:41.635 INFO:teuthology.orchestra.run.smithi078.stdout:722 2023-12-12T10:15:41.635 INFO:teuthology.orchestra.run.smithi078.stdout:722.out 2023-12-12T10:15:41.635 INFO:teuthology.orchestra.run.smithi078.stdout:723 2023-12-12T10:15:41.635 INFO:teuthology.orchestra.run.smithi078.stdout:723.out 2023-12-12T10:15:41.635 INFO:teuthology.orchestra.run.smithi078.stdout:724 2023-12-12T10:15:41.635 INFO:teuthology.orchestra.run.smithi078.stdout:724.out 2023-12-12T10:15:41.635 INFO:teuthology.orchestra.run.smithi078.stdout:725 2023-12-12T10:15:41.635 INFO:teuthology.orchestra.run.smithi078.stdout:725.out 2023-12-12T10:15:41.635 INFO:teuthology.orchestra.run.smithi078.stdout:726 2023-12-12T10:15:41.635 INFO:teuthology.orchestra.run.smithi078.stdout:726.out 2023-12-12T10:15:41.635 INFO:teuthology.orchestra.run.smithi078.stdout:727 2023-12-12T10:15:41.635 INFO:teuthology.orchestra.run.smithi078.stdout:727.out 2023-12-12T10:15:41.636 INFO:teuthology.orchestra.run.smithi078.stdout:728 2023-12-12T10:15:41.636 INFO:teuthology.orchestra.run.smithi078.stdout:728.out 2023-12-12T10:15:41.636 INFO:teuthology.orchestra.run.smithi078.stdout:729 2023-12-12T10:15:41.636 INFO:teuthology.orchestra.run.smithi078.stdout:729.out 2023-12-12T10:15:41.636 INFO:teuthology.orchestra.run.smithi078.stdout:730 2023-12-12T10:15:41.636 INFO:teuthology.orchestra.run.smithi078.stdout:730.out 2023-12-12T10:15:41.636 INFO:teuthology.orchestra.run.smithi078.stdout:731 2023-12-12T10:15:41.636 INFO:teuthology.orchestra.run.smithi078.stdout:731.out 2023-12-12T10:15:41.636 INFO:teuthology.orchestra.run.smithi078.stdout:732 2023-12-12T10:15:41.636 INFO:teuthology.orchestra.run.smithi078.stdout:732.out 2023-12-12T10:15:41.636 INFO:teuthology.orchestra.run.smithi078.stdout:733 2023-12-12T10:15:41.636 INFO:teuthology.orchestra.run.smithi078.stdout:733.out 2023-12-12T10:15:41.636 INFO:teuthology.orchestra.run.smithi078.stdout:group.list 2023-12-12T10:15:41.636 INFO:teuthology.orchestra.run.smithi078.stdout:Makefile 2023-12-12T10:15:41.638 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/001) 2023-12-12T10:15:42.018 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T10:15:42.028 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T10:15:42.028 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:15:46.233 INFO:teuthology.orchestra.run.smithi078.stdout:generic/001 4s 2023-12-12T10:15:46.245 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/001 2023-12-12T10:15:46.245 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T10:15:46.251 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:15:46.254 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi078.stderr:ceph-fuse[50160]: fuse finished with error 0 and tester_r 0 2023-12-12T10:15:46.273 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T10:15:46.273 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/002) 2023-12-12T10:15:46.645 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T10:15:46.656 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T10:15:46.656 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:15:47.417 INFO:teuthology.orchestra.run.smithi078.stdout:generic/002 1s 2023-12-12T10:15:47.430 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/002 2023-12-12T10:15:47.430 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T10:15:47.436 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:15:47.463 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T10:15:47.463 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/003) 2023-12-12T10:15:47.837 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T10:15:47.848 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T10:15:47.848 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:15:48.126 INFO:teuthology.orchestra.run.smithi078.stdout:generic/003 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T10:15:48.134 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/003 2023-12-12T10:15:48.134 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/003 2023-12-12T10:15:48.134 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T10:15:48.140 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:15:48.161 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T10:15:48.161 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/004) 2023-12-12T10:15:48.523 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T10:15:48.533 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T10:15:48.533 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:15:48.833 INFO:teuthology.orchestra.run.smithi078.stdout:generic/004 [not run] O_TMPFILE is not supported 2023-12-12T10:15:48.842 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/004 2023-12-12T10:15:48.843 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/004 2023-12-12T10:15:48.843 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T10:15:48.848 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:15:48.868 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T10:15:48.868 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/005) 2023-12-12T10:15:49.226 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T10:15:49.236 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T10:15:49.237 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:15:50.147 INFO:teuthology.orchestra.run.smithi078.stdout:generic/005 1s 2023-12-12T10:15:50.159 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/005 2023-12-12T10:15:50.159 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T10:15:50.166 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:15:50.188 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T10:15:50.189 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/006) 2023-12-12T10:15:50.609 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T10:15:50.621 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T10:15:50.621 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:16:07.836 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T10:16:07.840 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T10:16:24.366 INFO:teuthology.orchestra.run.smithi078.stdout:generic/006 34s 2023-12-12T10:16:24.381 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/006 2023-12-12T10:16:24.381 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T10:16:24.389 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:16:24.472 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T10:16:24.472 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/007) 2023-12-12T10:16:24.897 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T10:16:24.907 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T10:16:24.907 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:16:37.893 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T10:16:37.897 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T10:17:07.955 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T10:17:07.961 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T10:17:39.204 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T10:17:39.209 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T10:17:44.625 INFO:teuthology.orchestra.run.smithi078.stdout:generic/007 80s 2023-12-12T10:17:44.637 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/007 2023-12-12T10:17:44.637 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T10:17:44.646 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:17:44.691 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T10:17:44.691 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/008) 2023-12-12T10:17:45.084 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T10:17:45.095 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T10:17:45.095 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:17:46.604 INFO:teuthology.orchestra.run.smithi078.stdout:generic/008 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-12-12T10:17:46.612 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/008 2023-12-12T10:17:46.612 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/008 2023-12-12T10:17:46.612 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T10:17:46.618 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:17:46.640 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T10:17:46.640 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/009) 2023-12-12T10:17:47.001 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T10:17:47.011 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T10:17:47.011 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:17:48.421 INFO:teuthology.orchestra.run.smithi078.stdout:generic/009 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-12-12T10:17:48.429 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/009 2023-12-12T10:17:48.429 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/009 2023-12-12T10:17:48.429 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T10:17:48.435 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:17:48.455 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T10:17:48.456 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/010) 2023-12-12T10:17:48.817 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T10:17:48.828 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T10:17:48.828 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:17:49.107 INFO:teuthology.orchestra.run.smithi078.stdout:generic/010 [not run] /tmp/tmp.GmWnCxuSqIxfstests-dev/src/dbtest not built 2023-12-12T10:17:49.116 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/010 2023-12-12T10:17:49.117 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/010 2023-12-12T10:17:49.117 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T10:17:49.122 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:17:49.143 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T10:17:49.143 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/011) 2023-12-12T10:17:49.575 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T10:17:49.585 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T10:17:49.586 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:18:09.265 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T10:18:09.270 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T10:18:31.066 INFO:teuthology.orchestra.run.smithi078.stdout:generic/011 42s 2023-12-12T10:18:31.090 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/011 2023-12-12T10:18:31.090 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T10:18:31.096 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:18:31.129 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T10:18:31.130 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/012) 2023-12-12T10:18:31.523 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T10:18:31.534 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T10:18:31.534 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:18:33.108 INFO:teuthology.orchestra.run.smithi078.stdout:generic/012 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-12-12T10:18:33.116 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/012 2023-12-12T10:18:33.116 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/012 2023-12-12T10:18:33.116 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T10:18:33.123 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:18:33.160 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T10:18:33.161 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/013) 2023-12-12T10:18:33.552 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T10:18:33.563 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T10:18:33.563 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:18:39.329 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T10:18:39.334 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T10:19:09.454 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T10:19:09.462 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T10:19:39.886 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T10:19:39.893 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T10:20:10.894 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T10:20:10.899 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T10:20:27.706 INFO:teuthology.orchestra.run.smithi078.stdout:generic/013 114s 2023-12-12T10:20:28.951 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/013 2023-12-12T10:20:28.951 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T10:20:28.961 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:20:28.995 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T10:20:28.996 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/014) 2023-12-12T10:20:29.604 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T10:20:29.621 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T10:20:29.621 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:20:42.618 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T10:20:42.623 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T10:20:42.687 INFO:tasks.ceph.mds.c.smithi078.stderr:2023-12-12T10:20:42.679+0000 7f93f9020640 -1 Fail to open '/proc/94197/cmdline' error = (2) No such file or directory 2023-12-12T10:20:42.687 INFO:tasks.ceph.mds.c.smithi078.stderr:2023-12-12T10:20:42.679+0000 7f93f9020640 -1 received signal: Hangup from (PID: 94197) UID: 0 2023-12-12T10:20:42.688 INFO:tasks.ceph.mds.a.smithi078.stderr:2023-12-12T10:20:42.679+0000 7fd9e625e640 -1 Fail to open '/proc/94197/cmdline' error = (2) No such file or directory 2023-12-12T10:20:42.688 INFO:tasks.ceph.mds.a.smithi078.stderr:2023-12-12T10:20:42.679+0000 7fd9e625e640 -1 received signal: Hangup from (PID: 94197) UID: 0 2023-12-12T10:24:03.979 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T10:24:03.986 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T10:24:34.166 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T10:24:34.171 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T10:25:04.274 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T10:25:04.281 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T10:25:30.808 INFO:teuthology.orchestra.run.smithi078.stdout:generic/014 301s 2023-12-12T10:25:30.848 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/014 2023-12-12T10:25:30.848 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T10:25:30.858 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:25:30.892 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T10:25:30.892 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/015) 2023-12-12T10:25:31.540 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T10:25:31.556 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T10:25:31.556 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:25:31.943 INFO:teuthology.orchestra.run.smithi078.stdout:generic/015 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T10:25:31.957 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/015 2023-12-12T10:25:31.958 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/015 2023-12-12T10:25:31.958 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T10:25:31.967 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:25:31.995 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T10:25:31.995 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/016) 2023-12-12T10:25:32.548 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T10:25:32.563 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T10:25:32.563 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:25:34.380 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T10:25:34.384 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T10:25:36.217 INFO:teuthology.orchestra.run.smithi078.stdout:generic/016 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-12-12T10:25:36.231 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/016 2023-12-12T10:25:36.231 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/016 2023-12-12T10:25:36.231 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T10:25:36.242 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:25:36.349 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T10:25:36.349 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/017) 2023-12-12T10:25:37.038 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T10:25:37.055 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T10:25:37.055 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:25:37.466 INFO:teuthology.orchestra.run.smithi078.stdout:generic/017 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T10:25:37.479 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/017 2023-12-12T10:25:37.480 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/017 2023-12-12T10:25:37.480 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T10:25:37.490 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:25:37.523 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T10:25:37.523 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/018) 2023-12-12T10:25:38.041 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T10:25:38.055 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T10:25:38.055 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:25:38.476 INFO:teuthology.orchestra.run.smithi078.stdout:generic/018 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T10:25:38.486 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/018 2023-12-12T10:25:38.487 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/018 2023-12-12T10:25:38.487 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T10:25:38.496 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:25:38.525 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T10:25:38.525 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/019) 2023-12-12T10:25:39.070 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T10:25:39.085 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T10:25:39.085 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:25:39.479 INFO:teuthology.orchestra.run.smithi078.stdout:generic/019 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T10:25:39.490 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/019 2023-12-12T10:25:39.490 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/019 2023-12-12T10:25:39.491 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T10:25:39.499 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:25:39.528 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T10:25:39.529 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/020) 2023-12-12T10:25:40.065 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T10:25:40.080 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T10:25:40.080 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:25:56.004 INFO:teuthology.orchestra.run.smithi078.stdout:generic/020 - output mismatch (see /tmp/tmp.GmWnCxuSqIxfstests-dev/results//generic/020.out.bad) 2023-12-12T10:25:56.015 INFO:teuthology.orchestra.run.smithi078.stdout: --- tests/generic/020.out 2023-12-12 10:13:40.368817637 +0000 2023-12-12T10:25:56.015 INFO:teuthology.orchestra.run.smithi078.stdout: +++ /tmp/tmp.GmWnCxuSqIxfstests-dev/results//generic/020.out.bad 2023-12-12 10:25:55.996128114 +0000 2023-12-12T10:25:56.015 INFO:teuthology.orchestra.run.smithi078.stdout: @@ -47,9 +47,13 @@ 2023-12-12T10:25:56.015 INFO:teuthology.orchestra.run.smithi078.stdout: user.snrub="fish2\012" 2023-12-12T10:25:56.015 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:25:56.015 INFO:teuthology.orchestra.run.smithi078.stdout: *** really long value 2023-12-12T10:25:56.015 INFO:teuthology.orchestra.run.smithi078.stdout: -0000000 00 2023-12-12T10:25:56.015 INFO:teuthology.orchestra.run.smithi078.stdout: -* 2023-12-12T10:25:56.016 INFO:teuthology.orchestra.run.smithi078.stdout: -ATTRSIZE 2023-12-12T10:25:56.016 INFO:teuthology.orchestra.run.smithi078.stdout: +attr_set: No space left on device 2023-12-12T10:25:56.016 INFO:teuthology.orchestra.run.smithi078.stdout: +Could not set "long_attr" for 2023-12-12T10:25:56.016 INFO:teuthology.orchestra.run.smithi078.stdout: +attr_get: No data available 2023-12-12T10:25:56.016 INFO:teuthology.orchestra.run.smithi078.stdout: +Could not get "long_attr" for 2023-12-12T10:25:56.016 INFO:teuthology.orchestra.run.smithi078.stdout: +0000000 2023-12-12T10:25:56.016 INFO:teuthology.orchestra.run.smithi078.stdout: +attr_remove: No data available 2023-12-12T10:25:56.016 INFO:teuthology.orchestra.run.smithi078.stdout: +Could not remove "long_attr" for 2023-12-12T10:25:56.016 INFO:teuthology.orchestra.run.smithi078.stdout: *** set/get/remove really long names (expect failure) 2023-12-12T10:25:56.016 INFO:teuthology.orchestra.run.smithi078.stdout: attr_set: Invalid argument 2023-12-12T10:25:56.016 INFO:teuthology.orchestra.run.smithi078.stdout: Could not set "XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX" for 2023-12-12T10:25:56.022 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/020 2023-12-12T10:25:56.022 INFO:teuthology.orchestra.run.smithi078.stdout:Failures: generic/020 2023-12-12T10:25:56.022 INFO:teuthology.orchestra.run.smithi078.stdout:Failed 1 of 1 tests 2023-12-12T10:25:56.030 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:25:56.061 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-12T10:25:56.061 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-12-12T10:25:56.061 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-12-12T10:25:56.062 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/021) 2023-12-12T10:25:56.784 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T10:25:56.801 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T10:25:56.802 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:25:59.347 INFO:teuthology.orchestra.run.smithi078.stdout:generic/021 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-12-12T10:25:59.360 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/021 2023-12-12T10:25:59.360 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/021 2023-12-12T10:25:59.360 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T10:25:59.367 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:25:59.433 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T10:25:59.433 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/022) 2023-12-12T10:26:00.174 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T10:26:00.190 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T10:26:00.190 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:26:02.745 INFO:teuthology.orchestra.run.smithi078.stdout:generic/022 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-12-12T10:26:02.756 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/022 2023-12-12T10:26:02.756 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/022 2023-12-12T10:26:02.756 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T10:26:02.765 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:26:02.948 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T10:26:02.949 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/023) 2023-12-12T10:26:03.589 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T10:26:03.604 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T10:26:03.604 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:26:06.316 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T10:26:06.322 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T10:26:06.790 INFO:teuthology.orchestra.run.smithi078.stdout:generic/023 3s 2023-12-12T10:26:06.805 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/023 2023-12-12T10:26:06.805 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T10:26:06.814 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:26:06.921 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T10:26:06.922 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/024) 2023-12-12T10:26:07.620 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T10:26:07.634 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T10:26:07.634 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:26:08.059 INFO:teuthology.orchestra.run.smithi078.stdout:generic/024 [not run] kernel doesn't support renameat2 syscall 2023-12-12T10:26:08.070 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/024 2023-12-12T10:26:08.070 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/024 2023-12-12T10:26:08.070 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T10:26:08.079 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:26:08.109 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T10:26:08.110 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/025) 2023-12-12T10:26:08.850 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T10:26:08.864 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T10:26:08.864 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:26:09.322 INFO:teuthology.orchestra.run.smithi078.stdout:generic/025 [not run] kernel doesn't support renameat2 syscall 2023-12-12T10:26:09.333 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/025 2023-12-12T10:26:09.333 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/025 2023-12-12T10:26:09.333 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T10:26:09.342 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:26:09.378 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T10:26:09.379 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/026) 2023-12-12T10:26:10.180 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T10:26:10.194 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T10:26:10.195 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:26:11.762 INFO:teuthology.orchestra.run.smithi078.stdout:generic/026 [not run] ACLs not supported by this filesystem type: ceph-fuse 2023-12-12T10:26:11.776 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/026 2023-12-12T10:26:11.776 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/026 2023-12-12T10:26:11.776 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T10:26:11.787 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:26:11.814 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T10:26:11.814 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/027) 2023-12-12T10:26:12.376 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T10:26:12.389 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T10:26:12.389 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:26:12.801 INFO:teuthology.orchestra.run.smithi078.stdout:generic/027 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T10:26:12.813 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/027 2023-12-12T10:26:12.813 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/027 2023-12-12T10:26:12.813 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T10:26:12.822 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:26:12.882 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T10:26:12.883 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/028) 2023-12-12T10:26:13.433 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T10:26:13.449 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T10:26:13.450 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:26:18.905 INFO:teuthology.orchestra.run.smithi078.stdout:generic/028 5s 2023-12-12T10:26:18.926 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/028 2023-12-12T10:26:18.926 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T10:26:18.936 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:26:18.966 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T10:26:18.966 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/029) 2023-12-12T10:26:19.509 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T10:26:19.525 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T10:26:19.525 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:26:19.892 INFO:teuthology.orchestra.run.smithi078.stdout:generic/029 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T10:26:19.907 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/029 2023-12-12T10:26:19.907 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/029 2023-12-12T10:26:19.907 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T10:26:19.915 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:26:19.952 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T10:26:19.952 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/030) 2023-12-12T10:26:20.478 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T10:26:20.494 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T10:26:20.494 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:26:20.891 INFO:teuthology.orchestra.run.smithi078.stdout:generic/030 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T10:26:20.904 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/030 2023-12-12T10:26:20.904 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/030 2023-12-12T10:26:20.904 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T10:26:20.912 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:26:20.941 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T10:26:20.941 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/031) 2023-12-12T10:26:21.465 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T10:26:21.478 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T10:26:21.479 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:26:21.877 INFO:teuthology.orchestra.run.smithi078.stdout:generic/031 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T10:26:21.887 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/031 2023-12-12T10:26:21.887 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/031 2023-12-12T10:26:21.887 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T10:26:21.895 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:26:21.922 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T10:26:21.922 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/032) 2023-12-12T10:26:22.446 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T10:26:22.462 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T10:26:22.462 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:26:22.850 INFO:teuthology.orchestra.run.smithi078.stdout:generic/032 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T10:26:22.863 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/032 2023-12-12T10:26:22.863 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/032 2023-12-12T10:26:22.863 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T10:26:22.872 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:26:22.902 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T10:26:22.903 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/033) 2023-12-12T10:26:23.458 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T10:26:23.473 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T10:26:23.473 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:26:23.840 INFO:teuthology.orchestra.run.smithi078.stdout:generic/033 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T10:26:23.852 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/033 2023-12-12T10:26:23.852 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/033 2023-12-12T10:26:23.852 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T10:26:23.862 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:26:23.890 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T10:26:23.891 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/034) 2023-12-12T10:26:24.424 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T10:26:24.439 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T10:26:24.439 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:26:24.856 INFO:teuthology.orchestra.run.smithi078.stdout:generic/034 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T10:26:24.866 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/034 2023-12-12T10:26:24.866 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/034 2023-12-12T10:26:24.866 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T10:26:24.877 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:26:24.904 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T10:26:24.904 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/035) 2023-12-12T10:26:25.446 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T10:26:25.464 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T10:26:25.464 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:26:26.000 INFO:teuthology.orchestra.run.smithi078.stdout:generic/035 0s 2023-12-12T10:26:26.016 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/035 2023-12-12T10:26:26.016 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T10:26:26.025 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:26:26.228 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T10:26:26.228 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/036) 2023-12-12T10:26:26.879 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T10:26:26.895 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T10:26:26.895 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:26:36.426 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T10:26:36.436 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T10:26:37.621 INFO:teuthology.orchestra.run.smithi078.stdout:generic/036 11s 2023-12-12T10:26:37.638 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/036 2023-12-12T10:26:37.639 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T10:26:37.649 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:26:37.766 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T10:26:37.766 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/037) 2023-12-12T10:26:38.457 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T10:26:38.470 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T10:26:38.470 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:26:38.860 INFO:teuthology.orchestra.run.smithi078.stdout:generic/037 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T10:26:38.873 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/037 2023-12-12T10:26:38.873 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/037 2023-12-12T10:26:38.873 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T10:26:38.888 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:26:38.916 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T10:26:38.916 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/038) 2023-12-12T10:26:39.447 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T10:26:39.466 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T10:26:39.467 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:26:39.853 INFO:teuthology.orchestra.run.smithi078.stdout:generic/038 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T10:26:39.863 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/038 2023-12-12T10:26:39.863 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/038 2023-12-12T10:26:39.863 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T10:26:39.873 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:26:39.905 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T10:26:39.905 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/039) 2023-12-12T10:26:40.468 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T10:26:40.484 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T10:26:40.484 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:26:40.899 INFO:teuthology.orchestra.run.smithi078.stdout:generic/039 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T10:26:40.910 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/039 2023-12-12T10:26:40.911 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/039 2023-12-12T10:26:40.911 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T10:26:40.920 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:26:40.956 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T10:26:40.956 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/040) 2023-12-12T10:26:41.470 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T10:26:41.488 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T10:26:41.488 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:26:41.906 INFO:teuthology.orchestra.run.smithi078.stdout:generic/040 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T10:26:41.917 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/040 2023-12-12T10:26:41.917 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/040 2023-12-12T10:26:41.917 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T10:26:41.927 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:26:41.960 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T10:26:41.961 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/041) 2023-12-12T10:26:42.485 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T10:26:42.499 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T10:26:42.500 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:26:42.938 INFO:teuthology.orchestra.run.smithi078.stdout:generic/041 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T10:26:42.949 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/041 2023-12-12T10:26:42.949 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/041 2023-12-12T10:26:42.950 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T10:26:42.959 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:26:42.990 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T10:26:42.991 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/042) 2023-12-12T10:26:43.527 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T10:26:43.541 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T10:26:43.541 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:26:43.926 INFO:teuthology.orchestra.run.smithi078.stdout:generic/042 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T10:26:43.940 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/042 2023-12-12T10:26:43.940 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/042 2023-12-12T10:26:43.940 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T10:26:43.949 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:26:44.037 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T10:26:44.037 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/043) 2023-12-12T10:26:44.547 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T10:26:44.559 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T10:26:44.560 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:26:44.958 INFO:teuthology.orchestra.run.smithi078.stdout:generic/043 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T10:26:44.968 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/043 2023-12-12T10:26:44.968 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/043 2023-12-12T10:26:44.968 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T10:26:44.977 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:26:45.006 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T10:26:45.007 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/044) 2023-12-12T10:26:45.534 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T10:26:45.550 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T10:26:45.550 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:26:45.944 INFO:teuthology.orchestra.run.smithi078.stdout:generic/044 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T10:26:45.955 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/044 2023-12-12T10:26:45.955 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/044 2023-12-12T10:26:45.955 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T10:26:45.973 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:26:46.044 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T10:26:46.044 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/045) 2023-12-12T10:26:46.429 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T10:26:46.440 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T10:26:46.440 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:26:46.903 INFO:teuthology.orchestra.run.smithi078.stdout:generic/045 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T10:26:46.911 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/045 2023-12-12T10:26:46.912 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/045 2023-12-12T10:26:46.912 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T10:26:46.918 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:26:46.938 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T10:26:46.938 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/046) 2023-12-12T10:26:47.307 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T10:26:47.317 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T10:26:47.317 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:26:47.608 INFO:teuthology.orchestra.run.smithi078.stdout:generic/046 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T10:26:47.617 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/046 2023-12-12T10:26:47.617 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/046 2023-12-12T10:26:47.617 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T10:26:47.623 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:26:47.644 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T10:26:47.644 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/047) 2023-12-12T10:26:48.006 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T10:26:48.017 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T10:26:48.017 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:26:48.291 INFO:teuthology.orchestra.run.smithi078.stdout:generic/047 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T10:26:48.298 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/047 2023-12-12T10:26:48.298 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/047 2023-12-12T10:26:48.298 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T10:26:48.305 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:26:48.324 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T10:26:48.325 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/048) 2023-12-12T10:26:48.686 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T10:26:48.697 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T10:26:48.697 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:26:48.971 INFO:teuthology.orchestra.run.smithi078.stdout:generic/048 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T10:26:48.980 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/048 2023-12-12T10:26:48.980 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/048 2023-12-12T10:26:48.980 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T10:26:48.986 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:26:49.005 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T10:26:49.006 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/049) 2023-12-12T10:26:49.380 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T10:26:49.391 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T10:26:49.391 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:26:49.663 INFO:teuthology.orchestra.run.smithi078.stdout:generic/049 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T10:26:49.671 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/049 2023-12-12T10:26:49.671 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/049 2023-12-12T10:26:49.671 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T10:26:49.678 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:26:49.696 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T10:26:49.697 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/050) 2023-12-12T10:26:50.065 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T10:26:50.076 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T10:26:50.076 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:26:50.385 INFO:teuthology.orchestra.run.smithi078.stdout:generic/050 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T10:26:50.393 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/050 2023-12-12T10:26:50.393 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/050 2023-12-12T10:26:50.393 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T10:26:50.399 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:26:50.419 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T10:26:50.419 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/051) 2023-12-12T10:26:50.785 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T10:26:50.795 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T10:26:50.796 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:26:51.085 INFO:teuthology.orchestra.run.smithi078.stdout:generic/051 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T10:26:51.093 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/051 2023-12-12T10:26:51.093 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/051 2023-12-12T10:26:51.093 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T10:26:51.100 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:26:51.118 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T10:26:51.119 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/052) 2023-12-12T10:26:51.498 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T10:26:51.508 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T10:26:51.509 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:26:51.782 INFO:teuthology.orchestra.run.smithi078.stdout:generic/052 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T10:26:51.790 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/052 2023-12-12T10:26:51.790 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/052 2023-12-12T10:26:51.790 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T10:26:51.797 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:26:51.816 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T10:26:51.817 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/053) 2023-12-12T10:26:52.184 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T10:26:52.194 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T10:26:52.195 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:26:52.469 INFO:teuthology.orchestra.run.smithi078.stdout:generic/053 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T10:26:52.477 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/053 2023-12-12T10:26:52.478 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/053 2023-12-12T10:26:52.478 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T10:26:52.483 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:26:52.568 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T10:26:52.568 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/054) 2023-12-12T10:26:52.925 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T10:26:52.936 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T10:26:52.936 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:26:53.218 INFO:teuthology.orchestra.run.smithi078.stdout:generic/054 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T10:26:53.229 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/054 2023-12-12T10:26:53.229 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/054 2023-12-12T10:26:53.229 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T10:26:53.233 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:26:53.252 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T10:26:53.253 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/055) 2023-12-12T10:26:53.620 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T10:26:53.631 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T10:26:53.631 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:26:53.908 INFO:teuthology.orchestra.run.smithi078.stdout:generic/055 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T10:26:53.916 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/055 2023-12-12T10:26:53.917 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/055 2023-12-12T10:26:53.917 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T10:26:53.923 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:26:53.942 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T10:26:53.942 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/056) 2023-12-12T10:26:54.288 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T10:26:54.298 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T10:26:54.299 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:26:54.606 INFO:teuthology.orchestra.run.smithi078.stdout:generic/056 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T10:26:54.614 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/056 2023-12-12T10:26:54.614 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/056 2023-12-12T10:26:54.614 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T10:26:54.620 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:26:54.640 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T10:26:54.640 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/057) 2023-12-12T10:26:55.017 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T10:26:55.028 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T10:26:55.028 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:26:55.323 INFO:teuthology.orchestra.run.smithi078.stdout:generic/057 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T10:26:55.331 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/057 2023-12-12T10:26:55.331 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/057 2023-12-12T10:26:55.331 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T10:26:55.337 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:26:55.357 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T10:26:55.357 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/058) 2023-12-12T10:26:55.716 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T10:26:55.727 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T10:26:55.727 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:26:57.263 INFO:teuthology.orchestra.run.smithi078.stdout:generic/058 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-12-12T10:26:57.271 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/058 2023-12-12T10:26:57.271 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/058 2023-12-12T10:26:57.271 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T10:26:57.277 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:26:57.346 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T10:26:57.346 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/059) 2023-12-12T10:26:57.917 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T10:26:57.927 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T10:26:57.927 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:26:58.258 INFO:teuthology.orchestra.run.smithi078.stdout:generic/059 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T10:26:58.266 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/059 2023-12-12T10:26:58.266 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/059 2023-12-12T10:26:58.266 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T10:26:58.272 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:26:58.293 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T10:26:58.293 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/060) 2023-12-12T10:26:58.661 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T10:26:58.672 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T10:26:58.672 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:27:00.168 INFO:teuthology.orchestra.run.smithi078.stdout:generic/060 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-12-12T10:27:00.176 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/060 2023-12-12T10:27:00.176 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/060 2023-12-12T10:27:00.176 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T10:27:00.182 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:27:00.332 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T10:27:00.332 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/061) 2023-12-12T10:27:00.889 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T10:27:00.900 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T10:27:00.900 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:27:02.392 INFO:teuthology.orchestra.run.smithi078.stdout:generic/061 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-12-12T10:27:02.400 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/061 2023-12-12T10:27:02.400 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/061 2023-12-12T10:27:02.401 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T10:27:02.406 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:27:02.489 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T10:27:02.490 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/062) 2023-12-12T10:27:03.045 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T10:27:03.055 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T10:27:03.055 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:27:03.331 INFO:teuthology.orchestra.run.smithi078.stdout:generic/062 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T10:27:03.340 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/062 2023-12-12T10:27:03.340 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/062 2023-12-12T10:27:03.340 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T10:27:03.346 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:27:03.365 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T10:27:03.366 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/063) 2023-12-12T10:27:03.728 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T10:27:03.739 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T10:27:03.739 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:27:05.216 INFO:teuthology.orchestra.run.smithi078.stdout:generic/063 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-12-12T10:27:05.224 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/063 2023-12-12T10:27:05.225 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/063 2023-12-12T10:27:05.225 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T10:27:05.230 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:27:05.331 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T10:27:05.331 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/064) 2023-12-12T10:27:05.894 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T10:27:05.904 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T10:27:05.904 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:27:06.175 INFO:teuthology.orchestra.run.smithi078.stdout:generic/064 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T10:27:06.183 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/064 2023-12-12T10:27:06.183 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/064 2023-12-12T10:27:06.183 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T10:27:06.189 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:27:06.208 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T10:27:06.209 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/065) 2023-12-12T10:27:06.512 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T10:27:06.516 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T10:27:06.569 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T10:27:06.579 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T10:27:06.580 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:27:06.878 INFO:teuthology.orchestra.run.smithi078.stdout:generic/065 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T10:27:06.886 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/065 2023-12-12T10:27:06.886 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/065 2023-12-12T10:27:06.886 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T10:27:06.892 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:27:06.912 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T10:27:06.912 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/066) 2023-12-12T10:27:07.309 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T10:27:07.319 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T10:27:07.319 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:27:07.626 INFO:teuthology.orchestra.run.smithi078.stdout:generic/066 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T10:27:07.634 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/066 2023-12-12T10:27:07.634 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/066 2023-12-12T10:27:07.634 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T10:27:07.640 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:27:07.660 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T10:27:07.660 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/067) 2023-12-12T10:27:08.018 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T10:27:08.029 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T10:27:08.029 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:27:08.338 INFO:teuthology.orchestra.run.smithi078.stdout:generic/067 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T10:27:08.347 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/067 2023-12-12T10:27:08.347 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/067 2023-12-12T10:27:08.347 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T10:27:08.353 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:27:08.420 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T10:27:08.420 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/068) 2023-12-12T10:27:08.780 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T10:27:08.791 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T10:27:08.791 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:27:09.087 INFO:teuthology.orchestra.run.smithi078.stdout:generic/068 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T10:27:09.095 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/068 2023-12-12T10:27:09.095 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/068 2023-12-12T10:27:09.095 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T10:27:09.101 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:27:09.120 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T10:27:09.121 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/069) 2023-12-12T10:27:09.496 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T10:27:09.507 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T10:27:09.507 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:27:09.787 INFO:teuthology.orchestra.run.smithi078.stdout:generic/069 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T10:27:09.795 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/069 2023-12-12T10:27:09.795 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/069 2023-12-12T10:27:09.795 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T10:27:09.802 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:27:09.821 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T10:27:09.821 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/070) 2023-12-12T10:27:10.193 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T10:27:10.203 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T10:27:10.203 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:27:36.582 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T10:27:36.588 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T10:28:06.695 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T10:28:06.700 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T10:28:27.285 INFO:teuthology.orchestra.run.smithi078.stdout:generic/070 77s 2023-12-12T10:28:27.297 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/070 2023-12-12T10:28:27.297 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T10:28:27.303 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:28:27.555 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T10:28:27.555 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/071) 2023-12-12T10:28:28.134 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T10:28:28.149 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T10:28:28.149 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:28:28.547 INFO:teuthology.orchestra.run.smithi078.stdout:generic/071 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T10:28:28.558 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/071 2023-12-12T10:28:28.558 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/071 2023-12-12T10:28:28.558 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T10:28:28.568 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:28:28.603 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T10:28:28.603 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/072) 2023-12-12T10:28:29.141 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T10:28:29.154 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T10:28:29.154 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:28:31.642 INFO:teuthology.orchestra.run.smithi078.stdout:generic/072 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2023-12-12T10:28:31.650 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/072 2023-12-12T10:28:31.650 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/072 2023-12-12T10:28:31.650 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T10:28:31.658 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:28:31.688 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T10:28:31.688 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/073) 2023-12-12T10:28:32.234 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T10:28:32.249 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T10:28:32.249 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:28:32.688 INFO:teuthology.orchestra.run.smithi078.stdout:generic/073 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T10:28:32.699 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/073 2023-12-12T10:28:32.699 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/073 2023-12-12T10:28:32.700 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T10:28:32.708 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:28:32.738 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T10:28:32.738 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/074) 2023-12-12T10:28:33.265 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T10:28:33.281 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T10:28:33.281 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T10:28:36.748 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T10:28:36.755 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T10:29:07.007 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T10:29:07.014 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T10:29:37.087 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T10:29:37.092 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T10:30:07.343 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T10:30:07.348 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T10:30:38.192 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T10:30:38.204 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T10:31:09.030 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T10:31:09.051 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T10:31:39.293 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T10:31:39.298 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T10:32:09.557 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T10:32:09.563 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T10:32:40.861 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T10:32:40.868 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T10:33:11.824 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T10:33:11.835 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T10:33:42.482 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T10:33:42.488 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T10:34:12.554 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T10:34:12.560 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T10:34:42.727 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T10:34:42.732 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T10:34:42.822 INFO:tasks.ceph.osd.5.smithi187.stderr:2023-12-12T10:34:42.818+0000 7f363eb0f640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44487) UID: 0 2023-12-12T10:34:42.823 INFO:tasks.ceph.osd.6.smithi187.stderr:2023-12-12T10:34:42.818+0000 7fb917830640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44487) UID: 0 2023-12-12T10:34:42.823 INFO:tasks.ceph.osd.4.smithi187.stderr:2023-12-12T10:34:42.818+0000 7fcf5f6ed640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44487) UID: 0 2023-12-12T10:34:42.823 INFO:tasks.ceph.osd.7.smithi187.stderr:2023-12-12T10:34:42.822+0000 7f9c745c6640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44487) UID: 0 2023-12-12T10:39:02.594 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T10:39:02.599 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T10:39:02.632 INFO:tasks.ceph.osd.4.smithi187.stderr:2023-12-12T10:39:02.624+0000 7fcf5f6ed640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44502) UID: 0 2023-12-12T10:39:02.632 INFO:tasks.ceph.osd.5.smithi187.stderr:2023-12-12T10:39:02.624+0000 7f363eb0f640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44502) UID: 0 2023-12-12T10:39:02.633 INFO:tasks.ceph.osd.6.smithi187.stderr:2023-12-12T10:39:02.624+0000 7fb917830640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44502) UID: 0 2023-12-12T10:39:02.633 INFO:tasks.ceph.osd.7.smithi187.stderr:2023-12-12T10:39:02.624+0000 7f9c745c6640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44502) UID: 0 2023-12-12T10:39:02.649 INFO:tasks.ceph.osd.0.smithi078.stderr:2023-12-12T10:39:02.650+0000 7f7267fb3640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 126557) UID: 0 2023-12-12T10:39:02.649 INFO:tasks.ceph.osd.1.smithi078.stderr:2023-12-12T10:39:02.650+0000 7fda08c74640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 126557) UID: 0 2023-12-12T10:39:02.649 INFO:tasks.ceph.osd.2.smithi078.stderr:2023-12-12T10:39:02.650+0000 7efffc42e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 126557) UID: 0 2023-12-12T10:39:02.650 INFO:tasks.ceph.osd.3.smithi078.stderr:2023-12-12T10:39:02.650+0000 7f238c6c1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 126557) UID: 0 2023-12-12T10:45:00.431 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T10:45:00.438 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T10:45:00.494 INFO:tasks.ceph.osd.0.smithi078.stderr:2023-12-12T10:45:00.491+0000 7f7267fb3640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 129596) UID: 0 2023-12-12T10:45:00.494 INFO:tasks.ceph.osd.1.smithi078.stderr:2023-12-12T10:45:00.491+0000 7fda08c74640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 129596) UID: 0 2023-12-12T10:45:00.495 INFO:tasks.ceph.osd.3.smithi078.stderr:2023-12-12T10:45:00.491+0000 7f238c6c1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 129596) UID: 0 2023-12-12T10:45:00.495 INFO:tasks.ceph.osd.2.smithi078.stderr:2023-12-12T10:45:00.491+0000 7efffc42e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 129596) UID: 0 2023-12-12T10:55:56.680 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T10:55:56.713 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T10:55:56.990 INFO:tasks.ceph.osd.0.smithi078.stderr:2023-12-12T10:55:56.984+0000 7f7267fb3640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 135539) UID: 0 2023-12-12T10:55:56.991 INFO:tasks.ceph.osd.1.smithi078.stderr:2023-12-12T10:55:56.988+0000 7fda08c74640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 135539) UID: 0 2023-12-12T10:55:56.991 INFO:tasks.ceph.osd.2.smithi078.stderr:2023-12-12T10:55:56.988+0000 7efffc42e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 135539) UID: 0 2023-12-12T10:55:56.991 INFO:tasks.ceph.osd.3.smithi078.stderr:2023-12-12T10:55:56.988+0000 7f238c6c1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 135539) UID: 0 2023-12-12T10:56:01.913 INFO:tasks.ceph.osd.4.smithi187.stderr:2023-12-12T10:56:01.909+0000 7fcf5f6ed640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44781) UID: 0 2023-12-12T10:56:01.914 INFO:tasks.ceph.osd.5.smithi187.stderr:2023-12-12T10:56:01.909+0000 7f363eb0f640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44781) UID: 0 2023-12-12T10:56:01.914 INFO:tasks.ceph.osd.7.smithi187.stderr:2023-12-12T10:56:01.909+0000 7f9c745c6640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44781) UID: 0 2023-12-12T10:56:01.915 INFO:tasks.ceph.osd.6.smithi187.stderr:2023-12-12T10:56:01.909+0000 7fb917830640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44781) UID: 0 2023-12-12T11:02:03.039 INFO:teuthology.orchestra.run.smithi078.stdout:generic/074 2010s 2023-12-12T11:02:03.153 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/074 2023-12-12T11:02:03.153 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:02:03.161 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:02:03.181 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:02:03.182 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/075) 2023-12-12T11:02:04.310 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:02:04.320 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:02:04.320 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:02:49.676 INFO:teuthology.orchestra.run.smithi078.stdout:generic/075 45s 2023-12-12T11:02:49.688 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/075 2023-12-12T11:02:49.689 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:02:49.695 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:02:49.941 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:02:49.942 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/076) 2023-12-12T11:02:50.422 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:02:50.432 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:02:50.432 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:02:50.720 INFO:teuthology.orchestra.run.smithi078.stdout:generic/076 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T11:02:50.728 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/076 2023-12-12T11:02:50.728 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/076 2023-12-12T11:02:50.728 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:02:50.734 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:02:50.753 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:02:50.753 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/077) 2023-12-12T11:02:51.104 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:02:51.114 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:02:51.114 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:02:52.614 INFO:teuthology.orchestra.run.smithi078.stdout:generic/077 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T11:02:52.622 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/077 2023-12-12T11:02:52.622 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/077 2023-12-12T11:02:52.622 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:02:52.628 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:02:52.648 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:02:52.648 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/078) 2023-12-12T11:02:53.139 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:02:53.150 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:02:53.150 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:02:53.475 INFO:teuthology.orchestra.run.smithi078.stdout:generic/078 [not run] kernel doesn't support renameat2 syscall 2023-12-12T11:02:53.483 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/078 2023-12-12T11:02:53.483 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/078 2023-12-12T11:02:53.483 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:02:53.490 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:02:53.529 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:02:53.530 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/079) 2023-12-12T11:02:54.204 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:02:54.215 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:02:54.215 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:02:55.325 INFO:teuthology.orchestra.run.smithi078.stdout:generic/079 [not run] file system doesn't support chattr +ia 2023-12-12T11:02:55.333 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/079 2023-12-12T11:02:55.334 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/079 2023-12-12T11:02:55.334 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:02:55.340 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:02:55.361 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:02:55.362 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/080) 2023-12-12T11:02:55.743 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:02:55.753 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:02:55.753 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:02:58.148 INFO:teuthology.orchestra.run.smithi078.stdout:generic/080 3s 2023-12-12T11:02:58.162 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/080 2023-12-12T11:02:58.162 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:02:58.169 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:02:58.240 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:02:58.241 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/081) 2023-12-12T11:02:58.600 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:02:58.610 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:02:58.610 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:02:58.894 INFO:teuthology.orchestra.run.smithi078.stdout:generic/081 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T11:02:58.902 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/081 2023-12-12T11:02:58.903 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/081 2023-12-12T11:02:58.903 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:02:58.908 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:02:58.928 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:02:58.928 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/082) 2023-12-12T11:02:59.299 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:02:59.309 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:02:59.310 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:02:59.607 INFO:teuthology.orchestra.run.smithi078.stdout:generic/082 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T11:02:59.614 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/082 2023-12-12T11:02:59.614 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/082 2023-12-12T11:02:59.615 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:02:59.620 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:02:59.639 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:02:59.640 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/083) 2023-12-12T11:03:00.015 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:03:00.025 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:03:00.025 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:03:00.305 INFO:teuthology.orchestra.run.smithi078.stdout:generic/083 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T11:03:00.314 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/083 2023-12-12T11:03:00.314 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/083 2023-12-12T11:03:00.314 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:03:00.320 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:03:00.339 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:03:00.339 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/084) 2023-12-12T11:03:00.707 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:03:00.717 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:03:00.717 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:03:00.976 INFO:teuthology.orchestra.run.smithi078.stdout:generic/084 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T11:03:00.984 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/084 2023-12-12T11:03:00.985 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/084 2023-12-12T11:03:00.985 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:03:00.991 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:03:01.009 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:03:01.010 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/085) 2023-12-12T11:03:01.388 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:03:01.398 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:03:01.399 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:03:01.713 INFO:teuthology.orchestra.run.smithi078.stdout:generic/085 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T11:03:01.721 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/085 2023-12-12T11:03:01.721 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/085 2023-12-12T11:03:01.721 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:03:01.727 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:03:01.747 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:03:01.747 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/086) 2023-12-12T11:03:02.118 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:03:02.128 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:03:02.128 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:03:18.533 INFO:teuthology.orchestra.run.smithi078.stdout:generic/086 16s 2023-12-12T11:03:18.652 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/086 2023-12-12T11:03:18.652 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:03:18.658 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:03:18.891 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:03:18.891 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/087) 2023-12-12T11:03:20.389 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:03:20.400 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:03:20.400 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:03:21.009 INFO:teuthology.orchestra.run.smithi078.stdout:generic/087 1s 2023-12-12T11:03:21.022 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/087 2023-12-12T11:03:21.022 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:03:21.028 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:03:21.062 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:03:21.062 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/088) 2023-12-12T11:03:21.730 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:03:21.741 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:03:21.741 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:03:22.108 INFO:teuthology.orchestra.run.smithi078.stdout:generic/088 1s 2023-12-12T11:03:22.120 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/088 2023-12-12T11:03:22.120 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:03:22.127 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:03:22.171 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:03:22.171 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/089) 2023-12-12T11:03:22.831 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:03:22.841 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:03:22.841 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:11:35.602 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T11:11:35.607 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T11:11:36.035 INFO:tasks.ceph.mds.c.smithi078.stderr:2023-12-12T11:11:36.033+0000 7f93f9020640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 145151) UID: 0 2023-12-12T11:11:36.035 INFO:tasks.ceph.mds.a.smithi078.stderr:2023-12-12T11:11:36.033+0000 7fd9e625e640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 145151) UID: 0 2023-12-12T11:19:28.373 INFO:tasks.ceph.osd.0.smithi078.stderr:2023-12-12T11:19:28.374+0000 7f7267fb3640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 147184) UID: 0 2023-12-12T11:19:28.373 INFO:tasks.ceph.osd.2.smithi078.stderr:2023-12-12T11:19:28.374+0000 7efffc42e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 147184) UID: 0 2023-12-12T11:19:28.374 INFO:tasks.ceph.osd.1.smithi078.stderr:2023-12-12T11:19:28.374+0000 7fda08c74640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 147184) UID: 0 2023-12-12T11:19:28.374 INFO:tasks.ceph.osd.3.smithi078.stderr:2023-12-12T11:19:28.374+0000 7f238c6c1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 147184) UID: 0 2023-12-12T11:21:53.301 INFO:teuthology.orchestra.run.smithi078.stdout:generic/089 1111s 2023-12-12T11:21:53.453 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/089 2023-12-12T11:21:53.453 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:21:53.472 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:21:53.513 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:21:53.514 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/090) 2023-12-12T11:21:55.322 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:21:55.333 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:21:55.333 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:21:55.914 INFO:teuthology.orchestra.run.smithi078.stdout:generic/090 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T11:21:55.924 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/090 2023-12-12T11:21:55.924 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/090 2023-12-12T11:21:55.924 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:21:55.931 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:21:55.952 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:21:55.952 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/091) 2023-12-12T11:21:57.424 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:21:57.436 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:21:57.436 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:23:32.128 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T11:23:32.134 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T11:23:32.203 INFO:tasks.ceph.mds.c.smithi078.stderr:2023-12-12T11:23:32.198+0000 7f93f9020640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 148080) UID: 0 2023-12-12T11:23:32.203 INFO:tasks.ceph.mds.a.smithi078.stderr:2023-12-12T11:23:32.198+0000 7fd9e625e640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 148080) UID: 0 2023-12-12T11:24:24.072 INFO:teuthology.orchestra.run.smithi078.stdout:generic/091 147s 2023-12-12T11:24:24.085 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/091 2023-12-12T11:24:24.085 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:24:24.092 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:24:24.147 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:24:24.147 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/092) 2023-12-12T11:24:24.907 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:24:24.918 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:24:24.918 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:24:25.296 INFO:teuthology.orchestra.run.smithi078.stdout:generic/092 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-12-12T11:24:25.304 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/092 2023-12-12T11:24:25.304 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/092 2023-12-12T11:24:25.304 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:24:25.310 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:24:25.384 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:24:25.384 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/093) 2023-12-12T11:24:26.077 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:24:26.088 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:24:26.088 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:24:28.083 INFO:teuthology.orchestra.run.smithi078.stdout:generic/093 2s 2023-12-12T11:24:28.096 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/093 2023-12-12T11:24:28.096 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:24:28.102 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:24:28.148 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:24:28.148 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/094) 2023-12-12T11:24:28.862 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:24:28.872 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:24:28.872 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:24:29.165 INFO:teuthology.orchestra.run.smithi078.stdout:generic/094 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T11:24:29.173 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/094 2023-12-12T11:24:29.173 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/094 2023-12-12T11:24:29.173 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:24:29.180 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:24:29.201 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:24:29.201 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/095) 2023-12-12T11:24:29.569 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:24:29.580 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:24:29.580 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:24:29.870 INFO:teuthology.orchestra.run.smithi078.stdout:generic/095 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T11:24:29.878 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/095 2023-12-12T11:24:29.878 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/095 2023-12-12T11:24:29.878 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:24:29.885 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:24:29.905 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:24:29.905 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/096) 2023-12-12T11:24:30.305 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:24:30.316 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:24:30.316 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:24:30.657 INFO:teuthology.orchestra.run.smithi078.stdout:generic/096 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T11:24:30.665 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/096 2023-12-12T11:24:30.666 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/096 2023-12-12T11:24:30.666 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:24:30.672 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:24:30.694 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:24:30.694 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/097) 2023-12-12T11:24:31.072 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:24:31.083 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:24:31.083 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:24:32.033 INFO:teuthology.orchestra.run.smithi078.stdout:generic/097 1s 2023-12-12T11:24:32.045 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/097 2023-12-12T11:24:32.045 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:24:32.051 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:24:32.070 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:24:32.070 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/098) 2023-12-12T11:24:32.444 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:24:32.455 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:24:32.455 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:24:32.776 INFO:teuthology.orchestra.run.smithi078.stdout:generic/098 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T11:24:32.786 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/098 2023-12-12T11:24:32.786 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/098 2023-12-12T11:24:32.786 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:24:32.793 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:24:32.812 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:24:32.812 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/099) 2023-12-12T11:24:33.205 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:24:33.216 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:24:33.216 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:24:33.600 INFO:teuthology.orchestra.run.smithi078.stdout:generic/099 [not run] ACLs not supported by this filesystem type: ceph-fuse 2023-12-12T11:24:33.609 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/099 2023-12-12T11:24:33.609 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/099 2023-12-12T11:24:33.609 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:24:33.615 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:24:33.636 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:24:33.637 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/100) 2023-12-12T11:24:34.020 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:24:34.030 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:24:34.031 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:25:24.398 INFO:teuthology.orchestra.run.smithi078.stdout:generic/100 50s 2023-12-12T11:25:24.410 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/100 2023-12-12T11:25:24.410 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:25:24.417 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:25:24.478 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:25:24.478 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/101) 2023-12-12T11:25:25.254 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:25:25.265 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:25:25.265 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:25:25.660 INFO:teuthology.orchestra.run.smithi078.stdout:generic/101 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T11:25:25.668 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/101 2023-12-12T11:25:25.669 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/101 2023-12-12T11:25:25.669 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:25:25.676 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:25:25.697 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:25:25.697 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/102) 2023-12-12T11:25:26.081 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:25:26.092 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:25:26.092 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:25:26.373 INFO:teuthology.orchestra.run.smithi078.stdout:generic/102 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T11:25:26.382 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/102 2023-12-12T11:25:26.382 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/102 2023-12-12T11:25:26.382 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:25:26.388 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:25:26.409 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:25:26.410 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/103) 2023-12-12T11:25:26.776 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:25:26.787 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:25:26.787 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:25:27.103 INFO:teuthology.orchestra.run.smithi078.stdout:generic/103 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T11:25:27.111 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/103 2023-12-12T11:25:27.111 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/103 2023-12-12T11:25:27.111 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:25:27.118 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:25:27.138 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:25:27.138 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/104) 2023-12-12T11:25:27.519 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:25:27.530 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:25:27.530 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:25:27.853 INFO:teuthology.orchestra.run.smithi078.stdout:generic/104 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T11:25:27.862 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/104 2023-12-12T11:25:27.862 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/104 2023-12-12T11:25:27.862 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:25:27.868 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:25:27.888 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:25:27.888 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/105) 2023-12-12T11:25:28.280 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:25:28.290 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:25:28.290 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:25:28.567 INFO:teuthology.orchestra.run.smithi078.stdout:generic/105 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T11:25:28.576 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/105 2023-12-12T11:25:28.576 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/105 2023-12-12T11:25:28.576 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:25:28.582 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:25:28.603 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:25:28.603 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/106) 2023-12-12T11:25:29.009 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:25:29.019 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:25:29.019 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:25:29.319 INFO:teuthology.orchestra.run.smithi078.stdout:generic/106 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T11:25:29.327 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/106 2023-12-12T11:25:29.327 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/106 2023-12-12T11:25:29.327 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:25:29.334 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:25:29.355 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:25:29.355 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/107) 2023-12-12T11:25:29.729 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:25:29.739 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:25:29.740 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:25:30.077 INFO:teuthology.orchestra.run.smithi078.stdout:generic/107 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T11:25:30.086 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/107 2023-12-12T11:25:30.086 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/107 2023-12-12T11:25:30.086 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:25:30.092 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:25:30.112 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:25:30.113 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/108) 2023-12-12T11:25:30.497 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:25:30.507 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:25:30.507 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:25:31.311 INFO:teuthology.orchestra.run.smithi078.stdout:generic/108 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T11:25:31.319 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/108 2023-12-12T11:25:31.320 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/108 2023-12-12T11:25:31.320 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:25:31.326 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:25:31.347 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:25:31.347 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/109) 2023-12-12T11:25:31.724 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:25:31.735 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:25:31.735 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:25:32.012 INFO:teuthology.orchestra.run.smithi078.stdout:generic/109 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T11:25:32.020 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/109 2023-12-12T11:25:32.020 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/109 2023-12-12T11:25:32.020 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:25:32.026 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:25:32.096 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:25:32.096 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/110) 2023-12-12T11:25:32.465 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:25:32.476 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:25:32.476 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:25:32.845 INFO:teuthology.orchestra.run.smithi078.stdout:generic/110 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-12-12T11:25:32.853 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/110 2023-12-12T11:25:32.853 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/110 2023-12-12T11:25:32.853 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:25:32.859 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:25:32.884 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:25:32.884 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/111) 2023-12-12T11:25:33.609 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:25:33.620 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:25:33.620 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:25:33.968 INFO:teuthology.orchestra.run.smithi078.stdout:generic/111 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-12-12T11:25:33.976 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/111 2023-12-12T11:25:33.976 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/111 2023-12-12T11:25:33.976 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:25:33.982 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:25:34.027 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:25:34.027 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/112) 2023-12-12T11:25:34.737 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:25:34.748 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:25:34.748 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:26:25.774 INFO:teuthology.orchestra.run.smithi078.stdout:generic/112 51s 2023-12-12T11:26:25.795 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/112 2023-12-12T11:26:25.795 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:26:25.802 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:26:25.838 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:26:25.838 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/113) 2023-12-12T11:26:26.562 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:26:26.573 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:26:26.573 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:27:18.309 INFO:teuthology.orchestra.run.smithi078.stdout:generic/113 52s 2023-12-12T11:27:18.321 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/113 2023-12-12T11:27:18.321 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:27:18.328 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:27:18.399 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:27:18.399 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/114) 2023-12-12T11:27:19.157 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:27:19.168 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:27:19.168 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:27:19.667 INFO:teuthology.orchestra.run.smithi078.stdout:generic/114 [not run] device block size: 4096 greater than 512 2023-12-12T11:27:19.675 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/114 2023-12-12T11:27:19.675 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/114 2023-12-12T11:27:19.676 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:27:19.682 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:27:19.703 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:27:19.703 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/115) 2023-12-12T11:27:20.105 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:27:20.116 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:27:20.116 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:27:20.492 INFO:teuthology.orchestra.run.smithi078.stdout:generic/115 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-12-12T11:27:20.500 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/115 2023-12-12T11:27:20.500 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/115 2023-12-12T11:27:20.500 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:27:20.507 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:27:20.556 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:27:20.556 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/116) 2023-12-12T11:27:21.269 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:27:21.280 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:27:21.281 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:27:21.626 INFO:teuthology.orchestra.run.smithi078.stdout:generic/116 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-12-12T11:27:21.634 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/116 2023-12-12T11:27:21.634 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/116 2023-12-12T11:27:21.634 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:27:21.641 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:27:21.681 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:27:21.681 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/117) 2023-12-12T11:27:22.381 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:27:22.392 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:27:22.392 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:27:22.676 INFO:teuthology.orchestra.run.smithi078.stdout:generic/117 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T11:27:22.684 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/117 2023-12-12T11:27:22.684 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/117 2023-12-12T11:27:22.684 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:27:22.691 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:27:22.714 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:27:22.714 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/118) 2023-12-12T11:27:23.094 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:27:23.104 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:27:23.105 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:27:23.458 INFO:teuthology.orchestra.run.smithi078.stdout:generic/118 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-12-12T11:27:23.466 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/118 2023-12-12T11:27:23.467 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/118 2023-12-12T11:27:23.467 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:27:23.473 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:27:23.516 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:27:23.517 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/119) 2023-12-12T11:27:24.221 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:27:24.232 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:27:24.232 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:27:24.697 INFO:teuthology.orchestra.run.smithi078.stdout:generic/119 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-12-12T11:27:24.705 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/119 2023-12-12T11:27:24.705 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/119 2023-12-12T11:27:24.705 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:27:24.712 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:27:24.734 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:27:24.735 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/120) 2023-12-12T11:27:25.466 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:27:25.477 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:27:25.477 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:27:25.766 INFO:teuthology.orchestra.run.smithi078.stdout:generic/120 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T11:27:25.774 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/120 2023-12-12T11:27:25.775 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/120 2023-12-12T11:27:25.775 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:27:25.782 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:27:25.801 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:27:25.802 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/121) 2023-12-12T11:27:26.182 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:27:26.193 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:27:26.193 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:27:26.650 INFO:teuthology.orchestra.run.smithi078.stdout:generic/121 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2023-12-12T11:27:26.658 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/121 2023-12-12T11:27:26.658 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/121 2023-12-12T11:27:26.658 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:27:26.687 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:27:26.893 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:27:26.893 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/122) 2023-12-12T11:27:27.490 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:27:27.500 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:27:27.500 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:27:27.889 INFO:teuthology.orchestra.run.smithi078.stdout:generic/122 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2023-12-12T11:27:27.898 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/122 2023-12-12T11:27:27.898 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/122 2023-12-12T11:27:27.898 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:27:27.904 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:27:27.946 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:27:27.946 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/123) 2023-12-12T11:27:28.737 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:27:28.748 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:27:28.748 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:27:30.337 INFO:teuthology.orchestra.run.smithi078.stdout:generic/123 2s 2023-12-12T11:27:30.349 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/123 2023-12-12T11:27:30.349 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:27:30.355 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:27:30.377 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:27:30.377 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/124) 2023-12-12T11:27:31.094 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:27:31.105 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:27:31.105 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:27:31.389 INFO:teuthology.orchestra.run.smithi078.stdout:generic/124 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T11:27:31.398 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/124 2023-12-12T11:27:31.398 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/124 2023-12-12T11:27:31.398 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:27:31.404 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:27:31.426 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:27:31.427 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/125) 2023-12-12T11:27:31.815 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:27:31.826 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:27:31.826 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:28:34.008 INFO:teuthology.orchestra.run.smithi078.stdout:generic/125 62s 2023-12-12T11:28:34.021 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/125 2023-12-12T11:28:34.021 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:28:34.028 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:28:34.056 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:28:34.057 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/126) 2023-12-12T11:28:34.746 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:28:34.757 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:28:34.757 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:28:35.861 INFO:teuthology.orchestra.run.smithi078.stdout:generic/126 - output mismatch (see /tmp/tmp.GmWnCxuSqIxfstests-dev/results//generic/126.out.bad) 2023-12-12T11:28:35.867 INFO:teuthology.orchestra.run.smithi078.stdout: --- tests/generic/126.out 2023-12-12 10:13:40.384817142 +0000 2023-12-12T11:28:35.867 INFO:teuthology.orchestra.run.smithi078.stdout: +++ /tmp/tmp.GmWnCxuSqIxfstests-dev/results//generic/126.out.bad 2023-12-12 11:28:35.857562362 +0000 2023-12-12T11:28:35.867 INFO:teuthology.orchestra.run.smithi078.stdout: @@ -1,7 +1,7 @@ 2023-12-12T11:28:35.867 INFO:teuthology.orchestra.run.smithi078.stdout: QA output created by 126 2023-12-12T11:28:35.867 INFO:teuthology.orchestra.run.smithi078.stdout: -x a 001 file owned by (99/99) as user/group(12/100) PASS 2023-12-12T11:28:35.868 INFO:teuthology.orchestra.run.smithi078.stdout: -x a 010 file owned by (99/99) as user/group(200/99) PASS 2023-12-12T11:28:35.868 INFO:teuthology.orchestra.run.smithi078.stdout: -x a 100 file owned by (99/99) as user/group(99/500) PASS 2023-12-12T11:28:35.868 INFO:teuthology.orchestra.run.smithi078.stdout: +x a 001 file owned by (99/99) as user/group(12/100) FAIL 2023-12-12T11:28:35.868 INFO:teuthology.orchestra.run.smithi078.stdout: +x a 010 file owned by (99/99) as user/group(200/99) FAIL 2023-12-12T11:28:35.868 INFO:teuthology.orchestra.run.smithi078.stdout: +x a 100 file owned by (99/99) as user/group(99/500) FAIL 2023-12-12T11:28:35.868 INFO:teuthology.orchestra.run.smithi078.stdout: w a 002 file owned by (99/99) as user/group(12/100) PASS 2023-12-12T11:28:35.868 INFO:teuthology.orchestra.run.smithi078.stdout: w a 020 file owned by (99/99) as user/group(200/99) PASS 2023-12-12T11:28:35.868 INFO:teuthology.orchestra.run.smithi078.stdout: w a 200 file owned by (99/99) as user/group(99/500) PASS 2023-12-12T11:28:35.873 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/126 2023-12-12T11:28:35.873 INFO:teuthology.orchestra.run.smithi078.stdout:Failures: generic/126 2023-12-12T11:28:35.873 INFO:teuthology.orchestra.run.smithi078.stdout:Failed 1 of 1 tests 2023-12-12T11:28:35.879 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:28:35.899 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-12T11:28:35.900 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-12-12T11:28:35.900 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-12-12T11:28:35.900 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/127) 2023-12-12T11:28:36.658 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:28:36.669 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:28:36.669 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:29:00.050 INFO:tasks.ceph.osd.0.smithi078.stderr:2023-12-12T11:29:00.049+0000 7f7267fb3640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 177914) UID: 0 2023-12-12T11:29:00.051 INFO:tasks.ceph.osd.1.smithi078.stderr:2023-12-12T11:29:00.049+0000 7fda08c74640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 177914) UID: 0 2023-12-12T11:29:00.051 INFO:tasks.ceph.osd.2.smithi078.stderr:2023-12-12T11:29:00.049+0000 7efffc42e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 177914) UID: 0 2023-12-12T11:29:00.051 INFO:tasks.ceph.osd.3.smithi078.stderr:2023-12-12T11:29:00.049+0000 7f238c6c1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 177914) UID: 0 2023-12-12T11:32:11.313 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T11:32:11.319 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T11:32:41.393 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T11:32:41.398 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T11:33:11.506 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T11:33:11.511 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T11:33:41.628 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T11:33:41.632 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T11:34:11.704 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T11:34:11.710 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T11:34:41.829 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T11:34:41.834 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T11:35:11.885 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T11:35:11.889 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T11:35:42.532 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T11:35:42.537 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T11:36:13.182 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T11:36:13.187 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T11:36:43.254 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T11:36:43.259 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T11:37:13.354 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T11:37:13.358 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T11:37:43.486 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T11:37:43.490 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T11:38:13.591 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T11:38:13.596 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T11:38:43.724 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T11:38:43.731 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T11:39:13.880 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T11:39:13.885 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T11:39:44.036 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T11:39:44.041 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T11:40:14.158 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T11:40:14.163 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T11:40:44.272 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T11:40:44.277 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T11:41:14.376 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T11:41:14.381 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T11:41:45.472 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T11:41:45.477 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T11:41:45.504 INFO:tasks.ceph.osd.0.smithi078.stderr:2023-12-12T11:41:45.500+0000 7f7267fb3640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 178005) UID: 0 2023-12-12T11:41:45.505 INFO:tasks.ceph.osd.1.smithi078.stderr:2023-12-12T11:41:45.500+0000 7fda08c74640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 178005) UID: 0 2023-12-12T11:41:45.505 INFO:tasks.ceph.osd.2.smithi078.stderr:2023-12-12T11:41:45.500+0000 7efffc42e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 178005) UID: 0 2023-12-12T11:41:45.505 INFO:tasks.ceph.osd.3.smithi078.stderr:2023-12-12T11:41:45.500+0000 7f238c6c1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 178005) UID: 0 2023-12-12T11:44:52.020 INFO:teuthology.orchestra.run.smithi078.stdout:generic/127 975s 2023-12-12T11:44:52.072 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/127 2023-12-12T11:44:52.072 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:44:52.078 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:44:52.116 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:44:52.116 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/128) 2023-12-12T11:44:53.118 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:44:53.128 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:44:53.128 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:44:53.418 INFO:teuthology.orchestra.run.smithi078.stdout:generic/128 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T11:44:53.426 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/128 2023-12-12T11:44:53.426 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/128 2023-12-12T11:44:53.426 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:44:53.432 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:44:53.452 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:44:53.452 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/129) 2023-12-12T11:44:53.812 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:44:53.822 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:44:53.822 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:44:54.093 INFO:teuthology.orchestra.run.smithi078.stdout:generic/129 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T11:44:54.101 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/129 2023-12-12T11:44:54.101 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/129 2023-12-12T11:44:54.101 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:44:54.107 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:44:54.127 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:44:54.127 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/130) 2023-12-12T11:44:54.513 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:44:54.523 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:44:54.524 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:44:54.799 INFO:teuthology.orchestra.run.smithi078.stdout:generic/130 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T11:44:54.807 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/130 2023-12-12T11:44:54.808 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/130 2023-12-12T11:44:54.808 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:44:54.813 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:44:54.834 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:44:54.834 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/131) 2023-12-12T11:44:55.191 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:44:55.202 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:44:55.202 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:44:56.722 INFO:teuthology.orchestra.run.smithi078.stdout:generic/131 1s 2023-12-12T11:44:56.735 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/131 2023-12-12T11:44:56.735 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:44:56.741 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:44:56.762 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:44:56.762 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/132) 2023-12-12T11:44:57.431 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:44:57.442 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:44:57.442 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:44:57.743 INFO:teuthology.orchestra.run.smithi078.stdout:generic/132 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T11:44:57.751 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/132 2023-12-12T11:44:57.751 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/132 2023-12-12T11:44:57.752 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:44:57.757 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:44:57.776 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:44:57.777 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/133) 2023-12-12T11:44:57.991 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T11:44:57.995 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T11:44:58.151 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:44:58.161 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:44:58.162 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:45:28.160 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T11:45:28.165 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T11:45:58.373 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T11:45:58.377 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T11:46:28.436 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T11:46:28.441 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T11:46:58.665 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T11:46:58.670 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T11:47:28.762 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T11:47:28.767 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T11:47:58.917 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T11:47:58.922 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T11:48:29.023 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T11:48:29.027 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T11:48:59.127 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T11:48:59.132 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T11:49:28.943 INFO:teuthology.orchestra.run.smithi078.stdout:generic/133 270s 2023-12-12T11:49:28.955 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/133 2023-12-12T11:49:28.955 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:49:28.961 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:49:29.035 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:49:29.035 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/134) 2023-12-12T11:49:29.240 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T11:49:29.246 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T11:49:29.759 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:49:29.769 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:49:29.770 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:49:30.140 INFO:teuthology.orchestra.run.smithi078.stdout:generic/134 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-12-12T11:49:30.148 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/134 2023-12-12T11:49:30.148 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/134 2023-12-12T11:49:30.148 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:49:30.154 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:49:30.182 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:49:30.182 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/135) 2023-12-12T11:49:30.853 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:49:30.861 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:49:30.861 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:49:31.186 INFO:teuthology.orchestra.run.smithi078.stdout:generic/135 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T11:49:31.194 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/135 2023-12-12T11:49:31.194 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/135 2023-12-12T11:49:31.194 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:49:31.200 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:49:31.220 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:49:31.220 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/136) 2023-12-12T11:49:31.600 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:49:31.610 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:49:31.610 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:49:31.977 INFO:teuthology.orchestra.run.smithi078.stdout:generic/136 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2023-12-12T11:49:31.985 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/136 2023-12-12T11:49:31.985 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/136 2023-12-12T11:49:31.985 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:49:31.992 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:49:32.022 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:49:32.022 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/137) 2023-12-12T11:49:32.687 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:49:32.699 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:49:32.699 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:49:33.042 INFO:teuthology.orchestra.run.smithi078.stdout:generic/137 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-12-12T11:49:33.051 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/137 2023-12-12T11:49:33.051 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/137 2023-12-12T11:49:33.051 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:49:33.057 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:49:33.091 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:49:33.091 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/138) 2023-12-12T11:49:33.768 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:49:33.779 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:49:33.779 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:49:34.158 INFO:teuthology.orchestra.run.smithi078.stdout:generic/138 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-12-12T11:49:34.166 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/138 2023-12-12T11:49:34.166 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/138 2023-12-12T11:49:34.166 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:49:34.172 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:49:34.200 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:49:34.200 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/139) 2023-12-12T11:49:34.892 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:49:34.902 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:49:34.902 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:49:35.249 INFO:teuthology.orchestra.run.smithi078.stdout:generic/139 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-12-12T11:49:35.258 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/139 2023-12-12T11:49:35.258 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/139 2023-12-12T11:49:35.258 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:49:35.264 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:49:35.297 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:49:35.297 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/140) 2023-12-12T11:49:35.975 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:49:35.985 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:49:35.986 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:49:36.322 INFO:teuthology.orchestra.run.smithi078.stdout:generic/140 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-12-12T11:49:36.331 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/140 2023-12-12T11:49:36.331 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/140 2023-12-12T11:49:36.331 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:49:36.337 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:49:36.404 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:49:36.404 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/141) 2023-12-12T11:49:37.027 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:49:37.037 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:49:37.037 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:49:37.315 INFO:teuthology.orchestra.run.smithi078.stdout:generic/141 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T11:49:37.323 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/141 2023-12-12T11:49:37.323 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/141 2023-12-12T11:49:37.323 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:49:37.329 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:49:37.349 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:49:37.349 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/142) 2023-12-12T11:49:37.719 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:49:37.730 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:49:37.730 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:49:38.071 INFO:teuthology.orchestra.run.smithi078.stdout:generic/142 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-12-12T11:49:38.079 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/142 2023-12-12T11:49:38.080 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/142 2023-12-12T11:49:38.080 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:49:38.086 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:49:38.131 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:49:38.131 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/143) 2023-12-12T11:49:38.796 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:49:38.806 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:49:38.806 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:49:39.146 INFO:teuthology.orchestra.run.smithi078.stdout:generic/143 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-12-12T11:49:39.154 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/143 2023-12-12T11:49:39.154 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/143 2023-12-12T11:49:39.154 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:49:39.160 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:49:39.204 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:49:39.205 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/144) 2023-12-12T11:49:39.876 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:49:39.886 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:49:39.887 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:49:40.251 INFO:teuthology.orchestra.run.smithi078.stdout:generic/144 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-12-12T11:49:40.259 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/144 2023-12-12T11:49:40.259 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/144 2023-12-12T11:49:40.259 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:49:40.265 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:49:40.286 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:49:40.287 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/145) 2023-12-12T11:49:41.000 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:49:41.010 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:49:41.010 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:49:41.356 INFO:teuthology.orchestra.run.smithi078.stdout:generic/145 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-12-12T11:49:41.364 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/145 2023-12-12T11:49:41.364 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/145 2023-12-12T11:49:41.364 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:49:41.370 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:49:41.584 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:49:41.584 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/146) 2023-12-12T11:49:42.107 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:49:42.118 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:49:42.118 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:49:42.477 INFO:teuthology.orchestra.run.smithi078.stdout:generic/146 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-12-12T11:49:42.485 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/146 2023-12-12T11:49:42.485 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/146 2023-12-12T11:49:42.485 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:49:42.491 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:49:42.537 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:49:42.537 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/147) 2023-12-12T11:49:43.180 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:49:43.190 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:49:43.190 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:49:43.539 INFO:teuthology.orchestra.run.smithi078.stdout:generic/147 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-12-12T11:49:43.547 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/147 2023-12-12T11:49:43.547 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/147 2023-12-12T11:49:43.547 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:49:43.554 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:49:43.585 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:49:43.585 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/148) 2023-12-12T11:49:44.272 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:49:44.282 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:49:44.282 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:49:44.642 INFO:teuthology.orchestra.run.smithi078.stdout:generic/148 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-12-12T11:49:44.650 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/148 2023-12-12T11:49:44.650 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/148 2023-12-12T11:49:44.650 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:49:44.656 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:49:44.684 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:49:44.684 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/149) 2023-12-12T11:49:45.373 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:49:45.383 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:49:45.383 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:49:45.747 INFO:teuthology.orchestra.run.smithi078.stdout:generic/149 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-12-12T11:49:45.755 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/149 2023-12-12T11:49:45.755 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/149 2023-12-12T11:49:45.755 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:49:45.762 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:49:45.782 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:49:45.782 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/150) 2023-12-12T11:49:46.473 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:49:46.481 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:49:46.482 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:49:46.844 INFO:teuthology.orchestra.run.smithi078.stdout:generic/150 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-12-12T11:49:46.854 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/150 2023-12-12T11:49:46.854 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/150 2023-12-12T11:49:46.854 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:49:46.858 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:49:46.891 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:49:46.892 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/151) 2023-12-12T11:49:47.572 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:49:47.582 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:49:47.582 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:49:47.949 INFO:teuthology.orchestra.run.smithi078.stdout:generic/151 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-12-12T11:49:47.957 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/151 2023-12-12T11:49:47.957 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/151 2023-12-12T11:49:47.958 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:49:47.964 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:49:48.003 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:49:48.003 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/152) 2023-12-12T11:49:48.701 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:49:48.713 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:49:48.713 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:49:49.495 INFO:teuthology.orchestra.run.smithi078.stdout:generic/152 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-12-12T11:49:49.503 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/152 2023-12-12T11:49:49.504 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/152 2023-12-12T11:49:49.504 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:49:49.510 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:49:49.532 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:49:49.532 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/153) 2023-12-12T11:49:50.234 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:49:50.245 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:49:50.245 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:49:50.624 INFO:teuthology.orchestra.run.smithi078.stdout:generic/153 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-12-12T11:49:50.633 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/153 2023-12-12T11:49:50.633 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/153 2023-12-12T11:49:50.633 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:49:50.639 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:49:50.684 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:49:50.685 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/154) 2023-12-12T11:49:51.335 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:49:51.346 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:49:51.346 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:49:51.691 INFO:teuthology.orchestra.run.smithi078.stdout:generic/154 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-12-12T11:49:51.699 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/154 2023-12-12T11:49:51.699 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/154 2023-12-12T11:49:51.699 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:49:51.705 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:49:51.738 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:49:51.738 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/155) 2023-12-12T11:49:52.432 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:49:52.442 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:49:52.442 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:49:52.813 INFO:teuthology.orchestra.run.smithi078.stdout:generic/155 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-12-12T11:49:52.819 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/155 2023-12-12T11:49:52.819 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/155 2023-12-12T11:49:52.819 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:49:52.825 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:49:52.900 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:49:52.900 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/156) 2023-12-12T11:49:53.539 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:49:53.549 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:49:53.549 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:49:53.926 INFO:teuthology.orchestra.run.smithi078.stdout:generic/156 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-12-12T11:49:53.934 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/156 2023-12-12T11:49:53.934 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/156 2023-12-12T11:49:53.934 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:49:53.941 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:49:53.963 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:49:53.963 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/157) 2023-12-12T11:49:54.627 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:49:54.639 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:49:54.639 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:49:55.106 INFO:teuthology.orchestra.run.smithi078.stdout:generic/157 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-12-12T11:49:55.114 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/157 2023-12-12T11:49:55.115 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/157 2023-12-12T11:49:55.115 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:49:55.121 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:49:55.142 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:49:55.143 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/158) 2023-12-12T11:49:55.819 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:49:55.830 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:49:55.830 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:49:56.209 INFO:teuthology.orchestra.run.smithi078.stdout:generic/158 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2023-12-12T11:49:56.217 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/158 2023-12-12T11:49:56.217 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/158 2023-12-12T11:49:56.217 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:49:56.223 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:49:56.246 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:49:56.247 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/159) 2023-12-12T11:49:56.940 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:49:56.951 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:49:56.951 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:49:57.296 INFO:teuthology.orchestra.run.smithi078.stdout:generic/159 [not run] file system doesn't support chattr +i 2023-12-12T11:49:57.304 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/159 2023-12-12T11:49:57.304 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/159 2023-12-12T11:49:57.304 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:49:57.311 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:49:57.330 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:49:57.330 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/160) 2023-12-12T11:49:57.728 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:49:57.739 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:49:57.739 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:49:58.063 INFO:teuthology.orchestra.run.smithi078.stdout:generic/160 [not run] file system doesn't support chattr +i 2023-12-12T11:49:58.072 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/160 2023-12-12T11:49:58.072 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/160 2023-12-12T11:49:58.072 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:49:58.078 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:49:58.150 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:49:58.151 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/161) 2023-12-12T11:49:58.512 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:49:58.522 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:49:58.522 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:49:58.801 INFO:teuthology.orchestra.run.smithi078.stdout:generic/161 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T11:49:58.810 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/161 2023-12-12T11:49:58.810 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/161 2023-12-12T11:49:58.810 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:49:58.816 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:49:58.836 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:49:58.836 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/162) 2023-12-12T11:49:59.191 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:49:59.202 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:49:59.202 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:49:59.341 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T11:49:59.345 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T11:49:59.489 INFO:teuthology.orchestra.run.smithi078.stdout:generic/162 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T11:49:59.498 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/162 2023-12-12T11:49:59.498 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/162 2023-12-12T11:49:59.498 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:49:59.504 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:49:59.523 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:49:59.523 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/163) 2023-12-12T11:49:59.891 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:49:59.903 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:49:59.903 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:50:00.174 INFO:teuthology.orchestra.run.smithi078.stdout:generic/163 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T11:50:00.182 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/163 2023-12-12T11:50:00.182 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/163 2023-12-12T11:50:00.183 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:50:00.188 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:50:00.207 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:50:00.207 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/164) 2023-12-12T11:50:00.597 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:50:00.607 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:50:00.607 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:50:00.897 INFO:teuthology.orchestra.run.smithi078.stdout:generic/164 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T11:50:00.905 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/164 2023-12-12T11:50:00.905 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/164 2023-12-12T11:50:00.906 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:50:00.912 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:50:00.932 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:50:00.932 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/165) 2023-12-12T11:50:01.319 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:50:01.330 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:50:01.330 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:50:01.627 INFO:teuthology.orchestra.run.smithi078.stdout:generic/165 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T11:50:01.635 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/165 2023-12-12T11:50:01.635 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/165 2023-12-12T11:50:01.635 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:50:01.642 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:50:01.660 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:50:01.661 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/166) 2023-12-12T11:50:02.063 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:50:02.073 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:50:02.073 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:50:02.367 INFO:teuthology.orchestra.run.smithi078.stdout:generic/166 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T11:50:02.375 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/166 2023-12-12T11:50:02.375 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/166 2023-12-12T11:50:02.375 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:50:02.381 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:50:02.401 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:50:02.402 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/167) 2023-12-12T11:50:02.783 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:50:02.794 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:50:02.794 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:50:03.063 INFO:teuthology.orchestra.run.smithi078.stdout:generic/167 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T11:50:03.091 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/167 2023-12-12T11:50:03.091 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/167 2023-12-12T11:50:03.091 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:50:03.091 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:50:03.131 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:50:03.131 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/168) 2023-12-12T11:50:03.487 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:50:03.498 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:50:03.498 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:50:03.785 INFO:teuthology.orchestra.run.smithi078.stdout:generic/168 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T11:50:03.793 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/168 2023-12-12T11:50:03.793 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/168 2023-12-12T11:50:03.793 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:50:03.799 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:50:03.821 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:50:03.822 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/169) 2023-12-12T11:50:04.208 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:50:04.218 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:50:04.218 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:50:04.490 INFO:teuthology.orchestra.run.smithi078.stdout:generic/169 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T11:50:04.498 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/169 2023-12-12T11:50:04.498 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/169 2023-12-12T11:50:04.498 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:50:04.504 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:50:04.523 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:50:04.523 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/170) 2023-12-12T11:50:04.876 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:50:04.887 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:50:04.887 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:50:05.169 INFO:teuthology.orchestra.run.smithi078.stdout:generic/170 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T11:50:05.177 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/170 2023-12-12T11:50:05.178 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/170 2023-12-12T11:50:05.178 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:50:05.184 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:50:05.202 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:50:05.203 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/171) 2023-12-12T11:50:05.588 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:50:05.598 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:50:05.599 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:50:05.917 INFO:teuthology.orchestra.run.smithi078.stdout:generic/171 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T11:50:05.925 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/171 2023-12-12T11:50:05.925 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/171 2023-12-12T11:50:05.925 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:50:05.931 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:50:05.951 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:50:05.951 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/172) 2023-12-12T11:50:06.336 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:50:06.347 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:50:06.347 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:50:06.642 INFO:teuthology.orchestra.run.smithi078.stdout:generic/172 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T11:50:06.650 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/172 2023-12-12T11:50:06.651 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/172 2023-12-12T11:50:06.651 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:50:06.657 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:50:06.677 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:50:06.677 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/173) 2023-12-12T11:50:07.048 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:50:07.058 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:50:07.058 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:50:07.338 INFO:teuthology.orchestra.run.smithi078.stdout:generic/173 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T11:50:07.346 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/173 2023-12-12T11:50:07.347 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/173 2023-12-12T11:50:07.347 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:50:07.352 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:50:07.372 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:50:07.373 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/174) 2023-12-12T11:50:07.743 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:50:07.754 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:50:07.754 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:50:08.043 INFO:teuthology.orchestra.run.smithi078.stdout:generic/174 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T11:50:08.049 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/174 2023-12-12T11:50:08.049 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/174 2023-12-12T11:50:08.049 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:50:08.056 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:50:08.118 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:50:08.118 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/175) 2023-12-12T11:50:08.496 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:50:08.506 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:50:08.506 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:50:08.786 INFO:teuthology.orchestra.run.smithi078.stdout:generic/175 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T11:50:08.794 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/175 2023-12-12T11:50:08.794 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/175 2023-12-12T11:50:08.794 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:50:08.800 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:50:08.820 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:50:08.820 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/176) 2023-12-12T11:50:09.188 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:50:09.198 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:50:09.199 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:50:09.488 INFO:teuthology.orchestra.run.smithi078.stdout:generic/176 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T11:50:09.496 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/176 2023-12-12T11:50:09.496 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/176 2023-12-12T11:50:09.496 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:50:09.502 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:50:09.521 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:50:09.521 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/177) 2023-12-12T11:50:09.875 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:50:09.885 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:50:09.886 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:50:10.228 INFO:teuthology.orchestra.run.smithi078.stdout:generic/177 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T11:50:10.236 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/177 2023-12-12T11:50:10.236 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/177 2023-12-12T11:50:10.236 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:50:10.242 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:50:10.261 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:50:10.261 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/178) 2023-12-12T11:50:10.631 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:50:10.642 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:50:10.642 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:50:10.985 INFO:teuthology.orchestra.run.smithi078.stdout:generic/178 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-12-12T11:50:10.993 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/178 2023-12-12T11:50:10.993 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/178 2023-12-12T11:50:10.993 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:50:10.999 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:50:11.031 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:50:11.031 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/179) 2023-12-12T11:50:11.720 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:50:11.731 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:50:11.732 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:50:12.072 INFO:teuthology.orchestra.run.smithi078.stdout:generic/179 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-12-12T11:50:12.080 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/179 2023-12-12T11:50:12.080 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/179 2023-12-12T11:50:12.080 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:50:12.086 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:50:12.107 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:50:12.107 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/180) 2023-12-12T11:50:12.808 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:50:12.818 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:50:12.818 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:50:13.169 INFO:teuthology.orchestra.run.smithi078.stdout:generic/180 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-12-12T11:50:13.177 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/180 2023-12-12T11:50:13.178 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/180 2023-12-12T11:50:13.178 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:50:13.184 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:50:13.384 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:50:13.385 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/181) 2023-12-12T11:50:13.897 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:50:13.906 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:50:13.906 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:50:14.258 INFO:teuthology.orchestra.run.smithi078.stdout:generic/181 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-12-12T11:50:14.266 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/181 2023-12-12T11:50:14.266 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/181 2023-12-12T11:50:14.267 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:50:14.273 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:50:14.305 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:50:14.305 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/182) 2023-12-12T11:50:14.983 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:50:14.994 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:50:14.994 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:50:15.403 INFO:teuthology.orchestra.run.smithi078.stdout:generic/182 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2023-12-12T11:50:15.410 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/182 2023-12-12T11:50:15.410 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/182 2023-12-12T11:50:15.410 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:50:15.416 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:50:15.446 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:50:15.446 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/183) 2023-12-12T11:50:16.136 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:50:16.147 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:50:16.147 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:50:16.427 INFO:teuthology.orchestra.run.smithi078.stdout:generic/183 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T11:50:16.436 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/183 2023-12-12T11:50:16.436 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/183 2023-12-12T11:50:16.436 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:50:16.442 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:50:16.462 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:50:16.462 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/184) 2023-12-12T11:50:16.856 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:50:16.867 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:50:16.867 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:50:17.220 INFO:teuthology.orchestra.run.smithi078.stdout:generic/184 [failed, exit status 1]- output mismatch (see /tmp/tmp.GmWnCxuSqIxfstests-dev/results//generic/184.out.bad) 2023-12-12T11:50:17.225 INFO:teuthology.orchestra.run.smithi078.stdout: --- tests/generic/184.out 2023-12-12 10:13:40.392816895 +0000 2023-12-12T11:50:17.225 INFO:teuthology.orchestra.run.smithi078.stdout: +++ /tmp/tmp.GmWnCxuSqIxfstests-dev/results//generic/184.out.bad 2023-12-12 11:50:17.212365995 +0000 2023-12-12T11:50:17.225 INFO:teuthology.orchestra.run.smithi078.stdout: @@ -1 +1,2 @@ 2023-12-12T11:50:17.225 INFO:teuthology.orchestra.run.smithi078.stdout: QA output created by 184 2023-12-12T11:50:17.225 INFO:teuthology.orchestra.run.smithi078.stdout: +/tmp/tmp.GmWnCxuSqIxfstests-dev/tests/generic/184: line 23: /tmp/tmp.Rxjq0xhkP8test/null: Permission denied 2023-12-12T11:50:17.231 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/184 2023-12-12T11:50:17.231 INFO:teuthology.orchestra.run.smithi078.stdout:Failures: generic/184 2023-12-12T11:50:17.231 INFO:teuthology.orchestra.run.smithi078.stdout:Failed 1 of 1 tests 2023-12-12T11:50:17.237 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:50:17.255 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-12T11:50:17.256 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-12-12T11:50:17.256 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-12-12T11:50:17.256 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/185) 2023-12-12T11:50:17.632 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:50:17.642 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:50:17.642 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:50:17.924 INFO:teuthology.orchestra.run.smithi078.stdout:generic/185 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T11:50:17.933 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/185 2023-12-12T11:50:17.933 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/185 2023-12-12T11:50:17.933 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:50:17.939 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:50:17.959 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:50:17.960 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/186) 2023-12-12T11:50:18.328 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:50:18.339 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:50:18.339 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:50:18.635 INFO:teuthology.orchestra.run.smithi078.stdout:generic/186 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T11:50:18.644 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/186 2023-12-12T11:50:18.644 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/186 2023-12-12T11:50:18.644 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:50:18.650 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:50:18.670 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:50:18.671 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/187) 2023-12-12T11:50:19.040 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:50:19.050 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:50:19.050 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:50:19.314 INFO:teuthology.orchestra.run.smithi078.stdout:generic/187 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T11:50:19.322 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/187 2023-12-12T11:50:19.322 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/187 2023-12-12T11:50:19.322 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:50:19.329 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:50:19.349 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:50:19.349 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/188) 2023-12-12T11:50:19.699 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:50:19.709 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:50:19.709 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:50:20.006 INFO:teuthology.orchestra.run.smithi078.stdout:generic/188 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T11:50:20.014 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/188 2023-12-12T11:50:20.014 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/188 2023-12-12T11:50:20.014 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:50:20.020 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:50:20.040 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:50:20.041 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/189) 2023-12-12T11:50:20.398 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:50:20.408 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:50:20.408 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:50:20.687 INFO:teuthology.orchestra.run.smithi078.stdout:generic/189 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T11:50:20.695 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/189 2023-12-12T11:50:20.695 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/189 2023-12-12T11:50:20.695 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:50:20.701 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:50:20.721 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:50:20.721 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/190) 2023-12-12T11:50:21.101 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:50:21.111 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:50:21.111 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:50:21.398 INFO:teuthology.orchestra.run.smithi078.stdout:generic/190 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T11:50:21.406 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/190 2023-12-12T11:50:21.406 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/190 2023-12-12T11:50:21.406 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:50:21.412 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:50:21.432 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:50:21.432 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/191) 2023-12-12T11:50:21.804 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:50:21.815 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:50:21.815 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:50:22.079 INFO:teuthology.orchestra.run.smithi078.stdout:generic/191 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T11:50:22.087 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/191 2023-12-12T11:50:22.087 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/191 2023-12-12T11:50:22.089 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:50:22.094 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:50:22.113 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:50:22.114 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/192) 2023-12-12T11:50:22.481 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:50:22.492 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:50:22.492 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:50:22.793 INFO:teuthology.orchestra.run.smithi078.stdout:generic/192 [not run] atime not maintained by ceph-fuse 2023-12-12T11:50:22.802 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/192 2023-12-12T11:50:22.802 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/192 2023-12-12T11:50:22.802 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:50:22.808 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:50:22.827 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:50:22.827 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/193) 2023-12-12T11:50:23.191 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:50:23.203 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:50:23.203 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:50:24.805 INFO:teuthology.orchestra.run.smithi078.stdout:generic/193 - output mismatch (see /tmp/tmp.GmWnCxuSqIxfstests-dev/results//generic/193.out.bad) 2023-12-12T11:50:24.810 INFO:teuthology.orchestra.run.smithi078.stdout: --- tests/generic/193.out 2023-12-12 10:13:40.392816895 +0000 2023-12-12T11:50:24.811 INFO:teuthology.orchestra.run.smithi078.stdout: +++ /tmp/tmp.GmWnCxuSqIxfstests-dev/results//generic/193.out.bad 2023-12-12 11:50:24.796233489 +0000 2023-12-12T11:50:24.811 INFO:teuthology.orchestra.run.smithi078.stdout: @@ -24,7 +24,6 @@ 2023-12-12T11:50:24.811 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:50:24.811 INFO:teuthology.orchestra.run.smithi078.stdout: user: chmod a+r on qa_user owned file (should succeed) 2023-12-12T11:50:24.811 INFO:teuthology.orchestra.run.smithi078.stdout: user: chmod a+r on root owned file (should fail) 2023-12-12T11:50:24.811 INFO:teuthology.orchestra.run.smithi078.stdout: -chmod: changing permissions of 'test.root': Operation not permitted 2023-12-12T11:50:24.811 INFO:teuthology.orchestra.run.smithi078.stdout: check that the sgid bit is cleared 2023-12-12T11:50:24.811 INFO:teuthology.orchestra.run.smithi078.stdout: -rw-rw-rw- 2023-12-12T11:50:24.811 INFO:teuthology.orchestra.run.smithi078.stdout: check that suid bit is not cleared 2023-12-12T11:50:24.816 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/193 2023-12-12T11:50:24.816 INFO:teuthology.orchestra.run.smithi078.stdout:Failures: generic/193 2023-12-12T11:50:24.816 INFO:teuthology.orchestra.run.smithi078.stdout:Failed 1 of 1 tests 2023-12-12T11:50:24.823 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:50:24.874 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-12T11:50:24.875 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-12-12T11:50:24.875 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-12-12T11:50:24.875 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/194) 2023-12-12T11:50:25.531 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:50:25.542 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:50:25.542 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:50:25.832 INFO:teuthology.orchestra.run.smithi078.stdout:generic/194 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T11:50:25.840 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/194 2023-12-12T11:50:25.840 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/194 2023-12-12T11:50:25.840 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:50:25.846 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:50:25.866 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:50:25.866 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/195) 2023-12-12T11:50:26.249 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:50:26.260 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:50:26.260 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:50:26.532 INFO:teuthology.orchestra.run.smithi078.stdout:generic/195 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T11:50:26.541 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/195 2023-12-12T11:50:26.541 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/195 2023-12-12T11:50:26.541 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:50:26.547 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:50:26.567 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:50:26.568 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/196) 2023-12-12T11:50:26.929 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:50:26.939 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:50:26.939 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:50:27.207 INFO:teuthology.orchestra.run.smithi078.stdout:generic/196 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T11:50:27.218 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/196 2023-12-12T11:50:27.219 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/196 2023-12-12T11:50:27.219 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:50:27.222 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:50:27.242 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:50:27.243 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/197) 2023-12-12T11:50:27.611 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:50:27.622 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:50:27.622 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:50:27.897 INFO:teuthology.orchestra.run.smithi078.stdout:generic/197 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T11:50:27.905 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/197 2023-12-12T11:50:27.905 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/197 2023-12-12T11:50:27.905 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:50:27.911 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:50:27.931 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:50:27.931 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/198) 2023-12-12T11:50:28.295 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:50:28.306 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:50:28.306 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:50:29.636 INFO:teuthology.orchestra.run.smithi078.stdout:generic/198 1s 2023-12-12T11:50:29.649 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/198 2023-12-12T11:50:29.649 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:50:29.655 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:50:29.675 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:50:29.676 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/199) 2023-12-12T11:50:29.903 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T11:50:29.908 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T11:50:30.421 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:50:30.431 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:50:30.431 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:50:30.725 INFO:teuthology.orchestra.run.smithi078.stdout:generic/199 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T11:50:30.733 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/199 2023-12-12T11:50:30.733 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/199 2023-12-12T11:50:30.733 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:50:30.739 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:50:30.759 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:50:30.759 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/200) 2023-12-12T11:50:31.120 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:50:31.130 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:50:31.130 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:50:31.424 INFO:teuthology.orchestra.run.smithi078.stdout:generic/200 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T11:50:31.432 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/200 2023-12-12T11:50:31.432 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/200 2023-12-12T11:50:31.432 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:50:31.438 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:50:31.459 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:50:31.459 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/201) 2023-12-12T11:50:31.827 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:50:31.838 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:50:31.839 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:50:32.113 INFO:teuthology.orchestra.run.smithi078.stdout:generic/201 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T11:50:32.121 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/201 2023-12-12T11:50:32.121 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/201 2023-12-12T11:50:32.121 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:50:32.127 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:50:32.147 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:50:32.148 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/202) 2023-12-12T11:50:32.515 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:50:32.526 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:50:32.526 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:50:32.813 INFO:teuthology.orchestra.run.smithi078.stdout:generic/202 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T11:50:32.821 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/202 2023-12-12T11:50:32.821 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/202 2023-12-12T11:50:32.822 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:50:32.827 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:50:32.847 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:50:32.847 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/203) 2023-12-12T11:50:33.207 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:50:33.218 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:50:33.218 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:50:33.489 INFO:teuthology.orchestra.run.smithi078.stdout:generic/203 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T11:50:33.497 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/203 2023-12-12T11:50:33.497 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/203 2023-12-12T11:50:33.497 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:50:33.503 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:50:33.523 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:50:33.523 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/204) 2023-12-12T11:50:33.898 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:50:33.909 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:50:33.909 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:50:34.924 INFO:teuthology.orchestra.run.smithi078.stdout:generic/204 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T11:50:34.933 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/204 2023-12-12T11:50:34.933 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/204 2023-12-12T11:50:34.933 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:50:34.941 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:50:35.008 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:50:35.008 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/205) 2023-12-12T11:50:35.381 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:50:35.392 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:50:35.392 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:50:35.688 INFO:teuthology.orchestra.run.smithi078.stdout:generic/205 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T11:50:35.696 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/205 2023-12-12T11:50:35.696 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/205 2023-12-12T11:50:35.696 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:50:35.702 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:50:35.722 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:50:35.722 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/206) 2023-12-12T11:50:36.088 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:50:36.099 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:50:36.099 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:50:36.377 INFO:teuthology.orchestra.run.smithi078.stdout:generic/206 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T11:50:36.385 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/206 2023-12-12T11:50:36.386 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/206 2023-12-12T11:50:36.386 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:50:36.392 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:50:36.411 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:50:36.412 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/207) 2023-12-12T11:50:36.800 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:50:36.811 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:50:36.811 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:50:56.839 INFO:teuthology.orchestra.run.smithi078.stdout:generic/207 20s 2023-12-12T11:50:56.851 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/207 2023-12-12T11:50:56.852 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:50:56.857 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:50:56.885 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:50:56.886 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/208) 2023-12-12T11:50:57.587 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:50:57.597 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:50:57.598 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:51:00.063 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T11:51:00.068 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T11:51:30.668 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T11:51:30.674 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T11:52:00.738 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T11:52:00.742 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T11:52:00.817 INFO:tasks.ceph.osd.4.smithi187.stderr:2023-12-12T11:52:00.815+0000 7fcf5f6ed640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45309) UID: 0 2023-12-12T11:52:00.817 INFO:tasks.ceph.osd.5.smithi187.stderr:2023-12-12T11:52:00.815+0000 7f363eb0f640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45309) UID: 0 2023-12-12T11:52:00.818 INFO:tasks.ceph.osd.6.smithi187.stderr:2023-12-12T11:52:00.815+0000 7fb917830640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45309) UID: 0 2023-12-12T11:52:00.818 INFO:tasks.ceph.osd.7.smithi187.stderr:2023-12-12T11:52:00.815+0000 7f9c745c6640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45309) UID: 0 2023-12-12T11:54:18.104 INFO:teuthology.orchestra.run.smithi078.stdout:generic/208 201s 2023-12-12T11:54:18.115 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/208 2023-12-12T11:54:18.115 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:54:18.122 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:54:18.163 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:54:18.164 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/209) 2023-12-12T11:54:18.836 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:54:18.847 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:54:18.847 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:54:31.220 INFO:teuthology.orchestra.run.smithi078.stdout:generic/209 [failed, exit status 1]- output mismatch (see /tmp/tmp.GmWnCxuSqIxfstests-dev/results//generic/209.out.bad) 2023-12-12T11:54:31.257 INFO:teuthology.orchestra.run.smithi078.stdout: --- tests/generic/209.out 2023-12-12 10:13:40.392816895 +0000 2023-12-12T11:54:31.257 INFO:teuthology.orchestra.run.smithi078.stdout: +++ /tmp/tmp.GmWnCxuSqIxfstests-dev/results//generic/209.out.bad 2023-12-12 11:54:31.204129829 +0000 2023-12-12T11:54:31.258 INFO:teuthology.orchestra.run.smithi078.stdout: @@ -1,2 +1,2 @@ 2023-12-12T11:54:31.258 INFO:teuthology.orchestra.run.smithi078.stdout: QA output created by 209 2023-12-12T11:54:31.258 INFO:teuthology.orchestra.run.smithi078.stdout: -test ran for 30 seconds without error 2023-12-12T11:54:31.258 INFO:teuthology.orchestra.run.smithi078.stdout: +reader found old byte at pos 4096 2023-12-12T11:54:31.258 INFO:teuthology.orchestra.run.smithi078.stdout: \ No newline at end of file 2023-12-12T11:54:31.298 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/209 2023-12-12T11:54:31.299 INFO:teuthology.orchestra.run.smithi078.stdout:Failures: generic/209 2023-12-12T11:54:31.299 INFO:teuthology.orchestra.run.smithi078.stdout:Failed 1 of 1 tests 2023-12-12T11:54:31.312 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:54:31.384 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-12T11:54:31.384 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-12-12T11:54:31.385 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-12-12T11:54:31.385 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/210) 2023-12-12T11:54:31.752 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:54:31.763 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:54:31.763 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:54:32.285 INFO:teuthology.orchestra.run.smithi078.stdout:generic/210 1s 2023-12-12T11:54:32.297 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/210 2023-12-12T11:54:32.298 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:54:32.304 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:54:32.363 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:54:32.363 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/211) 2023-12-12T11:54:33.012 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:54:33.023 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:54:33.023 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:54:33.858 INFO:teuthology.orchestra.run.smithi078.stdout:generic/211 0s 2023-12-12T11:54:33.871 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/211 2023-12-12T11:54:33.871 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:54:33.877 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:54:33.897 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:54:33.897 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/212) 2023-12-12T11:54:34.264 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:54:34.307 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:54:34.307 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:54:34.714 INFO:teuthology.orchestra.run.smithi078.stdout:generic/212 0s 2023-12-12T11:54:34.727 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/212 2023-12-12T11:54:34.727 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:54:34.733 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:54:34.754 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:54:34.757 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/213) 2023-12-12T11:54:35.123 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:54:35.134 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:54:35.134 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:54:35.758 INFO:teuthology.orchestra.run.smithi078.stdout:generic/213 - output mismatch (see /tmp/tmp.GmWnCxuSqIxfstests-dev/results//generic/213.out.bad) 2023-12-12T11:54:35.764 INFO:teuthology.orchestra.run.smithi078.stdout: --- tests/generic/213.out 2023-12-12 10:13:40.392816895 +0000 2023-12-12T11:54:35.764 INFO:teuthology.orchestra.run.smithi078.stdout: +++ /tmp/tmp.GmWnCxuSqIxfstests-dev/results//generic/213.out.bad 2023-12-12 11:54:35.752056123 +0000 2023-12-12T11:54:35.764 INFO:teuthology.orchestra.run.smithi078.stdout: @@ -1,4 +1,3 @@ 2023-12-12T11:54:35.764 INFO:teuthology.orchestra.run.smithi078.stdout: QA output created by 213 2023-12-12T11:54:35.764 INFO:teuthology.orchestra.run.smithi078.stdout: We should get: fallocate: No space left on device 2023-12-12T11:54:35.765 INFO:teuthology.orchestra.run.smithi078.stdout: Strangely, xfs_io sometimes says "Success" when something went wrong, FYI 2023-12-12T11:54:35.765 INFO:teuthology.orchestra.run.smithi078.stdout: -fallocate: No space left on device 2023-12-12T11:54:35.770 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/213 2023-12-12T11:54:35.770 INFO:teuthology.orchestra.run.smithi078.stdout:Failures: generic/213 2023-12-12T11:54:35.770 INFO:teuthology.orchestra.run.smithi078.stdout:Failed 1 of 1 tests 2023-12-12T11:54:35.776 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:54:35.845 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-12T11:54:35.846 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-12-12T11:54:35.846 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-12-12T11:54:35.846 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/214) 2023-12-12T11:54:36.546 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:54:36.563 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:54:36.564 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:54:37.486 INFO:teuthology.orchestra.run.smithi078.stdout:generic/214 1s 2023-12-12T11:54:37.505 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/214 2023-12-12T11:54:37.505 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:54:37.514 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:54:37.544 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:54:37.545 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/215) 2023-12-12T11:54:38.370 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:54:38.387 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:54:38.387 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:54:42.333 INFO:teuthology.orchestra.run.smithi078.stdout:generic/215 4s 2023-12-12T11:54:42.353 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/215 2023-12-12T11:54:42.353 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:54:42.362 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:54:42.396 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:54:42.397 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/216) 2023-12-12T11:54:42.917 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:54:42.932 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:54:42.932 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:54:43.316 INFO:teuthology.orchestra.run.smithi078.stdout:generic/216 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T11:54:43.327 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/216 2023-12-12T11:54:43.327 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/216 2023-12-12T11:54:43.327 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:54:43.338 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:54:43.367 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:54:43.367 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/217) 2023-12-12T11:54:43.902 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:54:43.917 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:54:43.917 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:54:44.515 INFO:teuthology.orchestra.run.smithi078.stdout:generic/217 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T11:54:44.524 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/217 2023-12-12T11:54:44.525 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/217 2023-12-12T11:54:44.525 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:54:44.532 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:54:44.557 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:54:44.557 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/218) 2023-12-12T11:54:45.125 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:54:45.141 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:54:45.142 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:54:45.545 INFO:teuthology.orchestra.run.smithi078.stdout:generic/218 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T11:54:45.558 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/218 2023-12-12T11:54:45.558 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/218 2023-12-12T11:54:45.558 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:54:45.569 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:54:45.600 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:54:45.600 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/219) 2023-12-12T11:54:46.127 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:54:46.143 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:54:46.144 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:54:46.529 INFO:teuthology.orchestra.run.smithi078.stdout:generic/219 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T11:54:46.541 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/219 2023-12-12T11:54:46.541 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/219 2023-12-12T11:54:46.541 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:54:46.549 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:54:46.579 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:54:46.580 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/220) 2023-12-12T11:54:47.121 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:54:47.135 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:54:47.135 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:54:47.554 INFO:teuthology.orchestra.run.smithi078.stdout:generic/220 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T11:54:47.566 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/220 2023-12-12T11:54:47.566 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/220 2023-12-12T11:54:47.566 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:54:47.575 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:54:47.604 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:54:47.604 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/221) 2023-12-12T11:54:48.148 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:54:48.163 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:54:48.163 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:54:49.631 INFO:teuthology.orchestra.run.smithi078.stdout:generic/221 1s 2023-12-12T11:54:49.644 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/221 2023-12-12T11:54:49.644 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:54:49.653 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:54:49.690 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:54:49.690 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/222) 2023-12-12T11:54:50.214 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:54:50.228 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:54:50.228 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:54:50.601 INFO:teuthology.orchestra.run.smithi078.stdout:generic/222 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T11:54:50.613 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/222 2023-12-12T11:54:50.613 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/222 2023-12-12T11:54:50.613 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:54:50.623 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:54:50.696 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:54:50.696 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/223) 2023-12-12T11:54:51.211 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:54:51.226 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:54:51.226 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:54:51.631 INFO:teuthology.orchestra.run.smithi078.stdout:generic/223 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T11:54:51.642 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/223 2023-12-12T11:54:51.642 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/223 2023-12-12T11:54:51.642 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:54:51.650 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:54:51.714 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:54:51.714 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/224) 2023-12-12T11:54:52.278 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:54:52.293 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:54:52.293 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:54:52.684 INFO:teuthology.orchestra.run.smithi078.stdout:generic/224 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T11:54:52.698 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/224 2023-12-12T11:54:52.698 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/224 2023-12-12T11:54:52.698 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:54:52.707 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:54:52.776 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:54:52.776 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/225) 2023-12-12T11:54:53.319 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:54:53.337 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:54:53.337 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:54:53.769 INFO:teuthology.orchestra.run.smithi078.stdout:generic/225 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T11:54:53.782 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/225 2023-12-12T11:54:53.782 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/225 2023-12-12T11:54:53.782 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:54:53.791 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:54:53.816 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:54:53.816 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/226) 2023-12-12T11:54:54.355 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:54:54.369 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:54:54.369 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:54:54.763 INFO:teuthology.orchestra.run.smithi078.stdout:generic/226 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T11:54:54.774 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/226 2023-12-12T11:54:54.774 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/226 2023-12-12T11:54:54.774 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:54:54.783 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:54:54.812 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:54:54.812 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/227) 2023-12-12T11:54:55.369 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:54:55.381 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:54:55.381 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:54:55.755 INFO:teuthology.orchestra.run.smithi078.stdout:generic/227 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T11:54:55.766 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/227 2023-12-12T11:54:55.766 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/227 2023-12-12T11:54:55.766 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:54:55.775 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:54:55.842 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:54:55.842 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/228) 2023-12-12T11:54:56.392 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:54:56.405 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:54:56.406 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:54:57.051 INFO:teuthology.orchestra.run.smithi078.stdout:generic/228 1s 2023-12-12T11:54:57.069 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/228 2023-12-12T11:54:57.069 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:54:57.076 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:54:57.135 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:54:57.136 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/229) 2023-12-12T11:54:57.925 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:54:57.939 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:54:57.939 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:54:58.331 INFO:teuthology.orchestra.run.smithi078.stdout:generic/229 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T11:54:58.344 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/229 2023-12-12T11:54:58.344 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/229 2023-12-12T11:54:58.344 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:54:58.352 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:54:58.382 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:54:58.382 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/230) 2023-12-12T11:54:58.937 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:54:58.954 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:54:58.954 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:54:59.361 INFO:teuthology.orchestra.run.smithi078.stdout:generic/230 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T11:54:59.371 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/230 2023-12-12T11:54:59.371 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/230 2023-12-12T11:54:59.371 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:54:59.381 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:54:59.408 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:54:59.408 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/231) 2023-12-12T11:54:59.936 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:54:59.954 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:54:59.954 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:55:00.349 INFO:teuthology.orchestra.run.smithi078.stdout:generic/231 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T11:55:00.359 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/231 2023-12-12T11:55:00.359 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/231 2023-12-12T11:55:00.359 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:55:00.367 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:55:00.402 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:55:00.402 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/232) 2023-12-12T11:55:00.958 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:55:00.973 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:55:00.973 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:55:01.354 INFO:teuthology.orchestra.run.smithi078.stdout:generic/232 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T11:55:01.365 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/232 2023-12-12T11:55:01.366 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/232 2023-12-12T11:55:01.367 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:55:01.375 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:55:01.405 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:55:01.406 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/233) 2023-12-12T11:55:01.471 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T11:55:01.476 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T11:55:01.964 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:55:01.979 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:55:01.980 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:55:02.380 INFO:teuthology.orchestra.run.smithi078.stdout:generic/233 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T11:55:02.390 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/233 2023-12-12T11:55:02.390 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/233 2023-12-12T11:55:02.390 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:55:02.397 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:55:02.426 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:55:02.427 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/234) 2023-12-12T11:55:02.959 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:55:02.973 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:55:02.973 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:55:03.373 INFO:teuthology.orchestra.run.smithi078.stdout:generic/234 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T11:55:03.378 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/234 2023-12-12T11:55:03.379 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/234 2023-12-12T11:55:03.379 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:55:03.388 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:55:03.422 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:55:03.422 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/235) 2023-12-12T11:55:03.952 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:55:03.968 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:55:03.969 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:55:04.400 INFO:teuthology.orchestra.run.smithi078.stdout:generic/235 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T11:55:04.413 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/235 2023-12-12T11:55:04.413 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/235 2023-12-12T11:55:04.414 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:55:04.424 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:55:04.493 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:55:04.494 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/236) 2023-12-12T11:55:05.037 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:55:05.055 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:55:05.056 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:55:06.656 INFO:teuthology.orchestra.run.smithi078.stdout:generic/236 1s 2023-12-12T11:55:06.674 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/236 2023-12-12T11:55:06.674 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:55:06.683 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:55:06.772 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:55:06.772 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/237) 2023-12-12T11:55:07.558 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:55:07.573 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:55:07.573 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:55:08.090 INFO:teuthology.orchestra.run.smithi078.stdout:generic/237 [not run] ACLs not supported by this filesystem type: ceph-fuse 2023-12-12T11:55:08.103 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/237 2023-12-12T11:55:08.103 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/237 2023-12-12T11:55:08.103 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:55:08.116 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:55:08.140 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:55:08.141 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/238) 2023-12-12T11:55:08.666 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:55:08.682 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:55:08.682 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:55:09.078 INFO:teuthology.orchestra.run.smithi078.stdout:generic/238 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T11:55:09.089 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/238 2023-12-12T11:55:09.090 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/238 2023-12-12T11:55:09.090 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:55:09.101 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:55:09.126 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:55:09.126 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/239) 2023-12-12T11:55:09.679 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:55:09.696 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:55:09.696 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:55:32.477 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T11:55:32.482 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T11:56:02.608 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T11:56:02.614 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T11:56:32.687 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T11:56:32.692 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T11:57:02.870 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T11:57:02.875 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T11:57:34.934 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T11:57:34.961 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T11:57:35.016 INFO:tasks.ceph.osd.2.smithi078.stderr:2023-12-12T11:57:35.013+0000 7efffc42e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 225429) UID: 0 2023-12-12T11:57:35.016 INFO:tasks.ceph.osd.1.smithi078.stderr:2023-12-12T11:57:35.013+0000 7fda08c74640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 225429) UID: 0 2023-12-12T11:57:35.016 INFO:tasks.ceph.osd.0.smithi078.stderr:2023-12-12T11:57:35.013+0000 7f7267fb3640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 225429) UID: 0 2023-12-12T11:57:35.017 INFO:tasks.ceph.osd.3.smithi078.stderr:2023-12-12T11:57:35.013+0000 7f238c6c1640 -1 received signal: Hangup from (PID: 225429) UID: 0 2023-12-12T11:57:35.073 INFO:tasks.ceph.osd.4.smithi187.stderr:2023-12-12T11:57:35.069+0000 7fcf5f6ed640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45339) UID: 0 2023-12-12T11:57:35.074 INFO:tasks.ceph.osd.5.smithi187.stderr:2023-12-12T11:57:35.069+0000 7f363eb0f640 -1 Fail to open '/proc/45339/cmdline' error = (2) No such file or directory 2023-12-12T11:57:35.074 INFO:tasks.ceph.osd.5.smithi187.stderr:2023-12-12T11:57:35.069+0000 7f363eb0f640 -1 received signal: Hangup from (PID: 45339) UID: 0 2023-12-12T11:57:35.075 INFO:tasks.ceph.osd.7.smithi187.stderr:2023-12-12T11:57:35.069+0000 7f9c745c6640 -1 Fail to open '/proc/45339/cmdline' error = (2) No such file or directory 2023-12-12T11:57:35.076 INFO:tasks.ceph.osd.7.smithi187.stderr:2023-12-12T11:57:35.073+0000 7f9c745c6640 -1 received signal: Hangup from (PID: 45339) UID: 0 2023-12-12T11:57:35.089 INFO:tasks.ceph.osd.6.smithi187.stderr:2023-12-12T11:57:35.073+0000 7fb917830640 -1 Fail to open '/proc/45339/cmdline' error = (2) No such file or directory 2023-12-12T11:57:35.089 INFO:tasks.ceph.osd.6.smithi187.stderr:2023-12-12T11:57:35.077+0000 7fb917830640 -1 received signal: Hangup from (PID: 45339) UID: 0 2023-12-12T11:57:44.975 INFO:teuthology.orchestra.run.smithi078.stdout:generic/239 155s 2023-12-12T11:57:44.994 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/239 2023-12-12T11:57:44.994 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:57:45.004 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:57:45.034 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:57:45.034 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/240) 2023-12-12T11:57:45.930 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:57:45.945 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:57:45.945 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:57:50.601 INFO:teuthology.orchestra.run.smithi078.stdout:generic/240 5s 2023-12-12T11:57:50.622 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/240 2023-12-12T11:57:50.622 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:57:50.631 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:57:50.660 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:57:50.661 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/241) 2023-12-12T11:57:51.526 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:57:51.542 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:57:51.542 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:59:08.282 INFO:teuthology.orchestra.run.smithi078.stdout:generic/241 76s 2023-12-12T11:59:10.131 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/241 2023-12-12T11:59:10.131 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:59:10.579 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:59:10.615 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:59:10.616 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/242) 2023-12-12T11:59:12.350 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:59:12.373 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:59:12.374 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:59:12.938 INFO:teuthology.orchestra.run.smithi078.stdout:generic/242 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T11:59:12.952 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/242 2023-12-12T11:59:12.952 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/242 2023-12-12T11:59:12.952 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:59:12.965 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:59:12.996 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:59:12.996 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/243) 2023-12-12T11:59:13.534 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:59:13.554 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:59:13.554 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:59:13.978 INFO:teuthology.orchestra.run.smithi078.stdout:generic/243 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T11:59:13.991 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/243 2023-12-12T11:59:13.991 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/243 2023-12-12T11:59:13.991 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:59:14.002 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:59:14.032 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:59:14.033 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/244) 2023-12-12T11:59:14.615 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:59:14.630 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:59:14.630 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:59:15.595 INFO:teuthology.orchestra.run.smithi078.stdout:generic/244 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2023-12-12T11:59:15.605 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/244 2023-12-12T11:59:15.606 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/244 2023-12-12T11:59:15.606 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:59:15.613 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:59:15.639 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:59:15.640 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/245) 2023-12-12T11:59:16.204 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:59:16.221 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:59:16.221 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:59:18.288 INFO:teuthology.orchestra.run.smithi078.stdout:generic/245 1s 2023-12-12T11:59:18.312 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/245 2023-12-12T11:59:18.312 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:59:18.322 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:59:18.354 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:59:18.354 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/246) 2023-12-12T11:59:19.255 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:59:19.273 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:59:19.274 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:59:19.980 INFO:teuthology.orchestra.run.smithi078.stdout:generic/246 0s 2023-12-12T11:59:20.003 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/246 2023-12-12T11:59:20.003 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T11:59:20.014 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T11:59:20.048 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T11:59:20.048 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/247) 2023-12-12T11:59:20.884 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T11:59:20.902 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T11:59:20.903 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:00:15.457 INFO:teuthology.orchestra.run.smithi078.stdout:generic/247 54s 2023-12-12T12:00:15.476 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/247 2023-12-12T12:00:15.476 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:00:15.484 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:00:15.519 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:00:15.520 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/248) 2023-12-12T12:00:16.021 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:00:16.037 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:00:16.037 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:00:17.719 INFO:teuthology.orchestra.run.smithi078.stdout:generic/248 1s 2023-12-12T12:00:17.738 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/248 2023-12-12T12:00:17.738 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:00:17.745 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:00:17.782 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:00:17.783 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/249) 2023-12-12T12:00:18.318 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:00:18.335 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:00:18.335 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:00:22.496 INFO:teuthology.orchestra.run.smithi078.stdout:generic/249 4s 2023-12-12T12:00:22.514 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/249 2023-12-12T12:00:22.514 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:00:22.525 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:00:22.554 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:00:22.555 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/250) 2023-12-12T12:00:23.445 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:00:23.467 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:00:23.467 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:00:24.158 INFO:teuthology.orchestra.run.smithi078.stdout:generic/250 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:00:24.169 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/250 2023-12-12T12:00:24.169 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/250 2023-12-12T12:00:24.169 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:00:24.179 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:00:24.217 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:00:24.217 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/251) 2023-12-12T12:00:24.828 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:00:24.844 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:00:24.844 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:00:25.305 INFO:teuthology.orchestra.run.smithi078.stdout:generic/251 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:00:25.314 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/251 2023-12-12T12:00:25.315 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/251 2023-12-12T12:00:25.315 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:00:25.325 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:00:25.359 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:00:25.360 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/252) 2023-12-12T12:00:25.933 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:00:25.952 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:00:25.952 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:00:26.385 INFO:teuthology.orchestra.run.smithi078.stdout:generic/252 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:00:26.395 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/252 2023-12-12T12:00:26.395 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/252 2023-12-12T12:00:26.395 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:00:26.402 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:00:26.431 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:00:26.432 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/253) 2023-12-12T12:00:27.033 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:00:27.045 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:00:27.045 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:00:27.457 INFO:teuthology.orchestra.run.smithi078.stdout:generic/253 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:00:27.469 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/253 2023-12-12T12:00:27.469 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/253 2023-12-12T12:00:27.470 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:00:27.479 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:00:27.510 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:00:27.511 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/254) 2023-12-12T12:00:28.104 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:00:28.125 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:00:28.126 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:00:28.565 INFO:teuthology.orchestra.run.smithi078.stdout:generic/254 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:00:28.576 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/254 2023-12-12T12:00:28.576 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/254 2023-12-12T12:00:28.577 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:00:28.585 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:00:28.617 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:00:28.617 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/255) 2023-12-12T12:00:29.199 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:00:29.217 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:00:29.217 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:00:32.265 INFO:teuthology.orchestra.run.smithi078.stdout:generic/255 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-12-12T12:00:32.281 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/255 2023-12-12T12:00:32.281 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/255 2023-12-12T12:00:32.281 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:00:32.290 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:00:32.326 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:00:32.326 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/256) 2023-12-12T12:00:33.191 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:00:33.207 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:00:33.207 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:00:35.750 INFO:teuthology.orchestra.run.smithi078.stdout:generic/256 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:00:35.763 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/256 2023-12-12T12:00:35.764 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/256 2023-12-12T12:00:35.764 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:00:35.774 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:00:35.849 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:00:35.849 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/257) 2023-12-12T12:00:36.435 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:00:36.447 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:00:36.447 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:00:39.562 INFO:teuthology.orchestra.run.smithi078.stdout:generic/257 3s 2023-12-12T12:00:39.580 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/257 2023-12-12T12:00:39.580 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:00:39.592 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:00:39.625 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:00:39.626 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/258) 2023-12-12T12:00:40.576 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:00:40.594 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:00:40.594 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:00:41.118 INFO:teuthology.orchestra.run.smithi078.stdout:generic/258 [failed, exit status 1]- output mismatch (see /tmp/tmp.GmWnCxuSqIxfstests-dev/results//generic/258.out.bad) 2023-12-12T12:00:41.126 INFO:teuthology.orchestra.run.smithi078.stdout: --- tests/generic/258.out 2023-12-12 10:13:40.400816648 +0000 2023-12-12T12:00:41.126 INFO:teuthology.orchestra.run.smithi078.stdout: +++ /tmp/tmp.GmWnCxuSqIxfstests-dev/results//generic/258.out.bad 2023-12-12 12:00:41.110196958 +0000 2023-12-12T12:00:41.126 INFO:teuthology.orchestra.run.smithi078.stdout: @@ -1,5 +1,6 @@ 2023-12-12T12:00:41.126 INFO:teuthology.orchestra.run.smithi078.stdout: QA output created by 258 2023-12-12T12:00:41.126 INFO:teuthology.orchestra.run.smithi078.stdout: Creating file with timestamp of Jan 1, 1960 2023-12-12T12:00:41.126 INFO:teuthology.orchestra.run.smithi078.stdout: Testing for negative seconds since epoch 2023-12-12T12:00:41.126 INFO:teuthology.orchestra.run.smithi078.stdout: -Remounting to flush cache 2023-12-12T12:00:41.127 INFO:teuthology.orchestra.run.smithi078.stdout: -Testing for negative seconds since epoch 2023-12-12T12:00:41.127 INFO:teuthology.orchestra.run.smithi078.stdout: +Timestamp wrapped: 3979351756 2023-12-12T12:00:41.127 INFO:teuthology.orchestra.run.smithi078.stdout: +Timestamp wrapped 2023-12-12T12:00:41.127 INFO:teuthology.orchestra.run.smithi078.stdout: +(see /tmp/tmp.GmWnCxuSqIxfstests-dev/results//generic/258.full for details) 2023-12-12T12:00:41.135 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/258 2023-12-12T12:00:41.135 INFO:teuthology.orchestra.run.smithi078.stdout:Failures: generic/258 2023-12-12T12:00:41.135 INFO:teuthology.orchestra.run.smithi078.stdout:Failed 1 of 1 tests 2023-12-12T12:00:41.148 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:00:41.172 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-12T12:00:41.172 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-12-12T12:00:41.172 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-12-12T12:00:41.173 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/259) 2023-12-12T12:00:41.948 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:00:41.964 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:00:41.964 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:00:42.784 INFO:teuthology.orchestra.run.smithi078.stdout:generic/259 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:00:42.798 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/259 2023-12-12T12:00:42.798 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/259 2023-12-12T12:00:42.798 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:00:42.808 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:00:42.845 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:00:42.845 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/260) 2023-12-12T12:00:43.414 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:00:43.430 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:00:43.430 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:00:44.293 INFO:teuthology.orchestra.run.smithi078.stdout:generic/260 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:00:44.331 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/260 2023-12-12T12:00:44.331 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/260 2023-12-12T12:00:44.331 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:00:44.492 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:00:44.517 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:00:44.517 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/261) 2023-12-12T12:00:45.106 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:00:45.122 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:00:45.122 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:00:45.546 INFO:teuthology.orchestra.run.smithi078.stdout:generic/261 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:00:45.557 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/261 2023-12-12T12:00:45.557 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/261 2023-12-12T12:00:45.557 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:00:45.566 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:00:45.597 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:00:45.598 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/262) 2023-12-12T12:00:46.176 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:00:46.191 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:00:46.192 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:00:46.608 INFO:teuthology.orchestra.run.smithi078.stdout:generic/262 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:00:46.622 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/262 2023-12-12T12:00:46.622 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/262 2023-12-12T12:00:46.622 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:00:46.633 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:00:46.664 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:00:46.664 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/263) 2023-12-12T12:00:47.186 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:00:47.204 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:00:47.204 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:01:48.218 INFO:teuthology.orchestra.run.smithi078.stdout:generic/263 61s 2023-12-12T12:01:48.230 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/263 2023-12-12T12:01:48.230 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:01:48.237 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:01:48.296 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:01:48.296 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/264) 2023-12-12T12:01:48.933 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:01:48.944 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:01:48.944 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:01:49.257 INFO:teuthology.orchestra.run.smithi078.stdout:generic/264 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:01:49.265 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/264 2023-12-12T12:01:49.265 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/264 2023-12-12T12:01:49.265 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:01:49.272 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:01:49.291 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:01:49.291 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/265) 2023-12-12T12:01:49.648 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:01:49.658 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:01:49.658 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:01:50.013 INFO:teuthology.orchestra.run.smithi078.stdout:generic/265 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:01:50.021 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/265 2023-12-12T12:01:50.022 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/265 2023-12-12T12:01:50.022 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:01:50.028 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:01:50.047 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:01:50.048 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/266) 2023-12-12T12:01:50.428 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:01:50.438 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:01:50.438 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:01:50.739 INFO:teuthology.orchestra.run.smithi078.stdout:generic/266 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:01:50.748 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/266 2023-12-12T12:01:50.748 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/266 2023-12-12T12:01:50.748 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:01:50.754 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:01:50.774 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:01:50.774 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/267) 2023-12-12T12:01:51.140 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:01:51.151 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:01:51.151 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:01:51.443 INFO:teuthology.orchestra.run.smithi078.stdout:generic/267 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:01:51.451 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/267 2023-12-12T12:01:51.451 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/267 2023-12-12T12:01:51.451 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:01:51.457 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:01:51.476 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:01:51.477 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/268) 2023-12-12T12:01:51.832 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:01:51.842 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:01:51.842 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:01:52.167 INFO:teuthology.orchestra.run.smithi078.stdout:generic/268 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:01:52.175 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/268 2023-12-12T12:01:52.175 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/268 2023-12-12T12:01:52.175 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:01:52.181 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:01:52.201 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:01:52.201 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/269) 2023-12-12T12:01:52.584 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:01:52.595 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:01:52.595 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:01:52.870 INFO:teuthology.orchestra.run.smithi078.stdout:generic/269 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:01:52.878 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/269 2023-12-12T12:01:52.879 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/269 2023-12-12T12:01:52.879 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:01:52.885 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:01:52.905 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:01:52.905 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/270) 2023-12-12T12:01:53.268 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:01:53.278 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:01:53.278 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:01:53.578 INFO:teuthology.orchestra.run.smithi078.stdout:generic/270 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2023-12-12T12:01:53.586 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/270 2023-12-12T12:01:53.586 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/270 2023-12-12T12:01:53.586 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:01:53.592 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:01:53.651 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:01:53.652 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/271) 2023-12-12T12:01:54.016 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:01:54.026 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:01:54.027 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:01:54.331 INFO:teuthology.orchestra.run.smithi078.stdout:generic/271 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:01:54.339 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/271 2023-12-12T12:01:54.339 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/271 2023-12-12T12:01:54.339 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:01:54.345 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:01:54.365 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:01:54.365 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/272) 2023-12-12T12:01:54.747 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:01:54.758 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:01:54.758 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:01:55.066 INFO:teuthology.orchestra.run.smithi078.stdout:generic/272 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:01:55.074 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/272 2023-12-12T12:01:55.074 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/272 2023-12-12T12:01:55.075 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:01:55.081 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:01:55.100 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:01:55.100 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/273) 2023-12-12T12:01:55.468 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:01:55.478 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:01:55.478 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:01:55.767 INFO:teuthology.orchestra.run.smithi078.stdout:generic/273 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:01:55.775 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/273 2023-12-12T12:01:55.775 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/273 2023-12-12T12:01:55.776 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:01:55.781 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:01:55.800 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:01:55.801 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/274) 2023-12-12T12:01:56.172 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:01:56.182 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:01:56.183 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:01:56.446 INFO:teuthology.orchestra.run.smithi078.stdout:generic/274 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:01:56.453 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/274 2023-12-12T12:01:56.454 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/274 2023-12-12T12:01:56.454 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:01:56.460 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:01:56.479 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:01:56.479 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/275) 2023-12-12T12:01:56.850 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:01:56.860 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:01:56.861 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:01:57.164 INFO:teuthology.orchestra.run.smithi078.stdout:generic/275 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:01:57.172 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/275 2023-12-12T12:01:57.172 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/275 2023-12-12T12:01:57.172 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:01:57.178 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:01:57.251 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:01:57.251 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/276) 2023-12-12T12:01:57.623 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:01:57.633 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:01:57.633 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:01:57.934 INFO:teuthology.orchestra.run.smithi078.stdout:generic/276 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:01:57.943 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/276 2023-12-12T12:01:57.943 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/276 2023-12-12T12:01:57.943 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:01:57.949 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:01:57.968 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:01:57.968 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/277) 2023-12-12T12:01:58.324 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:01:58.335 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:01:58.335 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:01:58.622 INFO:teuthology.orchestra.run.smithi078.stdout:generic/277 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:01:58.630 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/277 2023-12-12T12:01:58.631 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/277 2023-12-12T12:01:58.631 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:01:58.637 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:01:58.656 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:01:58.656 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/278) 2023-12-12T12:01:59.026 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:01:59.036 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:01:59.037 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:01:59.343 INFO:teuthology.orchestra.run.smithi078.stdout:generic/278 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:01:59.351 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/278 2023-12-12T12:01:59.351 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/278 2023-12-12T12:01:59.351 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:01:59.357 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:01:59.376 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:01:59.377 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/279) 2023-12-12T12:01:59.748 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:01:59.758 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:01:59.758 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:01:59.879 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:01:59.883 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:02:00.047 INFO:teuthology.orchestra.run.smithi078.stdout:generic/279 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:02:00.055 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/279 2023-12-12T12:02:00.056 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/279 2023-12-12T12:02:00.056 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:02:00.062 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:02:00.118 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:02:00.119 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/280) 2023-12-12T12:02:00.488 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:02:00.498 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:02:00.499 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:02:00.823 INFO:teuthology.orchestra.run.smithi078.stdout:generic/280 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:02:00.831 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/280 2023-12-12T12:02:00.832 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/280 2023-12-12T12:02:00.832 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:02:00.837 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:02:00.857 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:02:00.857 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/281) 2023-12-12T12:02:01.223 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:02:01.234 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:02:01.234 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:02:01.535 INFO:teuthology.orchestra.run.smithi078.stdout:generic/281 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:02:01.543 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/281 2023-12-12T12:02:01.543 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/281 2023-12-12T12:02:01.543 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:02:01.549 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:02:01.569 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:02:01.569 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/282) 2023-12-12T12:02:01.931 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:02:01.942 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:02:01.942 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:02:02.250 INFO:teuthology.orchestra.run.smithi078.stdout:generic/282 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:02:02.259 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/282 2023-12-12T12:02:02.259 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/282 2023-12-12T12:02:02.259 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:02:02.265 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:02:02.347 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:02:02.347 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/283) 2023-12-12T12:02:02.720 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:02:02.731 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:02:02.731 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:02:03.050 INFO:teuthology.orchestra.run.smithi078.stdout:generic/283 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:02:03.059 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/283 2023-12-12T12:02:03.059 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/283 2023-12-12T12:02:03.059 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:02:03.065 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:02:03.084 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:02:03.085 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/284) 2023-12-12T12:02:03.468 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:02:03.479 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:02:03.479 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:02:03.757 INFO:teuthology.orchestra.run.smithi078.stdout:generic/284 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:02:03.765 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/284 2023-12-12T12:02:03.766 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/284 2023-12-12T12:02:03.766 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:02:03.772 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:02:03.831 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:02:03.831 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/285) 2023-12-12T12:02:04.200 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:02:04.210 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:02:04.210 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:02:06.475 INFO:teuthology.orchestra.run.smithi078.stdout:generic/285 2s 2023-12-12T12:02:06.488 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/285 2023-12-12T12:02:06.488 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:02:06.494 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:02:06.651 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:02:06.652 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/286) 2023-12-12T12:02:07.236 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:02:07.246 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:02:07.247 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:02:30.073 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:02:30.078 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:02:57.159 INFO:teuthology.orchestra.run.smithi078.stdout:generic/286 50s 2023-12-12T12:02:57.171 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/286 2023-12-12T12:02:57.171 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:02:57.178 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:02:57.198 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:02:57.199 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/287) 2023-12-12T12:02:57.993 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:02:58.003 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:02:58.003 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:02:58.318 INFO:teuthology.orchestra.run.smithi078.stdout:generic/287 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:02:58.327 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/287 2023-12-12T12:02:58.327 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/287 2023-12-12T12:02:58.327 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:02:58.333 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:02:58.352 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:02:58.353 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/288) 2023-12-12T12:02:58.720 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:02:58.730 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:02:58.730 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:02:59.013 INFO:teuthology.orchestra.run.smithi078.stdout:generic/288 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:02:59.021 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/288 2023-12-12T12:02:59.021 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/288 2023-12-12T12:02:59.021 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:02:59.028 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:02:59.048 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:02:59.048 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/289) 2023-12-12T12:02:59.430 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:02:59.440 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:02:59.440 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:02:59.717 INFO:teuthology.orchestra.run.smithi078.stdout:generic/289 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:02:59.725 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/289 2023-12-12T12:02:59.726 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/289 2023-12-12T12:02:59.726 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:02:59.732 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:02:59.752 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:02:59.752 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/290) 2023-12-12T12:03:00.104 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:03:00.114 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:03:00.114 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:03:00.228 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:03:00.232 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:03:00.391 INFO:teuthology.orchestra.run.smithi078.stdout:generic/290 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:03:00.399 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/290 2023-12-12T12:03:00.399 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/290 2023-12-12T12:03:00.399 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:03:00.405 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:03:00.424 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:03:00.425 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/291) 2023-12-12T12:03:00.788 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:03:00.799 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:03:00.799 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:03:01.067 INFO:teuthology.orchestra.run.smithi078.stdout:generic/291 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:03:01.076 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/291 2023-12-12T12:03:01.076 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/291 2023-12-12T12:03:01.076 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:03:01.082 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:03:01.101 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:03:01.101 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/292) 2023-12-12T12:03:01.486 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:03:01.496 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:03:01.496 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:03:01.797 INFO:teuthology.orchestra.run.smithi078.stdout:generic/292 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:03:01.805 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/292 2023-12-12T12:03:01.805 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/292 2023-12-12T12:03:01.806 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:03:01.812 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:03:01.831 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:03:01.832 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/293) 2023-12-12T12:03:02.197 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:03:02.208 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:03:02.208 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:03:02.485 INFO:teuthology.orchestra.run.smithi078.stdout:generic/293 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:03:02.493 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/293 2023-12-12T12:03:02.493 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/293 2023-12-12T12:03:02.493 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:03:02.499 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:03:02.518 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:03:02.519 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/294) 2023-12-12T12:03:02.888 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:03:02.899 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:03:02.899 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:03:03.179 INFO:teuthology.orchestra.run.smithi078.stdout:generic/294 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:03:03.187 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/294 2023-12-12T12:03:03.187 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/294 2023-12-12T12:03:03.187 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:03:03.194 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:03:03.212 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:03:03.213 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/295) 2023-12-12T12:03:03.593 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:03:03.606 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:03:03.606 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:03:03.892 INFO:teuthology.orchestra.run.smithi078.stdout:generic/295 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:03:03.900 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/295 2023-12-12T12:03:03.900 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/295 2023-12-12T12:03:03.900 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:03:03.907 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:03:03.926 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:03:03.926 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/296) 2023-12-12T12:03:04.297 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:03:04.307 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:03:04.307 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:03:04.596 INFO:teuthology.orchestra.run.smithi078.stdout:generic/296 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:03:04.604 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/296 2023-12-12T12:03:04.604 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/296 2023-12-12T12:03:04.604 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:03:04.610 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:03:04.629 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:03:04.629 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/297) 2023-12-12T12:03:04.985 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:03:04.995 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:03:04.995 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:03:05.269 INFO:teuthology.orchestra.run.smithi078.stdout:generic/297 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:03:05.277 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/297 2023-12-12T12:03:05.277 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/297 2023-12-12T12:03:05.277 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:03:05.284 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:03:05.304 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:03:05.304 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/298) 2023-12-12T12:03:05.689 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:03:05.699 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:03:05.699 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:03:05.973 INFO:teuthology.orchestra.run.smithi078.stdout:generic/298 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:03:05.981 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/298 2023-12-12T12:03:05.982 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/298 2023-12-12T12:03:05.982 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:03:05.988 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:03:06.007 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:03:06.007 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/299) 2023-12-12T12:03:06.368 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:03:06.378 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:03:06.378 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:03:06.657 INFO:teuthology.orchestra.run.smithi078.stdout:generic/299 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:03:06.665 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/299 2023-12-12T12:03:06.665 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/299 2023-12-12T12:03:06.666 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:03:06.672 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:03:06.691 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:03:06.692 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/300) 2023-12-12T12:03:07.064 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:03:07.074 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:03:07.074 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:03:07.362 INFO:teuthology.orchestra.run.smithi078.stdout:generic/300 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:03:07.371 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/300 2023-12-12T12:03:07.371 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/300 2023-12-12T12:03:07.371 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:03:07.377 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:03:07.397 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:03:07.397 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/301) 2023-12-12T12:03:07.748 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:03:07.758 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:03:07.759 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:03:08.036 INFO:teuthology.orchestra.run.smithi078.stdout:generic/301 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:03:08.044 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/301 2023-12-12T12:03:08.045 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/301 2023-12-12T12:03:08.045 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:03:08.051 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:03:08.070 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:03:08.070 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/302) 2023-12-12T12:03:08.436 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:03:08.446 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:03:08.446 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:03:08.722 INFO:teuthology.orchestra.run.smithi078.stdout:generic/302 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:03:08.728 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/302 2023-12-12T12:03:08.728 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/302 2023-12-12T12:03:08.728 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:03:08.734 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:03:08.753 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:03:08.755 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/303) 2023-12-12T12:03:09.116 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:03:09.126 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:03:09.126 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:03:09.499 INFO:teuthology.orchestra.run.smithi078.stdout:generic/303 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-12-12T12:03:09.507 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/303 2023-12-12T12:03:09.507 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/303 2023-12-12T12:03:09.507 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:03:09.513 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:03:09.551 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:03:09.552 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/304) 2023-12-12T12:03:10.224 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:03:10.234 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:03:10.234 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:03:10.620 INFO:teuthology.orchestra.run.smithi078.stdout:generic/304 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2023-12-12T12:03:10.628 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/304 2023-12-12T12:03:10.628 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/304 2023-12-12T12:03:10.628 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:03:10.634 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:03:10.668 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:03:10.669 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/305) 2023-12-12T12:03:11.291 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:03:11.302 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:03:11.302 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:03:11.593 INFO:teuthology.orchestra.run.smithi078.stdout:generic/305 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:03:11.599 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/305 2023-12-12T12:03:11.599 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/305 2023-12-12T12:03:11.599 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:03:11.605 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:03:11.625 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:03:11.626 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/306) 2023-12-12T12:03:12.007 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:03:12.017 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:03:12.018 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:03:12.307 INFO:teuthology.orchestra.run.smithi078.stdout:generic/306 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:03:12.315 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/306 2023-12-12T12:03:12.315 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/306 2023-12-12T12:03:12.316 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:03:12.321 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:03:12.341 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:03:12.341 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/307) 2023-12-12T12:03:12.725 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:03:12.735 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:03:12.735 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:03:13.014 INFO:teuthology.orchestra.run.smithi078.stdout:generic/307 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:03:13.022 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/307 2023-12-12T12:03:13.022 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/307 2023-12-12T12:03:13.023 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:03:13.028 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:03:13.047 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:03:13.047 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/308) 2023-12-12T12:03:13.397 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:03:13.407 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:03:13.407 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:03:15.243 INFO:teuthology.orchestra.run.smithi078.stdout:generic/308 2s 2023-12-12T12:03:15.256 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/308 2023-12-12T12:03:15.256 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:03:15.262 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:03:15.282 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:03:15.282 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/309) 2023-12-12T12:03:15.649 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:03:15.660 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:03:15.660 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:03:17.055 INFO:teuthology.orchestra.run.smithi078.stdout:generic/309 2s 2023-12-12T12:03:17.068 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/309 2023-12-12T12:03:17.068 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:03:17.074 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:03:17.102 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:03:17.103 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/310) 2023-12-12T12:03:17.768 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:03:17.778 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:03:17.778 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:03:30.367 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:03:30.371 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:04:01.223 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:04:01.227 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:04:33.152 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:04:33.156 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:04:48.239 INFO:teuthology.orchestra.run.smithi078.stdout:generic/310 89s 2023-12-12T12:04:48.254 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/310 2023-12-12T12:04:48.254 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:04:48.261 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:04:48.308 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:04:48.308 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/311) 2023-12-12T12:04:49.100 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:04:49.110 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:04:49.110 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:04:49.454 INFO:teuthology.orchestra.run.smithi078.stdout:generic/311 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:04:49.462 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/311 2023-12-12T12:04:49.463 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/311 2023-12-12T12:04:49.463 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:04:49.469 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:04:49.489 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:04:49.489 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/312) 2023-12-12T12:04:49.860 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:04:49.871 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:04:49.871 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:04:50.196 INFO:teuthology.orchestra.run.smithi078.stdout:generic/312 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:04:50.205 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/312 2023-12-12T12:04:50.205 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/312 2023-12-12T12:04:50.205 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:04:50.211 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:04:50.231 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:04:50.232 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/313) 2023-12-12T12:04:50.604 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:04:50.614 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:04:50.614 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:04:55.007 INFO:teuthology.orchestra.run.smithi078.stdout:generic/313 4s 2023-12-12T12:04:55.021 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/313 2023-12-12T12:04:55.021 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:04:55.028 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:04:55.103 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:04:55.104 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/314) 2023-12-12T12:04:55.476 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:04:55.486 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:04:55.487 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:04:56.303 INFO:teuthology.orchestra.run.smithi078.stdout:generic/314 1s 2023-12-12T12:04:56.316 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/314 2023-12-12T12:04:56.316 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:04:56.322 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:04:56.343 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:04:56.343 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/315) 2023-12-12T12:04:56.696 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:04:56.707 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:04:56.707 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:04:58.798 INFO:teuthology.orchestra.run.smithi078.stdout:generic/315 2s 2023-12-12T12:04:58.811 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/315 2023-12-12T12:04:58.811 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:04:58.818 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:04:59.012 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:04:59.013 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/316) 2023-12-12T12:04:59.521 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:04:59.531 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:04:59.531 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:05:01.018 INFO:teuthology.orchestra.run.smithi078.stdout:generic/316 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-12-12T12:05:01.026 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/316 2023-12-12T12:05:01.026 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/316 2023-12-12T12:05:01.026 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:05:01.032 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:05:01.067 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:05:01.067 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/317) 2023-12-12T12:05:01.752 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:05:01.763 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:05:01.763 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:05:02.047 INFO:teuthology.orchestra.run.smithi078.stdout:generic/317 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:05:02.055 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/317 2023-12-12T12:05:02.055 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/317 2023-12-12T12:05:02.055 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:05:02.061 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:05:02.082 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:05:02.082 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/318) 2023-12-12T12:05:02.481 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:05:02.491 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:05:02.491 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:05:02.802 INFO:teuthology.orchestra.run.smithi078.stdout:generic/318 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:05:02.811 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/318 2023-12-12T12:05:02.811 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/318 2023-12-12T12:05:02.811 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:05:02.817 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:05:02.836 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:05:02.836 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/319) 2023-12-12T12:05:03.212 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:05:03.222 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:05:03.222 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:05:03.540 INFO:teuthology.orchestra.run.smithi078.stdout:generic/319 [not run] ACLs not supported by this filesystem type: ceph-fuse 2023-12-12T12:05:03.548 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/319 2023-12-12T12:05:03.549 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/319 2023-12-12T12:05:03.549 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:05:03.555 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:05:03.574 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:05:03.575 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/320) 2023-12-12T12:05:03.936 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:05:03.947 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:05:03.947 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:05:04.238 INFO:teuthology.orchestra.run.smithi078.stdout:generic/320 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:05:04.246 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/320 2023-12-12T12:05:04.246 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/320 2023-12-12T12:05:04.246 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:05:04.252 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:05:04.272 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:05:04.272 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/321) 2023-12-12T12:05:04.641 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:05:04.651 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:05:04.651 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:05:04.962 INFO:teuthology.orchestra.run.smithi078.stdout:generic/321 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:05:04.970 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/321 2023-12-12T12:05:04.970 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/321 2023-12-12T12:05:04.971 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:05:04.977 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:05:04.996 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:05:04.996 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/322) 2023-12-12T12:05:05.376 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:05:05.386 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:05:05.386 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:05:05.706 INFO:teuthology.orchestra.run.smithi078.stdout:generic/322 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:05:05.714 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/322 2023-12-12T12:05:05.714 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/322 2023-12-12T12:05:05.714 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:05:05.720 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:05:05.740 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:05:05.740 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/323) 2023-12-12T12:05:06.095 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:05:06.106 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:05:06.106 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:05:06.306 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:05:06.311 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:05:36.420 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:05:36.424 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:06:07.367 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:06:07.372 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:06:37.449 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:06:37.455 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:07:07.412 INFO:teuthology.orchestra.run.smithi078.stdout:generic/323 121s 2023-12-12T12:07:07.433 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/323 2023-12-12T12:07:07.434 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:07:07.439 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:07:07.476 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:07:07.477 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/324) 2023-12-12T12:07:08.140 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:07:08.150 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:07:08.150 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:07:08.486 INFO:teuthology.orchestra.run.smithi078.stdout:generic/324 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:07:08.494 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/324 2023-12-12T12:07:08.494 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/324 2023-12-12T12:07:08.494 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:07:08.500 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:07:08.520 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:07:08.520 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/325) 2023-12-12T12:07:08.646 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:07:08.649 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:07:08.679 INFO:tasks.ceph.osd.4.smithi187.stderr:2023-12-12T12:07:08.676+0000 7fcf5f6ed640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45426) UID: 0 2023-12-12T12:07:08.680 INFO:tasks.ceph.osd.5.smithi187.stderr:2023-12-12T12:07:08.676+0000 7f363eb0f640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45426) UID: 0 2023-12-12T12:07:08.680 INFO:tasks.ceph.osd.6.smithi187.stderr:2023-12-12T12:07:08.676+0000 7fb917830640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45426) UID: 0 2023-12-12T12:07:08.680 INFO:tasks.ceph.osd.7.smithi187.stderr:2023-12-12T12:07:08.676+0000 7f9c745c6640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45426) UID: 0 2023-12-12T12:07:08.892 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:07:08.903 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:07:08.903 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:07:09.220 INFO:teuthology.orchestra.run.smithi078.stdout:generic/325 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:07:09.228 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/325 2023-12-12T12:07:09.229 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/325 2023-12-12T12:07:09.229 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:07:09.235 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:07:09.254 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:07:09.255 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/326) 2023-12-12T12:07:09.620 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:07:09.631 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:07:09.631 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:07:09.925 INFO:teuthology.orchestra.run.smithi078.stdout:generic/326 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:07:09.933 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/326 2023-12-12T12:07:09.933 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/326 2023-12-12T12:07:09.933 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:07:09.940 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:07:09.960 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:07:09.961 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/327) 2023-12-12T12:07:10.324 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:07:10.334 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:07:10.334 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:07:10.614 INFO:teuthology.orchestra.run.smithi078.stdout:generic/327 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:07:10.625 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/327 2023-12-12T12:07:10.625 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/327 2023-12-12T12:07:10.625 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:07:10.629 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:07:10.648 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:07:10.649 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/328) 2023-12-12T12:07:11.028 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:07:11.038 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:07:11.038 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:07:11.317 INFO:teuthology.orchestra.run.smithi078.stdout:generic/328 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:07:11.325 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/328 2023-12-12T12:07:11.326 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/328 2023-12-12T12:07:11.326 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:07:11.332 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:07:11.351 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:07:11.351 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/329) 2023-12-12T12:07:11.726 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:07:11.736 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:07:11.737 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:07:12.031 INFO:teuthology.orchestra.run.smithi078.stdout:generic/329 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:07:12.039 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/329 2023-12-12T12:07:12.039 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/329 2023-12-12T12:07:12.039 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:07:12.045 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:07:12.065 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:07:12.065 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/330) 2023-12-12T12:07:12.452 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:07:12.462 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:07:12.462 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:07:12.733 INFO:teuthology.orchestra.run.smithi078.stdout:generic/330 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:07:12.741 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/330 2023-12-12T12:07:12.741 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/330 2023-12-12T12:07:12.741 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:07:12.747 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:07:12.767 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:07:12.767 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/331) 2023-12-12T12:07:13.136 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:07:13.147 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:07:13.147 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:07:13.479 INFO:teuthology.orchestra.run.smithi078.stdout:generic/331 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:07:13.489 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/331 2023-12-12T12:07:13.489 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/331 2023-12-12T12:07:13.490 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:07:13.493 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:07:13.513 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:07:13.513 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/332) 2023-12-12T12:07:13.914 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:07:13.923 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:07:13.923 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:07:14.218 INFO:teuthology.orchestra.run.smithi078.stdout:generic/332 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:07:14.227 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/332 2023-12-12T12:07:14.227 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/332 2023-12-12T12:07:14.227 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:07:14.233 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:07:14.252 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:07:14.252 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/333) 2023-12-12T12:07:14.632 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:07:14.642 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:07:14.642 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:07:14.929 INFO:teuthology.orchestra.run.smithi078.stdout:generic/333 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:07:14.937 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/333 2023-12-12T12:07:14.937 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/333 2023-12-12T12:07:14.937 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:07:14.943 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:07:15.039 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:07:15.039 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/334) 2023-12-12T12:07:15.399 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:07:15.410 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:07:15.410 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:07:15.685 INFO:teuthology.orchestra.run.smithi078.stdout:generic/334 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:07:15.693 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/334 2023-12-12T12:07:15.693 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/334 2023-12-12T12:07:15.693 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:07:15.699 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:07:15.719 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:07:15.720 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/335) 2023-12-12T12:07:16.100 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:07:16.111 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:07:16.111 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:07:16.384 INFO:teuthology.orchestra.run.smithi078.stdout:generic/335 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:07:16.392 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/335 2023-12-12T12:07:16.392 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/335 2023-12-12T12:07:16.392 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:07:16.399 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:07:16.419 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:07:16.419 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/336) 2023-12-12T12:07:16.785 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:07:16.795 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:07:16.796 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:07:17.112 INFO:teuthology.orchestra.run.smithi078.stdout:generic/336 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:07:17.121 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/336 2023-12-12T12:07:17.121 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/336 2023-12-12T12:07:17.121 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:07:17.127 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:07:17.147 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:07:17.147 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/337) 2023-12-12T12:07:17.504 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:07:17.514 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:07:17.514 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:07:17.785 INFO:teuthology.orchestra.run.smithi078.stdout:generic/337 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:07:17.793 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/337 2023-12-12T12:07:17.793 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/337 2023-12-12T12:07:17.793 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:07:17.799 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:07:17.819 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:07:17.819 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/338) 2023-12-12T12:07:18.177 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:07:18.187 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:07:18.187 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:07:18.498 INFO:teuthology.orchestra.run.smithi078.stdout:generic/338 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:07:18.506 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/338 2023-12-12T12:07:18.507 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/338 2023-12-12T12:07:18.507 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:07:18.513 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:07:18.532 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:07:18.533 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/339) 2023-12-12T12:07:18.904 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:07:18.914 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:07:18.914 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:07:19.199 INFO:teuthology.orchestra.run.smithi078.stdout:generic/339 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:07:19.208 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/339 2023-12-12T12:07:19.208 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/339 2023-12-12T12:07:19.208 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:07:19.214 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:07:19.295 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:07:19.295 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/340) 2023-12-12T12:07:19.664 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:07:19.674 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:07:19.674 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:07:19.955 INFO:teuthology.orchestra.run.smithi078.stdout:generic/340 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:07:19.963 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/340 2023-12-12T12:07:19.964 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/340 2023-12-12T12:07:19.964 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:07:19.970 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:07:19.989 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:07:19.989 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/341) 2023-12-12T12:07:20.368 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:07:20.379 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:07:20.379 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:07:20.680 INFO:teuthology.orchestra.run.smithi078.stdout:generic/341 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:07:20.688 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/341 2023-12-12T12:07:20.688 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/341 2023-12-12T12:07:20.688 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:07:20.695 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:07:20.714 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:07:20.714 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/342) 2023-12-12T12:07:21.072 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:07:21.082 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:07:21.082 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:07:21.396 INFO:teuthology.orchestra.run.smithi078.stdout:generic/342 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:07:21.404 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/342 2023-12-12T12:07:21.404 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/342 2023-12-12T12:07:21.405 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:07:21.410 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:07:21.467 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:07:21.467 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/343) 2023-12-12T12:07:21.846 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:07:21.856 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:07:21.856 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:07:22.144 INFO:teuthology.orchestra.run.smithi078.stdout:generic/343 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:07:22.152 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/343 2023-12-12T12:07:22.152 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/343 2023-12-12T12:07:22.152 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:07:22.158 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:07:22.178 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:07:22.178 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/344) 2023-12-12T12:07:22.549 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:07:22.560 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:07:22.560 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:07:23.251 INFO:teuthology.orchestra.run.smithi078.stdout:generic/344 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:07:23.260 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/344 2023-12-12T12:07:23.260 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/344 2023-12-12T12:07:23.260 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:07:23.266 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:07:23.287 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:07:23.287 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/345) 2023-12-12T12:07:23.706 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:07:23.716 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:07:23.716 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:07:24.424 INFO:teuthology.orchestra.run.smithi078.stdout:generic/345 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:07:24.432 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/345 2023-12-12T12:07:24.432 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/345 2023-12-12T12:07:24.432 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:07:24.438 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:07:24.458 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:07:24.458 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/346) 2023-12-12T12:07:24.824 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:07:24.834 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:07:24.834 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:07:25.105 INFO:teuthology.orchestra.run.smithi078.stdout:generic/346 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:07:25.113 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/346 2023-12-12T12:07:25.114 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/346 2023-12-12T12:07:25.114 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:07:25.120 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:07:25.139 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:07:25.139 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/347) 2023-12-12T12:07:25.520 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:07:25.530 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:07:25.530 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:07:25.890 INFO:teuthology.orchestra.run.smithi078.stdout:generic/347 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:07:25.898 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/347 2023-12-12T12:07:25.898 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/347 2023-12-12T12:07:25.898 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:07:25.904 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:07:25.924 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:07:25.924 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/348) 2023-12-12T12:07:26.284 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:07:26.295 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:07:26.295 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:07:26.601 INFO:teuthology.orchestra.run.smithi078.stdout:generic/348 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:07:26.609 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/348 2023-12-12T12:07:26.609 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/348 2023-12-12T12:07:26.609 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:07:26.615 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:07:26.634 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:07:26.635 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/349) 2023-12-12T12:07:27.003 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:07:27.014 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:07:27.014 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:07:28.557 INFO:teuthology.orchestra.run.smithi078.stdout:generic/349 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-12-12T12:07:28.565 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/349 2023-12-12T12:07:28.565 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/349 2023-12-12T12:07:28.565 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:07:28.572 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:07:28.639 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:07:28.639 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/350) 2023-12-12T12:07:29.017 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:07:29.027 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:07:29.027 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:07:31.811 INFO:teuthology.orchestra.run.smithi078.stdout:generic/350 2s 2023-12-12T12:07:31.823 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/350 2023-12-12T12:07:31.823 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:07:31.829 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:07:31.847 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:07:31.848 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/351) 2023-12-12T12:07:32.208 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:07:32.218 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:07:32.218 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:07:33.717 INFO:teuthology.orchestra.run.smithi078.stdout:generic/351 [not run] xfs_io finsert failed (old kernel/wrong fs?) 2023-12-12T12:07:33.725 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/351 2023-12-12T12:07:33.725 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/351 2023-12-12T12:07:33.726 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:07:33.732 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:07:33.762 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:07:33.762 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/352) 2023-12-12T12:07:34.449 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:07:34.460 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:07:34.460 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:07:34.764 INFO:teuthology.orchestra.run.smithi078.stdout:generic/352 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:07:34.773 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/352 2023-12-12T12:07:34.773 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/352 2023-12-12T12:07:34.773 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:07:34.779 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:07:34.798 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:07:34.798 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/353) 2023-12-12T12:07:35.160 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:07:35.170 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:07:35.170 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:07:35.450 INFO:teuthology.orchestra.run.smithi078.stdout:generic/353 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:07:35.458 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/353 2023-12-12T12:07:35.459 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/353 2023-12-12T12:07:35.459 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:07:35.464 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:07:35.483 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:07:35.483 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/354) 2023-12-12T12:07:35.854 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:07:35.865 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:07:35.865 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:07:36.156 INFO:teuthology.orchestra.run.smithi078.stdout:generic/354 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:07:36.164 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/354 2023-12-12T12:07:36.164 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/354 2023-12-12T12:07:36.164 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:07:36.170 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:07:36.190 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:07:36.190 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/355) 2023-12-12T12:07:36.552 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:07:36.562 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:07:36.563 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:07:37.615 INFO:teuthology.orchestra.run.smithi078.stdout:generic/355 1s 2023-12-12T12:07:37.628 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/355 2023-12-12T12:07:37.628 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:07:37.634 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:07:37.654 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:07:37.655 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/356) 2023-12-12T12:07:38.320 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:07:38.330 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:07:38.330 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:07:38.633 INFO:teuthology.orchestra.run.smithi078.stdout:generic/356 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:07:38.641 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/356 2023-12-12T12:07:38.641 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/356 2023-12-12T12:07:38.641 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:07:38.647 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:07:38.668 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:07:38.669 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/357) 2023-12-12T12:07:39.025 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:07:39.035 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:07:39.035 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:07:39.309 INFO:teuthology.orchestra.run.smithi078.stdout:generic/357 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:07:39.317 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/357 2023-12-12T12:07:39.318 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/357 2023-12-12T12:07:39.318 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:07:39.324 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:07:39.343 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:07:39.344 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/358) 2023-12-12T12:07:39.709 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:07:39.719 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:07:39.719 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:07:39.992 INFO:teuthology.orchestra.run.smithi078.stdout:generic/358 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:07:40.000 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/358 2023-12-12T12:07:40.000 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/358 2023-12-12T12:07:40.000 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:07:40.006 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:07:40.027 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:07:40.028 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/359) 2023-12-12T12:07:40.394 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:07:40.404 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:07:40.404 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:07:40.690 INFO:teuthology.orchestra.run.smithi078.stdout:generic/359 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:07:40.698 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/359 2023-12-12T12:07:40.698 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/359 2023-12-12T12:07:40.698 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:07:40.705 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:07:40.725 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:07:40.726 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/360) 2023-12-12T12:07:41.096 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:07:41.107 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:07:41.108 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:07:41.507 INFO:teuthology.orchestra.run.smithi078.stdout:generic/360 0s 2023-12-12T12:07:41.519 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/360 2023-12-12T12:07:41.519 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:07:41.525 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:07:41.607 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:07:41.607 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/361) 2023-12-12T12:07:41.970 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:07:41.980 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:07:41.980 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:07:42.273 INFO:teuthology.orchestra.run.smithi078.stdout:generic/361 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:07:42.281 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/361 2023-12-12T12:07:42.281 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/361 2023-12-12T12:07:42.281 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:07:42.288 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:07:42.307 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:07:42.307 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/362) 2023-12-12T12:07:42.689 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:07:42.699 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:07:42.699 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:07:42.974 INFO:teuthology.orchestra.run.smithi078.stdout:generic/362 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:07:42.985 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/362 2023-12-12T12:07:42.985 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/362 2023-12-12T12:07:42.985 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:07:42.989 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:07:43.009 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:07:43.009 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/363) 2023-12-12T12:07:43.400 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:07:43.410 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:07:43.411 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:07:43.684 INFO:teuthology.orchestra.run.smithi078.stdout:generic/363 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:07:43.692 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/363 2023-12-12T12:07:43.692 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/363 2023-12-12T12:07:43.693 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:07:43.699 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:07:43.719 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:07:43.720 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/364) 2023-12-12T12:07:44.086 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:07:44.097 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:07:44.097 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:07:44.369 INFO:teuthology.orchestra.run.smithi078.stdout:generic/364 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:07:44.378 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/364 2023-12-12T12:07:44.378 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/364 2023-12-12T12:07:44.378 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:07:44.384 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:07:44.447 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:07:44.447 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/365) 2023-12-12T12:07:44.821 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:07:44.832 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:07:44.832 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:07:45.116 INFO:teuthology.orchestra.run.smithi078.stdout:generic/365 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:07:45.125 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/365 2023-12-12T12:07:45.125 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/365 2023-12-12T12:07:45.125 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:07:45.131 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:07:45.152 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:07:45.152 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/366) 2023-12-12T12:07:45.509 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:07:45.519 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:07:45.519 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:07:45.795 INFO:teuthology.orchestra.run.smithi078.stdout:generic/366 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:07:45.803 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/366 2023-12-12T12:07:45.803 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/366 2023-12-12T12:07:45.803 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:07:45.809 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:07:45.829 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:07:45.829 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/367) 2023-12-12T12:07:46.196 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:07:46.206 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:07:46.206 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:07:46.482 INFO:teuthology.orchestra.run.smithi078.stdout:generic/367 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:07:46.490 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/367 2023-12-12T12:07:46.490 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/367 2023-12-12T12:07:46.490 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:07:46.496 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:07:46.515 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:07:46.516 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/368) 2023-12-12T12:07:46.893 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:07:46.904 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:07:46.904 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:07:47.163 INFO:teuthology.orchestra.run.smithi078.stdout:generic/368 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:07:47.171 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/368 2023-12-12T12:07:47.171 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/368 2023-12-12T12:07:47.171 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:07:47.177 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:07:47.243 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:07:47.243 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/369) 2023-12-12T12:07:47.593 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:07:47.603 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:07:47.603 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:07:47.864 INFO:teuthology.orchestra.run.smithi078.stdout:generic/369 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:07:47.872 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/369 2023-12-12T12:07:47.872 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/369 2023-12-12T12:07:47.872 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:07:47.878 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:07:47.899 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:07:47.899 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/370) 2023-12-12T12:07:48.272 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:07:48.283 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:07:48.283 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:07:48.563 INFO:teuthology.orchestra.run.smithi078.stdout:generic/370 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:07:48.571 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/370 2023-12-12T12:07:48.571 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/370 2023-12-12T12:07:48.571 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:07:48.577 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:07:48.597 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:07:48.598 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/371) 2023-12-12T12:07:48.969 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:07:48.979 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:07:48.979 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:07:49.252 INFO:teuthology.orchestra.run.smithi078.stdout:generic/371 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:07:49.260 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/371 2023-12-12T12:07:49.260 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/371 2023-12-12T12:07:49.260 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:07:49.267 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:07:49.286 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:07:49.286 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/372) 2023-12-12T12:07:49.653 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:07:49.663 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:07:49.663 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:07:49.965 INFO:teuthology.orchestra.run.smithi078.stdout:generic/372 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:07:49.973 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/372 2023-12-12T12:07:49.973 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/372 2023-12-12T12:07:49.973 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:07:49.979 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:07:49.999 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:07:49.999 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/373) 2023-12-12T12:07:50.374 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:07:50.385 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:07:50.385 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:07:50.665 INFO:teuthology.orchestra.run.smithi078.stdout:generic/373 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:07:50.673 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/373 2023-12-12T12:07:50.673 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/373 2023-12-12T12:07:50.674 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:07:50.680 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:07:50.699 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:07:50.699 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/374) 2023-12-12T12:07:51.059 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:07:51.070 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:07:51.070 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:07:51.356 INFO:teuthology.orchestra.run.smithi078.stdout:generic/374 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:07:51.364 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/374 2023-12-12T12:07:51.364 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/374 2023-12-12T12:07:51.364 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:07:51.371 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:07:51.391 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:07:51.391 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/375) 2023-12-12T12:07:51.773 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:07:51.784 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:07:51.784 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:07:52.117 INFO:teuthology.orchestra.run.smithi078.stdout:generic/375 [not run] ACLs not supported by this filesystem type: ceph-fuse 2023-12-12T12:07:52.125 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/375 2023-12-12T12:07:52.125 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/375 2023-12-12T12:07:52.126 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:07:52.132 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:07:52.150 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:07:52.150 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/376) 2023-12-12T12:07:52.536 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:07:52.547 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:07:52.547 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:07:52.860 INFO:teuthology.orchestra.run.smithi078.stdout:generic/376 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:07:52.868 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/376 2023-12-12T12:07:52.868 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/376 2023-12-12T12:07:52.868 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:07:52.875 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:07:52.894 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:07:52.894 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/377) 2023-12-12T12:07:53.264 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:07:53.274 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:07:53.274 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:07:53.540 INFO:teuthology.orchestra.run.smithi078.stdout:generic/377 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:07:53.548 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/377 2023-12-12T12:07:53.548 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/377 2023-12-12T12:07:53.549 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:07:53.554 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:07:53.574 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:07:53.574 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/378) 2023-12-12T12:07:53.931 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:07:53.942 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:07:53.942 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:07:54.612 INFO:teuthology.orchestra.run.smithi078.stdout:generic/378 1s 2023-12-12T12:07:54.624 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/378 2023-12-12T12:07:54.624 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:07:54.630 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:07:54.657 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:07:54.657 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/379) 2023-12-12T12:07:55.352 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:07:55.362 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:07:55.363 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:07:55.675 INFO:teuthology.orchestra.run.smithi078.stdout:generic/379 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:07:55.683 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/379 2023-12-12T12:07:55.683 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/379 2023-12-12T12:07:55.683 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:07:55.689 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:07:55.709 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:07:55.709 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/380) 2023-12-12T12:07:56.065 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:07:56.076 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:07:56.076 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:07:56.371 INFO:teuthology.orchestra.run.smithi078.stdout:generic/380 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:07:56.379 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/380 2023-12-12T12:07:56.379 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/380 2023-12-12T12:07:56.379 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:07:56.385 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:07:56.405 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:07:56.405 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/381) 2023-12-12T12:07:56.757 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:07:56.768 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:07:56.768 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:07:57.059 INFO:teuthology.orchestra.run.smithi078.stdout:generic/381 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:07:57.068 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/381 2023-12-12T12:07:57.068 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/381 2023-12-12T12:07:57.068 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:07:57.075 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:07:57.094 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:07:57.094 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/382) 2023-12-12T12:07:57.484 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:07:57.494 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:07:57.494 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:07:57.786 INFO:teuthology.orchestra.run.smithi078.stdout:generic/382 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:07:57.794 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/382 2023-12-12T12:07:57.794 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/382 2023-12-12T12:07:57.794 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:07:57.800 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:07:57.819 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:07:57.820 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/383) 2023-12-12T12:07:58.196 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:07:58.206 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:07:58.206 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:07:58.496 INFO:teuthology.orchestra.run.smithi078.stdout:generic/383 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:07:58.504 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/383 2023-12-12T12:07:58.504 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/383 2023-12-12T12:07:58.504 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:07:58.511 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:07:58.530 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:07:58.531 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/384) 2023-12-12T12:07:58.907 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:07:58.918 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:07:58.918 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:07:59.217 INFO:teuthology.orchestra.run.smithi078.stdout:generic/384 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2023-12-12T12:07:59.226 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/384 2023-12-12T12:07:59.226 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/384 2023-12-12T12:07:59.226 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:07:59.232 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:07:59.251 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:07:59.251 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/385) 2023-12-12T12:07:59.632 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:07:59.642 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:07:59.643 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:07:59.937 INFO:teuthology.orchestra.run.smithi078.stdout:generic/385 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:07:59.945 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/385 2023-12-12T12:07:59.945 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/385 2023-12-12T12:07:59.945 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:07:59.952 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:07:59.972 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:07:59.972 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/386) 2023-12-12T12:08:00.340 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:08:00.351 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:08:00.351 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:08:00.637 INFO:teuthology.orchestra.run.smithi078.stdout:generic/386 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2023-12-12T12:08:00.645 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/386 2023-12-12T12:08:00.645 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/386 2023-12-12T12:08:00.645 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:08:00.651 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:08:00.671 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:08:00.671 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/387) 2023-12-12T12:08:01.037 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:08:01.047 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:08:01.047 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:08:01.326 INFO:teuthology.orchestra.run.smithi078.stdout:generic/387 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:08:01.334 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/387 2023-12-12T12:08:01.334 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/387 2023-12-12T12:08:01.334 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:08:01.340 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:08:01.410 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:08:01.411 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/388) 2023-12-12T12:08:01.773 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:08:01.784 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:08:01.784 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:08:02.094 INFO:teuthology.orchestra.run.smithi078.stdout:generic/388 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:08:02.102 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/388 2023-12-12T12:08:02.102 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/388 2023-12-12T12:08:02.102 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:08:02.108 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:08:02.128 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:08:02.128 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/389) 2023-12-12T12:08:02.528 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:08:02.538 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:08:02.539 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:08:02.853 INFO:teuthology.orchestra.run.smithi078.stdout:generic/389 [not run] O_TMPFILE is not supported 2023-12-12T12:08:02.859 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/389 2023-12-12T12:08:02.859 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/389 2023-12-12T12:08:02.859 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:08:02.866 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:08:02.885 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:08:02.885 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/390) 2023-12-12T12:08:03.244 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:08:03.254 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:08:03.255 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:08:03.575 INFO:teuthology.orchestra.run.smithi078.stdout:generic/390 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:08:03.583 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/390 2023-12-12T12:08:03.583 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/390 2023-12-12T12:08:03.584 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:08:03.589 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:08:03.610 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:08:03.610 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/391) 2023-12-12T12:08:04.000 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:08:04.010 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:08:04.011 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:08:44.107 INFO:teuthology.orchestra.run.smithi078.stdout:generic/391 40s 2023-12-12T12:08:44.300 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/391 2023-12-12T12:08:44.300 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:08:44.307 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:08:44.663 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:08:44.663 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/392) 2023-12-12T12:08:46.564 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:08:46.585 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:08:46.585 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:08:47.047 INFO:teuthology.orchestra.run.smithi078.stdout:generic/392 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:08:47.059 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/392 2023-12-12T12:08:47.059 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/392 2023-12-12T12:08:47.059 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:08:47.069 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:08:47.102 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:08:47.103 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/393) 2023-12-12T12:08:47.655 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:08:47.666 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:08:47.666 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:08:47.949 INFO:teuthology.orchestra.run.smithi078.stdout:generic/393 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:08:47.958 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/393 2023-12-12T12:08:47.958 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/393 2023-12-12T12:08:47.958 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:08:47.964 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:08:47.984 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:08:47.985 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/394) 2023-12-12T12:08:48.336 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:08:48.347 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:08:48.347 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:08:48.698 INFO:teuthology.orchestra.run.smithi078.stdout:generic/394 0s 2023-12-12T12:08:48.710 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/394 2023-12-12T12:08:48.710 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:08:48.717 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:08:48.736 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:08:48.736 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/395) 2023-12-12T12:08:49.541 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:08:49.557 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:08:49.557 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:08:49.996 INFO:teuthology.orchestra.run.smithi078.stdout:generic/395 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:08:50.004 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/395 2023-12-12T12:08:50.005 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/395 2023-12-12T12:08:50.005 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:08:50.011 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:08:50.033 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:08:50.033 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/396) 2023-12-12T12:08:50.431 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:08:50.441 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:08:50.441 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:08:50.777 INFO:teuthology.orchestra.run.smithi078.stdout:generic/396 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:08:50.785 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/396 2023-12-12T12:08:50.786 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/396 2023-12-12T12:08:50.786 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:08:50.792 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:08:50.811 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:08:50.811 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/397) 2023-12-12T12:08:51.197 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:08:51.207 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:08:51.208 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:08:51.598 INFO:teuthology.orchestra.run.smithi078.stdout:generic/397 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:08:51.606 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/397 2023-12-12T12:08:51.606 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/397 2023-12-12T12:08:51.606 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:08:51.612 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:08:51.633 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:08:51.633 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/398) 2023-12-12T12:08:51.984 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:08:51.996 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:08:51.996 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:08:52.367 INFO:teuthology.orchestra.run.smithi078.stdout:generic/398 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:08:52.375 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/398 2023-12-12T12:08:52.375 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/398 2023-12-12T12:08:52.376 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:08:52.382 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:08:52.401 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:08:52.402 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/399) 2023-12-12T12:08:52.780 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:08:52.791 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:08:52.791 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:08:53.128 INFO:teuthology.orchestra.run.smithi078.stdout:generic/399 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:08:53.136 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/399 2023-12-12T12:08:53.136 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/399 2023-12-12T12:08:53.136 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:08:53.142 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:08:53.162 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:08:53.162 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/400) 2023-12-12T12:08:53.544 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:08:53.554 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:08:53.554 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:08:53.825 INFO:teuthology.orchestra.run.smithi078.stdout:generic/400 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2023-12-12T12:08:53.833 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/400 2023-12-12T12:08:53.834 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/400 2023-12-12T12:08:53.834 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:08:53.840 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:08:53.859 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:08:53.859 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/401) 2023-12-12T12:08:54.232 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:08:54.242 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:08:54.242 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:08:54.525 INFO:teuthology.orchestra.run.smithi078.stdout:generic/401 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:08:54.533 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/401 2023-12-12T12:08:54.533 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/401 2023-12-12T12:08:54.533 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:08:54.539 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:08:54.560 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:08:54.560 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/402) 2023-12-12T12:08:54.940 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:08:54.951 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:08:54.951 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:08:55.246 INFO:teuthology.orchestra.run.smithi078.stdout:generic/402 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:08:55.254 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/402 2023-12-12T12:08:55.254 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/402 2023-12-12T12:08:55.255 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:08:55.261 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:08:55.280 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:08:55.281 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/403) 2023-12-12T12:08:55.668 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:08:55.678 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:08:55.679 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:08:55.966 INFO:teuthology.orchestra.run.smithi078.stdout:generic/403 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:08:55.974 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/403 2023-12-12T12:08:55.974 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/403 2023-12-12T12:08:55.974 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:08:55.981 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:08:56.000 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:08:56.000 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/404) 2023-12-12T12:08:56.369 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:08:56.378 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:08:56.379 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:08:57.862 INFO:teuthology.orchestra.run.smithi078.stdout:generic/404 [not run] xfs_io finsert failed (old kernel/wrong fs?) 2023-12-12T12:08:57.870 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/404 2023-12-12T12:08:57.871 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/404 2023-12-12T12:08:57.871 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:08:57.877 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:08:58.003 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:08:58.003 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/405) 2023-12-12T12:08:58.601 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:08:58.611 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:08:58.611 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:08:59.044 INFO:teuthology.orchestra.run.smithi078.stdout:generic/405 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:08:59.052 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/405 2023-12-12T12:08:59.052 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/405 2023-12-12T12:08:59.052 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:08:59.058 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:08:59.079 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:08:59.079 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/406) 2023-12-12T12:08:59.437 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:08:59.447 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:08:59.447 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:08:59.718 INFO:teuthology.orchestra.run.smithi078.stdout:generic/406 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:08:59.726 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/406 2023-12-12T12:08:59.727 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/406 2023-12-12T12:08:59.727 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:08:59.733 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:08:59.753 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:08:59.754 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/407) 2023-12-12T12:09:00.122 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:09:00.133 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:09:00.133 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:09:00.509 INFO:teuthology.orchestra.run.smithi078.stdout:generic/407 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-12-12T12:09:00.517 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/407 2023-12-12T12:09:00.517 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/407 2023-12-12T12:09:00.517 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:09:00.523 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:09:00.568 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:09:00.568 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/408) 2023-12-12T12:09:01.221 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:09:01.231 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:09:01.231 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:09:01.632 INFO:teuthology.orchestra.run.smithi078.stdout:generic/408 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2023-12-12T12:09:01.640 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/408 2023-12-12T12:09:01.640 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/408 2023-12-12T12:09:01.640 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:09:01.646 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:09:01.704 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:09:01.704 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/409) 2023-12-12T12:09:02.336 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:09:02.346 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:09:02.346 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:09:02.626 INFO:teuthology.orchestra.run.smithi078.stdout:generic/409 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:09:02.634 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/409 2023-12-12T12:09:02.634 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/409 2023-12-12T12:09:02.634 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:09:02.640 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:09:02.659 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:09:02.659 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/410) 2023-12-12T12:09:03.044 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:09:03.054 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:09:03.055 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:09:03.332 INFO:teuthology.orchestra.run.smithi078.stdout:generic/410 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:09:03.340 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/410 2023-12-12T12:09:03.340 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/410 2023-12-12T12:09:03.340 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:09:03.347 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:09:03.366 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:09:03.366 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/411) 2023-12-12T12:09:03.736 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:09:03.747 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:09:03.747 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:09:04.060 INFO:teuthology.orchestra.run.smithi078.stdout:generic/411 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:09:04.068 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/411 2023-12-12T12:09:04.068 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/411 2023-12-12T12:09:04.068 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:09:04.075 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:09:04.094 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:09:04.094 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/412) 2023-12-12T12:09:04.468 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:09:04.478 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:09:04.478 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:09:04.753 INFO:teuthology.orchestra.run.smithi078.stdout:generic/412 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:09:04.762 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/412 2023-12-12T12:09:04.762 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/412 2023-12-12T12:09:04.762 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:09:04.768 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:09:04.815 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:09:04.815 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/413) 2023-12-12T12:09:05.197 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:09:05.208 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:09:05.209 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:09:05.525 INFO:teuthology.orchestra.run.smithi078.stdout:generic/413 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:09:05.533 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/413 2023-12-12T12:09:05.533 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/413 2023-12-12T12:09:05.533 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:09:05.539 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:09:05.558 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:09:05.559 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/414) 2023-12-12T12:09:05.940 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:09:05.951 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:09:05.951 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:09:06.235 INFO:teuthology.orchestra.run.smithi078.stdout:generic/414 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:09:06.243 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/414 2023-12-12T12:09:06.243 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/414 2023-12-12T12:09:06.243 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:09:06.249 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:09:06.270 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:09:06.270 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/415) 2023-12-12T12:09:06.636 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:09:06.646 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:09:06.647 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:09:06.925 INFO:teuthology.orchestra.run.smithi078.stdout:generic/415 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:09:06.933 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/415 2023-12-12T12:09:06.933 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/415 2023-12-12T12:09:06.934 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:09:06.940 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:09:06.959 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:09:06.959 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/416) 2023-12-12T12:09:07.318 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:09:07.321 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:09:07.328 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:09:07.339 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:09:07.339 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:09:07.607 INFO:teuthology.orchestra.run.smithi078.stdout:generic/416 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:09:07.615 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/416 2023-12-12T12:09:07.615 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/416 2023-12-12T12:09:07.615 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:09:07.621 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:09:07.640 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:09:07.641 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/417) 2023-12-12T12:09:08.012 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:09:08.022 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:09:08.022 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:09:08.307 INFO:teuthology.orchestra.run.smithi078.stdout:generic/417 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:09:08.315 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/417 2023-12-12T12:09:08.315 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/417 2023-12-12T12:09:08.316 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:09:08.322 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:09:08.341 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:09:08.341 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/418) 2023-12-12T12:09:08.730 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:09:08.740 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:09:08.740 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:09:09.083 INFO:teuthology.orchestra.run.smithi078.stdout:generic/418 [not run] require ceph-fuse to be valid block disk 2023-12-12T12:09:09.091 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/418 2023-12-12T12:09:09.091 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/418 2023-12-12T12:09:09.091 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:09:09.097 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:09:09.118 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:09:09.118 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/419) 2023-12-12T12:09:09.500 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:09:09.510 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:09:09.510 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:09:09.875 INFO:teuthology.orchestra.run.smithi078.stdout:generic/419 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:09:09.883 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/419 2023-12-12T12:09:09.883 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/419 2023-12-12T12:09:09.883 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:09:09.890 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:09:09.909 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:09:09.910 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/420) 2023-12-12T12:09:10.281 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:09:10.292 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:09:10.292 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:09:11.823 INFO:teuthology.orchestra.run.smithi078.stdout:generic/420 1s 2023-12-12T12:09:11.836 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/420 2023-12-12T12:09:11.836 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:09:11.842 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:09:11.997 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:09:11.997 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/421) 2023-12-12T12:09:12.593 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:09:12.603 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:09:12.603 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:09:12.943 INFO:teuthology.orchestra.run.smithi078.stdout:generic/421 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:09:12.951 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/421 2023-12-12T12:09:12.951 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/421 2023-12-12T12:09:12.951 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:09:12.958 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:09:12.977 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:09:12.977 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/422) 2023-12-12T12:09:13.360 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:09:13.371 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:09:13.371 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:09:13.678 INFO:teuthology.orchestra.run.smithi078.stdout:generic/422 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:09:13.686 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/422 2023-12-12T12:09:13.686 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/422 2023-12-12T12:09:13.686 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:09:13.692 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:09:13.712 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:09:13.713 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/423) 2023-12-12T12:09:14.088 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:09:14.098 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:09:14.098 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:09:14.890 INFO:teuthology.orchestra.run.smithi078.stdout:generic/423 0s 2023-12-12T12:09:14.956 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/423 2023-12-12T12:09:14.956 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:09:14.962 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:09:15.016 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:09:15.016 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/424) 2023-12-12T12:09:15.692 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:09:15.703 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:09:15.703 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:09:16.066 INFO:teuthology.orchestra.run.smithi078.stdout:generic/424 [not run] file system doesn't support any of /usr/bin/chattr +a/+c/+d/+i 2023-12-12T12:09:16.074 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/424 2023-12-12T12:09:16.075 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/424 2023-12-12T12:09:16.075 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:09:16.081 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:09:16.101 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:09:16.102 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/425) 2023-12-12T12:09:16.492 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:09:16.503 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:09:16.503 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:09:16.786 INFO:teuthology.orchestra.run.smithi078.stdout:generic/425 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:09:16.794 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/425 2023-12-12T12:09:16.794 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/425 2023-12-12T12:09:16.794 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:09:16.800 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:09:16.821 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:09:16.821 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/426) 2023-12-12T12:09:17.184 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:09:17.195 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:09:17.195 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:09:37.409 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:09:37.413 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:09:55.181 INFO:teuthology.orchestra.run.smithi078.stdout:generic/426 - output mismatch (see /tmp/tmp.GmWnCxuSqIxfstests-dev/results//generic/426.out.bad) 2023-12-12T12:09:55.200 INFO:teuthology.orchestra.run.smithi078.stdout: --- tests/generic/426.out 2023-12-12 10:13:40.424815905 +0000 2023-12-12T12:09:55.200 INFO:teuthology.orchestra.run.smithi078.stdout: +++ /tmp/tmp.GmWnCxuSqIxfstests-dev/results//generic/426.out.bad 2023-12-12 12:09:55.149453596 +0000 2023-12-12T12:09:55.200 INFO:teuthology.orchestra.run.smithi078.stdout: @@ -1,5 +1,436 @@ 2023-12-12T12:09:55.200 INFO:teuthology.orchestra.run.smithi078.stdout: QA output created by 426 2023-12-12T12:09:55.200 INFO:teuthology.orchestra.run.smithi078.stdout: test_file_handles TEST_DIR/426-dir -d 2023-12-12T12:09:55.200 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000038) opened an unlinked file! 2023-12-12T12:09:55.200 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000039) opened an unlinked file! 2023-12-12T12:09:55.200 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000040) opened an unlinked file! 2023-12-12T12:09:55.200 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000041) opened an unlinked file! 2023-12-12T12:09:55.200 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000042) opened an unlinked file! 2023-12-12T12:09:55.200 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000043) opened an unlinked file! 2023-12-12T12:09:55.200 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000044) opened an unlinked file! 2023-12-12T12:09:55.201 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000045) opened an unlinked file! 2023-12-12T12:09:55.201 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000046) opened an unlinked file! 2023-12-12T12:09:55.201 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000047) opened an unlinked file! 2023-12-12T12:09:55.201 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000048) opened an unlinked file! 2023-12-12T12:09:55.201 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000049) opened an unlinked file! 2023-12-12T12:09:55.201 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000050) opened an unlinked file! 2023-12-12T12:09:55.201 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000051) opened an unlinked file! 2023-12-12T12:09:55.201 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000052) opened an unlinked file! 2023-12-12T12:09:55.201 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000053) opened an unlinked file! 2023-12-12T12:09:55.201 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000054) opened an unlinked file! 2023-12-12T12:09:55.201 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000055) opened an unlinked file! 2023-12-12T12:09:55.201 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000056) opened an unlinked file! 2023-12-12T12:09:55.201 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000057) opened an unlinked file! 2023-12-12T12:09:55.201 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000058) opened an unlinked file! 2023-12-12T12:09:55.201 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000059) opened an unlinked file! 2023-12-12T12:09:55.202 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000060) opened an unlinked file! 2023-12-12T12:09:55.202 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000061) opened an unlinked file! 2023-12-12T12:09:55.202 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000062) opened an unlinked file! 2023-12-12T12:09:55.202 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000063) opened an unlinked file! 2023-12-12T12:09:55.202 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000064) opened an unlinked file! 2023-12-12T12:09:55.202 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000065) opened an unlinked file! 2023-12-12T12:09:55.202 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000066) opened an unlinked file! 2023-12-12T12:09:55.202 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000067) opened an unlinked file! 2023-12-12T12:09:55.202 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000068) opened an unlinked file! 2023-12-12T12:09:55.202 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000069) opened an unlinked file! 2023-12-12T12:09:55.202 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000070) opened an unlinked file! 2023-12-12T12:09:55.202 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000071) opened an unlinked file! 2023-12-12T12:09:55.202 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000072) opened an unlinked file! 2023-12-12T12:09:55.202 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000073) opened an unlinked file! 2023-12-12T12:09:55.203 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000074) opened an unlinked file! 2023-12-12T12:09:55.203 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000075) opened an unlinked file! 2023-12-12T12:09:55.203 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000076) opened an unlinked file! 2023-12-12T12:09:55.203 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000077) opened an unlinked file! 2023-12-12T12:09:55.203 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000078) opened an unlinked file! 2023-12-12T12:09:55.203 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000079) opened an unlinked file! 2023-12-12T12:09:55.203 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000080) opened an unlinked file! 2023-12-12T12:09:55.203 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000081) opened an unlinked file! 2023-12-12T12:09:55.203 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000082) opened an unlinked file! 2023-12-12T12:09:55.203 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000083) opened an unlinked file! 2023-12-12T12:09:55.203 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000084) opened an unlinked file! 2023-12-12T12:09:55.203 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000085) opened an unlinked file! 2023-12-12T12:09:55.203 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000086) opened an unlinked file! 2023-12-12T12:09:55.203 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000087) opened an unlinked file! 2023-12-12T12:09:55.203 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000088) opened an unlinked file! 2023-12-12T12:09:55.204 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000089) opened an unlinked file! 2023-12-12T12:09:55.204 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000090) opened an unlinked file! 2023-12-12T12:09:55.204 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000091) opened an unlinked file! 2023-12-12T12:09:55.204 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000092) opened an unlinked file! 2023-12-12T12:09:55.204 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000093) opened an unlinked file! 2023-12-12T12:09:55.204 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000094) opened an unlinked file! 2023-12-12T12:09:55.204 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000095) opened an unlinked file! 2023-12-12T12:09:55.204 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000096) opened an unlinked file! 2023-12-12T12:09:55.204 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000097) opened an unlinked file! 2023-12-12T12:09:55.204 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000098) opened an unlinked file! 2023-12-12T12:09:55.204 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000099) opened an unlinked file! 2023-12-12T12:09:55.204 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000100) opened an unlinked file! 2023-12-12T12:09:55.204 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000101) opened an unlinked file! 2023-12-12T12:09:55.204 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000102) opened an unlinked file! 2023-12-12T12:09:55.205 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000103) opened an unlinked file! 2023-12-12T12:09:55.205 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000104) opened an unlinked file! 2023-12-12T12:09:55.205 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000105) opened an unlinked file! 2023-12-12T12:09:55.205 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000106) opened an unlinked file! 2023-12-12T12:09:55.205 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000107) opened an unlinked file! 2023-12-12T12:09:55.205 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000108) opened an unlinked file! 2023-12-12T12:09:55.205 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000109) opened an unlinked file! 2023-12-12T12:09:55.205 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000110) opened an unlinked file! 2023-12-12T12:09:55.205 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000111) opened an unlinked file! 2023-12-12T12:09:55.205 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000112) opened an unlinked file! 2023-12-12T12:09:55.205 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000113) opened an unlinked file! 2023-12-12T12:09:55.205 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000114) opened an unlinked file! 2023-12-12T12:09:55.205 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000115) opened an unlinked file! 2023-12-12T12:09:55.205 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000116) opened an unlinked file! 2023-12-12T12:09:55.205 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000117) opened an unlinked file! 2023-12-12T12:09:55.205 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000118) opened an unlinked file! 2023-12-12T12:09:55.206 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000674) opened an unlinked file! 2023-12-12T12:09:55.206 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000675) opened an unlinked file! 2023-12-12T12:09:55.206 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000676) opened an unlinked file! 2023-12-12T12:09:55.206 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000677) opened an unlinked file! 2023-12-12T12:09:55.206 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000678) opened an unlinked file! 2023-12-12T12:09:55.206 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000679) opened an unlinked file! 2023-12-12T12:09:55.206 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000680) opened an unlinked file! 2023-12-12T12:09:55.206 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000681) opened an unlinked file! 2023-12-12T12:09:55.217 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000682) opened an unlinked file! 2023-12-12T12:09:55.217 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000683) opened an unlinked file! 2023-12-12T12:09:55.217 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000684) opened an unlinked file! 2023-12-12T12:09:55.217 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000685) opened an unlinked file! 2023-12-12T12:09:55.217 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000686) opened an unlinked file! 2023-12-12T12:09:55.217 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000687) opened an unlinked file! 2023-12-12T12:09:55.217 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000688) opened an unlinked file! 2023-12-12T12:09:55.217 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000689) opened an unlinked file! 2023-12-12T12:09:55.218 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000690) opened an unlinked file! 2023-12-12T12:09:55.218 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000691) opened an unlinked file! 2023-12-12T12:09:55.218 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000692) opened an unlinked file! 2023-12-12T12:09:55.218 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000693) opened an unlinked file! 2023-12-12T12:09:55.218 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000694) opened an unlinked file! 2023-12-12T12:09:55.218 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000695) opened an unlinked file! 2023-12-12T12:09:55.218 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000696) opened an unlinked file! 2023-12-12T12:09:55.218 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000697) opened an unlinked file! 2023-12-12T12:09:55.218 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000698) opened an unlinked file! 2023-12-12T12:09:55.218 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000699) opened an unlinked file! 2023-12-12T12:09:55.218 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000700) opened an unlinked file! 2023-12-12T12:09:55.218 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000701) opened an unlinked file! 2023-12-12T12:09:55.218 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000702) opened an unlinked file! 2023-12-12T12:09:55.219 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000703) opened an unlinked file! 2023-12-12T12:09:55.219 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000704) opened an unlinked file! 2023-12-12T12:09:55.219 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000705) opened an unlinked file! 2023-12-12T12:09:55.219 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000706) opened an unlinked file! 2023-12-12T12:09:55.219 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000707) opened an unlinked file! 2023-12-12T12:09:55.219 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000708) opened an unlinked file! 2023-12-12T12:09:55.219 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000709) opened an unlinked file! 2023-12-12T12:09:55.219 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000710) opened an unlinked file! 2023-12-12T12:09:55.219 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000711) opened an unlinked file! 2023-12-12T12:09:55.219 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000712) opened an unlinked file! 2023-12-12T12:09:55.219 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000713) opened an unlinked file! 2023-12-12T12:09:55.219 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000714) opened an unlinked file! 2023-12-12T12:09:55.219 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000715) opened an unlinked file! 2023-12-12T12:09:55.219 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000716) opened an unlinked file! 2023-12-12T12:09:55.219 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000717) opened an unlinked file! 2023-12-12T12:09:55.220 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000718) opened an unlinked file! 2023-12-12T12:09:55.220 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000719) opened an unlinked file! 2023-12-12T12:09:55.220 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000720) opened an unlinked file! 2023-12-12T12:09:55.220 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000721) opened an unlinked file! 2023-12-12T12:09:55.220 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000722) opened an unlinked file! 2023-12-12T12:09:55.220 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000723) opened an unlinked file! 2023-12-12T12:09:55.220 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000724) opened an unlinked file! 2023-12-12T12:09:55.220 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000725) opened an unlinked file! 2023-12-12T12:09:55.220 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000726) opened an unlinked file! 2023-12-12T12:09:55.220 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000727) opened an unlinked file! 2023-12-12T12:09:55.220 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000728) opened an unlinked file! 2023-12-12T12:09:55.220 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000729) opened an unlinked file! 2023-12-12T12:09:55.220 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000730) opened an unlinked file! 2023-12-12T12:09:55.220 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000731) opened an unlinked file! 2023-12-12T12:09:55.221 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000732) opened an unlinked file! 2023-12-12T12:09:55.221 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000733) opened an unlinked file! 2023-12-12T12:09:55.221 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000734) opened an unlinked file! 2023-12-12T12:09:55.221 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000735) opened an unlinked file! 2023-12-12T12:09:55.221 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000736) opened an unlinked file! 2023-12-12T12:09:55.221 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000737) opened an unlinked file! 2023-12-12T12:09:55.221 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000738) opened an unlinked file! 2023-12-12T12:09:55.221 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000739) opened an unlinked file! 2023-12-12T12:09:55.221 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000740) opened an unlinked file! 2023-12-12T12:09:55.221 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000741) opened an unlinked file! 2023-12-12T12:09:55.221 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000742) opened an unlinked file! 2023-12-12T12:09:55.221 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000743) opened an unlinked file! 2023-12-12T12:09:55.221 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000744) opened an unlinked file! 2023-12-12T12:09:55.221 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000745) opened an unlinked file! 2023-12-12T12:09:55.221 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000746) opened an unlinked file! 2023-12-12T12:09:55.222 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000747) opened an unlinked file! 2023-12-12T12:09:55.222 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000748) opened an unlinked file! 2023-12-12T12:09:55.222 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000749) opened an unlinked file! 2023-12-12T12:09:55.222 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000750) opened an unlinked file! 2023-12-12T12:09:55.222 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000751) opened an unlinked file! 2023-12-12T12:09:55.222 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000752) opened an unlinked file! 2023-12-12T12:09:55.222 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000753) opened an unlinked file! 2023-12-12T12:09:55.222 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000754) opened an unlinked file! 2023-12-12T12:09:55.222 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000755) opened an unlinked file! 2023-12-12T12:09:55.222 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000756) opened an unlinked file! 2023-12-12T12:09:55.222 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000757) opened an unlinked file! 2023-12-12T12:09:55.222 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000758) opened an unlinked file! 2023-12-12T12:09:55.222 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000759) opened an unlinked file! 2023-12-12T12:09:55.222 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000760) opened an unlinked file! 2023-12-12T12:09:55.222 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000761) opened an unlinked file! 2023-12-12T12:09:55.223 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000762) opened an unlinked file! 2023-12-12T12:09:55.223 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000763) opened an unlinked file! 2023-12-12T12:09:55.223 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000764) opened an unlinked file! 2023-12-12T12:09:55.223 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000765) opened an unlinked file! 2023-12-12T12:09:55.223 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000766) opened an unlinked file! 2023-12-12T12:09:55.223 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000767) opened an unlinked file! 2023-12-12T12:09:55.223 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000768) opened an unlinked file! 2023-12-12T12:09:55.223 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000769) opened an unlinked file! 2023-12-12T12:09:55.223 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000770) opened an unlinked file! 2023-12-12T12:09:55.223 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000771) opened an unlinked file! 2023-12-12T12:09:55.223 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000772) opened an unlinked file! 2023-12-12T12:09:55.223 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000773) opened an unlinked file! 2023-12-12T12:09:55.223 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000774) opened an unlinked file! 2023-12-12T12:09:55.223 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000775) opened an unlinked file! 2023-12-12T12:09:55.224 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000776) opened an unlinked file! 2023-12-12T12:09:55.224 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000777) opened an unlinked file! 2023-12-12T12:09:55.224 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000778) opened an unlinked file! 2023-12-12T12:09:55.224 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000779) opened an unlinked file! 2023-12-12T12:09:55.224 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000780) opened an unlinked file! 2023-12-12T12:09:55.224 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000781) opened an unlinked file! 2023-12-12T12:09:55.224 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000782) opened an unlinked file! 2023-12-12T12:09:55.224 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000783) opened an unlinked file! 2023-12-12T12:09:55.224 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000784) opened an unlinked file! 2023-12-12T12:09:55.224 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000785) opened an unlinked file! 2023-12-12T12:09:55.224 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000786) opened an unlinked file! 2023-12-12T12:09:55.224 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000787) opened an unlinked file! 2023-12-12T12:09:55.224 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000788) opened an unlinked file! 2023-12-12T12:09:55.224 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000789) opened an unlinked file! 2023-12-12T12:09:55.224 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000790) opened an unlinked file! 2023-12-12T12:09:55.225 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000791) opened an unlinked file! 2023-12-12T12:09:55.225 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000792) opened an unlinked file! 2023-12-12T12:09:55.225 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000793) opened an unlinked file! 2023-12-12T12:09:55.225 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000794) opened an unlinked file! 2023-12-12T12:09:55.225 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000795) opened an unlinked file! 2023-12-12T12:09:55.225 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000796) opened an unlinked file! 2023-12-12T12:09:55.225 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000797) opened an unlinked file! 2023-12-12T12:09:55.225 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000798) opened an unlinked file! 2023-12-12T12:09:55.225 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000799) opened an unlinked file! 2023-12-12T12:09:55.225 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000800) opened an unlinked file! 2023-12-12T12:09:55.225 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000801) opened an unlinked file! 2023-12-12T12:09:55.225 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000802) opened an unlinked file! 2023-12-12T12:09:55.225 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000803) opened an unlinked file! 2023-12-12T12:09:55.225 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000804) opened an unlinked file! 2023-12-12T12:09:55.225 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000805) opened an unlinked file! 2023-12-12T12:09:55.226 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000806) opened an unlinked file! 2023-12-12T12:09:55.226 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000807) opened an unlinked file! 2023-12-12T12:09:55.226 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000808) opened an unlinked file! 2023-12-12T12:09:55.226 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000809) opened an unlinked file! 2023-12-12T12:09:55.226 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000810) opened an unlinked file! 2023-12-12T12:09:55.226 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000811) opened an unlinked file! 2023-12-12T12:09:55.226 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000812) opened an unlinked file! 2023-12-12T12:09:55.226 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000813) opened an unlinked file! 2023-12-12T12:09:55.226 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000814) opened an unlinked file! 2023-12-12T12:09:55.226 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000815) opened an unlinked file! 2023-12-12T12:09:55.226 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000816) opened an unlinked file! 2023-12-12T12:09:55.226 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000817) opened an unlinked file! 2023-12-12T12:09:55.226 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000818) opened an unlinked file! 2023-12-12T12:09:55.226 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000819) opened an unlinked file! 2023-12-12T12:09:55.227 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000820) opened an unlinked file! 2023-12-12T12:09:55.227 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000821) opened an unlinked file! 2023-12-12T12:09:55.227 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000822) opened an unlinked file! 2023-12-12T12:09:55.227 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000823) opened an unlinked file! 2023-12-12T12:09:55.227 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000824) opened an unlinked file! 2023-12-12T12:09:55.227 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000825) opened an unlinked file! 2023-12-12T12:09:55.227 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000826) opened an unlinked file! 2023-12-12T12:09:55.227 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000827) opened an unlinked file! 2023-12-12T12:09:55.227 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000828) opened an unlinked file! 2023-12-12T12:09:55.227 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000829) opened an unlinked file! 2023-12-12T12:09:55.227 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000830) opened an unlinked file! 2023-12-12T12:09:55.227 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000831) opened an unlinked file! 2023-12-12T12:09:55.227 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000832) opened an unlinked file! 2023-12-12T12:09:55.227 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000833) opened an unlinked file! 2023-12-12T12:09:55.227 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000834) opened an unlinked file! 2023-12-12T12:09:55.228 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000835) opened an unlinked file! 2023-12-12T12:09:55.228 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000836) opened an unlinked file! 2023-12-12T12:09:55.228 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000837) opened an unlinked file! 2023-12-12T12:09:55.228 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000838) opened an unlinked file! 2023-12-12T12:09:55.228 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000839) opened an unlinked file! 2023-12-12T12:09:55.228 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000840) opened an unlinked file! 2023-12-12T12:09:55.228 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000841) opened an unlinked file! 2023-12-12T12:09:55.228 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000842) opened an unlinked file! 2023-12-12T12:09:55.228 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000843) opened an unlinked file! 2023-12-12T12:09:55.228 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000844) opened an unlinked file! 2023-12-12T12:09:55.228 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000845) opened an unlinked file! 2023-12-12T12:09:55.228 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000846) opened an unlinked file! 2023-12-12T12:09:55.228 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000847) opened an unlinked file! 2023-12-12T12:09:55.228 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000848) opened an unlinked file! 2023-12-12T12:09:55.229 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000849) opened an unlinked file! 2023-12-12T12:09:55.229 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000850) opened an unlinked file! 2023-12-12T12:09:55.229 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000851) opened an unlinked file! 2023-12-12T12:09:55.229 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000852) opened an unlinked file! 2023-12-12T12:09:55.229 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000853) opened an unlinked file! 2023-12-12T12:09:55.229 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000854) opened an unlinked file! 2023-12-12T12:09:55.229 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000855) opened an unlinked file! 2023-12-12T12:09:55.229 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000856) opened an unlinked file! 2023-12-12T12:09:55.229 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000857) opened an unlinked file! 2023-12-12T12:09:55.229 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000858) opened an unlinked file! 2023-12-12T12:09:55.229 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000859) opened an unlinked file! 2023-12-12T12:09:55.229 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000860) opened an unlinked file! 2023-12-12T12:09:55.229 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000861) opened an unlinked file! 2023-12-12T12:09:55.229 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000862) opened an unlinked file! 2023-12-12T12:09:55.229 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000863) opened an unlinked file! 2023-12-12T12:09:55.230 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000864) opened an unlinked file! 2023-12-12T12:09:55.230 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000865) opened an unlinked file! 2023-12-12T12:09:55.230 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000866) opened an unlinked file! 2023-12-12T12:09:55.230 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000867) opened an unlinked file! 2023-12-12T12:09:55.230 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000868) opened an unlinked file! 2023-12-12T12:09:55.230 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000869) opened an unlinked file! 2023-12-12T12:09:55.230 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000870) opened an unlinked file! 2023-12-12T12:09:55.230 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000871) opened an unlinked file! 2023-12-12T12:09:55.230 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000872) opened an unlinked file! 2023-12-12T12:09:55.230 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000873) opened an unlinked file! 2023-12-12T12:09:55.230 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000874) opened an unlinked file! 2023-12-12T12:09:55.230 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000875) opened an unlinked file! 2023-12-12T12:09:55.230 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000876) opened an unlinked file! 2023-12-12T12:09:55.231 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000877) opened an unlinked file! 2023-12-12T12:09:55.231 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000878) opened an unlinked file! 2023-12-12T12:09:55.231 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000879) opened an unlinked file! 2023-12-12T12:09:55.231 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000880) opened an unlinked file! 2023-12-12T12:09:55.231 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000881) opened an unlinked file! 2023-12-12T12:09:55.231 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000882) opened an unlinked file! 2023-12-12T12:09:55.231 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000883) opened an unlinked file! 2023-12-12T12:09:55.231 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000884) opened an unlinked file! 2023-12-12T12:09:55.231 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000885) opened an unlinked file! 2023-12-12T12:09:55.231 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000886) opened an unlinked file! 2023-12-12T12:09:55.231 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000887) opened an unlinked file! 2023-12-12T12:09:55.231 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000888) opened an unlinked file! 2023-12-12T12:09:55.231 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000889) opened an unlinked file! 2023-12-12T12:09:55.231 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000890) opened an unlinked file! 2023-12-12T12:09:55.231 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000891) opened an unlinked file! 2023-12-12T12:09:55.232 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000892) opened an unlinked file! 2023-12-12T12:09:55.232 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000893) opened an unlinked file! 2023-12-12T12:09:55.232 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000894) opened an unlinked file! 2023-12-12T12:09:55.232 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000895) opened an unlinked file! 2023-12-12T12:09:55.232 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000896) opened an unlinked file! 2023-12-12T12:09:55.232 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000897) opened an unlinked file! 2023-12-12T12:09:55.232 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000898) opened an unlinked file! 2023-12-12T12:09:55.232 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000899) opened an unlinked file! 2023-12-12T12:09:55.232 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000900) opened an unlinked file! 2023-12-12T12:09:55.232 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000901) opened an unlinked file! 2023-12-12T12:09:55.232 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000902) opened an unlinked file! 2023-12-12T12:09:55.232 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000903) opened an unlinked file! 2023-12-12T12:09:55.232 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000904) opened an unlinked file! 2023-12-12T12:09:55.232 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000905) opened an unlinked file! 2023-12-12T12:09:55.233 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000906) opened an unlinked file! 2023-12-12T12:09:55.233 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000907) opened an unlinked file! 2023-12-12T12:09:55.233 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000908) opened an unlinked file! 2023-12-12T12:09:55.233 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000909) opened an unlinked file! 2023-12-12T12:09:55.233 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000910) opened an unlinked file! 2023-12-12T12:09:55.233 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000911) opened an unlinked file! 2023-12-12T12:09:55.233 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000912) opened an unlinked file! 2023-12-12T12:09:55.233 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000913) opened an unlinked file! 2023-12-12T12:09:55.233 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000914) opened an unlinked file! 2023-12-12T12:09:55.233 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000915) opened an unlinked file! 2023-12-12T12:09:55.233 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000916) opened an unlinked file! 2023-12-12T12:09:55.233 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000917) opened an unlinked file! 2023-12-12T12:09:55.233 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000918) opened an unlinked file! 2023-12-12T12:09:55.233 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000919) opened an unlinked file! 2023-12-12T12:09:55.233 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000920) opened an unlinked file! 2023-12-12T12:09:55.234 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000921) opened an unlinked file! 2023-12-12T12:09:55.234 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000922) opened an unlinked file! 2023-12-12T12:09:55.234 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000923) opened an unlinked file! 2023-12-12T12:09:55.234 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000924) opened an unlinked file! 2023-12-12T12:09:55.234 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000925) opened an unlinked file! 2023-12-12T12:09:55.234 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000926) opened an unlinked file! 2023-12-12T12:09:55.234 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000927) opened an unlinked file! 2023-12-12T12:09:55.234 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000928) opened an unlinked file! 2023-12-12T12:09:55.234 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000929) opened an unlinked file! 2023-12-12T12:09:55.234 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000930) opened an unlinked file! 2023-12-12T12:09:55.234 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000931) opened an unlinked file! 2023-12-12T12:09:55.234 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000932) opened an unlinked file! 2023-12-12T12:09:55.234 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000933) opened an unlinked file! 2023-12-12T12:09:55.234 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000934) opened an unlinked file! 2023-12-12T12:09:55.235 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000935) opened an unlinked file! 2023-12-12T12:09:55.235 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000936) opened an unlinked file! 2023-12-12T12:09:55.235 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000937) opened an unlinked file! 2023-12-12T12:09:55.235 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000938) opened an unlinked file! 2023-12-12T12:09:55.235 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000939) opened an unlinked file! 2023-12-12T12:09:55.235 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000940) opened an unlinked file! 2023-12-12T12:09:55.235 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000941) opened an unlinked file! 2023-12-12T12:09:55.235 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000942) opened an unlinked file! 2023-12-12T12:09:55.235 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000943) opened an unlinked file! 2023-12-12T12:09:55.235 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000944) opened an unlinked file! 2023-12-12T12:09:55.235 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000945) opened an unlinked file! 2023-12-12T12:09:55.235 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000946) opened an unlinked file! 2023-12-12T12:09:55.235 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000947) opened an unlinked file! 2023-12-12T12:09:55.235 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000948) opened an unlinked file! 2023-12-12T12:09:55.235 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000949) opened an unlinked file! 2023-12-12T12:09:55.236 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000950) opened an unlinked file! 2023-12-12T12:09:55.236 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000951) opened an unlinked file! 2023-12-12T12:09:55.236 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000952) opened an unlinked file! 2023-12-12T12:09:55.236 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000953) opened an unlinked file! 2023-12-12T12:09:55.236 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000954) opened an unlinked file! 2023-12-12T12:09:55.236 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000955) opened an unlinked file! 2023-12-12T12:09:55.236 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000956) opened an unlinked file! 2023-12-12T12:09:55.236 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000957) opened an unlinked file! 2023-12-12T12:09:55.236 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000958) opened an unlinked file! 2023-12-12T12:09:55.236 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000959) opened an unlinked file! 2023-12-12T12:09:55.236 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000960) opened an unlinked file! 2023-12-12T12:09:55.236 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000961) opened an unlinked file! 2023-12-12T12:09:55.236 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000962) opened an unlinked file! 2023-12-12T12:09:55.236 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000963) opened an unlinked file! 2023-12-12T12:09:55.236 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000964) opened an unlinked file! 2023-12-12T12:09:55.237 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000965) opened an unlinked file! 2023-12-12T12:09:55.237 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000966) opened an unlinked file! 2023-12-12T12:09:55.237 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000967) opened an unlinked file! 2023-12-12T12:09:55.237 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000968) opened an unlinked file! 2023-12-12T12:09:55.237 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000969) opened an unlinked file! 2023-12-12T12:09:55.237 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000970) opened an unlinked file! 2023-12-12T12:09:55.237 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000971) opened an unlinked file! 2023-12-12T12:09:55.237 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000972) opened an unlinked file! 2023-12-12T12:09:55.237 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000973) opened an unlinked file! 2023-12-12T12:09:55.237 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000974) opened an unlinked file! 2023-12-12T12:09:55.237 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000975) opened an unlinked file! 2023-12-12T12:09:55.237 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000976) opened an unlinked file! 2023-12-12T12:09:55.237 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000977) opened an unlinked file! 2023-12-12T12:09:55.237 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000978) opened an unlinked file! 2023-12-12T12:09:55.237 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000979) opened an unlinked file! 2023-12-12T12:09:55.238 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000980) opened an unlinked file! 2023-12-12T12:09:55.238 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000981) opened an unlinked file! 2023-12-12T12:09:55.238 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000982) opened an unlinked file! 2023-12-12T12:09:55.238 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000983) opened an unlinked file! 2023-12-12T12:09:55.238 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000984) opened an unlinked file! 2023-12-12T12:09:55.238 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000985) opened an unlinked file! 2023-12-12T12:09:55.238 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000986) opened an unlinked file! 2023-12-12T12:09:55.238 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000987) opened an unlinked file! 2023-12-12T12:09:55.238 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000988) opened an unlinked file! 2023-12-12T12:09:55.238 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000989) opened an unlinked file! 2023-12-12T12:09:55.238 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000990) opened an unlinked file! 2023-12-12T12:09:55.238 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000991) opened an unlinked file! 2023-12-12T12:09:55.238 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000992) opened an unlinked file! 2023-12-12T12:09:55.238 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000993) opened an unlinked file! 2023-12-12T12:09:55.239 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000994) opened an unlinked file! 2023-12-12T12:09:55.239 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000995) opened an unlinked file! 2023-12-12T12:09:55.239 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000996) opened an unlinked file! 2023-12-12T12:09:55.239 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000997) opened an unlinked file! 2023-12-12T12:09:55.239 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000998) opened an unlinked file! 2023-12-12T12:09:55.239 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file000999) opened an unlinked file! 2023-12-12T12:09:55.239 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file001000) opened an unlinked file! 2023-12-12T12:09:55.239 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file001001) opened an unlinked file! 2023-12-12T12:09:55.239 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file001002) opened an unlinked file! 2023-12-12T12:09:55.239 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file001003) opened an unlinked file! 2023-12-12T12:09:55.239 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file001004) opened an unlinked file! 2023-12-12T12:09:55.239 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file001005) opened an unlinked file! 2023-12-12T12:09:55.239 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file001006) opened an unlinked file! 2023-12-12T12:09:55.239 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file001007) opened an unlinked file! 2023-12-12T12:09:55.240 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file001008) opened an unlinked file! 2023-12-12T12:09:55.240 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file001009) opened an unlinked file! 2023-12-12T12:09:55.240 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file001010) opened an unlinked file! 2023-12-12T12:09:55.240 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file001011) opened an unlinked file! 2023-12-12T12:09:55.240 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file001012) opened an unlinked file! 2023-12-12T12:09:55.240 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file001013) opened an unlinked file! 2023-12-12T12:09:55.240 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file001014) opened an unlinked file! 2023-12-12T12:09:55.240 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file001015) opened an unlinked file! 2023-12-12T12:09:55.240 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file001016) opened an unlinked file! 2023-12-12T12:09:55.240 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file001017) opened an unlinked file! 2023-12-12T12:09:55.240 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file001018) opened an unlinked file! 2023-12-12T12:09:55.240 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file001019) opened an unlinked file! 2023-12-12T12:09:55.240 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file001020) opened an unlinked file! 2023-12-12T12:09:55.240 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file001021) opened an unlinked file! 2023-12-12T12:09:55.240 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file001022) opened an unlinked file! 2023-12-12T12:09:55.241 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/426-dir/file001023) opened an unlinked file! 2023-12-12T12:09:55.241 INFO:teuthology.orchestra.run.smithi078.stdout: test_file_handles TEST_DIR/426-dir 2023-12-12T12:09:55.241 INFO:teuthology.orchestra.run.smithi078.stdout: test_file_handles TEST_DIR/426-dir -l 2023-12-12T12:09:55.241 INFO:teuthology.orchestra.run.smithi078.stdout: test_file_handles TEST_DIR/426-dir -u 2023-12-12T12:09:55.241 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/426 2023-12-12T12:09:55.241 INFO:teuthology.orchestra.run.smithi078.stdout:Failures: generic/426 2023-12-12T12:09:55.241 INFO:teuthology.orchestra.run.smithi078.stdout:Failed 1 of 1 tests 2023-12-12T12:09:55.291 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:09:55.355 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-12T12:09:55.356 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-12-12T12:09:55.356 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-12-12T12:09:55.356 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/427) 2023-12-12T12:09:57.094 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:09:57.105 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:09:57.105 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:09:57.474 INFO:teuthology.orchestra.run.smithi078.stdout:generic/427 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:09:57.482 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/427 2023-12-12T12:09:57.482 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/427 2023-12-12T12:09:57.483 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:09:57.489 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:09:57.508 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:09:57.508 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/428) 2023-12-12T12:09:57.884 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:09:57.895 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:09:57.895 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:09:58.253 INFO:teuthology.orchestra.run.smithi078.stdout:generic/428 1s 2023-12-12T12:09:58.279 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/428 2023-12-12T12:09:58.279 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:09:58.285 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:09:58.306 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:09:58.306 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/429) 2023-12-12T12:09:58.664 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:09:58.674 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:09:58.674 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:09:59.043 INFO:teuthology.orchestra.run.smithi078.stdout:generic/429 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:09:59.054 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/429 2023-12-12T12:09:59.054 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/429 2023-12-12T12:09:59.054 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:09:59.057 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:09:59.077 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:09:59.077 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/430) 2023-12-12T12:09:59.445 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:09:59.455 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:09:59.455 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:10:00.034 INFO:teuthology.orchestra.run.smithi078.stdout:generic/430 0s 2023-12-12T12:10:00.047 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/430 2023-12-12T12:10:00.047 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:10:00.053 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:10:00.074 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:10:00.074 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/431) 2023-12-12T12:10:00.752 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:10:00.763 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:10:00.763 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:10:01.247 INFO:teuthology.orchestra.run.smithi078.stdout:generic/431 1s 2023-12-12T12:10:01.259 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/431 2023-12-12T12:10:01.260 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:10:01.266 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:10:01.286 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:10:01.287 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/432) 2023-12-12T12:10:01.968 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:10:01.978 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:10:01.978 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:10:02.540 INFO:teuthology.orchestra.run.smithi078.stdout:generic/432 1s 2023-12-12T12:10:02.553 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/432 2023-12-12T12:10:02.553 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:10:02.559 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:10:02.729 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:10:02.730 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/433) 2023-12-12T12:10:03.264 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:10:03.274 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:10:03.275 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:10:03.757 INFO:teuthology.orchestra.run.smithi078.stdout:generic/433 0s 2023-12-12T12:10:03.770 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/433 2023-12-12T12:10:03.771 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:10:03.777 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:10:03.797 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:10:03.797 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/434) 2023-12-12T12:10:04.478 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:10:04.488 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:10:04.489 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:10:04.992 INFO:teuthology.orchestra.run.smithi078.stdout:generic/434 - output mismatch (see /tmp/tmp.GmWnCxuSqIxfstests-dev/results//generic/434.out.bad) 2023-12-12T12:10:04.998 INFO:teuthology.orchestra.run.smithi078.stdout: --- tests/generic/434.out 2023-12-12 10:13:40.424815905 +0000 2023-12-12T12:10:04.998 INFO:teuthology.orchestra.run.smithi078.stdout: +++ /tmp/tmp.GmWnCxuSqIxfstests-dev/results//generic/434.out.bad 2023-12-12 12:10:04.985293555 +0000 2023-12-12T12:10:04.998 INFO:teuthology.orchestra.run.smithi078.stdout: @@ -9,6 +9,6 @@ 2023-12-12T12:10:04.998 INFO:teuthology.orchestra.run.smithi078.stdout: copy_range: Bad file descriptor 2023-12-12T12:10:04.998 INFO:teuthology.orchestra.run.smithi078.stdout: d41d8cd98f00b204e9800998ecf8427e TEST_DIR/test-434/copy 2023-12-12T12:10:04.998 INFO:teuthology.orchestra.run.smithi078.stdout: Try to copy to a device 2023-12-12T12:10:04.998 INFO:teuthology.orchestra.run.smithi078.stdout: -copy_range: Invalid argument 2023-12-12T12:10:04.998 INFO:teuthology.orchestra.run.smithi078.stdout: +/tmp/tmp.Rxjq0xhkP8test/test-434/dev1: Permission denied 2023-12-12T12:10:04.998 INFO:teuthology.orchestra.run.smithi078.stdout: Try to copy to a fifo 2023-12-12T12:10:04.999 INFO:teuthology.orchestra.run.smithi078.stdout: copy_range: Invalid argument 2023-12-12T12:10:05.006 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/434 2023-12-12T12:10:05.006 INFO:teuthology.orchestra.run.smithi078.stdout:Failures: generic/434 2023-12-12T12:10:05.006 INFO:teuthology.orchestra.run.smithi078.stdout:Failed 1 of 1 tests 2023-12-12T12:10:05.010 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:10:05.226 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-12T12:10:05.227 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-12-12T12:10:05.227 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-12-12T12:10:05.227 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/435) 2023-12-12T12:10:05.728 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:10:05.738 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:10:05.739 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:10:06.093 INFO:teuthology.orchestra.run.smithi078.stdout:generic/435 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:10:06.101 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/435 2023-12-12T12:10:06.102 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/435 2023-12-12T12:10:06.102 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:10:06.108 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:10:06.128 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:10:06.128 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/436) 2023-12-12T12:10:06.496 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:10:06.507 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:10:06.507 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:10:07.780 INFO:teuthology.orchestra.run.smithi078.stdout:generic/436 1s 2023-12-12T12:10:07.793 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/436 2023-12-12T12:10:07.793 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:10:07.798 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:10:07.996 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:10:07.996 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/437) 2023-12-12T12:10:08.537 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:10:08.547 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:10:08.547 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:10:09.684 INFO:teuthology.orchestra.run.smithi078.stdout:generic/437 1s 2023-12-12T12:10:09.697 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/437 2023-12-12T12:10:09.697 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:10:09.703 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:10:09.724 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:10:09.724 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/438) 2023-12-12T12:10:10.092 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:10:10.103 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:10:10.103 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:10:10.450 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:10:10.454 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:10:40.572 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:10:40.577 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:11:10.726 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:11:10.730 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:11:40.881 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:11:40.890 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:11:48.512 INFO:teuthology.orchestra.run.smithi078.stdout:generic/438 98s 2023-12-12T12:11:48.525 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/438 2023-12-12T12:11:48.525 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:11:48.531 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:11:48.552 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:11:48.553 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/439) 2023-12-12T12:11:48.901 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:11:48.911 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:11:48.911 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:11:49.230 INFO:teuthology.orchestra.run.smithi078.stdout:generic/439 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:11:49.239 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/439 2023-12-12T12:11:49.239 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/439 2023-12-12T12:11:49.239 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:11:49.245 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:11:49.264 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:11:49.264 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/440) 2023-12-12T12:11:49.645 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:11:49.655 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:11:49.655 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:11:50.000 INFO:teuthology.orchestra.run.smithi078.stdout:generic/440 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:11:50.009 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/440 2023-12-12T12:11:50.009 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/440 2023-12-12T12:11:50.009 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:11:50.015 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:11:50.035 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:11:50.035 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/441) 2023-12-12T12:11:50.425 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:11:50.436 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:11:50.436 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:11:52.310 INFO:teuthology.orchestra.run.smithi078.stdout:generic/441 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:11:52.319 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/441 2023-12-12T12:11:52.320 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/441 2023-12-12T12:11:52.320 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:11:52.326 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:11:52.348 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:11:52.348 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/442) 2023-12-12T12:11:52.725 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:11:52.735 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:11:52.735 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:11:53.047 INFO:teuthology.orchestra.run.smithi078.stdout:generic/442 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:11:53.055 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/442 2023-12-12T12:11:53.056 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/442 2023-12-12T12:11:53.056 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:11:53.061 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:11:53.081 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:11:53.081 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/443) 2023-12-12T12:11:53.457 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:11:53.467 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:11:53.467 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:11:53.813 INFO:teuthology.orchestra.run.smithi078.stdout:generic/443 0s 2023-12-12T12:11:53.825 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/443 2023-12-12T12:11:53.825 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:11:53.831 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:11:53.853 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:11:53.853 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/444) 2023-12-12T12:11:54.224 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:11:54.232 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:11:54.232 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:11:54.563 INFO:teuthology.orchestra.run.smithi078.stdout:generic/444 [not run] ACLs not supported by this filesystem type: ceph-fuse 2023-12-12T12:11:54.571 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/444 2023-12-12T12:11:54.571 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/444 2023-12-12T12:11:54.571 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:11:54.578 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:11:54.596 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:11:54.596 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/445) 2023-12-12T12:11:54.981 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:11:54.992 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:11:54.992 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:11:56.254 INFO:teuthology.orchestra.run.smithi078.stdout:generic/445 1s 2023-12-12T12:11:56.267 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/445 2023-12-12T12:11:56.267 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:11:56.273 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:11:56.299 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:11:56.299 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/446) 2023-12-12T12:11:56.976 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:11:56.986 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:11:56.986 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:11:57.265 INFO:teuthology.orchestra.run.smithi078.stdout:generic/446 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:11:57.273 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/446 2023-12-12T12:11:57.273 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/446 2023-12-12T12:11:57.273 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:11:57.280 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:11:57.299 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:11:57.299 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/447) 2023-12-12T12:11:57.665 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:11:57.676 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:11:57.676 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:11:57.939 INFO:teuthology.orchestra.run.smithi078.stdout:generic/447 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:11:57.947 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/447 2023-12-12T12:11:57.947 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/447 2023-12-12T12:11:57.947 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:11:57.953 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:11:57.973 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:11:57.973 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/448) 2023-12-12T12:11:58.333 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:11:58.344 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:11:58.344 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:11:59.512 INFO:teuthology.orchestra.run.smithi078.stdout:generic/448 1s 2023-12-12T12:11:59.525 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/448 2023-12-12T12:11:59.525 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:11:59.531 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:11:59.576 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:11:59.577 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/449) 2023-12-12T12:12:00.232 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:12:00.243 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:12:00.243 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:12:00.530 INFO:teuthology.orchestra.run.smithi078.stdout:generic/449 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:12:00.540 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/449 2023-12-12T12:12:00.540 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/449 2023-12-12T12:12:00.540 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:12:00.545 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:12:00.564 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:12:00.565 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/450) 2023-12-12T12:12:00.924 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:12:00.934 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:12:00.934 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:12:02.289 INFO:teuthology.orchestra.run.smithi078.stdout:generic/450 2s 2023-12-12T12:12:02.302 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/450 2023-12-12T12:12:02.302 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:12:02.308 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:12:02.468 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:12:02.468 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/451) 2023-12-12T12:12:03.013 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:12:03.023 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:12:03.023 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:12:03.678 INFO:teuthology.orchestra.run.smithi078.stdout:generic/451 - output mismatch (see /tmp/tmp.GmWnCxuSqIxfstests-dev/results//generic/451.out.bad) 2023-12-12T12:12:03.683 INFO:teuthology.orchestra.run.smithi078.stdout: --- tests/generic/451.out 2023-12-12 10:13:40.424815905 +0000 2023-12-12T12:12:03.683 INFO:teuthology.orchestra.run.smithi078.stdout: +++ /tmp/tmp.GmWnCxuSqIxfstests-dev/results//generic/451.out.bad 2023-12-12 12:12:03.671369904 +0000 2023-12-12T12:12:03.684 INFO:teuthology.orchestra.run.smithi078.stdout: @@ -1,2 +1,5 @@ 2023-12-12T12:12:03.684 INFO:teuthology.orchestra.run.smithi078.stdout: QA output created by 451 2023-12-12T12:12:03.684 INFO:teuthology.orchestra.run.smithi078.stdout: +get stale data from buffer read 2023-12-12T12:12:03.684 INFO:teuthology.orchestra.run.smithi078.stdout: +00000000 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................ 2023-12-12T12:12:03.684 INFO:teuthology.orchestra.run.smithi078.stdout: +000a0000 2023-12-12T12:12:03.684 INFO:teuthology.orchestra.run.smithi078.stdout: Silence is golden 2023-12-12T12:12:03.689 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/451 2023-12-12T12:12:03.689 INFO:teuthology.orchestra.run.smithi078.stdout:Failures: generic/451 2023-12-12T12:12:03.689 INFO:teuthology.orchestra.run.smithi078.stdout:Failed 1 of 1 tests 2023-12-12T12:12:03.696 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:12:03.770 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-12T12:12:03.771 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-12-12T12:12:03.771 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-12-12T12:12:03.771 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/452) 2023-12-12T12:12:04.465 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:12:04.476 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:12:04.476 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:12:04.742 INFO:teuthology.orchestra.run.smithi078.stdout:generic/452 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:12:04.750 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/452 2023-12-12T12:12:04.751 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/452 2023-12-12T12:12:04.751 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:12:04.757 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:12:04.776 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:12:04.776 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/453) 2023-12-12T12:12:05.124 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:12:05.134 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:12:05.134 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:12:05.424 INFO:teuthology.orchestra.run.smithi078.stdout:generic/453 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:12:05.432 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/453 2023-12-12T12:12:05.432 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/453 2023-12-12T12:12:05.433 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:12:05.439 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:12:05.507 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:12:05.507 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/454) 2023-12-12T12:12:05.864 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:12:05.874 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:12:05.874 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:12:06.137 INFO:teuthology.orchestra.run.smithi078.stdout:generic/454 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:12:06.145 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/454 2023-12-12T12:12:06.145 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/454 2023-12-12T12:12:06.145 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:12:06.151 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:12:06.171 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:12:06.171 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/455) 2023-12-12T12:12:06.540 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:12:06.551 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:12:06.551 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:12:06.922 INFO:teuthology.orchestra.run.smithi078.stdout:generic/455 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:12:06.931 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/455 2023-12-12T12:12:06.931 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/455 2023-12-12T12:12:06.931 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:12:06.937 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:12:06.956 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:12:06.957 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/456) 2023-12-12T12:12:07.332 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:12:07.342 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:12:07.342 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:12:07.906 INFO:teuthology.orchestra.run.smithi078.stdout:generic/456 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:12:07.915 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/456 2023-12-12T12:12:07.915 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/456 2023-12-12T12:12:07.916 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:12:07.922 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:12:07.942 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:12:07.942 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/457) 2023-12-12T12:12:08.330 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:12:08.340 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:12:08.340 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:12:08.818 INFO:teuthology.orchestra.run.smithi078.stdout:generic/457 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:12:08.826 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/457 2023-12-12T12:12:08.826 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/457 2023-12-12T12:12:08.826 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:12:08.833 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:12:08.853 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:12:08.853 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/458) 2023-12-12T12:12:09.212 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:12:09.222 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:12:09.222 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:12:09.524 INFO:teuthology.orchestra.run.smithi078.stdout:generic/458 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:12:09.532 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/458 2023-12-12T12:12:09.532 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/458 2023-12-12T12:12:09.532 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:12:09.538 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:12:09.559 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:12:09.560 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/459) 2023-12-12T12:12:09.928 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:12:09.939 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:12:09.939 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:12:10.417 INFO:teuthology.orchestra.run.smithi078.stdout:generic/459 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:12:10.425 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/459 2023-12-12T12:12:10.425 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/459 2023-12-12T12:12:10.425 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:12:10.432 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:12:10.491 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:12:10.491 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/460) 2023-12-12T12:12:10.867 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:12:10.878 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:12:10.878 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:12:10.987 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:12:10.991 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:12:11.159 INFO:teuthology.orchestra.run.smithi078.stdout:generic/460 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:12:11.167 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/460 2023-12-12T12:12:11.168 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/460 2023-12-12T12:12:11.168 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:12:11.174 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:12:11.193 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:12:11.193 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/461) 2023-12-12T12:12:11.568 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:12:11.579 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:12:11.580 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:12:11.859 INFO:teuthology.orchestra.run.smithi078.stdout:generic/461 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:12:11.868 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/461 2023-12-12T12:12:11.868 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/461 2023-12-12T12:12:11.868 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:12:11.874 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:12:11.894 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:12:11.894 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/462) 2023-12-12T12:12:12.277 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:12:12.287 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:12:12.287 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:12:12.569 INFO:teuthology.orchestra.run.smithi078.stdout:generic/462 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:12:12.577 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/462 2023-12-12T12:12:12.577 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/462 2023-12-12T12:12:12.577 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:12:12.584 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:12:12.604 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:12:12.604 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/463) 2023-12-12T12:12:12.991 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:12:12.999 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:12:12.999 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:12:13.391 INFO:teuthology.orchestra.run.smithi078.stdout:generic/463 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-12-12T12:12:13.399 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/463 2023-12-12T12:12:13.399 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/463 2023-12-12T12:12:13.399 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:12:13.405 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:12:13.448 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:12:13.448 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/464) 2023-12-12T12:12:14.112 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:12:14.123 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:12:14.123 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:12:14.417 INFO:teuthology.orchestra.run.smithi078.stdout:generic/464 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:12:14.426 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/464 2023-12-12T12:12:14.426 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/464 2023-12-12T12:12:14.426 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:12:14.432 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:12:14.499 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:12:14.499 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/465) 2023-12-12T12:12:14.849 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:12:14.862 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:12:14.863 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:12:30.579 INFO:teuthology.orchestra.run.smithi078.stdout:generic/465 16s 2023-12-12T12:12:30.698 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/465 2023-12-12T12:12:30.698 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:12:30.718 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:12:30.788 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:12:30.788 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/466) 2023-12-12T12:12:31.233 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:12:31.243 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:12:31.243 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:12:31.510 INFO:teuthology.orchestra.run.smithi078.stdout:generic/466 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:12:31.518 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/466 2023-12-12T12:12:31.519 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/466 2023-12-12T12:12:31.519 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:12:31.524 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:12:31.543 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:12:31.543 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/467) 2023-12-12T12:12:31.897 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:12:31.908 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:12:31.908 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:12:39.792 INFO:teuthology.orchestra.run.smithi078.stdout:generic/467 - output mismatch (see /tmp/tmp.GmWnCxuSqIxfstests-dev/results//generic/467.out.bad) 2023-12-12T12:12:39.807 INFO:teuthology.orchestra.run.smithi078.stdout: --- tests/generic/467.out 2023-12-12 10:13:40.428815781 +0000 2023-12-12T12:12:39.808 INFO:teuthology.orchestra.run.smithi078.stdout: +++ /tmp/tmp.GmWnCxuSqIxfstests-dev/results//generic/467.out.bad 2023-12-12 12:12:39.778787283 +0000 2023-12-12T12:12:39.808 INFO:teuthology.orchestra.run.smithi078.stdout: @@ -1,5 +1,15 @@ 2023-12-12T12:12:39.808 INFO:teuthology.orchestra.run.smithi078.stdout: QA output created by 467 2023-12-12T12:12:39.808 INFO:teuthology.orchestra.run.smithi078.stdout: test_file_handles TEST_DIR/467-dir -dp 2023-12-12T12:12:39.808 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/467-dir/file000000) opened an unlinked file! 2023-12-12T12:12:39.808 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/467-dir/file000001) opened an unlinked file! 2023-12-12T12:12:39.808 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/467-dir/file000002) opened an unlinked file! 2023-12-12T12:12:39.808 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/467-dir/file000003) opened an unlinked file! 2023-12-12T12:12:39.809 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/467-dir/file000004) opened an unlinked file! 2023-12-12T12:12:39.809 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/467-dir/file000005) opened an unlinked file! 2023-12-12T12:12:39.809 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/467-dir/file000006) opened an unlinked file! 2023-12-12T12:12:39.809 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/467-dir/file000007) opened an unlinked file! 2023-12-12T12:12:39.809 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/467-dir/file000008) opened an unlinked file! 2023-12-12T12:12:39.809 INFO:teuthology.orchestra.run.smithi078.stdout: +open_by_handle(/tmp/tmp.Rxjq0xhkP8test/467-dir/file000009) opened an unlinked file! 2023-12-12T12:12:39.809 INFO:teuthology.orchestra.run.smithi078.stdout: test_file_handles TEST_DIR/467-dir -rp 2023-12-12T12:12:39.809 INFO:teuthology.orchestra.run.smithi078.stdout: test_file_handles TEST_DIR/467-dir -dkr 2023-12-12T12:12:39.809 INFO:teuthology.orchestra.run.smithi078.stdout: test_file_handles TEST_DIR/467-dir -lr 2023-12-12T12:12:39.832 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/467 2023-12-12T12:12:39.832 INFO:teuthology.orchestra.run.smithi078.stdout:Failures: generic/467 2023-12-12T12:12:39.832 INFO:teuthology.orchestra.run.smithi078.stdout:Failed 1 of 1 tests 2023-12-12T12:12:39.867 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:12:39.972 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-12T12:12:39.972 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-12-12T12:12:39.972 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-12-12T12:12:39.973 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/468) 2023-12-12T12:12:41.143 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:12:41.147 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:12:41.781 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:12:41.792 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:12:41.792 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:12:42.127 INFO:teuthology.orchestra.run.smithi078.stdout:generic/468 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:12:42.135 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/468 2023-12-12T12:12:42.136 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/468 2023-12-12T12:12:42.136 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:12:42.142 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:12:42.162 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:12:42.162 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/469) 2023-12-12T12:12:42.542 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:12:42.552 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:12:42.552 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:12:45.191 INFO:teuthology.orchestra.run.smithi078.stdout:generic/469 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-12-12T12:12:45.199 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/469 2023-12-12T12:12:45.199 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/469 2023-12-12T12:12:45.199 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:12:45.206 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:12:45.244 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:12:45.244 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/470) 2023-12-12T12:12:45.952 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:12:45.963 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:12:45.963 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:12:46.319 INFO:teuthology.orchestra.run.smithi078.stdout:generic/470 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:12:46.327 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/470 2023-12-12T12:12:46.327 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/470 2023-12-12T12:12:46.327 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:12:46.333 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:12:46.354 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:12:46.355 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/471) 2023-12-12T12:12:46.712 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:12:46.722 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:12:46.723 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:13:11.498 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:13:11.502 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:13:42.371 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:13:42.375 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:13:49.098 INFO:teuthology.orchestra.run.smithi078.stdout:generic/471 62s 2023-12-12T12:13:49.110 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/471 2023-12-12T12:13:49.111 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:13:49.116 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:13:49.138 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:13:49.139 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/472) 2023-12-12T12:13:50.021 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:13:50.032 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:13:50.032 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:13:50.333 INFO:teuthology.orchestra.run.smithi078.stdout:generic/472 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:13:50.341 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/472 2023-12-12T12:13:50.342 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/472 2023-12-12T12:13:50.342 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:13:50.350 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:13:50.367 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:13:50.367 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/473) 2023-12-12T12:13:50.736 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:13:50.747 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:13:50.747 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:13:51.110 INFO:teuthology.orchestra.run.smithi078.stdout:generic/473 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-12-12T12:13:51.119 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/473 2023-12-12T12:13:51.119 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/473 2023-12-12T12:13:51.119 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:13:51.126 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:13:51.145 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:13:51.146 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/474) 2023-12-12T12:13:51.498 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:13:51.509 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:13:51.509 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:13:51.791 INFO:teuthology.orchestra.run.smithi078.stdout:generic/474 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:13:51.799 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/474 2023-12-12T12:13:51.799 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/474 2023-12-12T12:13:51.800 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:13:51.806 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:13:51.825 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:13:51.826 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/475) 2023-12-12T12:13:52.197 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:13:52.208 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:13:52.208 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:13:52.538 INFO:teuthology.orchestra.run.smithi078.stdout:generic/475 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:13:52.546 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/475 2023-12-12T12:13:52.546 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/475 2023-12-12T12:13:52.546 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:13:52.552 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:13:52.572 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:13:52.572 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/476) 2023-12-12T12:13:52.937 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:13:52.947 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:13:52.947 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:13:53.240 INFO:teuthology.orchestra.run.smithi078.stdout:generic/476 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:13:53.248 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/476 2023-12-12T12:13:53.248 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/476 2023-12-12T12:13:53.248 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:13:53.254 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:13:53.274 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:13:53.275 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/477) 2023-12-12T12:13:53.648 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:13:53.658 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:13:53.659 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:14:09.278 INFO:teuthology.orchestra.run.smithi078.stdout:generic/477 16s 2023-12-12T12:14:09.437 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/477 2023-12-12T12:14:09.437 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:14:09.443 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:14:09.488 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:14:09.489 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/478) 2023-12-12T12:14:11.094 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:14:11.105 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:14:11.105 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:14:12.487 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:14:12.491 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:14:12.595 INFO:tasks.ceph.mds.c.smithi078.stderr:2023-12-12T12:14:12.593+0000 7f93f9020640 -1 Fail to open '/proc/390968/cmdline' error = (2) No such file or directory 2023-12-12T12:14:12.596 INFO:tasks.ceph.mds.c.smithi078.stderr:2023-12-12T12:14:12.593+0000 7f93f9020640 -1 received signal: Hangup from (PID: 390968) UID: 0 2023-12-12T12:14:12.596 INFO:tasks.ceph.mds.a.smithi078.stderr:2023-12-12T12:14:12.593+0000 7fd9e625e640 -1 Fail to open '/proc/390968/cmdline' error = (2) No such file or directory 2023-12-12T12:14:12.596 INFO:tasks.ceph.mds.a.smithi078.stderr:2023-12-12T12:14:12.593+0000 7fd9e625e640 -1 received signal: Hangup from (PID: 390968) UID: 0 2023-12-12T12:14:21.920 INFO:teuthology.orchestra.run.smithi078.stdout:generic/478 - output mismatch (see /tmp/tmp.GmWnCxuSqIxfstests-dev/results//generic/478.out.bad) 2023-12-12T12:14:21.926 INFO:teuthology.orchestra.run.smithi078.stdout: --- tests/generic/478.out 2023-12-12 10:13:40.428815781 +0000 2023-12-12T12:14:21.926 INFO:teuthology.orchestra.run.smithi078.stdout: +++ /tmp/tmp.GmWnCxuSqIxfstests-dev/results//generic/478.out.bad 2023-12-12 12:14:21.913133692 +0000 2023-12-12T12:14:21.926 INFO:teuthology.orchestra.run.smithi078.stdout: @@ -10,7 +10,7 @@ 2023-12-12T12:14:21.926 INFO:teuthology.orchestra.run.smithi078.stdout: lock could be placed 2023-12-12T12:14:21.927 INFO:teuthology.orchestra.run.smithi078.stdout: get wrlck 2023-12-12T12:14:21.927 INFO:teuthology.orchestra.run.smithi078.stdout: lock could be placed 2023-12-12T12:14:21.927 INFO:teuthology.orchestra.run.smithi078.stdout: -lock could be placed 2023-12-12T12:14:21.927 INFO:teuthology.orchestra.run.smithi078.stdout: +get wrlck 2023-12-12T12:14:21.927 INFO:teuthology.orchestra.run.smithi078.stdout: lock could be placed 2023-12-12T12:14:21.927 INFO:teuthology.orchestra.run.smithi078.stdout: lock could be placed 2023-12-12T12:14:21.927 INFO:teuthology.orchestra.run.smithi078.stdout: lock could be placed 2023-12-12T12:14:21.927 INFO:teuthology.orchestra.run.smithi078.stdout: @@ -25,7 +25,7 @@ 2023-12-12T12:14:21.927 INFO:teuthology.orchestra.run.smithi078.stdout: lock could be placed 2023-12-12T12:14:21.928 INFO:teuthology.orchestra.run.smithi078.stdout: get wrlck 2023-12-12T12:14:21.928 INFO:teuthology.orchestra.run.smithi078.stdout: lock could be placed 2023-12-12T12:14:21.928 INFO:teuthology.orchestra.run.smithi078.stdout: -lock could be placed 2023-12-12T12:14:21.928 INFO:teuthology.orchestra.run.smithi078.stdout: +get wrlck 2023-12-12T12:14:21.928 INFO:teuthology.orchestra.run.smithi078.stdout: lock could be placed 2023-12-12T12:14:21.928 INFO:teuthology.orchestra.run.smithi078.stdout: lock could be placed 2023-12-12T12:14:21.928 INFO:teuthology.orchestra.run.smithi078.stdout: lock could be placed 2023-12-12T12:14:21.928 INFO:teuthology.orchestra.run.smithi078.stdout: @@ -37,16 +37,16 @@ 2023-12-12T12:14:21.929 INFO:teuthology.orchestra.run.smithi078.stdout: get rdlck 2023-12-12T12:14:21.929 INFO:teuthology.orchestra.run.smithi078.stdout: get rdlck 2023-12-12T12:14:21.929 INFO:teuthology.orchestra.run.smithi078.stdout: lock could be placed 2023-12-12T12:14:21.929 INFO:teuthology.orchestra.run.smithi078.stdout: -lock could be placed 2023-12-12T12:14:21.929 INFO:teuthology.orchestra.run.smithi078.stdout: +get rdlck 2023-12-12T12:14:21.929 INFO:teuthology.orchestra.run.smithi078.stdout: get rdlck 2023-12-12T12:14:21.929 INFO:teuthology.orchestra.run.smithi078.stdout: lock could be placed 2023-12-12T12:14:21.930 INFO:teuthology.orchestra.run.smithi078.stdout: get rdlck 2023-12-12T12:14:21.930 INFO:teuthology.orchestra.run.smithi078.stdout: get rdlck 2023-12-12T12:14:21.930 INFO:teuthology.orchestra.run.smithi078.stdout: -lock could be placed 2023-12-12T12:14:21.930 INFO:teuthology.orchestra.run.smithi078.stdout: +get rdlck 2023-12-12T12:14:21.930 INFO:teuthology.orchestra.run.smithi078.stdout: get rdlck 2023-12-12T12:14:21.930 INFO:teuthology.orchestra.run.smithi078.stdout: get rdlck 2023-12-12T12:14:21.930 INFO:teuthology.orchestra.run.smithi078.stdout: lock could be placed 2023-12-12T12:14:21.930 INFO:teuthology.orchestra.run.smithi078.stdout: -lock could be placed 2023-12-12T12:14:21.931 INFO:teuthology.orchestra.run.smithi078.stdout: +get rdlck 2023-12-12T12:14:21.931 INFO:teuthology.orchestra.run.smithi078.stdout: lock could be placed 2023-12-12T12:14:21.931 INFO:teuthology.orchestra.run.smithi078.stdout: lock could be placed 2023-12-12T12:14:21.931 INFO:teuthology.orchestra.run.smithi078.stdout: lock could be placed 2023-12-12T12:14:21.932 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/478 2023-12-12T12:14:21.932 INFO:teuthology.orchestra.run.smithi078.stdout:Failures: generic/478 2023-12-12T12:14:21.932 INFO:teuthology.orchestra.run.smithi078.stdout:Failed 1 of 1 tests 2023-12-12T12:14:21.938 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:14:21.959 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-12T12:14:21.960 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-12-12T12:14:21.960 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-12-12T12:14:21.960 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/479) 2023-12-12T12:14:22.341 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:14:22.351 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:14:22.351 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:14:22.765 INFO:teuthology.orchestra.run.smithi078.stdout:generic/479 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:14:22.773 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/479 2023-12-12T12:14:22.773 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/479 2023-12-12T12:14:22.773 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:14:22.779 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:14:22.801 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:14:22.802 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/480) 2023-12-12T12:14:23.192 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:14:23.202 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:14:23.202 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:14:23.520 INFO:teuthology.orchestra.run.smithi078.stdout:generic/480 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:14:23.528 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/480 2023-12-12T12:14:23.529 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/480 2023-12-12T12:14:23.529 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:14:23.536 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:14:23.555 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:14:23.555 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/481) 2023-12-12T12:14:23.957 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:14:23.967 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:14:23.968 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:14:24.277 INFO:teuthology.orchestra.run.smithi078.stdout:generic/481 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:14:24.286 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/481 2023-12-12T12:14:24.286 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/481 2023-12-12T12:14:24.286 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:14:24.292 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:14:24.355 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:14:24.355 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/482) 2023-12-12T12:14:24.741 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:14:24.751 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:14:24.751 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:14:25.189 INFO:teuthology.orchestra.run.smithi078.stdout:generic/482 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:14:25.199 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/482 2023-12-12T12:14:25.199 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/482 2023-12-12T12:14:25.199 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:14:25.204 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:14:25.224 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:14:25.224 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/483) 2023-12-12T12:14:25.625 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:14:25.636 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:14:25.636 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:14:25.981 INFO:teuthology.orchestra.run.smithi078.stdout:generic/483 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:14:25.990 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/483 2023-12-12T12:14:25.991 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/483 2023-12-12T12:14:25.991 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:14:25.997 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:14:26.018 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:14:26.018 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/484) 2023-12-12T12:14:26.400 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:14:26.411 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:14:26.411 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:14:26.721 INFO:teuthology.orchestra.run.smithi078.stdout:generic/484 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:14:26.729 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/484 2023-12-12T12:14:26.729 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/484 2023-12-12T12:14:26.730 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:14:26.736 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:14:26.795 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:14:26.795 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/485) 2023-12-12T12:14:27.177 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:14:27.188 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:14:27.188 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:14:28.764 INFO:teuthology.orchestra.run.smithi078.stdout:generic/485 [not run] xfs_io finsert failed (old kernel/wrong fs?) 2023-12-12T12:14:28.772 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/485 2023-12-12T12:14:28.773 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/485 2023-12-12T12:14:28.773 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:14:28.779 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:14:28.799 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:14:28.799 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/486) 2023-12-12T12:14:29.524 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:14:29.535 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:14:29.535 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:14:29.892 INFO:teuthology.orchestra.run.smithi078.stdout:generic/486 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:14:29.901 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/486 2023-12-12T12:14:29.901 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/486 2023-12-12T12:14:29.901 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:14:29.907 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:14:29.928 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:14:29.929 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/487) 2023-12-12T12:14:30.288 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:14:30.299 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:14:30.299 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:14:30.623 INFO:teuthology.orchestra.run.smithi078.stdout:generic/487 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:14:30.631 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/487 2023-12-12T12:14:30.631 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/487 2023-12-12T12:14:30.632 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:14:30.638 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:14:30.658 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:14:30.659 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/488) 2023-12-12T12:14:31.036 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:14:31.047 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:14:31.047 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:14:31.340 INFO:teuthology.orchestra.run.smithi078.stdout:generic/488 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:14:31.348 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/488 2023-12-12T12:14:31.349 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/488 2023-12-12T12:14:31.349 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:14:31.357 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:14:31.375 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:14:31.375 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/489) 2023-12-12T12:14:31.760 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:14:31.771 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:14:31.771 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:14:32.130 INFO:teuthology.orchestra.run.smithi078.stdout:generic/489 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:14:32.138 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/489 2023-12-12T12:14:32.138 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/489 2023-12-12T12:14:32.138 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:14:32.144 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:14:32.164 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:14:32.165 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/490) 2023-12-12T12:14:32.550 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:14:32.560 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:14:32.560 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:14:33.905 INFO:teuthology.orchestra.run.smithi078.stdout:generic/490 1s 2023-12-12T12:14:33.919 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/490 2023-12-12T12:14:33.919 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:14:33.925 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:14:33.947 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:14:33.947 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/491) 2023-12-12T12:14:34.706 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:14:34.716 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:14:34.716 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:14:35.048 INFO:teuthology.orchestra.run.smithi078.stdout:generic/491 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:14:35.057 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/491 2023-12-12T12:14:35.057 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/491 2023-12-12T12:14:35.057 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:14:35.063 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:14:35.086 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:14:35.086 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/492) 2023-12-12T12:14:35.459 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:14:35.469 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:14:35.470 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:14:35.760 INFO:teuthology.orchestra.run.smithi078.stdout:generic/492 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:14:35.769 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/492 2023-12-12T12:14:35.769 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/492 2023-12-12T12:14:35.769 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:14:35.775 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:14:35.796 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:14:35.797 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/493) 2023-12-12T12:14:36.174 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:14:36.185 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:14:36.185 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:14:36.480 INFO:teuthology.orchestra.run.smithi078.stdout:generic/493 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:14:36.488 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/493 2023-12-12T12:14:36.488 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/493 2023-12-12T12:14:36.489 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:14:36.495 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:14:36.514 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:14:36.514 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/494) 2023-12-12T12:14:36.904 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:14:36.915 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:14:36.915 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:14:37.199 INFO:teuthology.orchestra.run.smithi078.stdout:generic/494 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:14:37.208 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/494 2023-12-12T12:14:37.208 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/494 2023-12-12T12:14:37.208 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:14:37.214 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:14:37.236 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:14:37.236 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/495) 2023-12-12T12:14:37.609 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:14:37.620 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:14:37.620 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:14:37.927 INFO:teuthology.orchestra.run.smithi078.stdout:generic/495 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:14:37.935 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/495 2023-12-12T12:14:37.935 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/495 2023-12-12T12:14:37.936 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:14:37.942 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:14:37.962 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:14:37.962 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/496) 2023-12-12T12:14:38.352 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:14:38.363 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:14:38.363 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:14:38.735 INFO:teuthology.orchestra.run.smithi078.stdout:generic/496 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:14:38.744 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/496 2023-12-12T12:14:38.744 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/496 2023-12-12T12:14:38.744 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:14:38.750 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:14:38.772 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:14:38.772 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/497) 2023-12-12T12:14:39.190 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:14:39.200 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:14:39.201 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:14:39.570 INFO:teuthology.orchestra.run.smithi078.stdout:generic/497 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:14:39.579 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/497 2023-12-12T12:14:39.579 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/497 2023-12-12T12:14:39.579 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:14:39.586 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:14:39.607 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:14:39.607 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/498) 2023-12-12T12:14:40.002 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:14:40.012 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:14:40.013 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:14:40.326 INFO:teuthology.orchestra.run.smithi078.stdout:generic/498 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:14:40.334 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/498 2023-12-12T12:14:40.334 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/498 2023-12-12T12:14:40.334 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:14:40.340 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:14:40.361 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:14:40.361 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/499) 2023-12-12T12:14:40.761 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:14:40.772 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:14:40.772 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:14:41.051 INFO:teuthology.orchestra.run.smithi078.stdout:generic/499 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:14:41.060 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/499 2023-12-12T12:14:41.060 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/499 2023-12-12T12:14:41.060 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:14:41.066 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:14:41.087 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:14:41.087 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/500) 2023-12-12T12:14:41.485 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:14:41.496 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:14:41.497 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:14:41.835 INFO:teuthology.orchestra.run.smithi078.stdout:generic/500 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:14:41.843 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/500 2023-12-12T12:14:41.843 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/500 2023-12-12T12:14:41.844 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:14:41.850 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:14:41.870 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:14:41.870 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/501) 2023-12-12T12:14:42.268 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:14:42.279 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:14:42.279 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:14:42.593 INFO:teuthology.orchestra.run.smithi078.stdout:generic/501 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:14:42.604 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/501 2023-12-12T12:14:42.604 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/501 2023-12-12T12:14:42.604 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:14:42.608 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:14:42.628 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:14:42.628 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/502) 2023-12-12T12:14:43.013 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:14:43.023 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:14:43.023 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:14:43.341 INFO:teuthology.orchestra.run.smithi078.stdout:generic/502 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:14:43.349 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/502 2023-12-12T12:14:43.349 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/502 2023-12-12T12:14:43.349 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:14:43.355 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:14:43.377 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:14:43.377 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/503) 2023-12-12T12:14:43.757 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:14:43.768 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:14:43.768 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:14:44.071 INFO:teuthology.orchestra.run.smithi078.stdout:generic/503 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:14:44.079 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/503 2023-12-12T12:14:44.080 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/503 2023-12-12T12:14:44.080 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:14:44.086 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:14:44.107 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:14:44.107 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/504) 2023-12-12T12:14:44.509 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:14:44.520 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:14:44.520 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:14:45.497 INFO:teuthology.orchestra.run.smithi078.stdout:generic/504 - output mismatch (see /tmp/tmp.GmWnCxuSqIxfstests-dev/results//generic/504.out.bad) 2023-12-12T12:14:45.503 INFO:teuthology.orchestra.run.smithi078.stdout: --- tests/generic/504.out 2023-12-12 10:13:40.432815657 +0000 2023-12-12T12:14:45.503 INFO:teuthology.orchestra.run.smithi078.stdout: +++ /tmp/tmp.GmWnCxuSqIxfstests-dev/results//generic/504.out.bad 2023-12-12 12:14:45.488750094 +0000 2023-12-12T12:14:45.503 INFO:teuthology.orchestra.run.smithi078.stdout: @@ -1,2 +1,3 @@ 2023-12-12T12:14:45.503 INFO:teuthology.orchestra.run.smithi078.stdout: QA output created by 504 2023-12-12T12:14:45.503 INFO:teuthology.orchestra.run.smithi078.stdout: +lock info not found 2023-12-12T12:14:45.503 INFO:teuthology.orchestra.run.smithi078.stdout: Silence is golden 2023-12-12T12:14:45.509 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/504 2023-12-12T12:14:45.509 INFO:teuthology.orchestra.run.smithi078.stdout:Failures: generic/504 2023-12-12T12:14:45.509 INFO:teuthology.orchestra.run.smithi078.stdout:Failed 1 of 1 tests 2023-12-12T12:14:45.516 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:14:45.568 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-12T12:14:45.569 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-12-12T12:14:45.569 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-12-12T12:14:45.569 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/505) 2023-12-12T12:14:46.008 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:14:46.019 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:14:46.019 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:14:46.309 INFO:teuthology.orchestra.run.smithi078.stdout:generic/505 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:14:46.317 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/505 2023-12-12T12:14:46.317 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/505 2023-12-12T12:14:46.317 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:14:46.324 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:14:46.343 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:14:46.344 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/506) 2023-12-12T12:14:46.716 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:14:46.727 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:14:46.728 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:14:47.038 INFO:teuthology.orchestra.run.smithi078.stdout:generic/506 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:14:47.047 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/506 2023-12-12T12:14:47.047 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/506 2023-12-12T12:14:47.047 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:14:47.054 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:14:47.073 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:14:47.074 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/507) 2023-12-12T12:14:47.456 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:14:47.467 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:14:47.467 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:14:47.821 INFO:teuthology.orchestra.run.smithi078.stdout:generic/507 [not run] file system doesn't support chattr +ASai 2023-12-12T12:14:47.829 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/507 2023-12-12T12:14:47.829 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/507 2023-12-12T12:14:47.829 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:14:47.836 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:14:47.857 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:14:47.858 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/508) 2023-12-12T12:14:48.228 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:14:48.239 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:14:48.239 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:14:48.532 INFO:teuthology.orchestra.run.smithi078.stdout:generic/508 [not run] lsattr not supported by test filesystem type: ceph-fuse 2023-12-12T12:14:48.542 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/508 2023-12-12T12:14:48.542 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/508 2023-12-12T12:14:48.542 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:14:48.546 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:14:48.566 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:14:48.566 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/509) 2023-12-12T12:14:48.931 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:14:48.942 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:14:48.942 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:14:49.264 INFO:teuthology.orchestra.run.smithi078.stdout:generic/509 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:14:49.273 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/509 2023-12-12T12:14:49.273 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/509 2023-12-12T12:14:49.273 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:14:49.279 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:14:49.299 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:14:49.299 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/510) 2023-12-12T12:14:49.696 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:14:49.707 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:14:49.707 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:14:50.023 INFO:teuthology.orchestra.run.smithi078.stdout:generic/510 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:14:50.031 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/510 2023-12-12T12:14:50.031 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/510 2023-12-12T12:14:50.031 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:14:50.038 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:14:50.059 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:14:50.059 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/511) 2023-12-12T12:14:50.448 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:14:50.458 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:14:50.458 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:14:50.739 INFO:teuthology.orchestra.run.smithi078.stdout:generic/511 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:14:50.748 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/511 2023-12-12T12:14:50.748 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/511 2023-12-12T12:14:50.748 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:14:50.754 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:14:50.774 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:14:50.775 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/512) 2023-12-12T12:14:51.161 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:14:51.172 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:14:51.173 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:14:51.484 INFO:teuthology.orchestra.run.smithi078.stdout:generic/512 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:14:51.493 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/512 2023-12-12T12:14:51.493 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/512 2023-12-12T12:14:51.493 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:14:51.499 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:14:51.519 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:14:51.519 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/513) 2023-12-12T12:14:51.908 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:14:51.919 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:14:51.919 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:14:52.198 INFO:teuthology.orchestra.run.smithi078.stdout:generic/513 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:14:52.207 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/513 2023-12-12T12:14:52.207 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/513 2023-12-12T12:14:52.207 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:14:52.213 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:14:52.234 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:14:52.234 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/514) 2023-12-12T12:14:52.612 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:14:52.623 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:14:52.623 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:14:52.930 INFO:teuthology.orchestra.run.smithi078.stdout:generic/514 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:14:52.938 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/514 2023-12-12T12:14:52.938 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/514 2023-12-12T12:14:52.939 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:14:52.945 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:14:52.964 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:14:52.964 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/515) 2023-12-12T12:14:53.352 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:14:53.363 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:14:53.363 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:14:53.671 INFO:teuthology.orchestra.run.smithi078.stdout:generic/515 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:14:53.680 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/515 2023-12-12T12:14:53.680 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/515 2023-12-12T12:14:53.680 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:14:53.687 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:14:53.707 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:14:53.707 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/516) 2023-12-12T12:14:54.100 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:14:54.111 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:14:54.111 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:14:54.512 INFO:teuthology.orchestra.run.smithi078.stdout:generic/516 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2023-12-12T12:14:54.521 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/516 2023-12-12T12:14:54.521 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/516 2023-12-12T12:14:54.521 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:14:54.527 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:14:54.560 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:14:54.560 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/517) 2023-12-12T12:14:55.272 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:14:55.283 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:14:55.284 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:14:55.584 INFO:teuthology.orchestra.run.smithi078.stdout:generic/517 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:14:55.593 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/517 2023-12-12T12:14:55.616 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/517 2023-12-12T12:14:55.616 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:14:55.617 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:14:55.621 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:14:55.622 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/518) 2023-12-12T12:14:55.997 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:14:56.008 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:14:56.008 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:14:56.282 INFO:teuthology.orchestra.run.smithi078.stdout:generic/518 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:14:56.291 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/518 2023-12-12T12:14:56.291 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/518 2023-12-12T12:14:56.291 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:14:56.298 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:14:56.318 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:14:56.318 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/519) 2023-12-12T12:14:56.706 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:14:56.716 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:14:56.716 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:14:56.995 INFO:teuthology.orchestra.run.smithi078.stdout:generic/519 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:14:57.003 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/519 2023-12-12T12:14:57.004 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/519 2023-12-12T12:14:57.004 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:14:57.010 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:14:57.033 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:14:57.033 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/520) 2023-12-12T12:14:57.417 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:14:57.428 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:14:57.428 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:14:57.738 INFO:teuthology.orchestra.run.smithi078.stdout:generic/520 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T12:14:57.746 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/520 2023-12-12T12:14:57.746 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/520 2023-12-12T12:14:57.747 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T12:14:57.753 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:14:57.775 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T12:14:57.775 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/521) 2023-12-12T12:14:58.161 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T12:14:58.172 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T12:14:58.172 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T12:17:02.894 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:17:02.899 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:17:32.974 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:17:32.978 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:18:03.029 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:18:03.034 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:18:33.126 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:18:33.131 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:19:03.241 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:19:03.245 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:19:33.506 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:19:33.510 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:20:04.416 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:20:04.421 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:20:34.470 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:20:34.475 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:21:04.583 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:21:04.588 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:21:34.991 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:21:34.995 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:22:05.067 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:22:05.072 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:22:35.409 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:22:35.413 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:23:05.474 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:23:05.479 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:23:35.574 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:23:35.579 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:24:05.704 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:24:05.708 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:24:35.845 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:24:35.849 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:25:05.905 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:25:05.909 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:25:36.019 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:25:36.024 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:26:06.091 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:26:06.096 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:26:36.181 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:26:36.185 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:27:06.270 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:27:06.274 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:27:36.354 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:27:36.360 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:28:06.447 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:28:06.451 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:28:36.785 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:28:36.789 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:29:08.114 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:29:08.118 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:29:38.179 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:29:38.183 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:30:08.340 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:30:08.344 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:30:38.854 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:30:38.859 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:31:08.950 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:31:08.954 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:31:39.063 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:31:39.067 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:32:09.218 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:32:09.222 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:32:39.389 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:32:39.393 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:33:09.446 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:33:09.450 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:33:39.550 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:33:39.554 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:34:09.638 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:34:09.643 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:34:39.743 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:34:39.747 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:35:09.848 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:35:09.853 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:35:40.011 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:35:40.015 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:36:10.116 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:36:10.120 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:36:40.878 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:36:40.883 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:37:11.038 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:37:11.042 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:37:41.180 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:37:41.184 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:38:11.642 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:38:11.647 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:38:41.697 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:38:41.701 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:39:11.806 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:39:11.811 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:39:41.921 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:39:41.925 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:39:41.963 INFO:tasks.ceph.osd.5.smithi187.stderr:2023-12-12T12:39:41.962+0000 7f363eb0f640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45635) UID: 0 2023-12-12T12:39:41.964 INFO:tasks.ceph.osd.6.smithi187.stderr:2023-12-12T12:39:41.962+0000 7fb917830640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45635) UID: 0 2023-12-12T12:39:41.964 INFO:tasks.ceph.osd.7.smithi187.stderr:2023-12-12T12:39:41.962+0000 7f9c745c6640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45635) UID: 0 2023-12-12T12:39:41.965 INFO:tasks.ceph.osd.4.smithi187.stderr:2023-12-12T12:39:41.962+0000 7fcf5f6ed640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45635) UID: 0 2023-12-12T12:42:38.439 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:42:38.444 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:43:08.583 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:43:08.588 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:43:38.688 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:43:38.692 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:44:08.784 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:44:08.788 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:44:38.879 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:44:38.883 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:45:08.985 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:45:08.990 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:45:39.115 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:45:39.119 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:46:09.175 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:46:09.179 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:46:39.476 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:46:39.480 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:47:09.530 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:47:09.534 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:47:39.629 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:47:39.633 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:47:39.683 INFO:tasks.ceph.osd.4.smithi187.stderr:2023-12-12T12:47:39.683+0000 7fcf5f6ed640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45683) UID: 0 2023-12-12T12:47:39.683 INFO:tasks.ceph.osd.5.smithi187.stderr:2023-12-12T12:47:39.683+0000 7f363eb0f640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45683) UID: 0 2023-12-12T12:47:39.683 INFO:tasks.ceph.osd.6.smithi187.stderr:2023-12-12T12:47:39.683+0000 7fb917830640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45683) UID: 0 2023-12-12T12:47:39.684 INFO:tasks.ceph.osd.7.smithi187.stderr:2023-12-12T12:47:39.683+0000 7f9c745c6640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45683) UID: 0 2023-12-12T12:50:30.193 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:50:30.198 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:51:00.257 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:51:00.261 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:51:30.368 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:51:30.372 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:52:00.679 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:52:00.684 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:52:30.878 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:52:30.883 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:53:00.948 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:53:00.952 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:53:31.285 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:53:31.289 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:54:01.400 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:54:01.404 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:54:31.453 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:54:31.458 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:55:01.580 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:55:01.584 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:55:31.638 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:55:31.642 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:56:01.878 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:56:01.881 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:56:32.648 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:56:32.652 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:57:02.711 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:57:02.715 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:57:32.816 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:57:32.820 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:58:02.920 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:58:02.925 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:58:33.087 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:58:33.091 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:59:03.202 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:59:03.207 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:59:33.261 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T12:59:33.265 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:00:03.624 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:00:03.629 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:00:33.728 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:00:33.732 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:01:03.799 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:01:03.803 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:01:33.922 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:01:33.926 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:02:04.042 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:02:04.047 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:02:34.130 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:02:34.134 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:03:04.227 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:03:04.231 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:03:34.450 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:03:34.454 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:04:05.381 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:04:05.386 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:04:35.441 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:04:35.445 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:04:35.475 INFO:tasks.ceph.osd.4.smithi187.stderr:2023-12-12T13:04:35.480+0000 7fcf5f6ed640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45791) UID: 0 2023-12-12T13:04:35.476 INFO:tasks.ceph.osd.5.smithi187.stderr:2023-12-12T13:04:35.480+0000 7f363eb0f640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45791) UID: 0 2023-12-12T13:04:35.476 INFO:tasks.ceph.osd.6.smithi187.stderr:2023-12-12T13:04:35.480+0000 7fb917830640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45791) UID: 0 2023-12-12T13:04:35.476 INFO:tasks.ceph.osd.7.smithi187.stderr:2023-12-12T13:04:35.480+0000 7f9c745c6640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45791) UID: 0 2023-12-12T13:07:50.158 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:07:50.162 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:07:50.236 INFO:tasks.ceph.osd.4.smithi187.stderr:2023-12-12T13:07:50.237+0000 7fcf5f6ed640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45806) UID: 0 2023-12-12T13:07:50.236 INFO:tasks.ceph.osd.5.smithi187.stderr:2023-12-12T13:07:50.237+0000 7f363eb0f640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45806) UID: 0 2023-12-12T13:07:50.237 INFO:tasks.ceph.osd.6.smithi187.stderr:2023-12-12T13:07:50.237+0000 7fb917830640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45806) UID: 0 2023-12-12T13:07:50.237 INFO:tasks.ceph.osd.7.smithi187.stderr:2023-12-12T13:07:50.237+0000 7f9c745c6640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45806) UID: 0 2023-12-12T13:10:24.808 INFO:teuthology.orchestra.run.smithi078.stdout:generic/521 3326s 2023-12-12T13:10:24.820 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/521 2023-12-12T13:10:24.820 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T13:10:24.830 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T13:10:24.880 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T13:10:24.881 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/522) 2023-12-12T13:10:25.600 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T13:10:25.610 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T13:10:25.611 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T13:10:51.355 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:10:51.359 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:11:21.484 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:11:21.490 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:11:51.622 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:11:51.627 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:12:21.717 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:12:21.721 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:12:51.819 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:12:51.824 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:13:21.925 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:13:21.931 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:13:52.041 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:13:52.046 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:14:22.192 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:14:22.199 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:14:52.259 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:14:52.264 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:15:22.363 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:15:22.368 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:15:52.470 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:15:52.475 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:16:22.635 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:16:22.639 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:16:52.767 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:16:52.772 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:17:22.875 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:17:22.880 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:17:53.013 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:17:53.020 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:18:23.079 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:18:23.083 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:18:23.145 INFO:tasks.ceph.osd.4.smithi187.stderr:2023-12-12T13:18:23.143+0000 7fcf5f6ed640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45877) UID: 0 2023-12-12T13:18:23.145 INFO:tasks.ceph.osd.5.smithi187.stderr:2023-12-12T13:18:23.143+0000 7f363eb0f640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45877) UID: 0 2023-12-12T13:18:23.146 INFO:tasks.ceph.osd.6.smithi187.stderr:2023-12-12T13:18:23.143+0000 7fb917830640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45877) UID: 0 2023-12-12T13:18:23.146 INFO:tasks.ceph.osd.7.smithi187.stderr:2023-12-12T13:18:23.143+0000 7f9c745c6640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45877) UID: 0 2023-12-12T13:21:37.385 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:21:37.390 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:22:07.672 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:22:07.676 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:22:37.838 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:22:37.846 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:23:07.953 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:23:07.961 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:23:38.026 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:23:38.030 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:24:08.141 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:24:08.145 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:24:38.272 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:24:38.276 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:25:08.517 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:25:08.522 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:25:38.836 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:25:38.840 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:26:08.901 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:26:08.906 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:26:39.040 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:26:39.045 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:27:09.289 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:27:09.292 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:27:39.396 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:27:39.400 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:28:09.457 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:28:09.461 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:28:39.579 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:28:39.582 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:29:09.692 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:29:09.697 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:29:39.840 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:29:39.845 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:30:09.964 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:30:09.968 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:30:10.032 INFO:tasks.ceph.mds.a.smithi078.stderr:2023-12-12T13:30:10.035+0000 7fd9e625e640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 410425) UID: 0 2023-12-12T13:30:10.032 INFO:tasks.ceph.mds.c.smithi078.stderr:2023-12-12T13:30:10.035+0000 7f93f9020640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 410425) UID: 0 2023-12-12T13:32:48.944 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:32:48.948 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:33:19.132 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:33:19.136 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:33:49.238 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:33:49.243 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:34:19.411 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:34:19.415 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:34:49.803 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:34:49.807 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:35:19.908 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:35:19.912 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:35:50.390 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:35:50.394 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:36:20.885 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:36:20.889 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:36:50.998 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:36:51.002 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:37:21.087 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:37:21.106 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:37:51.166 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:37:51.170 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:38:21.339 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:38:21.343 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:38:51.461 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:38:51.466 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:39:21.565 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:39:21.569 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:39:51.687 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:39:51.691 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:39:51.721 INFO:tasks.ceph.osd.4.smithi187.stderr:2023-12-12T13:39:51.728+0000 7fcf5f6ed640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46009) UID: 0 2023-12-12T13:39:51.721 INFO:tasks.ceph.osd.5.smithi187.stderr:2023-12-12T13:39:51.728+0000 7f363eb0f640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46009) UID: 0 2023-12-12T13:39:51.722 INFO:tasks.ceph.osd.6.smithi187.stderr:2023-12-12T13:39:51.728+0000 7fb917830640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46009) UID: 0 2023-12-12T13:39:51.722 INFO:tasks.ceph.osd.7.smithi187.stderr:2023-12-12T13:39:51.728+0000 7f9c745c6640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46009) UID: 0 2023-12-12T13:42:43.038 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:42:43.043 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:43:13.194 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:43:13.200 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:43:43.274 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:43:43.279 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:43:43.416 INFO:tasks.ceph.osd.4.smithi187.stderr:2023-12-12T13:43:43.416+0000 7fcf5f6ed640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46029) UID: 0 2023-12-12T13:43:43.417 INFO:tasks.ceph.osd.5.smithi187.stderr:2023-12-12T13:43:43.416+0000 7f363eb0f640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46029) UID: 0 2023-12-12T13:43:43.417 INFO:tasks.ceph.osd.6.smithi187.stderr:2023-12-12T13:43:43.416+0000 7fb917830640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46029) UID: 0 2023-12-12T13:43:43.417 INFO:tasks.ceph.osd.7.smithi187.stderr:2023-12-12T13:43:43.416+0000 7f9c745c6640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46029) UID: 0 2023-12-12T13:46:43.171 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:46:43.175 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:47:13.308 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:47:13.312 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:47:43.362 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:47:43.366 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:48:13.430 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:48:13.434 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:48:43.537 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:48:43.542 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:49:13.652 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:49:13.657 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:49:28.799 INFO:teuthology.orchestra.run.smithi078.stdout:generic/522 2342s 2023-12-12T13:49:28.862 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/522 2023-12-12T13:49:28.862 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T13:49:28.870 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T13:49:28.892 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T13:49:28.892 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/523) 2023-12-12T13:49:29.689 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T13:49:29.699 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T13:49:29.700 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T13:49:30.039 INFO:teuthology.orchestra.run.smithi078.stdout:generic/523 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T13:49:30.047 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/523 2023-12-12T13:49:30.047 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/523 2023-12-12T13:49:30.048 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T13:49:30.054 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T13:49:30.073 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T13:49:30.074 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/524) 2023-12-12T13:49:30.447 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T13:49:30.457 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T13:49:30.457 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T13:49:30.736 INFO:teuthology.orchestra.run.smithi078.stdout:generic/524 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T13:49:30.744 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/524 2023-12-12T13:49:30.744 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/524 2023-12-12T13:49:30.744 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T13:49:30.750 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T13:49:30.770 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T13:49:30.770 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/525) 2023-12-12T13:49:31.156 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T13:49:31.167 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T13:49:31.167 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T13:49:31.434 INFO:teuthology.orchestra.run.smithi078.stdout:generic/525 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T13:49:31.439 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/525 2023-12-12T13:49:31.439 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/525 2023-12-12T13:49:31.439 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T13:49:31.446 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T13:49:31.466 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T13:49:31.466 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/526) 2023-12-12T13:49:31.853 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T13:49:31.862 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T13:49:31.862 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T13:49:32.194 INFO:teuthology.orchestra.run.smithi078.stdout:generic/526 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T13:49:32.202 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/526 2023-12-12T13:49:32.202 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/526 2023-12-12T13:49:32.202 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T13:49:32.208 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T13:49:32.228 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T13:49:32.228 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/527) 2023-12-12T13:49:32.611 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T13:49:32.621 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T13:49:32.621 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T13:49:32.917 INFO:teuthology.orchestra.run.smithi078.stdout:generic/527 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T13:49:32.925 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/527 2023-12-12T13:49:32.925 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/527 2023-12-12T13:49:32.925 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T13:49:32.931 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T13:49:32.950 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T13:49:32.951 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/528) 2023-12-12T13:49:33.324 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T13:49:33.334 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T13:49:33.334 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T13:49:33.676 INFO:teuthology.orchestra.run.smithi078.stdout:generic/528 [not run] inode creation time not supported by this filesystem 2023-12-12T13:49:33.684 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/528 2023-12-12T13:49:33.684 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/528 2023-12-12T13:49:33.684 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T13:49:33.690 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T13:49:33.709 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T13:49:33.709 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/529) 2023-12-12T13:49:34.063 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T13:49:34.074 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T13:49:34.074 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T13:49:34.388 INFO:teuthology.orchestra.run.smithi078.stdout:generic/529 [not run] ACLs not supported by this filesystem type: ceph-fuse 2023-12-12T13:49:34.396 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/529 2023-12-12T13:49:34.397 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/529 2023-12-12T13:49:34.397 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T13:49:34.403 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T13:49:34.422 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T13:49:34.422 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/530) 2023-12-12T13:49:34.787 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T13:49:34.797 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T13:49:34.797 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T13:49:35.076 INFO:teuthology.orchestra.run.smithi078.stdout:generic/530 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T13:49:35.085 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/530 2023-12-12T13:49:35.085 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/530 2023-12-12T13:49:35.086 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T13:49:35.091 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T13:49:35.111 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T13:49:35.111 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/531) 2023-12-12T13:49:35.484 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T13:49:35.495 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T13:49:35.495 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T13:49:35.776 INFO:teuthology.orchestra.run.smithi078.stdout:generic/531 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T13:49:35.784 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/531 2023-12-12T13:49:35.785 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/531 2023-12-12T13:49:35.785 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T13:49:35.791 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T13:49:35.810 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T13:49:35.810 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/532) 2023-12-12T13:49:36.187 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T13:49:36.197 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T13:49:36.197 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T13:49:36.572 INFO:teuthology.orchestra.run.smithi078.stdout:generic/532 0s 2023-12-12T13:49:36.586 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/532 2023-12-12T13:49:36.586 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T13:49:36.592 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T13:49:36.666 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T13:49:36.666 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/533) 2023-12-12T13:49:37.039 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T13:49:37.049 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T13:49:37.049 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T13:49:37.742 INFO:teuthology.orchestra.run.smithi078.stdout:generic/533 0s 2023-12-12T13:49:37.751 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/533 2023-12-12T13:49:37.751 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T13:49:37.757 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T13:49:37.775 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T13:49:37.775 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/534) 2023-12-12T13:49:38.154 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T13:49:38.161 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T13:49:38.161 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T13:49:38.471 INFO:teuthology.orchestra.run.smithi078.stdout:generic/534 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T13:49:38.479 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/534 2023-12-12T13:49:38.479 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/534 2023-12-12T13:49:38.479 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T13:49:38.485 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T13:49:38.504 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T13:49:38.505 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/535) 2023-12-12T13:49:38.887 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T13:49:38.898 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T13:49:38.898 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T13:49:39.223 INFO:teuthology.orchestra.run.smithi078.stdout:generic/535 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T13:49:39.233 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/535 2023-12-12T13:49:39.233 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/535 2023-12-12T13:49:39.233 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T13:49:39.238 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T13:49:39.258 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T13:49:39.258 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/536) 2023-12-12T13:49:39.626 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T13:49:39.637 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T13:49:39.637 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T13:49:39.929 INFO:teuthology.orchestra.run.smithi078.stdout:generic/536 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T13:49:39.937 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/536 2023-12-12T13:49:39.937 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/536 2023-12-12T13:49:39.937 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T13:49:39.943 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T13:49:39.963 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T13:49:39.963 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/537) 2023-12-12T13:49:40.331 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T13:49:40.341 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T13:49:40.341 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T13:49:40.616 INFO:teuthology.orchestra.run.smithi078.stdout:generic/537 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T13:49:40.625 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/537 2023-12-12T13:49:40.625 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/537 2023-12-12T13:49:40.625 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T13:49:40.634 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T13:49:40.651 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T13:49:40.651 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/538) 2023-12-12T13:49:41.018 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T13:49:41.026 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T13:49:41.026 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T13:49:43.759 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:49:43.763 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:50:14.234 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:50:14.242 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:50:44.311 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:50:44.316 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:51:14.424 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:51:14.429 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:51:44.829 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:51:44.834 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:52:14.936 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:52:14.942 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:52:45.048 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:52:45.052 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:53:15.203 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:53:15.208 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:53:45.552 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:53:45.557 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:54:15.667 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:54:15.671 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:54:45.770 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:54:45.774 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:55:15.951 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:55:15.955 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:55:46.089 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:55:46.094 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:56:16.144 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:56:16.148 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:56:46.577 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:56:46.582 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:57:16.650 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:57:16.654 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:57:46.749 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:57:46.753 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:58:16.832 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:58:16.836 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T13:58:16.862 INFO:tasks.ceph.osd.0.smithi078.stderr:2023-12-12T13:58:16.852+0000 7f7267fb3640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 418541) UID: 0 2023-12-12T13:58:16.862 INFO:tasks.ceph.osd.2.smithi078.stderr:2023-12-12T13:58:16.852+0000 7efffc42e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 418541) UID: 0 2023-12-12T13:58:16.862 INFO:tasks.ceph.osd.1.smithi078.stderr:2023-12-12T13:58:16.852+0000 7fda08c74640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 418541) UID: 0 2023-12-12T13:58:16.863 INFO:tasks.ceph.osd.3.smithi078.stderr:2023-12-12T13:58:16.852+0000 7f238c6c1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 418541) UID: 0 2023-12-12T14:01:22.873 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:01:22.878 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:01:52.997 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:01:53.002 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:02:23.085 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:02:23.091 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:02:53.432 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:02:53.438 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:03:23.607 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:03:23.616 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:03:53.735 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:03:53.739 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:04:23.840 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:04:23.845 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:04:53.946 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:04:53.951 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:05:24.068 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:05:24.072 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:05:54.134 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:05:54.141 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:06:24.269 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:06:24.273 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:06:54.728 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:06:54.733 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:07:24.804 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:07:24.809 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:07:54.951 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:07:54.956 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:08:25.334 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:08:25.340 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:08:55.641 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:08:55.646 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:09:25.707 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:09:25.712 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:09:55.815 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:09:55.819 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:10:25.977 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:10:25.982 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:10:56.031 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:10:56.036 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:11:26.161 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:11:26.165 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:11:56.258 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:11:56.263 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:12:26.323 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:12:26.327 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:12:57.441 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:12:57.447 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:13:27.518 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:13:27.523 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:13:57.663 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:13:57.668 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:14:27.900 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:14:27.906 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:14:58.065 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:14:58.070 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:15:28.178 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:15:28.183 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:15:58.328 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:15:58.333 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:16:28.412 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:16:28.417 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:16:58.552 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:16:58.557 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:17:28.656 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:17:28.663 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:17:58.793 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:17:58.798 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:18:28.932 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:18:28.937 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:18:59.211 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:18:59.218 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:19:29.266 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:19:29.271 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:19:59.345 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:19:59.350 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:20:29.917 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:20:29.922 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:21:00.013 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:21:00.017 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:21:30.117 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:21:30.122 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:22:00.497 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:22:00.501 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:22:30.610 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:22:30.614 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:23:00.868 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:23:00.872 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:23:31.008 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:23:31.012 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:24:01.123 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:24:01.128 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:24:31.247 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:24:31.251 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:25:01.353 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:25:01.357 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:25:31.426 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:25:31.430 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:26:01.541 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:26:01.545 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:26:31.831 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:26:31.836 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:26:31.931 INFO:tasks.ceph.osd.1.smithi078.stderr:2023-12-12T14:26:31.923+0000 7fda08c74640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 422540) UID: 0 2023-12-12T14:26:31.932 INFO:tasks.ceph.osd.0.smithi078.stderr:2023-12-12T14:26:31.923+0000 7f7267fb3640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 422540) UID: 0 2023-12-12T14:26:31.932 INFO:tasks.ceph.osd.2.smithi078.stderr:2023-12-12T14:26:31.923+0000 7efffc42e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 422540) UID: 0 2023-12-12T14:26:31.932 INFO:tasks.ceph.osd.3.smithi078.stderr:2023-12-12T14:26:31.923+0000 7f238c6c1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 422540) UID: 0 2023-12-12T14:29:37.420 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:29:37.425 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:30:07.558 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:30:07.562 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:30:37.684 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:30:37.689 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:31:08.082 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:31:08.087 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:31:38.220 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:31:38.224 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:32:08.333 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:32:08.337 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:32:08.366 INFO:tasks.ceph.osd.0.smithi078.stderr:2023-12-12T14:32:08.361+0000 7f7267fb3640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 423305) UID: 0 2023-12-12T14:32:08.366 INFO:tasks.ceph.osd.2.smithi078.stderr:2023-12-12T14:32:08.361+0000 7efffc42e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 423305) UID: 0 2023-12-12T14:32:08.367 INFO:tasks.ceph.osd.3.smithi078.stderr:2023-12-12T14:32:08.361+0000 7f238c6c1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 423305) UID: 0 2023-12-12T14:32:08.367 INFO:tasks.ceph.osd.1.smithi078.stderr:2023-12-12T14:32:08.361+0000 7fda08c74640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 423305) UID: 0 2023-12-12T14:35:12.006 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:35:12.011 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:35:14.350 INFO:teuthology.orchestra.run.smithi078.stdout:generic/538 2733s 2023-12-12T14:35:14.405 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/538 2023-12-12T14:35:14.405 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T14:35:14.411 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:35:14.514 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T14:35:14.514 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/539) 2023-12-12T14:35:15.500 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T14:35:15.511 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T14:35:15.511 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:35:18.051 INFO:teuthology.orchestra.run.smithi078.stdout:generic/539 3s 2023-12-12T14:35:18.064 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/539 2023-12-12T14:35:18.064 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T14:35:18.070 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:35:18.091 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T14:35:18.092 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/540) 2023-12-12T14:35:18.757 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T14:35:18.767 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T14:35:18.767 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:35:19.055 INFO:teuthology.orchestra.run.smithi078.stdout:generic/540 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T14:35:19.063 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/540 2023-12-12T14:35:19.063 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/540 2023-12-12T14:35:19.063 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T14:35:19.070 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:35:19.090 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T14:35:19.090 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/541) 2023-12-12T14:35:19.450 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T14:35:19.461 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T14:35:19.461 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:35:19.760 INFO:teuthology.orchestra.run.smithi078.stdout:generic/541 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T14:35:19.768 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/541 2023-12-12T14:35:19.768 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/541 2023-12-12T14:35:19.768 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T14:35:19.775 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:35:19.794 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T14:35:19.795 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/542) 2023-12-12T14:35:20.166 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T14:35:20.176 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T14:35:20.177 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:35:20.482 INFO:teuthology.orchestra.run.smithi078.stdout:generic/542 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T14:35:20.490 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/542 2023-12-12T14:35:20.490 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/542 2023-12-12T14:35:20.490 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T14:35:20.496 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:35:20.516 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T14:35:20.516 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/543) 2023-12-12T14:35:20.889 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T14:35:20.899 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T14:35:20.899 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:35:21.212 INFO:teuthology.orchestra.run.smithi078.stdout:generic/543 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T14:35:21.220 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/543 2023-12-12T14:35:21.220 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/543 2023-12-12T14:35:21.220 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T14:35:21.226 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:35:21.245 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T14:35:21.246 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/544) 2023-12-12T14:35:21.610 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T14:35:21.620 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T14:35:21.620 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:35:21.885 INFO:teuthology.orchestra.run.smithi078.stdout:generic/544 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T14:35:21.893 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/544 2023-12-12T14:35:21.894 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/544 2023-12-12T14:35:21.894 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T14:35:21.900 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:35:21.920 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T14:35:21.920 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/545) 2023-12-12T14:35:22.290 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T14:35:22.300 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T14:35:22.300 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:35:22.664 INFO:teuthology.orchestra.run.smithi078.stdout:generic/545 [not run] file system doesn't support chattr +i 2023-12-12T14:35:22.673 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/545 2023-12-12T14:35:22.673 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/545 2023-12-12T14:35:22.673 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T14:35:22.679 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:35:22.699 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T14:35:22.700 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/546) 2023-12-12T14:35:23.077 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T14:35:23.088 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T14:35:23.088 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:35:23.502 INFO:teuthology.orchestra.run.smithi078.stdout:generic/546 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T14:35:23.511 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/546 2023-12-12T14:35:23.511 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/546 2023-12-12T14:35:23.511 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T14:35:23.517 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:35:23.537 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T14:35:23.537 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/547) 2023-12-12T14:35:23.902 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T14:35:23.912 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T14:35:23.912 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:35:24.258 INFO:teuthology.orchestra.run.smithi078.stdout:generic/547 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T14:35:24.266 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/547 2023-12-12T14:35:24.266 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/547 2023-12-12T14:35:24.266 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T14:35:24.272 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:35:24.292 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T14:35:24.292 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/548) 2023-12-12T14:35:24.658 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T14:35:24.668 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T14:35:24.668 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:35:25.042 INFO:teuthology.orchestra.run.smithi078.stdout:generic/548 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T14:35:25.050 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/548 2023-12-12T14:35:25.050 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/548 2023-12-12T14:35:25.050 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T14:35:25.056 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:35:25.108 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T14:35:25.108 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/549) 2023-12-12T14:35:25.470 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T14:35:25.481 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T14:35:25.481 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:35:25.855 INFO:teuthology.orchestra.run.smithi078.stdout:generic/549 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T14:35:25.863 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/549 2023-12-12T14:35:25.863 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/549 2023-12-12T14:35:25.863 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T14:35:25.870 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:35:25.944 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T14:35:25.944 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/550) 2023-12-12T14:35:26.302 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T14:35:26.312 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T14:35:26.312 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:35:26.675 INFO:teuthology.orchestra.run.smithi078.stdout:generic/550 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T14:35:26.684 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/550 2023-12-12T14:35:26.684 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/550 2023-12-12T14:35:26.684 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T14:35:26.690 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:35:26.709 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T14:35:26.710 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/551) 2023-12-12T14:35:27.098 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T14:35:27.109 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T14:35:27.109 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:35:27.382 INFO:teuthology.orchestra.run.smithi078.stdout:generic/551 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T14:35:27.390 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/551 2023-12-12T14:35:27.390 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/551 2023-12-12T14:35:27.391 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T14:35:27.397 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:35:27.416 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T14:35:27.416 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/552) 2023-12-12T14:35:27.781 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T14:35:27.792 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T14:35:27.792 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:35:28.130 INFO:teuthology.orchestra.run.smithi078.stdout:generic/552 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T14:35:28.138 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/552 2023-12-12T14:35:28.138 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/552 2023-12-12T14:35:28.138 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T14:35:28.145 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:35:28.165 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T14:35:28.165 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/553) 2023-12-12T14:35:28.545 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T14:35:28.556 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T14:35:28.556 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:35:28.965 INFO:teuthology.orchestra.run.smithi078.stdout:generic/553 [not run] xfs_io chattr +i failed (old kernel/wrong fs/bad args?) 2023-12-12T14:35:28.973 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/553 2023-12-12T14:35:28.973 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/553 2023-12-12T14:35:28.974 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T14:35:28.980 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:35:29.000 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T14:35:29.001 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/554) 2023-12-12T14:35:29.677 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T14:35:29.687 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T14:35:29.688 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:35:29.971 INFO:teuthology.orchestra.run.smithi078.stdout:generic/554 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T14:35:29.979 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/554 2023-12-12T14:35:29.979 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/554 2023-12-12T14:35:29.979 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T14:35:29.985 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:35:30.006 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T14:35:30.006 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/555) 2023-12-12T14:35:30.385 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T14:35:30.395 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T14:35:30.396 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:35:30.768 INFO:teuthology.orchestra.run.smithi078.stdout:generic/555 [not run] xfs_io chattr +ia failed (old kernel/wrong fs/bad args?) 2023-12-12T14:35:30.776 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/555 2023-12-12T14:35:30.777 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/555 2023-12-12T14:35:30.777 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T14:35:30.782 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:35:30.816 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T14:35:30.816 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/556) 2023-12-12T14:35:31.478 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T14:35:31.488 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T14:35:31.489 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:35:31.767 INFO:teuthology.orchestra.run.smithi078.stdout:generic/556 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T14:35:31.775 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/556 2023-12-12T14:35:31.775 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/556 2023-12-12T14:35:31.775 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T14:35:31.781 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:35:31.800 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T14:35:31.801 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/557) 2023-12-12T14:35:32.166 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T14:35:32.177 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T14:35:32.177 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:35:32.502 INFO:teuthology.orchestra.run.smithi078.stdout:generic/557 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T14:35:32.510 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/557 2023-12-12T14:35:32.510 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/557 2023-12-12T14:35:32.510 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T14:35:32.517 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:35:32.583 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T14:35:32.584 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/558) 2023-12-12T14:35:32.974 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T14:35:32.984 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T14:35:32.985 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:35:33.331 INFO:teuthology.orchestra.run.smithi078.stdout:generic/558 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T14:35:33.339 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/558 2023-12-12T14:35:33.340 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/558 2023-12-12T14:35:33.340 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T14:35:33.346 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:35:33.366 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T14:35:33.366 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/559) 2023-12-12T14:35:33.737 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T14:35:33.748 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T14:35:33.748 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:35:34.035 INFO:teuthology.orchestra.run.smithi078.stdout:generic/559 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T14:35:34.043 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/559 2023-12-12T14:35:34.043 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/559 2023-12-12T14:35:34.043 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T14:35:34.049 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:35:34.068 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T14:35:34.068 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/560) 2023-12-12T14:35:34.429 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T14:35:34.440 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T14:35:34.440 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:35:34.735 INFO:teuthology.orchestra.run.smithi078.stdout:generic/560 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T14:35:34.743 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/560 2023-12-12T14:35:34.743 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/560 2023-12-12T14:35:34.743 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T14:35:34.749 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:35:34.768 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T14:35:34.768 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/561) 2023-12-12T14:35:35.146 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T14:35:35.157 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T14:35:35.157 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:35:35.432 INFO:teuthology.orchestra.run.smithi078.stdout:generic/561 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T14:35:35.441 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/561 2023-12-12T14:35:35.441 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/561 2023-12-12T14:35:35.441 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T14:35:35.447 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:35:35.467 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T14:35:35.467 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/562) 2023-12-12T14:35:35.834 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T14:35:35.845 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T14:35:35.845 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:35:36.131 INFO:teuthology.orchestra.run.smithi078.stdout:generic/562 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T14:35:36.139 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/562 2023-12-12T14:35:36.139 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/562 2023-12-12T14:35:36.139 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T14:35:36.145 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:35:36.165 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T14:35:36.166 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/563) 2023-12-12T14:35:36.530 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T14:35:36.541 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T14:35:36.541 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:35:36.882 INFO:teuthology.orchestra.run.smithi078.stdout:generic/563 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T14:35:36.890 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/563 2023-12-12T14:35:36.890 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/563 2023-12-12T14:35:36.891 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T14:35:36.897 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:35:36.961 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T14:35:36.961 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/564) 2023-12-12T14:35:37.325 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T14:35:37.335 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T14:35:37.335 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:35:38.220 INFO:teuthology.orchestra.run.smithi078.stdout:generic/564 1s 2023-12-12T14:35:38.232 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/564 2023-12-12T14:35:38.232 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T14:35:38.239 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:35:38.418 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T14:35:38.419 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/565) 2023-12-12T14:35:38.955 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T14:35:38.967 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T14:35:38.967 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:35:39.250 INFO:teuthology.orchestra.run.smithi078.stdout:generic/565 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T14:35:39.258 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/565 2023-12-12T14:35:39.258 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/565 2023-12-12T14:35:39.258 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T14:35:39.265 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:35:39.285 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T14:35:39.285 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/566) 2023-12-12T14:35:39.654 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T14:35:39.664 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T14:35:39.664 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:35:39.957 INFO:teuthology.orchestra.run.smithi078.stdout:generic/566 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T14:35:39.965 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/566 2023-12-12T14:35:39.965 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/566 2023-12-12T14:35:39.965 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T14:35:39.971 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:35:39.990 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T14:35:39.991 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/567) 2023-12-12T14:35:40.374 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T14:35:40.384 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T14:35:40.384 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:35:40.677 INFO:teuthology.orchestra.run.smithi078.stdout:generic/567 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T14:35:40.685 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/567 2023-12-12T14:35:40.685 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/567 2023-12-12T14:35:40.685 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T14:35:40.692 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:35:40.712 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T14:35:40.712 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/568) 2023-12-12T14:35:41.077 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T14:35:41.088 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T14:35:41.088 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:35:41.555 INFO:teuthology.orchestra.run.smithi078.stdout:generic/568 0s 2023-12-12T14:35:41.685 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/568 2023-12-12T14:35:41.685 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T14:35:41.745 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:35:41.804 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T14:35:41.804 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/569) 2023-12-12T14:35:42.086 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:35:42.090 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:35:42.175 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T14:35:42.185 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T14:35:42.185 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:35:42.523 INFO:teuthology.orchestra.run.smithi078.stdout:generic/569 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T14:35:42.531 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/569 2023-12-12T14:35:42.531 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/569 2023-12-12T14:35:42.531 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T14:35:42.537 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:35:42.559 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T14:35:42.559 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/570) 2023-12-12T14:35:42.962 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T14:35:42.972 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T14:35:42.972 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:35:43.242 INFO:teuthology.orchestra.run.smithi078.stdout:generic/570 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T14:35:43.250 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/570 2023-12-12T14:35:43.250 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/570 2023-12-12T14:35:43.250 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T14:35:43.256 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:35:43.277 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T14:35:43.277 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/571) 2023-12-12T14:35:43.641 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T14:35:43.652 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T14:35:43.652 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:35:50.083 INFO:teuthology.orchestra.run.smithi078.stdout:generic/571 7s 2023-12-12T14:35:50.097 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/571 2023-12-12T14:35:50.097 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T14:35:50.104 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:35:50.125 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T14:35:50.125 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/572) 2023-12-12T14:35:50.805 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T14:35:50.816 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T14:35:50.816 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:35:51.102 INFO:teuthology.orchestra.run.smithi078.stdout:generic/572 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T14:35:51.111 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/572 2023-12-12T14:35:51.111 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/572 2023-12-12T14:35:51.111 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T14:35:51.117 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:35:51.137 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T14:35:51.137 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/573) 2023-12-12T14:35:51.489 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T14:35:51.499 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T14:35:51.500 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:35:51.771 INFO:teuthology.orchestra.run.smithi078.stdout:generic/573 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T14:35:51.779 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/573 2023-12-12T14:35:51.779 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/573 2023-12-12T14:35:51.780 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T14:35:51.786 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:35:51.805 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T14:35:51.805 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/574) 2023-12-12T14:35:52.162 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T14:35:52.173 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T14:35:52.173 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:35:52.461 INFO:teuthology.orchestra.run.smithi078.stdout:generic/574 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T14:35:52.469 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/574 2023-12-12T14:35:52.470 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/574 2023-12-12T14:35:52.470 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T14:35:52.476 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:35:52.496 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T14:35:52.496 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/575) 2023-12-12T14:35:52.882 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T14:35:52.892 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T14:35:52.892 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:35:53.174 INFO:teuthology.orchestra.run.smithi078.stdout:generic/575 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T14:35:53.182 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/575 2023-12-12T14:35:53.182 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/575 2023-12-12T14:35:53.182 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T14:35:53.188 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:35:53.208 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T14:35:53.208 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/576) 2023-12-12T14:35:53.585 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T14:35:53.595 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T14:35:53.595 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:35:53.945 INFO:teuthology.orchestra.run.smithi078.stdout:generic/576 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T14:35:53.954 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/576 2023-12-12T14:35:53.954 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/576 2023-12-12T14:35:53.954 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T14:35:53.960 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:35:53.980 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T14:35:53.980 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/577) 2023-12-12T14:35:54.349 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T14:35:54.360 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T14:35:54.360 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:35:54.641 INFO:teuthology.orchestra.run.smithi078.stdout:generic/577 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T14:35:54.649 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/577 2023-12-12T14:35:54.649 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/577 2023-12-12T14:35:54.649 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T14:35:54.655 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:35:54.675 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T14:35:54.675 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/578) 2023-12-12T14:35:55.049 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T14:35:55.060 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T14:35:55.060 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:35:55.384 INFO:teuthology.orchestra.run.smithi078.stdout:generic/578 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-12-12T14:35:55.392 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/578 2023-12-12T14:35:55.392 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/578 2023-12-12T14:35:55.392 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T14:35:55.398 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:35:55.418 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T14:35:55.419 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/579) 2023-12-12T14:35:55.786 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T14:35:55.796 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T14:35:55.796 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:35:56.101 INFO:teuthology.orchestra.run.smithi078.stdout:generic/579 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T14:35:56.109 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/579 2023-12-12T14:35:56.109 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/579 2023-12-12T14:35:56.109 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T14:35:56.115 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:35:56.134 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T14:35:56.135 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/580) 2023-12-12T14:35:56.486 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T14:35:56.497 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T14:35:56.497 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:35:56.844 INFO:teuthology.orchestra.run.smithi078.stdout:generic/580 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T14:35:56.852 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/580 2023-12-12T14:35:56.852 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/580 2023-12-12T14:35:56.852 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T14:35:56.858 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:35:56.878 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T14:35:56.879 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/581) 2023-12-12T14:35:57.254 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T14:35:57.264 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T14:35:57.264 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:35:58.179 INFO:teuthology.orchestra.run.smithi078.stdout:generic/581 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T14:35:58.187 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/581 2023-12-12T14:35:58.187 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/581 2023-12-12T14:35:58.187 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T14:35:58.193 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:35:58.264 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T14:35:58.264 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/582) 2023-12-12T14:35:58.621 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T14:35:58.631 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T14:35:58.632 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:35:58.990 INFO:teuthology.orchestra.run.smithi078.stdout:generic/582 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T14:35:58.998 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/582 2023-12-12T14:35:58.998 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/582 2023-12-12T14:35:58.998 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T14:35:59.004 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:35:59.023 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T14:35:59.024 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/583) 2023-12-12T14:35:59.377 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T14:35:59.388 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T14:35:59.388 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:35:59.727 INFO:teuthology.orchestra.run.smithi078.stdout:generic/583 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T14:35:59.735 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/583 2023-12-12T14:35:59.735 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/583 2023-12-12T14:35:59.735 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T14:35:59.741 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:35:59.761 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T14:35:59.761 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/584) 2023-12-12T14:36:00.127 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T14:36:00.137 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T14:36:00.137 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:36:00.509 INFO:teuthology.orchestra.run.smithi078.stdout:generic/584 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T14:36:00.517 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/584 2023-12-12T14:36:00.517 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/584 2023-12-12T14:36:00.517 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T14:36:00.523 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:36:00.588 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T14:36:00.588 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/585) 2023-12-12T14:36:00.941 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T14:36:00.951 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T14:36:00.951 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:36:01.231 INFO:teuthology.orchestra.run.smithi078.stdout:generic/585 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T14:36:01.240 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/585 2023-12-12T14:36:01.240 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/585 2023-12-12T14:36:01.240 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T14:36:01.246 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:36:01.266 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T14:36:01.266 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/586) 2023-12-12T14:36:01.662 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T14:36:01.672 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T14:36:01.673 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:36:12.196 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:36:12.199 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:36:22.953 INFO:teuthology.orchestra.run.smithi078.stdout:generic/586 21s 2023-12-12T14:36:22.966 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/586 2023-12-12T14:36:22.966 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T14:36:22.972 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:36:23.014 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T14:36:23.015 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/587) 2023-12-12T14:36:23.649 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T14:36:23.660 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T14:36:23.660 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:36:24.164 INFO:teuthology.orchestra.run.smithi078.stdout:generic/587 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2023-12-12T14:36:24.173 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/587 2023-12-12T14:36:24.173 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/587 2023-12-12T14:36:24.173 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T14:36:24.179 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:36:24.200 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T14:36:24.201 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/588) 2023-12-12T14:36:24.577 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T14:36:24.587 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T14:36:24.588 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:36:24.880 INFO:teuthology.orchestra.run.smithi078.stdout:generic/588 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T14:36:24.888 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/588 2023-12-12T14:36:24.888 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/588 2023-12-12T14:36:24.888 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T14:36:24.894 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:36:24.914 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T14:36:24.914 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/589) 2023-12-12T14:36:25.277 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T14:36:25.287 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T14:36:25.288 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:36:25.590 INFO:teuthology.orchestra.run.smithi078.stdout:generic/589 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T14:36:25.599 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/589 2023-12-12T14:36:25.599 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/589 2023-12-12T14:36:25.599 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T14:36:25.605 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:36:25.627 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T14:36:25.627 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/590) 2023-12-12T14:36:25.989 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T14:36:25.999 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T14:36:25.999 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:36:26.301 INFO:teuthology.orchestra.run.smithi078.stdout:generic/590 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T14:36:26.309 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/590 2023-12-12T14:36:26.310 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/590 2023-12-12T14:36:26.310 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T14:36:26.315 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:36:26.335 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T14:36:26.335 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/591) 2023-12-12T14:36:26.714 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T14:36:26.724 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T14:36:26.724 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:36:27.233 INFO:teuthology.orchestra.run.smithi078.stdout:generic/591 1s 2023-12-12T14:36:27.246 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/591 2023-12-12T14:36:27.246 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T14:36:27.252 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:36:27.273 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T14:36:27.273 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/592) 2023-12-12T14:36:27.950 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T14:36:27.960 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T14:36:27.960 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:36:28.316 INFO:teuthology.orchestra.run.smithi078.stdout:generic/592 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T14:36:28.324 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/592 2023-12-12T14:36:28.324 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/592 2023-12-12T14:36:28.324 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T14:36:28.330 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:36:28.351 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T14:36:28.351 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/593) 2023-12-12T14:36:28.766 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T14:36:28.777 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T14:36:28.777 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:36:29.137 INFO:teuthology.orchestra.run.smithi078.stdout:generic/593 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T14:36:29.145 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/593 2023-12-12T14:36:29.145 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/593 2023-12-12T14:36:29.145 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T14:36:29.151 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:36:29.171 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T14:36:29.172 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/594) 2023-12-12T14:36:29.557 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T14:36:29.568 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T14:36:29.568 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:36:29.837 INFO:teuthology.orchestra.run.smithi078.stdout:generic/594 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T14:36:29.846 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/594 2023-12-12T14:36:29.846 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/594 2023-12-12T14:36:29.846 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T14:36:29.852 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:36:29.872 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T14:36:29.873 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/595) 2023-12-12T14:36:30.261 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T14:36:30.272 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T14:36:30.272 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:36:30.635 INFO:teuthology.orchestra.run.smithi078.stdout:generic/595 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T14:36:30.643 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/595 2023-12-12T14:36:30.643 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/595 2023-12-12T14:36:30.643 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T14:36:30.649 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:36:30.669 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T14:36:30.669 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/596) 2023-12-12T14:36:31.029 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T14:36:31.039 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T14:36:31.039 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:36:31.331 INFO:teuthology.orchestra.run.smithi078.stdout:generic/596 [not run] accton utility required, skipped this test 2023-12-12T14:36:31.339 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/596 2023-12-12T14:36:31.340 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/596 2023-12-12T14:36:31.340 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T14:36:31.346 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:36:31.428 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T14:36:31.428 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/597) 2023-12-12T14:36:31.801 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T14:36:31.811 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T14:36:31.811 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:36:32.937 INFO:teuthology.orchestra.run.smithi078.stdout:generic/597 - output mismatch (see /tmp/tmp.GmWnCxuSqIxfstests-dev/results//generic/597.out.bad) 2023-12-12T14:36:32.940 INFO:teuthology.orchestra.run.smithi078.stdout: --- tests/generic/597.out 2023-12-12 10:13:40.444815286 +0000 2023-12-12T14:36:32.940 INFO:teuthology.orchestra.run.smithi078.stdout: +++ /tmp/tmp.GmWnCxuSqIxfstests-dev/results//generic/597.out.bad 2023-12-12 14:36:32.925477812 +0000 2023-12-12T14:36:32.940 INFO:teuthology.orchestra.run.smithi078.stdout: @@ -4,11 +4,11 @@ 2023-12-12T14:36:32.940 INFO:teuthology.orchestra.run.smithi078.stdout: fs.protected_symlinks = 0 2023-12-12T14:36:32.940 INFO:teuthology.orchestra.run.smithi078.stdout: successfully followed symlink 2023-12-12T14:36:32.940 INFO:teuthology.orchestra.run.smithi078.stdout: fs.protected_symlinks = 1 2023-12-12T14:36:32.940 INFO:teuthology.orchestra.run.smithi078.stdout: -Permission denied 2023-12-12T14:36:32.940 INFO:teuthology.orchestra.run.smithi078.stdout: +successfully followed symlink 2023-12-12T14:36:32.940 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:36:32.940 INFO:teuthology.orchestra.run.smithi078.stdout: == Test hardlink create protection when 2023-12-12T14:36:32.940 INFO:teuthology.orchestra.run.smithi078.stdout: == process != target owner and process cannot read target 2023-12-12T14:36:32.940 INFO:teuthology.orchestra.run.smithi078.stdout: fs.protected_hardlinks = 0 2023-12-12T14:36:32.941 INFO:teuthology.orchestra.run.smithi078.stdout: -successfully created hardlink 2023-12-12T14:36:32.941 INFO:teuthology.orchestra.run.smithi078.stdout: +Permission denied 2023-12-12T14:36:32.941 INFO:teuthology.orchestra.run.smithi078.stdout: fs.protected_hardlinks = 1 2023-12-12T14:36:32.941 INFO:teuthology.orchestra.run.smithi078.stdout: -ln: failed to create hard link 'TEST_DIR/597/sticky_dir/hardlink' => 'TEST_DIR/597/target': Operation not permitted 2023-12-12T14:36:32.941 INFO:teuthology.orchestra.run.smithi078.stdout: +Permission denied 2023-12-12T14:36:32.945 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/597 2023-12-12T14:36:32.945 INFO:teuthology.orchestra.run.smithi078.stdout:Failures: generic/597 2023-12-12T14:36:32.945 INFO:teuthology.orchestra.run.smithi078.stdout:Failed 1 of 1 tests 2023-12-12T14:36:32.951 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:36:32.974 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-12T14:36:32.974 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-12-12T14:36:32.974 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-12-12T14:36:32.975 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/598) 2023-12-12T14:36:33.649 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T14:36:33.660 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T14:36:33.660 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:36:34.690 INFO:teuthology.orchestra.run.smithi078.stdout:generic/598 - output mismatch (see /tmp/tmp.GmWnCxuSqIxfstests-dev/results//generic/598.out.bad) 2023-12-12T14:36:34.695 INFO:teuthology.orchestra.run.smithi078.stdout: --- tests/generic/598.out 2023-12-12 10:13:40.444815286 +0000 2023-12-12T14:36:34.695 INFO:teuthology.orchestra.run.smithi078.stdout: +++ /tmp/tmp.GmWnCxuSqIxfstests-dev/results//generic/598.out.bad 2023-12-12 14:36:34.681449969 +0000 2023-12-12T14:36:34.696 INFO:teuthology.orchestra.run.smithi078.stdout: @@ -5,13 +5,10 @@ 2023-12-12T14:36:34.696 INFO:teuthology.orchestra.run.smithi078.stdout: = only group writable dir 2023-12-12T14:36:34.696 INFO:teuthology.orchestra.run.smithi078.stdout: fs.protected_regular = 1 2023-12-12T14:36:34.696 INFO:teuthology.orchestra.run.smithi078.stdout: = group & world writable dir 2023-12-12T14:36:34.696 INFO:teuthology.orchestra.run.smithi078.stdout: -Permission denied 2023-12-12T14:36:34.696 INFO:teuthology.orchestra.run.smithi078.stdout: = only group writable dir 2023-12-12T14:36:34.696 INFO:teuthology.orchestra.run.smithi078.stdout: fs.protected_regular = 2 2023-12-12T14:36:34.696 INFO:teuthology.orchestra.run.smithi078.stdout: = group & world writable dir 2023-12-12T14:36:34.696 INFO:teuthology.orchestra.run.smithi078.stdout: -Permission denied 2023-12-12T14:36:34.696 INFO:teuthology.orchestra.run.smithi078.stdout: = only group writable dir 2023-12-12T14:36:34.696 INFO:teuthology.orchestra.run.smithi078.stdout: -Permission denied 2023-12-12T14:36:34.696 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:36:34.696 INFO:teuthology.orchestra.run.smithi078.stdout: == Test fifo open when owned by another and fifo owner != dir owner 2023-12-12T14:36:34.697 INFO:teuthology.orchestra.run.smithi078.stdout: fs.protected_fifos = 0 2023-12-12T14:36:34.697 INFO:teuthology.orchestra.run.smithi078.stdout: @@ -19,10 +16,7 @@ 2023-12-12T14:36:34.697 INFO:teuthology.orchestra.run.smithi078.stdout: = only group writable dir 2023-12-12T14:36:34.697 INFO:teuthology.orchestra.run.smithi078.stdout: fs.protected_fifos = 1 2023-12-12T14:36:34.697 INFO:teuthology.orchestra.run.smithi078.stdout: = group & world writable dir 2023-12-12T14:36:34.697 INFO:teuthology.orchestra.run.smithi078.stdout: -Permission denied 2023-12-12T14:36:34.697 INFO:teuthology.orchestra.run.smithi078.stdout: = only group writable dir 2023-12-12T14:36:34.697 INFO:teuthology.orchestra.run.smithi078.stdout: fs.protected_fifos = 2 2023-12-12T14:36:34.697 INFO:teuthology.orchestra.run.smithi078.stdout: = group & world writable dir 2023-12-12T14:36:34.697 INFO:teuthology.orchestra.run.smithi078.stdout: -Permission denied 2023-12-12T14:36:34.697 INFO:teuthology.orchestra.run.smithi078.stdout: = only group writable dir 2023-12-12T14:36:34.697 INFO:teuthology.orchestra.run.smithi078.stdout: -Permission denied 2023-12-12T14:36:34.701 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/598 2023-12-12T14:36:34.701 INFO:teuthology.orchestra.run.smithi078.stdout:Failures: generic/598 2023-12-12T14:36:34.701 INFO:teuthology.orchestra.run.smithi078.stdout:Failed 1 of 1 tests 2023-12-12T14:36:34.707 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:36:34.727 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-12T14:36:34.727 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-12-12T14:36:34.727 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-12-12T14:36:34.728 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/599) 2023-12-12T14:36:35.398 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T14:36:35.408 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T14:36:35.408 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:36:35.669 INFO:teuthology.orchestra.run.smithi078.stdout:generic/599 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T14:36:35.677 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/599 2023-12-12T14:36:35.678 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/599 2023-12-12T14:36:35.678 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T14:36:35.684 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:36:35.704 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T14:36:35.704 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/600) 2023-12-12T14:36:36.098 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T14:36:36.109 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T14:36:36.109 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:36:36.387 INFO:teuthology.orchestra.run.smithi078.stdout:generic/600 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T14:36:36.396 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/600 2023-12-12T14:36:36.396 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/600 2023-12-12T14:36:36.396 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T14:36:36.402 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:36:36.422 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T14:36:36.422 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/601) 2023-12-12T14:36:36.801 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T14:36:36.811 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T14:36:36.812 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:36:37.084 INFO:teuthology.orchestra.run.smithi078.stdout:generic/601 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T14:36:37.092 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/601 2023-12-12T14:36:37.092 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/601 2023-12-12T14:36:37.092 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T14:36:37.098 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:36:37.119 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T14:36:37.119 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/602) 2023-12-12T14:36:37.474 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T14:36:37.485 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T14:36:37.485 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:36:37.850 INFO:teuthology.orchestra.run.smithi078.stdout:generic/602 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T14:36:37.859 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/602 2023-12-12T14:36:37.859 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/602 2023-12-12T14:36:37.859 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T14:36:37.865 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:36:37.884 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T14:36:37.885 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/603) 2023-12-12T14:36:38.289 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T14:36:38.299 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T14:36:38.300 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:36:38.572 INFO:teuthology.orchestra.run.smithi078.stdout:generic/603 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T14:36:38.580 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/603 2023-12-12T14:36:38.581 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/603 2023-12-12T14:36:38.581 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T14:36:38.587 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:36:38.607 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T14:36:38.607 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/604) 2023-12-12T14:36:38.977 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T14:36:38.987 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T14:36:38.987 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:36:39.263 INFO:teuthology.orchestra.run.smithi078.stdout:generic/604 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T14:36:39.271 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/604 2023-12-12T14:36:39.271 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/604 2023-12-12T14:36:39.271 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T14:36:39.278 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:36:39.298 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T14:36:39.298 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/605) 2023-12-12T14:36:39.669 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T14:36:39.680 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T14:36:39.680 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:36:39.945 INFO:teuthology.orchestra.run.smithi078.stdout:generic/605 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T14:36:39.953 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/605 2023-12-12T14:36:39.953 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/605 2023-12-12T14:36:39.953 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T14:36:39.959 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:36:39.980 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T14:36:39.980 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/606) 2023-12-12T14:36:40.367 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T14:36:40.378 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T14:36:40.378 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:36:40.661 INFO:teuthology.orchestra.run.smithi078.stdout:generic/606 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T14:36:40.669 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/606 2023-12-12T14:36:40.670 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/606 2023-12-12T14:36:40.670 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T14:36:40.676 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:36:40.695 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T14:36:40.696 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/607) 2023-12-12T14:36:41.069 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T14:36:41.080 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T14:36:41.080 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:36:41.354 INFO:teuthology.orchestra.run.smithi078.stdout:generic/607 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T14:36:41.363 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/607 2023-12-12T14:36:41.363 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/607 2023-12-12T14:36:41.363 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T14:36:41.370 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:36:41.390 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T14:36:41.390 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/608) 2023-12-12T14:36:41.786 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T14:36:41.796 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T14:36:41.796 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:36:42.068 INFO:teuthology.orchestra.run.smithi078.stdout:generic/608 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T14:36:42.077 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/608 2023-12-12T14:36:42.077 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/608 2023-12-12T14:36:42.077 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T14:36:42.083 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:36:42.103 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T14:36:42.103 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/609) 2023-12-12T14:36:42.334 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:36:42.337 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:36:42.501 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T14:36:42.512 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T14:36:42.512 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:36:43.108 INFO:teuthology.orchestra.run.smithi078.stdout:generic/609 1s 2023-12-12T14:36:43.121 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/609 2023-12-12T14:36:43.121 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T14:36:43.127 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:36:43.339 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T14:36:43.339 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/610) 2023-12-12T14:36:43.837 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T14:36:43.847 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T14:36:43.847 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:36:44.173 INFO:teuthology.orchestra.run.smithi078.stdout:generic/610 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T14:36:44.181 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/610 2023-12-12T14:36:44.181 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/610 2023-12-12T14:36:44.181 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T14:36:44.188 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:36:44.208 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T14:36:44.208 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/611) 2023-12-12T14:36:44.562 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T14:36:44.573 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T14:36:44.573 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:36:44.875 INFO:teuthology.orchestra.run.smithi078.stdout:generic/611 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T14:36:44.883 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/611 2023-12-12T14:36:44.883 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/611 2023-12-12T14:36:44.883 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T14:36:44.890 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:36:44.980 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T14:36:44.980 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/612) 2023-12-12T14:36:45.354 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T14:36:45.365 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T14:36:45.365 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:36:45.735 INFO:teuthology.orchestra.run.smithi078.stdout:generic/612 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-12-12T14:36:45.744 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/612 2023-12-12T14:36:45.744 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/612 2023-12-12T14:36:45.744 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T14:36:45.750 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:36:45.960 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T14:36:45.960 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/613) 2023-12-12T14:36:46.469 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T14:36:46.480 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T14:36:46.480 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:36:46.828 INFO:teuthology.orchestra.run.smithi078.stdout:generic/613 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T14:36:46.836 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/613 2023-12-12T14:36:46.836 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/613 2023-12-12T14:36:46.836 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T14:36:46.842 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:36:46.862 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T14:36:46.862 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/614) 2023-12-12T14:36:47.218 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T14:36:47.228 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T14:36:47.228 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:36:47.514 INFO:teuthology.orchestra.run.smithi078.stdout:generic/614 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T14:36:47.522 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/614 2023-12-12T14:36:47.522 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/614 2023-12-12T14:36:47.522 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T14:36:47.528 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:36:47.548 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T14:36:47.549 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/615) 2023-12-12T14:36:47.922 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T14:36:47.933 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T14:36:47.933 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:36:48.209 INFO:teuthology.orchestra.run.smithi078.stdout:generic/615 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T14:36:48.217 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/615 2023-12-12T14:36:48.217 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/615 2023-12-12T14:36:48.218 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T14:36:48.224 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:36:48.244 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T14:36:48.244 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/616) 2023-12-12T14:36:48.637 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T14:36:48.648 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T14:36:48.648 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:37:12.405 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:37:12.409 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:37:42.518 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:37:42.522 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:38:12.836 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:38:12.841 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:38:42.943 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:38:42.947 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:39:13.025 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:39:13.030 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:39:43.147 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:39:43.152 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:40:13.260 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:40:13.264 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:40:27.672 INFO:teuthology.orchestra.run.smithi078.stdout:generic/616 219s 2023-12-12T14:40:27.685 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/616 2023-12-12T14:40:27.685 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T14:40:27.691 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:40:27.713 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T14:40:27.713 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/617) 2023-12-12T14:40:28.089 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T14:40:28.099 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T14:40:28.099 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:40:43.393 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:40:43.398 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:41:13.537 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:41:13.541 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:41:30.568 INFO:teuthology.orchestra.run.smithi078.stdout:generic/617 62s 2023-12-12T14:41:30.580 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/617 2023-12-12T14:41:30.581 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T14:41:30.587 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:41:30.664 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T14:41:30.664 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/618) 2023-12-12T14:41:31.289 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T14:41:31.299 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T14:41:31.299 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:41:31.572 INFO:teuthology.orchestra.run.smithi078.stdout:generic/618 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T14:41:31.580 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/618 2023-12-12T14:41:31.581 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/618 2023-12-12T14:41:31.581 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T14:41:31.587 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:41:31.606 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T14:41:31.607 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/619) 2023-12-12T14:41:31.965 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T14:41:31.976 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T14:41:31.976 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:41:32.386 INFO:teuthology.orchestra.run.smithi078.stdout:generic/619 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T14:41:32.394 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/619 2023-12-12T14:41:32.394 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/619 2023-12-12T14:41:32.395 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T14:41:32.401 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:41:32.420 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T14:41:32.420 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/620) 2023-12-12T14:41:32.794 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T14:41:32.804 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T14:41:32.804 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:41:33.145 INFO:teuthology.orchestra.run.smithi078.stdout:generic/620 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T14:41:33.153 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/620 2023-12-12T14:41:33.153 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/620 2023-12-12T14:41:33.153 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T14:41:33.160 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:41:33.179 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T14:41:33.180 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/621) 2023-12-12T14:41:33.545 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T14:41:33.555 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T14:41:33.556 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:41:33.895 INFO:teuthology.orchestra.run.smithi078.stdout:generic/621 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T14:41:33.903 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/621 2023-12-12T14:41:33.903 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/621 2023-12-12T14:41:33.903 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T14:41:33.910 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:41:33.929 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T14:41:33.929 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/622) 2023-12-12T14:41:34.318 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T14:41:34.328 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T14:41:34.328 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:41:34.610 INFO:teuthology.orchestra.run.smithi078.stdout:generic/622 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T14:41:34.618 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/622 2023-12-12T14:41:34.618 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/622 2023-12-12T14:41:34.618 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T14:41:34.624 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:41:34.644 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T14:41:34.644 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/623) 2023-12-12T14:41:35.005 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T14:41:35.015 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T14:41:35.015 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:41:35.294 INFO:teuthology.orchestra.run.smithi078.stdout:generic/623 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T14:41:35.302 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/623 2023-12-12T14:41:35.302 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/623 2023-12-12T14:41:35.302 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T14:41:35.308 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:41:35.328 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T14:41:35.328 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/624) 2023-12-12T14:41:35.688 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T14:41:35.699 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T14:41:35.699 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:41:35.994 INFO:teuthology.orchestra.run.smithi078.stdout:generic/624 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T14:41:36.002 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/624 2023-12-12T14:41:36.002 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/624 2023-12-12T14:41:36.002 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T14:41:36.008 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:41:36.028 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T14:41:36.028 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/625) 2023-12-12T14:41:36.397 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T14:41:36.407 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T14:41:36.408 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:41:36.707 INFO:teuthology.orchestra.run.smithi078.stdout:generic/625 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T14:41:36.715 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/625 2023-12-12T14:41:36.715 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/625 2023-12-12T14:41:36.716 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T14:41:36.722 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:41:36.791 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T14:41:36.792 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/626) 2023-12-12T14:41:37.170 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T14:41:37.180 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T14:41:37.180 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:41:37.460 INFO:teuthology.orchestra.run.smithi078.stdout:generic/626 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T14:41:37.468 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/626 2023-12-12T14:41:37.468 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/626 2023-12-12T14:41:37.468 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T14:41:37.474 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:41:37.495 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T14:41:37.495 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/627) 2023-12-12T14:41:37.869 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T14:41:37.879 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T14:41:37.879 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:41:38.167 INFO:teuthology.orchestra.run.smithi078.stdout:generic/627 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T14:41:38.175 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/627 2023-12-12T14:41:38.175 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/627 2023-12-12T14:41:38.175 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T14:41:38.182 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:41:38.201 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T14:41:38.201 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/628) 2023-12-12T14:41:38.549 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T14:41:38.560 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T14:41:38.560 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:41:38.867 INFO:teuthology.orchestra.run.smithi078.stdout:generic/628 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T14:41:38.875 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/628 2023-12-12T14:41:38.875 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/628 2023-12-12T14:41:38.875 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T14:41:38.882 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:41:38.967 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T14:41:38.967 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/629) 2023-12-12T14:41:39.344 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T14:41:39.355 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T14:41:39.355 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:41:39.664 INFO:teuthology.orchestra.run.smithi078.stdout:generic/629 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T14:41:39.672 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/629 2023-12-12T14:41:39.672 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/629 2023-12-12T14:41:39.672 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T14:41:39.678 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:41:39.739 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T14:41:39.740 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/630) 2023-12-12T14:41:40.097 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T14:41:40.108 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T14:41:40.108 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:41:40.405 INFO:teuthology.orchestra.run.smithi078.stdout:generic/630 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T14:41:40.413 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/630 2023-12-12T14:41:40.413 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/630 2023-12-12T14:41:40.413 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T14:41:40.419 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:41:40.440 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T14:41:40.440 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/631) 2023-12-12T14:41:40.817 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T14:41:40.828 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T14:41:40.828 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:41:41.114 INFO:teuthology.orchestra.run.smithi078.stdout:generic/631 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T14:41:41.122 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/631 2023-12-12T14:41:41.122 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/631 2023-12-12T14:41:41.122 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T14:41:41.129 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:41:41.187 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T14:41:41.187 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/632) 2023-12-12T14:41:41.565 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T14:41:41.576 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T14:41:41.576 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:41:43.649 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:41:43.654 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:41:43.682 INFO:tasks.ceph.osd.0.smithi078.stderr:2023-12-12T14:41:43.676+0000 7f7267fb3640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 463745) UID: 0 2023-12-12T14:41:43.683 INFO:tasks.ceph.osd.1.smithi078.stderr:2023-12-12T14:41:43.676+0000 7fda08c74640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 463745) UID: 0 2023-12-12T14:41:43.683 INFO:tasks.ceph.osd.2.smithi078.stderr:2023-12-12T14:41:43.676+0000 7efffc42e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 463745) UID: 0 2023-12-12T14:41:43.683 INFO:tasks.ceph.osd.3.smithi078.stderr:2023-12-12T14:41:43.676+0000 7f238c6c1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 463745) UID: 0 2023-12-12T14:41:47.839 INFO:teuthology.orchestra.run.smithi078.stdout:generic/632 6s 2023-12-12T14:41:47.852 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/632 2023-12-12T14:41:47.852 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T14:41:47.858 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:41:47.912 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T14:41:47.912 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/633) 2023-12-12T14:41:48.324 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T14:41:48.335 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T14:41:48.335 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:41:49.040 INFO:teuthology.orchestra.run.smithi078.stdout:generic/633 [failed, exit status 1]- output mismatch (see /tmp/tmp.GmWnCxuSqIxfstests-dev/results//generic/633.out.bad) 2023-12-12T14:41:49.088 INFO:teuthology.orchestra.run.smithi078.stdout: --- tests/generic/633.out 2023-12-12 10:13:40.452815038 +0000 2023-12-12T14:41:49.088 INFO:teuthology.orchestra.run.smithi078.stdout: +++ /tmp/tmp.GmWnCxuSqIxfstests-dev/results//generic/633.out.bad 2023-12-12 14:41:48.980448508 +0000 2023-12-12T14:41:49.088 INFO:teuthology.orchestra.run.smithi078.stdout: @@ -1,2 +1,5 @@ 2023-12-12T14:41:49.088 INFO:teuthology.orchestra.run.smithi078.stdout: QA output created by 633 2023-12-12T14:41:49.088 INFO:teuthology.orchestra.run.smithi078.stdout: Silence is golden 2023-12-12T14:41:49.088 INFO:teuthology.orchestra.run.smithi078.stdout: +vfstest.c: 1164: protected_symlinks - Success - failure: openat 2023-12-12T14:41:49.088 INFO:teuthology.orchestra.run.smithi078.stdout: +vfstest.c: 1171: protected_symlinks - Success - failure: wait_for_pid 2023-12-12T14:41:49.088 INFO:teuthology.orchestra.run.smithi078.stdout: +vfstest.c: 2418: run_test - Success - failure: following protected symlinks on regular mounts 2023-12-12T14:41:49.120 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/633 2023-12-12T14:41:49.122 INFO:teuthology.orchestra.run.smithi078.stdout:Failures: generic/633 2023-12-12T14:41:49.122 INFO:teuthology.orchestra.run.smithi078.stdout:Failed 1 of 1 tests 2023-12-12T14:41:49.163 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:41:49.244 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-12T14:41:49.245 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-12-12T14:41:49.245 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-12-12T14:41:49.245 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/634) 2023-12-12T14:41:49.690 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T14:41:49.700 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T14:41:49.701 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:41:49.993 INFO:teuthology.orchestra.run.smithi078.stdout:generic/634 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T14:41:50.001 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/634 2023-12-12T14:41:50.001 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/634 2023-12-12T14:41:50.001 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T14:41:50.008 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:41:50.031 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T14:41:50.031 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/635) 2023-12-12T14:41:50.411 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T14:41:50.422 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T14:41:50.422 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:41:50.693 INFO:teuthology.orchestra.run.smithi078.stdout:generic/635 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T14:41:50.702 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/635 2023-12-12T14:41:50.702 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/635 2023-12-12T14:41:50.702 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T14:41:50.708 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:41:50.728 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T14:41:50.728 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/636) 2023-12-12T14:41:51.117 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T14:41:51.129 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T14:41:51.129 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:41:51.420 INFO:teuthology.orchestra.run.smithi078.stdout:generic/636 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T14:41:51.429 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/636 2023-12-12T14:41:51.429 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/636 2023-12-12T14:41:51.429 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T14:41:51.435 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:41:51.456 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T14:41:51.457 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/637) 2023-12-12T14:41:51.841 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T14:41:51.851 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T14:41:51.851 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:41:53.373 INFO:teuthology.orchestra.run.smithi078.stdout:generic/637 2s 2023-12-12T14:41:53.386 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/637 2023-12-12T14:41:53.387 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T14:41:53.393 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:41:53.417 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T14:41:53.417 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/638) 2023-12-12T14:41:54.149 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T14:41:54.159 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T14:41:54.159 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:41:54.530 INFO:teuthology.orchestra.run.smithi078.stdout:generic/638 0s 2023-12-12T14:41:54.543 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/638 2023-12-12T14:41:54.543 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T14:41:54.550 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:41:54.571 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T14:41:54.571 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/639) 2023-12-12T14:41:54.969 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T14:41:54.980 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T14:41:54.980 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:41:59.330 INFO:teuthology.orchestra.run.smithi078.stdout:generic/639 5s 2023-12-12T14:41:59.343 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/639 2023-12-12T14:41:59.343 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T14:41:59.350 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:41:59.368 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T14:41:59.369 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/640) 2023-12-12T14:41:59.750 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T14:41:59.760 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T14:41:59.760 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:42:00.094 INFO:teuthology.orchestra.run.smithi078.stdout:generic/640 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T14:42:00.103 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/640 2023-12-12T14:42:00.103 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/640 2023-12-12T14:42:00.103 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T14:42:00.109 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:42:00.129 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T14:42:00.129 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/641) 2023-12-12T14:42:00.509 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T14:42:00.519 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T14:42:00.519 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:42:00.813 INFO:teuthology.orchestra.run.smithi078.stdout:generic/641 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T14:42:00.821 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/641 2023-12-12T14:42:00.821 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/641 2023-12-12T14:42:00.821 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T14:42:00.828 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:42:00.848 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T14:42:00.848 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/642) 2023-12-12T14:42:01.237 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T14:42:01.248 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T14:42:01.248 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:42:01.561 INFO:teuthology.orchestra.run.smithi078.stdout:generic/642 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T14:42:01.569 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/642 2023-12-12T14:42:01.570 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/642 2023-12-12T14:42:01.570 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T14:42:01.576 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:42:01.595 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T14:42:01.595 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/643) 2023-12-12T14:42:01.985 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T14:42:01.996 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T14:42:01.996 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:42:02.274 INFO:teuthology.orchestra.run.smithi078.stdout:generic/643 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T14:42:02.282 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/643 2023-12-12T14:42:02.282 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/643 2023-12-12T14:42:02.283 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T14:42:02.288 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:42:02.308 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T14:42:02.308 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/644) 2023-12-12T14:42:02.693 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T14:42:02.704 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T14:42:02.704 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:42:02.991 INFO:teuthology.orchestra.run.smithi078.stdout:generic/644 [not run] vfstest not support by ceph-fuse 2023-12-12T14:42:02.999 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/644 2023-12-12T14:42:02.999 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/644 2023-12-12T14:42:02.999 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T14:42:03.006 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:42:03.026 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T14:42:03.026 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/645) 2023-12-12T14:42:03.433 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T14:42:03.444 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T14:42:03.444 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:42:03.782 INFO:teuthology.orchestra.run.smithi078.stdout:generic/645 [not run] vfstest not support by ceph-fuse 2023-12-12T14:42:03.790 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/645 2023-12-12T14:42:03.790 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/645 2023-12-12T14:42:03.790 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T14:42:03.796 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:42:03.816 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T14:42:03.816 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/646) 2023-12-12T14:42:04.215 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T14:42:04.226 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T14:42:04.226 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:42:04.501 INFO:teuthology.orchestra.run.smithi078.stdout:generic/646 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T14:42:04.511 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/646 2023-12-12T14:42:04.511 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/646 2023-12-12T14:42:04.511 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T14:42:04.518 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:42:04.538 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T14:42:04.539 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/647) 2023-12-12T14:42:04.910 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T14:42:04.921 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T14:42:04.921 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:42:05.466 INFO:teuthology.orchestra.run.smithi078.stdout:generic/647 1s 2023-12-12T14:42:05.479 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/647 2023-12-12T14:42:05.479 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T14:42:05.485 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:42:05.705 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T14:42:05.705 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/648) 2023-12-12T14:42:06.226 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T14:42:06.236 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T14:42:06.237 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:42:06.566 INFO:teuthology.orchestra.run.smithi078.stdout:generic/648 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T14:42:06.574 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/648 2023-12-12T14:42:06.574 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/648 2023-12-12T14:42:06.575 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T14:42:06.581 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:42:06.651 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T14:42:06.652 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/649) 2023-12-12T14:42:07.013 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T14:42:07.024 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T14:42:07.024 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:42:07.451 INFO:teuthology.orchestra.run.smithi078.stdout:generic/649 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-12-12T14:42:07.459 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/649 2023-12-12T14:42:07.459 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/649 2023-12-12T14:42:07.460 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T14:42:07.466 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:42:07.515 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T14:42:07.515 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/650) 2023-12-12T14:42:08.202 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T14:42:08.212 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T14:42:08.212 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T14:50:59.355 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:50:59.361 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:50:59.457 INFO:tasks.ceph.osd.4.smithi187.stderr:2023-12-12T14:50:59.453+0000 7fcf5f6ed640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46432) UID: 0 2023-12-12T14:50:59.457 INFO:tasks.ceph.osd.5.smithi187.stderr:2023-12-12T14:50:59.453+0000 7f363eb0f640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46432) UID: 0 2023-12-12T14:50:59.458 INFO:tasks.ceph.osd.6.smithi187.stderr:2023-12-12T14:50:59.453+0000 7fb917830640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46432) UID: 0 2023-12-12T14:50:59.458 INFO:tasks.ceph.osd.7.smithi187.stderr:2023-12-12T14:50:59.453+0000 7f9c745c6640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46432) UID: 0 2023-12-12T14:54:34.014 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:54:34.052 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:55:04.653 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:55:04.682 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:55:35.038 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:55:35.042 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:55:35.070 INFO:tasks.ceph.osd.4.smithi187.stderr:2023-12-12T14:55:35.065+0000 7fcf5f6ed640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46460) UID: 0 2023-12-12T14:55:35.070 INFO:tasks.ceph.osd.5.smithi187.stderr:2023-12-12T14:55:35.065+0000 7f363eb0f640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46460) UID: 0 2023-12-12T14:55:35.071 INFO:tasks.ceph.osd.6.smithi187.stderr:2023-12-12T14:55:35.065+0000 7fb917830640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46460) UID: 0 2023-12-12T14:55:35.071 INFO:tasks.ceph.osd.7.smithi187.stderr:2023-12-12T14:55:35.065+0000 7f9c745c6640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46460) UID: 0 2023-12-12T14:58:43.290 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:58:43.299 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T14:58:43.454 INFO:tasks.ceph.mds.c.smithi078.stderr:2023-12-12T14:58:43.448+0000 7f93f9020640 -1 received signal: Hangup from (PID: 474983) UID: 0 2023-12-12T14:58:43.455 INFO:tasks.ceph.mds.a.smithi078.stderr:2023-12-12T14:58:43.448+0000 7fd9e625e640 -1 received signal: Hangup from (PID: 474983) UID: 0 2023-12-12T15:08:32.923 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T15:08:32.948 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T15:09:03.300 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T15:09:03.314 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T15:09:03.344 INFO:tasks.ceph.osd.4.smithi187.stderr:2023-12-12T15:09:03.340+0000 7fcf5f6ed640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46515) UID: 0 2023-12-12T15:09:03.344 INFO:tasks.ceph.osd.5.smithi187.stderr:2023-12-12T15:09:03.340+0000 7f363eb0f640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46515) UID: 0 2023-12-12T15:09:03.344 INFO:tasks.ceph.osd.6.smithi187.stderr:2023-12-12T15:09:03.340+0000 7fb917830640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46515) UID: 0 2023-12-12T15:09:03.345 INFO:tasks.ceph.osd.7.smithi187.stderr:2023-12-12T15:09:03.340+0000 7f9c745c6640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46515) UID: 0 2023-12-12T15:12:14.372 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T15:12:14.393 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T15:12:14.424 INFO:tasks.ceph.osd.5.smithi187.stderr:2023-12-12T15:12:14.421+0000 7f363eb0f640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46530) UID: 0 2023-12-12T15:12:14.425 INFO:tasks.ceph.osd.4.smithi187.stderr:2023-12-12T15:12:14.421+0000 7fcf5f6ed640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46530) UID: 0 2023-12-12T15:12:14.425 INFO:tasks.ceph.osd.6.smithi187.stderr:2023-12-12T15:12:14.421+0000 7fb917830640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46530) UID: 0 2023-12-12T15:12:14.425 INFO:tasks.ceph.osd.7.smithi187.stderr:2023-12-12T15:12:14.421+0000 7f9c745c6640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46530) UID: 0 2023-12-12T15:15:30.798 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T15:15:30.806 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T15:16:02.198 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T15:16:02.205 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T15:16:32.823 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T15:16:32.829 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T15:17:02.940 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T15:17:02.948 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T15:17:34.290 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T15:17:34.311 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T15:18:04.594 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T15:18:04.627 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T15:18:34.901 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T15:18:34.915 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T15:19:05.126 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T15:19:05.139 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T15:19:35.909 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T15:19:35.928 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T15:20:06.298 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T15:20:06.346 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T15:20:36.723 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T15:20:36.731 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T15:21:06.824 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T15:21:06.838 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T15:21:37.074 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T15:21:37.084 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T15:22:07.184 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T15:22:07.198 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T15:22:37.538 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T15:22:37.587 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T15:23:07.831 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T15:23:07.835 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T15:23:37.991 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T15:23:37.996 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T15:24:08.205 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T15:24:08.221 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T15:24:38.406 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T15:24:38.429 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T15:25:08.789 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T15:25:08.800 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T15:25:39.249 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T15:25:39.256 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T15:26:09.368 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T15:26:09.432 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T15:26:39.595 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T15:26:39.622 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T15:27:09.786 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T15:27:09.923 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T15:27:40.377 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T15:27:40.383 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T15:28:10.462 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T15:28:10.467 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T15:28:40.731 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T15:28:40.740 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T15:29:10.823 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T15:29:10.892 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T15:29:41.039 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T15:29:41.059 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T15:29:41.239 INFO:tasks.ceph.mds.a.smithi078.stderr:2023-12-12T15:29:41.234+0000 7fd9e625e640 -1 Fail to open '/proc/479186/cmdline' error = (2) No such file or directory 2023-12-12T15:29:41.239 INFO:tasks.ceph.mds.a.smithi078.stderr:2023-12-12T15:29:41.234+0000 7fd9e625e640 -1 received signal: Hangup from (PID: 479186) UID: 0 2023-12-12T15:29:41.240 INFO:tasks.ceph.mds.c.smithi078.stderr:2023-12-12T15:29:41.238+0000 7f93f9020640 -1 Fail to open '/proc/479186/cmdline' error = (2) No such file or directory 2023-12-12T15:29:41.240 INFO:tasks.ceph.mds.c.smithi078.stderr:2023-12-12T15:29:41.238+0000 7f93f9020640 -1 received signal: Hangup from (PID: 479186) UID: 0 2023-12-12T15:41:11.057 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T15:41:11.064 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T15:41:41.344 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T15:41:41.353 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T15:42:11.636 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T15:42:11.643 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T15:42:41.814 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T15:42:41.837 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T15:43:12.392 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T15:43:12.396 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T15:43:12.539 INFO:tasks.ceph.osd.0.smithi078.stderr:2023-12-12T15:43:12.536+0000 7f7267fb3640 -1 Fail to open '/proc/480852/cmdline' error = (2) No such file or directory 2023-12-12T15:43:12.540 INFO:tasks.ceph.osd.0.smithi078.stderr:2023-12-12T15:43:12.536+0000 7f7267fb3640 -1 received signal: Hangup from (PID: 480852) UID: 0 2023-12-12T15:43:12.540 INFO:tasks.ceph.osd.2.smithi078.stderr:2023-12-12T15:43:12.536+0000 7efffc42e640 -1 Fail to open '/proc/480852/cmdline' error = (2) No such file or directory 2023-12-12T15:43:12.540 INFO:tasks.ceph.osd.2.smithi078.stderr:2023-12-12T15:43:12.536+0000 7efffc42e640 -1 received signal: Hangup from (PID: 480852) UID: 0 2023-12-12T15:43:12.540 INFO:tasks.ceph.osd.1.smithi078.stderr:2023-12-12T15:43:12.536+0000 7fda08c74640 -1 Fail to open '/proc/480852/cmdline' error = (2) No such file or directory 2023-12-12T15:43:12.541 INFO:tasks.ceph.osd.1.smithi078.stderr:2023-12-12T15:43:12.536+0000 7fda08c74640 -1 received signal: Hangup from (PID: 480852) UID: 0 2023-12-12T15:43:12.541 INFO:tasks.ceph.osd.3.smithi078.stderr:2023-12-12T15:43:12.536+0000 7f238c6c1640 -1 Fail to open '/proc/480852/cmdline' error = (2) No such file or directory 2023-12-12T15:43:12.541 INFO:tasks.ceph.osd.3.smithi078.stderr:2023-12-12T15:43:12.536+0000 7f238c6c1640 -1 received signal: Hangup from (PID: 480852) UID: 0 2023-12-12T15:54:03.508 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T15:54:03.514 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T15:54:03.662 INFO:tasks.ceph.osd.4.smithi187.stderr:2023-12-12T15:54:03.658+0000 7fcf5f6ed640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46764) UID: 0 2023-12-12T15:54:03.663 INFO:tasks.ceph.osd.6.smithi187.stderr:2023-12-12T15:54:03.658+0000 7fb917830640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46764) UID: 0 2023-12-12T15:54:03.663 INFO:tasks.ceph.osd.5.smithi187.stderr:2023-12-12T15:54:03.662+0000 7f363eb0f640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46764) UID: 0 2023-12-12T15:54:03.664 INFO:tasks.ceph.osd.7.smithi187.stderr:2023-12-12T15:54:03.662+0000 7f9c745c6640 -1 Fail to open '/proc/46764/cmdline' error = (2) No such file or directory 2023-12-12T15:54:03.664 INFO:tasks.ceph.osd.7.smithi187.stderr:2023-12-12T15:54:03.662+0000 7f9c745c6640 -1 received signal: Hangup from (PID: 46764) UID: 0 2023-12-12T15:54:05.132 INFO:tasks.ceph.osd.0.smithi078.stderr:2023-12-12T15:54:05.105+0000 7f7267fb3640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 482222) UID: 0 2023-12-12T15:54:05.132 INFO:tasks.ceph.osd.3.smithi078.stderr:2023-12-12T15:54:05.109+0000 7f238c6c1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 482222) UID: 0 2023-12-12T15:54:05.144 INFO:tasks.ceph.osd.2.smithi078.stderr:2023-12-12T15:54:05.129+0000 7efffc42e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 482222) UID: 0 2023-12-12T15:54:05.144 INFO:tasks.ceph.osd.1.smithi078.stderr:2023-12-12T15:54:05.141+0000 7fda08c74640 -1 Fail to open '/proc/482222/cmdline' error = (2) No such file or directory 2023-12-12T15:54:05.144 INFO:tasks.ceph.osd.1.smithi078.stderr:2023-12-12T15:54:05.141+0000 7fda08c74640 -1 received signal: Hangup from (PID: 482222) UID: 0 2023-12-12T16:17:32.909 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T16:17:32.915 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T16:17:32.953 INFO:tasks.ceph.osd.4.smithi187.stderr:2023-12-12T16:17:32.945+0000 7fcf5f6ed640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46859) UID: 0 2023-12-12T16:17:32.954 INFO:tasks.ceph.osd.5.smithi187.stderr:2023-12-12T16:17:32.945+0000 7f363eb0f640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46859) UID: 0 2023-12-12T16:17:32.954 INFO:tasks.ceph.osd.6.smithi187.stderr:2023-12-12T16:17:32.945+0000 7fb917830640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46859) UID: 0 2023-12-12T16:17:32.954 INFO:tasks.ceph.osd.7.smithi187.stderr:2023-12-12T16:17:32.945+0000 7f9c745c6640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46859) UID: 0 2023-12-12T16:17:33.245 INFO:tasks.ceph.mds.c.smithi078.stderr:2023-12-12T16:17:33.238+0000 7f93f9020640 -1 Fail to open '/proc/485062/cmdline' error = (2) No such file or directory 2023-12-12T16:17:33.246 INFO:tasks.ceph.mds.c.smithi078.stderr:2023-12-12T16:17:33.238+0000 7f93f9020640 -1 received signal: Hangup from (PID: 485062) UID: 0 2023-12-12T16:17:33.246 INFO:tasks.ceph.mds.a.smithi078.stderr:2023-12-12T16:17:33.238+0000 7fd9e625e640 -1 Fail to open '/proc/485062/cmdline' error = (2) No such file or directory 2023-12-12T16:17:33.246 INFO:tasks.ceph.mds.a.smithi078.stderr:2023-12-12T16:17:33.238+0000 7fd9e625e640 -1 received signal: Hangup from (PID: 485062) UID: 0 2023-12-12T16:23:37.002 INFO:teuthology.orchestra.run.smithi078.stdout:generic/650 6088s 2023-12-12T16:23:37.345 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/650 2023-12-12T16:23:37.345 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T16:23:37.372 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T16:23:37.472 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T16:23:37.473 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/651) 2023-12-12T16:23:39.667 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T16:23:39.710 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T16:23:39.710 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T16:23:40.929 INFO:teuthology.orchestra.run.smithi078.stdout:generic/651 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T16:23:40.945 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/651 2023-12-12T16:23:40.946 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/651 2023-12-12T16:23:40.946 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T16:23:40.956 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T16:23:41.026 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T16:23:41.026 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/652) 2023-12-12T16:23:43.302 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T16:23:43.318 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T16:23:43.319 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T16:23:44.987 INFO:teuthology.orchestra.run.smithi078.stdout:generic/652 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T16:23:45.010 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/652 2023-12-12T16:23:45.010 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/652 2023-12-12T16:23:45.011 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T16:23:45.029 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T16:23:45.102 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T16:23:45.102 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/653) 2023-12-12T16:23:46.441 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T16:23:46.469 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T16:23:46.469 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T16:23:47.485 INFO:teuthology.orchestra.run.smithi078.stdout:generic/653 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T16:23:47.513 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/653 2023-12-12T16:23:47.514 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/653 2023-12-12T16:23:47.514 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T16:23:47.532 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T16:23:47.595 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T16:23:47.596 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/654) 2023-12-12T16:23:48.883 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T16:23:48.914 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T16:23:48.914 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T16:23:50.564 INFO:teuthology.orchestra.run.smithi078.stdout:generic/654 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T16:23:50.576 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/654 2023-12-12T16:23:50.576 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/654 2023-12-12T16:23:50.576 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T16:23:50.591 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T16:23:50.693 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T16:23:50.693 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/655) 2023-12-12T16:23:51.810 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T16:23:51.830 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T16:23:51.830 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T16:23:53.021 INFO:teuthology.orchestra.run.smithi078.stdout:generic/655 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T16:23:53.035 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/655 2023-12-12T16:23:53.035 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/655 2023-12-12T16:23:53.035 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T16:23:53.056 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T16:23:53.167 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T16:23:53.167 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/656) 2023-12-12T16:23:54.513 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T16:23:54.543 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T16:23:54.543 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T16:23:55.617 INFO:teuthology.orchestra.run.smithi078.stdout:generic/656 [not run] vfstest not support by ceph-fuse 2023-12-12T16:23:55.654 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/656 2023-12-12T16:23:55.654 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/656 2023-12-12T16:23:55.654 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T16:23:55.680 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T16:23:55.754 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T16:23:55.754 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/657) 2023-12-12T16:23:57.158 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T16:23:57.229 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T16:23:57.229 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T16:23:58.595 INFO:teuthology.orchestra.run.smithi078.stdout:generic/657 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T16:23:58.629 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/657 2023-12-12T16:23:58.629 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/657 2023-12-12T16:23:58.629 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T16:23:58.660 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T16:23:58.758 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T16:23:58.758 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/658) 2023-12-12T16:23:59.930 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T16:23:59.974 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T16:23:59.974 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T16:24:00.893 INFO:teuthology.orchestra.run.smithi078.stdout:generic/658 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T16:24:00.906 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/658 2023-12-12T16:24:00.907 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/658 2023-12-12T16:24:00.907 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T16:24:00.917 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T16:24:00.958 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T16:24:00.958 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/659) 2023-12-12T16:24:02.253 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T16:24:02.287 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T16:24:02.287 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T16:24:03.817 INFO:teuthology.orchestra.run.smithi078.stdout:generic/659 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T16:24:03.854 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/659 2023-12-12T16:24:03.854 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/659 2023-12-12T16:24:03.855 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T16:24:03.888 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T16:24:03.978 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T16:24:03.978 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/660) 2023-12-12T16:24:05.436 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T16:24:05.490 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T16:24:05.490 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T16:24:06.743 INFO:teuthology.orchestra.run.smithi078.stdout:generic/660 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T16:24:06.771 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/660 2023-12-12T16:24:06.771 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/660 2023-12-12T16:24:06.771 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T16:24:06.805 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T16:24:06.855 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T16:24:06.855 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/661) 2023-12-12T16:24:08.238 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T16:24:08.301 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T16:24:08.302 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T16:24:09.443 INFO:teuthology.orchestra.run.smithi078.stdout:generic/661 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T16:24:09.460 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/661 2023-12-12T16:24:09.460 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/661 2023-12-12T16:24:09.460 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T16:24:09.486 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T16:24:09.594 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T16:24:09.595 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/662) 2023-12-12T16:24:10.727 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T16:24:10.750 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T16:24:10.750 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T16:24:11.759 INFO:teuthology.orchestra.run.smithi078.stdout:generic/662 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T16:24:11.774 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/662 2023-12-12T16:24:11.774 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/662 2023-12-12T16:24:11.775 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T16:24:11.788 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T16:24:11.865 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T16:24:11.865 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/663) 2023-12-12T16:24:13.177 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T16:24:13.198 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T16:24:13.198 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T16:24:14.100 INFO:teuthology.orchestra.run.smithi078.stdout:generic/663 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T16:24:14.141 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/663 2023-12-12T16:24:14.142 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/663 2023-12-12T16:24:14.143 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T16:24:14.160 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T16:24:14.259 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T16:24:14.260 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/664) 2023-12-12T16:24:15.605 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T16:24:15.638 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T16:24:15.638 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T16:24:16.630 INFO:teuthology.orchestra.run.smithi078.stdout:generic/664 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T16:24:16.651 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/664 2023-12-12T16:24:16.652 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/664 2023-12-12T16:24:16.652 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T16:24:16.673 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T16:24:16.777 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T16:24:16.778 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/665) 2023-12-12T16:24:17.964 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T16:24:17.984 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T16:24:17.984 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T16:24:19.019 INFO:teuthology.orchestra.run.smithi078.stdout:generic/665 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T16:24:19.055 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/665 2023-12-12T16:24:19.055 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/665 2023-12-12T16:24:19.056 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T16:24:19.081 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T16:24:19.113 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T16:24:19.113 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/666) 2023-12-12T16:24:20.583 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T16:24:20.628 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T16:24:20.628 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T16:24:21.561 INFO:teuthology.orchestra.run.smithi078.stdout:generic/666 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T16:24:21.574 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/666 2023-12-12T16:24:21.575 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/666 2023-12-12T16:24:21.575 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T16:24:21.584 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T16:24:21.616 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T16:24:21.616 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/667) 2023-12-12T16:24:23.081 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T16:24:23.119 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T16:24:23.119 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T16:24:24.563 INFO:teuthology.orchestra.run.smithi078.stdout:generic/667 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T16:24:24.578 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/667 2023-12-12T16:24:24.579 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/667 2023-12-12T16:24:24.579 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T16:24:24.597 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T16:24:24.685 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T16:24:24.685 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/668) 2023-12-12T16:24:26.028 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T16:24:26.070 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T16:24:26.070 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T16:24:27.097 INFO:teuthology.orchestra.run.smithi078.stdout:generic/668 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T16:24:27.128 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/668 2023-12-12T16:24:27.129 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/668 2023-12-12T16:24:27.130 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T16:24:27.156 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T16:24:27.218 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T16:24:27.218 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/669) 2023-12-12T16:24:28.514 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T16:24:28.551 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T16:24:28.554 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T16:24:29.592 INFO:teuthology.orchestra.run.smithi078.stdout:generic/669 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T16:24:29.632 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/669 2023-12-12T16:24:29.633 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/669 2023-12-12T16:24:29.635 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T16:24:29.671 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T16:24:29.739 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T16:24:29.740 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/670) 2023-12-12T16:24:31.308 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T16:24:31.361 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T16:24:31.362 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T16:24:32.408 INFO:teuthology.orchestra.run.smithi078.stdout:generic/670 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T16:24:32.451 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/670 2023-12-12T16:24:32.451 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/670 2023-12-12T16:24:32.451 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T16:24:32.486 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T16:24:32.534 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T16:24:32.535 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/671) 2023-12-12T16:24:34.014 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T16:24:34.055 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T16:24:34.055 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T16:24:35.205 INFO:teuthology.orchestra.run.smithi078.stdout:generic/671 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T16:24:35.234 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/671 2023-12-12T16:24:35.234 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/671 2023-12-12T16:24:35.236 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T16:24:35.262 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T16:24:35.304 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T16:24:35.305 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/672) 2023-12-12T16:24:36.728 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T16:24:36.769 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T16:24:36.769 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T16:24:37.919 INFO:teuthology.orchestra.run.smithi078.stdout:generic/672 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T16:24:37.958 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/672 2023-12-12T16:24:37.958 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/672 2023-12-12T16:24:37.958 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T16:24:37.988 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T16:24:38.101 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T16:24:38.101 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/673) 2023-12-12T16:24:39.295 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T16:24:39.323 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T16:24:39.323 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T16:24:41.516 INFO:teuthology.orchestra.run.smithi078.stdout:generic/673 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T16:24:41.544 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/673 2023-12-12T16:24:41.544 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/673 2023-12-12T16:24:41.545 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T16:24:41.561 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T16:24:41.597 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T16:24:41.597 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/674) 2023-12-12T16:24:42.993 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T16:24:43.021 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T16:24:43.022 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T16:24:44.195 INFO:teuthology.orchestra.run.smithi078.stdout:generic/674 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T16:24:44.227 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/674 2023-12-12T16:24:44.227 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/674 2023-12-12T16:24:44.227 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T16:24:44.247 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T16:24:44.295 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T16:24:44.295 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/675) 2023-12-12T16:24:45.577 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T16:24:45.611 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T16:24:45.611 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T16:24:46.908 INFO:teuthology.orchestra.run.smithi078.stdout:generic/675 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T16:24:46.946 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/675 2023-12-12T16:24:46.947 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/675 2023-12-12T16:24:46.947 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T16:24:46.974 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T16:24:47.038 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T16:24:47.038 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/676) 2023-12-12T16:24:48.505 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T16:24:48.562 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T16:24:48.562 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T16:27:00.059 INFO:tasks.ceph.osd.0.smithi078.stderr:2023-12-12T16:27:00.053+0000 7f7267fb3640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 495644) UID: 0 2023-12-12T16:27:00.060 INFO:tasks.ceph.osd.1.smithi078.stderr:2023-12-12T16:27:00.053+0000 7fda08c74640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 495644) UID: 0 2023-12-12T16:27:00.060 INFO:tasks.ceph.osd.2.smithi078.stderr:2023-12-12T16:27:00.053+0000 7efffc42e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 495644) UID: 0 2023-12-12T16:27:00.060 INFO:tasks.ceph.osd.3.smithi078.stderr:2023-12-12T16:27:00.053+0000 7f238c6c1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 495644) UID: 0 2023-12-12T16:37:02.776 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T16:37:02.787 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T16:37:02.970 INFO:tasks.ceph.osd.4.smithi187.stderr:2023-12-12T16:37:02.963+0000 7fcf5f6ed640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46906) UID: 0 2023-12-12T16:37:02.970 INFO:tasks.ceph.osd.5.smithi187.stderr:2023-12-12T16:37:02.963+0000 7f363eb0f640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46906) UID: 0 2023-12-12T16:37:02.970 INFO:tasks.ceph.osd.6.smithi187.stderr:2023-12-12T16:37:02.963+0000 7fb917830640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46906) UID: 0 2023-12-12T16:37:02.971 INFO:tasks.ceph.osd.7.smithi187.stderr:2023-12-12T16:37:02.963+0000 7f9c745c6640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46906) UID: 0 2023-12-12T16:37:02.981 INFO:tasks.ceph.mds.c.smithi078.stderr:2023-12-12T16:37:02.971+0000 7f93f9020640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 495669) UID: 0 2023-12-12T16:37:02.983 INFO:tasks.ceph.mds.a.smithi078.stderr:2023-12-12T16:37:02.975+0000 7fd9e625e640 -1 Fail to open '/proc/495669/cmdline' error = (2) No such file or directory 2023-12-12T16:37:02.990 INFO:tasks.ceph.mds.a.smithi078.stderr:2023-12-12T16:37:02.975+0000 7fd9e625e640 -1 received signal: Hangup from (PID: 495669) UID: 0 2023-12-12T16:44:27.960 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T16:44:27.973 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T16:44:58.234 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T16:44:58.255 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T16:45:28.879 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T16:45:28.887 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T16:45:59.899 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T16:45:59.913 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T16:46:32.090 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T16:46:32.096 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T16:46:32.150 INFO:tasks.ceph.osd.4.smithi187.stderr:2023-12-12T16:46:32.147+0000 7fcf5f6ed640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46937) UID: 0 2023-12-12T16:46:32.150 INFO:tasks.ceph.osd.5.smithi187.stderr:2023-12-12T16:46:32.147+0000 7f363eb0f640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46937) UID: 0 2023-12-12T16:46:32.151 INFO:tasks.ceph.osd.6.smithi187.stderr:2023-12-12T16:46:32.147+0000 7fb917830640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46937) UID: 0 2023-12-12T16:46:32.151 INFO:tasks.ceph.osd.7.smithi187.stderr:2023-12-12T16:46:32.147+0000 7f9c745c6640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46937) UID: 0 2023-12-12T16:49:47.053 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T16:49:47.066 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T16:50:17.189 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T16:50:17.194 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T16:50:47.330 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T16:50:47.350 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T16:51:17.495 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T16:51:17.517 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T16:51:47.651 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T16:51:47.668 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T16:52:17.736 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T16:52:17.756 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T16:52:17.893 INFO:tasks.ceph.mds.c.smithi078.stderr:2023-12-12T16:52:17.888+0000 7f93f9020640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 495720) UID: 0 2023-12-12T16:52:17.910 INFO:tasks.ceph.mds.a.smithi078.stderr:2023-12-12T16:52:17.888+0000 7fd9e625e640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 495720) UID: 0 2023-12-12T16:58:31.910 INFO:tasks.ceph.osd.1.smithi078.stderr:2023-12-12T16:58:31.902+0000 7fda08c74640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 495742) UID: 0 2023-12-12T16:58:31.911 INFO:tasks.ceph.osd.3.smithi078.stderr:2023-12-12T16:58:31.902+0000 7f238c6c1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 495742) UID: 0 2023-12-12T16:58:31.911 INFO:tasks.ceph.osd.2.smithi078.stderr:2023-12-12T16:58:31.902+0000 7efffc42e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 495742) UID: 0 2023-12-12T16:58:31.912 INFO:tasks.ceph.osd.0.smithi078.stderr:2023-12-12T16:58:31.902+0000 7f7267fb3640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 495742) UID: 0 2023-12-12T17:13:28.162 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T17:13:28.182 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T17:13:28.585 INFO:tasks.ceph.mds.c.smithi078.stderr:2023-12-12T17:13:28.580+0000 7f93f9020640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 495772) UID: 0 2023-12-12T17:13:28.586 INFO:tasks.ceph.mds.a.smithi078.stderr:2023-12-12T17:13:28.580+0000 7fd9e625e640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 495772) UID: 0 2023-12-12T17:21:30.420 INFO:tasks.ceph.osd.0.smithi078.stderr:2023-12-12T17:21:30.408+0000 7f7267fb3640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 495793) UID: 0 2023-12-12T17:21:30.420 INFO:tasks.ceph.osd.1.smithi078.stderr:2023-12-12T17:21:30.412+0000 7fda08c74640 -1 Fail to open '/proc/495793/cmdline' error = (2) No such file or directory 2023-12-12T17:21:30.421 INFO:tasks.ceph.osd.1.smithi078.stderr:2023-12-12T17:21:30.412+0000 7fda08c74640 -1 received signal: Hangup from (PID: 495793) UID: 0 2023-12-12T17:21:30.421 INFO:tasks.ceph.osd.2.smithi078.stderr:2023-12-12T17:21:30.408+0000 7efffc42e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 495793) UID: 0 2023-12-12T17:21:30.421 INFO:tasks.ceph.osd.3.smithi078.stderr:2023-12-12T17:21:30.408+0000 7f238c6c1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 495793) UID: 0 2023-12-12T17:29:04.763 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T17:29:04.777 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T17:29:04.914 INFO:tasks.ceph.osd.4.smithi187.stderr:2023-12-12T17:29:04.909+0000 7fcf5f6ed640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 47046) UID: 0 2023-12-12T17:29:04.915 INFO:tasks.ceph.osd.5.smithi187.stderr:2023-12-12T17:29:04.909+0000 7f363eb0f640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 47046) UID: 0 2023-12-12T17:29:04.915 INFO:tasks.ceph.osd.6.smithi187.stderr:2023-12-12T17:29:04.909+0000 7fb917830640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 47046) UID: 0 2023-12-12T17:29:04.915 INFO:tasks.ceph.osd.7.smithi187.stderr:2023-12-12T17:29:04.909+0000 7f9c745c6640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 47046) UID: 0 2023-12-12T17:31:07.434 INFO:teuthology.orchestra.run.smithi078.stdout:generic/676 3979s 2023-12-12T17:31:07.633 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/676 2023-12-12T17:31:07.634 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T17:31:07.657 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T17:31:07.729 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T17:31:07.729 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/677) 2023-12-12T17:31:13.659 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T17:31:13.709 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T17:31:13.710 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T17:31:14.987 INFO:teuthology.orchestra.run.smithi078.stdout:generic/677 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T17:31:15.026 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/677 2023-12-12T17:31:15.026 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/677 2023-12-12T17:31:15.026 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T17:31:15.046 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T17:31:15.088 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T17:31:15.088 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/678) 2023-12-12T17:31:16.270 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T17:31:16.289 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T17:31:16.290 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T17:31:17.846 INFO:teuthology.orchestra.run.smithi078.stdout:generic/678 1s 2023-12-12T17:31:17.896 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/678 2023-12-12T17:31:17.896 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T17:31:17.905 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T17:31:17.946 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T17:31:17.946 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/679) 2023-12-12T17:31:19.736 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T17:31:19.768 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T17:31:19.769 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T17:31:20.604 INFO:teuthology.orchestra.run.smithi078.stdout:generic/679 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T17:31:20.644 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/679 2023-12-12T17:31:20.644 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/679 2023-12-12T17:31:20.644 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T17:31:20.674 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T17:31:20.752 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T17:31:20.752 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/680) 2023-12-12T17:31:22.383 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T17:31:22.396 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T17:31:22.396 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T17:31:24.998 INFO:teuthology.orchestra.run.smithi078.stdout:generic/680 2s 2023-12-12T17:31:25.061 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/680 2023-12-12T17:31:25.061 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T17:31:25.089 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T17:31:25.197 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T17:31:25.197 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/681) 2023-12-12T17:31:27.215 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T17:31:27.263 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T17:31:27.263 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T17:31:28.231 INFO:teuthology.orchestra.run.smithi078.stdout:generic/681 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2023-12-12T17:31:28.243 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/681 2023-12-12T17:31:28.243 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/681 2023-12-12T17:31:28.243 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T17:31:28.253 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T17:31:28.358 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T17:31:28.358 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/682) 2023-12-12T17:31:29.935 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T17:31:29.953 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T17:31:29.953 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T17:31:30.942 INFO:teuthology.orchestra.run.smithi078.stdout:generic/682 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2023-12-12T17:31:30.979 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/682 2023-12-12T17:31:30.979 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/682 2023-12-12T17:31:30.982 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T17:31:31.014 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T17:31:31.113 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T17:31:31.113 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/683) 2023-12-12T17:31:32.428 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T17:31:32.464 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T17:31:32.464 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T17:31:33.940 INFO:teuthology.orchestra.run.smithi078.stdout:generic/683 [not run] /tmp/tmp.Rxjq0xhkP8test: file alloc unit 4194304 larger than op length 65536 2023-12-12T17:31:33.969 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/683 2023-12-12T17:31:33.969 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/683 2023-12-12T17:31:33.969 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T17:31:33.988 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T17:31:34.034 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T17:31:34.034 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/684) 2023-12-12T17:31:35.169 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T17:31:35.203 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T17:31:35.203 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T17:31:40.625 INFO:teuthology.orchestra.run.smithi078.stdout:generic/684 [not run] /tmp/tmp.Rxjq0xhkP8test: file alloc unit 4194304 larger than op length 65536 2023-12-12T17:31:40.659 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/684 2023-12-12T17:31:40.659 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/684 2023-12-12T17:31:40.659 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T17:31:40.679 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T17:31:40.734 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T17:31:40.735 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/685) 2023-12-12T17:31:41.803 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T17:31:41.820 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T17:31:41.821 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T17:31:47.133 INFO:teuthology.orchestra.run.smithi078.stdout:generic/685 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-12-12T17:31:47.154 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/685 2023-12-12T17:31:47.155 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/685 2023-12-12T17:31:47.155 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T17:31:47.193 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T17:31:47.277 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T17:31:47.277 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/686) 2023-12-12T17:31:48.470 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T17:31:48.501 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T17:31:48.501 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T17:31:53.889 INFO:teuthology.orchestra.run.smithi078.stdout:generic/686 [not run] xfs_io finsert failed (old kernel/wrong fs?) 2023-12-12T17:31:53.912 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/686 2023-12-12T17:31:53.912 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/686 2023-12-12T17:31:53.912 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T17:31:53.933 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T17:31:54.000 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T17:31:54.000 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/687) 2023-12-12T17:31:55.253 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T17:31:55.296 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T17:31:55.296 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T17:32:01.343 INFO:teuthology.orchestra.run.smithi078.stdout:generic/687 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2023-12-12T17:32:01.378 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/687 2023-12-12T17:32:01.378 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/687 2023-12-12T17:32:01.378 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T17:32:01.406 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T17:32:01.490 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T17:32:01.490 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/688) 2023-12-12T17:32:02.921 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T17:32:02.949 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T17:32:02.949 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T17:32:04.250 INFO:teuthology.orchestra.run.smithi078.stdout:generic/688 [not run] /tmp/tmp.Rxjq0xhkP8test: file alloc unit 4194304 larger than op length 65536 2023-12-12T17:32:04.279 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/688 2023-12-12T17:32:04.279 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/688 2023-12-12T17:32:04.280 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T17:32:04.294 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T17:32:04.341 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T17:32:04.341 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/689) 2023-12-12T17:32:05.607 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T17:32:05.637 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T17:32:05.637 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T17:32:06.597 INFO:teuthology.orchestra.run.smithi078.stdout:generic/689 [not run] vfstest not support by ceph-fuse 2023-12-12T17:32:06.632 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/689 2023-12-12T17:32:06.632 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/689 2023-12-12T17:32:06.632 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T17:32:06.649 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T17:32:06.693 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T17:32:06.693 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/690) 2023-12-12T17:32:07.881 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T17:32:07.923 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T17:32:07.924 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T17:32:08.963 INFO:teuthology.orchestra.run.smithi078.stdout:generic/690 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T17:32:08.984 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/690 2023-12-12T17:32:08.984 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/690 2023-12-12T17:32:08.984 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T17:32:09.011 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T17:32:09.096 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T17:32:09.097 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/691) 2023-12-12T17:32:10.320 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T17:32:10.354 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T17:32:10.355 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T17:32:11.237 INFO:teuthology.orchestra.run.smithi078.stdout:generic/691 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T17:32:11.266 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/691 2023-12-12T17:32:11.266 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/691 2023-12-12T17:32:11.266 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T17:32:11.287 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T17:32:11.343 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T17:32:11.343 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/692) 2023-12-12T17:32:12.565 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T17:32:12.615 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T17:32:12.615 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T17:32:13.602 INFO:teuthology.orchestra.run.smithi078.stdout:generic/692 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T17:32:13.636 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/692 2023-12-12T17:32:13.636 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/692 2023-12-12T17:32:13.636 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T17:32:13.647 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T17:32:13.698 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T17:32:13.698 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/693) 2023-12-12T17:32:14.865 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T17:32:14.901 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T17:32:14.901 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T17:32:16.173 INFO:teuthology.orchestra.run.smithi078.stdout:generic/693 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T17:32:16.186 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/693 2023-12-12T17:32:16.187 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/693 2023-12-12T17:32:16.187 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T17:32:16.222 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T17:32:16.280 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T17:32:16.280 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/694) 2023-12-12T17:32:17.487 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T17:32:17.519 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T17:32:17.520 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T17:32:19.724 INFO:teuthology.orchestra.run.smithi078.stdout:generic/694 2s 2023-12-12T17:32:19.783 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/694 2023-12-12T17:32:19.784 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T17:32:19.806 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T17:32:19.881 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T17:32:19.882 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/695) 2023-12-12T17:32:21.115 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T17:32:21.161 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T17:32:21.161 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T17:32:22.078 INFO:teuthology.orchestra.run.smithi078.stdout:generic/695 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T17:32:22.105 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/695 2023-12-12T17:32:22.105 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/695 2023-12-12T17:32:22.105 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T17:32:22.114 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T17:32:22.185 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T17:32:22.186 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/696) 2023-12-12T17:32:23.347 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T17:32:23.386 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T17:32:23.386 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T17:32:24.399 INFO:teuthology.orchestra.run.smithi078.stdout:generic/696 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T17:32:24.420 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/696 2023-12-12T17:32:24.420 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/696 2023-12-12T17:32:24.420 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T17:32:24.447 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T17:32:24.509 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T17:32:24.509 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/697) 2023-12-12T17:32:25.716 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T17:32:25.760 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T17:32:25.760 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T17:32:26.854 INFO:teuthology.orchestra.run.smithi078.stdout:generic/697 [not run] ACLs not supported by this filesystem type: ceph-fuse 2023-12-12T17:32:26.886 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/697 2023-12-12T17:32:26.888 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/697 2023-12-12T17:32:26.888 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T17:32:26.905 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T17:32:26.963 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T17:32:26.964 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/698) 2023-12-12T17:32:28.183 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T17:32:28.232 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T17:32:28.232 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T17:32:29.559 INFO:teuthology.orchestra.run.smithi078.stdout:generic/698 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T17:32:29.588 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/698 2023-12-12T17:32:29.591 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/698 2023-12-12T17:32:29.591 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T17:32:29.601 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T17:32:29.648 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T17:32:29.648 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/699) 2023-12-12T17:32:30.962 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T17:32:31.000 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T17:32:31.000 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T17:32:32.089 INFO:teuthology.orchestra.run.smithi078.stdout:generic/699 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T17:32:32.128 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/699 2023-12-12T17:32:32.128 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/699 2023-12-12T17:32:32.128 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T17:32:32.161 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T17:32:32.228 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T17:32:32.228 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/700) 2023-12-12T17:32:33.432 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T17:32:33.465 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T17:32:33.465 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T17:32:34.472 INFO:teuthology.orchestra.run.smithi078.stdout:generic/700 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T17:32:34.488 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/700 2023-12-12T17:32:34.488 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/700 2023-12-12T17:32:34.489 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T17:32:34.518 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T17:32:34.596 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T17:32:34.596 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/701) 2023-12-12T17:32:35.699 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T17:32:35.735 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T17:32:35.735 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T17:32:37.341 INFO:teuthology.orchestra.run.smithi078.stdout:generic/701 2s 2023-12-12T17:32:37.396 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/701 2023-12-12T17:32:37.396 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T17:32:37.422 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T17:32:37.457 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T17:32:37.457 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/702) 2023-12-12T17:32:38.949 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T17:32:38.978 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T17:32:38.979 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T17:32:39.793 INFO:teuthology.orchestra.run.smithi078.stdout:generic/702 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T17:32:39.829 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/702 2023-12-12T17:32:39.830 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/702 2023-12-12T17:32:39.830 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T17:32:39.856 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T17:32:39.921 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T17:32:39.921 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/703) 2023-12-12T17:32:41.145 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T17:32:41.175 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T17:32:41.175 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T17:32:42.136 INFO:teuthology.orchestra.run.smithi078.stdout:generic/703 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T17:32:42.165 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/703 2023-12-12T17:32:42.165 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/703 2023-12-12T17:32:42.166 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T17:32:42.187 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T17:32:42.256 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T17:32:42.256 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/704) 2023-12-12T17:32:43.417 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T17:32:43.457 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T17:32:43.457 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T17:32:44.518 INFO:teuthology.orchestra.run.smithi078.stdout:generic/704 [not run] require ceph-fuse to be valid block disk 2023-12-12T17:32:44.538 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/704 2023-12-12T17:32:44.539 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/704 2023-12-12T17:32:44.539 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T17:32:44.560 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T17:32:44.632 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T17:32:44.633 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/705) 2023-12-12T17:32:45.703 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T17:32:45.721 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T17:32:45.721 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T17:32:46.623 INFO:teuthology.orchestra.run.smithi078.stdout:generic/705 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T17:32:46.646 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/705 2023-12-12T17:32:46.646 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/705 2023-12-12T17:32:46.646 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T17:32:46.655 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T17:32:46.739 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T17:32:46.739 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/706) 2023-12-12T17:32:47.871 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T17:32:47.895 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T17:32:47.895 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T17:32:51.758 INFO:teuthology.orchestra.run.smithi078.stdout:generic/706 4s 2023-12-12T17:32:51.801 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/706 2023-12-12T17:32:51.801 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T17:32:51.824 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T17:32:51.878 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T17:32:51.879 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/707) 2023-12-12T17:32:53.642 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T17:32:53.673 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T17:32:53.673 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T17:32:54.531 INFO:teuthology.orchestra.run.smithi078.stdout:generic/707 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T17:32:54.547 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/707 2023-12-12T17:32:54.548 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/707 2023-12-12T17:32:54.548 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T17:32:54.568 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T17:32:54.639 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T17:32:54.640 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/708) 2023-12-12T17:32:55.793 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T17:32:55.839 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T17:32:55.839 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T17:32:57.720 INFO:teuthology.orchestra.run.smithi078.stdout:generic/708 2s 2023-12-12T17:32:57.753 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/708 2023-12-12T17:32:57.754 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T17:32:57.772 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T17:32:57.854 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T17:32:57.854 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/709) 2023-12-12T17:32:59.568 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T17:32:59.610 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T17:32:59.610 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T17:33:00.710 INFO:teuthology.orchestra.run.smithi078.stdout:generic/709 [not run] xfs_io swapext -v exchrange not supported on ceph-fuse 2023-12-12T17:33:00.722 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/709 2023-12-12T17:33:00.723 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/709 2023-12-12T17:33:00.723 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T17:33:00.734 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T17:33:00.831 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T17:33:00.831 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/710) 2023-12-12T17:33:02.404 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T17:33:02.455 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T17:33:02.455 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T17:33:03.539 INFO:teuthology.orchestra.run.smithi078.stdout:generic/710 [not run] xfs_io swapext -v exchrange not supported on ceph-fuse 2023-12-12T17:33:03.573 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/710 2023-12-12T17:33:03.573 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/710 2023-12-12T17:33:03.573 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T17:33:03.588 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T17:33:03.737 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T17:33:03.737 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/711) 2023-12-12T17:33:05.422 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T17:33:05.463 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T17:33:05.463 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T17:33:06.494 INFO:teuthology.orchestra.run.smithi078.stdout:generic/711 [not run] xfs_io swapext -v exchrange not supported on ceph-fuse 2023-12-12T17:33:06.506 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/711 2023-12-12T17:33:06.507 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/711 2023-12-12T17:33:06.507 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T17:33:06.517 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T17:33:06.564 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T17:33:06.564 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/712) 2023-12-12T17:33:08.381 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T17:33:08.408 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T17:33:08.408 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T17:33:09.512 INFO:teuthology.orchestra.run.smithi078.stdout:generic/712 [not run] xfs_io swapext -v exchrange not supported on ceph-fuse 2023-12-12T17:33:09.543 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/712 2023-12-12T17:33:09.543 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/712 2023-12-12T17:33:09.544 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T17:33:09.570 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T17:33:09.616 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T17:33:09.616 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/713) 2023-12-12T17:33:10.237 DEBUG:teuthology.orchestra.run.smithi078:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T17:33:10.259 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T17:33:10.326 INFO:tasks.ceph.mds.a.smithi078.stderr:2023-12-12T17:33:10.321+0000 7fd9e625e640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 511202) UID: 0 2023-12-12T17:33:10.335 INFO:tasks.ceph.mds.c.smithi078.stderr:2023-12-12T17:33:10.329+0000 7f93f9020640 -1 Fail to open '/proc/511202/cmdline' error = (2) No such file or directory 2023-12-12T17:33:10.335 INFO:tasks.ceph.mds.c.smithi078.stderr:2023-12-12T17:33:10.329+0000 7f93f9020640 -1 received signal: Hangup from (PID: 511202) UID: 0 2023-12-12T17:33:11.351 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T17:33:11.395 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T17:33:11.395 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T17:33:12.482 INFO:teuthology.orchestra.run.smithi078.stdout:generic/713 [not run] xfs_io swapext -v exchrange -s 64k -l 64k not supported on ceph-fuse 2023-12-12T17:33:12.525 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/713 2023-12-12T17:33:12.525 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/713 2023-12-12T17:33:12.525 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T17:33:12.539 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T17:33:12.585 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T17:33:12.585 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/714) 2023-12-12T17:33:14.503 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T17:33:14.532 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T17:33:14.532 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T17:33:15.698 INFO:teuthology.orchestra.run.smithi078.stdout:generic/714 [not run] xfs_io swapext -v exchrange not supported on ceph-fuse 2023-12-12T17:33:15.710 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/714 2023-12-12T17:33:15.711 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/714 2023-12-12T17:33:15.711 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T17:33:15.722 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T17:33:15.885 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T17:33:15.885 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/715) 2023-12-12T17:33:17.583 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T17:33:17.616 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T17:33:17.617 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T17:33:18.896 INFO:teuthology.orchestra.run.smithi078.stdout:generic/715 [not run] xfs_io swapext -v exchrange -s 64k -l 64k not supported on ceph-fuse 2023-12-12T17:33:18.914 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/715 2023-12-12T17:33:18.915 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/715 2023-12-12T17:33:18.915 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T17:33:18.926 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T17:33:18.974 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T17:33:18.975 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/716) 2023-12-12T17:33:20.582 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T17:33:20.599 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T17:33:20.599 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T17:33:21.731 INFO:teuthology.orchestra.run.smithi078.stdout:generic/716 [not run] xfs_io swapext -v exchrange not supported on ceph-fuse 2023-12-12T17:33:21.748 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/716 2023-12-12T17:33:21.748 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/716 2023-12-12T17:33:21.748 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T17:33:21.773 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T17:33:21.872 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T17:33:21.872 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/717) 2023-12-12T17:33:23.598 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T17:33:23.643 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T17:33:23.643 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T17:33:24.860 INFO:teuthology.orchestra.run.smithi078.stdout:generic/717 [not run] xfs_io swapext -v exchrange not supported on ceph-fuse 2023-12-12T17:33:24.876 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/717 2023-12-12T17:33:24.877 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/717 2023-12-12T17:33:24.877 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T17:33:24.887 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T17:33:24.919 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T17:33:24.920 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/718) 2023-12-12T17:33:26.907 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T17:33:26.928 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T17:33:26.928 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T17:33:28.084 INFO:teuthology.orchestra.run.smithi078.stdout:generic/718 [not run] xfs_io swapext -v exchrange not supported on ceph-fuse 2023-12-12T17:33:28.115 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/718 2023-12-12T17:33:28.116 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/718 2023-12-12T17:33:28.116 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T17:33:28.144 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T17:33:28.187 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T17:33:28.187 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/719) 2023-12-12T17:33:30.129 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T17:33:30.166 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T17:33:30.167 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T17:33:31.425 INFO:teuthology.orchestra.run.smithi078.stdout:generic/719 [not run] xfs_io swapext -v exchrange not supported on ceph-fuse 2023-12-12T17:33:31.466 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/719 2023-12-12T17:33:31.466 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/719 2023-12-12T17:33:31.466 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T17:33:31.500 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T17:33:31.602 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T17:33:31.602 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/720) 2023-12-12T17:33:33.252 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T17:33:33.296 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T17:33:33.296 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T17:33:34.602 INFO:teuthology.orchestra.run.smithi078.stdout:generic/720 [not run] xfs_io swapext -v exchrange not supported on ceph-fuse 2023-12-12T17:33:34.641 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/720 2023-12-12T17:33:34.641 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/720 2023-12-12T17:33:34.644 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T17:33:34.665 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T17:33:34.775 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T17:33:34.775 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/721) 2023-12-12T17:33:36.605 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T17:33:36.653 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T17:33:36.653 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T17:33:37.720 INFO:teuthology.orchestra.run.smithi078.stdout:generic/721 [not run] xfs_io startupdate support is missing 2023-12-12T17:33:37.754 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/721 2023-12-12T17:33:37.754 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/721 2023-12-12T17:33:37.754 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T17:33:37.785 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T17:33:37.890 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T17:33:37.890 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/722) 2023-12-12T17:33:39.170 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T17:33:39.218 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T17:33:39.219 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T17:33:40.385 INFO:teuthology.orchestra.run.smithi078.stdout:generic/722 [not run] xfs_io swapext -v exchrange -a not supported on ceph-fuse 2023-12-12T17:33:40.428 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/722 2023-12-12T17:33:40.428 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/722 2023-12-12T17:33:40.428 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T17:33:40.456 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T17:33:40.555 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T17:33:40.556 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/723) 2023-12-12T17:33:42.320 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T17:33:42.335 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T17:33:42.335 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T17:33:43.635 INFO:teuthology.orchestra.run.smithi078.stdout:generic/723 [not run] xfs_io swapext -v exchrange not supported on ceph-fuse 2023-12-12T17:33:43.651 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/723 2023-12-12T17:33:43.652 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/723 2023-12-12T17:33:43.656 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T17:33:43.685 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T17:33:43.719 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T17:33:43.719 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/724) 2023-12-12T17:33:45.554 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T17:33:45.583 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T17:33:45.583 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T17:33:46.751 INFO:teuthology.orchestra.run.smithi078.stdout:generic/724 [not run] xfs_io swapext -v exchrange -a not supported on ceph-fuse 2023-12-12T17:33:46.779 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/724 2023-12-12T17:33:46.779 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/724 2023-12-12T17:33:46.779 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T17:33:46.797 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T17:33:46.857 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T17:33:46.857 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/725) 2023-12-12T17:33:48.636 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T17:33:48.688 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T17:33:48.689 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T17:33:49.933 INFO:teuthology.orchestra.run.smithi078.stdout:generic/725 [not run] xfs_io swapext -v exchrange -a not supported on ceph-fuse 2023-12-12T17:33:49.958 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/725 2023-12-12T17:33:49.958 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/725 2023-12-12T17:33:49.958 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T17:33:49.978 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T17:33:50.097 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T17:33:50.097 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/726) 2023-12-12T17:33:51.750 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T17:33:51.780 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T17:33:51.781 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T17:33:53.850 INFO:teuthology.orchestra.run.smithi078.stdout:generic/726 [not run] xfs_io swapext -v exchrange -a not supported on ceph-fuse 2023-12-12T17:33:53.889 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/726 2023-12-12T17:33:53.892 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/726 2023-12-12T17:33:53.892 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T17:33:53.920 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T17:33:53.997 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T17:33:53.998 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/727) 2023-12-12T17:33:55.827 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T17:33:55.875 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T17:33:55.875 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T17:33:57.359 INFO:teuthology.orchestra.run.smithi078.stdout:generic/727 [not run] xfs_io swapext -v exchrange -a not supported on ceph-fuse 2023-12-12T17:33:57.382 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/727 2023-12-12T17:33:57.382 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/727 2023-12-12T17:33:57.382 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T17:33:57.408 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T17:33:57.595 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T17:33:57.595 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/728) 2023-12-12T17:33:59.352 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T17:33:59.372 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T17:33:59.372 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T17:34:04.750 INFO:teuthology.orchestra.run.smithi078.stdout:generic/728 5s 2023-12-12T17:34:04.803 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/728 2023-12-12T17:34:04.803 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T17:34:04.812 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T17:34:04.893 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T17:34:04.893 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/729) 2023-12-12T17:34:06.108 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T17:34:06.155 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T17:34:06.155 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T17:34:08.263 INFO:teuthology.orchestra.run.smithi078.stdout:generic/729 2s 2023-12-12T17:34:08.323 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/729 2023-12-12T17:34:08.323 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T17:34:08.351 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T17:34:08.397 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T17:34:08.397 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/730) 2023-12-12T17:34:10.019 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T17:34:10.054 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T17:34:10.055 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T17:34:11.311 INFO:teuthology.orchestra.run.smithi078.stdout:generic/730 [not run] require ceph-fuse to be valid block disk 2023-12-12T17:34:11.341 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/730 2023-12-12T17:34:11.341 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/730 2023-12-12T17:34:11.342 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T17:34:11.371 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T17:34:11.455 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T17:34:11.455 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/731) 2023-12-12T17:34:12.875 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T17:34:12.916 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T17:34:12.916 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T17:34:14.047 INFO:teuthology.orchestra.run.smithi078.stdout:generic/731 [not run] require ceph-fuse to be valid block disk 2023-12-12T17:34:14.083 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/731 2023-12-12T17:34:14.083 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/731 2023-12-12T17:34:14.083 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T17:34:14.109 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T17:34:14.189 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T17:34:14.190 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/732) 2023-12-12T17:34:15.522 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T17:34:15.556 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T17:34:15.556 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T17:34:16.521 INFO:teuthology.orchestra.run.smithi078.stdout:generic/732 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T17:34:16.544 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/732 2023-12-12T17:34:16.544 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/732 2023-12-12T17:34:16.544 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T17:34:16.576 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T17:34:16.642 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T17:34:16.642 DEBUG:teuthology.orchestra.run.smithi078:> (cd /tmp/tmp.GmWnCxuSqIxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/733) 2023-12-12T17:34:17.985 INFO:teuthology.orchestra.run.smithi078.stdout:FSTYP -- ceph-fuse 2023-12-12T17:34:18.052 INFO:teuthology.orchestra.run.smithi078.stdout:PLATFORM -- Linux/x86_64 smithi078 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:51:24 UTC 2023 2023-12-12T17:34:18.052 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T17:34:19.149 INFO:teuthology.orchestra.run.smithi078.stdout:generic/733 [not run] this test requires a valid $SCRATCH_DEV 2023-12-12T17:34:19.168 INFO:teuthology.orchestra.run.smithi078.stdout:Ran: generic/733 2023-12-12T17:34:19.171 INFO:teuthology.orchestra.run.smithi078.stdout:Not run: generic/733 2023-12-12T17:34:19.172 INFO:teuthology.orchestra.run.smithi078.stdout:Passed all 1 tests 2023-12-12T17:34:19.190 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T17:34:19.240 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-12T17:34:19.241 INFO:tasks.cephfs.xfstests_dev:=========================================================Total number of tests failed = 16========================================================= 2023-12-12T17:34:19.241 DEBUG:teuthology.orchestra.run.smithi078:> sudo userdel --force --remove fsgqa 2023-12-12T17:34:20.063 INFO:teuthology.orchestra.run.smithi078.stderr:userdel: fsgqa mail spool (/var/mail/fsgqa) not found 2023-12-12T17:34:20.719 DEBUG:teuthology.orchestra.run.smithi078:> sudo userdel --force --remove 123456-fsgqa 2023-12-12T17:34:20.907 INFO:teuthology.orchestra.run.smithi078.stderr:userdel: 123456-fsgqa mail spool (/var/mail/123456-fsgqa) not found 2023-12-12T17:34:20.908 INFO:teuthology.orchestra.run.smithi078.stderr:userdel: 123456-fsgqa home directory (/home/123456-fsgqa) not found 2023-12-12T17:34:22.061 DEBUG:teuthology.orchestra.run.smithi078:> sudo groupdel fsgqa 2023-12-12T17:34:22.166 INFO:teuthology.orchestra.run.smithi078.stderr:groupdel: group 'fsgqa' does not exist 2023-12-12T17:34:22.174 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-12-12T17:34:22.175 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T17:34:22.175 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo stat /tmp/tmp.GmWnCxuSqIxfstests-dev/results) 2023-12-12T17:34:22.209 INFO:teuthology.orchestra.run.smithi078.stderr:bash: line 1: cd: /home/ubuntu/cephtest/mnt.0: Permission denied 2023-12-12T17:34:22.218 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-12T17:34:22.218 INFO:tasks.cephfs.xfstests_dev:xfstests-dev repo contains not directory named "results". repo location: /tmp/tmp.GmWnCxuSqIxfstests-dev 2023-12-12T17:34:22.218 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -rf /tmp/tmp.GmWnCxuSqIxfstests-dev 2023-12-12T17:34:23.574 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-12T17:34:23.574 DEBUG:teuthology.orchestra.run.smithi078:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-12T17:34:24.019 DEBUG:teuthology.orchestra.run.smithi187:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-12T17:34:24.605 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-12T17:34:24.605 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-12-12T17:34:24.606 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-12T17:34:24.685 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354608k,nr_inodes=4088652,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275372k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=4514 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275368k,nr_inodes=818842,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275372k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-12T17:34:24.685 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi078.front.sepia.ceph.com 2023-12-12T17:34:24.685 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T17:34:24.685 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-12T17:34:24.845 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-12-12T17:34:24.845 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-12T17:34:24.875 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354632k,nr_inodes=4088658,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2532 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-12T17:34:24.875 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi187.front.sepia.ceph.com 2023-12-12T17:34:24.875 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T17:34:24.875 DEBUG:teuthology.orchestra.run.smithi187:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-12T17:34:24.945 INFO:teuthology.orchestra.run.smithi187.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-12-12T17:34:24.951 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-12T17:34:24.951 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-12-12T17:34:24.951 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-12T17:34:24.986 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354608k,nr_inodes=4088652,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275372k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=4514 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275368k,nr_inodes=818842,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275372k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-12T17:34:24.987 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi078.front.sepia.ceph.com 2023-12-12T17:34:24.987 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T17:34:24.987 DEBUG:teuthology.orchestra.run.smithi078:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-12-12T17:34:25.044 INFO:teuthology.orchestra.run.smithi078.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-12-12T17:34:25.045 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-12T17:34:25.046 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-12-12T17:34:25.046 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-12T17:34:25.058 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354632k,nr_inodes=4088658,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2532 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-12T17:34:25.058 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi187.front.sepia.ceph.com 2023-12-12T17:34:25.058 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T17:34:25.059 DEBUG:teuthology.orchestra.run.smithi187:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-12-12T17:34:25.112 INFO:teuthology.orchestra.run.smithi187.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-12-12T17:34:25.113 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-12T17:34:25.114 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-12T17:34:27.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:27.288+0000 7f4bad52a640 1 Processor -- start 2023-12-12T17:34:27.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:27.288+0000 7f4bad52a640 1 -- start start 2023-12-12T17:34:27.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:27.292+0000 7f4bad52a640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4ba8161900 0x7f4ba8160cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:34:27.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:27.292+0000 7f4bad52a640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f4ba8161210 0x7f4ba80ac880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:34:27.297 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:27.292+0000 7f4bad52a640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ba80b4f10 con 0x7f4ba81401a0 2023-12-12T17:34:27.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:27.292+0000 7f4bad52a640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ba80b4a80 con 0x7f4ba8161210 2023-12-12T17:34:27.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:27.292+0000 7f4bad52a640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ba80b2780 con 0x7f4ba8161900 2023-12-12T17:34:27.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:27.292+0000 7f4ba77fe640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f4ba8161210 0x7f4ba80ac880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:34:27.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:27.292+0000 7f4ba77fe640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f4ba8161210 0x7f4ba80ac880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.78:40392/0 (socket says 172.21.15.78:40392) 2023-12-12T17:34:27.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:27.292+0000 7f4ba77fe640 1 -- 172.21.15.78:0/4289497376 learned_addr learned my addr 172.21.15.78:0/4289497376 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T17:34:27.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:27.292+0000 7f4ba77fe640 1 -- 172.21.15.78:0/4289497376 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4ba8161900 msgr2=0x7f4ba8160cd0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-12-12T17:34:27.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:27.292+0000 7f4ba77fe640 1 --2- 172.21.15.78:0/4289497376 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4ba8161900 0x7f4ba8160cd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:27.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:27.292+0000 7f4ba77fe640 1 -- 172.21.15.78:0/4289497376 >> v1:172.21.15.187:6789/0 conn(0x7f4ba81401a0 legacy=0x7f4ba80b2070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:34:27.300 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:27.292+0000 7f4ba77fe640 1 -- 172.21.15.78:0/4289497376 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ba8161630 con 0x7f4ba8161210 2023-12-12T17:34:27.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:27.296+0000 7f4ba77fe640 1 --2- 172.21.15.78:0/4289497376 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4ba8161210 0x7f4ba80ac880 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f4ba0009870 tx=0x7f4ba001c560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=469063ee48e0fbc6 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T17:34:27.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:27.296+0000 7f4ba67fc640 1 -- 172.21.15.78:0/4289497376 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ba00ab650 con 0x7f4ba8161210 2023-12-12T17:34:27.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:27.296+0000 7f4ba67fc640 1 -- 172.21.15.78:0/4289497376 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ba00ab7b0 con 0x7f4ba8161210 2023-12-12T17:34:27.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:27.296+0000 7f4ba67fc640 1 -- 172.21.15.78:0/4289497376 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ba00abb40 con 0x7f4ba8161210 2023-12-12T17:34:27.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:27.296+0000 7f4bad52a640 1 -- 172.21.15.78:0/4289497376 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4ba8161210 msgr2=0x7f4ba80ac880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:34:27.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:27.296+0000 7f4bad52a640 1 --2- 172.21.15.78:0/4289497376 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4ba8161210 0x7f4ba80ac880 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f4ba0009870 tx=0x7f4ba001c560 comp rx=0 tx=0).stop 2023-12-12T17:34:27.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:27.300+0000 7f4bad52a640 1 -- 172.21.15.78:0/4289497376 shutdown_connections 2023-12-12T17:34:27.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:27.300+0000 7f4bad52a640 1 --2- 172.21.15.78:0/4289497376 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4ba8161210 0x7f4ba80ac880 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:27.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:27.300+0000 7f4bad52a640 1 --2- 172.21.15.78:0/4289497376 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4ba8161900 0x7f4ba8160cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:27.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:27.300+0000 7f4bad52a640 1 -- 172.21.15.78:0/4289497376 >> 172.21.15.78:0/4289497376 conn(0x7f4ba806c5d0 msgr2=0x7f4ba806c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T17:34:27.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:27.300+0000 7f4bad52a640 1 -- 172.21.15.78:0/4289497376 shutdown_connections 2023-12-12T17:34:27.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:27.300+0000 7f4bad52a640 1 -- 172.21.15.78:0/4289497376 wait complete. 2023-12-12T17:34:27.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:27.300+0000 7f4bad52a640 1 Processor -- start 2023-12-12T17:34:27.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:27.300+0000 7f4bad52a640 1 -- start start 2023-12-12T17:34:27.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:27.300+0000 7f4bad52a640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4ba81401a0 0x7f4ba813ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:34:27.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:27.300+0000 7f4bad52a640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4ba8161210 0x7f4ba80cc410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:34:27.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:27.300+0000 7f4bad52a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4ba8161900 0x7f4ba80ce290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:34:27.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:27.304+0000 7f4bad52a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ba8136510 con 0x7f4ba8161900 2023-12-12T17:34:27.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:27.304+0000 7f4bad52a640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ba80ce7d0 con 0x7f4ba8161210 2023-12-12T17:34:27.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:27.304+0000 7f4bad52a640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ba813e8e0 con 0x7f4ba81401a0 2023-12-12T17:34:27.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:27.304+0000 7f4ba6ffd640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4ba81401a0 0x7f4ba813ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:34:27.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:27.304+0000 7f4ba6ffd640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4ba81401a0 0x7f4ba813ed70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.78:54716/0 (socket says 172.21.15.78:54716) 2023-12-12T17:34:27.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:27.304+0000 7f4ba6ffd640 1 -- 172.21.15.78:0/3393912410 learned_addr learned my addr 172.21.15.78:0/3393912410 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T17:34:27.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:27.304+0000 7f4ba6ffd640 1 -- 172.21.15.78:0/3393912410 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4ba8161210 msgr2=0x7f4ba80cc410 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-12-12T17:34:27.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:27.304+0000 7f4ba6ffd640 1 --2- 172.21.15.78:0/3393912410 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4ba8161210 0x7f4ba80cc410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:27.310 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:27.304+0000 7f4ba6ffd640 1 -- 172.21.15.78:0/3393912410 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4ba8161900 msgr2=0x7f4ba80ce290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:34:27.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:27.304+0000 7f4ba6ffd640 1 --2- 172.21.15.78:0/3393912410 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4ba8161900 0x7f4ba80ce290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:27.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:27.304+0000 7f4ba6ffd640 1 -- 172.21.15.78:0/3393912410 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ba00094d0 con 0x7f4ba81401a0 2023-12-12T17:34:27.315 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:27.304+0000 7f4ba6ffd640 1 --2- 172.21.15.78:0/3393912410 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4ba81401a0 0x7f4ba813ed70 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f4b9800c820 tx=0x7f4b9800cce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T17:34:27.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:27.304+0000 7f4b9ffff640 1 -- 172.21.15.78:0/3393912410 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b98003b80 con 0x7f4ba81401a0 2023-12-12T17:34:27.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:27.304+0000 7f4b9ffff640 1 -- 172.21.15.78:0/3393912410 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b98003ce0 con 0x7f4ba81401a0 2023-12-12T17:34:27.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:27.304+0000 7f4bad52a640 1 -- 172.21.15.78:0/3393912410 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ba813dcd0 con 0x7f4ba81401a0 2023-12-12T17:34:27.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:27.304+0000 7f4b9ffff640 1 -- 172.21.15.78:0/3393912410 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b9800aa90 con 0x7f4ba81401a0 2023-12-12T17:34:27.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:27.304+0000 7f4bad52a640 1 -- 172.21.15.78:0/3393912410 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ba813e290 con 0x7f4ba81401a0 2023-12-12T17:34:27.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:27.308+0000 7f4b9ffff640 1 -- 172.21.15.78:0/3393912410 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4b9800abf0 con 0x7f4ba81401a0 2023-12-12T17:34:27.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:27.308+0000 7f4b9ffff640 1 --2- 172.21.15.78:0/3393912410 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f4b88066470 0x7f4b88068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:34:27.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:27.308+0000 7f4b9ffff640 1 -- 172.21.15.78:0/3393912410 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f4b980840b0 con 0x7f4ba81401a0 2023-12-12T17:34:27.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:27.308+0000 7f4b9e7fc640 1 --2- 172.21.15.78:0/3393912410 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f4b88066470 0x7f4b88068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:34:27.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:27.308+0000 7f4b9e7fc640 1 --2- 172.21.15.78:0/3393912410 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f4b88066470 0x7f4b88068930 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f4b90006fd0 tx=0x7f4b90006b40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T17:34:27.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:27.312+0000 7f4bad52a640 1 -- 172.21.15.78:0/3393912410 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ba80671f0 con 0x7f4ba81401a0 2023-12-12T17:34:27.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:27.500+0000 7f4b9ffff640 1 -- 172.21.15.78:0/3393912410 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4b980512a0 con 0x7f4ba81401a0 2023-12-12T17:34:28.494 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:28.488+0000 7f4bad52a640 1 -- 172.21.15.78:0/3393912410 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4ba8067530 con 0x7f4ba81401a0 2023-12-12T17:34:28.543 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:28.536+0000 7f4b9ffff640 1 -- 172.21.15.78:0/3393912410 <== mon.2 v2:172.21.15.187:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4913 (secure 0 0 0) 0x7f4b980548c0 con 0x7f4ba81401a0 2023-12-12T17:34:28.544 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T17:34:28.544 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5024,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/142991070","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":142991070},{"type":"v1","addr":"172.21.15.187:6835","nonce":142991070}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5374,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/1159092364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":1159092364},{"type":"v1","addr":"172.21.15.187:6834","nonce":1159092364}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5469,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6836/314422656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":314422656},{"type":"v1","addr":"172.21.15.78:6836","nonce":314422656}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-12T10:13:31.320201+0000","modified":"2023-12-12T10:13:34.407772+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5472":{"gid":5472,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.78:6837/4134128104","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":4134128104},{"type":"v1","addr":"172.21.15.78:6837","nonce":4134128104}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-12T17:34:28.544 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 17 2023-12-12T17:34:28.549 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:28.544+0000 7f4bad52a640 1 -- 172.21.15.78:0/3393912410 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f4b88066470 msgr2=0x7f4b88068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:34:28.549 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:28.544+0000 7f4bad52a640 1 --2- 172.21.15.78:0/3393912410 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f4b88066470 0x7f4b88068930 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f4b90006fd0 tx=0x7f4b90006b40 comp rx=0 tx=0).stop 2023-12-12T17:34:28.549 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:28.544+0000 7f4bad52a640 1 -- 172.21.15.78:0/3393912410 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4ba81401a0 msgr2=0x7f4ba813ed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:34:28.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:28.544+0000 7f4bad52a640 1 --2- 172.21.15.78:0/3393912410 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4ba81401a0 0x7f4ba813ed70 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f4b9800c820 tx=0x7f4b9800cce0 comp rx=0 tx=0).stop 2023-12-12T17:34:28.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:28.544+0000 7f4bad52a640 1 -- 172.21.15.78:0/3393912410 shutdown_connections 2023-12-12T17:34:28.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:28.544+0000 7f4bad52a640 1 --2- 172.21.15.78:0/3393912410 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f4b88066470 0x7f4b88068930 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:28.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:28.544+0000 7f4bad52a640 1 --2- 172.21.15.78:0/3393912410 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4ba8161900 0x7f4ba80ce290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:28.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:28.544+0000 7f4bad52a640 1 --2- 172.21.15.78:0/3393912410 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4ba8161210 0x7f4ba80cc410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:28.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:28.544+0000 7f4bad52a640 1 --2- 172.21.15.78:0/3393912410 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4ba81401a0 0x7f4ba813ed70 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:28.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:28.544+0000 7f4bad52a640 1 -- 172.21.15.78:0/3393912410 >> 172.21.15.78:0/3393912410 conn(0x7f4ba806c5d0 msgr2=0x7f4ba80af480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T17:34:28.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:28.544+0000 7f4bad52a640 1 -- 172.21.15.78:0/3393912410 shutdown_connections 2023-12-12T17:34:28.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:28.544+0000 7f4bad52a640 1 -- 172.21.15.78:0/3393912410 wait complete. 2023-12-12T17:34:28.635 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T17:34:28.889 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:28.884+0000 7f3ae7fff640 1 Processor -- start 2023-12-12T17:34:28.892 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:28.884+0000 7f3ae7fff640 1 -- start start 2023-12-12T17:34:28.895 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:28.888+0000 7f3ae7fff640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3ae8142800 0x7f3ae8071460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:34:28.895 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:28.888+0000 7f3ae7fff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f3ae80719a0 0x7f3ae815a600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:34:28.896 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:28.888+0000 7f3ae7fff640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ae8070400 con 0x7f3ae806b060 2023-12-12T17:34:28.896 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:28.888+0000 7f3ae7fff640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ae80706a0 con 0x7f3ae80719a0 2023-12-12T17:34:28.897 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:28.892+0000 7f3ae7fff640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae8070980 con 0x7f3ae8142800 2023-12-12T17:34:28.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:28.892+0000 7f3ae6ffd640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3ae8142800 0x7f3ae8071460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:34:28.900 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:28.892+0000 7f3ae67fc640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f3ae80719a0 0x7f3ae815a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:34:28.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:28.892+0000 7f3ae67fc640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f3ae80719a0 0x7f3ae815a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49396/0 (socket says 172.21.15.78:49396) 2023-12-12T17:34:28.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:28.892+0000 7f3ae67fc640 1 -- 172.21.15.78:0/3528208914 learned_addr learned my addr 172.21.15.78:0/3528208914 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T17:34:28.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:28.892+0000 7f3ae67fc640 1 -- 172.21.15.78:0/3528208914 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3ae8142800 msgr2=0x7f3ae8071460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T17:34:28.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:28.892+0000 7f3ae67fc640 1 --2- 172.21.15.78:0/3528208914 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3ae8142800 0x7f3ae8071460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:28.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:28.892+0000 7f3ae67fc640 1 -- 172.21.15.78:0/3528208914 >> v1:172.21.15.187:6789/0 conn(0x7f3ae806b060 legacy=0x7f3ae81597d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:34:28.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:28.892+0000 7f3ae67fc640 1 -- 172.21.15.78:0/3528208914 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ae8070c60 con 0x7f3ae80719a0 2023-12-12T17:34:28.904 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:28.900+0000 7f3ae67fc640 1 --2- 172.21.15.78:0/3528208914 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ae80719a0 0x7f3ae815a600 secure :-1 s=READY pgs=2099 cs=0 l=1 rev1=1 crypto rx=0x7f3ad0009870 tx=0x7f3ad001c550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10fc146e6752c684 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T17:34:28.905 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:28.900+0000 7f3ae5ffb640 1 -- 172.21.15.78:0/3528208914 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ad00ab620 con 0x7f3ae80719a0 2023-12-12T17:34:28.908 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:28.900+0000 7f3ae5ffb640 1 -- 172.21.15.78:0/3528208914 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ad00ab780 con 0x7f3ae80719a0 2023-12-12T17:34:28.908 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:28.900+0000 7f3ae7fff640 1 -- 172.21.15.78:0/3528208914 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ae80719a0 msgr2=0x7f3ae815a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:34:28.908 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:28.904+0000 7f3ae5ffb640 1 -- 172.21.15.78:0/3528208914 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ad00abb10 con 0x7f3ae80719a0 2023-12-12T17:34:28.913 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:28.908+0000 7f3ae7fff640 1 --2- 172.21.15.78:0/3528208914 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ae80719a0 0x7f3ae815a600 secure :-1 s=READY pgs=2099 cs=0 l=1 rev1=1 crypto rx=0x7f3ad0009870 tx=0x7f3ad001c550 comp rx=0 tx=0).stop 2023-12-12T17:34:28.915 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:28.908+0000 7f3ae7fff640 1 -- 172.21.15.78:0/3528208914 shutdown_connections 2023-12-12T17:34:28.915 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:28.908+0000 7f3ae7fff640 1 --2- 172.21.15.78:0/3528208914 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ae80719a0 0x7f3ae815a600 unknown :-1 s=CLOSED pgs=2099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:28.915 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:28.908+0000 7f3ae7fff640 1 --2- 172.21.15.78:0/3528208914 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3ae8142800 0x7f3ae8071460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:28.915 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:28.908+0000 7f3ae7fff640 1 -- 172.21.15.78:0/3528208914 >> 172.21.15.78:0/3528208914 conn(0x7f3ae806a540 msgr2=0x7f3ae806a950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T17:34:28.915 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:28.908+0000 7f3ae7fff640 1 -- 172.21.15.78:0/3528208914 shutdown_connections 2023-12-12T17:34:28.920 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:28.908+0000 7f3ae7fff640 1 -- 172.21.15.78:0/3528208914 wait complete. 2023-12-12T17:34:28.922 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:28.916+0000 7f3ae7fff640 1 Processor -- start 2023-12-12T17:34:28.923 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:28.916+0000 7f3ae7fff640 1 -- start start 2023-12-12T17:34:28.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:28.920+0000 7f3ae7fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ae806b060 0x7f3ae8137450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:34:28.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:28.920+0000 7f3ae7fff640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3ae80719a0 0x7f3ae8164a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:34:28.929 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:28.920+0000 7f3ae7fff640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3ae8142800 0x7f3ae8164fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:34:28.929 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:28.920+0000 7f3ae7fff640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae80cc510 con 0x7f3ae806b060 2023-12-12T17:34:28.929 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:28.920+0000 7f3ae7fff640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae80cc7f0 con 0x7f3ae80719a0 2023-12-12T17:34:28.931 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:28.920+0000 7f3ae7fff640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae80ccad0 con 0x7f3ae8142800 2023-12-12T17:34:28.931 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:28.924+0000 7f3ae6ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ae806b060 0x7f3ae8137450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:34:28.931 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:28.924+0000 7f3ae6ffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ae806b060 0x7f3ae8137450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:49410/0 (socket says 172.21.15.78:49410) 2023-12-12T17:34:28.931 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:28.924+0000 7f3ae6ffd640 1 -- 172.21.15.78:0/4225264956 learned_addr learned my addr 172.21.15.78:0/4225264956 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T17:34:28.931 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:28.924+0000 7f3ae6ffd640 1 -- 172.21.15.78:0/4225264956 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3ae8142800 msgr2=0x7f3ae8164fc0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-12-12T17:34:28.931 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:28.924+0000 7f3ae6ffd640 1 --2- 172.21.15.78:0/4225264956 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3ae8142800 0x7f3ae8164fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:28.931 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:28.924+0000 7f3ae6ffd640 1 -- 172.21.15.78:0/4225264956 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3ae80719a0 msgr2=0x7f3ae8164a80 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-12-12T17:34:28.931 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:28.924+0000 7f3ae6ffd640 1 --2- 172.21.15.78:0/4225264956 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3ae80719a0 0x7f3ae8164a80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:28.931 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:28.924+0000 7f3ae6ffd640 1 -- 172.21.15.78:0/4225264956 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ad00094d0 con 0x7f3ae806b060 2023-12-12T17:34:28.931 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:28.924+0000 7f3ae6ffd640 1 --2- 172.21.15.78:0/4225264956 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ae806b060 0x7f3ae8137450 secure :-1 s=READY pgs=2100 cs=0 l=1 rev1=1 crypto rx=0x7f3ad8007e40 tx=0x7f3ad800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T17:34:28.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:28.928+0000 7f3adf7fe640 1 -- 172.21.15.78:0/4225264956 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ad8014620 con 0x7f3ae806b060 2023-12-12T17:34:28.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:28.928+0000 7f3adf7fe640 1 -- 172.21.15.78:0/4225264956 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ad800ee90 con 0x7f3ae806b060 2023-12-12T17:34:28.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:28.928+0000 7f3adf7fe640 1 -- 172.21.15.78:0/4225264956 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ad8014980 con 0x7f3ae806b060 2023-12-12T17:34:28.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:28.928+0000 7f3ae7fff640 1 -- 172.21.15.78:0/4225264956 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ae80ccdb0 con 0x7f3ae806b060 2023-12-12T17:34:28.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:28.928+0000 7f3ae7fff640 1 -- 172.21.15.78:0/4225264956 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ae80cc1d0 con 0x7f3ae806b060 2023-12-12T17:34:28.944 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:28.932+0000 7f3ae7fff640 1 -- 172.21.15.78:0/4225264956 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ae80671f0 con 0x7f3ae806b060 2023-12-12T17:34:28.944 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:28.936+0000 7f3adf7fe640 1 -- 172.21.15.78:0/4225264956 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3ad8014ae0 con 0x7f3ae806b060 2023-12-12T17:34:28.947 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:28.940+0000 7f3adf7fe640 1 --2- 172.21.15.78:0/4225264956 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f3ac8066470 0x7f3ac8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:34:28.948 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:28.944+0000 7f3adf7fe640 1 -- 172.21.15.78:0/4225264956 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f3ad8085870 con 0x7f3ae806b060 2023-12-12T17:34:28.950 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:28.944+0000 7f3ae67fc640 1 --2- 172.21.15.78:0/4225264956 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f3ac8066470 0x7f3ac8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:34:28.952 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:28.948+0000 7f3ae67fc640 1 --2- 172.21.15.78:0/4225264956 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f3ac8066470 0x7f3ac8068930 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f3ad00af000 tx=0x7f3ad0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T17:34:29.170 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:29.164+0000 7f3adf7fe640 1 -- 172.21.15.78:0/4225264956 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3ad8052b70 con 0x7f3ae806b060 2023-12-12T17:34:29.609 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:29.600+0000 7f3ae7fff640 1 -- 172.21.15.78:0/4225264956 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3ae8074610 con 0x7f3ae806b060 2023-12-12T17:34:29.663 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:29.652+0000 7f3adf7fe640 1 -- 172.21.15.78:0/4225264956 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+16787 (secure 0 0 0) 0x7f3ad8056190 con 0x7f3ae806b060 2023-12-12T17:34:29.670 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T17:34:29.670 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":41,"fsid":"fc81937c-bd26-483c-952b-d1324fcb0c9e","created":"2023-12-12T10:11:44.020214+0000","modified":"2023-12-12T10:13:50.935087+0000","last_up_change":"2023-12-12T10:11:56.278318+0000","last_in_change":"2023-12-12T10:11:46.553610+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T10:11:57.053584+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-12-12T10:13:29.004403+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-12-12T10:13:30.321623+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"22dfdedf-5f6c-4b20-9f6c-30517a1db70a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6809","nonce":3345683600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6811","nonce":3345683600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6815","nonce":3345683600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6813","nonce":3345683600}]},"public_addr":"172.21.15.78:6809/3345683600","cluster_addr":"172.21.15.78:6811/3345683600","heartbeat_back_addr":"172.21.15.78:6815/3345683600","heartbeat_front_addr":"172.21.15.78:6813/3345683600","state":["exists","up"]},{"osd":1,"uuid":"be34a7f3-a69a-462e-9ddf-5e537448dba2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6801","nonce":962652768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6803","nonce":962652768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6807","nonce":962652768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6805","nonce":962652768}]},"public_addr":"172.21.15.78:6801/962652768","cluster_addr":"172.21.15.78:6803/962652768","heartbeat_back_addr":"172.21.15.78:6807/962652768","heartbeat_front_addr":"172.21.15.78:6805/962652768","state":["exists","up"]},{"osd":2,"uuid":"55b381de-5f56-4b14-80f7-e6e41e084a13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6818","nonce":2910206054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6822","nonce":2910206054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6829","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6831","nonce":2910206054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6826","nonce":2910206054}]},"public_addr":"172.21.15.78:6818/2910206054","cluster_addr":"172.21.15.78:6822/2910206054","heartbeat_back_addr":"172.21.15.78:6831/2910206054","heartbeat_front_addr":"172.21.15.78:6826/2910206054","state":["exists","up"]},{"osd":3,"uuid":"d7682de1-25cb-4cec-869f-8851c28b0e6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6819","nonce":3750796703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6821","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6823","nonce":3750796703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6830","nonce":3750796703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6825","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6827","nonce":3750796703}]},"public_addr":"172.21.15.78:6819/3750796703","cluster_addr":"172.21.15.78:6823/3750796703","heartbeat_back_addr":"172.21.15.78:6830/3750796703","heartbeat_front_addr":"172.21.15.78:6827/3750796703","state":["exists","up"]},{"osd":4,"uuid":"8279815a-d6c7-4199-871e-d28971b9dc07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6809","nonce":2944277204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6811","nonce":2944277204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6815","nonce":2944277204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6813","nonce":2944277204}]},"public_addr":"172.21.15.187:6809/2944277204","cluster_addr":"172.21.15.187:6811/2944277204","heartbeat_back_addr":"172.21.15.187:6815/2944277204","heartbeat_front_addr":"172.21.15.187:6813/2944277204","state":["exists","up"]},{"osd":5,"uuid":"0a714c65-f8ce-4340-968f-11a799677ef3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6801","nonce":185858620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6803","nonce":185858620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6807","nonce":185858620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6805","nonce":185858620}]},"public_addr":"172.21.15.187:6801/185858620","cluster_addr":"172.21.15.187:6803/185858620","heartbeat_back_addr":"172.21.15.187:6807/185858620","heartbeat_front_addr":"172.21.15.187:6805/185858620","state":["exists","up"]},{"osd":6,"uuid":"d0bba9ab-f7ee-449e-8999-1c0cf7e6d53c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6817","nonce":4213392126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6819","nonce":4213392126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6824","nonce":4213392126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6821","nonce":4213392126}]},"public_addr":"172.21.15.187:6817/4213392126","cluster_addr":"172.21.15.187:6819/4213392126","heartbeat_back_addr":"172.21.15.187:6824/4213392126","heartbeat_front_addr":"172.21.15.187:6821/4213392126","state":["exists","up"]},{"osd":7,"uuid":"efe5e0d9-2f87-4889-a27a-e2a95a632302","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6823","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6825","nonce":85774004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6827","nonce":85774004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6831","nonce":85774004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6829","nonce":85774004}]},"public_addr":"172.21.15.187:6825/85774004","cluster_addr":"172.21.15.187:6827/85774004","heartbeat_back_addr":"172.21.15.187:6831/85774004","heartbeat_front_addr":"172.21.15.187:6829/85774004","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.214447+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.448899+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.293107+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.564184+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.175026+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.097717+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.261141+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.287681+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.26","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T17:34:29.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:29.672+0000 7f3ae7fff640 1 -- 172.21.15.78:0/4225264956 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f3ac8066470 msgr2=0x7f3ac8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:34:29.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:29.672+0000 7f3ae7fff640 1 --2- 172.21.15.78:0/4225264956 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f3ac8066470 0x7f3ac8068930 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f3ad00af000 tx=0x7f3ad0008040 comp rx=0 tx=0).stop 2023-12-12T17:34:29.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:29.672+0000 7f3ae7fff640 1 -- 172.21.15.78:0/4225264956 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ae806b060 msgr2=0x7f3ae8137450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:34:29.678 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:29.672+0000 7f3ae7fff640 1 --2- 172.21.15.78:0/4225264956 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ae806b060 0x7f3ae8137450 secure :-1 s=READY pgs=2100 cs=0 l=1 rev1=1 crypto rx=0x7f3ad8007e40 tx=0x7f3ad800e4b0 comp rx=0 tx=0).stop 2023-12-12T17:34:29.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:29.672+0000 7f3ae7fff640 1 -- 172.21.15.78:0/4225264956 shutdown_connections 2023-12-12T17:34:29.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:29.672+0000 7f3ae7fff640 1 --2- 172.21.15.78:0/4225264956 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f3ac8066470 0x7f3ac8068930 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:29.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:29.672+0000 7f3ae7fff640 1 --2- 172.21.15.78:0/4225264956 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3ae8142800 0x7f3ae8164fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:29.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:29.672+0000 7f3ae7fff640 1 --2- 172.21.15.78:0/4225264956 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3ae80719a0 0x7f3ae8164a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:29.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:29.672+0000 7f3ae7fff640 1 --2- 172.21.15.78:0/4225264956 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3ae806b060 0x7f3ae8137450 unknown :-1 s=CLOSED pgs=2100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:29.679 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:29.672+0000 7f3ae7fff640 1 -- 172.21.15.78:0/4225264956 >> 172.21.15.78:0/4225264956 conn(0x7f3ae806a540 msgr2=0x7f3ae806d5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T17:34:29.680 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:29.676+0000 7f3ae7fff640 1 -- 172.21.15.78:0/4225264956 shutdown_connections 2023-12-12T17:34:29.681 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:29.676+0000 7f3ae7fff640 1 -- 172.21.15.78:0/4225264956 wait complete. 2023-12-12T17:34:29.713 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-12T10:11:57.053584+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-12T10:13:29.004403+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-12-12T10:13:30.321623+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-12T17:34:29.713 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-12T17:34:30.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.012+0000 7f452d279640 1 Processor -- start 2023-12-12T17:34:30.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.012+0000 7f452d279640 1 -- start start 2023-12-12T17:34:30.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.016+0000 7f452d279640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f4528161600 0x7f452806b170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:34:30.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.016+0000 7f452d279640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f452806bae0 con 0x7f45280b4f60 2023-12-12T17:34:30.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.020+0000 7f452d279640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f452806bdc0 con 0x7f45280b09d0 2023-12-12T17:34:30.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.020+0000 7f452d279640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45280ac2b0 con 0x7f4528161600 2023-12-12T17:34:30.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.020+0000 7f45277fe640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f45280b09d0 0x7f45280acd90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.78:51514/0 (socket says 172.21.15.78:51514) 2023-12-12T17:34:30.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.020+0000 7f45277fe640 1 -- 172.21.15.78:0/982445001 learned_addr learned my addr 172.21.15.78:0/982445001 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-12-12T17:34:30.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.020+0000 7f4526ffd640 1 --2- 172.21.15.78:0/982445001 >> v2:172.21.15.187:3300/0 conn(0x7f4528161600 0x7f452806b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:34:30.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.020+0000 7f4525ffb640 1 -- 172.21.15.78:0/982445001 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4079860827 0 0) 0x7f452806bdc0 con 0x7f45280b09d0 2023-12-12T17:34:30.027 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.020+0000 7f4525ffb640 1 -- 172.21.15.78:0/982445001 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4510003530 con 0x7f45280b09d0 2023-12-12T17:34:30.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.020+0000 7f4525ffb640 1 -- 172.21.15.78:0/982445001 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2246214801 0 0) 0x7f452806bae0 con 0x7f45280b4f60 2023-12-12T17:34:30.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.020+0000 7f4525ffb640 1 -- 172.21.15.78:0/982445001 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f452806bdc0 con 0x7f45280b4f60 2023-12-12T17:34:30.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.020+0000 7f4525ffb640 1 -- 172.21.15.78:0/982445001 <== mon.1 v1:172.21.15.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1979207978 0 0) 0x7f4510003530 con 0x7f45280b09d0 2023-12-12T17:34:30.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.020+0000 7f4525ffb640 1 -- 172.21.15.78:0/982445001 >> v2:172.21.15.187:3300/0 conn(0x7f4528161600 msgr2=0x7f452806b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T17:34:30.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.020+0000 7f4525ffb640 1 --2- 172.21.15.78:0/982445001 >> v2:172.21.15.187:3300/0 conn(0x7f4528161600 0x7f452806b170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:30.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.020+0000 7f4525ffb640 1 -- 172.21.15.78:0/982445001 >> v1:172.21.15.78:6789/0 conn(0x7f45280b4f60 legacy=0x7f45280b02c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:34:30.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.020+0000 7f4525ffb640 1 -- 172.21.15.78:0/982445001 --> v1:172.21.15.187:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45280ac590 con 0x7f45280b09d0 2023-12-12T17:34:30.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.020+0000 7f4525ffb640 1 -- 172.21.15.78:0/982445001 <== mon.1 v1:172.21.15.187:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 465499599 0 0) 0x7f4520001a00 con 0x7f45280b09d0 2023-12-12T17:34:30.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.020+0000 7f4525ffb640 1 -- 172.21.15.78:0/982445001 >> v1:172.21.15.187:6789/0 conn(0x7f45280b09d0 legacy=0x7f45280acd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:34:30.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.020+0000 7f4525ffb640 1 --2- 172.21.15.78:0/982445001 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4510003b10 0x7f4510003f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:34:30.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.020+0000 7f4525ffb640 1 --2- 172.21.15.78:0/982445001 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f45100047d0 0x7f4510004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:34:30.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.020+0000 7f4525ffb640 1 --2- 172.21.15.78:0/982445001 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4510005190 0x7f451000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:34:30.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.020+0000 7f4525ffb640 1 -- 172.21.15.78:0/982445001 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45280ac2b0 con 0x7f4510003b10 2023-12-12T17:34:30.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.020+0000 7f4525ffb640 1 -- 172.21.15.78:0/982445001 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f451000c0c0 con 0x7f45100047d0 2023-12-12T17:34:30.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.020+0000 7f4525ffb640 1 -- 172.21.15.78:0/982445001 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f451000c280 con 0x7f4510005190 2023-12-12T17:34:30.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.024+0000 7f4526ffd640 1 --2- 172.21.15.78:0/982445001 >> v2:172.21.15.187:3300/0 conn(0x7f4528161600 0x7f452806b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-12T17:34:30.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.024+0000 7f45267fc640 1 --2- 172.21.15.78:0/982445001 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f45100047d0 0x7f4510004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:34:30.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.024+0000 7f45267fc640 1 -- 172.21.15.78:0/982445001 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4510005190 msgr2=0x7f451000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T17:34:30.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.024+0000 7f45277fe640 1 --2- 172.21.15.78:0/982445001 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4510005190 0x7f451000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:34:30.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.024+0000 7f4526ffd640 1 --2- 172.21.15.78:0/982445001 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4510003b10 0x7f4510003f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:34:30.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.024+0000 7f45267fc640 1 --2- 172.21.15.78:0/982445001 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4510005190 0x7f451000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:30.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.024+0000 7f45267fc640 1 -- 172.21.15.78:0/982445001 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4510003b10 msgr2=0x7f4510003f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T17:34:30.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.024+0000 7f45267fc640 1 --2- 172.21.15.78:0/982445001 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4510003b10 0x7f4510003f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:30.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.024+0000 7f45267fc640 1 -- 172.21.15.78:0/982445001 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45280ac590 con 0x7f45100047d0 2023-12-12T17:34:30.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.024+0000 7f4526ffd640 1 --2- 172.21.15.78:0/982445001 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4510003b10 0x7f4510003f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T17:34:30.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.024+0000 7f45277fe640 1 --2- 172.21.15.78:0/982445001 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4510005190 0x7f451000b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T17:34:30.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.024+0000 7f45277fe640 1 -- 172.21.15.78:0/982445001 reap_dead start 2023-12-12T17:34:30.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.036+0000 7f45267fc640 1 --2- 172.21.15.78:0/982445001 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f45100047d0 0x7f4510004c50 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f451c0018c0 tx=0x7f451c01c4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5c32cc0525172f43 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T17:34:30.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.036+0000 7f4525ffb640 1 -- 172.21.15.78:0/982445001 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f451c0052d0 con 0x7f45100047d0 2023-12-12T17:34:30.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.036+0000 7f4525ffb640 1 -- 172.21.15.78:0/982445001 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f451c005450 con 0x7f45100047d0 2023-12-12T17:34:30.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.036+0000 7f4525ffb640 1 -- 172.21.15.78:0/982445001 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f451c007260 con 0x7f45100047d0 2023-12-12T17:34:30.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.036+0000 7f452d279640 1 -- 172.21.15.78:0/982445001 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f45100047d0 msgr2=0x7f4510004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:34:30.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.036+0000 7f452d279640 1 --2- 172.21.15.78:0/982445001 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f45100047d0 0x7f4510004c50 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f451c0018c0 tx=0x7f451c01c4b0 comp rx=0 tx=0).stop 2023-12-12T17:34:30.044 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.040+0000 7f452d279640 1 -- 172.21.15.78:0/982445001 shutdown_connections 2023-12-12T17:34:30.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.040+0000 7f452d279640 1 --2- 172.21.15.78:0/982445001 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f45100047d0 0x7f4510004c50 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:30.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.040+0000 7f452d279640 1 -- 172.21.15.78:0/982445001 >> 172.21.15.78:0/982445001 conn(0x7f45280b4100 msgr2=0x7f45280b47c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T17:34:30.045 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.040+0000 7f452d279640 1 -- 172.21.15.78:0/982445001 shutdown_connections 2023-12-12T17:34:30.046 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.040+0000 7f452d279640 1 -- 172.21.15.78:0/982445001 wait complete. 2023-12-12T17:34:30.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.044+0000 7f452d279640 1 Processor -- start 2023-12-12T17:34:30.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.044+0000 7f452d279640 1 -- start start 2023-12-12T17:34:30.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.044+0000 7f452d279640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f45100047d0 0x7f4528146530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:34:30.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.044+0000 7f452d279640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4528156660 0x7f452815d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:34:30.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.044+0000 7f452d279640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f45281644b0 0x7f452815c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:34:30.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.044+0000 7f452d279640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f452815eb30 con 0x7f45281644b0 2023-12-12T17:34:30.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.044+0000 7f452d279640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f452815df20 con 0x7f45100047d0 2023-12-12T17:34:30.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.044+0000 7f452d279640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f452815e200 con 0x7f4528156660 2023-12-12T17:34:30.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.044+0000 7f4526ffd640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f45100047d0 0x7f4528146530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:34:30.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.044+0000 7f4526ffd640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f45100047d0 0x7f4528146530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.78:52712/0 (socket says 172.21.15.78:52712) 2023-12-12T17:34:30.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.044+0000 7f4526ffd640 1 -- 172.21.15.78:0/1496013462 learned_addr learned my addr 172.21.15.78:0/1496013462 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T17:34:30.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.044+0000 7f45267fc640 1 --2- 172.21.15.78:0/1496013462 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4528156660 0x7f452815d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:34:30.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.044+0000 7f45277fe640 1 --2- 172.21.15.78:0/1496013462 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f45281644b0 0x7f452815c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:34:30.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.044+0000 7f4526ffd640 1 -- 172.21.15.78:0/1496013462 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4528156660 msgr2=0x7f452815d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:34:30.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.044+0000 7f4526ffd640 1 --2- 172.21.15.78:0/1496013462 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4528156660 0x7f452815d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:30.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.044+0000 7f4526ffd640 1 -- 172.21.15.78:0/1496013462 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f45281644b0 msgr2=0x7f452815c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:34:30.057 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.044+0000 7f4526ffd640 1 --2- 172.21.15.78:0/1496013462 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f45281644b0 0x7f452815c490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:30.057 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.044+0000 7f4526ffd640 1 -- 172.21.15.78:0/1496013462 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f452815e4e0 con 0x7f45100047d0 2023-12-12T17:34:30.057 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.048+0000 7f45267fc640 1 --2- 172.21.15.78:0/1496013462 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4528156660 0x7f452815d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T17:34:30.057 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.048+0000 7f4526ffd640 1 --2- 172.21.15.78:0/1496013462 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f45100047d0 0x7f4528146530 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f4518010900 tx=0x7f4518010dc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T17:34:30.057 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.052+0000 7f450f7fe640 1 -- 172.21.15.78:0/1496013462 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f451800ec20 con 0x7f45100047d0 2023-12-12T17:34:30.057 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.052+0000 7f450f7fe640 1 -- 172.21.15.78:0/1496013462 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f451800ed80 con 0x7f45100047d0 2023-12-12T17:34:30.058 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.052+0000 7f450f7fe640 1 -- 172.21.15.78:0/1496013462 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f451801c620 con 0x7f45100047d0 2023-12-12T17:34:30.059 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.052+0000 7f452d279640 1 -- 172.21.15.78:0/1496013462 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f452815e7c0 con 0x7f45100047d0 2023-12-12T17:34:30.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.052+0000 7f452d279640 1 -- 172.21.15.78:0/1496013462 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f452815dc30 con 0x7f45100047d0 2023-12-12T17:34:30.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.060+0000 7f452d279640 1 -- 172.21.15.78:0/1496013462 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f452815e950 con 0x7f45100047d0 2023-12-12T17:34:30.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.060+0000 7f450f7fe640 1 -- 172.21.15.78:0/1496013462 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f451801c780 con 0x7f45100047d0 2023-12-12T17:34:30.069 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.064+0000 7f450f7fe640 1 --2- 172.21.15.78:0/1496013462 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f45140664f0 0x7f45140689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:34:30.069 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.064+0000 7f450f7fe640 1 -- 172.21.15.78:0/1496013462 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f45180845f0 con 0x7f45100047d0 2023-12-12T17:34:30.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.068+0000 7f45267fc640 1 --2- 172.21.15.78:0/1496013462 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f45140664f0 0x7f45140689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:34:30.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.076+0000 7f45267fc640 1 --2- 172.21.15.78:0/1496013462 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f45140664f0 0x7f45140689b0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f45280b5380 tx=0x7f451c001350 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T17:34:30.153 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.148+0000 7f450f7fe640 1 -- 172.21.15.78:0/1496013462 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f45180518f0 con 0x7f45100047d0 2023-12-12T17:34:30.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.400+0000 7f452d279640 1 -- 172.21.15.78:0/1496013462 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4528074610 con 0x7f45100047d0 2023-12-12T17:34:30.484 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.476+0000 7f450f7fe640 1 -- 172.21.15.78:0/1496013462 <== mon.1 v2:172.21.15.187:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v41) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4518054f10 con 0x7f45100047d0 2023-12-12T17:34:30.485 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 1 2023-12-12T17:34:30.490 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.484+0000 7f452d279640 1 -- 172.21.15.78:0/1496013462 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f45140664f0 msgr2=0x7f45140689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:34:30.491 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.484+0000 7f452d279640 1 --2- 172.21.15.78:0/1496013462 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f45140664f0 0x7f45140689b0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f45280b5380 tx=0x7f451c001350 comp rx=0 tx=0).stop 2023-12-12T17:34:30.491 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.484+0000 7f452d279640 1 -- 172.21.15.78:0/1496013462 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f45100047d0 msgr2=0x7f4528146530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:34:30.491 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.484+0000 7f452d279640 1 --2- 172.21.15.78:0/1496013462 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f45100047d0 0x7f4528146530 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f4518010900 tx=0x7f4518010dc0 comp rx=0 tx=0).stop 2023-12-12T17:34:30.491 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.484+0000 7f452d279640 1 -- 172.21.15.78:0/1496013462 shutdown_connections 2023-12-12T17:34:30.491 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.484+0000 7f452d279640 1 --2- 172.21.15.78:0/1496013462 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f45140664f0 0x7f45140689b0 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:30.491 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.484+0000 7f452d279640 1 --2- 172.21.15.78:0/1496013462 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f45281644b0 0x7f452815c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:30.491 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.484+0000 7f452d279640 1 --2- 172.21.15.78:0/1496013462 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4528156660 0x7f452815d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:30.492 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.484+0000 7f452d279640 1 --2- 172.21.15.78:0/1496013462 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f45100047d0 0x7f4528146530 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:30.492 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.484+0000 7f452d279640 1 -- 172.21.15.78:0/1496013462 >> 172.21.15.78:0/1496013462 conn(0x7f45280b4100 msgr2=0x7f452806a540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T17:34:30.492 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.484+0000 7f452d279640 1 -- 172.21.15.78:0/1496013462 shutdown_connections 2023-12-12T17:34:30.492 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.484+0000 7f452d279640 1 -- 172.21.15.78:0/1496013462 wait complete. 2023-12-12T17:34:30.551 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-12T17:34:30.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.796+0000 7f92b5617640 1 Processor -- start 2023-12-12T17:34:30.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.796+0000 7f92b5617640 1 -- start start 2023-12-12T17:34:30.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.800+0000 7f92b5617640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f92b00720e0 0x7f92b006a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:34:30.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.800+0000 7f92b5617640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f92b006abb0 0x7f92b015d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:34:30.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.800+0000 7f92b5617640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92b00b5660 con 0x7f92b015cc80 2023-12-12T17:34:30.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.800+0000 7f92b5617640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92b015d5a0 con 0x7f92b00720e0 2023-12-12T17:34:30.807 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.800+0000 7f92b5617640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92b00b4460 con 0x7f92b006abb0 2023-12-12T17:34:30.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.800+0000 7f92ae7fc640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f92b00720e0 0x7f92b006a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:34:30.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.800+0000 7f92ae7fc640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f92b00720e0 0x7f92b006a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52966/0 (socket says 172.21.15.78:52966) 2023-12-12T17:34:30.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.800+0000 7f92ae7fc640 1 -- 172.21.15.78:0/3047416235 learned_addr learned my addr 172.21.15.78:0/3047416235 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T17:34:30.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.800+0000 7f92ae7fc640 1 -- 172.21.15.78:0/3047416235 >> v2:172.21.15.187:3300/0 conn(0x7f92b006abb0 msgr2=0x7f92b015d060 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-12T17:34:30.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.800+0000 7f92ae7fc640 1 --2- 172.21.15.78:0/3047416235 >> v2:172.21.15.187:3300/0 conn(0x7f92b006abb0 0x7f92b015d060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:30.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.800+0000 7f92ae7fc640 1 -- 172.21.15.78:0/3047416235 >> v1:172.21.15.187:6789/0 conn(0x7f92b015cc80 legacy=0x7f92b00719d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T17:34:30.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.800+0000 7f92ae7fc640 1 -- 172.21.15.78:0/3047416235 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92b006b170 con 0x7f92b00720e0 2023-12-12T17:34:30.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.804+0000 7f92ae7fc640 1 --2- 172.21.15.78:0/3047416235 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f92b00720e0 0x7f92b006a540 secure :-1 s=READY pgs=2102 cs=0 l=1 rev1=1 crypto rx=0x7f92b006c860 tx=0x7f92a401c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7d2e1534c464a82 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T17:34:30.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.808+0000 7f92adffb640 1 -- 172.21.15.78:0/3047416235 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92a40aa610 con 0x7f92b00720e0 2023-12-12T17:34:30.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.808+0000 7f92adffb640 1 -- 172.21.15.78:0/3047416235 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92a40a6040 con 0x7f92b00720e0 2023-12-12T17:34:30.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.808+0000 7f92adffb640 1 -- 172.21.15.78:0/3047416235 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92a40aa990 con 0x7f92b00720e0 2023-12-12T17:34:30.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.808+0000 7f92b5617640 1 -- 172.21.15.78:0/3047416235 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f92b00720e0 msgr2=0x7f92b006a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:34:30.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.808+0000 7f92b5617640 1 --2- 172.21.15.78:0/3047416235 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f92b00720e0 0x7f92b006a540 secure :-1 s=READY pgs=2102 cs=0 l=1 rev1=1 crypto rx=0x7f92b006c860 tx=0x7f92a401c4b0 comp rx=0 tx=0).stop 2023-12-12T17:34:30.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.808+0000 7f92b5617640 1 -- 172.21.15.78:0/3047416235 shutdown_connections 2023-12-12T17:34:30.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.808+0000 7f92b5617640 1 --2- 172.21.15.78:0/3047416235 >> v2:172.21.15.187:3300/0 conn(0x7f92b006abb0 0x7f92b015d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:30.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.808+0000 7f92b5617640 1 --2- 172.21.15.78:0/3047416235 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f92b00720e0 0x7f92b006a540 unknown :-1 s=CLOSED pgs=2102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:30.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.808+0000 7f92b5617640 1 -- 172.21.15.78:0/3047416235 >> 172.21.15.78:0/3047416235 conn(0x7f92b00b2150 msgr2=0x7f92b00b2560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T17:34:30.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.808+0000 7f92b5617640 1 -- 172.21.15.78:0/3047416235 shutdown_connections 2023-12-12T17:34:30.814 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.808+0000 7f92b5617640 1 -- 172.21.15.78:0/3047416235 wait complete. 2023-12-12T17:34:30.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.808+0000 7f92b5617640 1 Processor -- start 2023-12-12T17:34:30.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.808+0000 7f92b5617640 1 -- start start 2023-12-12T17:34:30.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.812+0000 7f92b5617640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f92b006abb0 0x7f92b015ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:34:30.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.812+0000 7f92b5617640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f92b00720e0 0x7f92b014a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:34:30.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.812+0000 7f92b5617640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f92b015cc80 0x7f92b014ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:34:30.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.812+0000 7f92b5617640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92b0152330 con 0x7f92b006abb0 2023-12-12T17:34:30.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.812+0000 7f92b5617640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92b0152610 con 0x7f92b00720e0 2023-12-12T17:34:30.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.812+0000 7f92b5617640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92b01528f0 con 0x7f92b015cc80 2023-12-12T17:34:30.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.812+0000 7f92aeffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f92b006abb0 0x7f92b015ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:34:30.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.812+0000 7f92aeffd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f92b006abb0 0x7f92b015ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:52980/0 (socket says 172.21.15.78:52980) 2023-12-12T17:34:30.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.812+0000 7f92aeffd640 1 -- 172.21.15.78:0/3432407840 learned_addr learned my addr 172.21.15.78:0/3432407840 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T17:34:30.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.812+0000 7f92affff640 1 --2- 172.21.15.78:0/3432407840 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f92b015cc80 0x7f92b014ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:34:30.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.812+0000 7f92aeffd640 1 -- 172.21.15.78:0/3432407840 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f92b015cc80 msgr2=0x7f92b014ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:34:30.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.812+0000 7f92aeffd640 1 --2- 172.21.15.78:0/3432407840 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f92b015cc80 0x7f92b014ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:30.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.812+0000 7f92aeffd640 1 -- 172.21.15.78:0/3432407840 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f92b00720e0 msgr2=0x7f92b014a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:34:30.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.812+0000 7f92ae7fc640 1 --2- 172.21.15.78:0/3432407840 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f92b00720e0 0x7f92b014a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:34:30.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.812+0000 7f92aeffd640 1 --2- 172.21.15.78:0/3432407840 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f92b00720e0 0x7f92b014a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:30.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.812+0000 7f92aeffd640 1 -- 172.21.15.78:0/3432407840 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92a40094d0 con 0x7f92b006abb0 2023-12-12T17:34:30.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.812+0000 7f92aeffd640 1 --2- 172.21.15.78:0/3432407840 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f92b006abb0 0x7f92b015ef40 secure :-1 s=READY pgs=2103 cs=0 l=1 rev1=1 crypto rx=0x7f92a000b410 tx=0x7f92a000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T17:34:30.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.816+0000 7f92ae7fc640 1 --2- 172.21.15.78:0/3432407840 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f92b00720e0 0x7f92b014a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T17:34:30.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.820+0000 7f92977fe640 1 -- 172.21.15.78:0/3432407840 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92a0004020 con 0x7f92b006abb0 2023-12-12T17:34:30.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.820+0000 7f92977fe640 1 -- 172.21.15.78:0/3432407840 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92a0004180 con 0x7f92b006abb0 2023-12-12T17:34:30.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.820+0000 7f92977fe640 1 -- 172.21.15.78:0/3432407840 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92a0011630 con 0x7f92b006abb0 2023-12-12T17:34:30.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.820+0000 7f92b5617640 1 -- 172.21.15.78:0/3432407840 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92b0152bd0 con 0x7f92b006abb0 2023-12-12T17:34:30.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.820+0000 7f92b5617640 1 -- 172.21.15.78:0/3432407840 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92b015f650 con 0x7f92b006abb0 2023-12-12T17:34:30.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.824+0000 7f92b5617640 1 -- 172.21.15.78:0/3432407840 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92b00671f0 con 0x7f92b006abb0 2023-12-12T17:34:30.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.832+0000 7f92977fe640 1 -- 172.21.15.78:0/3432407840 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f92a0011790 con 0x7f92b006abb0 2023-12-12T17:34:30.843 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.836+0000 7f92977fe640 1 --2- 172.21.15.78:0/3432407840 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f929c0664c0 0x7f929c068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:34:30.843 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.836+0000 7f92977fe640 1 -- 172.21.15.78:0/3432407840 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f92a0084330 con 0x7f92b006abb0 2023-12-12T17:34:30.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.840+0000 7f92ae7fc640 1 --2- 172.21.15.78:0/3432407840 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f929c0664c0 0x7f929c068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:34:30.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.844+0000 7f92ae7fc640 1 --2- 172.21.15.78:0/3432407840 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f929c0664c0 0x7f929c068980 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f92a40ae000 tx=0x7f92a4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T17:34:30.895 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:30.888+0000 7f92977fe640 1 -- 172.21.15.78:0/3432407840 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f92a00517c0 con 0x7f92b006abb0 2023-12-12T17:34:31.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:31.772+0000 7f92b5617640 1 -- 172.21.15.78:0/3432407840 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f92b00ccee0 con 0x7f92b006abb0 2023-12-12T17:34:31.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:31.816+0000 7f92977fe640 1 -- 172.21.15.78:0/3432407840 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v41) v1 ==== 104+0+11 (secure 0 0 0) 0x7f92a0054de0 con 0x7f92b006abb0 2023-12-12T17:34:31.828 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 32 2023-12-12T17:34:31.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:31.824+0000 7f92b5617640 1 -- 172.21.15.78:0/3432407840 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f929c0664c0 msgr2=0x7f929c068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:34:31.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:31.824+0000 7f92b5617640 1 --2- 172.21.15.78:0/3432407840 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f929c0664c0 0x7f929c068980 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f92a40ae000 tx=0x7f92a4008040 comp rx=0 tx=0).stop 2023-12-12T17:34:31.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:31.824+0000 7f92b5617640 1 -- 172.21.15.78:0/3432407840 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f92b006abb0 msgr2=0x7f92b015ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:34:31.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:31.824+0000 7f92b5617640 1 --2- 172.21.15.78:0/3432407840 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f92b006abb0 0x7f92b015ef40 secure :-1 s=READY pgs=2103 cs=0 l=1 rev1=1 crypto rx=0x7f92a000b410 tx=0x7f92a000b8d0 comp rx=0 tx=0).stop 2023-12-12T17:34:31.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:31.828+0000 7f92b5617640 1 -- 172.21.15.78:0/3432407840 shutdown_connections 2023-12-12T17:34:31.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:31.828+0000 7f92b5617640 1 --2- 172.21.15.78:0/3432407840 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f929c0664c0 0x7f929c068980 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:31.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:31.828+0000 7f92b5617640 1 --2- 172.21.15.78:0/3432407840 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f92b015cc80 0x7f92b014ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:31.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:31.828+0000 7f92b5617640 1 --2- 172.21.15.78:0/3432407840 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f92b00720e0 0x7f92b014a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:31.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:31.828+0000 7f92b5617640 1 --2- 172.21.15.78:0/3432407840 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f92b006abb0 0x7f92b015ef40 unknown :-1 s=CLOSED pgs=2103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:31.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:31.828+0000 7f92b5617640 1 -- 172.21.15.78:0/3432407840 >> 172.21.15.78:0/3432407840 conn(0x7f92b00b2150 msgr2=0x7f92b015e570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T17:34:31.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:31.828+0000 7f92b5617640 1 -- 172.21.15.78:0/3432407840 shutdown_connections 2023-12-12T17:34:31.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:31.828+0000 7f92b5617640 1 -- 172.21.15.78:0/3432407840 wait complete. 2023-12-12T17:34:31.903 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-12T17:34:32.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:32.124+0000 7f592ddc1640 1 Processor -- start 2023-12-12T17:34:32.132 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:32.128+0000 7f592ddc1640 1 -- start start 2023-12-12T17:34:32.137 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:32.132+0000 7f592ddc1640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f592809a120 0x7f59280cef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:34:32.138 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:32.132+0000 7f592ddc1640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59280cbe70 con 0x7f592806d2e0 2023-12-12T17:34:32.139 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:32.132+0000 7f592ddc1640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59280d0300 con 0x7f592806e540 2023-12-12T17:34:32.139 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:32.132+0000 7f592ddc1640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59280cd310 con 0x7f592809a120 2023-12-12T17:34:32.139 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:32.132+0000 7f59277fe640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f592806d2e0 0x7f5928099a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:34998/0 (socket says 172.21.15.78:34998) 2023-12-12T17:34:32.139 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:32.132+0000 7f59277fe640 1 -- 172.21.15.78:0/3160888630 learned_addr learned my addr 172.21.15.78:0/3160888630 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-12-12T17:34:32.139 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:32.132+0000 7f5926ffd640 1 --2- 172.21.15.78:0/3160888630 >> v2:172.21.15.78:3300/0 conn(0x7f592809a120 0x7f59280cef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:34:32.139 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:32.132+0000 7f59267fc640 1 -- 172.21.15.78:0/3160888630 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 213827001 0 0) 0x7f59280cbe70 con 0x7f592806d2e0 2023-12-12T17:34:32.140 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:32.132+0000 7f59267fc640 1 -- 172.21.15.78:0/3160888630 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5914003530 con 0x7f592806d2e0 2023-12-12T17:34:32.140 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:32.132+0000 7f59267fc640 1 -- 172.21.15.78:0/3160888630 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 296567521 0 0) 0x7f59280d0300 con 0x7f592806e540 2023-12-12T17:34:32.140 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:32.132+0000 7f59267fc640 1 -- 172.21.15.78:0/3160888630 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59280cbe70 con 0x7f592806e540 2023-12-12T17:34:32.140 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:32.132+0000 7f59267fc640 1 -- 172.21.15.78:0/3160888630 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2263622171 0 0) 0x7f5914003530 con 0x7f592806d2e0 2023-12-12T17:34:32.140 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:32.132+0000 7f59267fc640 1 -- 172.21.15.78:0/3160888630 >> v2:172.21.15.78:3300/0 conn(0x7f592809a120 msgr2=0x7f59280cef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T17:34:32.140 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:32.132+0000 7f59267fc640 1 --2- 172.21.15.78:0/3160888630 >> v2:172.21.15.78:3300/0 conn(0x7f592809a120 0x7f59280cef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:32.140 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:32.132+0000 7f59267fc640 1 -- 172.21.15.78:0/3160888630 >> v1:172.21.15.187:6789/0 conn(0x7f592806e540 legacy=0x7f592806e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:34:32.140 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:32.132+0000 7f59267fc640 1 -- 172.21.15.78:0/3160888630 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59280cb540 con 0x7f592806d2e0 2023-12-12T17:34:32.140 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:32.132+0000 7f59267fc640 1 -- 172.21.15.78:0/3160888630 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 465499599 0 0) 0x7f5920001a00 con 0x7f592806d2e0 2023-12-12T17:34:32.141 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:32.136+0000 7f59267fc640 1 -- 172.21.15.78:0/3160888630 >> v1:172.21.15.78:6789/0 conn(0x7f592806d2e0 legacy=0x7f5928099a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:34:32.141 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:32.136+0000 7f59267fc640 1 --2- 172.21.15.78:0/3160888630 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5914004ba0 0x7f5914004f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:34:32.141 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:32.136+0000 7f59267fc640 1 --2- 172.21.15.78:0/3160888630 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5914003770 0x7f5914003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:34:32.141 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:32.136+0000 7f59267fc640 1 --2- 172.21.15.78:0/3160888630 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5914004130 0x7f591400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:34:32.141 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:32.136+0000 7f59267fc640 1 -- 172.21.15.78:0/3160888630 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5918001240 con 0x7f5914003770 2023-12-12T17:34:32.142 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:32.136+0000 7f59267fc640 1 -- 172.21.15.78:0/3160888630 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59280cd310 con 0x7f5914004ba0 2023-12-12T17:34:32.142 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:32.136+0000 7f59267fc640 1 -- 172.21.15.78:0/3160888630 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f591400c1b0 con 0x7f5914004130 2023-12-12T17:34:32.142 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:32.136+0000 7f59277fe640 1 --2- 172.21.15.78:0/3160888630 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5914004ba0 0x7f5914004f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:34:32.142 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:32.136+0000 7f5927fff640 1 --2- 172.21.15.78:0/3160888630 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5914004130 0x7f591400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:34:32.142 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:32.136+0000 7f5926ffd640 1 --2- 172.21.15.78:0/3160888630 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5914003770 0x7f5914003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:34:32.142 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:32.136+0000 7f5927fff640 1 -- 172.21.15.78:0/3160888630 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5914004ba0 msgr2=0x7f5914004f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T17:34:32.142 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:32.136+0000 7f5927fff640 1 --2- 172.21.15.78:0/3160888630 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5914004ba0 0x7f5914004f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:32.142 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:32.136+0000 7f5927fff640 1 -- 172.21.15.78:0/3160888630 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5914003770 msgr2=0x7f5914003bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T17:34:32.143 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:32.136+0000 7f5927fff640 1 --2- 172.21.15.78:0/3160888630 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5914003770 0x7f5914003bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:32.143 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:32.136+0000 7f5927fff640 1 -- 172.21.15.78:0/3160888630 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5914003530 con 0x7f5914004130 2023-12-12T17:34:32.143 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:32.136+0000 7f5926ffd640 1 --2- 172.21.15.78:0/3160888630 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5914003770 0x7f5914003bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T17:34:32.153 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:32.148+0000 7f5927fff640 1 -- 172.21.15.78:0/3160888630 reap_dead start 2023-12-12T17:34:32.153 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:32.148+0000 7f5927fff640 1 --2- 172.21.15.78:0/3160888630 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5914004130 0x7f591400b990 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f5918007ed0 tx=0x7f591801f170 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1b858fadcd21f02e server_cookie=0 in_seq=0 out_seq=0 2023-12-12T17:34:32.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:32.148+0000 7f59267fc640 1 -- 172.21.15.78:0/3160888630 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59180a8d70 con 0x7f5914004130 2023-12-12T17:34:32.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:32.148+0000 7f59267fc640 1 -- 172.21.15.78:0/3160888630 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5918005070 con 0x7f5914004130 2023-12-12T17:34:32.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:32.148+0000 7f59267fc640 1 -- 172.21.15.78:0/3160888630 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5918005400 con 0x7f5914004130 2023-12-12T17:34:32.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:32.148+0000 7f592ddc1640 1 -- 172.21.15.78:0/3160888630 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5914004130 msgr2=0x7f591400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:34:32.156 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:32.148+0000 7f592ddc1640 1 --2- 172.21.15.78:0/3160888630 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5914004130 0x7f591400b990 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f5918007ed0 tx=0x7f591801f170 comp rx=0 tx=0).stop 2023-12-12T17:34:32.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:32.152+0000 7f592ddc1640 1 -- 172.21.15.78:0/3160888630 shutdown_connections 2023-12-12T17:34:32.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:32.152+0000 7f592ddc1640 1 --2- 172.21.15.78:0/3160888630 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5914004130 0x7f591400b990 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:32.157 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:32.152+0000 7f592ddc1640 1 -- 172.21.15.78:0/3160888630 >> 172.21.15.78:0/3160888630 conn(0x7f59280d0de0 msgr2=0x7f59280d11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T17:34:32.160 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:32.156+0000 7f592ddc1640 1 -- 172.21.15.78:0/3160888630 shutdown_connections 2023-12-12T17:34:32.162 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:32.156+0000 7f592ddc1640 1 -- 172.21.15.78:0/3160888630 wait complete. 2023-12-12T17:34:32.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:32.164+0000 7f592ddc1640 1 Processor -- start 2023-12-12T17:34:32.169 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:32.164+0000 7f592ddc1640 1 -- start start 2023-12-12T17:34:32.173 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:32.168+0000 7f592ddc1640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5914004130 0x7f59280afa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:34:32.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:32.168+0000 7f592ddc1640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f592806e9d0 0x7f592806ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:34:32.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:32.168+0000 7f592ddc1640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f592815a560 0x7f592815a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:34:32.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:32.168+0000 7f592ddc1640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f592806f390 con 0x7f592806e9d0 2023-12-12T17:34:32.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:32.168+0000 7f592ddc1640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59280ae580 con 0x7f592815a560 2023-12-12T17:34:32.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:32.168+0000 7f592ddc1640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59280adc90 con 0x7f5914004130 2023-12-12T17:34:32.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:32.168+0000 7f59277fe640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5914004130 0x7f59280afa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:34:32.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:32.168+0000 7f59277fe640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5914004130 0x7f59280afa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.78:50360/0 (socket says 172.21.15.78:50360) 2023-12-12T17:34:32.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:32.168+0000 7f59277fe640 1 -- 172.21.15.78:0/295738462 learned_addr learned my addr 172.21.15.78:0/295738462 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T17:34:32.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:32.168+0000 7f5927fff640 1 --2- 172.21.15.78:0/295738462 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f592815a560 0x7f592815a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:34:32.175 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:32.168+0000 7f5926ffd640 1 --2- 172.21.15.78:0/295738462 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f592806e9d0 0x7f592806ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:34:32.176 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:32.168+0000 7f5926ffd640 1 -- 172.21.15.78:0/295738462 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5914004130 msgr2=0x7f59280afa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:34:32.176 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:32.168+0000 7f5926ffd640 1 --2- 172.21.15.78:0/295738462 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5914004130 0x7f59280afa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:32.176 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:32.168+0000 7f5926ffd640 1 -- 172.21.15.78:0/295738462 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f592815a560 msgr2=0x7f592815a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:34:32.176 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:32.168+0000 7f5926ffd640 1 --2- 172.21.15.78:0/295738462 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f592815a560 0x7f592815a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:32.176 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:32.168+0000 7f5926ffd640 1 -- 172.21.15.78:0/295738462 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59280b5df0 con 0x7f592806e9d0 2023-12-12T17:34:32.177 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:32.172+0000 7f5926ffd640 1 --2- 172.21.15.78:0/295738462 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f592806e9d0 0x7f592806ee50 secure :-1 s=READY pgs=2105 cs=0 l=1 rev1=1 crypto rx=0x7f591000f460 tx=0x7f591000f920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T17:34:32.178 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:32.172+0000 7f591ffff640 1 -- 172.21.15.78:0/295738462 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5910004440 con 0x7f592806e9d0 2023-12-12T17:34:32.178 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:32.172+0000 7f591ffff640 1 -- 172.21.15.78:0/295738462 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5910003620 con 0x7f592806e9d0 2023-12-12T17:34:32.178 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:32.172+0000 7f591ffff640 1 -- 172.21.15.78:0/295738462 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59100039d0 con 0x7f592806e9d0 2023-12-12T17:34:32.178 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:32.172+0000 7f592ddc1640 1 -- 172.21.15.78:0/295738462 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59280aea10 con 0x7f592806e9d0 2023-12-12T17:34:32.179 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:32.172+0000 7f592ddc1640 1 -- 172.21.15.78:0/295738462 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59280ae210 con 0x7f592806e9d0 2023-12-12T17:34:32.182 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:32.176+0000 7f592ddc1640 1 -- 172.21.15.78:0/295738462 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59280671f0 con 0x7f592806e9d0 2023-12-12T17:34:32.185 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:32.180+0000 7f591ffff640 1 -- 172.21.15.78:0/295738462 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5910003b30 con 0x7f592806e9d0 2023-12-12T17:34:32.187 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:32.180+0000 7f591ffff640 1 --2- 172.21.15.78:0/295738462 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f59080664c0 0x7f5908068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:34:32.188 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:32.180+0000 7f591ffff640 1 -- 172.21.15.78:0/295738462 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f59100840a0 con 0x7f592806e9d0 2023-12-12T17:34:32.189 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:32.184+0000 7f59277fe640 1 --2- 172.21.15.78:0/295738462 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f59080664c0 0x7f5908068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:34:32.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:32.184+0000 7f59277fe640 1 --2- 172.21.15.78:0/295738462 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f59080664c0 0x7f5908068980 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f59200020c0 tx=0x7f5920006040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T17:34:32.196 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:32.188+0000 7f591ffff640 1 -- 172.21.15.78:0/295738462 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f59100513a0 con 0x7f592806e9d0 2023-12-12T17:34:33.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:33.016+0000 7f592ddc1640 1 -- 172.21.15.78:0/295738462 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5928067530 con 0x7f592806e9d0 2023-12-12T17:34:33.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:33.016+0000 7f591ffff640 1 -- 172.21.15.78:0/295738462 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v41) v1 ==== 100+0+11 (secure 0 0 0) 0x7f59100549c0 con 0x7f592806e9d0 2023-12-12T17:34:33.024 INFO:teuthology.orchestra.run.smithi078.stdout:pg_num: 64 2023-12-12T17:34:33.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:33.020+0000 7f592ddc1640 1 -- 172.21.15.78:0/295738462 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f59080664c0 msgr2=0x7f5908068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:34:33.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:33.020+0000 7f592ddc1640 1 --2- 172.21.15.78:0/295738462 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f59080664c0 0x7f5908068980 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f59200020c0 tx=0x7f5920006040 comp rx=0 tx=0).stop 2023-12-12T17:34:33.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:33.024+0000 7f592ddc1640 1 -- 172.21.15.78:0/295738462 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f592806e9d0 msgr2=0x7f592806ee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:34:33.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:33.024+0000 7f592ddc1640 1 --2- 172.21.15.78:0/295738462 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f592806e9d0 0x7f592806ee50 secure :-1 s=READY pgs=2105 cs=0 l=1 rev1=1 crypto rx=0x7f591000f460 tx=0x7f591000f920 comp rx=0 tx=0).stop 2023-12-12T17:34:33.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:33.024+0000 7f592ddc1640 1 -- 172.21.15.78:0/295738462 shutdown_connections 2023-12-12T17:34:33.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:33.024+0000 7f592ddc1640 1 --2- 172.21.15.78:0/295738462 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f59080664c0 0x7f5908068980 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:33.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:33.024+0000 7f592ddc1640 1 --2- 172.21.15.78:0/295738462 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f592815a560 0x7f592815a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:33.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:33.024+0000 7f592ddc1640 1 --2- 172.21.15.78:0/295738462 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f592806e9d0 0x7f592806ee50 unknown :-1 s=CLOSED pgs=2105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:33.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:33.024+0000 7f592ddc1640 1 --2- 172.21.15.78:0/295738462 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5914004130 0x7f59280afa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:33.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:33.024+0000 7f592ddc1640 1 -- 172.21.15.78:0/295738462 >> 172.21.15.78:0/295738462 conn(0x7f59280d0de0 msgr2=0x7f5928099a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T17:34:33.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:33.024+0000 7f592ddc1640 1 -- 172.21.15.78:0/295738462 shutdown_connections 2023-12-12T17:34:33.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:33.024+0000 7f592ddc1640 1 -- 172.21.15.78:0/295738462 wait complete. 2023-12-12T17:34:33.096 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-12T17:34:33.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:33.648+0000 7f64323d8640 1 Processor -- start 2023-12-12T17:34:33.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:33.648+0000 7f64323d8640 1 -- start start 2023-12-12T17:34:33.661 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:33.656+0000 7f64323d8640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f642c143720 0x7f642c0b1db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:34:33.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:33.656+0000 7f64323d8640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f642c0ac9b0 con 0x7f642c06dcf0 2023-12-12T17:34:33.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:33.656+0000 7f64323d8640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f642c0acc90 con 0x7f642c0b22f0 2023-12-12T17:34:33.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:33.656+0000 7f64323d8640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f642c161bf0 con 0x7f642c143720 2023-12-12T17:34:33.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:33.656+0000 7f642b7fe640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f642c0b22f0 0x7f642c06d5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.78:51548/0 (socket says 172.21.15.78:51548) 2023-12-12T17:34:33.664 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:33.656+0000 7f642b7fe640 1 -- 172.21.15.78:0/2394449296 learned_addr learned my addr 172.21.15.78:0/2394449296 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-12-12T17:34:33.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:33.660+0000 7f642affd640 1 -- 172.21.15.78:0/2394449296 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2034873787 0 0) 0x7f642c0acc90 con 0x7f642c0b22f0 2023-12-12T17:34:33.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:33.660+0000 7f642affd640 1 -- 172.21.15.78:0/2394449296 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6418003530 con 0x7f642c0b22f0 2023-12-12T17:34:33.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:33.660+0000 7f642bfff640 1 --2- 172.21.15.78:0/2394449296 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f642c143720 0x7f642c0b1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:34:33.665 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:33.660+0000 7f642affd640 1 -- 172.21.15.78:0/2394449296 <== mon.1 v1:172.21.15.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 643249686 0 0) 0x7f6418003530 con 0x7f642c0b22f0 2023-12-12T17:34:33.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:33.660+0000 7f642affd640 1 -- 172.21.15.78:0/2394449296 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f642c143720 msgr2=0x7f642c0b1db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T17:34:33.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:33.660+0000 7f642affd640 1 --2- 172.21.15.78:0/2394449296 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f642c143720 0x7f642c0b1db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:33.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:33.660+0000 7f642affd640 1 -- 172.21.15.78:0/2394449296 >> v1:172.21.15.78:6789/0 conn(0x7f642c06dcf0 legacy=0x7f642c0b3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:34:33.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:33.660+0000 7f642affd640 1 -- 172.21.15.78:0/2394449296 --> v1:172.21.15.187:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f642c0acf70 con 0x7f642c0b22f0 2023-12-12T17:34:33.666 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:33.660+0000 7f642affd640 1 -- 172.21.15.78:0/2394449296 <== mon.1 v1:172.21.15.187:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 465499599 0 0) 0x7f6414001680 con 0x7f642c0b22f0 2023-12-12T17:34:33.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:33.660+0000 7f642affd640 1 -- 172.21.15.78:0/2394449296 >> v1:172.21.15.187:6789/0 conn(0x7f642c0b22f0 legacy=0x7f642c06d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:34:33.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:33.660+0000 7f642affd640 1 --2- 172.21.15.78:0/2394449296 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6418003980 0x7f6418003d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:34:33.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:33.660+0000 7f642affd640 1 --2- 172.21.15.78:0/2394449296 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f642c143720 0x7f64180047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:34:33.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:33.660+0000 7f642affd640 1 --2- 172.21.15.78:0/2394449296 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6418004d10 0x7f6418005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:34:33.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:33.660+0000 7f642affd640 1 -- 172.21.15.78:0/2394449296 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f642c161bf0 con 0x7f6418004d10 2023-12-12T17:34:33.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:33.660+0000 7f642affd640 1 -- 172.21.15.78:0/2394449296 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f641800b990 con 0x7f6418003980 2023-12-12T17:34:33.669 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:33.660+0000 7f642affd640 1 -- 172.21.15.78:0/2394449296 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f641800bb50 con 0x7f642c143720 2023-12-12T17:34:33.671 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:33.664+0000 7f642bfff640 1 --2- 172.21.15.78:0/2394449296 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6418003980 0x7f6418003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:34:33.676 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:33.664+0000 7f6430975640 1 --2- 172.21.15.78:0/2394449296 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6418004d10 0x7f6418005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:34:33.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:33.664+0000 7f642bfff640 1 -- 172.21.15.78:0/2394449296 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f642c143720 msgr2=0x7f64180047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T17:34:33.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:33.664+0000 7f642bfff640 1 --2- 172.21.15.78:0/2394449296 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f642c143720 0x7f64180047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:33.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:33.664+0000 7f642bfff640 1 -- 172.21.15.78:0/2394449296 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6418004d10 msgr2=0x7f6418005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T17:34:33.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:33.664+0000 7f642bfff640 1 --2- 172.21.15.78:0/2394449296 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6418004d10 0x7f6418005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:33.677 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:33.664+0000 7f642bfff640 1 -- 172.21.15.78:0/2394449296 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6418003530 con 0x7f6418003980 2023-12-12T17:34:33.687 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:33.680+0000 7f642bfff640 1 --2- 172.21.15.78:0/2394449296 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6418003980 0x7f6418003d60 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f642400e170 tx=0x7f642401cca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b4e0a4243cf0e6c7 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T17:34:33.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:33.680+0000 7f642affd640 1 -- 172.21.15.78:0/2394449296 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64240a5a70 con 0x7f6418003980 2023-12-12T17:34:33.688 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:33.684+0000 7f642affd640 1 -- 172.21.15.78:0/2394449296 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f642400f040 con 0x7f6418003980 2023-12-12T17:34:33.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:33.684+0000 7f64323d8640 1 -- 172.21.15.78:0/2394449296 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6418003980 msgr2=0x7f6418003d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:34:33.690 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:33.684+0000 7f64323d8640 1 --2- 172.21.15.78:0/2394449296 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6418003980 0x7f6418003d60 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f642400e170 tx=0x7f642401cca0 comp rx=0 tx=0).stop 2023-12-12T17:34:33.691 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:33.684+0000 7f6430975640 1 -- 172.21.15.78:0/2394449296 reap_dead start 2023-12-12T17:34:33.692 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:33.688+0000 7f64323d8640 1 -- 172.21.15.78:0/2394449296 shutdown_connections 2023-12-12T17:34:33.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:33.688+0000 7f64323d8640 1 -- 172.21.15.78:0/2394449296 >> 172.21.15.78:0/2394449296 conn(0x7f642c0b0ab0 msgr2=0x7f642c0b0ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T17:34:33.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:33.688+0000 7f64323d8640 1 -- 172.21.15.78:0/2394449296 shutdown_connections 2023-12-12T17:34:33.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:33.688+0000 7f64323d8640 1 -- 172.21.15.78:0/2394449296 wait complete. 2023-12-12T17:34:33.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:33.696+0000 7f64323d8640 1 Processor -- start 2023-12-12T17:34:33.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:33.696+0000 7f64323d8640 1 -- start start 2023-12-12T17:34:33.706 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:33.700+0000 7f64323d8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6418003980 0x7f642c15c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:34:33.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:33.700+0000 7f64323d8640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f642c15f820 0x7f642c15fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:34:33.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:33.700+0000 7f64323d8640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f642c1fa230 0x7f642c1fa6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:34:33.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:33.700+0000 7f64323d8640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f642c0aab50 con 0x7f6418003980 2023-12-12T17:34:33.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:33.700+0000 7f64323d8640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f642c1601e0 con 0x7f642c15f820 2023-12-12T17:34:33.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:33.700+0000 7f64323d8640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f642c15ccd0 con 0x7f642c1fa230 2023-12-12T17:34:33.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:33.700+0000 7f6430975640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f642c1fa230 0x7f642c1fa6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:34:33.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:33.700+0000 7f6430975640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f642c1fa230 0x7f642c1fa6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.78:50384/0 (socket says 172.21.15.78:50384) 2023-12-12T17:34:33.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:33.700+0000 7f6430975640 1 -- 172.21.15.78:0/3161293383 learned_addr learned my addr 172.21.15.78:0/3161293383 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T17:34:33.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:33.700+0000 7f642b7fe640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f642c15f820 0x7f642c15fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:34:33.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:33.704+0000 7f642b7fe640 1 -- 172.21.15.78:0/3161293383 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f642c1fa230 msgr2=0x7f642c1fa6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:34:33.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:33.712+0000 7f642b7fe640 1 --2- 172.21.15.78:0/3161293383 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f642c1fa230 0x7f642c1fa6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:33.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:33.712+0000 7f642b7fe640 1 -- 172.21.15.78:0/3161293383 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6418003980 msgr2=0x7f642c15c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:34:33.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:33.712+0000 7f642b7fe640 1 --2- 172.21.15.78:0/3161293383 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6418003980 0x7f642c15c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:33.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:33.712+0000 7f642b7fe640 1 -- 172.21.15.78:0/3161293383 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f642c0a9ed0 con 0x7f642c15f820 2023-12-12T17:34:33.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:33.712+0000 7f6430975640 1 --2- 172.21.15.78:0/3161293383 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f642c1fa230 0x7f642c1fa6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-12T17:34:33.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:33.712+0000 7f642b7fe640 1 --2- 172.21.15.78:0/3161293383 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f642c15f820 0x7f642c15fca0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f641400c750 tx=0x7f641400cc10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T17:34:33.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:33.712+0000 7f6428ff9640 1 -- 172.21.15.78:0/3161293383 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6414004ba0 con 0x7f642c15f820 2023-12-12T17:34:33.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:33.712+0000 7f6428ff9640 1 -- 172.21.15.78:0/3161293383 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6414004d20 con 0x7f642c15f820 2023-12-12T17:34:33.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:33.712+0000 7f64323d8640 1 -- 172.21.15.78:0/3161293383 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f642c0aa1b0 con 0x7f642c15f820 2023-12-12T17:34:33.719 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:33.712+0000 7f64323d8640 1 -- 172.21.15.78:0/3161293383 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f642c0aa770 con 0x7f642c15f820 2023-12-12T17:34:33.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:33.712+0000 7f6428ff9640 1 -- 172.21.15.78:0/3161293383 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6414007310 con 0x7f642c15f820 2023-12-12T17:34:33.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:33.720+0000 7f6428ff9640 1 -- 172.21.15.78:0/3161293383 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6414007470 con 0x7f642c15f820 2023-12-12T17:34:33.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:33.720+0000 7f64323d8640 1 -- 172.21.15.78:0/3161293383 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6410005260 con 0x7f642c15f820 2023-12-12T17:34:33.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:33.724+0000 7f6428ff9640 1 --2- 172.21.15.78:0/3161293383 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f640c066470 0x7f640c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:34:33.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:33.724+0000 7f6428ff9640 1 -- 172.21.15.78:0/3161293383 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6414083730 con 0x7f642c15f820 2023-12-12T17:34:33.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:33.724+0000 7f642bfff640 1 --2- 172.21.15.78:0/3161293383 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f640c066470 0x7f640c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:34:33.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:33.732+0000 7f642bfff640 1 --2- 172.21.15.78:0/3161293383 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f640c066470 0x7f640c068930 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f64240af000 tx=0x7f642401b4e0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T17:34:33.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:33.736+0000 7f6428ff9640 1 -- 172.21.15.78:0/3161293383 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6414050b00 con 0x7f642c15f820 2023-12-12T17:34:34.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:34.720+0000 7f64323d8640 1 -- 172.21.15.78:0/3161293383 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6410005510 con 0x7f642c15f820 2023-12-12T17:34:34.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:34.724+0000 7f6428ff9640 1 -- 172.21.15.78:0/3161293383 <== mon.1 v2:172.21.15.187:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4913 (secure 0 0 0) 0x7f6414018090 con 0x7f642c15f820 2023-12-12T17:34:34.732 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 17 2023-12-12T17:34:34.732 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T17:34:34.732 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5024,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/142991070","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":142991070},{"type":"v1","addr":"172.21.15.187:6835","nonce":142991070}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5374,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/1159092364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":1159092364},{"type":"v1","addr":"172.21.15.187:6834","nonce":1159092364}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5469,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6836/314422656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":314422656},{"type":"v1","addr":"172.21.15.78:6836","nonce":314422656}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-12T10:13:31.320201+0000","modified":"2023-12-12T10:13:34.407772+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5472":{"gid":5472,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.78:6837/4134128104","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":4134128104},{"type":"v1","addr":"172.21.15.78:6837","nonce":4134128104}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-12T17:34:34.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:34.732+0000 7f64227fc640 1 -- 172.21.15.78:0/3161293383 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f640c066470 msgr2=0x7f640c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:34:34.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:34.732+0000 7f64227fc640 1 --2- 172.21.15.78:0/3161293383 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f640c066470 0x7f640c068930 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f64240af000 tx=0x7f642401b4e0 comp rx=0 tx=0).stop 2023-12-12T17:34:34.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:34.736+0000 7f64227fc640 1 -- 172.21.15.78:0/3161293383 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f642c15f820 msgr2=0x7f642c15fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:34:34.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:34.736+0000 7f64227fc640 1 --2- 172.21.15.78:0/3161293383 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f642c15f820 0x7f642c15fca0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f641400c750 tx=0x7f641400cc10 comp rx=0 tx=0).stop 2023-12-12T17:34:34.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:34.736+0000 7f64227fc640 1 -- 172.21.15.78:0/3161293383 shutdown_connections 2023-12-12T17:34:34.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:34.736+0000 7f64227fc640 1 --2- 172.21.15.78:0/3161293383 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f640c066470 0x7f640c068930 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:34.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:34.736+0000 7f64227fc640 1 --2- 172.21.15.78:0/3161293383 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f642c1fa230 0x7f642c1fa6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:34.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:34.736+0000 7f64227fc640 1 --2- 172.21.15.78:0/3161293383 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f642c15f820 0x7f642c15fca0 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:34.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:34.736+0000 7f64227fc640 1 --2- 172.21.15.78:0/3161293383 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f6418003980 0x7f642c15c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:34.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:34.736+0000 7f64227fc640 1 -- 172.21.15.78:0/3161293383 >> 172.21.15.78:0/3161293383 conn(0x7f642c0b0ab0 msgr2=0x7f642c142960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T17:34:34.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:34.736+0000 7f64227fc640 1 -- 172.21.15.78:0/3161293383 shutdown_connections 2023-12-12T17:34:34.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:34.736+0000 7f64227fc640 1 -- 172.21.15.78:0/3161293383 wait complete. 2023-12-12T17:34:34.830 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T17:34:35.501 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:35.488+0000 7fa1f9f01640 1 Processor -- start 2023-12-12T17:34:35.501 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:35.488+0000 7fa1f9f01640 1 -- start start 2023-12-12T17:34:35.502 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:35.496+0000 7fa1f9f01640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa1f4161440 0x7fa1f406d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:34:35.502 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:35.496+0000 7fa1f9f01640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fa1f406db20 0x7fa1f4161c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:34:35.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:35.496+0000 7fa1f2ffd640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fa1f406db20 0x7fa1f4161c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:34:35.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:35.496+0000 7fa1f2ffd640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fa1f406db20 0x7fa1f4161c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.78:52782/0 (socket says 172.21.15.78:52782) 2023-12-12T17:34:35.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:35.496+0000 7fa1f9f01640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1f41629f0 con 0x7fa1f41621c0 2023-12-12T17:34:35.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:35.496+0000 7fa1f9f01640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1f4070d20 con 0x7fa1f4161440 2023-12-12T17:34:35.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:35.496+0000 7fa1f9f01640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1f406dfb0 con 0x7fa1f406db20 2023-12-12T17:34:35.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:35.500+0000 7fa1f2ffd640 1 -- 172.21.15.78:0/264409015 learned_addr learned my addr 172.21.15.78:0/264409015 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T17:34:35.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:35.500+0000 7fa1f2ffd640 1 -- 172.21.15.78:0/264409015 >> v2:172.21.15.78:3300/0 conn(0x7fa1f4161440 msgr2=0x7fa1f406d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T17:34:35.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:35.500+0000 7fa1f2ffd640 1 --2- 172.21.15.78:0/264409015 >> v2:172.21.15.78:3300/0 conn(0x7fa1f4161440 0x7fa1f406d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:35.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:35.500+0000 7fa1f2ffd640 1 -- 172.21.15.78:0/264409015 >> v1:172.21.15.78:6789/0 conn(0x7fa1f41621c0 legacy=0x7fa1f40b1db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T17:34:35.510 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:35.500+0000 7fa1f2ffd640 1 -- 172.21.15.78:0/264409015 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1f4070380 con 0x7fa1f406db20 2023-12-12T17:34:35.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:35.516+0000 7fa1f2ffd640 1 --2- 172.21.15.78:0/264409015 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa1f406db20 0x7fa1f4161c80 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fa1f4164f70 tx=0x7fa1e401c370 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fc584e10a17d18e5 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T17:34:35.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:35.516+0000 7fa1f27fc640 1 -- 172.21.15.78:0/264409015 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1e40ab600 con 0x7fa1f406db20 2023-12-12T17:34:35.522 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:35.516+0000 7fa1f27fc640 1 -- 172.21.15.78:0/264409015 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1e40a7050 con 0x7fa1f406db20 2023-12-12T17:34:35.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:35.516+0000 7fa1f27fc640 1 -- 172.21.15.78:0/264409015 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1e40ab980 con 0x7fa1f406db20 2023-12-12T17:34:35.526 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:35.520+0000 7fa1f9f01640 1 -- 172.21.15.78:0/264409015 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa1f406db20 msgr2=0x7fa1f4161c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:34:35.526 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:35.520+0000 7fa1f9f01640 1 --2- 172.21.15.78:0/264409015 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa1f406db20 0x7fa1f4161c80 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fa1f4164f70 tx=0x7fa1e401c370 comp rx=0 tx=0).stop 2023-12-12T17:34:35.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:35.524+0000 7fa1f9f01640 1 -- 172.21.15.78:0/264409015 shutdown_connections 2023-12-12T17:34:35.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:35.524+0000 7fa1f9f01640 1 --2- 172.21.15.78:0/264409015 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa1f406db20 0x7fa1f4161c80 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:35.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:35.524+0000 7fa1f9f01640 1 --2- 172.21.15.78:0/264409015 >> v2:172.21.15.78:3300/0 conn(0x7fa1f4161440 0x7fa1f406d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:35.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:35.524+0000 7fa1f9f01640 1 -- 172.21.15.78:0/264409015 >> 172.21.15.78:0/264409015 conn(0x7fa1f40b0ab0 msgr2=0x7fa1f40b0ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T17:34:35.534 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:35.524+0000 7fa1f9f01640 1 -- 172.21.15.78:0/264409015 shutdown_connections 2023-12-12T17:34:35.535 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:35.524+0000 7fa1f9f01640 1 -- 172.21.15.78:0/264409015 wait complete. 2023-12-12T17:34:35.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:35.532+0000 7fa1f9f01640 1 Processor -- start 2023-12-12T17:34:35.539 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:35.532+0000 7fa1f9f01640 1 -- start start 2023-12-12T17:34:35.543 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:35.536+0000 7fa1f9f01640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa1f406db20 0x7fa1f4156dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:34:35.543 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:35.536+0000 7fa1f9f01640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa1f4161440 0x7fa1f4143db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:34:35.544 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:35.536+0000 7fa1f9f01640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa1f41621c0 0x7fa1f4154800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:34:35.544 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:35.536+0000 7fa1f9f01640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f4156930 con 0x7fa1f406db20 2023-12-12T17:34:35.544 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:35.536+0000 7fa1f9f01640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f41442f0 con 0x7fa1f4161440 2023-12-12T17:34:35.544 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:35.536+0000 7fa1f9f01640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f4155d20 con 0x7fa1f41621c0 2023-12-12T17:34:35.544 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:35.536+0000 7fa1f3fff640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa1f41621c0 0x7fa1f4154800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:34:35.544 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:35.540+0000 7fa1f3fff640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa1f41621c0 0x7fa1f4154800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.78:50390/0 (socket says 172.21.15.78:50390) 2023-12-12T17:34:35.544 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:35.540+0000 7fa1f2ffd640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa1f4161440 0x7fa1f4143db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:34:35.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:35.540+0000 7fa1f3fff640 1 -- 172.21.15.78:0/1446368205 learned_addr learned my addr 172.21.15.78:0/1446368205 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T17:34:35.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:35.540+0000 7fa1f2ffd640 1 -- 172.21.15.78:0/1446368205 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa1f41621c0 msgr2=0x7fa1f4154800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:34:35.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:35.540+0000 7fa1f2ffd640 1 --2- 172.21.15.78:0/1446368205 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa1f41621c0 0x7fa1f4154800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:35.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:35.540+0000 7fa1f2ffd640 1 -- 172.21.15.78:0/1446368205 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa1f406db20 msgr2=0x7fa1f4156dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:34:35.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:35.540+0000 7fa1f2ffd640 1 --2- 172.21.15.78:0/1446368205 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa1f406db20 0x7fa1f4156dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:35.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:35.540+0000 7fa1f2ffd640 1 -- 172.21.15.78:0/1446368205 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1e40094d0 con 0x7fa1f4161440 2023-12-12T17:34:35.547 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:35.540+0000 7fa1f3fff640 1 --2- 172.21.15.78:0/1446368205 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa1f41621c0 0x7fa1f4154800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-12T17:34:35.549 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:35.540+0000 7fa1f2ffd640 1 --2- 172.21.15.78:0/1446368205 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa1f4161440 0x7fa1f4143db0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fa1e40ab000 tx=0x7fa1e4019110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T17:34:35.549 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:35.544+0000 7fa1dbfff640 1 -- 172.21.15.78:0/1446368205 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1e40b4870 con 0x7fa1f4161440 2023-12-12T17:34:35.549 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:35.544+0000 7fa1dbfff640 1 -- 172.21.15.78:0/1446368205 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1e40b49d0 con 0x7fa1f4161440 2023-12-12T17:34:35.549 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:35.544+0000 7fa1dbfff640 1 -- 172.21.15.78:0/1446368205 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1e40b4d80 con 0x7fa1f4161440 2023-12-12T17:34:35.551 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:35.544+0000 7fa1f9f01640 1 -- 172.21.15.78:0/1446368205 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1f4156000 con 0x7fa1f4161440 2023-12-12T17:34:35.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:35.548+0000 7fa1f9f01640 1 -- 172.21.15.78:0/1446368205 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1f41565c0 con 0x7fa1f4161440 2023-12-12T17:34:35.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:35.552+0000 7fa1f9f01640 1 -- 172.21.15.78:0/1446368205 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1f40671f0 con 0x7fa1f4161440 2023-12-12T17:34:35.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:35.560+0000 7fa1dbfff640 1 -- 172.21.15.78:0/1446368205 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa1e40b5440 con 0x7fa1f4161440 2023-12-12T17:34:35.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:35.564+0000 7fa1dbfff640 1 --2- 172.21.15.78:0/1446368205 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fa1e0066540 0x7fa1e0068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:34:35.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:35.564+0000 7fa1dbfff640 1 -- 172.21.15.78:0/1446368205 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa1e411e4c0 con 0x7fa1f4161440 2023-12-12T17:34:35.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:35.564+0000 7fa1dbfff640 1 -- 172.21.15.78:0/1446368205 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa1e4120a30 con 0x7fa1f4161440 2023-12-12T17:34:35.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:35.564+0000 7fa1f37fe640 1 --2- 172.21.15.78:0/1446368205 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fa1e0066540 0x7fa1e0068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:34:35.579 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:35.568+0000 7fa1f37fe640 1 --2- 172.21.15.78:0/1446368205 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fa1e0066540 0x7fa1e0068a00 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec00ab90 tx=0x7fa1ec009250 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T17:34:36.220 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:36.212+0000 7fa1f9f01640 1 -- 172.21.15.78:0/1446368205 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa1f4066dd0 con 0x7fa1f4161440 2023-12-12T17:34:36.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:36.268+0000 7fa1dbfff640 1 -- 172.21.15.78:0/1446368205 <== mon.1 v2:172.21.15.187:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+16787 (secure 0 0 0) 0x7fa1e40eb850 con 0x7fa1f4161440 2023-12-12T17:34:36.276 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T17:34:36.276 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":41,"fsid":"fc81937c-bd26-483c-952b-d1324fcb0c9e","created":"2023-12-12T10:11:44.020214+0000","modified":"2023-12-12T10:13:50.935087+0000","last_up_change":"2023-12-12T10:11:56.278318+0000","last_in_change":"2023-12-12T10:11:46.553610+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T10:11:57.053584+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-12-12T10:13:29.004403+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-12-12T10:13:30.321623+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"22dfdedf-5f6c-4b20-9f6c-30517a1db70a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6809","nonce":3345683600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6811","nonce":3345683600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6815","nonce":3345683600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6813","nonce":3345683600}]},"public_addr":"172.21.15.78:6809/3345683600","cluster_addr":"172.21.15.78:6811/3345683600","heartbeat_back_addr":"172.21.15.78:6815/3345683600","heartbeat_front_addr":"172.21.15.78:6813/3345683600","state":["exists","up"]},{"osd":1,"uuid":"be34a7f3-a69a-462e-9ddf-5e537448dba2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6801","nonce":962652768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6803","nonce":962652768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6807","nonce":962652768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6805","nonce":962652768}]},"public_addr":"172.21.15.78:6801/962652768","cluster_addr":"172.21.15.78:6803/962652768","heartbeat_back_addr":"172.21.15.78:6807/962652768","heartbeat_front_addr":"172.21.15.78:6805/962652768","state":["exists","up"]},{"osd":2,"uuid":"55b381de-5f56-4b14-80f7-e6e41e084a13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6818","nonce":2910206054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6822","nonce":2910206054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6829","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6831","nonce":2910206054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6826","nonce":2910206054}]},"public_addr":"172.21.15.78:6818/2910206054","cluster_addr":"172.21.15.78:6822/2910206054","heartbeat_back_addr":"172.21.15.78:6831/2910206054","heartbeat_front_addr":"172.21.15.78:6826/2910206054","state":["exists","up"]},{"osd":3,"uuid":"d7682de1-25cb-4cec-869f-8851c28b0e6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6819","nonce":3750796703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6821","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6823","nonce":3750796703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6830","nonce":3750796703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6825","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6827","nonce":3750796703}]},"public_addr":"172.21.15.78:6819/3750796703","cluster_addr":"172.21.15.78:6823/3750796703","heartbeat_back_addr":"172.21.15.78:6830/3750796703","heartbeat_front_addr":"172.21.15.78:6827/3750796703","state":["exists","up"]},{"osd":4,"uuid":"8279815a-d6c7-4199-871e-d28971b9dc07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6809","nonce":2944277204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6811","nonce":2944277204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6815","nonce":2944277204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6813","nonce":2944277204}]},"public_addr":"172.21.15.187:6809/2944277204","cluster_addr":"172.21.15.187:6811/2944277204","heartbeat_back_addr":"172.21.15.187:6815/2944277204","heartbeat_front_addr":"172.21.15.187:6813/2944277204","state":["exists","up"]},{"osd":5,"uuid":"0a714c65-f8ce-4340-968f-11a799677ef3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6801","nonce":185858620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6803","nonce":185858620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6807","nonce":185858620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6805","nonce":185858620}]},"public_addr":"172.21.15.187:6801/185858620","cluster_addr":"172.21.15.187:6803/185858620","heartbeat_back_addr":"172.21.15.187:6807/185858620","heartbeat_front_addr":"172.21.15.187:6805/185858620","state":["exists","up"]},{"osd":6,"uuid":"d0bba9ab-f7ee-449e-8999-1c0cf7e6d53c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6817","nonce":4213392126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6819","nonce":4213392126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6824","nonce":4213392126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6821","nonce":4213392126}]},"public_addr":"172.21.15.187:6817/4213392126","cluster_addr":"172.21.15.187:6819/4213392126","heartbeat_back_addr":"172.21.15.187:6824/4213392126","heartbeat_front_addr":"172.21.15.187:6821/4213392126","state":["exists","up"]},{"osd":7,"uuid":"efe5e0d9-2f87-4889-a27a-e2a95a632302","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6823","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6825","nonce":85774004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6827","nonce":85774004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6831","nonce":85774004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6829","nonce":85774004}]},"public_addr":"172.21.15.187:6825/85774004","cluster_addr":"172.21.15.187:6827/85774004","heartbeat_back_addr":"172.21.15.187:6831/85774004","heartbeat_front_addr":"172.21.15.187:6829/85774004","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.214447+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.448899+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.293107+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.564184+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.175026+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.097717+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.261141+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.287681+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.26","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T17:34:36.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:36.276+0000 7fa1f9f01640 1 -- 172.21.15.78:0/1446368205 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fa1e0066540 msgr2=0x7fa1e0068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:34:36.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:36.276+0000 7fa1f9f01640 1 --2- 172.21.15.78:0/1446368205 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fa1e0066540 0x7fa1e0068a00 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec00ab90 tx=0x7fa1ec009250 comp rx=0 tx=0).stop 2023-12-12T17:34:36.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:36.276+0000 7fa1f9f01640 1 -- 172.21.15.78:0/1446368205 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa1f4161440 msgr2=0x7fa1f4143db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:34:36.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:36.276+0000 7fa1f9f01640 1 --2- 172.21.15.78:0/1446368205 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa1f4161440 0x7fa1f4143db0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fa1e40ab000 tx=0x7fa1e4019110 comp rx=0 tx=0).stop 2023-12-12T17:34:36.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:36.276+0000 7fa1f9f01640 1 -- 172.21.15.78:0/1446368205 shutdown_connections 2023-12-12T17:34:36.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:36.276+0000 7fa1f9f01640 1 --2- 172.21.15.78:0/1446368205 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fa1e0066540 0x7fa1e0068a00 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:36.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:36.276+0000 7fa1f9f01640 1 --2- 172.21.15.78:0/1446368205 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa1f41621c0 0x7fa1f4154800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:36.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:36.276+0000 7fa1f9f01640 1 --2- 172.21.15.78:0/1446368205 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa1f4161440 0x7fa1f4143db0 secure :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fa1e40ab000 tx=0x7fa1e4019110 comp rx=0 tx=0).stop 2023-12-12T17:34:36.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:36.276+0000 7fa1f9f01640 1 --2- 172.21.15.78:0/1446368205 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa1f406db20 0x7fa1f4156dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:36.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:36.276+0000 7fa1f9f01640 1 -- 172.21.15.78:0/1446368205 >> 172.21.15.78:0/1446368205 conn(0x7fa1f40b0ab0 msgr2=0x7fa1f40cde20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T17:34:36.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:36.280+0000 7fa1f9f01640 1 -- 172.21.15.78:0/1446368205 shutdown_connections 2023-12-12T17:34:36.286 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:36.280+0000 7fa1f9f01640 1 -- 172.21.15.78:0/1446368205 wait complete. 2023-12-12T17:34:36.387 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-12T17:34:36.388 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-12T17:34:36.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:36.803+0000 7fd8fc97d640 1 Processor -- start 2023-12-12T17:34:36.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:36.803+0000 7fd8fc97d640 1 -- start start 2023-12-12T17:34:36.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:36.807+0000 7fd8fc97d640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fd8f815b960 0x7fd8f81658e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:34:36.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:36.807+0000 7fd8fc97d640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8f8144700 con 0x7fd8f80cf300 2023-12-12T17:34:36.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:36.807+0000 7fd8fc97d640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8f8164e90 con 0x7fd8f81618a0 2023-12-12T17:34:36.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:36.807+0000 7fd8fc97d640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8f8165e20 con 0x7fd8f815b960 2023-12-12T17:34:36.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:36.811+0000 7fd8f7fff640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fd8f80cf300 0x7fd8f806c0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:35012/0 (socket says 172.21.15.78:35012) 2023-12-12T17:34:36.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:36.811+0000 7fd8f6ffd640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7fd8f81618a0 0x7fd8f80cebf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.78:51550/0 (socket says 172.21.15.78:51550) 2023-12-12T17:34:36.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:36.811+0000 7fd8f7fff640 1 -- 172.21.15.78:0/839503560 learned_addr learned my addr 172.21.15.78:0/839503560 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-12-12T17:34:36.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:36.811+0000 7fd8f67fc640 1 -- 172.21.15.78:0/839503560 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2769180781 0 0) 0x7fd8f8164e90 con 0x7fd8f81618a0 2023-12-12T17:34:36.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:36.811+0000 7fd8f67fc640 1 -- 172.21.15.78:0/839503560 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd8e0003530 con 0x7fd8f81618a0 2023-12-12T17:34:36.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:36.811+0000 7fd8f67fc640 1 -- 172.21.15.78:0/839503560 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2758636676 0 0) 0x7fd8f8144700 con 0x7fd8f80cf300 2023-12-12T17:34:36.818 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:36.811+0000 7fd8f67fc640 1 -- 172.21.15.78:0/839503560 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd8f8164e90 con 0x7fd8f80cf300 2023-12-12T17:34:36.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:36.811+0000 7fd8f67fc640 1 -- 172.21.15.78:0/839503560 <== mon.1 v1:172.21.15.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 328218103 0 0) 0x7fd8e0003530 con 0x7fd8f81618a0 2023-12-12T17:34:36.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:36.811+0000 7fd8f67fc640 1 -- 172.21.15.78:0/839503560 >> v2:172.21.15.78:3300/0 conn(0x7fd8f815b960 msgr2=0x7fd8f81658e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T17:34:36.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:36.811+0000 7fd8f67fc640 1 --2- 172.21.15.78:0/839503560 >> v2:172.21.15.78:3300/0 conn(0x7fd8f815b960 0x7fd8f81658e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:36.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:36.811+0000 7fd8f67fc640 1 -- 172.21.15.78:0/839503560 >> v1:172.21.15.78:6789/0 conn(0x7fd8f80cf300 legacy=0x7fd8f806c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:34:36.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:36.811+0000 7fd8f67fc640 1 -- 172.21.15.78:0/839503560 --> v1:172.21.15.187:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8f815bd40 con 0x7fd8f81618a0 2023-12-12T17:34:36.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:36.811+0000 7fd8f67fc640 1 -- 172.21.15.78:0/839503560 <== mon.1 v1:172.21.15.187:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 465499599 0 0) 0x7fd8e8001680 con 0x7fd8f81618a0 2023-12-12T17:34:36.819 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:36.811+0000 7fd8f67fc640 1 -- 172.21.15.78:0/839503560 >> v1:172.21.15.187:6789/0 conn(0x7fd8f81618a0 legacy=0x7fd8f80cebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:34:36.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:36.811+0000 7fd8f67fc640 1 --2- 172.21.15.78:0/839503560 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd8e0004b70 0x7fd8e0004f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:34:36.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:36.811+0000 7fd8f67fc640 1 --2- 172.21.15.78:0/839503560 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd8e0003770 0x7fd8e0003bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:34:36.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:36.811+0000 7fd8f67fc640 1 --2- 172.21.15.78:0/839503560 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8e0004250 0x7fd8e000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:34:36.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:36.811+0000 7fd8f67fc640 1 -- 172.21.15.78:0/839503560 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8ec001170 con 0x7fd8e0004250 2023-12-12T17:34:36.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:36.811+0000 7fd8f67fc640 1 -- 172.21.15.78:0/839503560 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8f8165e20 con 0x7fd8e0003770 2023-12-12T17:34:36.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:36.811+0000 7fd8f67fc640 1 -- 172.21.15.78:0/839503560 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8e000c200 con 0x7fd8e0004b70 2023-12-12T17:34:36.820 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:36.815+0000 7fd8f6ffd640 1 --2- 172.21.15.78:0/839503560 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd8e0003770 0x7fd8e0003bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:34:36.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:36.815+0000 7fd8f6ffd640 1 -- 172.21.15.78:0/839503560 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd8e0004b70 msgr2=0x7fd8e0004f50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-12-12T17:34:36.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:36.815+0000 7fd8f6ffd640 1 --2- 172.21.15.78:0/839503560 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd8e0004b70 0x7fd8e0004f50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:36.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:36.815+0000 7fd8f6ffd640 1 -- 172.21.15.78:0/839503560 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8e0004250 msgr2=0x7fd8e000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T17:34:36.821 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:36.815+0000 7fd8f6ffd640 1 --2- 172.21.15.78:0/839503560 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8e0004250 0x7fd8e000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:36.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:36.815+0000 7fd8f6ffd640 1 -- 172.21.15.78:0/839503560 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8f815bd40 con 0x7fd8e0003770 2023-12-12T17:34:36.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:36.815+0000 7fd8f7fff640 1 -- 172.21.15.78:0/839503560 reap_dead start 2023-12-12T17:34:36.829 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:36.819+0000 7fd8f6ffd640 1 --2- 172.21.15.78:0/839503560 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd8e0003770 0x7fd8e0003bf0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fd8e800c130 tx=0x7fd8e801f190 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9e967c225907f7b0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T17:34:36.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:36.819+0000 7fd8f67fc640 1 -- 172.21.15.78:0/839503560 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8e80a8db0 con 0x7fd8e0003770 2023-12-12T17:34:36.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:36.819+0000 7fd8f67fc640 1 -- 172.21.15.78:0/839503560 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8e8005820 con 0x7fd8e0003770 2023-12-12T17:34:36.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:36.819+0000 7fd8f67fc640 1 -- 172.21.15.78:0/839503560 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8e8005c50 con 0x7fd8e0003770 2023-12-12T17:34:36.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:36.823+0000 7fd8fc97d640 1 -- 172.21.15.78:0/839503560 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd8e0003770 msgr2=0x7fd8e0003bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:34:36.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:36.823+0000 7fd8fc97d640 1 --2- 172.21.15.78:0/839503560 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd8e0003770 0x7fd8e0003bf0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fd8e800c130 tx=0x7fd8e801f190 comp rx=0 tx=0).stop 2023-12-12T17:34:36.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:36.823+0000 7fd8fc97d640 1 -- 172.21.15.78:0/839503560 shutdown_connections 2023-12-12T17:34:36.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:36.823+0000 7fd8fc97d640 1 --2- 172.21.15.78:0/839503560 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd8e0003770 0x7fd8e0003bf0 secure :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fd8e800c130 tx=0x7fd8e801f190 comp rx=0 tx=0).stop 2023-12-12T17:34:36.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:36.823+0000 7fd8fc97d640 1 -- 172.21.15.78:0/839503560 >> 172.21.15.78:0/839503560 conn(0x7fd8f806a540 msgr2=0x7fd8f806a950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T17:34:36.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:36.827+0000 7fd8fc97d640 1 -- 172.21.15.78:0/839503560 shutdown_connections 2023-12-12T17:34:36.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:36.831+0000 7fd8fc97d640 1 -- 172.21.15.78:0/839503560 wait complete. 2023-12-12T17:34:36.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:36.839+0000 7fd8fc97d640 1 Processor -- start 2023-12-12T17:34:36.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:36.839+0000 7fd8fc97d640 1 -- start start 2023-12-12T17:34:36.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:36.847+0000 7fd8fc97d640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd8f8143170 0x7fd8f8141980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:34:36.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:36.847+0000 7fd8fc97d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8f814cc90 0x7fd8f8141ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:34:36.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:36.847+0000 7fd8fc97d640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd8f8143550 0x7fd8f8142400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:34:36.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:36.847+0000 7fd8fc97d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8f8147230 con 0x7fd8f814cc90 2023-12-12T17:34:36.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:36.847+0000 7fd8fc97d640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8f81413b0 con 0x7fd8f8143550 2023-12-12T17:34:36.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:36.847+0000 7fd8fc97d640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8f8146b70 con 0x7fd8f8143170 2023-12-12T17:34:36.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:36.847+0000 7fd8f77fe640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd8f8143170 0x7fd8f8141980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:34:36.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:36.847+0000 7fd8f77fe640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd8f8143170 0x7fd8f8141980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.78:50396/0 (socket says 172.21.15.78:50396) 2023-12-12T17:34:36.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:36.847+0000 7fd8f77fe640 1 -- 172.21.15.78:0/2967015362 learned_addr learned my addr 172.21.15.78:0/2967015362 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T17:34:36.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:36.847+0000 7fd8f7fff640 1 --2- 172.21.15.78:0/2967015362 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd8f8143550 0x7fd8f8142400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:34:36.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:36.847+0000 7fd8f77fe640 1 -- 172.21.15.78:0/2967015362 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd8f8143550 msgr2=0x7fd8f8142400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:34:36.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:36.847+0000 7fd8f77fe640 1 --2- 172.21.15.78:0/2967015362 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd8f8143550 0x7fd8f8142400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:36.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:36.847+0000 7fd8f77fe640 1 -- 172.21.15.78:0/2967015362 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8f814cc90 msgr2=0x7fd8f8141ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:34:36.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:36.847+0000 7fd8f77fe640 1 --2- 172.21.15.78:0/2967015362 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8f814cc90 0x7fd8f8141ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:36.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:36.847+0000 7fd8f77fe640 1 -- 172.21.15.78:0/2967015362 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8f8146e50 con 0x7fd8f8143170 2023-12-12T17:34:36.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:36.847+0000 7fd8f77fe640 1 --2- 172.21.15.78:0/2967015362 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd8f8143170 0x7fd8f8141980 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fd8f000b9c0 tx=0x7fd8f000be80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T17:34:36.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:36.847+0000 7fd8dffff640 1 -- 172.21.15.78:0/2967015362 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8f000cb20 con 0x7fd8f8143170 2023-12-12T17:34:36.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:36.847+0000 7fd8dffff640 1 -- 172.21.15.78:0/2967015362 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8f000cca0 con 0x7fd8f8143170 2023-12-12T17:34:36.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:36.847+0000 7fd8dffff640 1 -- 172.21.15.78:0/2967015362 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8f0014680 con 0x7fd8f8143170 2023-12-12T17:34:36.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:36.847+0000 7fd8fc97d640 1 -- 172.21.15.78:0/2967015362 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8f8141690 con 0x7fd8f8143170 2023-12-12T17:34:36.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:36.847+0000 7fd8fc97d640 1 -- 172.21.15.78:0/2967015362 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8f8141140 con 0x7fd8f8143170 2023-12-12T17:34:36.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:36.851+0000 7fd8dffff640 1 -- 172.21.15.78:0/2967015362 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd8f001d3b0 con 0x7fd8f8143170 2023-12-12T17:34:36.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:36.851+0000 7fd8fc97d640 1 -- 172.21.15.78:0/2967015362 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8f80671f0 con 0x7fd8f8143170 2023-12-12T17:34:36.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:36.855+0000 7fd8dffff640 1 --2- 172.21.15.78:0/2967015362 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fd8e4066470 0x7fd8e4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:34:36.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:36.855+0000 7fd8dffff640 1 -- 172.21.15.78:0/2967015362 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd8f0083f40 con 0x7fd8f8143170 2023-12-12T17:34:36.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:36.855+0000 7fd8f6ffd640 1 --2- 172.21.15.78:0/2967015362 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fd8e4066470 0x7fd8e4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:34:36.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:36.859+0000 7fd8f6ffd640 1 --2- 172.21.15.78:0/2967015362 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fd8e4066470 0x7fd8e4068930 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7fd8e80ae000 tx=0x7fd8e8001940 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T17:34:36.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:36.863+0000 7fd8dffff640 1 -- 172.21.15.78:0/2967015362 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd8f00511c0 con 0x7fd8f8143170 2023-12-12T17:34:37.171 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:37.163+0000 7fd8fc97d640 1 -- 172.21.15.78:0/2967015362 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd8f8067530 con 0x7fd8f8143170 2023-12-12T17:34:37.176 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:37.171+0000 7fd8dffff640 1 -- 172.21.15.78:0/2967015362 <== mon.2 v2:172.21.15.187:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4913 (secure 0 0 0) 0x7fd8f0019090 con 0x7fd8f8143170 2023-12-12T17:34:37.177 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T17:34:37.177 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5024,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/142991070","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":142991070},{"type":"v1","addr":"172.21.15.187:6835","nonce":142991070}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5374,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/1159092364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":1159092364},{"type":"v1","addr":"172.21.15.187:6834","nonce":1159092364}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5469,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6836/314422656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":314422656},{"type":"v1","addr":"172.21.15.78:6836","nonce":314422656}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-12T10:13:31.320201+0000","modified":"2023-12-12T10:13:34.407772+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5472":{"gid":5472,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.78:6837/4134128104","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":4134128104},{"type":"v1","addr":"172.21.15.78:6837","nonce":4134128104}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-12T17:34:37.177 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 17 2023-12-12T17:34:37.179 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:37.171+0000 7fd8fc97d640 1 -- 172.21.15.78:0/2967015362 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fd8e4066470 msgr2=0x7fd8e4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:34:37.180 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:37.171+0000 7fd8fc97d640 1 --2- 172.21.15.78:0/2967015362 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fd8e4066470 0x7fd8e4068930 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7fd8e80ae000 tx=0x7fd8e8001940 comp rx=0 tx=0).stop 2023-12-12T17:34:37.180 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:37.171+0000 7fd8fc97d640 1 -- 172.21.15.78:0/2967015362 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd8f8143170 msgr2=0x7fd8f8141980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:34:37.180 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:37.171+0000 7fd8fc97d640 1 --2- 172.21.15.78:0/2967015362 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd8f8143170 0x7fd8f8141980 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fd8f000b9c0 tx=0x7fd8f000be80 comp rx=0 tx=0).stop 2023-12-12T17:34:37.180 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:37.171+0000 7fd8fc97d640 1 -- 172.21.15.78:0/2967015362 shutdown_connections 2023-12-12T17:34:37.180 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:37.171+0000 7fd8fc97d640 1 --2- 172.21.15.78:0/2967015362 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fd8e4066470 0x7fd8e4068930 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:37.180 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:37.171+0000 7fd8fc97d640 1 --2- 172.21.15.78:0/2967015362 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd8f8143550 0x7fd8f8142400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:37.181 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:37.171+0000 7fd8fc97d640 1 --2- 172.21.15.78:0/2967015362 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd8f814cc90 0x7fd8f8141ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:37.181 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:37.171+0000 7fd8fc97d640 1 --2- 172.21.15.78:0/2967015362 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd8f8143170 0x7fd8f8141980 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:37.181 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:37.171+0000 7fd8fc97d640 1 -- 172.21.15.78:0/2967015362 >> 172.21.15.78:0/2967015362 conn(0x7fd8f806a540 msgr2=0x7fd8f8162a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T17:34:37.181 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:37.171+0000 7fd8fc97d640 1 -- 172.21.15.78:0/2967015362 shutdown_connections 2023-12-12T17:34:37.181 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:37.175+0000 7fd8fc97d640 1 -- 172.21.15.78:0/2967015362 wait complete. 2023-12-12T17:34:37.254 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-12T17:34:37.490 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:37.483+0000 7f19de9e7640 1 Processor -- start 2023-12-12T17:34:37.491 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:37.483+0000 7f19de9e7640 1 -- start start 2023-12-12T17:34:37.491 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:37.483+0000 7f19de9e7640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f19d80d1cb0 0x7f19d8167f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:34:37.492 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:37.483+0000 7f19de9e7640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19d80b3250 con 0x7f19d815d3c0 2023-12-12T17:34:37.492 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:37.483+0000 7f19de9e7640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19d80cee50 con 0x7f19d80d3b10 2023-12-12T17:34:37.492 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:37.483+0000 7f19de9e7640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19d80b2920 con 0x7f19d80d1cb0 2023-12-12T17:34:37.492 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:37.483+0000 7f19cffff640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f19d80d3b10 0x7f19d80d15a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.78:51556/0 (socket says 172.21.15.78:51556) 2023-12-12T17:34:37.492 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:37.483+0000 7f19cffff640 1 -- 172.21.15.78:0/2849779481 learned_addr learned my addr 172.21.15.78:0/2849779481 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-12-12T17:34:37.492 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:37.487+0000 7f19dcf84640 1 --2- 172.21.15.78:0/2849779481 >> v2:172.21.15.78:3300/0 conn(0x7f19d80d1cb0 0x7f19d8167f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:34:37.493 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:37.487+0000 7f19d77fe640 1 -- 172.21.15.78:0/2849779481 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2909681034 0 0) 0x7f19d80cee50 con 0x7f19d80d3b10 2023-12-12T17:34:37.493 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:37.487+0000 7f19d77fe640 1 -- 172.21.15.78:0/2849779481 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f19c4003530 con 0x7f19d80d3b10 2023-12-12T17:34:37.494 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:37.487+0000 7f19d77fe640 1 -- 172.21.15.78:0/2849779481 <== mon.1 v1:172.21.15.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2934570294 0 0) 0x7f19c4003530 con 0x7f19d80d3b10 2023-12-12T17:34:37.494 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:37.487+0000 7f19d77fe640 1 -- 172.21.15.78:0/2849779481 >> v2:172.21.15.78:3300/0 conn(0x7f19d80d1cb0 msgr2=0x7f19d8167f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T17:34:37.494 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:37.487+0000 7f19d77fe640 1 --2- 172.21.15.78:0/2849779481 >> v2:172.21.15.78:3300/0 conn(0x7f19d80d1cb0 0x7f19d8167f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:37.494 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:37.487+0000 7f19d77fe640 1 -- 172.21.15.78:0/2849779481 >> v1:172.21.15.78:6789/0 conn(0x7f19d815d3c0 legacy=0x7f19d80ce670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T17:34:37.494 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:37.487+0000 7f19d77fe640 1 -- 172.21.15.78:0/2849779481 --> v1:172.21.15.187:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19d80b2c00 con 0x7f19d80d3b10 2023-12-12T17:34:37.494 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:37.487+0000 7f19d77fe640 1 -- 172.21.15.78:0/2849779481 <== mon.1 v1:172.21.15.187:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 465499599 0 0) 0x7f19c0001680 con 0x7f19d80d3b10 2023-12-12T17:34:37.494 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:37.487+0000 7f19d77fe640 1 -- 172.21.15.78:0/2849779481 >> v1:172.21.15.187:6789/0 conn(0x7f19d80d3b10 legacy=0x7f19d80d15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:34:37.494 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:37.487+0000 7f19d77fe640 1 --2- 172.21.15.78:0/2849779481 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f19c4003980 0x7f19c4003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:34:37.494 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:37.487+0000 7f19d77fe640 1 --2- 172.21.15.78:0/2849779481 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f19c40047d0 0x7f19c4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:34:37.494 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:37.487+0000 7f19d77fe640 1 --2- 172.21.15.78:0/2849779481 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f19c4005190 0x7f19c400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:34:37.495 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:37.487+0000 7f19d77fe640 1 -- 172.21.15.78:0/2849779481 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19d80b2920 con 0x7f19c40047d0 2023-12-12T17:34:37.495 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:37.487+0000 7f19d77fe640 1 -- 172.21.15.78:0/2849779481 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19c400c0a0 con 0x7f19c4005190 2023-12-12T17:34:37.495 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:37.487+0000 7f19d77fe640 1 -- 172.21.15.78:0/2849779481 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19c400c260 con 0x7f19c4003980 2023-12-12T17:34:37.495 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:37.487+0000 7f19dcf84640 1 --2- 172.21.15.78:0/2849779481 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f19c4005190 0x7f19c400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:34:37.495 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:37.487+0000 7f19d7fff640 1 --2- 172.21.15.78:0/2849779481 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f19c4003980 0x7f19c4003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:34:37.495 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:37.487+0000 7f19cffff640 1 --2- 172.21.15.78:0/2849779481 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f19c40047d0 0x7f19c4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:34:37.495 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:37.487+0000 7f19dcf84640 1 -- 172.21.15.78:0/2849779481 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f19c4003980 msgr2=0x7f19c4003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T17:34:37.496 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:37.487+0000 7f19dcf84640 1 --2- 172.21.15.78:0/2849779481 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f19c4003980 0x7f19c4003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:37.496 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:37.487+0000 7f19dcf84640 1 -- 172.21.15.78:0/2849779481 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f19c40047d0 msgr2=0x7f19c4004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T17:34:37.496 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:37.487+0000 7f19dcf84640 1 --2- 172.21.15.78:0/2849779481 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f19c40047d0 0x7f19c4004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:37.496 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:37.487+0000 7f19dcf84640 1 -- 172.21.15.78:0/2849779481 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19d80b2c00 con 0x7f19c4005190 2023-12-12T17:34:37.496 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:37.487+0000 7f19cffff640 1 --2- 172.21.15.78:0/2849779481 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f19c40047d0 0x7f19c4004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T17:34:37.497 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:37.491+0000 7f19dcf84640 1 -- 172.21.15.78:0/2849779481 reap_dead start 2023-12-12T17:34:37.497 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:37.491+0000 7f19dcf84640 1 --2- 172.21.15.78:0/2849779481 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f19c4005190 0x7f19c400b990 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f19d808c3f0 tx=0x7f19d001ce20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b8e3a40e6ec3a288 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T17:34:37.498 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:37.491+0000 7f19d77fe640 1 -- 172.21.15.78:0/2849779481 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19d00a5d00 con 0x7f19c4005190 2023-12-12T17:34:37.498 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:37.491+0000 7f19d77fe640 1 -- 172.21.15.78:0/2849779481 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19d00a5e60 con 0x7f19c4005190 2023-12-12T17:34:37.498 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:37.491+0000 7f19d77fe640 1 -- 172.21.15.78:0/2849779481 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19d0003be0 con 0x7f19c4005190 2023-12-12T17:34:37.502 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:37.495+0000 7f19de9e7640 1 -- 172.21.15.78:0/2849779481 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f19c4005190 msgr2=0x7f19c400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:34:37.502 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:37.495+0000 7f19de9e7640 1 --2- 172.21.15.78:0/2849779481 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f19c4005190 0x7f19c400b990 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f19d808c3f0 tx=0x7f19d001ce20 comp rx=0 tx=0).stop 2023-12-12T17:34:37.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:37.503+0000 7f19de9e7640 1 -- 172.21.15.78:0/2849779481 shutdown_connections 2023-12-12T17:34:37.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:37.503+0000 7f19de9e7640 1 --2- 172.21.15.78:0/2849779481 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f19c4005190 0x7f19c400b990 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:37.509 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:37.503+0000 7f19de9e7640 1 -- 172.21.15.78:0/2849779481 >> 172.21.15.78:0/2849779481 conn(0x7f19d809c2a0 msgr2=0x7f19d80d2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T17:34:37.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:37.511+0000 7f19de9e7640 1 -- 172.21.15.78:0/2849779481 shutdown_connections 2023-12-12T17:34:37.519 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:37.511+0000 7f19de9e7640 1 -- 172.21.15.78:0/2849779481 wait complete. 2023-12-12T17:34:37.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:37.515+0000 7f19de9e7640 1 Processor -- start 2023-12-12T17:34:37.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:37.515+0000 7f19de9e7640 1 -- start start 2023-12-12T17:34:37.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:37.515+0000 7f19de9e7640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f19c4005190 0x7f19d80c80d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:34:37.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:37.515+0000 7f19de9e7640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f19d80c6a90 0x7f19d81f7940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:34:37.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:37.515+0000 7f19de9e7640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f19d81595b0 0x7f19d80c8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:34:37.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:37.515+0000 7f19de9e7640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19d80c7c40 con 0x7f19d80c6a90 2023-12-12T17:34:37.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:37.515+0000 7f19de9e7640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19d81f7e80 con 0x7f19d81595b0 2023-12-12T17:34:37.523 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:37.515+0000 7f19de9e7640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19d80c7030 con 0x7f19c4005190 2023-12-12T17:34:37.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:37.515+0000 7f19dcf84640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f19d81595b0 0x7f19d80c8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:34:37.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:37.515+0000 7f19dcf84640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f19d81595b0 0x7f19d80c8fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.78:52826/0 (socket says 172.21.15.78:52826) 2023-12-12T17:34:37.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:37.515+0000 7f19dcf84640 1 -- 172.21.15.78:0/4039324400 learned_addr learned my addr 172.21.15.78:0/4039324400 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T17:34:37.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:37.519+0000 7f19dcf84640 1 -- 172.21.15.78:0/4039324400 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f19c4005190 msgr2=0x7f19d80c80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:34:37.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:37.519+0000 7f19dcf84640 1 --2- 172.21.15.78:0/4039324400 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f19c4005190 0x7f19d80c80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:37.528 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:37.519+0000 7f19dcf84640 1 -- 172.21.15.78:0/4039324400 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f19d80c6a90 msgr2=0x7f19d81f7940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:34:37.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:37.519+0000 7f19dcf84640 1 --2- 172.21.15.78:0/4039324400 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f19d80c6a90 0x7f19d81f7940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:37.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:37.519+0000 7f19dcf84640 1 -- 172.21.15.78:0/4039324400 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19d80c7310 con 0x7f19d81595b0 2023-12-12T17:34:37.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:37.519+0000 7f19dcf84640 1 --2- 172.21.15.78:0/4039324400 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f19d81595b0 0x7f19d80c8fc0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f19d00a5fd0 tx=0x7f19d0019bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T17:34:37.529 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:37.523+0000 7f19d57fa640 1 -- 172.21.15.78:0/4039324400 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19d0004430 con 0x7f19d81595b0 2023-12-12T17:34:37.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:37.523+0000 7f19d57fa640 1 -- 172.21.15.78:0/4039324400 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19d0004590 con 0x7f19d81595b0 2023-12-12T17:34:37.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:37.523+0000 7f19d57fa640 1 -- 172.21.15.78:0/4039324400 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19d00094d0 con 0x7f19d81595b0 2023-12-12T17:34:37.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:37.523+0000 7f19de9e7640 1 -- 172.21.15.78:0/4039324400 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19d80c75f0 con 0x7f19d81595b0 2023-12-12T17:34:37.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:37.523+0000 7f19de9e7640 1 -- 172.21.15.78:0/4039324400 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19d8159a30 con 0x7f19d81595b0 2023-12-12T17:34:37.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:37.523+0000 7f19de9e7640 1 -- 172.21.15.78:0/4039324400 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19d8067530 con 0x7f19d81595b0 2023-12-12T17:34:37.544 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:37.535+0000 7f19d57fa640 1 -- 172.21.15.78:0/4039324400 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f19d00ad430 con 0x7f19d81595b0 2023-12-12T17:34:37.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:37.539+0000 7f19d57fa640 1 --2- 172.21.15.78:0/4039324400 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f19b80664c0 0x7f19b8068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:34:37.545 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:37.539+0000 7f19d57fa640 1 -- 172.21.15.78:0/4039324400 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f19d011e220 con 0x7f19d81595b0 2023-12-12T17:34:37.546 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:37.539+0000 7f19d7fff640 1 --2- 172.21.15.78:0/4039324400 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f19b80664c0 0x7f19b8068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:34:37.548 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:37.539+0000 7f19d7fff640 1 --2- 172.21.15.78:0/4039324400 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f19b80664c0 0x7f19b8068980 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f19d80b0c80 tx=0x7f19c8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T17:34:37.648 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:37.635+0000 7f19d57fa640 1 -- 172.21.15.78:0/4039324400 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f19d00eb6b0 con 0x7f19d81595b0 2023-12-12T17:34:38.713 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:38.707+0000 7f19de9e7640 1 -- 172.21.15.78:0/4039324400 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f19d80c7d80 con 0x7f19d81595b0 2023-12-12T17:34:38.713 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T17:34:38.714 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5024,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/142991070","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":142991070},{"type":"v1","addr":"172.21.15.187:6835","nonce":142991070}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5374,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/1159092364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":1159092364},{"type":"v1","addr":"172.21.15.187:6834","nonce":1159092364}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5469,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6836/314422656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":314422656},{"type":"v1","addr":"172.21.15.78:6836","nonce":314422656}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-12T10:13:31.320201+0000","modified":"2023-12-12T10:13:34.407772+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5472},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5472":{"gid":5472,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.78:6837/4134128104","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":4134128104},{"type":"v1","addr":"172.21.15.78:6837","nonce":4134128104}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-12T17:34:38.714 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 17 2023-12-12T17:34:38.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:38.707+0000 7f19d57fa640 1 -- 172.21.15.78:0/4039324400 <== mon.1 v2:172.21.15.187:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4913 (secure 0 0 0) 0x7f19d00eecd0 con 0x7f19d81595b0 2023-12-12T17:34:38.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:38.707+0000 7f19de9e7640 1 -- 172.21.15.78:0/4039324400 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f19b80664c0 msgr2=0x7f19b8068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:34:38.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:38.707+0000 7f19de9e7640 1 --2- 172.21.15.78:0/4039324400 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f19b80664c0 0x7f19b8068980 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f19d80b0c80 tx=0x7f19c8009040 comp rx=0 tx=0).stop 2023-12-12T17:34:38.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:38.707+0000 7f19de9e7640 1 -- 172.21.15.78:0/4039324400 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f19d81595b0 msgr2=0x7f19d80c8fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:34:38.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:38.707+0000 7f19de9e7640 1 --2- 172.21.15.78:0/4039324400 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f19d81595b0 0x7f19d80c8fc0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f19d00a5fd0 tx=0x7f19d0019bc0 comp rx=0 tx=0).stop 2023-12-12T17:34:38.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:38.711+0000 7f19de9e7640 1 -- 172.21.15.78:0/4039324400 shutdown_connections 2023-12-12T17:34:38.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:38.711+0000 7f19de9e7640 1 --2- 172.21.15.78:0/4039324400 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f19b80664c0 0x7f19b8068980 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:38.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:38.711+0000 7f19de9e7640 1 --2- 172.21.15.78:0/4039324400 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f19d81595b0 0x7f19d80c8fc0 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:38.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:38.711+0000 7f19de9e7640 1 --2- 172.21.15.78:0/4039324400 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f19d80c6a90 0x7f19d81f7940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:38.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:38.711+0000 7f19de9e7640 1 --2- 172.21.15.78:0/4039324400 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f19c4005190 0x7f19d80c80d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:38.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:38.711+0000 7f19de9e7640 1 -- 172.21.15.78:0/4039324400 >> 172.21.15.78:0/4039324400 conn(0x7f19d809c2a0 msgr2=0x7f19d815f930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T17:34:38.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:38.711+0000 7f19de9e7640 1 -- 172.21.15.78:0/4039324400 shutdown_connections 2023-12-12T17:34:38.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:38.711+0000 7f19de9e7640 1 -- 172.21.15.78:0/4039324400 wait complete. 2023-12-12T17:34:38.750 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T17:34:39.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:39.019+0000 7efe6689a640 1 Processor -- start 2023-12-12T17:34:39.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:39.019+0000 7efe6689a640 1 -- start start 2023-12-12T17:34:39.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:39.023+0000 7efe6689a640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7efe6006d5e0 0x7efe6006da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:34:39.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:39.023+0000 7efe5ffff640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7efe601447c0 0x7efe600ce570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:35032/0 (socket says 172.21.15.78:35032) 2023-12-12T17:34:39.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:39.023+0000 7efe5ffff640 1 -- 172.21.15.78:0/1804689780 learned_addr learned my addr 172.21.15.78:0/1804689780 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-12-12T17:34:39.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:39.027+0000 7efe6689a640 1 -- 172.21.15.78:0/1804689780 --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe60071e40 con 0x7efe601447c0 2023-12-12T17:34:39.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:39.027+0000 7efe6689a640 1 -- 172.21.15.78:0/1804689780 --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe6006df50 con 0x7efe6015b5e0 2023-12-12T17:34:39.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:39.027+0000 7efe6689a640 1 -- 172.21.15.78:0/1804689780 --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe600cba20 con 0x7efe6006d5e0 2023-12-12T17:34:39.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:39.027+0000 7efe5effd640 1 -- 172.21.15.78:0/1804689780 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3122124640 0 0) 0x7efe60071e40 con 0x7efe601447c0 2023-12-12T17:34:39.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:39.027+0000 7efe5effd640 1 -- 172.21.15.78:0/1804689780 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe48003530 con 0x7efe601447c0 2023-12-12T17:34:39.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:39.027+0000 7efe5effd640 1 -- 172.21.15.78:0/1804689780 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1234775724 0 0) 0x7efe48003530 con 0x7efe601447c0 2023-12-12T17:34:39.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:39.027+0000 7efe5effd640 1 -- 172.21.15.78:0/1804689780 >> v2:172.21.15.187:3300/0 conn(0x7efe6006d5e0 msgr2=0x7efe6006da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T17:34:39.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:39.027+0000 7efe64e37640 1 --2- 172.21.15.78:0/1804689780 >> v2:172.21.15.187:3300/0 conn(0x7efe6006d5e0 0x7efe6006da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:34:39.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:39.027+0000 7efe5effd640 1 --2- 172.21.15.78:0/1804689780 >> v2:172.21.15.187:3300/0 conn(0x7efe6006d5e0 0x7efe6006da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:39.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:39.027+0000 7efe5effd640 1 -- 172.21.15.78:0/1804689780 >> v1:172.21.15.187:6789/0 conn(0x7efe6015b5e0 legacy=0x7efe60071730 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-12-12T17:34:39.036 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:39.027+0000 7efe5effd640 1 -- 172.21.15.78:0/1804689780 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe6015baf0 con 0x7efe601447c0 2023-12-12T17:34:39.036 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:39.027+0000 7efe5effd640 1 -- 172.21.15.78:0/1804689780 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 465499599 0 0) 0x7efe50001680 con 0x7efe601447c0 2023-12-12T17:34:39.036 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:39.027+0000 7efe5effd640 1 -- 172.21.15.78:0/1804689780 >> v1:172.21.15.78:6789/0 conn(0x7efe601447c0 legacy=0x7efe600ce570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:34:39.036 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:39.027+0000 7efe5effd640 1 --2- 172.21.15.78:0/1804689780 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efe48003980 0x7efe48003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:34:39.036 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:39.027+0000 7efe5effd640 1 --2- 172.21.15.78:0/1804689780 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efe480047d0 0x7efe48004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:34:39.036 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:39.027+0000 7efe5effd640 1 --2- 172.21.15.78:0/1804689780 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efe48005200 0x7efe4800fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:34:39.036 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:39.027+0000 7efe5effd640 1 -- 172.21.15.78:0/1804689780 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe600cba20 con 0x7efe48005200 2023-12-12T17:34:39.036 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:39.027+0000 7efe5effd640 1 -- 172.21.15.78:0/1804689780 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe48010570 con 0x7efe48003980 2023-12-12T17:34:39.036 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:39.027+0000 7efe5effd640 1 -- 172.21.15.78:0/1804689780 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe48010730 con 0x7efe480047d0 2023-12-12T17:34:39.036 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:39.027+0000 7efe5ffff640 1 --2- 172.21.15.78:0/1804689780 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efe48003980 0x7efe48003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:34:39.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:39.027+0000 7efe64e37640 1 --2- 172.21.15.78:0/1804689780 >> v2:172.21.15.187:3300/0 conn(0x7efe6006d5e0 0x7efe6006da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T17:34:39.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:39.031+0000 7efe5f7fe640 1 --2- 172.21.15.78:0/1804689780 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efe480047d0 0x7efe48004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:34:39.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:39.031+0000 7efe64e37640 1 --2- 172.21.15.78:0/1804689780 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efe48005200 0x7efe4800fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:34:39.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:39.031+0000 7efe5ffff640 1 -- 172.21.15.78:0/1804689780 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efe480047d0 msgr2=0x7efe48004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T17:34:39.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:39.031+0000 7efe5ffff640 1 --2- 172.21.15.78:0/1804689780 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efe480047d0 0x7efe48004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:39.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:39.031+0000 7efe5ffff640 1 -- 172.21.15.78:0/1804689780 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efe48005200 msgr2=0x7efe4800fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T17:34:39.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:39.031+0000 7efe5ffff640 1 --2- 172.21.15.78:0/1804689780 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efe48005200 0x7efe4800fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:39.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:39.031+0000 7efe64e37640 1 -- 172.21.15.78:0/1804689780 reap_dead start 2023-12-12T17:34:39.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:39.031+0000 7efe5ffff640 1 -- 172.21.15.78:0/1804689780 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe6015baf0 con 0x7efe48003980 2023-12-12T17:34:39.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:39.035+0000 7efe5f7fe640 1 --2- 172.21.15.78:0/1804689780 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efe480047d0 0x7efe48004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T17:34:39.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:39.043+0000 7efe5ffff640 1 --2- 172.21.15.78:0/1804689780 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efe48003980 0x7efe48003d80 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7efe5000c370 tx=0x7efe5001cdc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f388c37ee1964ba7 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T17:34:39.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:39.047+0000 7efe5effd640 1 -- 172.21.15.78:0/1804689780 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe500a5ca0 con 0x7efe48003980 2023-12-12T17:34:39.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:39.047+0000 7efe5effd640 1 -- 172.21.15.78:0/1804689780 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe500a5e20 con 0x7efe48003980 2023-12-12T17:34:39.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:39.047+0000 7efe5effd640 1 -- 172.21.15.78:0/1804689780 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe50005b20 con 0x7efe48003980 2023-12-12T17:34:39.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:39.047+0000 7efe6689a640 1 -- 172.21.15.78:0/1804689780 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efe48003980 msgr2=0x7efe48003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:34:39.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:39.047+0000 7efe6689a640 1 --2- 172.21.15.78:0/1804689780 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efe48003980 0x7efe48003d80 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7efe5000c370 tx=0x7efe5001cdc0 comp rx=0 tx=0).stop 2023-12-12T17:34:39.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:39.047+0000 7efe6689a640 1 -- 172.21.15.78:0/1804689780 shutdown_connections 2023-12-12T17:34:39.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:39.047+0000 7efe6689a640 1 --2- 172.21.15.78:0/1804689780 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efe48003980 0x7efe48003d80 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:39.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:39.047+0000 7efe6689a640 1 -- 172.21.15.78:0/1804689780 >> 172.21.15.78:0/1804689780 conn(0x7efe600b0ab0 msgr2=0x7efe600b0ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T17:34:39.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:39.047+0000 7efe6689a640 1 -- 172.21.15.78:0/1804689780 shutdown_connections 2023-12-12T17:34:39.061 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:39.047+0000 7efe6689a640 1 -- 172.21.15.78:0/1804689780 wait complete. 2023-12-12T17:34:39.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:39.055+0000 7efe6689a640 1 Processor -- start 2023-12-12T17:34:39.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:39.059+0000 7efe6689a640 1 -- start start 2023-12-12T17:34:39.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:39.063+0000 7efe6689a640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efe48003980 0x7efe601f7a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:34:39.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:39.063+0000 7efe6689a640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efe6013d0e0 0x7efe601438c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:34:39.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:39.063+0000 7efe6689a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efe60142530 0x7efe601429b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:34:39.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:39.063+0000 7efe6689a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe60143e00 con 0x7efe60142530 2023-12-12T17:34:39.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:39.063+0000 7efe6689a640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe60141dc0 con 0x7efe6013d0e0 2023-12-12T17:34:39.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:39.063+0000 7efe6689a640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe600b37b0 con 0x7efe48003980 2023-12-12T17:34:39.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:39.063+0000 7efe5f7fe640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efe6013d0e0 0x7efe601438c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:34:39.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:39.063+0000 7efe5f7fe640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efe6013d0e0 0x7efe601438c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.78:52862/0 (socket says 172.21.15.78:52862) 2023-12-12T17:34:39.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:39.063+0000 7efe5f7fe640 1 -- 172.21.15.78:0/836973979 learned_addr learned my addr 172.21.15.78:0/836973979 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T17:34:39.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:39.063+0000 7efe5f7fe640 1 -- 172.21.15.78:0/836973979 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efe48003980 msgr2=0x7efe601f7a90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-12T17:34:39.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:39.063+0000 7efe5f7fe640 1 --2- 172.21.15.78:0/836973979 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efe48003980 0x7efe601f7a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:39.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:39.063+0000 7efe5f7fe640 1 -- 172.21.15.78:0/836973979 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efe60142530 msgr2=0x7efe601429b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-12T17:34:39.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:39.063+0000 7efe5f7fe640 1 --2- 172.21.15.78:0/836973979 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efe60142530 0x7efe601429b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:39.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:39.063+0000 7efe5f7fe640 1 -- 172.21.15.78:0/836973979 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe600b3a70 con 0x7efe6013d0e0 2023-12-12T17:34:39.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:39.067+0000 7efe5f7fe640 1 --2- 172.21.15.78:0/836973979 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efe6013d0e0 0x7efe601438c0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7efe5400d4e0 tx=0x7efe5400d9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T17:34:39.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:39.067+0000 7efe5cff9640 1 -- 172.21.15.78:0/836973979 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe54014620 con 0x7efe6013d0e0 2023-12-12T17:34:39.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:39.067+0000 7efe5cff9640 1 -- 172.21.15.78:0/836973979 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe54014780 con 0x7efe6013d0e0 2023-12-12T17:34:39.074 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:39.067+0000 7efe5cff9640 1 -- 172.21.15.78:0/836973979 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe54014b10 con 0x7efe6013d0e0 2023-12-12T17:34:39.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:39.067+0000 7efe6689a640 1 -- 172.21.15.78:0/836973979 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe600b3d50 con 0x7efe6013d0e0 2023-12-12T17:34:39.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:39.067+0000 7efe6689a640 1 -- 172.21.15.78:0/836973979 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe600b1940 con 0x7efe6013d0e0 2023-12-12T17:34:39.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:39.071+0000 7efe6689a640 1 -- 172.21.15.78:0/836973979 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe600671f0 con 0x7efe6013d0e0 2023-12-12T17:34:39.087 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:39.079+0000 7efe5cff9640 1 -- 172.21.15.78:0/836973979 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7efe54014c70 con 0x7efe6013d0e0 2023-12-12T17:34:39.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:39.083+0000 7efe5cff9640 1 --2- 172.21.15.78:0/836973979 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7efe4c066540 0x7efe4c068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:34:39.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:39.083+0000 7efe5cff9640 1 -- 172.21.15.78:0/836973979 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7efe54084560 con 0x7efe6013d0e0 2023-12-12T17:34:39.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:39.087+0000 7efe5ffff640 1 --2- 172.21.15.78:0/836973979 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7efe4c066540 0x7efe4c068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:34:39.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:39.087+0000 7efe5ffff640 1 --2- 172.21.15.78:0/836973979 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7efe4c066540 0x7efe4c068a00 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7efe500ab000 tx=0x7efe500a7070 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T17:34:39.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:39.091+0000 7efe5cff9640 1 -- 172.21.15.78:0/836973979 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7efe54051860 con 0x7efe6013d0e0 2023-12-12T17:34:39.973 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:39.967+0000 7efe6689a640 1 -- 172.21.15.78:0/836973979 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efe60067530 con 0x7efe6013d0e0 2023-12-12T17:34:39.974 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:39.967+0000 7efe5cff9640 1 -- 172.21.15.78:0/836973979 <== mon.1 v2:172.21.15.187:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+16787 (secure 0 0 0) 0x7efe54054e80 con 0x7efe6013d0e0 2023-12-12T17:34:39.975 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T17:34:39.975 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":41,"fsid":"fc81937c-bd26-483c-952b-d1324fcb0c9e","created":"2023-12-12T10:11:44.020214+0000","modified":"2023-12-12T10:13:50.935087+0000","last_up_change":"2023-12-12T10:11:56.278318+0000","last_in_change":"2023-12-12T10:11:46.553610+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T10:11:57.053584+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-12-12T10:13:29.004403+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-12-12T10:13:30.321623+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"22dfdedf-5f6c-4b20-9f6c-30517a1db70a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6809","nonce":3345683600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6811","nonce":3345683600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6815","nonce":3345683600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6813","nonce":3345683600}]},"public_addr":"172.21.15.78:6809/3345683600","cluster_addr":"172.21.15.78:6811/3345683600","heartbeat_back_addr":"172.21.15.78:6815/3345683600","heartbeat_front_addr":"172.21.15.78:6813/3345683600","state":["exists","up"]},{"osd":1,"uuid":"be34a7f3-a69a-462e-9ddf-5e537448dba2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6801","nonce":962652768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6803","nonce":962652768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6807","nonce":962652768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6805","nonce":962652768}]},"public_addr":"172.21.15.78:6801/962652768","cluster_addr":"172.21.15.78:6803/962652768","heartbeat_back_addr":"172.21.15.78:6807/962652768","heartbeat_front_addr":"172.21.15.78:6805/962652768","state":["exists","up"]},{"osd":2,"uuid":"55b381de-5f56-4b14-80f7-e6e41e084a13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6818","nonce":2910206054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6822","nonce":2910206054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6829","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6831","nonce":2910206054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6826","nonce":2910206054}]},"public_addr":"172.21.15.78:6818/2910206054","cluster_addr":"172.21.15.78:6822/2910206054","heartbeat_back_addr":"172.21.15.78:6831/2910206054","heartbeat_front_addr":"172.21.15.78:6826/2910206054","state":["exists","up"]},{"osd":3,"uuid":"d7682de1-25cb-4cec-869f-8851c28b0e6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6819","nonce":3750796703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6821","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6823","nonce":3750796703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6830","nonce":3750796703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6825","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6827","nonce":3750796703}]},"public_addr":"172.21.15.78:6819/3750796703","cluster_addr":"172.21.15.78:6823/3750796703","heartbeat_back_addr":"172.21.15.78:6830/3750796703","heartbeat_front_addr":"172.21.15.78:6827/3750796703","state":["exists","up"]},{"osd":4,"uuid":"8279815a-d6c7-4199-871e-d28971b9dc07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6809","nonce":2944277204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6811","nonce":2944277204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6815","nonce":2944277204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6813","nonce":2944277204}]},"public_addr":"172.21.15.187:6809/2944277204","cluster_addr":"172.21.15.187:6811/2944277204","heartbeat_back_addr":"172.21.15.187:6815/2944277204","heartbeat_front_addr":"172.21.15.187:6813/2944277204","state":["exists","up"]},{"osd":5,"uuid":"0a714c65-f8ce-4340-968f-11a799677ef3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6801","nonce":185858620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6803","nonce":185858620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6807","nonce":185858620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6805","nonce":185858620}]},"public_addr":"172.21.15.187:6801/185858620","cluster_addr":"172.21.15.187:6803/185858620","heartbeat_back_addr":"172.21.15.187:6807/185858620","heartbeat_front_addr":"172.21.15.187:6805/185858620","state":["exists","up"]},{"osd":6,"uuid":"d0bba9ab-f7ee-449e-8999-1c0cf7e6d53c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6817","nonce":4213392126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6819","nonce":4213392126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6824","nonce":4213392126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6821","nonce":4213392126}]},"public_addr":"172.21.15.187:6817/4213392126","cluster_addr":"172.21.15.187:6819/4213392126","heartbeat_back_addr":"172.21.15.187:6824/4213392126","heartbeat_front_addr":"172.21.15.187:6821/4213392126","state":["exists","up"]},{"osd":7,"uuid":"efe5e0d9-2f87-4889-a27a-e2a95a632302","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6823","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6825","nonce":85774004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6827","nonce":85774004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6831","nonce":85774004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6829","nonce":85774004}]},"public_addr":"172.21.15.187:6825/85774004","cluster_addr":"172.21.15.187:6827/85774004","heartbeat_back_addr":"172.21.15.187:6831/85774004","heartbeat_front_addr":"172.21.15.187:6829/85774004","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.214447+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.448899+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.293107+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.564184+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.175026+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.097717+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.261141+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.287681+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.26","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T17:34:40.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:39.999+0000 7efe6689a640 1 -- 172.21.15.78:0/836973979 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7efe4c066540 msgr2=0x7efe4c068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:34:40.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:39.999+0000 7efe6689a640 1 --2- 172.21.15.78:0/836973979 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7efe4c066540 0x7efe4c068a00 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7efe500ab000 tx=0x7efe500a7070 comp rx=0 tx=0).stop 2023-12-12T17:34:40.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:39.999+0000 7efe6689a640 1 -- 172.21.15.78:0/836973979 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efe6013d0e0 msgr2=0x7efe601438c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:34:40.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:39.999+0000 7efe6689a640 1 --2- 172.21.15.78:0/836973979 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efe6013d0e0 0x7efe601438c0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7efe5400d4e0 tx=0x7efe5400d9a0 comp rx=0 tx=0).stop 2023-12-12T17:34:40.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:40.019+0000 7efe6689a640 1 -- 172.21.15.78:0/836973979 shutdown_connections 2023-12-12T17:34:40.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:40.019+0000 7efe6689a640 1 --2- 172.21.15.78:0/836973979 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7efe4c066540 0x7efe4c068a00 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:40.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:40.019+0000 7efe6689a640 1 --2- 172.21.15.78:0/836973979 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7efe60142530 0x7efe601429b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:40.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:40.019+0000 7efe6689a640 1 --2- 172.21.15.78:0/836973979 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efe6013d0e0 0x7efe601438c0 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:40.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:40.019+0000 7efe6689a640 1 --2- 172.21.15.78:0/836973979 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efe48003980 0x7efe601f7a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:40.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:40.019+0000 7efe6689a640 1 -- 172.21.15.78:0/836973979 >> 172.21.15.78:0/836973979 conn(0x7efe600b0ab0 msgr2=0x7efe60072e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T17:34:40.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:40.023+0000 7efe6689a640 1 -- 172.21.15.78:0/836973979 shutdown_connections 2023-12-12T17:34:40.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:40.023+0000 7efe6689a640 1 -- 172.21.15.78:0/836973979 wait complete. 2023-12-12T17:34:40.068 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-12T17:34:40.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:40.283+0000 7f397585a640 1 Processor -- start 2023-12-12T17:34:40.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:40.283+0000 7f397585a640 1 -- start start 2023-12-12T17:34:40.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:40.287+0000 7f397585a640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f39700cc780 0x7f39700ccc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:34:40.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:40.287+0000 7f397585a640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f397006e3b0 0x7f397006c850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:34:40.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:40.287+0000 7f397585a640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39700b4280 con 0x7f3970141ac0 2023-12-12T17:34:40.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:40.287+0000 7f397585a640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39700b2ea0 con 0x7f39700cc780 2023-12-12T17:34:40.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:40.287+0000 7f397585a640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39700b28e0 con 0x7f397006e3b0 2023-12-12T17:34:40.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:40.287+0000 7f396effd640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f3970141ac0 0x7f39700b1e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.78:48594/0 (socket says 172.21.15.78:48594) 2023-12-12T17:34:40.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:40.287+0000 7f396effd640 1 -- 172.21.15.78:0/1097990238 learned_addr learned my addr 172.21.15.78:0/1097990238 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-12-12T17:34:40.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:40.287+0000 7f396f7fe640 1 --2- 172.21.15.78:0/1097990238 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f397006e3b0 0x7f397006c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:34:40.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:40.287+0000 7f396e7fc640 1 --2- 172.21.15.78:0/1097990238 >> v2:172.21.15.187:3300/0 conn(0x7f39700cc780 0x7f39700ccc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:34:40.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:40.287+0000 7f396dffb640 1 -- 172.21.15.78:0/1097990238 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 617960600 0 0) 0x7f39700b4280 con 0x7f3970141ac0 2023-12-12T17:34:40.295 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:40.287+0000 7f396dffb640 1 -- 172.21.15.78:0/1097990238 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3958003430 con 0x7f3970141ac0 2023-12-12T17:34:40.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:40.287+0000 7f396f7fe640 1 -- 172.21.15.78:0/1097990238 >> v2:172.21.15.187:3300/0 conn(0x7f39700cc780 msgr2=0x7f39700ccc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T17:34:40.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:40.287+0000 7f396f7fe640 1 --2- 172.21.15.78:0/1097990238 >> v2:172.21.15.187:3300/0 conn(0x7f39700cc780 0x7f39700ccc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:40.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:40.287+0000 7f396f7fe640 1 -- 172.21.15.78:0/1097990238 >> v1:172.21.15.187:6789/0 conn(0x7f3970141ac0 legacy=0x7f39700b1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:34:40.296 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:40.287+0000 7f396f7fe640 1 -- 172.21.15.78:0/1097990238 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39700b2bc0 con 0x7f397006e3b0 2023-12-12T17:34:40.300 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:40.295+0000 7f396f7fe640 1 --2- 172.21.15.78:0/1097990238 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f397006e3b0 0x7f397006c850 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f3968009e10 tx=0x7f3968025120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=789f9e268c132e9a server_cookie=0 in_seq=0 out_seq=0 2023-12-12T17:34:40.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:40.295+0000 7f396dffb640 1 -- 172.21.15.78:0/1097990238 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3968009230 con 0x7f397006e3b0 2023-12-12T17:34:40.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:40.295+0000 7f396dffb640 1 -- 172.21.15.78:0/1097990238 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39680b0070 con 0x7f397006e3b0 2023-12-12T17:34:40.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:40.295+0000 7f396dffb640 1 -- 172.21.15.78:0/1097990238 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3968009390 con 0x7f397006e3b0 2023-12-12T17:34:40.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:40.295+0000 7f397585a640 1 -- 172.21.15.78:0/1097990238 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f397006e3b0 msgr2=0x7f397006c850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:34:40.301 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:40.295+0000 7f397585a640 1 --2- 172.21.15.78:0/1097990238 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f397006e3b0 0x7f397006c850 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f3968009e10 tx=0x7f3968025120 comp rx=0 tx=0).stop 2023-12-12T17:34:40.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:40.295+0000 7f397585a640 1 -- 172.21.15.78:0/1097990238 shutdown_connections 2023-12-12T17:34:40.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:40.295+0000 7f397585a640 1 --2- 172.21.15.78:0/1097990238 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f397006e3b0 0x7f397006c850 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:40.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:40.295+0000 7f397585a640 1 --2- 172.21.15.78:0/1097990238 >> v2:172.21.15.187:3300/0 conn(0x7f39700cc780 0x7f39700ccc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:40.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:40.295+0000 7f397585a640 1 -- 172.21.15.78:0/1097990238 >> 172.21.15.78:0/1097990238 conn(0x7f397006a710 msgr2=0x7f397006ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T17:34:40.302 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:40.295+0000 7f397585a640 1 -- 172.21.15.78:0/1097990238 shutdown_connections 2023-12-12T17:34:40.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:40.295+0000 7f397585a640 1 -- 172.21.15.78:0/1097990238 wait complete. 2023-12-12T17:34:40.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:40.295+0000 7f397585a640 1 Processor -- start 2023-12-12T17:34:40.304 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:40.299+0000 7f397585a640 1 -- start start 2023-12-12T17:34:40.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:40.299+0000 7f397585a640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f397006e3b0 0x7f397015c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:34:40.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:40.299+0000 7f397585a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f39700cc780 0x7f3970152310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:34:40.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:40.299+0000 7f397585a640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3970141ac0 0x7f3970157df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:34:40.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:40.299+0000 7f397585a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3970137190 con 0x7f39700cc780 2023-12-12T17:34:40.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:40.299+0000 7f397585a640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3970138930 con 0x7f3970141ac0 2023-12-12T17:34:40.306 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:40.299+0000 7f397585a640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3970152990 con 0x7f397006e3b0 2023-12-12T17:34:40.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:40.299+0000 7f396effd640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f397006e3b0 0x7f397015c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:34:40.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:40.299+0000 7f396f7fe640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3970141ac0 0x7f3970157df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:34:40.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:40.299+0000 7f396f7fe640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3970141ac0 0x7f3970157df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.78:39918/0 (socket says 172.21.15.78:39918) 2023-12-12T17:34:40.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:40.299+0000 7f396f7fe640 1 -- 172.21.15.78:0/2088463723 learned_addr learned my addr 172.21.15.78:0/2088463723 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T17:34:40.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:40.299+0000 7f396f7fe640 1 -- 172.21.15.78:0/2088463723 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f397006e3b0 msgr2=0x7f397015c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:34:40.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:40.299+0000 7f396f7fe640 1 --2- 172.21.15.78:0/2088463723 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f397006e3b0 0x7f397015c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:40.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:40.299+0000 7f396f7fe640 1 -- 172.21.15.78:0/2088463723 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f39700cc780 msgr2=0x7f3970152310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:34:40.307 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:40.299+0000 7f396f7fe640 1 --2- 172.21.15.78:0/2088463723 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f39700cc780 0x7f3970152310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:40.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:40.299+0000 7f396f7fe640 1 -- 172.21.15.78:0/2088463723 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3968009a70 con 0x7f3970141ac0 2023-12-12T17:34:40.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:40.299+0000 7f396f7fe640 1 --2- 172.21.15.78:0/2088463723 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3970141ac0 0x7f3970157df0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f39680237d0 tx=0x7f3968021ec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T17:34:40.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:40.303+0000 7f3957fff640 1 -- 172.21.15.78:0/2088463723 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39680bb040 con 0x7f3970141ac0 2023-12-12T17:34:40.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:40.303+0000 7f3957fff640 1 -- 172.21.15.78:0/2088463723 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39680042c0 con 0x7f3970141ac0 2023-12-12T17:34:40.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:40.303+0000 7f3957fff640 1 -- 172.21.15.78:0/2088463723 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3968004630 con 0x7f3970141ac0 2023-12-12T17:34:40.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:40.303+0000 7f397585a640 1 -- 172.21.15.78:0/2088463723 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39700b26b0 con 0x7f3970141ac0 2023-12-12T17:34:40.311 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:40.303+0000 7f397585a640 1 -- 172.21.15.78:0/2088463723 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3970152f50 con 0x7f3970141ac0 2023-12-12T17:34:40.312 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:40.307+0000 7f397585a640 1 -- 172.21.15.78:0/2088463723 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39700671f0 con 0x7f3970141ac0 2023-12-12T17:34:40.317 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:40.311+0000 7f3957fff640 1 -- 172.21.15.78:0/2088463723 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f39680cb460 con 0x7f3970141ac0 2023-12-12T17:34:40.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:40.311+0000 7f3957fff640 1 --2- 172.21.15.78:0/2088463723 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f3958066970 0x7f3958068e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:34:40.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:40.311+0000 7f3957fff640 1 -- 172.21.15.78:0/2088463723 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f39681279c0 con 0x7f3970141ac0 2023-12-12T17:34:40.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:40.315+0000 7f396effd640 1 --2- 172.21.15.78:0/2088463723 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f3958066970 0x7f3958068e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:34:40.325 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:40.319+0000 7f396effd640 1 --2- 172.21.15.78:0/2088463723 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f3958066970 0x7f3958068e30 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f3960007fd0 tx=0x7f3960000bd0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T17:34:40.328 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:40.323+0000 7f3957fff640 1 -- 172.21.15.78:0/2088463723 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f39680f4ee0 con 0x7f3970141ac0 2023-12-12T17:34:41.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:41.275+0000 7f397585a640 1 -- 172.21.15.78:0/2088463723 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f3970137300 con 0x7f3970141ac0 2023-12-12T17:34:41.458 INFO:tasks.ceph.mon.a.smithi078.stderr:2023-12-12T17:34:41.451+0000 7f1ddc928640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-12T17:34:41.496 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:41.491+0000 7f3957fff640 1 -- 172.21.15.78:0/2088463723 <== mon.1 v2:172.21.15.187:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v18) v1 ==== 161+0+0 (secure 0 0 0) 0x7f39680f8500 con 0x7f3970141ac0 2023-12-12T17:34:41.498 INFO:teuthology.orchestra.run.smithi078.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-12T17:34:41.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:41.495+0000 7f397585a640 1 -- 172.21.15.78:0/2088463723 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f3958066970 msgr2=0x7f3958068e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:34:41.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:41.499+0000 7f397585a640 1 --2- 172.21.15.78:0/2088463723 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f3958066970 0x7f3958068e30 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f3960007fd0 tx=0x7f3960000bd0 comp rx=0 tx=0).stop 2023-12-12T17:34:41.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:41.499+0000 7f397585a640 1 -- 172.21.15.78:0/2088463723 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3970141ac0 msgr2=0x7f3970157df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:34:41.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:41.499+0000 7f397585a640 1 --2- 172.21.15.78:0/2088463723 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3970141ac0 0x7f3970157df0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f39680237d0 tx=0x7f3968021ec0 comp rx=0 tx=0).stop 2023-12-12T17:34:41.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:41.499+0000 7f397585a640 1 -- 172.21.15.78:0/2088463723 shutdown_connections 2023-12-12T17:34:41.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:41.499+0000 7f397585a640 1 --2- 172.21.15.78:0/2088463723 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f3958066970 0x7f3958068e30 secure :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f3960007fd0 tx=0x7f3960000bd0 comp rx=0 tx=0).stop 2023-12-12T17:34:41.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:41.499+0000 7f397585a640 1 --2- 172.21.15.78:0/2088463723 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3970141ac0 0x7f3970157df0 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:41.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:41.499+0000 7f397585a640 1 --2- 172.21.15.78:0/2088463723 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f39700cc780 0x7f3970152310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:41.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:41.499+0000 7f397585a640 1 --2- 172.21.15.78:0/2088463723 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f397006e3b0 0x7f397015c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:41.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:41.499+0000 7f397585a640 1 -- 172.21.15.78:0/2088463723 >> 172.21.15.78:0/2088463723 conn(0x7f397006a710 msgr2=0x7f39700cd1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T17:34:41.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:41.499+0000 7f397585a640 1 -- 172.21.15.78:0/2088463723 shutdown_connections 2023-12-12T17:34:41.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:41.499+0000 7f397585a640 1 -- 172.21.15.78:0/2088463723 wait complete. 2023-12-12T17:34:41.602 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-12T17:34:41.841 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:41.835+0000 7f76fe996640 1 Processor -- start 2023-12-12T17:34:41.841 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:41.835+0000 7f76fe996640 1 -- start start 2023-12-12T17:34:41.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:41.839+0000 7f76fe996640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f76f8159cc0 0x7f76f806b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:34:41.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:41.839+0000 7f76fe996640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f76f80af370 0x7f76f806a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:34:41.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:41.839+0000 7f76fe996640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76f8072670 con 0x7f76f806bca0 2023-12-12T17:34:41.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:41.839+0000 7f76fe996640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76f8072ba0 con 0x7f76f8159cc0 2023-12-12T17:34:41.845 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:41.839+0000 7f76fe996640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76f80afde0 con 0x7f76f80af370 2023-12-12T17:34:41.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:41.839+0000 7f76fd994640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f76f8159cc0 0x7f76f806b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:34:41.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:41.839+0000 7f76fd193640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f76f806bca0 0x7f76f80ac6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.78:48608/0 (socket says 172.21.15.78:48608) 2023-12-12T17:34:41.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:41.839+0000 7f76fd193640 1 -- 172.21.15.78:0/4043265005 learned_addr learned my addr 172.21.15.78:0/4043265005 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-12-12T17:34:41.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:41.839+0000 7f76fe195640 1 --2- 172.21.15.78:0/4043265005 >> v2:172.21.15.187:3300/0 conn(0x7f76f80af370 0x7f76f806a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:34:41.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:41.839+0000 7f76fc992640 1 -- 172.21.15.78:0/4043265005 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 638387554 0 0) 0x7f76f8072670 con 0x7f76f806bca0 2023-12-12T17:34:41.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:41.839+0000 7f76fc992640 1 -- 172.21.15.78:0/4043265005 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f76e4003530 con 0x7f76f806bca0 2023-12-12T17:34:41.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:41.839+0000 7f76fd994640 1 -- 172.21.15.78:0/4043265005 >> v2:172.21.15.187:3300/0 conn(0x7f76f80af370 msgr2=0x7f76f806a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T17:34:41.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:41.839+0000 7f76fd994640 1 --2- 172.21.15.78:0/4043265005 >> v2:172.21.15.187:3300/0 conn(0x7f76f80af370 0x7f76f806a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:41.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:41.839+0000 7f76fd994640 1 -- 172.21.15.78:0/4043265005 >> v1:172.21.15.187:6789/0 conn(0x7f76f806bca0 legacy=0x7f76f80ac6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:34:41.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:41.839+0000 7f76fd994640 1 -- 172.21.15.78:0/4043265005 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76f80b4f70 con 0x7f76f8159cc0 2023-12-12T17:34:41.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:41.851+0000 7f76fd994640 1 --2- 172.21.15.78:0/4043265005 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f76f8159cc0 0x7f76f806b760 secure :-1 s=READY pgs=2111 cs=0 l=1 rev1=1 crypto rx=0x7f76f8071ae0 tx=0x7f76f401c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d77dce8b2b12845b server_cookie=0 in_seq=0 out_seq=0 2023-12-12T17:34:41.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:41.855+0000 7f76fc992640 1 -- 172.21.15.78:0/4043265005 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f40ac600 con 0x7f76f8159cc0 2023-12-12T17:34:41.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:41.855+0000 7f76fc992640 1 -- 172.21.15.78:0/4043265005 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76f40a8050 con 0x7f76f8159cc0 2023-12-12T17:34:41.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:41.855+0000 7f76fc992640 1 -- 172.21.15.78:0/4043265005 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f40ac980 con 0x7f76f8159cc0 2023-12-12T17:34:41.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:41.855+0000 7f76fe996640 1 -- 172.21.15.78:0/4043265005 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f76f8159cc0 msgr2=0x7f76f806b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:34:41.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:41.855+0000 7f76fe996640 1 --2- 172.21.15.78:0/4043265005 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f76f8159cc0 0x7f76f806b760 secure :-1 s=READY pgs=2111 cs=0 l=1 rev1=1 crypto rx=0x7f76f8071ae0 tx=0x7f76f401c3a0 comp rx=0 tx=0).stop 2023-12-12T17:34:41.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:41.855+0000 7f76fe996640 1 -- 172.21.15.78:0/4043265005 shutdown_connections 2023-12-12T17:34:41.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:41.855+0000 7f76fe996640 1 --2- 172.21.15.78:0/4043265005 >> v2:172.21.15.187:3300/0 conn(0x7f76f80af370 0x7f76f806a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:41.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:41.855+0000 7f76fe996640 1 --2- 172.21.15.78:0/4043265005 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f76f8159cc0 0x7f76f806b760 unknown :-1 s=CLOSED pgs=2111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:41.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:41.855+0000 7f76fe996640 1 -- 172.21.15.78:0/4043265005 >> 172.21.15.78:0/4043265005 conn(0x7f76f80b4000 msgr2=0x7f76f80b46c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T17:34:41.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:41.855+0000 7f76fe996640 1 -- 172.21.15.78:0/4043265005 shutdown_connections 2023-12-12T17:34:41.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:41.855+0000 7f76fe996640 1 -- 172.21.15.78:0/4043265005 wait complete. 2023-12-12T17:34:41.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:41.859+0000 7f76fe996640 1 Processor -- start 2023-12-12T17:34:41.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:41.859+0000 7f76fe996640 1 -- start start 2023-12-12T17:34:41.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:41.859+0000 7f76fe996640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f76f80af370 0x7f76f806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:34:41.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:41.859+0000 7f76fe996640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f76f8159cc0 0x7f76f814b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:34:41.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:41.859+0000 7f76fe996640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f76f80ce370 0x7f76f80ce800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:34:41.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:41.859+0000 7f76fe996640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76f80ced40 con 0x7f76f80ce370 2023-12-12T17:34:41.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:41.859+0000 7f76fe996640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76f8154d30 con 0x7f76f8159cc0 2023-12-12T17:34:41.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:41.859+0000 7f76fe996640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76f814ba60 con 0x7f76f80af370 2023-12-12T17:34:41.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:41.859+0000 7f76fe195640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f76f80ce370 0x7f76f80ce800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:34:41.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:41.859+0000 7f76fd193640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f76f8159cc0 0x7f76f814b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:34:41.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:41.859+0000 7f76fe195640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f76f80ce370 0x7f76f80ce800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35936/0 (socket says 172.21.15.78:35936) 2023-12-12T17:34:41.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:41.859+0000 7f76fe195640 1 -- 172.21.15.78:0/2383234220 learned_addr learned my addr 172.21.15.78:0/2383234220 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T17:34:41.867 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:41.859+0000 7f76fd994640 1 --2- 172.21.15.78:0/2383234220 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f76f80af370 0x7f76f806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:34:41.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:41.859+0000 7f76fd193640 1 -- 172.21.15.78:0/2383234220 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f76f80af370 msgr2=0x7f76f806d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:34:41.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:41.859+0000 7f76fd193640 1 --2- 172.21.15.78:0/2383234220 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f76f80af370 0x7f76f806d330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:41.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:41.859+0000 7f76fd193640 1 -- 172.21.15.78:0/2383234220 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f76f80ce370 msgr2=0x7f76f80ce800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:34:41.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:41.859+0000 7f76fd193640 1 --2- 172.21.15.78:0/2383234220 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f76f80ce370 0x7f76f80ce800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:41.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:41.859+0000 7f76fd193640 1 -- 172.21.15.78:0/2383234220 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76f4009420 con 0x7f76f8159cc0 2023-12-12T17:34:41.868 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:41.859+0000 7f76fd193640 1 --2- 172.21.15.78:0/2383234220 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f76f8159cc0 0x7f76f814b520 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f76e800c400 tx=0x7f76e800c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T17:34:41.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:41.863+0000 7f76ee7fc640 1 -- 172.21.15.78:0/2383234220 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76e8005cf0 con 0x7f76f8159cc0 2023-12-12T17:34:41.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:41.863+0000 7f76ee7fc640 1 -- 172.21.15.78:0/2383234220 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76e8005e50 con 0x7f76f8159cc0 2023-12-12T17:34:41.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:41.863+0000 7f76ee7fc640 1 -- 172.21.15.78:0/2383234220 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76e80072d0 con 0x7f76f8159cc0 2023-12-12T17:34:41.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:41.863+0000 7f76fe996640 1 -- 172.21.15.78:0/2383234220 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76f814be10 con 0x7f76f8159cc0 2023-12-12T17:34:41.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:41.863+0000 7f76fe996640 1 -- 172.21.15.78:0/2383234220 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76f8154a50 con 0x7f76f8159cc0 2023-12-12T17:34:41.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:41.863+0000 7f76fe996640 1 -- 172.21.15.78:0/2383234220 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76f814bc70 con 0x7f76f8159cc0 2023-12-12T17:34:41.875 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:41.867+0000 7f76ee7fc640 1 -- 172.21.15.78:0/2383234220 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f76e8007430 con 0x7f76f8159cc0 2023-12-12T17:34:41.876 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:41.871+0000 7f76ee7fc640 1 --2- 172.21.15.78:0/2383234220 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f76dc066470 0x7f76dc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:34:41.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:41.871+0000 7f76ee7fc640 1 -- 172.21.15.78:0/2383234220 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6144+0+0 (secure 0 0 0) 0x7f76e80835c0 con 0x7f76f8159cc0 2023-12-12T17:34:41.877 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:41.871+0000 7f76fd994640 1 --2- 172.21.15.78:0/2383234220 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f76dc066470 0x7f76dc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:34:41.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:41.871+0000 7f76fd994640 1 --2- 172.21.15.78:0/2383234220 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f76dc066470 0x7f76dc068930 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f76f40ae000 tx=0x7f76f40a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T17:34:41.882 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:41.875+0000 7f76ee7fc640 1 -- 172.21.15.78:0/2383234220 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f76f814bc70 con 0x7f76f8159cc0 2023-12-12T17:34:42.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:42.063+0000 7f76fe996640 1 -- 172.21.15.78:0/2383234220 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f76f814bc70 con 0x7f76f8159cc0 2023-12-12T17:34:42.211 INFO:tasks.ceph.mds.a.smithi078.stdout:starting mds.a at 2023-12-12T17:34:42.922 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:42.915+0000 7f76ee7fc640 1 -- 172.21.15.78:0/2383234220 <== mon.1 v2:172.21.15.187:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v19) v1 ==== 104+0+0 (secure 0 0 0) 0x7f76f814bc70 con 0x7f76f8159cc0 2023-12-12T17:34:42.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:42.919+0000 7f76fe996640 1 -- 172.21.15.78:0/2383234220 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f76dc066470 msgr2=0x7f76dc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:34:42.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:42.919+0000 7f76fe996640 1 --2- 172.21.15.78:0/2383234220 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f76dc066470 0x7f76dc068930 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f76f40ae000 tx=0x7f76f40a7000 comp rx=0 tx=0).stop 2023-12-12T17:34:42.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:42.919+0000 7f76fe996640 1 -- 172.21.15.78:0/2383234220 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f76f8159cc0 msgr2=0x7f76f814b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:34:42.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:42.919+0000 7f76fe996640 1 --2- 172.21.15.78:0/2383234220 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f76f8159cc0 0x7f76f814b520 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f76e800c400 tx=0x7f76e800c8c0 comp rx=0 tx=0).stop 2023-12-12T17:34:42.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:42.919+0000 7f76fe996640 1 -- 172.21.15.78:0/2383234220 shutdown_connections 2023-12-12T17:34:42.927 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:42.919+0000 7f76fe996640 1 --2- 172.21.15.78:0/2383234220 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f76dc066470 0x7f76dc068930 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:42.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:42.919+0000 7f76fe996640 1 --2- 172.21.15.78:0/2383234220 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f76f80ce370 0x7f76f80ce800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:42.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:42.919+0000 7f76fe996640 1 --2- 172.21.15.78:0/2383234220 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f76f8159cc0 0x7f76f814b520 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:42.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:42.919+0000 7f76fe996640 1 --2- 172.21.15.78:0/2383234220 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f76f80af370 0x7f76f806d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:42.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:42.919+0000 7f76fe996640 1 -- 172.21.15.78:0/2383234220 >> 172.21.15.78:0/2383234220 conn(0x7f76f80b4000 msgr2=0x7f76f80b43e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T17:34:42.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:42.919+0000 7f76fe996640 1 -- 172.21.15.78:0/2383234220 shutdown_connections 2023-12-12T17:34:42.928 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:42.919+0000 7f76fe996640 1 -- 172.21.15.78:0/2383234220 wait complete. 2023-12-12T17:34:42.974 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-12T17:34:43.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:43.371+0000 7f25413c4640 1 Processor -- start 2023-12-12T17:34:43.379 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:43.371+0000 7f25413c4640 1 -- start start 2023-12-12T17:34:43.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:43.375+0000 7f25413c4640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f253c0b3550 0x7f253c072180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:34:43.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:43.375+0000 7f25413c4640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f253c15df70 0x7f253c0702c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:34:43.383 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:43.375+0000 7f25413c4640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f253c15e6c0 con 0x7f253c0cd510 2023-12-12T17:34:43.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:43.375+0000 7f25413c4640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f253c0cd9b0 con 0x7f253c15df70 2023-12-12T17:34:43.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:43.375+0000 7f25413c4640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f253c0cdc90 con 0x7f253c0b3550 2023-12-12T17:34:43.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:43.375+0000 7f253b7fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f253c15df70 0x7f253c0702c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:34:43.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:43.375+0000 7f253affd640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f253c0b3550 0x7f253c072180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:34:43.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:43.375+0000 7f253b7fe640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f253c15df70 0x7f253c0702c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35976/0 (socket says 172.21.15.78:35976) 2023-12-12T17:34:43.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:43.375+0000 7f253b7fe640 1 -- 172.21.15.78:0/2432113680 learned_addr learned my addr 172.21.15.78:0/2432113680 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T17:34:43.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:43.375+0000 7f253a7fc640 1 --1- 172.21.15.78:0/2432113680 >> v1:172.21.15.187:6789/0 conn(0x7f253c0cd510 0x7f253c15d860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.78:48612/0 (socket says 172.21.15.78:48612) 2023-12-12T17:34:43.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:43.379+0000 7f253b7fe640 1 -- 172.21.15.78:0/2432113680 >> v2:172.21.15.187:3300/0 conn(0x7f253c0b3550 msgr2=0x7f253c072180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T17:34:43.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:43.379+0000 7f253b7fe640 1 --2- 172.21.15.78:0/2432113680 >> v2:172.21.15.187:3300/0 conn(0x7f253c0b3550 0x7f253c072180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:43.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:43.379+0000 7f253b7fe640 1 -- 172.21.15.78:0/2432113680 >> v1:172.21.15.187:6789/0 conn(0x7f253c0cd510 legacy=0x7f253c15d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:34:43.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:43.379+0000 7f253b7fe640 1 -- 172.21.15.78:0/2432113680 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f253c0cdf70 con 0x7f253c15df70 2023-12-12T17:34:43.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:43.379+0000 7f253b7fe640 1 --2- 172.21.15.78:0/2432113680 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f253c15df70 0x7f253c0702c0 secure :-1 s=READY pgs=2113 cs=0 l=1 rev1=1 crypto rx=0x7f253c06e370 tx=0x7f253401c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb2be1c1ef394b71 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T17:34:43.388 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:43.383+0000 7f2539ffb640 1 -- 172.21.15.78:0/2432113680 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25340a57d0 con 0x7f253c15df70 2023-12-12T17:34:43.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:43.383+0000 7f2539ffb640 1 -- 172.21.15.78:0/2432113680 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25340a5930 con 0x7f253c15df70 2023-12-12T17:34:43.389 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:43.383+0000 7f2539ffb640 1 -- 172.21.15.78:0/2432113680 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25340a5cc0 con 0x7f253c15df70 2023-12-12T17:34:43.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:43.383+0000 7f25413c4640 1 -- 172.21.15.78:0/2432113680 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f253c15df70 msgr2=0x7f253c0702c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:34:43.390 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:43.383+0000 7f25413c4640 1 --2- 172.21.15.78:0/2432113680 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f253c15df70 0x7f253c0702c0 secure :-1 s=READY pgs=2113 cs=0 l=1 rev1=1 crypto rx=0x7f253c06e370 tx=0x7f253401c910 comp rx=0 tx=0).stop 2023-12-12T17:34:43.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:43.383+0000 7f25413c4640 1 -- 172.21.15.78:0/2432113680 shutdown_connections 2023-12-12T17:34:43.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:43.383+0000 7f25413c4640 1 --2- 172.21.15.78:0/2432113680 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f253c15df70 0x7f253c0702c0 unknown :-1 s=CLOSED pgs=2113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:43.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:43.383+0000 7f25413c4640 1 --2- 172.21.15.78:0/2432113680 >> v2:172.21.15.187:3300/0 conn(0x7f253c0b3550 0x7f253c072180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:43.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:43.383+0000 7f25413c4640 1 -- 172.21.15.78:0/2432113680 >> 172.21.15.78:0/2432113680 conn(0x7f253c06a710 msgr2=0x7f253c06ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T17:34:43.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:43.383+0000 7f25413c4640 1 -- 172.21.15.78:0/2432113680 shutdown_connections 2023-12-12T17:34:43.391 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:43.383+0000 7f25413c4640 1 -- 172.21.15.78:0/2432113680 wait complete. 2023-12-12T17:34:43.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:43.387+0000 7f25413c4640 1 Processor -- start 2023-12-12T17:34:43.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:43.387+0000 7f25413c4640 1 -- start start 2023-12-12T17:34:43.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:43.391+0000 7f25413c4640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f253c0b3550 0x7f253c148fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:34:43.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:43.391+0000 7f25413c4640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f253c0cd510 0x7f253c14bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:34:43.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:43.391+0000 7f25413c4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f253c15df70 0x7f253c152150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:34:43.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:43.391+0000 7f25413c4640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f253c14b860 con 0x7f253c15df70 2023-12-12T17:34:43.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:43.391+0000 7f25413c4640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f253c14abe0 con 0x7f253c0cd510 2023-12-12T17:34:43.399 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:43.391+0000 7f25413c4640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f253c14aec0 con 0x7f253c0b3550 2023-12-12T17:34:43.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:43.391+0000 7f253b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f253c15df70 0x7f253c152150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:34:43.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:43.391+0000 7f253b7fe640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f253c15df70 0x7f253c152150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35984/0 (socket says 172.21.15.78:35984) 2023-12-12T17:34:43.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:43.391+0000 7f253b7fe640 1 -- 172.21.15.78:0/601590267 learned_addr learned my addr 172.21.15.78:0/601590267 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T17:34:43.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:43.391+0000 7f253affd640 1 --2- 172.21.15.78:0/601590267 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f253c0b3550 0x7f253c148fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:34:43.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:43.391+0000 7f253a7fc640 1 --2- 172.21.15.78:0/601590267 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f253c0cd510 0x7f253c14bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:34:43.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:43.391+0000 7f253b7fe640 1 -- 172.21.15.78:0/601590267 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f253c0b3550 msgr2=0x7f253c148fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:34:43.400 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:43.391+0000 7f253b7fe640 1 --2- 172.21.15.78:0/601590267 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f253c0b3550 0x7f253c148fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:43.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:43.391+0000 7f253b7fe640 1 -- 172.21.15.78:0/601590267 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f253c0cd510 msgr2=0x7f253c14bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:34:43.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:43.391+0000 7f253b7fe640 1 --2- 172.21.15.78:0/601590267 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f253c0cd510 0x7f253c14bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:43.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:43.391+0000 7f253b7fe640 1 -- 172.21.15.78:0/601590267 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2534009b30 con 0x7f253c15df70 2023-12-12T17:34:43.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:43.395+0000 7f253b7fe640 1 --2- 172.21.15.78:0/601590267 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f253c15df70 0x7f253c152150 secure :-1 s=READY pgs=2114 cs=0 l=1 rev1=1 crypto rx=0x7f25340af040 tx=0x7f25340196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T17:34:43.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:43.395+0000 7f25237fe640 1 -- 172.21.15.78:0/601590267 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25340b8640 con 0x7f253c15df70 2023-12-12T17:34:43.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:43.395+0000 7f25237fe640 1 -- 172.21.15.78:0/601590267 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25340b87a0 con 0x7f253c15df70 2023-12-12T17:34:43.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:43.395+0000 7f25413c4640 1 -- 172.21.15.78:0/601590267 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f253c14b1a0 con 0x7f253c15df70 2023-12-12T17:34:43.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:43.395+0000 7f25237fe640 1 -- 172.21.15.78:0/601590267 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25340b8b50 con 0x7f253c15df70 2023-12-12T17:34:43.402 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:43.395+0000 7f25413c4640 1 -- 172.21.15.78:0/601590267 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f253c149500 con 0x7f253c15df70 2023-12-12T17:34:43.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:43.399+0000 7f25237fe640 1 -- 172.21.15.78:0/601590267 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f25340b8cb0 con 0x7f253c15df70 2023-12-12T17:34:43.404 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:43.399+0000 7f25413c4640 1 -- 172.21.15.78:0/601590267 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f253c0671f0 con 0x7f253c15df70 2023-12-12T17:34:43.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:43.399+0000 7f25237fe640 1 --2- 172.21.15.78:0/601590267 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f2528066470 0x7f2528068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:34:43.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:43.399+0000 7f25237fe640 1 -- 172.21.15.78:0/601590267 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6144+0+0 (secure 0 0 0) 0x7f253411eb90 con 0x7f253c15df70 2023-12-12T17:34:43.407 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:43.399+0000 7f253affd640 1 --2- 172.21.15.78:0/601590267 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f2528066470 0x7f2528068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:34:43.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:43.403+0000 7f253affd640 1 --2- 172.21.15.78:0/601590267 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f2528066470 0x7f2528068930 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f252c009af0 tx=0x7f252c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T17:34:43.412 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:43.403+0000 7f25237fe640 1 -- 172.21.15.78:0/601590267 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f25340ebe60 con 0x7f253c15df70 2023-12-12T17:34:43.572 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:43.563+0000 7f25413c4640 1 -- 172.21.15.78:0/601590267 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f253c14b9a0 con 0x7f253c15df70 2023-12-12T17:34:43.926 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:43.919+0000 7f25237fe640 1 -- 172.21.15.78:0/601590267 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v43) v1 ==== 181+0+0 (secure 0 0 0) 0x7f253c14b9a0 con 0x7f253c15df70 2023-12-12T17:34:43.926 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_metadata' removed 2023-12-12T17:34:43.929 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:43.923+0000 7f25413c4640 1 -- 172.21.15.78:0/601590267 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f2528066470 msgr2=0x7f2528068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:34:43.929 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:43.923+0000 7f25413c4640 1 --2- 172.21.15.78:0/601590267 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f2528066470 0x7f2528068930 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f252c009af0 tx=0x7f252c008040 comp rx=0 tx=0).stop 2023-12-12T17:34:43.929 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:43.923+0000 7f25413c4640 1 -- 172.21.15.78:0/601590267 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f253c15df70 msgr2=0x7f253c152150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:34:43.929 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:43.923+0000 7f25413c4640 1 --2- 172.21.15.78:0/601590267 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f253c15df70 0x7f253c152150 secure :-1 s=READY pgs=2114 cs=0 l=1 rev1=1 crypto rx=0x7f25340af040 tx=0x7f25340196b0 comp rx=0 tx=0).stop 2023-12-12T17:34:43.929 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:43.923+0000 7f25413c4640 1 -- 172.21.15.78:0/601590267 shutdown_connections 2023-12-12T17:34:43.929 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:43.923+0000 7f25413c4640 1 --2- 172.21.15.78:0/601590267 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f2528066470 0x7f2528068930 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:43.930 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:43.923+0000 7f25413c4640 1 --2- 172.21.15.78:0/601590267 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f253c15df70 0x7f253c152150 unknown :-1 s=CLOSED pgs=2114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:43.930 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:43.923+0000 7f25413c4640 1 --2- 172.21.15.78:0/601590267 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f253c0cd510 0x7f253c14bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:43.930 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:43.923+0000 7f25413c4640 1 --2- 172.21.15.78:0/601590267 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f253c0b3550 0x7f253c148fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:43.930 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:43.923+0000 7f25413c4640 1 -- 172.21.15.78:0/601590267 >> 172.21.15.78:0/601590267 conn(0x7f253c06a710 msgr2=0x7f253c155300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T17:34:43.930 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:43.923+0000 7f25413c4640 1 -- 172.21.15.78:0/601590267 shutdown_connections 2023-12-12T17:34:43.930 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:43.923+0000 7f25413c4640 1 -- 172.21.15.78:0/601590267 wait complete. 2023-12-12T17:34:43.983 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-12T17:34:45.159 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:45.147+0000 7f3da59b5640 1 Processor -- start 2023-12-12T17:34:45.160 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:45.147+0000 7f3da59b5640 1 -- start start 2023-12-12T17:34:45.163 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:45.155+0000 7f3da59b5640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f3da014af20 0x7f3da00cb640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:34:45.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:45.159+0000 7f3da59b5640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f3da00cc930 0x7f3da00b3780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:34:45.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:45.159+0000 7f3da49b3640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f3da014af20 0x7f3da00cb640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:34:45.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:45.159+0000 7f3da49b3640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f3da014af20 0x7f3da00cb640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:35996/0 (socket says 172.21.15.78:35996) 2023-12-12T17:34:45.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:45.159+0000 7f3da59b5640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3da00cc680 con 0x7f3da00cd590 2023-12-12T17:34:45.167 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:45.159+0000 7f3da59b5640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3da00cbd40 con 0x7f3da014af20 2023-12-12T17:34:45.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:45.159+0000 7f3da59b5640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3da00b2ca0 con 0x7f3da00cc930 2023-12-12T17:34:45.168 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:45.163+0000 7f3da51b4640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f3da00cd590 0x7f3da0070010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.78:48628/0 (socket says 172.21.15.78:48628) 2023-12-12T17:34:45.169 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:45.163+0000 7f3da51b4640 1 -- 172.21.15.78:0/3669437728 learned_addr learned my addr 172.21.15.78:0/3669437728 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-12-12T17:34:45.169 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:45.163+0000 7f3d9f7fe640 1 -- 172.21.15.78:0/3669437728 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1847601616 0 0) 0x7f3da00cc680 con 0x7f3da00cd590 2023-12-12T17:34:45.170 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:45.163+0000 7f3d9f7fe640 1 -- 172.21.15.78:0/3669437728 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d88003530 con 0x7f3da00cd590 2023-12-12T17:34:45.170 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:45.163+0000 7f3d9f7fe640 1 -- 172.21.15.78:0/3669437728 <== mon.1 v1:172.21.15.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1386509222 0 0) 0x7f3d88003530 con 0x7f3da00cd590 2023-12-12T17:34:45.171 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:45.163+0000 7f3d9f7fe640 1 -- 172.21.15.78:0/3669437728 >> v2:172.21.15.187:3300/0 conn(0x7f3da00cc930 msgr2=0x7f3da00b3780 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-12-12T17:34:45.171 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:45.163+0000 7f3d9f7fe640 1 --2- 172.21.15.78:0/3669437728 >> v2:172.21.15.187:3300/0 conn(0x7f3da00cc930 0x7f3da00b3780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:45.172 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:45.163+0000 7f3d9f7fe640 1 -- 172.21.15.78:0/3669437728 >> v2:172.21.15.78:3300/0 conn(0x7f3da014af20 msgr2=0x7f3da00cb640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T17:34:45.172 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:45.163+0000 7f3d9f7fe640 1 --2- 172.21.15.78:0/3669437728 >> v2:172.21.15.78:3300/0 conn(0x7f3da014af20 0x7f3da00cb640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:45.172 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:45.163+0000 7f3d9f7fe640 1 -- 172.21.15.78:0/3669437728 --> v1:172.21.15.187:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3da00b2f80 con 0x7f3da00cd590 2023-12-12T17:34:45.172 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:45.163+0000 7f3da49b3640 1 --2- 172.21.15.78:0/3669437728 >> v2:172.21.15.78:3300/0 conn(0x7f3da014af20 0x7f3da00cb640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2023-12-12T17:34:45.172 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:45.163+0000 7f3d9f7fe640 1 -- 172.21.15.78:0/3669437728 <== mon.1 v1:172.21.15.187:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 465499599 0 0) 0x7f3d98001a00 con 0x7f3da00cd590 2023-12-12T17:34:45.173 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:45.163+0000 7f3d9f7fe640 1 -- 172.21.15.78:0/3669437728 >> v1:172.21.15.187:6789/0 conn(0x7f3da00cd590 legacy=0x7f3da0070010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:34:45.173 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:45.163+0000 7f3d9f7fe640 1 --2- 172.21.15.78:0/3669437728 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3d880039d0 0x7f3d88003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:34:45.173 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:45.163+0000 7f3d9f7fe640 1 --2- 172.21.15.78:0/3669437728 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d880047d0 0x7f3d88004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:34:45.173 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:45.163+0000 7f3d9f7fe640 1 --2- 172.21.15.78:0/3669437728 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3d88005390 0x7f3d8800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:34:45.173 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:45.163+0000 7f3d9f7fe640 1 -- 172.21.15.78:0/3669437728 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3da00cbd40 con 0x7f3d880047d0 2023-12-12T17:34:45.173 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:45.163+0000 7f3d9f7fe640 1 -- 172.21.15.78:0/3669437728 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3da00b2ca0 con 0x7f3d880039d0 2023-12-12T17:34:45.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:45.163+0000 7f3d9f7fe640 1 -- 172.21.15.78:0/3669437728 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d8800c280 con 0x7f3d88005390 2023-12-12T17:34:45.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:45.163+0000 7f3da51b4640 1 --2- 172.21.15.78:0/3669437728 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3d88005390 0x7f3d8800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:34:45.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:45.167+0000 7f3da49b3640 1 --2- 172.21.15.78:0/3669437728 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3d880039d0 0x7f3d88003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:34:45.174 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:45.167+0000 7f3d9ffff640 1 --2- 172.21.15.78:0/3669437728 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d880047d0 0x7f3d88004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:34:45.178 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:45.171+0000 7f3da51b4640 1 -- 172.21.15.78:0/3669437728 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3d880039d0 msgr2=0x7f3d88003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T17:34:45.179 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:45.171+0000 7f3da51b4640 1 --2- 172.21.15.78:0/3669437728 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3d880039d0 0x7f3d88003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:45.179 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:45.171+0000 7f3da51b4640 1 -- 172.21.15.78:0/3669437728 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d880047d0 msgr2=0x7f3d88004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T17:34:45.179 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:45.171+0000 7f3da51b4640 1 --2- 172.21.15.78:0/3669437728 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3d880047d0 0x7f3d88004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:45.179 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:45.171+0000 7f3da51b4640 1 -- 172.21.15.78:0/3669437728 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d88003530 con 0x7f3d88005390 2023-12-12T17:34:45.181 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:45.175+0000 7f3da51b4640 1 -- 172.21.15.78:0/3669437728 reap_dead start 2023-12-12T17:34:45.189 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:45.179+0000 7f3da51b4640 1 --2- 172.21.15.78:0/3669437728 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3d88005390 0x7f3d8800b990 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f3d9800a7b0 tx=0x7f3d9801fa20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ac528bda0d6fb8f7 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T17:34:45.189 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:45.179+0000 7f3d9f7fe640 1 -- 172.21.15.78:0/3669437728 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d980aa650 con 0x7f3d88005390 2023-12-12T17:34:45.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:45.179+0000 7f3d9f7fe640 1 -- 172.21.15.78:0/3669437728 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d980aa7d0 con 0x7f3d88005390 2023-12-12T17:34:45.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:45.179+0000 7f3d9f7fe640 1 -- 172.21.15.78:0/3669437728 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d980aab80 con 0x7f3d88005390 2023-12-12T17:34:45.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:45.179+0000 7f3da59b5640 1 -- 172.21.15.78:0/3669437728 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3d88005390 msgr2=0x7f3d8800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:34:45.190 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:45.179+0000 7f3da59b5640 1 --2- 172.21.15.78:0/3669437728 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3d88005390 0x7f3d8800b990 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f3d9800a7b0 tx=0x7f3d9801fa20 comp rx=0 tx=0).stop 2023-12-12T17:34:45.191 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:45.183+0000 7f3da59b5640 1 -- 172.21.15.78:0/3669437728 shutdown_connections 2023-12-12T17:34:45.192 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:45.183+0000 7f3da59b5640 1 --2- 172.21.15.78:0/3669437728 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3d88005390 0x7f3d8800b990 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:45.192 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:45.183+0000 7f3da59b5640 1 -- 172.21.15.78:0/3669437728 >> 172.21.15.78:0/3669437728 conn(0x7f3da00b07c0 msgr2=0x7f3da00b0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T17:34:45.192 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:45.183+0000 7f3da59b5640 1 -- 172.21.15.78:0/3669437728 shutdown_connections 2023-12-12T17:34:45.192 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:45.183+0000 7f3da59b5640 1 -- 172.21.15.78:0/3669437728 wait complete. 2023-12-12T17:34:45.209 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:45.195+0000 7f3da59b5640 1 Processor -- start 2023-12-12T17:34:45.209 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:45.199+0000 7f3da59b5640 1 -- start start 2023-12-12T17:34:45.209 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:45.199+0000 7f3da59b5640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3d88005390 0x7f3da01fae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:34:45.209 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:45.199+0000 7f3da59b5640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3da00a8470 0x7f3da00a9ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:34:45.209 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:45.199+0000 7f3da59b5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3da00add90 0x7f3da0070010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:34:45.210 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:45.203+0000 7f3d9ffff640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3da00a8470 0x7f3da00a9ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:34:45.210 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:45.203+0000 7f3da49b3640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3d88005390 0x7f3da01fae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:34:45.210 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:45.203+0000 7f3d9ffff640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3da00a8470 0x7f3da00a9ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.78:46206/0 (socket says 172.21.15.78:46206) 2023-12-12T17:34:45.210 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:45.203+0000 7f3da49b3640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3d88005390 0x7f3da01fae30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.78:40004/0 (socket says 172.21.15.78:40004) 2023-12-12T17:34:45.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:45.211+0000 7f3da59b5640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3da01fb370 con 0x7f3da00add90 2023-12-12T17:34:45.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:45.211+0000 7f3da59b5640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3da00aa010 con 0x7f3d88005390 2023-12-12T17:34:45.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:45.211+0000 7f3da59b5640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3da00a8a30 con 0x7f3da00a8470 2023-12-12T17:34:45.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:45.215+0000 7f3da51b4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3da00add90 0x7f3da0070010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:34:45.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:45.215+0000 7f3da51b4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3da00add90 0x7f3da0070010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:36016/0 (socket says 172.21.15.78:36016) 2023-12-12T17:34:45.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:45.215+0000 7f3da51b4640 1 -- 172.21.15.78:0/3115598151 learned_addr learned my addr 172.21.15.78:0/3115598151 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T17:34:45.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:45.215+0000 7f3da49b3640 1 -- 172.21.15.78:0/3115598151 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3da00a8470 msgr2=0x7f3da00a9ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:34:45.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:45.215+0000 7f3da49b3640 1 --2- 172.21.15.78:0/3115598151 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3da00a8470 0x7f3da00a9ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:45.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:45.215+0000 7f3da49b3640 1 -- 172.21.15.78:0/3115598151 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3da00add90 msgr2=0x7f3da0070010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:34:45.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:45.215+0000 7f3da49b3640 1 --2- 172.21.15.78:0/3115598151 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3da00add90 0x7f3da0070010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:45.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:45.215+0000 7f3da49b3640 1 -- 172.21.15.78:0/3115598151 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3da00a8d10 con 0x7f3d88005390 2023-12-12T17:34:45.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:45.219+0000 7f3da49b3640 1 --2- 172.21.15.78:0/3115598151 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3d88005390 0x7f3da01fae30 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f3d9400e840 tx=0x7f3d9400ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T17:34:45.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:45.219+0000 7f3d9d7fa640 1 -- 172.21.15.78:0/3115598151 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d9400ce00 con 0x7f3d88005390 2023-12-12T17:34:45.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:45.219+0000 7f3d9d7fa640 1 -- 172.21.15.78:0/3115598151 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d9400a920 con 0x7f3d88005390 2023-12-12T17:34:45.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:45.219+0000 7f3d9ffff640 1 --2- 172.21.15.78:0/3115598151 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3da00a8470 0x7f3da00a9ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2023-12-12T17:34:45.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:45.219+0000 7f3d9d7fa640 1 -- 172.21.15.78:0/3115598151 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d9400acb0 con 0x7f3d88005390 2023-12-12T17:34:45.233 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:45.219+0000 7f3da59b5640 1 -- 172.21.15.78:0/3115598151 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3da00a8ff0 con 0x7f3d88005390 2023-12-12T17:34:45.234 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:45.219+0000 7f3da59b5640 1 -- 172.21.15.78:0/3115598151 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3da00a95b0 con 0x7f3d88005390 2023-12-12T17:34:45.234 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:45.223+0000 7f3da59b5640 1 -- 172.21.15.78:0/3115598151 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3da00a97d0 con 0x7f3d88005390 2023-12-12T17:34:45.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:45.243+0000 7f3d9d7fa640 1 -- 172.21.15.78:0/3115598151 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3d94015480 con 0x7f3d88005390 2023-12-12T17:34:45.258 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:45.251+0000 7f3d9d7fa640 1 --2- 172.21.15.78:0/3115598151 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f3d8c0664a0 0x7f3d8c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:34:45.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:45.251+0000 7f3d9d7fa640 1 -- 172.21.15.78:0/3115598151 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5706+0+0 (secure 0 0 0) 0x7f3d94084da0 con 0x7f3d88005390 2023-12-12T17:34:45.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:45.251+0000 7f3d9d7fa640 1 -- 172.21.15.78:0/3115598151 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3d94085310 con 0x7f3d88005390 2023-12-12T17:34:45.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:45.251+0000 7f3d9ffff640 1 --2- 172.21.15.78:0/3115598151 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f3d8c0664a0 0x7f3d8c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:34:45.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:45.259+0000 7f3d9ffff640 1 --2- 172.21.15.78:0/3115598151 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f3d8c0664a0 0x7f3d8c068960 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f3da0163ed0 tx=0x7f3d90008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T17:34:45.718 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:45.711+0000 7f3da59b5640 1 -- 172.21.15.78:0/3115598151 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f3da0074610 con 0x7f3d88005390 2023-12-12T17:34:45.968 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:45.959+0000 7f3d9d7fa640 1 -- 172.21.15.78:0/3115598151 <== mon.1 v2:172.21.15.187:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v44) v1 ==== 169+0+0 (secure 0 0 0) 0x7f3d94052300 con 0x7f3d88005390 2023-12-12T17:34:45.968 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'cephfs_data' removed 2023-12-12T17:34:45.972 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:45.967+0000 7f3da59b5640 1 -- 172.21.15.78:0/3115598151 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f3d8c0664a0 msgr2=0x7f3d8c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:34:45.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:45.971+0000 7f3da59b5640 1 --2- 172.21.15.78:0/3115598151 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f3d8c0664a0 0x7f3d8c068960 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f3da0163ed0 tx=0x7f3d90008040 comp rx=0 tx=0).stop 2023-12-12T17:34:45.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:45.971+0000 7f3da59b5640 1 -- 172.21.15.78:0/3115598151 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3d88005390 msgr2=0x7f3da01fae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:34:45.976 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:45.971+0000 7f3da59b5640 1 --2- 172.21.15.78:0/3115598151 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3d88005390 0x7f3da01fae30 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f3d9400e840 tx=0x7f3d9400ed00 comp rx=0 tx=0).stop 2023-12-12T17:34:45.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:45.975+0000 7f3da59b5640 1 -- 172.21.15.78:0/3115598151 shutdown_connections 2023-12-12T17:34:45.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:45.975+0000 7f3da59b5640 1 --2- 172.21.15.78:0/3115598151 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f3d8c0664a0 0x7f3d8c068960 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:45.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:45.975+0000 7f3da59b5640 1 --2- 172.21.15.78:0/3115598151 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f3da00add90 0x7f3da0070010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:45.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:45.975+0000 7f3da59b5640 1 --2- 172.21.15.78:0/3115598151 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3da00a8470 0x7f3da00a9ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:45.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:45.975+0000 7f3da59b5640 1 --2- 172.21.15.78:0/3115598151 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3d88005390 0x7f3da01fae30 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:45.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:45.975+0000 7f3da59b5640 1 -- 172.21.15.78:0/3115598151 >> 172.21.15.78:0/3115598151 conn(0x7f3da00b07c0 msgr2=0x7f3da00ae7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T17:34:45.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:45.975+0000 7f3da59b5640 1 -- 172.21.15.78:0/3115598151 shutdown_connections 2023-12-12T17:34:45.984 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:45.975+0000 7f3da59b5640 1 -- 172.21.15.78:0/3115598151 wait complete. 2023-12-12T17:34:46.019 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-12-12T17:34:46.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:46.559+0000 7fe5f67c4640 1 Processor -- start 2023-12-12T17:34:46.568 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:46.559+0000 7fe5f67c4640 1 -- start start 2023-12-12T17:34:46.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:46.563+0000 7fe5f67c4640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe5f0071d40 0x7fe5f0164fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:34:46.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:46.567+0000 7fe5f67c4640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe5f01654e0 0x7fe5f00b2c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:34:46.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:46.567+0000 7fe5f67c4640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5f0165940 con 0x7fe5f00b31b0 2023-12-12T17:34:46.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:46.567+0000 7fe5f67c4640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5f0072120 con 0x7fe5f0071d40 2023-12-12T17:34:46.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:46.567+0000 7fe5f67c4640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f00b39a0 con 0x7fe5f01654e0 2023-12-12T17:34:46.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:46.567+0000 7fe5f4d61640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fe5f00b31b0 0x7fe5f0161960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:44770/0 (socket says 172.21.15.78:44770) 2023-12-12T17:34:46.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:46.567+0000 7fe5f4d61640 1 -- 172.21.15.78:0/3141969708 learned_addr learned my addr 172.21.15.78:0/3141969708 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-12-12T17:34:46.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:46.567+0000 7fe5effff640 1 --2- 172.21.15.78:0/3141969708 >> v2:172.21.15.78:3300/0 conn(0x7fe5f0071d40 0x7fe5f0164fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:34:46.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:46.567+0000 7fe5eeffd640 1 -- 172.21.15.78:0/3141969708 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 647304578 0 0) 0x7fe5f0165940 con 0x7fe5f00b31b0 2023-12-12T17:34:46.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:46.567+0000 7fe5eeffd640 1 -- 172.21.15.78:0/3141969708 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5d8003530 con 0x7fe5f00b31b0 2023-12-12T17:34:46.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:46.567+0000 7fe5eeffd640 1 -- 172.21.15.78:0/3141969708 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 428041309 0 0) 0x7fe5d8003530 con 0x7fe5f00b31b0 2023-12-12T17:34:46.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:46.567+0000 7fe5eeffd640 1 -- 172.21.15.78:0/3141969708 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe5f01654e0 msgr2=0x7fe5f00b2c70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-12-12T17:34:46.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:46.567+0000 7fe5eeffd640 1 --2- 172.21.15.78:0/3141969708 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe5f01654e0 0x7fe5f00b2c70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:46.575 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:46.567+0000 7fe5eeffd640 1 -- 172.21.15.78:0/3141969708 >> v2:172.21.15.78:3300/0 conn(0x7fe5f0071d40 msgr2=0x7fe5f0164fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T17:34:46.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:46.567+0000 7fe5eeffd640 1 --2- 172.21.15.78:0/3141969708 >> v2:172.21.15.78:3300/0 conn(0x7fe5f0071d40 0x7fe5f0164fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:46.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:46.567+0000 7fe5eeffd640 1 -- 172.21.15.78:0/3141969708 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5f00b3c80 con 0x7fe5f00b31b0 2023-12-12T17:34:46.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:46.567+0000 7fe5eeffd640 1 -- 172.21.15.78:0/3141969708 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 465499599 0 0) 0x7fe5e8001a00 con 0x7fe5f00b31b0 2023-12-12T17:34:46.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:46.567+0000 7fe5eeffd640 1 -- 172.21.15.78:0/3141969708 >> v1:172.21.15.78:6789/0 conn(0x7fe5f00b31b0 legacy=0x7fe5f0161960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:34:46.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:46.567+0000 7fe5eeffd640 1 --2- 172.21.15.78:0/3141969708 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe5d8003980 0x7fe5d8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:34:46.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:46.567+0000 7fe5eeffd640 1 --2- 172.21.15.78:0/3141969708 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe5d80047d0 0x7fe5d8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:34:46.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:46.567+0000 7fe5eeffd640 1 --2- 172.21.15.78:0/3141969708 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe5d8005190 0x7fe5d800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:34:46.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:46.567+0000 7fe5eeffd640 1 -- 172.21.15.78:0/3141969708 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f0072120 con 0x7fe5d8005190 2023-12-12T17:34:46.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:46.567+0000 7fe5eeffd640 1 -- 172.21.15.78:0/3141969708 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f00b39a0 con 0x7fe5d8003980 2023-12-12T17:34:46.578 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:46.567+0000 7fe5eeffd640 1 -- 172.21.15.78:0/3141969708 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5d800c030 con 0x7fe5d80047d0 2023-12-12T17:34:46.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:46.571+0000 7fe5effff640 1 --2- 172.21.15.78:0/3141969708 >> v2:172.21.15.78:3300/0 conn(0x7fe5f0071d40 0x7fe5f0164fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-12T17:34:46.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:46.571+0000 7fe5f4d61640 1 --2- 172.21.15.78:0/3141969708 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe5d8005190 0x7fe5d800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:34:46.580 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:46.571+0000 7fe5ef7fe640 1 --2- 172.21.15.78:0/3141969708 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe5d80047d0 0x7fe5d8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:34:46.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:46.571+0000 7fe5f4d61640 1 -- 172.21.15.78:0/3141969708 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe5d80047d0 msgr2=0x7fe5d8004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T17:34:46.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:46.571+0000 7fe5f4d61640 1 --2- 172.21.15.78:0/3141969708 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe5d80047d0 0x7fe5d8004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:46.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:46.571+0000 7fe5f4d61640 1 -- 172.21.15.78:0/3141969708 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe5d8003980 msgr2=0x7fe5d8003da0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-12-12T17:34:46.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:46.571+0000 7fe5f4d61640 1 --2- 172.21.15.78:0/3141969708 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe5d8003980 0x7fe5d8003da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:46.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:46.571+0000 7fe5f4d61640 1 -- 172.21.15.78:0/3141969708 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5d8003530 con 0x7fe5d8005190 2023-12-12T17:34:46.585 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:46.579+0000 7fe5f4d61640 1 --2- 172.21.15.78:0/3141969708 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe5d8005190 0x7fe5d800b990 secure :-1 s=READY pgs=2116 cs=0 l=1 rev1=1 crypto rx=0x7fe5e800a810 tx=0x7fe5e801d320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba1c3b45be80c054 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T17:34:46.588 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:46.579+0000 7fe5eeffd640 1 -- 172.21.15.78:0/3141969708 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e80ad630 con 0x7fe5d8005190 2023-12-12T17:34:46.588 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:46.579+0000 7fe5eeffd640 1 -- 172.21.15.78:0/3141969708 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5e80a8070 con 0x7fe5d8005190 2023-12-12T17:34:46.589 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:46.579+0000 7fe5eeffd640 1 -- 172.21.15.78:0/3141969708 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e80ada10 con 0x7fe5d8005190 2023-12-12T17:34:46.589 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:46.579+0000 7fe5f67c4640 1 -- 172.21.15.78:0/3141969708 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe5d8005190 msgr2=0x7fe5d800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:34:46.589 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:46.579+0000 7fe5f67c4640 1 --2- 172.21.15.78:0/3141969708 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe5d8005190 0x7fe5d800b990 secure :-1 s=READY pgs=2116 cs=0 l=1 rev1=1 crypto rx=0x7fe5e800a810 tx=0x7fe5e801d320 comp rx=0 tx=0).stop 2023-12-12T17:34:46.589 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:46.579+0000 7fe5f4d61640 1 -- 172.21.15.78:0/3141969708 reap_dead start 2023-12-12T17:34:46.589 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:46.579+0000 7fe5f67c4640 1 -- 172.21.15.78:0/3141969708 shutdown_connections 2023-12-12T17:34:46.589 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:46.579+0000 7fe5f67c4640 1 -- 172.21.15.78:0/3141969708 >> 172.21.15.78:0/3141969708 conn(0x7fe5f006a710 msgr2=0x7fe5f006ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T17:34:46.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:46.587+0000 7fe5f67c4640 1 -- 172.21.15.78:0/3141969708 shutdown_connections 2023-12-12T17:34:46.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:46.587+0000 7fe5f67c4640 1 -- 172.21.15.78:0/3141969708 wait complete. 2023-12-12T17:34:46.600 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:46.595+0000 7fe5f67c4640 1 Processor -- start 2023-12-12T17:34:46.604 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:46.595+0000 7fe5f67c4640 1 -- start start 2023-12-12T17:34:46.607 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:46.599+0000 7fe5f67c4640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe5d8005190 0x7fe5f015ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:34:46.608 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:46.603+0000 7fe5effff640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe5d8005190 0x7fe5f015ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:34:46.608 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:46.603+0000 7fe5effff640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe5d8005190 0x7fe5f015ea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.78:40036/0 (socket says 172.21.15.78:40036) 2023-12-12T17:34:46.609 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:46.603+0000 7fe5f67c4640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe5f00cdc50 0x7fe5f0156e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:34:46.609 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:46.603+0000 7fe5f67c4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe5f015c9f0 0x7fe5f0161280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:34:46.609 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:46.603+0000 7fe5f67c4640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f0141f80 con 0x7fe5f015c9f0 2023-12-12T17:34:46.609 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:46.603+0000 7fe5f67c4640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f015efd0 con 0x7fe5d8005190 2023-12-12T17:34:46.609 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:46.603+0000 7fe5f67c4640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f015d360 con 0x7fe5f00cdc50 2023-12-12T17:34:46.610 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:46.603+0000 7fe5effff640 1 -- 172.21.15.78:0/539313066 learned_addr learned my addr 172.21.15.78:0/539313066 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T17:34:46.611 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:46.603+0000 7fe5ef7fe640 1 --2- 172.21.15.78:0/539313066 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe5f00cdc50 0x7fe5f0156e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:34:46.612 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:46.603+0000 7fe5f4d61640 1 --2- 172.21.15.78:0/539313066 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe5f015c9f0 0x7fe5f0161280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:34:46.612 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:46.603+0000 7fe5effff640 1 -- 172.21.15.78:0/539313066 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe5f00cdc50 msgr2=0x7fe5f0156e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:34:46.612 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:46.603+0000 7fe5effff640 1 --2- 172.21.15.78:0/539313066 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe5f00cdc50 0x7fe5f0156e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:46.612 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:46.603+0000 7fe5effff640 1 -- 172.21.15.78:0/539313066 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe5f015c9f0 msgr2=0x7fe5f0161280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:34:46.612 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:46.603+0000 7fe5effff640 1 --2- 172.21.15.78:0/539313066 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe5f015c9f0 0x7fe5f0161280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:46.612 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:46.603+0000 7fe5effff640 1 -- 172.21.15.78:0/539313066 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5f0141930 con 0x7fe5d8005190 2023-12-12T17:34:46.613 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:46.603+0000 7fe5f4d61640 1 --2- 172.21.15.78:0/539313066 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe5f015c9f0 0x7fe5f0161280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T17:34:46.614 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:46.607+0000 7fe5effff640 1 --2- 172.21.15.78:0/539313066 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe5d8005190 0x7fe5f015ea90 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fe5e400e950 tx=0x7fe5e400ee10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T17:34:46.615 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:46.607+0000 7fe5ecff9640 1 -- 172.21.15.78:0/539313066 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e4009720 con 0x7fe5d8005190 2023-12-12T17:34:46.615 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:46.607+0000 7fe5ecff9640 1 -- 172.21.15.78:0/539313066 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5e400ca00 con 0x7fe5d8005190 2023-12-12T17:34:46.615 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:46.607+0000 7fe5ecff9640 1 -- 172.21.15.78:0/539313066 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e400cd90 con 0x7fe5d8005190 2023-12-12T17:34:46.615 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:46.607+0000 7fe5f67c4640 1 -- 172.21.15.78:0/539313066 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5f0141c10 con 0x7fe5d8005190 2023-12-12T17:34:46.623 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:46.615+0000 7fe5f67c4640 1 -- 172.21.15.78:0/539313066 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5f015cea0 con 0x7fe5d8005190 2023-12-12T17:34:46.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:46.619+0000 7fe5ecff9640 1 -- 172.21.15.78:0/539313066 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe5e4013470 con 0x7fe5d8005190 2023-12-12T17:34:46.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:46.623+0000 7fe5f67c4640 1 -- 172.21.15.78:0/539313066 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5f00671f0 con 0x7fe5d8005190 2023-12-12T17:34:46.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:46.623+0000 7fe5ecff9640 1 --2- 172.21.15.78:0/539313066 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fe5dc0664a0 0x7fe5dc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:34:46.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:46.623+0000 7fe5ecff9640 1 -- 172.21.15.78:0/539313066 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fe5e4054d80 con 0x7fe5d8005190 2023-12-12T17:34:46.632 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:46.623+0000 7fe5ef7fe640 1 --2- 172.21.15.78:0/539313066 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fe5dc0664a0 0x7fe5dc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:34:46.633 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:46.627+0000 7fe5ef7fe640 1 --2- 172.21.15.78:0/539313066 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fe5dc0664a0 0x7fe5dc068960 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fe5f01fa7b0 tx=0x7fe5e0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T17:34:46.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:46.631+0000 7fe5ecff9640 1 -- 172.21.15.78:0/539313066 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe5e4017080 con 0x7fe5d8005190 2023-12-12T17:34:47.127 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:47.119+0000 7fe5f67c4640 1 -- 172.21.15.78:0/539313066 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fe5f015d120 con 0x7fe5d8005190 2023-12-12T17:34:47.275 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:47.267+0000 7fe5ecff9640 1 -- 172.21.15.78:0/539313066 <== mon.1 v2:172.21.15.187:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7fe5f015d120 con 0x7fe5d8005190 2023-12-12T17:34:47.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:47.275+0000 7fe5f67c4640 1 -- 172.21.15.78:0/539313066 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fe5dc0664a0 msgr2=0x7fe5dc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:34:47.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:47.275+0000 7fe5f67c4640 1 --2- 172.21.15.78:0/539313066 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fe5dc0664a0 0x7fe5dc068960 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fe5f01fa7b0 tx=0x7fe5e0008040 comp rx=0 tx=0).stop 2023-12-12T17:34:47.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:47.275+0000 7fe5f67c4640 1 -- 172.21.15.78:0/539313066 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe5d8005190 msgr2=0x7fe5f015ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:34:47.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:47.275+0000 7fe5f67c4640 1 --2- 172.21.15.78:0/539313066 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe5d8005190 0x7fe5f015ea90 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fe5e400e950 tx=0x7fe5e400ee10 comp rx=0 tx=0).stop 2023-12-12T17:34:47.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:47.279+0000 7fe5f67c4640 1 -- 172.21.15.78:0/539313066 shutdown_connections 2023-12-12T17:34:47.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:47.279+0000 7fe5f67c4640 1 --2- 172.21.15.78:0/539313066 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fe5dc0664a0 0x7fe5dc068960 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:47.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:47.279+0000 7fe5f67c4640 1 --2- 172.21.15.78:0/539313066 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe5f015c9f0 0x7fe5f0161280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:47.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:47.279+0000 7fe5f67c4640 1 --2- 172.21.15.78:0/539313066 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe5f00cdc50 0x7fe5f0156e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:47.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:47.279+0000 7fe5f67c4640 1 --2- 172.21.15.78:0/539313066 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe5d8005190 0x7fe5f015ea90 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:47.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:47.279+0000 7fe5f67c4640 1 -- 172.21.15.78:0/539313066 >> 172.21.15.78:0/539313066 conn(0x7fe5f006a710 msgr2=0x7fe5f006d870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T17:34:47.288 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:47.279+0000 7fe5f67c4640 1 -- 172.21.15.78:0/539313066 shutdown_connections 2023-12-12T17:34:47.288 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:47.279+0000 7fe5f67c4640 1 -- 172.21.15.78:0/539313066 wait complete. 2023-12-12T17:34:47.327 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic' 2023-12-12T17:34:47.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:47.847+0000 7f2cf9a9a640 1 Processor -- start 2023-12-12T17:34:47.855 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:47.847+0000 7f2cf9a9a640 1 -- start start 2023-12-12T17:34:47.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:47.863+0000 7f2cf9a9a640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2cf41401a0 0x7f2cf40b2070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:34:47.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:47.863+0000 7f2cf9a9a640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f2cf41613e0 0x7f2cf40ac880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:34:47.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:47.863+0000 7f2cf9a9a640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cf40b4f10 con 0x7f2cf4161900 2023-12-12T17:34:47.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:47.863+0000 7f2cf9a9a640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cf40b4a80 con 0x7f2cf41613e0 2023-12-12T17:34:47.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:47.863+0000 7f2cf9a9a640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cf40b3bd0 con 0x7f2cf41401a0 2023-12-12T17:34:47.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:47.863+0000 7f2cf3fff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f2cf41613e0 0x7f2cf40ac880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:34:47.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:47.863+0000 7f2cf3fff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f2cf41613e0 0x7f2cf40ac880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:36048/0 (socket says 172.21.15.78:36048) 2023-12-12T17:34:47.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:47.863+0000 7f2cf3fff640 1 -- 172.21.15.78:0/3436070311 learned_addr learned my addr 172.21.15.78:0/3436070311 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T17:34:47.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:47.871+0000 7f2cf37fe640 1 --2- 172.21.15.78:0/3436070311 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2cf41401a0 0x7f2cf40b2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:34:47.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:47.871+0000 7f2cf3fff640 1 -- 172.21.15.78:0/3436070311 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2cf41401a0 msgr2=0x7f2cf40b2070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T17:34:47.878 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:47.871+0000 7f2cf3fff640 1 --2- 172.21.15.78:0/3436070311 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2cf41401a0 0x7f2cf40b2070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:47.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:47.871+0000 7f2cf3fff640 1 -- 172.21.15.78:0/3436070311 >> v1:172.21.15.187:6789/0 conn(0x7f2cf4161900 legacy=0x7f2cf4160cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T17:34:47.879 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:47.871+0000 7f2cf3fff640 1 -- 172.21.15.78:0/3436070311 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cf40b3e70 con 0x7f2cf41613e0 2023-12-12T17:34:47.901 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:47.887+0000 7f2cf3fff640 1 --2- 172.21.15.78:0/3436070311 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2cf41613e0 0x7f2cf40ac880 secure :-1 s=READY pgs=2117 cs=0 l=1 rev1=1 crypto rx=0x7f2ce4009870 tx=0x7f2ce401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f96392188a8e9687 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T17:34:47.906 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:47.899+0000 7f2cf27fc640 1 -- 172.21.15.78:0/3436070311 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ce40aa5f0 con 0x7f2cf41613e0 2023-12-12T17:34:47.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:47.899+0000 7f2cf27fc640 1 -- 172.21.15.78:0/3436070311 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ce40aa750 con 0x7f2cf41613e0 2023-12-12T17:34:47.907 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:47.899+0000 7f2cf27fc640 1 -- 172.21.15.78:0/3436070311 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ce40aaae0 con 0x7f2cf41613e0 2023-12-12T17:34:47.908 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:47.899+0000 7f2cf9a9a640 1 -- 172.21.15.78:0/3436070311 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2cf41613e0 msgr2=0x7f2cf40ac880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:34:47.908 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:47.899+0000 7f2cf9a9a640 1 --2- 172.21.15.78:0/3436070311 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2cf41613e0 0x7f2cf40ac880 secure :-1 s=READY pgs=2117 cs=0 l=1 rev1=1 crypto rx=0x7f2ce4009870 tx=0x7f2ce401c4d0 comp rx=0 tx=0).stop 2023-12-12T17:34:47.910 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:47.903+0000 7f2cf9a9a640 1 -- 172.21.15.78:0/3436070311 shutdown_connections 2023-12-12T17:34:47.910 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:47.903+0000 7f2cf9a9a640 1 --2- 172.21.15.78:0/3436070311 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2cf41613e0 0x7f2cf40ac880 unknown :-1 s=CLOSED pgs=2117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:47.910 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:47.903+0000 7f2cf9a9a640 1 --2- 172.21.15.78:0/3436070311 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2cf41401a0 0x7f2cf40b2070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:47.910 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:47.903+0000 7f2cf9a9a640 1 -- 172.21.15.78:0/3436070311 >> 172.21.15.78:0/3436070311 conn(0x7f2cf406c5d0 msgr2=0x7f2cf406c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T17:34:47.911 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:47.903+0000 7f2cf9a9a640 1 -- 172.21.15.78:0/3436070311 shutdown_connections 2023-12-12T17:34:47.915 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:47.903+0000 7f2cf9a9a640 1 -- 172.21.15.78:0/3436070311 wait complete. 2023-12-12T17:34:47.917 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:47.911+0000 7f2cf9a9a640 1 Processor -- start 2023-12-12T17:34:47.918 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:47.911+0000 7f2cf9a9a640 1 -- start start 2023-12-12T17:34:47.929 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:47.911+0000 7f2cf9a9a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2cf41401a0 0x7f2cf4156cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:34:47.929 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:47.911+0000 7f2cf9a9a640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2cf41613e0 0x7f2cf413b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:34:47.929 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:47.911+0000 7f2cf9a9a640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2cf4161900 0x7f2cf41547c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:34:47.929 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:47.911+0000 7f2cf9a9a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cf4070630 con 0x7f2cf41401a0 2023-12-12T17:34:47.929 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:47.911+0000 7f2cf9a9a640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cf40708d0 con 0x7f2cf4161900 2023-12-12T17:34:47.929 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:47.911+0000 7f2cf9a9a640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cf413f050 con 0x7f2cf41613e0 2023-12-12T17:34:47.930 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:47.915+0000 7f2cf2ffd640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2cf41613e0 0x7f2cf413b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:34:47.930 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:47.915+0000 7f2cf2ffd640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2cf41613e0 0x7f2cf413b3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.78:46266/0 (socket says 172.21.15.78:46266) 2023-12-12T17:34:47.930 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:47.915+0000 7f2cf2ffd640 1 -- 172.21.15.78:0/775919650 learned_addr learned my addr 172.21.15.78:0/775919650 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T17:34:47.930 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:47.919+0000 7f2cf3fff640 1 --2- 172.21.15.78:0/775919650 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2cf4161900 0x7f2cf41547c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:34:47.930 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:47.923+0000 7f2cf37fe640 1 --2- 172.21.15.78:0/775919650 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2cf41401a0 0x7f2cf4156cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:34:47.931 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:47.923+0000 7f2cf2ffd640 1 -- 172.21.15.78:0/775919650 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2cf4161900 msgr2=0x7f2cf41547c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:34:47.932 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:47.923+0000 7f2cf2ffd640 1 --2- 172.21.15.78:0/775919650 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2cf4161900 0x7f2cf41547c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:47.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:47.927+0000 7f2cf2ffd640 1 -- 172.21.15.78:0/775919650 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2cf41401a0 msgr2=0x7f2cf4156cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:34:47.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:47.927+0000 7f2cf2ffd640 1 --2- 172.21.15.78:0/775919650 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2cf41401a0 0x7f2cf4156cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:47.934 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:47.927+0000 7f2cf2ffd640 1 -- 172.21.15.78:0/775919650 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ce40094d0 con 0x7f2cf41613e0 2023-12-12T17:34:47.936 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:47.927+0000 7f2cf2ffd640 1 --2- 172.21.15.78:0/775919650 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2cf41613e0 0x7f2cf413b3b0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f2ce800b3e0 tx=0x7f2ce800b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T17:34:47.937 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:47.931+0000 7f2cdbfff640 1 -- 172.21.15.78:0/775919650 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ce8011830 con 0x7f2cf41613e0 2023-12-12T17:34:47.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:47.931+0000 7f2cf9a9a640 1 -- 172.21.15.78:0/775919650 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cf413f330 con 0x7f2cf41613e0 2023-12-12T17:34:47.938 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:47.931+0000 7f2cf9a9a640 1 -- 172.21.15.78:0/775919650 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cf41389d0 con 0x7f2cf41613e0 2023-12-12T17:34:47.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:47.931+0000 7f2cdbfff640 1 -- 172.21.15.78:0/775919650 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ce8011990 con 0x7f2cf41613e0 2023-12-12T17:34:47.939 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:47.931+0000 7f2cdbfff640 1 -- 172.21.15.78:0/775919650 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ce8011830 con 0x7f2cf41613e0 2023-12-12T17:34:47.945 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:47.939+0000 7f2cd9ffb640 1 -- 172.21.15.78:0/775919650 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cf40671f0 con 0x7f2cf41613e0 2023-12-12T17:34:47.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:47.943+0000 7f2cdbfff640 1 -- 172.21.15.78:0/775919650 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2ce8011b40 con 0x7f2cf41613e0 2023-12-12T17:34:47.970 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:47.955+0000 7f2cdbfff640 1 --2- 172.21.15.78:0/775919650 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f2ce00664d0 0x7f2ce0068990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:34:47.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:47.955+0000 7f2cdbfff640 1 -- 172.21.15.78:0/775919650 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f2ce80839d0 con 0x7f2cf41613e0 2023-12-12T17:34:47.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:47.959+0000 7f2cf37fe640 1 --2- 172.21.15.78:0/775919650 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f2ce00664d0 0x7f2ce0068990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:34:47.971 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:47.959+0000 7f2cf37fe640 1 --2- 172.21.15.78:0/775919650 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f2ce00664d0 0x7f2ce0068990 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f2cec003b90 tx=0x7f2cec0098d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T17:34:47.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:47.979+0000 7f2cdbfff640 1 -- 172.21.15.78:0/775919650 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2ce8050f90 con 0x7f2cf41613e0 2023-12-12T17:34:49.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:49.035+0000 7f2cd9ffb640 1 -- 172.21.15.78:0/775919650 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]} v 0) v1 -- 0x7f2cf4067530 con 0x7f2cf41613e0 2023-12-12T17:34:49.280 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:49.271+0000 7f2cdbfff640 1 -- 172.21.15.78:0/775919650 <== mon.2 v2:172.21.15.187:3301/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]}]=0 v13358) v1 ==== 144+0+0 (secure 0 0 0) 0x7f2ce80545b0 con 0x7f2cf41613e0 2023-12-12T17:34:49.298 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:49.291+0000 7f2cd9ffb640 1 -- 172.21.15.78:0/775919650 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f2ce00664d0 msgr2=0x7f2ce0068990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:34:49.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:49.291+0000 7f2cd9ffb640 1 --2- 172.21.15.78:0/775919650 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f2ce00664d0 0x7f2ce0068990 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f2cec003b90 tx=0x7f2cec0098d0 comp rx=0 tx=0).stop 2023-12-12T17:34:49.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:49.291+0000 7f2cd9ffb640 1 -- 172.21.15.78:0/775919650 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2cf41613e0 msgr2=0x7f2cf413b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:34:49.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:49.291+0000 7f2cd9ffb640 1 --2- 172.21.15.78:0/775919650 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2cf41613e0 0x7f2cf413b3b0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f2ce800b3e0 tx=0x7f2ce800b8a0 comp rx=0 tx=0).stop 2023-12-12T17:34:49.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:49.291+0000 7f2cd9ffb640 1 -- 172.21.15.78:0/775919650 shutdown_connections 2023-12-12T17:34:49.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:49.291+0000 7f2cd9ffb640 1 --2- 172.21.15.78:0/775919650 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f2ce00664d0 0x7f2ce0068990 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:49.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:49.291+0000 7f2cd9ffb640 1 --2- 172.21.15.78:0/775919650 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2cf4161900 0x7f2cf41547c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:49.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:49.291+0000 7f2cd9ffb640 1 --2- 172.21.15.78:0/775919650 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2cf41613e0 0x7f2cf413b3b0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:49.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:49.291+0000 7f2cd9ffb640 1 --2- 172.21.15.78:0/775919650 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f2cf41401a0 0x7f2cf4156cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:49.299 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:49.291+0000 7f2cd9ffb640 1 -- 172.21.15.78:0/775919650 >> 172.21.15.78:0/775919650 conn(0x7f2cf406c5d0 msgr2=0x7f2cf406cd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T17:34:49.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:49.299+0000 7f2cd9ffb640 1 -- 172.21.15.78:0/775919650 shutdown_connections 2023-12-12T17:34:49.305 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:49.299+0000 7f2cd9ffb640 1 -- 172.21.15.78:0/775919650 wait complete. 2023-12-12T17:34:49.660 INFO:tasks.cephfs_test_runner:test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) ... FAIL 2023-12-12T17:34:49.661 INFO:tasks.cephfs_test_runner: 2023-12-12T17:34:49.661 INFO:tasks.cephfs_test_runner:====================================================================== 2023-12-12T17:34:49.661 INFO:tasks.cephfs_test_runner:FAIL: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-12-12T17:34:49.661 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-12-12T17:34:49.661 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-12-12T17:34:49.661 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/qa/tasks/cephfs/tests_from_xfstests_dev.py", line 12, in test_generic 2023-12-12T17:34:49.661 INFO:tasks.cephfs_test_runner: self.run_generic_tests() 2023-12-12T17:34:49.661 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/qa/tasks/cephfs/xfstests_dev.py", line 407, in run_generic_tests 2023-12-12T17:34:49.661 INFO:tasks.cephfs_test_runner: return self.run_testdir('generic') 2023-12-12T17:34:49.661 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/qa/tasks/cephfs/xfstests_dev.py", line 399, in run_testdir 2023-12-12T17:34:49.661 INFO:tasks.cephfs_test_runner: self.assertEqual(self.total_tests_failed, 0) 2023-12-12T17:34:49.662 INFO:tasks.cephfs_test_runner:AssertionError: 16 != 0 2023-12-12T17:34:49.662 INFO:tasks.cephfs_test_runner: 2023-12-12T17:34:49.662 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-12-12T17:34:49.662 INFO:tasks.cephfs_test_runner:Ran 1 test in 26515.037s 2023-12-12T17:34:49.662 INFO:tasks.cephfs_test_runner: 2023-12-12T17:34:49.662 INFO:tasks.cephfs_test_runner:FAILED (failures=1) 2023-12-12T17:34:49.662 INFO:tasks.cephfs_test_runner: 2023-12-12T17:34:49.662 INFO:tasks.cephfs_test_runner:====================================================================== 2023-12-12T17:34:49.662 INFO:tasks.cephfs_test_runner:FAIL: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-12-12T17:34:49.662 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-12-12T17:34:49.662 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-12-12T17:34:49.662 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/qa/tasks/cephfs/tests_from_xfstests_dev.py", line 12, in test_generic 2023-12-12T17:34:49.663 INFO:tasks.cephfs_test_runner: self.run_generic_tests() 2023-12-12T17:34:49.663 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/qa/tasks/cephfs/xfstests_dev.py", line 407, in run_generic_tests 2023-12-12T17:34:49.663 INFO:tasks.cephfs_test_runner: return self.run_testdir('generic') 2023-12-12T17:34:49.663 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/qa/tasks/cephfs/xfstests_dev.py", line 399, in run_testdir 2023-12-12T17:34:49.663 INFO:tasks.cephfs_test_runner: self.assertEqual(self.total_tests_failed, 0) 2023-12-12T17:34:49.663 INFO:tasks.cephfs_test_runner:AssertionError: 16 != 0 2023-12-12T17:34:49.663 INFO:tasks.cephfs_test_runner: 2023-12-12T17:34:49.664 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-12-12T17:34:49.763 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=4ad4348061cf44aebb891b9964ad44b5 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_f1fbf3c583d03e19f5e58eb618e78d8e10d075f9/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-12-12T17:34:49.764 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-12-12T17:34:49.774 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2023-12-12T17:34:49.815 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2023-12-12T17:34:49.815 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-12-12T17:34:49.815 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-12T17:34:49.891 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354608k,nr_inodes=4088652,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275372k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=4514 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275368k,nr_inodes=818842,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275372k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-12T17:34:49.892 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2023-12-12T17:34:49.892 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-12T17:34:49.964 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354608k,nr_inodes=4088652,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275372k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=4514 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275368k,nr_inodes=818842,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275372k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-12T17:34:49.964 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-12-12T17:34:49.964 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-12T17:34:50.008 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354632k,nr_inodes=4088658,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2532 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-12T17:34:50.009 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-12-12T17:34:50.009 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-12T17:34:50.066 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354632k,nr_inodes=4088658,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=2532 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-12T17:34:50.066 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T17:34:50.066 DEBUG:teuthology.orchestra.run.smithi187:> ip netns list 2023-12-12T17:34:50.153 INFO:teuthology.orchestra.run.smithi187.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-12T17:34:50.153 INFO:teuthology.orchestra.run.smithi187.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-12-12T17:34:50.154 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T17:34:50.155 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-12T17:34:50.312 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T17:34:50.312 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-12-12T17:34:50.495 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T17:34:50.495 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip link delete ceph-brx 2023-12-12T17:34:50.848 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T17:34:50.848 DEBUG:teuthology.orchestra.run.smithi078:> ip netns list 2023-12-12T17:34:50.940 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-12T17:34:50.941 INFO:teuthology.orchestra.run.smithi078.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-12-12T17:34:50.955 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T17:34:50.955 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-12T17:34:51.233 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T17:34:51.233 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-12T17:34:51.551 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T17:34:51.551 DEBUG:teuthology.orchestra.run.smithi078:> sudo ip link delete ceph-brx 2023-12-12T17:34:51.909 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-12-12T17:34:51.919 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-12-12T17:34:51.919 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-12T17:34:54.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:54.255+0000 7f8a8a4ea640 1 Processor -- start 2023-12-12T17:34:54.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:54.255+0000 7f8a8a4ea640 1 -- start start 2023-12-12T17:34:54.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:54.279+0000 7f8a8a4ea640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f8a840b1270 0x7f8a84070540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:34:54.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:54.279+0000 7f8a8a4ea640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a84070a80 con 0x7f8a84070100 2023-12-12T17:34:54.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:54.279+0000 7f8a8a4ea640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a84159910 con 0x7f8a84141a40 2023-12-12T17:34:54.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:54.279+0000 7f8a8a4ea640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a84159bf0 con 0x7f8a840b1270 2023-12-12T17:34:54.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:54.283+0000 7f8a837fe640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f8a84070100 0x7f8a840cc680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:40936/0 (socket says 172.21.15.78:40936) 2023-12-12T17:34:54.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:54.283+0000 7f8a837fe640 1 -- 172.21.15.78:0/1977939858 learned_addr learned my addr 172.21.15.78:0/1977939858 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-12-12T17:34:54.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:54.283+0000 7f8a88a87640 1 --2- 172.21.15.78:0/1977939858 >> v2:172.21.15.78:3300/0 conn(0x7f8a840b1270 0x7f8a84070540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:34:54.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:54.287+0000 7f8a88a87640 1 -- 172.21.15.78:0/1977939858 >> v1:172.21.15.187:6789/0 conn(0x7f8a84141a40 legacy=0x7f8a8415d4e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-12T17:34:54.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:54.287+0000 7f8a88a87640 1 -- 172.21.15.78:0/1977939858 >> v1:172.21.15.78:6789/0 conn(0x7f8a84070100 legacy=0x7f8a840cc680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T17:34:54.294 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:54.287+0000 7f8a88a87640 1 -- 172.21.15.78:0/1977939858 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a84159ed0 con 0x7f8a840b1270 2023-12-12T17:34:54.316 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:54.307+0000 7f8a88a87640 1 --2- 172.21.15.78:0/1977939858 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8a840b1270 0x7f8a84070540 secure :-1 s=READY pgs=2119 cs=0 l=1 rev1=1 crypto rx=0x7f8a7c014a00 tx=0x7f8a7c025480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e44b26a7f284e0df server_cookie=0 in_seq=0 out_seq=0 2023-12-12T17:34:54.319 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:54.311+0000 7f8a82ffd640 1 -- 172.21.15.78:0/1977939858 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a7c00fd40 con 0x7f8a840b1270 2023-12-12T17:34:54.320 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:54.311+0000 7f8a82ffd640 1 -- 172.21.15.78:0/1977939858 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a7c0110d0 con 0x7f8a840b1270 2023-12-12T17:34:54.321 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:54.315+0000 7f8a82ffd640 1 -- 172.21.15.78:0/1977939858 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a7c00fd40 con 0x7f8a840b1270 2023-12-12T17:34:54.323 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:54.315+0000 7f8a8a4ea640 1 -- 172.21.15.78:0/1977939858 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8a840b1270 msgr2=0x7f8a84070540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:34:54.324 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:54.315+0000 7f8a8a4ea640 1 --2- 172.21.15.78:0/1977939858 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8a840b1270 0x7f8a84070540 secure :-1 s=READY pgs=2119 cs=0 l=1 rev1=1 crypto rx=0x7f8a7c014a00 tx=0x7f8a7c025480 comp rx=0 tx=0).stop 2023-12-12T17:34:54.331 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:54.323+0000 7f8a8a4ea640 1 -- 172.21.15.78:0/1977939858 shutdown_connections 2023-12-12T17:34:54.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:54.323+0000 7f8a8a4ea640 1 --2- 172.21.15.78:0/1977939858 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8a840b1270 0x7f8a84070540 unknown :-1 s=CLOSED pgs=2119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:54.332 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:54.323+0000 7f8a8a4ea640 1 -- 172.21.15.78:0/1977939858 >> 172.21.15.78:0/1977939858 conn(0x7f8a840b0750 msgr2=0x7f8a840b0b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T17:34:54.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:54.331+0000 7f8a8a4ea640 1 -- 172.21.15.78:0/1977939858 shutdown_connections 2023-12-12T17:34:54.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:54.335+0000 7f8a8a4ea640 1 -- 172.21.15.78:0/1977939858 wait complete. 2023-12-12T17:34:54.373 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:54.359+0000 7f8a8a4ea640 1 Processor -- start 2023-12-12T17:34:54.387 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:54.371+0000 7f8a8a4ea640 1 -- start start 2023-12-12T17:34:54.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:54.383+0000 7f8a8a4ea640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8a84070100 0x7f8a840b3d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:34:54.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:54.383+0000 7f8a8a4ea640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8a840b1270 0x7f8a84154090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:34:54.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:54.383+0000 7f8a8a4ea640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8a84141a40 0x7f8a841545d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:34:54.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:54.383+0000 7f8a8a4ea640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a84132ef0 con 0x7f8a84070100 2023-12-12T17:34:54.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:54.383+0000 7f8a8a4ea640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a84154b10 con 0x7f8a84141a40 2023-12-12T17:34:54.392 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:54.383+0000 7f8a8a4ea640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a8413dea0 con 0x7f8a840b1270 2023-12-12T17:34:54.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:54.383+0000 7f8a83fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8a84070100 0x7f8a840b3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:34:54.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:54.383+0000 7f8a83fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8a84070100 0x7f8a840b3d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54676/0 (socket says 172.21.15.78:54676) 2023-12-12T17:34:54.393 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:54.383+0000 7f8a83fff640 1 -- 172.21.15.78:0/3885390506 learned_addr learned my addr 172.21.15.78:0/3885390506 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T17:34:54.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:54.387+0000 7f8a88a87640 1 --2- 172.21.15.78:0/3885390506 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8a84141a40 0x7f8a841545d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:34:54.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:54.387+0000 7f8a88a87640 1 -- 172.21.15.78:0/3885390506 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8a840b1270 msgr2=0x7f8a84154090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:34:54.396 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:54.387+0000 7f8a88a87640 1 --2- 172.21.15.78:0/3885390506 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8a840b1270 0x7f8a84154090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:54.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:54.387+0000 7f8a88a87640 1 -- 172.21.15.78:0/3885390506 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8a84070100 msgr2=0x7f8a840b3d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:34:54.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:54.387+0000 7f8a88a87640 1 --2- 172.21.15.78:0/3885390506 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8a84070100 0x7f8a840b3d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:54.397 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:54.387+0000 7f8a88a87640 1 -- 172.21.15.78:0/3885390506 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a7c014660 con 0x7f8a84141a40 2023-12-12T17:34:54.401 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:54.395+0000 7f8a88a87640 1 --2- 172.21.15.78:0/3885390506 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8a84141a40 0x7f8a841545d0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f8a7c0b3000 tx=0x7f8a7c022220 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T17:34:54.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:54.399+0000 7f8a80ff9640 1 -- 172.21.15.78:0/3885390506 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a7c011650 con 0x7f8a84141a40 2023-12-12T17:34:54.417 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:54.403+0000 7f8a80ff9640 1 -- 172.21.15.78:0/3885390506 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a7c0c0070 con 0x7f8a84141a40 2023-12-12T17:34:54.418 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:54.403+0000 7f8a80ff9640 1 -- 172.21.15.78:0/3885390506 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a7c0119d0 con 0x7f8a84141a40 2023-12-12T17:34:54.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:54.415+0000 7f8a8a4ea640 1 -- 172.21.15.78:0/3885390506 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a841325c0 con 0x7f8a84141a40 2023-12-12T17:34:54.421 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:54.415+0000 7f8a8a4ea640 1 -- 172.21.15.78:0/3885390506 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a84132b80 con 0x7f8a84141a40 2023-12-12T17:34:54.436 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:54.423+0000 7f8a8a4ea640 1 -- 172.21.15.78:0/3885390506 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a840671f0 con 0x7f8a84141a40 2023-12-12T17:34:54.451 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:54.439+0000 7f8a80ff9640 1 -- 172.21.15.78:0/3885390506 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f8a7c004040 con 0x7f8a84141a40 2023-12-12T17:34:54.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:54.443+0000 7f8a80ff9640 1 --2- 172.21.15.78:0/3885390506 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f8a700664c0 0x7f8a70068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:34:54.454 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:54.447+0000 7f8a83fff640 1 --2- 172.21.15.78:0/3885390506 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f8a700664c0 0x7f8a70068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:34:54.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:54.451+0000 7f8a80ff9640 1 -- 172.21.15.78:0/3885390506 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f8a7c0c2070 con 0x7f8a84141a40 2023-12-12T17:34:54.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:54.451+0000 7f8a83fff640 1 --2- 172.21.15.78:0/3885390506 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f8a700664c0 0x7f8a70068980 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f8a74009a00 tx=0x7f8a74009110 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T17:34:54.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:54.455+0000 7f8a80ff9640 1 -- 172.21.15.78:0/3885390506 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8a7c12b2c0 con 0x7f8a84141a40 2023-12-12T17:34:55.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:55.007+0000 7f8a8a4ea640 1 -- 172.21.15.78:0/3885390506 --> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8a84159500 con 0x7f8a700664c0 2023-12-12T17:34:56.581 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:56.575+0000 7f8a80ff9640 1 -- 172.21.15.78:0/3885390506 <== mgr.4104 v2:172.21.15.78:6832/1725498448 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+49640 (secure 0 0 0) 0x7f8a7400e7f0 con 0x7f8a700664c0 2023-12-12T17:34:56.584 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T17:34:56.585 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2023-12-12T17:34:56.586 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:56.579+0000 7f8a8a4ea640 1 -- 172.21.15.78:0/3885390506 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f8a700664c0 msgr2=0x7f8a70068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:34:56.586 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:56.579+0000 7f8a8a4ea640 1 --2- 172.21.15.78:0/3885390506 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f8a700664c0 0x7f8a70068980 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f8a74009a00 tx=0x7f8a74009110 comp rx=0 tx=0).stop 2023-12-12T17:34:56.586 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:56.579+0000 7f8a8a4ea640 1 -- 172.21.15.78:0/3885390506 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8a84141a40 msgr2=0x7f8a841545d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:34:56.586 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:56.579+0000 7f8a8a4ea640 1 --2- 172.21.15.78:0/3885390506 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8a84141a40 0x7f8a841545d0 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f8a7c0b3000 tx=0x7f8a7c022220 comp rx=0 tx=0).stop 2023-12-12T17:34:56.587 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:56.579+0000 7f8a8a4ea640 1 -- 172.21.15.78:0/3885390506 shutdown_connections 2023-12-12T17:34:56.587 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:56.579+0000 7f8a8a4ea640 1 --2- 172.21.15.78:0/3885390506 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f8a700664c0 0x7f8a70068980 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:56.587 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:56.579+0000 7f8a8a4ea640 1 --2- 172.21.15.78:0/3885390506 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8a84141a40 0x7f8a841545d0 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:56.587 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:56.579+0000 7f8a8a4ea640 1 --2- 172.21.15.78:0/3885390506 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8a840b1270 0x7f8a84154090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:56.588 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:56.579+0000 7f8a8a4ea640 1 --2- 172.21.15.78:0/3885390506 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f8a84070100 0x7f8a840b3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:56.588 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:56.579+0000 7f8a8a4ea640 1 -- 172.21.15.78:0/3885390506 >> 172.21.15.78:0/3885390506 conn(0x7f8a840b0750 msgr2=0x7f8a840cd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T17:34:56.588 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:56.579+0000 7f8a8a4ea640 1 -- 172.21.15.78:0/3885390506 shutdown_connections 2023-12-12T17:34:56.588 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:56.579+0000 7f8a8a4ea640 1 -- 172.21.15.78:0/3885390506 wait complete. 2023-12-12T17:34:56.637 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":13312,"stamp":"2023-12-12T17:34:53.586669+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":176,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":37929012,"kb_used_data":25037660,"kb_used_omap":3470,"kb_used_meta":12879601,"kb_avail":717045708,"statfs":{"total":773094113280,"available":734254804992,"internally_reserved":0,"allocated":25638563840,"data_stored":25578963843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3554275,"internal_metadata":13188711453},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":687,"apply_latency_ms":687,"commit_latency_ns":687000000,"apply_latency_ns":687000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-26052398790,"num_objects":-22683,"num_object_clones":0,"num_object_copies":-45366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22683,"num_whiteouts":0,"num_read":-2048850,"num_read_kb":-143355453,"num_write":-6584726,"num_write_kb":-161614443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.661635"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":405,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-12T17:34:43.953907+0000","last_change":"2023-12-12T10:11:58.492812+0000","last_active":"2023-12-12T17:34:43.953907+0000","last_peered":"2023-12-12T17:34:43.953907+0000","last_clean":"2023-12-12T17:34:43.953907+0000","last_became_active":"2023-12-12T10:11:58.491470+0000","last_became_peered":"2023-12-12T10:11:58.491470+0000","last_unstale":"2023-12-12T17:34:43.953907+0000","last_undegraded":"2023-12-12T17:34:43.953907+0000","last_fullsized":"2023-12-12T17:34:43.953907+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:11:57.289641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:11:57.289641+0000","last_clean_scrub_stamp":"2023-12-12T10:11:57.289641+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:10:37.809139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834580163,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4378264,"kb_used_data":2789644,"kb_used_omap":161,"kb_used_meta":1588446,"kb_avail":89993576,"statfs":{"total":96636764160,"available":92153421824,"internally_reserved":0,"allocated":2856595456,"data_stored":2850530923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":165859,"internal_metadata":1626568733},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":92,"apply_latency_ms":92,"commit_latency_ns":92000000,"apply_latency_ns":92000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 17:34:08 2023","interfaces":[{"interface":"back","average":{"1min":2.952,"5min":1.784,"15min":1.762},"min":{"1min":0.39200000000000002,"5min":0.35999999999999999,"15min":0.30599999999999999},"max":{"1min":21.974,"5min":21.974,"15min":21.974},"last":2.2949999999999999},{"interface":"front","average":{"1min":2.931,"5min":2.367,"15min":1.8959999999999999},"min":{"1min":0.45100000000000001,"5min":0.38900000000000001,"15min":0.30199999999999999},"max":{"1min":22.475999999999999,"5min":22.475999999999999,"15min":22.475999999999999},"last":4.0810000000000004}]},{"osd":1,"last update":"Tue Dec 12 17:34:08 2023","interfaces":[{"interface":"back","average":{"1min":1.954,"5min":1.9039999999999999,"15min":1.9159999999999999},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.35599999999999998},"max":{"1min":8.8350000000000009,"5min":10.756,"15min":24.129000000000001},"last":0.91000000000000003},{"interface":"front","average":{"1min":2.0529999999999999,"5min":1.726,"15min":1.859},"min":{"1min":0.36399999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":9.0660000000000007,"5min":9.0660000000000007,"15min":10.593999999999999},"last":7.9800000000000004}]},{"osd":2,"last update":"Tue Dec 12 17:34:08 2023","interfaces":[{"interface":"back","average":{"1min":2.7280000000000002,"5min":2.1640000000000001,"15min":2.044},"min":{"1min":0.57199999999999995,"5min":0.41699999999999998,"15min":0.374},"max":{"1min":8.9410000000000007,"5min":11.038,"15min":11.038},"last":2.2549999999999999},{"interface":"front","average":{"1min":1.8049999999999999,"5min":2.1789999999999998,"15min":1.909},"min":{"1min":0.52200000000000002,"5min":0.51500000000000001,"15min":0.41899999999999998},"max":{"1min":12.380000000000001,"5min":19.434999999999999,"15min":19.434999999999999},"last":4.718}]},{"osd":3,"last update":"Tue Dec 12 17:34:08 2023","interfaces":[{"interface":"back","average":{"1min":2.1970000000000001,"5min":2.9049999999999998,"15min":2.2759999999999998},"min":{"1min":0.55700000000000005,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":8.8680000000000003,"5min":113.107,"15min":113.107},"last":2.0590000000000002},{"interface":"front","average":{"1min":2.3769999999999998,"5min":3.2490000000000001,"15min":2.2890000000000001},"min":{"1min":0.57699999999999996,"5min":0.49299999999999999,"15min":0.40699999999999997},"max":{"1min":8.9890000000000008,"5min":109.90900000000001,"15min":109.90900000000001},"last":2.3300000000000001}]},{"osd":4,"last update":"Tue Dec 12 17:34:08 2023","interfaces":[{"interface":"back","average":{"1min":1.496,"5min":1.0349999999999999,"15min":0.74099999999999999},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":12.436999999999999,"5min":12.436999999999999,"15min":12.436999999999999},"last":4.1139999999999999},{"interface":"front","average":{"1min":1.484,"5min":0.93200000000000005,"15min":0.751},"min":{"1min":0.42099999999999999,"5min":0.40200000000000002,"15min":0.33400000000000002},"max":{"1min":8.7880000000000003,"5min":8.7880000000000003,"15min":8.7880000000000003},"last":0.84999999999999998}]},{"osd":5,"last update":"Tue Dec 12 17:34:08 2023","interfaces":[{"interface":"back","average":{"1min":1.5169999999999999,"5min":0.85099999999999998,"15min":0.67700000000000005},"min":{"1min":0.39100000000000001,"5min":0.33300000000000002,"15min":0.32800000000000001},"max":{"1min":9.3640000000000008,"5min":9.3640000000000008,"15min":9.3640000000000008},"last":2.3660000000000001},{"interface":"front","average":{"1min":1.3999999999999999,"5min":1.0469999999999999,"15min":0.75},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.33900000000000002},"max":{"1min":12.48,"5min":12.48,"15min":12.48},"last":4.0380000000000003}]},{"osd":6,"last update":"Tue Dec 12 17:34:08 2023","interfaces":[{"interface":"back","average":{"1min":1.5469999999999999,"5min":1.123,"15min":0.81999999999999995},"min":{"1min":0.47899999999999998,"5min":0.441,"15min":0.41999999999999998},"max":{"1min":12.528,"5min":12.528,"15min":12.528},"last":4.1529999999999996},{"interface":"front","average":{"1min":1.294,"5min":0.94799999999999995,"15min":0.78100000000000003},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.35099999999999998},"max":{"1min":8.8979999999999997,"5min":8.8979999999999997,"15min":8.8979999999999997},"last":0.95099999999999996}]}]},{"osd":6,"up_from":13,"seq":55834580164,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4683628,"kb_used_data":2955168,"kb_used_omap":247,"kb_used_meta":1728200,"kb_avail":89688212,"statfs":{"total":96636764160,"available":91840729088,"internally_reserved":0,"allocated":3026092032,"data_stored":3018973276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":253535,"internal_metadata":1769677217},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 17:33:50 2023","interfaces":[{"interface":"back","average":{"1min":2.569,"5min":1.593,"15min":1.6739999999999999},"min":{"1min":0.37,"5min":0.34000000000000002,"15min":0.32900000000000001},"max":{"1min":18.879000000000001,"5min":18.879000000000001,"15min":18.879000000000001},"last":7.79},{"interface":"front","average":{"1min":3.702,"5min":1.9510000000000001,"15min":1.802},"min":{"1min":0.40300000000000002,"5min":0.35099999999999998,"15min":0.30599999999999999},"max":{"1min":19.068000000000001,"5min":19.068000000000001,"15min":19.068000000000001},"last":0.84299999999999997}]},{"osd":1,"last update":"Tue Dec 12 17:33:50 2023","interfaces":[{"interface":"back","average":{"1min":2.4790000000000001,"5min":1.8129999999999999,"15min":1.696},"min":{"1min":0.59799999999999998,"5min":0.376,"15min":0.34699999999999998},"max":{"1min":18.826000000000001,"5min":18.826000000000001,"15min":18.826000000000001},"last":6.8600000000000003},{"interface":"front","average":{"1min":2.3730000000000002,"5min":1.7949999999999999,"15min":1.718},"min":{"1min":0.64500000000000002,"5min":0.46500000000000002,"15min":0.371},"max":{"1min":16.858000000000001,"5min":16.858000000000001,"15min":16.858000000000001},"last":6.8929999999999998}]},{"osd":2,"last update":"Tue Dec 12 17:33:50 2023","interfaces":[{"interface":"back","average":{"1min":1.9279999999999999,"5min":1.706,"15min":1.889},"min":{"1min":0.41999999999999998,"5min":0.39800000000000002,"15min":0.378},"max":{"1min":19,"5min":19,"15min":19},"last":1.4139999999999999},{"interface":"front","average":{"1min":3.206,"5min":1.9990000000000001,"15min":1.917},"min":{"1min":0.51300000000000001,"5min":0.41999999999999998,"15min":0.40799999999999997},"max":{"1min":34.941000000000003,"5min":34.941000000000003,"15min":34.941000000000003},"last":6.0899999999999999}]},{"osd":3,"last update":"Tue Dec 12 17:33:50 2023","interfaces":[{"interface":"back","average":{"1min":2.4510000000000001,"5min":2.472,"15min":2.0790000000000002},"min":{"1min":0.505,"5min":0.48599999999999999,"15min":0.41999999999999998},"max":{"1min":16.475999999999999,"5min":88.251999999999995,"15min":88.251999999999995},"last":7.0730000000000004},{"interface":"front","average":{"1min":3.0880000000000001,"5min":2.8889999999999998,"15min":2.1179999999999999},"min":{"1min":0.44,"5min":0.44,"15min":0.41199999999999998},"max":{"1min":39.072000000000003,"5min":80.805999999999997,"15min":80.805999999999997},"last":5.4779999999999998}]},{"osd":4,"last update":"Tue Dec 12 17:33:50 2023","interfaces":[{"interface":"back","average":{"1min":1.752,"5min":1.0169999999999999,"15min":0.72399999999999998},"min":{"1min":0.36299999999999999,"5min":0.35499999999999998,"15min":0.318},"max":{"1min":16.427,"5min":16.427,"15min":16.427},"last":0.504},{"interface":"front","average":{"1min":1.5800000000000001,"5min":1.0009999999999999,"15min":0.72399999999999998},"min":{"1min":0.41799999999999998,"5min":0.34399999999999997,"15min":0.28100000000000003},"max":{"1min":18.933,"5min":18.933,"15min":18.933},"last":0.53800000000000003}]},{"osd":5,"last update":"Tue Dec 12 17:33:50 2023","interfaces":[{"interface":"back","average":{"1min":1.1850000000000001,"5min":0.95499999999999996,"15min":1.1180000000000001},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.36499999999999999},"max":{"1min":9.1400000000000006,"5min":9.1400000000000006,"15min":123.398},"last":0.58999999999999997},{"interface":"front","average":{"1min":1.78,"5min":1.0580000000000001,"15min":1.165},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":18.969000000000001,"5min":18.969000000000001,"15min":121.617},"last":0.64100000000000001}]},{"osd":7,"last update":"Tue Dec 12 17:33:50 2023","interfaces":[{"interface":"back","average":{"1min":1.6910000000000001,"5min":0.96299999999999997,"15min":0.74399999999999999},"min":{"1min":0.38,"5min":0.36699999999999999,"15min":0.35099999999999998},"max":{"1min":21.306000000000001,"5min":21.306000000000001,"15min":21.306000000000001},"last":0.65900000000000003},{"interface":"front","average":{"1min":1.175,"5min":0.98999999999999999,"15min":0.77900000000000003},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.38400000000000001},"max":{"1min":8.6340000000000003,"5min":8.6340000000000003,"15min":8.6340000000000003},"last":0.70099999999999996}]}]},{"osd":5,"up_from":13,"seq":55834580162,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6006568,"kb_used_data":4308828,"kb_used_omap":1077,"kb_used_meta":1696650,"kb_avail":88365272,"statfs":{"total":96636764160,"available":90486038528,"internally_reserved":0,"allocated":4412239872,"data_stored":4402025166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1102957,"internal_metadata":1737370515},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 17:33:41 2023","interfaces":[{"interface":"back","average":{"1min":2.1339999999999999,"5min":1.4419999999999999,"15min":1.6279999999999999},"min":{"1min":0.38900000000000001,"5min":0.33800000000000002,"15min":0.313},"max":{"1min":13.279,"5min":13.279,"15min":13.279},"last":4.4660000000000002},{"interface":"front","average":{"1min":2.4700000000000002,"5min":1.7569999999999999,"15min":1.716},"min":{"1min":0.63800000000000001,"5min":0.37,"15min":0.32100000000000001},"max":{"1min":6.569,"5min":7.5010000000000003,"15min":9.0180000000000007},"last":0.65300000000000002}]},{"osd":1,"last update":"Tue Dec 12 17:33:41 2023","interfaces":[{"interface":"back","average":{"1min":2.2970000000000002,"5min":1.915,"15min":1.966},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.38400000000000001},"max":{"1min":7.9050000000000002,"5min":8.6400000000000006,"15min":17.175000000000001},"last":2.9750000000000001},{"interface":"front","average":{"1min":1.1319999999999999,"5min":1.6279999999999999,"15min":1.6359999999999999},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":4.4630000000000001,"5min":12.363,"15min":16.434999999999999},"last":8.5440000000000005}]},{"osd":2,"last update":"Tue Dec 12 17:33:41 2023","interfaces":[{"interface":"back","average":{"1min":2.1829999999999998,"5min":1.6339999999999999,"15min":1.76},"min":{"1min":0.59299999999999997,"5min":0.40899999999999997,"15min":0.40100000000000002},"max":{"1min":6.077,"5min":6.077,"15min":9.9469999999999992},"last":1.123},{"interface":"front","average":{"1min":2.024,"5min":1.734,"15min":1.8280000000000001},"min":{"1min":0.60399999999999998,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":6.0110000000000001,"5min":6.0110000000000001,"15min":9.8970000000000002},"last":1.175}]},{"osd":3,"last update":"Tue Dec 12 17:33:41 2023","interfaces":[{"interface":"back","average":{"1min":3.5409999999999999,"5min":2.238,"15min":2.1499999999999999},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48399999999999999},"max":{"1min":32.682000000000002,"5min":32.682000000000002,"15min":32.682000000000002},"last":0.753},{"interface":"front","average":{"1min":2.3290000000000002,"5min":1.998,"15min":1.9970000000000001},"min":{"1min":0.67800000000000005,"5min":0.54400000000000004,"15min":0.42799999999999999},"max":{"1min":10.897,"5min":10.897,"15min":10.897},"last":0.79300000000000004}]},{"osd":4,"last update":"Tue Dec 12 17:33:41 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.76900000000000002,"15min":0.63900000000000001},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.34300000000000003},"max":{"1min":0.78200000000000003,"5min":4.5549999999999997,"15min":4.5549999999999997},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.77500000000000002,"15min":0.66300000000000003},"min":{"1min":0.41099999999999998,"5min":0.374,"15min":0.32100000000000001},"max":{"1min":4.4000000000000004,"5min":4.4000000000000004,"15min":4.4000000000000004},"last":0.53000000000000003}]},{"osd":6,"last update":"Tue Dec 12 17:33:41 2023","interfaces":[{"interface":"back","average":{"1min":1.089,"5min":0.82199999999999995,"15min":0.67700000000000005},"min":{"1min":0.38,"5min":0.35599999999999998,"15min":0.34100000000000003},"max":{"1min":10.016,"5min":10.016,"15min":10.016},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.81499999999999995,"15min":0.67100000000000004},"min":{"1min":0.40300000000000002,"5min":0.39300000000000002,"15min":0.34999999999999998},"max":{"1min":0.91000000000000003,"5min":5.202,"15min":5.202},"last":0.60099999999999998}]},{"osd":7,"last update":"Tue Dec 12 17:33:41 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.745,"15min":0.66700000000000004},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.35799999999999998},"max":{"1min":0.82499999999999996,"5min":3.089,"15min":3.089},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.624,"5min":0.81799999999999995,"15min":0.72099999999999997},"min":{"1min":0.46400000000000002,"5min":0.41499999999999998,"15min":0.39600000000000002},"max":{"1min":1.4059999999999999,"5min":3.407,"15min":3.875},"last":0.67000000000000004}]}]},{"osd":4,"up_from":13,"seq":55834580166,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4455340,"kb_used_data":2798052,"kb_used_omap":861,"kb_used_meta":1656418,"kb_avail":89916500,"statfs":{"total":96636764160,"available":92074496000,"internally_reserved":0,"allocated":2865205248,"data_stored":2858610869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":882141,"internal_metadata":1696172579},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":139,"apply_latency_ms":139,"commit_latency_ns":139000000,"apply_latency_ns":139000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 17:34:41 2023","interfaces":[{"interface":"back","average":{"1min":2.0059999999999998,"5min":1.7649999999999999,"15min":2.1789999999999998},"min":{"1min":0.498,"5min":0.36799999999999999,"15min":0.31900000000000001},"max":{"1min":6.0460000000000003,"5min":9.4499999999999993,"15min":170.917},"last":0.54300000000000004},{"interface":"front","average":{"1min":1.52,"5min":1.643,"15min":2.0910000000000002},"min":{"1min":0.47299999999999998,"5min":0.39700000000000002,"15min":0.33800000000000002},"max":{"1min":6.218,"5min":9.3119999999999994,"15min":170.74199999999999},"last":0.64100000000000001}]},{"osd":1,"last update":"Tue Dec 12 17:34:41 2023","interfaces":[{"interface":"back","average":{"1min":1.516,"5min":1.8440000000000001,"15min":1.6919999999999999},"min":{"1min":0.42199999999999999,"5min":0.40600000000000003,"15min":0.33400000000000002},"max":{"1min":4.5170000000000003,"5min":36.478999999999999,"15min":36.478999999999999},"last":7.5670000000000002},{"interface":"front","average":{"1min":1.5149999999999999,"5min":1.7709999999999999,"15min":1.931},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":6.5369999999999999,"5min":25.585999999999999,"15min":25.585999999999999},"last":0.72399999999999998}]},{"osd":2,"last update":"Tue Dec 12 17:34:41 2023","interfaces":[{"interface":"back","average":{"1min":1.5189999999999999,"5min":2.016,"15min":2.2509999999999999},"min":{"1min":0.47099999999999997,"5min":0.376,"15min":0.376},"max":{"1min":4.5549999999999997,"5min":14.356999999999999,"15min":169.21799999999999},"last":0.91300000000000003},{"interface":"front","average":{"1min":1.7809999999999999,"5min":1.768,"15min":2.3450000000000002},"min":{"1min":0.63800000000000001,"5min":0.57299999999999995,"15min":0.47999999999999998},"max":{"1min":5.9580000000000002,"5min":11.739000000000001,"15min":179.34100000000001},"last":1.0569999999999999}]},{"osd":3,"last update":"Tue Dec 12 17:34:41 2023","interfaces":[{"interface":"back","average":{"1min":1.9119999999999999,"5min":1.8320000000000001,"15min":2.4159999999999999},"min":{"1min":0.58499999999999996,"5min":0.433,"15min":0.39900000000000002},"max":{"1min":5.657,"5min":9.3650000000000002,"15min":169.232},"last":1.0409999999999999},{"interface":"front","average":{"1min":1.7529999999999999,"5min":1.861,"15min":2.48},"min":{"1min":0.52200000000000002,"5min":0.432,"15min":0.432},"max":{"1min":4.9370000000000003,"5min":14.401,"15min":168.79300000000001},"last":5.0110000000000001}]},{"osd":5,"last update":"Tue Dec 12 17:34:41 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":1.484,"15min":1.0580000000000001},"min":{"1min":0.34399999999999997,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.498,"5min":53.762,"15min":58.701999999999998},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.65700000000000003,"5min":1.522,"15min":1.101},"min":{"1min":0.42299999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":2.5539999999999998,"5min":53.628,"15min":59.149999999999999},"last":0.55800000000000005}]},{"osd":6,"last update":"Tue Dec 12 17:34:41 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.91600000000000004,"15min":0.71499999999999997},"min":{"1min":0.42999999999999999,"5min":0.378,"15min":0.33100000000000002},"max":{"1min":1.6200000000000001,"5min":14.432,"15min":14.432},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.91700000000000004,"15min":0.72699999999999998},"min":{"1min":0.39300000000000002,"5min":0.38100000000000001,"15min":0.36499999999999999},"max":{"1min":0.74199999999999999,"5min":10.343,"15min":10.343},"last":0.57499999999999996}]},{"osd":7,"last update":"Tue Dec 12 17:34:41 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":1.6319999999999999,"15min":0.95699999999999996},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.35299999999999998},"max":{"1min":0.85299999999999998,"5min":53.590000000000003,"15min":53.590000000000003},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.71099999999999997,"5min":1.7889999999999999,"15min":1.0529999999999999},"min":{"1min":0.502,"5min":0.44,"15min":0.38500000000000001},"max":{"1min":1.6970000000000001,"5min":54.088999999999999,"15min":54.088999999999999},"last":0.61799999999999999}]}]},{"osd":3,"up_from":13,"seq":55834580107,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5352296,"kb_used_data":3696668,"kb_used_omap":494,"kb_used_meta":1646929,"kb_avail":89019544,"statfs":{"total":96636764160,"available":91156013056,"internally_reserved":0,"allocated":3785388032,"data_stored":3776913406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":506379,"internal_metadata":1686455797},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 17:34:43 2023","interfaces":[{"interface":"back","average":{"1min":2.5379999999999998,"5min":2.516,"15min":2.851},"min":{"1min":0.68400000000000005,"5min":0.434,"15min":0.307},"max":{"1min":8.093,"5min":9.9570000000000007,"15min":18.190999999999999},"last":1.127},{"interface":"front","average":{"1min":3.2189999999999999,"5min":2.766,"15min":3.1589999999999998},"min":{"1min":0.85999999999999999,"5min":0.39500000000000002,"15min":0.27800000000000002},"max":{"1min":10.084,"5min":10.084,"15min":20.350000000000001},"last":1.3620000000000001}]},{"osd":1,"last update":"Tue Dec 12 17:34:43 2023","interfaces":[{"interface":"back","average":{"1min":3.1640000000000001,"5min":3.6949999999999998,"15min":3.4489999999999998},"min":{"1min":0.79800000000000004,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":13.246,"5min":49.18,"15min":49.18},"last":1.0880000000000001},{"interface":"front","average":{"1min":4.0030000000000001,"5min":3.758,"15min":3.5779999999999998},"min":{"1min":0.97099999999999997,"5min":0.61299999999999999,"15min":0.379},"max":{"1min":30.030999999999999,"5min":52.167999999999999,"15min":52.167999999999999},"last":1.214}]},{"osd":2,"last update":"Tue Dec 12 17:34:43 2023","interfaces":[{"interface":"back","average":{"1min":2.403,"5min":2.9809999999999999,"15min":3.3140000000000001},"min":{"1min":0.64400000000000002,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":5.0389999999999997,"5min":11.208,"15min":11.630000000000001},"last":1.276},{"interface":"front","average":{"1min":4.4189999999999996,"5min":3.3799999999999999,"15min":3.5510000000000002},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":18.041,"5min":18.379000000000001,"15min":18.379000000000001},"last":1.3460000000000001}]},{"osd":4,"last update":"Tue Dec 12 17:34:43 2023","interfaces":[{"interface":"back","average":{"1min":3.7610000000000001,"5min":2.504,"15min":2.4510000000000001},"min":{"1min":0.63,"5min":0.47099999999999997,"15min":0.38900000000000001},"max":{"1min":19.050000000000001,"5min":19.050000000000001,"15min":20.094999999999999},"last":1.1679999999999999},{"interface":"front","average":{"1min":2.923,"5min":2.5,"15min":2.6680000000000001},"min":{"1min":0.76200000000000001,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":18.914000000000001,"5min":18.914000000000001,"15min":18.914000000000001},"last":1.637}]},{"osd":5,"last update":"Tue Dec 12 17:34:43 2023","interfaces":[{"interface":"back","average":{"1min":2.7799999999999998,"5min":2.5009999999999999,"15min":2.6259999999999999},"min":{"1min":0.65300000000000002,"5min":0.52800000000000002,"15min":0.51900000000000002},"max":{"1min":8.4960000000000004,"5min":17.245000000000001,"15min":17.474},"last":1.589},{"interface":"front","average":{"1min":3.2629999999999999,"5min":2.5,"15min":2.5950000000000002},"min":{"1min":0.73399999999999999,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":10.616,"5min":10.616,"15min":19.887},"last":1.47}]},{"osd":6,"last update":"Tue Dec 12 17:34:43 2023","interfaces":[{"interface":"back","average":{"1min":2.1459999999999999,"5min":2.4039999999999999,"15min":2.7610000000000001},"min":{"1min":0.85699999999999998,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":5.5709999999999997,"5min":11.834,"15min":11.834},"last":1.7509999999999999},{"interface":"front","average":{"1min":2.7010000000000001,"5min":2.5920000000000001,"15min":2.6960000000000002},"min":{"1min":0.72699999999999998,"5min":0.504,"15min":0.504},"max":{"1min":5.3090000000000002,"5min":17.364999999999998,"15min":18.298999999999999},"last":1.659}]},{"osd":7,"last update":"Tue Dec 12 17:34:43 2023","interfaces":[{"interface":"back","average":{"1min":3.4649999999999999,"5min":2.6880000000000002,"15min":2.7869999999999999},"min":{"1min":0.77600000000000002,"5min":0.497,"15min":0.497},"max":{"1min":9.9730000000000008,"5min":9.9730000000000008,"15min":20.006},"last":1.6850000000000001},{"interface":"front","average":{"1min":2.2330000000000001,"5min":2.681,"15min":2.9620000000000002},"min":{"1min":0.94099999999999995,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":5.8259999999999996,"5min":11.954000000000001,"15min":11.954000000000001},"last":1.7150000000000001}]}]},{"osd":2,"up_from":13,"seq":55834580116,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5024116,"kb_used_data":3413028,"kb_used_omap":96,"kb_used_meta":1610975,"kb_avail":89347724,"statfs":{"total":96636764160,"available":91492069376,"internally_reserved":0,"allocated":3494940672,"data_stored":3486701156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":98548,"internal_metadata":1649639180},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":104,"apply_latency_ms":104,"commit_latency_ns":104000000,"apply_latency_ns":104000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 17:34:32 2023","interfaces":[{"interface":"back","average":{"1min":2.097,"5min":2.4129999999999998,"15min":3.1000000000000001},"min":{"1min":0.52700000000000002,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":6.7140000000000004,"5min":11.083,"15min":16.509},"last":6.742},{"interface":"front","average":{"1min":2.9340000000000002,"5min":2.8559999999999999,"15min":3.1299999999999999},"min":{"1min":0.59999999999999998,"5min":0.40000000000000002,"15min":0.317},"max":{"1min":6.069,"5min":12.016999999999999,"15min":17.859999999999999},"last":6.8979999999999997}]},{"osd":1,"last update":"Tue Dec 12 17:34:32 2023","interfaces":[{"interface":"back","average":{"1min":3.25,"5min":2.98,"15min":3.2130000000000001},"min":{"1min":0.61799999999999999,"5min":0.44600000000000001,"15min":0.39900000000000002},"max":{"1min":8.9130000000000003,"5min":13.569000000000001,"15min":13.76},"last":0.83799999999999997},{"interface":"front","average":{"1min":3.0830000000000002,"5min":2.706,"15min":3.5470000000000002},"min":{"1min":0.59699999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":12.25,"5min":12.25,"15min":19.837},"last":6.6479999999999997}]},{"osd":3,"last update":"Tue Dec 12 17:34:32 2023","interfaces":[{"interface":"back","average":{"1min":3.9329999999999998,"5min":4.3559999999999999,"15min":3.6909999999999998},"min":{"1min":0.73199999999999998,"5min":0.47199999999999998,"15min":0.437},"max":{"1min":9.0389999999999997,"5min":84.209999999999994,"15min":84.209999999999994},"last":2.5209999999999999},{"interface":"front","average":{"1min":2.7810000000000001,"5min":4.0039999999999996,"15min":4.1390000000000002},"min":{"1min":1.252,"5min":0.65200000000000002,"15min":0.41299999999999998},"max":{"1min":4.6200000000000001,"5min":80.575999999999993,"15min":80.575999999999993},"last":6.8380000000000001}]},{"osd":4,"last update":"Tue Dec 12 17:34:32 2023","interfaces":[{"interface":"back","average":{"1min":2.3380000000000001,"5min":2.3889999999999998,"15min":2.6110000000000002},"min":{"1min":0.82999999999999996,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":5.8559999999999999,"5min":14.877000000000001,"15min":14.877000000000001},"last":10.885999999999999},{"interface":"front","average":{"1min":2.7509999999999999,"5min":2.573,"15min":2.6240000000000001},"min":{"1min":0.92200000000000004,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":5.2839999999999998,"5min":14.787000000000001,"15min":14.787000000000001},"last":2.2440000000000002}]},{"osd":5,"last update":"Tue Dec 12 17:34:32 2023","interfaces":[{"interface":"back","average":{"1min":1.6479999999999999,"5min":2.5649999999999999,"15min":2.9140000000000001},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.48799999999999999},"max":{"1min":3.7949999999999999,"5min":37.231000000000002,"15min":37.231000000000002},"last":6.5179999999999998},{"interface":"front","average":{"1min":2.4079999999999999,"5min":3.165,"15min":2.9550000000000001},"min":{"1min":0.90600000000000003,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":5.976,"5min":41.021999999999998,"15min":41.021999999999998},"last":11.025}]},{"osd":6,"last update":"Tue Dec 12 17:34:32 2023","interfaces":[{"interface":"back","average":{"1min":2.851,"5min":2.7210000000000001,"15min":2.782},"min":{"1min":0.97599999999999998,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":5.3879999999999999,"5min":10.343999999999999,"15min":13.130000000000001},"last":2.4340000000000002},{"interface":"front","average":{"1min":1.73,"5min":2.3410000000000002,"15min":2.9689999999999999},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.52000000000000002},"max":{"1min":3.8300000000000001,"5min":7.6109999999999998,"15min":14.566000000000001},"last":6.3979999999999997}]},{"osd":7,"last update":"Tue Dec 12 17:34:32 2023","interfaces":[{"interface":"back","average":{"1min":2.6160000000000001,"5min":3.2429999999999999,"15min":3.089},"min":{"1min":1.042,"5min":0.60799999999999998,"15min":0.59399999999999997},"max":{"1min":6.173,"5min":41.134999999999998,"15min":41.134999999999998},"last":11.118},{"interface":"front","average":{"1min":2.9590000000000001,"5min":3.1520000000000001,"15min":3.0070000000000001},"min":{"1min":1.0249999999999999,"5min":0.53700000000000003,"15min":0.53500000000000003},"max":{"1min":5.5640000000000001,"5min":37.591000000000001,"15min":37.591000000000001},"last":2.3460000000000001}]}]},{"osd":1,"up_from":13,"seq":55834580125,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3840892,"kb_used_data":2511412,"kb_used_omap":204,"kb_used_meta":1329267,"kb_avail":90530948,"statfs":{"total":96636764160,"available":92703690752,"internally_reserved":0,"allocated":2571685888,"data_stored":2564987139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":209158,"internal_metadata":1361170170},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":167,"apply_latency_ms":167,"commit_latency_ns":167000000,"apply_latency_ns":167000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 17:33:47 2023","interfaces":[{"interface":"back","average":{"1min":3.5270000000000001,"5min":2.6280000000000001,"15min":3.2719999999999998},"min":{"1min":1.091,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":15.220000000000001,"5min":15.220000000000001,"15min":45.871000000000002},"last":4.2809999999999997},{"interface":"front","average":{"1min":7.2720000000000002,"5min":3.363,"15min":3.5569999999999999},"min":{"1min":0.77700000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":37.084000000000003,"5min":37.084000000000003,"15min":46.155999999999999},"last":2.0550000000000002}]},{"osd":2,"last update":"Tue Dec 12 17:33:47 2023","interfaces":[{"interface":"back","average":{"1min":6.8330000000000002,"5min":3.5960000000000001,"15min":3.806},"min":{"1min":0.65400000000000003,"5min":0.51500000000000001,"15min":0.45300000000000001},"max":{"1min":36.338999999999999,"5min":36.338999999999999,"15min":69.111000000000004},"last":11.622999999999999},{"interface":"front","average":{"1min":4.0730000000000004,"5min":3.0529999999999999,"15min":3.9449999999999998},"min":{"1min":0.77300000000000002,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":16.756,"5min":16.756,"15min":66.488},"last":11.863}]},{"osd":3,"last update":"Tue Dec 12 17:33:47 2023","interfaces":[{"interface":"back","average":{"1min":5.1289999999999996,"5min":3.3090000000000002,"15min":3.665},"min":{"1min":0.67300000000000004,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":36.104999999999997,"5min":36.104999999999997,"15min":66.596999999999994},"last":12.343},{"interface":"front","average":{"1min":8.016,"5min":3.8820000000000001,"15min":3.9220000000000002},"min":{"1min":1.4670000000000001,"5min":0.45300000000000001,"15min":0.44800000000000001},"max":{"1min":37.051000000000002,"5min":37.051000000000002,"15min":65.433999999999997},"last":7.6790000000000003}]},{"osd":4,"last update":"Tue Dec 12 17:33:47 2023","interfaces":[{"interface":"back","average":{"1min":5.6100000000000003,"5min":2.907,"15min":2.4529999999999998},"min":{"1min":0.79200000000000004,"5min":0.58499999999999996,"15min":0.41399999999999998},"max":{"1min":36.465000000000003,"5min":36.465000000000003,"15min":36.465000000000003},"last":11.237},{"interface":"front","average":{"1min":5.1420000000000003,"5min":3.0470000000000002,"15min":2.8839999999999999},"min":{"1min":0.79700000000000004,"5min":0.64100000000000001,"15min":0.46999999999999997},"max":{"1min":35.859000000000002,"5min":35.859000000000002,"15min":35.859000000000002},"last":1.1639999999999999}]},{"osd":5,"last update":"Tue Dec 12 17:33:47 2023","interfaces":[{"interface":"back","average":{"1min":7.6120000000000001,"5min":3.1949999999999998,"15min":2.8399999999999999},"min":{"1min":0.85299999999999998,"5min":0.51000000000000001,"15min":0.503},"max":{"1min":36.865000000000002,"5min":36.865000000000002,"15min":36.865000000000002},"last":5.4180000000000001},{"interface":"front","average":{"1min":6.4790000000000001,"5min":3.242,"15min":2.661},"min":{"1min":0.84399999999999997,"5min":0.58899999999999997,"15min":0.47399999999999998},"max":{"1min":36.695999999999998,"5min":36.695999999999998,"15min":36.695999999999998},"last":11.132999999999999}]},{"osd":6,"last update":"Tue Dec 12 17:33:47 2023","interfaces":[{"interface":"back","average":{"1min":7.4740000000000002,"5min":3.2360000000000002,"15min":2.9489999999999998},"min":{"1min":0.95999999999999996,"5min":0.55900000000000005,"15min":0.53500000000000003},"max":{"1min":36.433999999999997,"5min":36.433999999999997,"15min":36.433999999999997},"last":5.2939999999999996},{"interface":"front","average":{"1min":6.6349999999999998,"5min":3.2919999999999998,"15min":2.7909999999999999},"min":{"1min":0.873,"5min":0.57499999999999996,"15min":0.49099999999999999},"max":{"1min":36.612000000000002,"5min":36.612000000000002,"15min":36.612000000000002},"last":11.324999999999999}]},{"osd":7,"last update":"Tue Dec 12 17:33:47 2023","interfaces":[{"interface":"back","average":{"1min":5.8739999999999997,"5min":3.278,"15min":3.0310000000000001},"min":{"1min":0.89200000000000002,"5min":0.67700000000000005,"15min":0.51600000000000001},"max":{"1min":36.006999999999998,"5min":36.006999999999998,"15min":36.006999999999998},"last":1.022},{"interface":"front","average":{"1min":7.4550000000000001,"5min":3.3090000000000002,"15min":3.056},"min":{"1min":1.048,"5min":0.75900000000000001,"15min":0.58499999999999996},"max":{"1min":36.979999999999997,"5min":36.979999999999997,"15min":36.979999999999997},"last":3.0710000000000002}]}]},{"osd":0,"up_from":13,"seq":55834580119,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4187908,"kb_used_data":2564860,"kb_used_omap":327,"kb_used_meta":1622712,"kb_avail":90183932,"statfs":{"total":96636764160,"available":92348346368,"internally_reserved":0,"allocated":2626416640,"data_stored":2620221908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":335698,"internal_metadata":1661657262},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":150,"apply_latency_ms":150,"commit_latency_ns":150000000,"apply_latency_ns":150000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 12 17:34:43 2023","interfaces":[{"interface":"back","average":{"1min":2.9569999999999999,"5min":3.2229999999999999,"15min":2.988},"min":{"1min":0.34499999999999997,"5min":0.34300000000000003,"15min":0.32700000000000001},"max":{"1min":8.6050000000000004,"5min":24.763000000000002,"15min":24.763000000000002},"last":9.4039999999999999},{"interface":"front","average":{"1min":3.4039999999999999,"5min":3.536,"15min":3.242},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.378},"max":{"1min":16.047999999999998,"5min":22.780000000000001,"15min":22.780000000000001},"last":10.465}]},{"osd":2,"last update":"Tue Dec 12 17:34:43 2023","interfaces":[{"interface":"back","average":{"1min":3.7789999999999999,"5min":3.601,"15min":3.4929999999999999},"min":{"1min":0.59999999999999998,"5min":0.55800000000000005,"15min":0.51200000000000001},"max":{"1min":16.143999999999998,"5min":23.042999999999999,"15min":23.042999999999999},"last":10.315},{"interface":"front","average":{"1min":3.113,"5min":3.476,"15min":3.9380000000000002},"min":{"1min":0.64000000000000001,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":8.6940000000000008,"5min":24.658000000000001,"15min":151.84100000000001},"last":9.8330000000000002}]},{"osd":3,"last update":"Tue Dec 12 17:34:43 2023","interfaces":[{"interface":"back","average":{"1min":5.1059999999999999,"5min":4.4020000000000001,"15min":3.6680000000000001},"min":{"1min":0.89100000000000001,"5min":0.42399999999999999,"15min":0.38500000000000001},"max":{"1min":31.922999999999998,"5min":64.292000000000002,"15min":64.292000000000002},"last":9.4890000000000008},{"interface":"front","average":{"1min":4.181,"5min":3.891,"15min":3.524},"min":{"1min":0.70199999999999996,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":15.932,"5min":25.207999999999998,"15min":25.207999999999998},"last":10.108000000000001}]},{"osd":4,"last update":"Tue Dec 12 17:34:43 2023","interfaces":[{"interface":"back","average":{"1min":2.4620000000000002,"5min":2.855,"15min":2.4199999999999999},"min":{"1min":0.69799999999999995,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":8.1769999999999996,"5min":24.856000000000002,"15min":24.856000000000002},"last":9.5640000000000001},{"interface":"front","average":{"1min":4.2249999999999996,"5min":3.9180000000000001,"15min":2.8919999999999999},"min":{"1min":0.51900000000000002,"5min":0.47299999999999998,"15min":0.434},"max":{"1min":32.006999999999998,"5min":64.061999999999998,"15min":64.061999999999998},"last":9.6379999999999999}]},{"osd":5,"last update":"Tue Dec 12 17:34:43 2023","interfaces":[{"interface":"back","average":{"1min":3.6989999999999998,"5min":3.371,"15min":2.6749999999999998},"min":{"1min":0.66000000000000003,"5min":0.49299999999999999,"15min":0.438},"max":{"1min":21.183,"5min":27.843,"15min":27.843},"last":9.9800000000000004},{"interface":"front","average":{"1min":3.0680000000000001,"5min":3.3410000000000002,"15min":2.8439999999999999},"min":{"1min":0.66900000000000004,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":7.1870000000000003,"5min":22.68,"15min":22.68},"last":10.691000000000001}]},{"osd":6,"last update":"Tue Dec 12 17:34:43 2023","interfaces":[{"interface":"back","average":{"1min":3.1480000000000001,"5min":3.085,"15min":2.8370000000000002},"min":{"1min":0.63500000000000001,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":7.4130000000000003,"5min":22.457999999999998,"15min":22.457999999999998},"last":17.977},{"interface":"front","average":{"1min":2.972,"5min":3.3359999999999999,"15min":2.7759999999999998},"min":{"1min":0.79100000000000004,"5min":0.628,"15min":0.51500000000000001},"max":{"1min":8.4109999999999996,"5min":40.453000000000003,"15min":40.453000000000003},"last":10.256}]},{"osd":7,"last update":"Tue Dec 12 17:34:43 2023","interfaces":[{"interface":"back","average":{"1min":2.9380000000000002,"5min":3.2400000000000002,"15min":2.843},"min":{"1min":0.82899999999999996,"5min":0.65900000000000003,"15min":0.60599999999999998},"max":{"1min":8.5120000000000005,"5min":24.510999999999999,"15min":24.510999999999999},"last":10.4},{"interface":"front","average":{"1min":4.5890000000000004,"5min":4.1539999999999999,"15min":3.1059999999999999},"min":{"1min":0.55800000000000005,"5min":0.52000000000000002,"15min":0.46500000000000002},"max":{"1min":32.055,"5min":64.191999999999993,"15min":64.191999999999993},"last":10.218}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-12T17:34:56.639 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-12T17:34:56.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:56.839+0000 7faf52fb5640 1 Processor -- start 2023-12-12T17:34:56.847 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:56.839+0000 7faf52fb5640 1 -- start start 2023-12-12T17:34:56.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:56.843+0000 7faf52fb5640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7faf4c1607a0 0x7faf4c06af50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:34:56.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:56.843+0000 7faf52fb5640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7faf4c0d3940 0x7faf4c06b490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:34:56.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:56.843+0000 7faf52fb5640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf4c0d1630 con 0x7faf4c06cda0 2023-12-12T17:34:56.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:56.843+0000 7faf52fb5640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf4c06c1a0 con 0x7faf4c1607a0 2023-12-12T17:34:56.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:56.843+0000 7faf52fb5640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf4c0d3dd0 con 0x7faf4c0d3940 2023-12-12T17:34:56.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:56.843+0000 7faf51fb3640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7faf4c1607a0 0x7faf4c06af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:34:56.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:56.843+0000 7faf51fb3640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7faf4c1607a0 0x7faf4c06af50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54678/0 (socket says 172.21.15.78:54678) 2023-12-12T17:34:56.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:56.843+0000 7faf51fb3640 1 -- 172.21.15.78:0/3063566116 learned_addr learned my addr 172.21.15.78:0/3063566116 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T17:34:56.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:56.843+0000 7faf517b2640 1 --2- 172.21.15.78:0/3063566116 >> v2:172.21.15.187:3300/0 conn(0x7faf4c0d3940 0x7faf4c06b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:34:56.852 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:56.843+0000 7faf51fb3640 1 -- 172.21.15.78:0/3063566116 >> v2:172.21.15.187:3300/0 conn(0x7faf4c0d3940 msgr2=0x7faf4c06b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T17:34:56.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:56.843+0000 7faf51fb3640 1 --2- 172.21.15.78:0/3063566116 >> v2:172.21.15.187:3300/0 conn(0x7faf4c0d3940 0x7faf4c06b490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:56.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:56.843+0000 7faf51fb3640 1 -- 172.21.15.78:0/3063566116 >> v1:172.21.15.78:6789/0 conn(0x7faf4c06cda0 legacy=0x7faf4c0afbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:34:56.853 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:56.843+0000 7faf51fb3640 1 -- 172.21.15.78:0/3063566116 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf4c06b9d0 con 0x7faf4c1607a0 2023-12-12T17:34:56.854 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:56.843+0000 7faf517b2640 1 --2- 172.21.15.78:0/3063566116 >> v2:172.21.15.187:3300/0 conn(0x7faf4c0d3940 0x7faf4c06b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T17:34:56.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:56.847+0000 7faf51fb3640 1 --2- 172.21.15.78:0/3063566116 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faf4c1607a0 0x7faf4c06af50 secure :-1 s=READY pgs=2121 cs=0 l=1 rev1=1 crypto rx=0x7faf4c0b8ed0 tx=0x7faf4801cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a739c453e62c7501 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T17:34:56.856 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:56.847+0000 7faf50fb1640 1 -- 172.21.15.78:0/3063566116 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf480ab610 con 0x7faf4c1607a0 2023-12-12T17:34:56.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:56.847+0000 7faf50fb1640 1 -- 172.21.15.78:0/3063566116 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf480ab770 con 0x7faf4c1607a0 2023-12-12T17:34:56.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:56.847+0000 7faf50fb1640 1 -- 172.21.15.78:0/3063566116 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf480abb00 con 0x7faf4c1607a0 2023-12-12T17:34:56.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:56.851+0000 7faf52fb5640 1 -- 172.21.15.78:0/3063566116 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faf4c1607a0 msgr2=0x7faf4c06af50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:34:56.857 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:56.851+0000 7faf52fb5640 1 --2- 172.21.15.78:0/3063566116 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faf4c1607a0 0x7faf4c06af50 secure :-1 s=READY pgs=2121 cs=0 l=1 rev1=1 crypto rx=0x7faf4c0b8ed0 tx=0x7faf4801cf60 comp rx=0 tx=0).stop 2023-12-12T17:34:56.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:56.851+0000 7faf52fb5640 1 -- 172.21.15.78:0/3063566116 shutdown_connections 2023-12-12T17:34:56.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:56.851+0000 7faf52fb5640 1 --2- 172.21.15.78:0/3063566116 >> v2:172.21.15.187:3300/0 conn(0x7faf4c0d3940 0x7faf4c06b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:56.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:56.851+0000 7faf52fb5640 1 --2- 172.21.15.78:0/3063566116 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faf4c1607a0 0x7faf4c06af50 unknown :-1 s=CLOSED pgs=2121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:56.858 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:56.851+0000 7faf52fb5640 1 -- 172.21.15.78:0/3063566116 >> 172.21.15.78:0/3063566116 conn(0x7faf4c0d2e20 msgr2=0x7faf4c0d3230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T17:34:56.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:56.851+0000 7faf52fb5640 1 -- 172.21.15.78:0/3063566116 shutdown_connections 2023-12-12T17:34:56.859 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:56.851+0000 7faf52fb5640 1 -- 172.21.15.78:0/3063566116 wait complete. 2023-12-12T17:34:56.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:56.851+0000 7faf52fb5640 1 Processor -- start 2023-12-12T17:34:56.860 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:56.855+0000 7faf52fb5640 1 -- start start 2023-12-12T17:34:56.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:56.855+0000 7faf52fb5640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faf4c06cda0 0x7faf4c14b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:34:56.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:56.855+0000 7faf52fb5640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faf4c1607a0 0x7faf4c0cbe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:34:56.861 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:56.855+0000 7faf52fb5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faf4c0cc360 0x7faf4c159ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:34:56.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:56.855+0000 7faf52fb5640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf4c14bad0 con 0x7faf4c0cc360 2023-12-12T17:34:56.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:56.855+0000 7faf52fb5640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf4c14cd80 con 0x7faf4c1607a0 2023-12-12T17:34:56.862 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:56.855+0000 7faf52fb5640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf4c14bce0 con 0x7faf4c06cda0 2023-12-12T17:34:56.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:56.855+0000 7faf517b2640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faf4c1607a0 0x7faf4c0cbe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:34:56.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:56.855+0000 7faf527b4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faf4c0cc360 0x7faf4c159ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:34:56.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:56.855+0000 7faf517b2640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faf4c1607a0 0x7faf4c0cbe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.78:48036/0 (socket says 172.21.15.78:48036) 2023-12-12T17:34:56.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:56.855+0000 7faf517b2640 1 -- 172.21.15.78:0/2412795065 learned_addr learned my addr 172.21.15.78:0/2412795065 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T17:34:56.863 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:56.855+0000 7faf51fb3640 1 --2- 172.21.15.78:0/2412795065 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faf4c06cda0 0x7faf4c14b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:34:56.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:56.855+0000 7faf517b2640 1 -- 172.21.15.78:0/2412795065 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faf4c06cda0 msgr2=0x7faf4c14b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:34:56.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:56.855+0000 7faf517b2640 1 --2- 172.21.15.78:0/2412795065 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faf4c06cda0 0x7faf4c14b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:56.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:56.855+0000 7faf517b2640 1 -- 172.21.15.78:0/2412795065 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faf4c0cc360 msgr2=0x7faf4c159ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:34:56.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:56.855+0000 7faf517b2640 1 --2- 172.21.15.78:0/2412795065 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faf4c0cc360 0x7faf4c159ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:56.864 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:56.855+0000 7faf517b2640 1 -- 172.21.15.78:0/2412795065 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf480094d0 con 0x7faf4c1607a0 2023-12-12T17:34:56.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:56.855+0000 7faf517b2640 1 --2- 172.21.15.78:0/2412795065 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faf4c1607a0 0x7faf4c0cbe20 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7faf3c00c7c0 tx=0x7faf3c00cc80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T17:34:56.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:56.855+0000 7faf427fc640 1 -- 172.21.15.78:0/2412795065 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf3c007a30 con 0x7faf4c1607a0 2023-12-12T17:34:56.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:56.855+0000 7faf427fc640 1 -- 172.21.15.78:0/2412795065 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf3c007b90 con 0x7faf4c1607a0 2023-12-12T17:34:56.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:56.855+0000 7faf427fc640 1 -- 172.21.15.78:0/2412795065 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf3c00ce70 con 0x7faf4c1607a0 2023-12-12T17:34:56.865 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:56.859+0000 7faf52fb5640 1 -- 172.21.15.78:0/2412795065 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf4c14bfc0 con 0x7faf4c1607a0 2023-12-12T17:34:56.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:56.859+0000 7faf52fb5640 1 -- 172.21.15.78:0/2412795065 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf4c14c580 con 0x7faf4c1607a0 2023-12-12T17:34:56.866 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:56.859+0000 7faf52fb5640 1 -- 172.21.15.78:0/2412795065 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf4c067bf0 con 0x7faf4c1607a0 2023-12-12T17:34:56.869 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:56.863+0000 7faf427fc640 1 -- 172.21.15.78:0/2412795065 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7faf3c039440 con 0x7faf4c1607a0 2023-12-12T17:34:56.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:56.863+0000 7faf427fc640 1 --2- 172.21.15.78:0/2412795065 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7faf300664a0 0x7faf30068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:34:56.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:56.863+0000 7faf427fc640 1 -- 172.21.15.78:0/2412795065 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5263+0+0 (secure 0 0 0) 0x7faf3c0842f0 con 0x7faf4c1607a0 2023-12-12T17:34:56.870 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:56.863+0000 7faf51fb3640 1 --2- 172.21.15.78:0/2412795065 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7faf300664a0 0x7faf30068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:34:56.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:56.863+0000 7faf51fb3640 1 --2- 172.21.15.78:0/2412795065 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7faf300664a0 0x7faf30068960 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7faf480af000 tx=0x7faf480b6040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T17:34:56.872 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:56.867+0000 7faf427fc640 1 -- 172.21.15.78:0/2412795065 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7faf3c051b50 con 0x7faf4c1607a0 2023-12-12T17:34:57.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:57.055+0000 7faf52fb5640 1 -- 172.21.15.78:0/2412795065 --> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7faf4c068610 con 0x7faf300664a0 2023-12-12T17:34:57.076 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T17:34:57.077 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2023-12-12T17:34:57.169 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:57.067+0000 7faf427fc640 1 -- 172.21.15.78:0/2412795065 <== mgr.4104 v2:172.21.15.78:6832/1725498448 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+49586 (secure 0 0 0) 0x7faf4c068610 con 0x7faf300664a0 2023-12-12T17:34:57.170 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:57.071+0000 7faf52fb5640 1 -- 172.21.15.78:0/2412795065 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7faf300664a0 msgr2=0x7faf30068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:34:57.170 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:57.071+0000 7faf52fb5640 1 --2- 172.21.15.78:0/2412795065 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7faf300664a0 0x7faf30068960 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7faf480af000 tx=0x7faf480b6040 comp rx=0 tx=0).stop 2023-12-12T17:34:57.170 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:57.071+0000 7faf52fb5640 1 -- 172.21.15.78:0/2412795065 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faf4c1607a0 msgr2=0x7faf4c0cbe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:34:57.170 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:57.071+0000 7faf52fb5640 1 --2- 172.21.15.78:0/2412795065 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faf4c1607a0 0x7faf4c0cbe20 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7faf3c00c7c0 tx=0x7faf3c00cc80 comp rx=0 tx=0).stop 2023-12-12T17:34:57.170 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:57.071+0000 7faf52fb5640 1 -- 172.21.15.78:0/2412795065 shutdown_connections 2023-12-12T17:34:57.170 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:57.071+0000 7faf52fb5640 1 --2- 172.21.15.78:0/2412795065 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7faf300664a0 0x7faf30068960 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:57.170 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:57.071+0000 7faf52fb5640 1 --2- 172.21.15.78:0/2412795065 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7faf4c0cc360 0x7faf4c159ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:57.171 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:57.071+0000 7faf52fb5640 1 --2- 172.21.15.78:0/2412795065 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faf4c1607a0 0x7faf4c0cbe20 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:57.171 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:57.071+0000 7faf52fb5640 1 --2- 172.21.15.78:0/2412795065 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faf4c06cda0 0x7faf4c14b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:57.171 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:57.071+0000 7faf52fb5640 1 -- 172.21.15.78:0/2412795065 >> 172.21.15.78:0/2412795065 conn(0x7faf4c0d2e20 msgr2=0x7faf4c0cd7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T17:34:57.171 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:57.071+0000 7faf52fb5640 1 -- 172.21.15.78:0/2412795065 shutdown_connections 2023-12-12T17:34:57.171 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:57.071+0000 7faf52fb5640 1 -- 172.21.15.78:0/2412795065 wait complete. 2023-12-12T17:34:57.232 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":13313,"stamp":"2023-12-12T17:34:56.578281+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":145,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":31423488,"kb_used_data":18398780,"kb_used_omap":3470,"kb_used_meta":12915697,"kb_avail":723551232,"statfs":{"total":773094113280,"available":740916461568,"internally_reserved":0,"allocated":18840350720,"data_stored":18796084386,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3554275,"internal_metadata":13225673757},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":854,"apply_latency_ms":854,"commit_latency_ns":854000000,"apply_latency_ns":854000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-26052398790,"num_objects":-22683,"num_object_clones":0,"num_object_copies":-45366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22683,"num_whiteouts":0,"num_read":-2048850,"num_read_kb":-143355453,"num_write":-6584726,"num_write_kb":-161614443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.007652"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":405,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-12T17:34:43.953907+0000","last_change":"2023-12-12T10:11:58.492812+0000","last_active":"2023-12-12T17:34:43.953907+0000","last_peered":"2023-12-12T17:34:43.953907+0000","last_clean":"2023-12-12T17:34:43.953907+0000","last_became_active":"2023-12-12T10:11:58.491470+0000","last_became_peered":"2023-12-12T10:11:58.491470+0000","last_unstale":"2023-12-12T17:34:43.953907+0000","last_undegraded":"2023-12-12T17:34:43.953907+0000","last_fullsized":"2023-12-12T17:34:43.953907+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:11:57.289641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:11:57.289641+0000","last_clean_scrub_stamp":"2023-12-12T10:11:57.289641+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:10:37.809139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834580163,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4378264,"kb_used_data":2789644,"kb_used_omap":161,"kb_used_meta":1588446,"kb_avail":89993576,"statfs":{"total":96636764160,"available":92153421824,"internally_reserved":0,"allocated":2856595456,"data_stored":2850530923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":165859,"internal_metadata":1626568733},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":92,"apply_latency_ms":92,"commit_latency_ns":92000000,"apply_latency_ns":92000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 17:34:08 2023","interfaces":[{"interface":"back","average":{"1min":2.952,"5min":1.784,"15min":1.762},"min":{"1min":0.39200000000000002,"5min":0.35999999999999999,"15min":0.30599999999999999},"max":{"1min":21.974,"5min":21.974,"15min":21.974},"last":2.2949999999999999},{"interface":"front","average":{"1min":2.931,"5min":2.367,"15min":1.8959999999999999},"min":{"1min":0.45100000000000001,"5min":0.38900000000000001,"15min":0.30199999999999999},"max":{"1min":22.475999999999999,"5min":22.475999999999999,"15min":22.475999999999999},"last":4.0810000000000004}]},{"osd":1,"last update":"Tue Dec 12 17:34:08 2023","interfaces":[{"interface":"back","average":{"1min":1.954,"5min":1.9039999999999999,"15min":1.9159999999999999},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.35599999999999998},"max":{"1min":8.8350000000000009,"5min":10.756,"15min":24.129000000000001},"last":0.91000000000000003},{"interface":"front","average":{"1min":2.0529999999999999,"5min":1.726,"15min":1.859},"min":{"1min":0.36399999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":9.0660000000000007,"5min":9.0660000000000007,"15min":10.593999999999999},"last":7.9800000000000004}]},{"osd":2,"last update":"Tue Dec 12 17:34:08 2023","interfaces":[{"interface":"back","average":{"1min":2.7280000000000002,"5min":2.1640000000000001,"15min":2.044},"min":{"1min":0.57199999999999995,"5min":0.41699999999999998,"15min":0.374},"max":{"1min":8.9410000000000007,"5min":11.038,"15min":11.038},"last":2.2549999999999999},{"interface":"front","average":{"1min":1.8049999999999999,"5min":2.1789999999999998,"15min":1.909},"min":{"1min":0.52200000000000002,"5min":0.51500000000000001,"15min":0.41899999999999998},"max":{"1min":12.380000000000001,"5min":19.434999999999999,"15min":19.434999999999999},"last":4.718}]},{"osd":3,"last update":"Tue Dec 12 17:34:08 2023","interfaces":[{"interface":"back","average":{"1min":2.1970000000000001,"5min":2.9049999999999998,"15min":2.2759999999999998},"min":{"1min":0.55700000000000005,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":8.8680000000000003,"5min":113.107,"15min":113.107},"last":2.0590000000000002},{"interface":"front","average":{"1min":2.3769999999999998,"5min":3.2490000000000001,"15min":2.2890000000000001},"min":{"1min":0.57699999999999996,"5min":0.49299999999999999,"15min":0.40699999999999997},"max":{"1min":8.9890000000000008,"5min":109.90900000000001,"15min":109.90900000000001},"last":2.3300000000000001}]},{"osd":4,"last update":"Tue Dec 12 17:34:08 2023","interfaces":[{"interface":"back","average":{"1min":1.496,"5min":1.0349999999999999,"15min":0.74099999999999999},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":12.436999999999999,"5min":12.436999999999999,"15min":12.436999999999999},"last":4.1139999999999999},{"interface":"front","average":{"1min":1.484,"5min":0.93200000000000005,"15min":0.751},"min":{"1min":0.42099999999999999,"5min":0.40200000000000002,"15min":0.33400000000000002},"max":{"1min":8.7880000000000003,"5min":8.7880000000000003,"15min":8.7880000000000003},"last":0.84999999999999998}]},{"osd":5,"last update":"Tue Dec 12 17:34:08 2023","interfaces":[{"interface":"back","average":{"1min":1.5169999999999999,"5min":0.85099999999999998,"15min":0.67700000000000005},"min":{"1min":0.39100000000000001,"5min":0.33300000000000002,"15min":0.32800000000000001},"max":{"1min":9.3640000000000008,"5min":9.3640000000000008,"15min":9.3640000000000008},"last":2.3660000000000001},{"interface":"front","average":{"1min":1.3999999999999999,"5min":1.0469999999999999,"15min":0.75},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.33900000000000002},"max":{"1min":12.48,"5min":12.48,"15min":12.48},"last":4.0380000000000003}]},{"osd":6,"last update":"Tue Dec 12 17:34:08 2023","interfaces":[{"interface":"back","average":{"1min":1.5469999999999999,"5min":1.123,"15min":0.81999999999999995},"min":{"1min":0.47899999999999998,"5min":0.441,"15min":0.41999999999999998},"max":{"1min":12.528,"5min":12.528,"15min":12.528},"last":4.1529999999999996},{"interface":"front","average":{"1min":1.294,"5min":0.94799999999999995,"15min":0.78100000000000003},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.35099999999999998},"max":{"1min":8.8979999999999997,"5min":8.8979999999999997,"15min":8.8979999999999997},"last":0.95099999999999996}]}]},{"osd":6,"up_from":13,"seq":55834580164,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4683628,"kb_used_data":2955168,"kb_used_omap":247,"kb_used_meta":1728200,"kb_avail":89688212,"statfs":{"total":96636764160,"available":91840729088,"internally_reserved":0,"allocated":3026092032,"data_stored":3018973276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":253535,"internal_metadata":1769677217},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 17:33:50 2023","interfaces":[{"interface":"back","average":{"1min":2.569,"5min":1.593,"15min":1.6739999999999999},"min":{"1min":0.37,"5min":0.34000000000000002,"15min":0.32900000000000001},"max":{"1min":18.879000000000001,"5min":18.879000000000001,"15min":18.879000000000001},"last":7.79},{"interface":"front","average":{"1min":3.702,"5min":1.9510000000000001,"15min":1.802},"min":{"1min":0.40300000000000002,"5min":0.35099999999999998,"15min":0.30599999999999999},"max":{"1min":19.068000000000001,"5min":19.068000000000001,"15min":19.068000000000001},"last":0.84299999999999997}]},{"osd":1,"last update":"Tue Dec 12 17:33:50 2023","interfaces":[{"interface":"back","average":{"1min":2.4790000000000001,"5min":1.8129999999999999,"15min":1.696},"min":{"1min":0.59799999999999998,"5min":0.376,"15min":0.34699999999999998},"max":{"1min":18.826000000000001,"5min":18.826000000000001,"15min":18.826000000000001},"last":6.8600000000000003},{"interface":"front","average":{"1min":2.3730000000000002,"5min":1.7949999999999999,"15min":1.718},"min":{"1min":0.64500000000000002,"5min":0.46500000000000002,"15min":0.371},"max":{"1min":16.858000000000001,"5min":16.858000000000001,"15min":16.858000000000001},"last":6.8929999999999998}]},{"osd":2,"last update":"Tue Dec 12 17:33:50 2023","interfaces":[{"interface":"back","average":{"1min":1.9279999999999999,"5min":1.706,"15min":1.889},"min":{"1min":0.41999999999999998,"5min":0.39800000000000002,"15min":0.378},"max":{"1min":19,"5min":19,"15min":19},"last":1.4139999999999999},{"interface":"front","average":{"1min":3.206,"5min":1.9990000000000001,"15min":1.917},"min":{"1min":0.51300000000000001,"5min":0.41999999999999998,"15min":0.40799999999999997},"max":{"1min":34.941000000000003,"5min":34.941000000000003,"15min":34.941000000000003},"last":6.0899999999999999}]},{"osd":3,"last update":"Tue Dec 12 17:33:50 2023","interfaces":[{"interface":"back","average":{"1min":2.4510000000000001,"5min":2.472,"15min":2.0790000000000002},"min":{"1min":0.505,"5min":0.48599999999999999,"15min":0.41999999999999998},"max":{"1min":16.475999999999999,"5min":88.251999999999995,"15min":88.251999999999995},"last":7.0730000000000004},{"interface":"front","average":{"1min":3.0880000000000001,"5min":2.8889999999999998,"15min":2.1179999999999999},"min":{"1min":0.44,"5min":0.44,"15min":0.41199999999999998},"max":{"1min":39.072000000000003,"5min":80.805999999999997,"15min":80.805999999999997},"last":5.4779999999999998}]},{"osd":4,"last update":"Tue Dec 12 17:33:50 2023","interfaces":[{"interface":"back","average":{"1min":1.752,"5min":1.0169999999999999,"15min":0.72399999999999998},"min":{"1min":0.36299999999999999,"5min":0.35499999999999998,"15min":0.318},"max":{"1min":16.427,"5min":16.427,"15min":16.427},"last":0.504},{"interface":"front","average":{"1min":1.5800000000000001,"5min":1.0009999999999999,"15min":0.72399999999999998},"min":{"1min":0.41799999999999998,"5min":0.34399999999999997,"15min":0.28100000000000003},"max":{"1min":18.933,"5min":18.933,"15min":18.933},"last":0.53800000000000003}]},{"osd":5,"last update":"Tue Dec 12 17:33:50 2023","interfaces":[{"interface":"back","average":{"1min":1.1850000000000001,"5min":0.95499999999999996,"15min":1.1180000000000001},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.36499999999999999},"max":{"1min":9.1400000000000006,"5min":9.1400000000000006,"15min":123.398},"last":0.58999999999999997},{"interface":"front","average":{"1min":1.78,"5min":1.0580000000000001,"15min":1.165},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":18.969000000000001,"5min":18.969000000000001,"15min":121.617},"last":0.64100000000000001}]},{"osd":7,"last update":"Tue Dec 12 17:33:50 2023","interfaces":[{"interface":"back","average":{"1min":1.6910000000000001,"5min":0.96299999999999997,"15min":0.74399999999999999},"min":{"1min":0.38,"5min":0.36699999999999999,"15min":0.35099999999999998},"max":{"1min":21.306000000000001,"5min":21.306000000000001,"15min":21.306000000000001},"last":0.65900000000000003},{"interface":"front","average":{"1min":1.175,"5min":0.98999999999999999,"15min":0.77900000000000003},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.38400000000000001},"max":{"1min":8.6340000000000003,"5min":8.6340000000000003,"15min":8.6340000000000003},"last":0.70099999999999996}]}]},{"osd":5,"up_from":13,"seq":55834580163,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2276396,"kb_used_data":463348,"kb_used_omap":1077,"kb_used_meta":1714698,"kb_avail":92095444,"statfs":{"total":96636764160,"available":94305734656,"internally_reserved":0,"allocated":474468352,"data_stored":473292390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1102957,"internal_metadata":1755851667},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":184,"apply_latency_ms":184,"commit_latency_ns":184000000,"apply_latency_ns":184000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 17:34:44 2023","interfaces":[{"interface":"back","average":{"1min":2.6600000000000001,"5min":1.718,"15min":1.6759999999999999},"min":{"1min":0.376,"5min":0.36899999999999999,"15min":0.313},"max":{"1min":10.356999999999999,"5min":13.279,"15min":13.279},"last":1.177},{"interface":"front","average":{"1min":2.0230000000000001,"5min":1.8460000000000001,"15min":1.744},"min":{"1min":0.50600000000000001,"5min":0.37,"15min":0.32100000000000001},"max":{"1min":10.586,"5min":10.586,"15min":10.586},"last":0.89800000000000002}]},{"osd":1,"last update":"Tue Dec 12 17:34:44 2023","interfaces":[{"interface":"back","average":{"1min":2.452,"5min":2.1179999999999999,"15min":2.032},"min":{"1min":0.51200000000000001,"5min":0.42299999999999999,"15min":0.38400000000000001},"max":{"1min":10.776,"5min":10.776,"15min":17.175000000000001},"last":1.137},{"interface":"front","average":{"1min":2.266,"5min":1.579,"15min":1.607},"min":{"1min":0.65500000000000003,"5min":0.379,"15min":0.379},"max":{"1min":8.5440000000000005,"5min":8.5440000000000005,"15min":12.363},"last":1.278}]},{"osd":2,"last update":"Tue Dec 12 17:34:44 2023","interfaces":[{"interface":"back","average":{"1min":3.3119999999999998,"5min":2.0430000000000001,"15min":1.8640000000000001},"min":{"1min":0.52400000000000002,"5min":0.40899999999999997,"15min":0.40100000000000002},"max":{"1min":16.010999999999999,"5min":16.010999999999999,"15min":16.010999999999999},"last":28.800000000000001},{"interface":"front","average":{"1min":3.274,"5min":2.0649999999999999,"15min":1.929},"min":{"1min":0.64600000000000002,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":16.209,"5min":16.209,"15min":16.209},"last":28.771999999999998}]},{"osd":3,"last update":"Tue Dec 12 17:34:44 2023","interfaces":[{"interface":"back","average":{"1min":2.6059999999999999,"5min":2.2559999999999998,"15min":2.1930000000000001},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":12.015000000000001,"5min":32.682000000000002,"15min":32.682000000000002},"last":0.70799999999999996},{"interface":"front","average":{"1min":2.7349999999999999,"5min":2.0089999999999999,"15min":2.0489999999999999},"min":{"1min":0.55900000000000005,"5min":0.54400000000000004,"15min":0.42799999999999999},"max":{"1min":10.516999999999999,"5min":10.897,"15min":10.897},"last":0.52100000000000002}]},{"osd":4,"last update":"Tue Dec 12 17:34:44 2023","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.753,"15min":0.66300000000000003},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":6.3639999999999999,"5min":6.3639999999999999,"15min":6.3639999999999999},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.73599999999999999,"15min":0.67000000000000004},"min":{"1min":0.41399999999999998,"5min":0.374,"15min":0.34000000000000002},"max":{"1min":1.6619999999999999,"5min":4.4000000000000004,"15min":4.4000000000000004},"last":1.216}]},{"osd":6,"last update":"Tue Dec 12 17:34:44 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.81499999999999995,"15min":0.69099999999999995},"min":{"1min":0.39100000000000001,"5min":0.35599999999999998,"15min":0.34100000000000003},"max":{"1min":2.9609999999999999,"5min":10.016,"15min":10.016},"last":1.238},{"interface":"front","average":{"1min":1.012,"5min":0.82399999999999995,"15min":0.70099999999999996},"min":{"1min":0.44800000000000001,"5min":0.39300000000000002,"15min":0.34999999999999998},"max":{"1min":7.0049999999999999,"5min":7.0049999999999999,"15min":7.0049999999999999},"last":0.60499999999999998}]},{"osd":7,"last update":"Tue Dec 12 17:34:44 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.76700000000000002,"15min":0.69199999999999995},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":4.109,"5min":4.109,"15min":4.109},"last":1.0880000000000001},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.81000000000000005,"15min":0.73799999999999999},"min":{"1min":0.433,"5min":0.41499999999999998,"15min":0.39600000000000002},"max":{"1min":2.7280000000000002,"5min":3.407,"15min":3.875},"last":0.95099999999999996}]}]},{"osd":4,"up_from":13,"seq":55834580167,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1679988,"kb_used_data":4652,"kb_used_omap":861,"kb_used_meta":1674466,"kb_avail":92691852,"statfs":{"total":96636764160,"available":94916456448,"internally_reserved":0,"allocated":4763648,"data_stored":4464188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":882141,"internal_metadata":1714653731},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":122,"apply_latency_ms":122,"commit_latency_ns":122000000,"apply_latency_ns":122000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 17:34:41 2023","interfaces":[{"interface":"back","average":{"1min":2.0059999999999998,"5min":1.7649999999999999,"15min":2.1789999999999998},"min":{"1min":0.498,"5min":0.36799999999999999,"15min":0.31900000000000001},"max":{"1min":6.0460000000000003,"5min":9.4499999999999993,"15min":170.917},"last":8.8510000000000009},{"interface":"front","average":{"1min":1.52,"5min":1.643,"15min":2.0910000000000002},"min":{"1min":0.47299999999999998,"5min":0.39700000000000002,"15min":0.33800000000000002},"max":{"1min":6.218,"5min":9.3119999999999994,"15min":170.74199999999999},"last":8.2189999999999994}]},{"osd":1,"last update":"Tue Dec 12 17:34:41 2023","interfaces":[{"interface":"back","average":{"1min":1.516,"5min":1.8440000000000001,"15min":1.6919999999999999},"min":{"1min":0.42199999999999999,"5min":0.40600000000000003,"15min":0.33400000000000002},"max":{"1min":4.5170000000000003,"5min":36.478999999999999,"15min":36.478999999999999},"last":17.623999999999999},{"interface":"front","average":{"1min":1.5149999999999999,"5min":1.7709999999999999,"15min":1.931},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":6.5369999999999999,"5min":25.585999999999999,"15min":25.585999999999999},"last":18.757999999999999}]},{"osd":2,"last update":"Tue Dec 12 17:34:41 2023","interfaces":[{"interface":"back","average":{"1min":1.5189999999999999,"5min":2.016,"15min":2.2509999999999999},"min":{"1min":0.47099999999999997,"5min":0.376,"15min":0.376},"max":{"1min":4.5549999999999997,"5min":14.356999999999999,"15min":169.21799999999999},"last":7.2880000000000003},{"interface":"front","average":{"1min":1.7809999999999999,"5min":1.768,"15min":2.3450000000000002},"min":{"1min":0.63800000000000001,"5min":0.57299999999999995,"15min":0.47999999999999998},"max":{"1min":5.9580000000000002,"5min":11.739000000000001,"15min":179.34100000000001},"last":8.8059999999999992}]},{"osd":3,"last update":"Tue Dec 12 17:34:41 2023","interfaces":[{"interface":"back","average":{"1min":1.9119999999999999,"5min":1.8320000000000001,"15min":2.4159999999999999},"min":{"1min":0.58499999999999996,"5min":0.433,"15min":0.39900000000000002},"max":{"1min":5.657,"5min":9.3650000000000002,"15min":169.232},"last":12.829000000000001},{"interface":"front","average":{"1min":1.7529999999999999,"5min":1.861,"15min":2.48},"min":{"1min":0.52200000000000002,"5min":0.432,"15min":0.432},"max":{"1min":4.9370000000000003,"5min":14.401,"15min":168.79300000000001},"last":8.6950000000000003}]},{"osd":5,"last update":"Tue Dec 12 17:34:41 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":1.484,"15min":1.0580000000000001},"min":{"1min":0.34399999999999997,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.498,"5min":53.762,"15min":58.701999999999998},"last":8.9060000000000006},{"interface":"front","average":{"1min":0.65700000000000003,"5min":1.522,"15min":1.101},"min":{"1min":0.42299999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":2.5539999999999998,"5min":53.628,"15min":59.149999999999999},"last":7.4219999999999997}]},{"osd":6,"last update":"Tue Dec 12 17:34:41 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.91600000000000004,"15min":0.71499999999999997},"min":{"1min":0.42999999999999999,"5min":0.378,"15min":0.33100000000000002},"max":{"1min":1.6200000000000001,"5min":14.432,"15min":14.432},"last":7.0389999999999997},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.91700000000000004,"15min":0.72699999999999998},"min":{"1min":0.39300000000000002,"5min":0.38100000000000001,"15min":0.36499999999999999},"max":{"1min":0.74199999999999999,"5min":10.343,"15min":10.343},"last":8.9429999999999996}]},{"osd":7,"last update":"Tue Dec 12 17:34:41 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":1.6319999999999999,"15min":0.95699999999999996},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.35299999999999998},"max":{"1min":0.85299999999999998,"5min":53.590000000000003,"15min":53.590000000000003},"last":6.9779999999999998},{"interface":"front","average":{"1min":0.71099999999999997,"5min":1.7889999999999999,"15min":1.0529999999999999},"min":{"1min":0.502,"5min":0.44,"15min":0.38500000000000001},"max":{"1min":1.6970000000000001,"5min":54.088999999999999,"15min":54.088999999999999},"last":7.0789999999999997}]}]},{"osd":3,"up_from":13,"seq":55834580107,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5352296,"kb_used_data":3696668,"kb_used_omap":494,"kb_used_meta":1646929,"kb_avail":89019544,"statfs":{"total":96636764160,"available":91156013056,"internally_reserved":0,"allocated":3785388032,"data_stored":3776913406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":506379,"internal_metadata":1686455797},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 17:34:43 2023","interfaces":[{"interface":"back","average":{"1min":2.5379999999999998,"5min":2.516,"15min":2.851},"min":{"1min":0.68400000000000005,"5min":0.434,"15min":0.307},"max":{"1min":8.093,"5min":9.9570000000000007,"15min":18.190999999999999},"last":1.127},{"interface":"front","average":{"1min":3.2189999999999999,"5min":2.766,"15min":3.1589999999999998},"min":{"1min":0.85999999999999999,"5min":0.39500000000000002,"15min":0.27800000000000002},"max":{"1min":10.084,"5min":10.084,"15min":20.350000000000001},"last":1.3620000000000001}]},{"osd":1,"last update":"Tue Dec 12 17:34:43 2023","interfaces":[{"interface":"back","average":{"1min":3.1640000000000001,"5min":3.6949999999999998,"15min":3.4489999999999998},"min":{"1min":0.79800000000000004,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":13.246,"5min":49.18,"15min":49.18},"last":1.0880000000000001},{"interface":"front","average":{"1min":4.0030000000000001,"5min":3.758,"15min":3.5779999999999998},"min":{"1min":0.97099999999999997,"5min":0.61299999999999999,"15min":0.379},"max":{"1min":30.030999999999999,"5min":52.167999999999999,"15min":52.167999999999999},"last":1.214}]},{"osd":2,"last update":"Tue Dec 12 17:34:43 2023","interfaces":[{"interface":"back","average":{"1min":2.403,"5min":2.9809999999999999,"15min":3.3140000000000001},"min":{"1min":0.64400000000000002,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":5.0389999999999997,"5min":11.208,"15min":11.630000000000001},"last":1.276},{"interface":"front","average":{"1min":4.4189999999999996,"5min":3.3799999999999999,"15min":3.5510000000000002},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":18.041,"5min":18.379000000000001,"15min":18.379000000000001},"last":1.3460000000000001}]},{"osd":4,"last update":"Tue Dec 12 17:34:43 2023","interfaces":[{"interface":"back","average":{"1min":3.7610000000000001,"5min":2.504,"15min":2.4510000000000001},"min":{"1min":0.63,"5min":0.47099999999999997,"15min":0.38900000000000001},"max":{"1min":19.050000000000001,"5min":19.050000000000001,"15min":20.094999999999999},"last":1.1679999999999999},{"interface":"front","average":{"1min":2.923,"5min":2.5,"15min":2.6680000000000001},"min":{"1min":0.76200000000000001,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":18.914000000000001,"5min":18.914000000000001,"15min":18.914000000000001},"last":1.637}]},{"osd":5,"last update":"Tue Dec 12 17:34:43 2023","interfaces":[{"interface":"back","average":{"1min":2.7799999999999998,"5min":2.5009999999999999,"15min":2.6259999999999999},"min":{"1min":0.65300000000000002,"5min":0.52800000000000002,"15min":0.51900000000000002},"max":{"1min":8.4960000000000004,"5min":17.245000000000001,"15min":17.474},"last":1.589},{"interface":"front","average":{"1min":3.2629999999999999,"5min":2.5,"15min":2.5950000000000002},"min":{"1min":0.73399999999999999,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":10.616,"5min":10.616,"15min":19.887},"last":1.47}]},{"osd":6,"last update":"Tue Dec 12 17:34:43 2023","interfaces":[{"interface":"back","average":{"1min":2.1459999999999999,"5min":2.4039999999999999,"15min":2.7610000000000001},"min":{"1min":0.85699999999999998,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":5.5709999999999997,"5min":11.834,"15min":11.834},"last":1.7509999999999999},{"interface":"front","average":{"1min":2.7010000000000001,"5min":2.5920000000000001,"15min":2.6960000000000002},"min":{"1min":0.72699999999999998,"5min":0.504,"15min":0.504},"max":{"1min":5.3090000000000002,"5min":17.364999999999998,"15min":18.298999999999999},"last":1.659}]},{"osd":7,"last update":"Tue Dec 12 17:34:43 2023","interfaces":[{"interface":"back","average":{"1min":3.4649999999999999,"5min":2.6880000000000002,"15min":2.7869999999999999},"min":{"1min":0.77600000000000002,"5min":0.497,"15min":0.497},"max":{"1min":9.9730000000000008,"5min":9.9730000000000008,"15min":20.006},"last":1.6850000000000001},{"interface":"front","average":{"1min":2.2330000000000001,"5min":2.681,"15min":2.9620000000000002},"min":{"1min":0.94099999999999995,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":5.8259999999999996,"5min":11.954000000000001,"15min":11.954000000000001},"last":1.7150000000000001}]}]},{"osd":2,"up_from":13,"seq":55834580116,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5024116,"kb_used_data":3413028,"kb_used_omap":96,"kb_used_meta":1610975,"kb_avail":89347724,"statfs":{"total":96636764160,"available":91492069376,"internally_reserved":0,"allocated":3494940672,"data_stored":3486701156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":98548,"internal_metadata":1649639180},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":104,"apply_latency_ms":104,"commit_latency_ns":104000000,"apply_latency_ns":104000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 17:34:32 2023","interfaces":[{"interface":"back","average":{"1min":2.097,"5min":2.4129999999999998,"15min":3.1000000000000001},"min":{"1min":0.52700000000000002,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":6.7140000000000004,"5min":11.083,"15min":16.509},"last":6.742},{"interface":"front","average":{"1min":2.9340000000000002,"5min":2.8559999999999999,"15min":3.1299999999999999},"min":{"1min":0.59999999999999998,"5min":0.40000000000000002,"15min":0.317},"max":{"1min":6.069,"5min":12.016999999999999,"15min":17.859999999999999},"last":6.8979999999999997}]},{"osd":1,"last update":"Tue Dec 12 17:34:32 2023","interfaces":[{"interface":"back","average":{"1min":3.25,"5min":2.98,"15min":3.2130000000000001},"min":{"1min":0.61799999999999999,"5min":0.44600000000000001,"15min":0.39900000000000002},"max":{"1min":8.9130000000000003,"5min":13.569000000000001,"15min":13.76},"last":0.83799999999999997},{"interface":"front","average":{"1min":3.0830000000000002,"5min":2.706,"15min":3.5470000000000002},"min":{"1min":0.59699999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":12.25,"5min":12.25,"15min":19.837},"last":6.6479999999999997}]},{"osd":3,"last update":"Tue Dec 12 17:34:32 2023","interfaces":[{"interface":"back","average":{"1min":3.9329999999999998,"5min":4.3559999999999999,"15min":3.6909999999999998},"min":{"1min":0.73199999999999998,"5min":0.47199999999999998,"15min":0.437},"max":{"1min":9.0389999999999997,"5min":84.209999999999994,"15min":84.209999999999994},"last":2.5209999999999999},{"interface":"front","average":{"1min":2.7810000000000001,"5min":4.0039999999999996,"15min":4.1390000000000002},"min":{"1min":1.252,"5min":0.65200000000000002,"15min":0.41299999999999998},"max":{"1min":4.6200000000000001,"5min":80.575999999999993,"15min":80.575999999999993},"last":6.8380000000000001}]},{"osd":4,"last update":"Tue Dec 12 17:34:32 2023","interfaces":[{"interface":"back","average":{"1min":2.3380000000000001,"5min":2.3889999999999998,"15min":2.6110000000000002},"min":{"1min":0.82999999999999996,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":5.8559999999999999,"5min":14.877000000000001,"15min":14.877000000000001},"last":10.885999999999999},{"interface":"front","average":{"1min":2.7509999999999999,"5min":2.573,"15min":2.6240000000000001},"min":{"1min":0.92200000000000004,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":5.2839999999999998,"5min":14.787000000000001,"15min":14.787000000000001},"last":2.2440000000000002}]},{"osd":5,"last update":"Tue Dec 12 17:34:32 2023","interfaces":[{"interface":"back","average":{"1min":1.6479999999999999,"5min":2.5649999999999999,"15min":2.9140000000000001},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.48799999999999999},"max":{"1min":3.7949999999999999,"5min":37.231000000000002,"15min":37.231000000000002},"last":6.5179999999999998},{"interface":"front","average":{"1min":2.4079999999999999,"5min":3.165,"15min":2.9550000000000001},"min":{"1min":0.90600000000000003,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":5.976,"5min":41.021999999999998,"15min":41.021999999999998},"last":11.025}]},{"osd":6,"last update":"Tue Dec 12 17:34:32 2023","interfaces":[{"interface":"back","average":{"1min":2.851,"5min":2.7210000000000001,"15min":2.782},"min":{"1min":0.97599999999999998,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":5.3879999999999999,"5min":10.343999999999999,"15min":13.130000000000001},"last":2.4340000000000002},{"interface":"front","average":{"1min":1.73,"5min":2.3410000000000002,"15min":2.9689999999999999},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.52000000000000002},"max":{"1min":3.8300000000000001,"5min":7.6109999999999998,"15min":14.566000000000001},"last":6.3979999999999997}]},{"osd":7,"last update":"Tue Dec 12 17:34:32 2023","interfaces":[{"interface":"back","average":{"1min":2.6160000000000001,"5min":3.2429999999999999,"15min":3.089},"min":{"1min":1.042,"5min":0.60799999999999998,"15min":0.59399999999999997},"max":{"1min":6.173,"5min":41.134999999999998,"15min":41.134999999999998},"last":11.118},{"interface":"front","average":{"1min":2.9590000000000001,"5min":3.1520000000000001,"15min":3.0070000000000001},"min":{"1min":1.0249999999999999,"5min":0.53700000000000003,"15min":0.53500000000000003},"max":{"1min":5.5640000000000001,"5min":37.591000000000001,"15min":37.591000000000001},"last":2.3460000000000001}]}]},{"osd":1,"up_from":13,"seq":55834580125,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3840892,"kb_used_data":2511412,"kb_used_omap":204,"kb_used_meta":1329267,"kb_avail":90530948,"statfs":{"total":96636764160,"available":92703690752,"internally_reserved":0,"allocated":2571685888,"data_stored":2564987139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":209158,"internal_metadata":1361170170},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":167,"apply_latency_ms":167,"commit_latency_ns":167000000,"apply_latency_ns":167000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 17:33:47 2023","interfaces":[{"interface":"back","average":{"1min":3.5270000000000001,"5min":2.6280000000000001,"15min":3.2719999999999998},"min":{"1min":1.091,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":15.220000000000001,"5min":15.220000000000001,"15min":45.871000000000002},"last":4.2809999999999997},{"interface":"front","average":{"1min":7.2720000000000002,"5min":3.363,"15min":3.5569999999999999},"min":{"1min":0.77700000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":37.084000000000003,"5min":37.084000000000003,"15min":46.155999999999999},"last":2.0550000000000002}]},{"osd":2,"last update":"Tue Dec 12 17:33:47 2023","interfaces":[{"interface":"back","average":{"1min":6.8330000000000002,"5min":3.5960000000000001,"15min":3.806},"min":{"1min":0.65400000000000003,"5min":0.51500000000000001,"15min":0.45300000000000001},"max":{"1min":36.338999999999999,"5min":36.338999999999999,"15min":69.111000000000004},"last":11.622999999999999},{"interface":"front","average":{"1min":4.0730000000000004,"5min":3.0529999999999999,"15min":3.9449999999999998},"min":{"1min":0.77300000000000002,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":16.756,"5min":16.756,"15min":66.488},"last":11.863}]},{"osd":3,"last update":"Tue Dec 12 17:33:47 2023","interfaces":[{"interface":"back","average":{"1min":5.1289999999999996,"5min":3.3090000000000002,"15min":3.665},"min":{"1min":0.67300000000000004,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":36.104999999999997,"5min":36.104999999999997,"15min":66.596999999999994},"last":12.343},{"interface":"front","average":{"1min":8.016,"5min":3.8820000000000001,"15min":3.9220000000000002},"min":{"1min":1.4670000000000001,"5min":0.45300000000000001,"15min":0.44800000000000001},"max":{"1min":37.051000000000002,"5min":37.051000000000002,"15min":65.433999999999997},"last":7.6790000000000003}]},{"osd":4,"last update":"Tue Dec 12 17:33:47 2023","interfaces":[{"interface":"back","average":{"1min":5.6100000000000003,"5min":2.907,"15min":2.4529999999999998},"min":{"1min":0.79200000000000004,"5min":0.58499999999999996,"15min":0.41399999999999998},"max":{"1min":36.465000000000003,"5min":36.465000000000003,"15min":36.465000000000003},"last":11.237},{"interface":"front","average":{"1min":5.1420000000000003,"5min":3.0470000000000002,"15min":2.8839999999999999},"min":{"1min":0.79700000000000004,"5min":0.64100000000000001,"15min":0.46999999999999997},"max":{"1min":35.859000000000002,"5min":35.859000000000002,"15min":35.859000000000002},"last":1.1639999999999999}]},{"osd":5,"last update":"Tue Dec 12 17:33:47 2023","interfaces":[{"interface":"back","average":{"1min":7.6120000000000001,"5min":3.1949999999999998,"15min":2.8399999999999999},"min":{"1min":0.85299999999999998,"5min":0.51000000000000001,"15min":0.503},"max":{"1min":36.865000000000002,"5min":36.865000000000002,"15min":36.865000000000002},"last":5.4180000000000001},{"interface":"front","average":{"1min":6.4790000000000001,"5min":3.242,"15min":2.661},"min":{"1min":0.84399999999999997,"5min":0.58899999999999997,"15min":0.47399999999999998},"max":{"1min":36.695999999999998,"5min":36.695999999999998,"15min":36.695999999999998},"last":11.132999999999999}]},{"osd":6,"last update":"Tue Dec 12 17:33:47 2023","interfaces":[{"interface":"back","average":{"1min":7.4740000000000002,"5min":3.2360000000000002,"15min":2.9489999999999998},"min":{"1min":0.95999999999999996,"5min":0.55900000000000005,"15min":0.53500000000000003},"max":{"1min":36.433999999999997,"5min":36.433999999999997,"15min":36.433999999999997},"last":5.2939999999999996},{"interface":"front","average":{"1min":6.6349999999999998,"5min":3.2919999999999998,"15min":2.7909999999999999},"min":{"1min":0.873,"5min":0.57499999999999996,"15min":0.49099999999999999},"max":{"1min":36.612000000000002,"5min":36.612000000000002,"15min":36.612000000000002},"last":11.324999999999999}]},{"osd":7,"last update":"Tue Dec 12 17:33:47 2023","interfaces":[{"interface":"back","average":{"1min":5.8739999999999997,"5min":3.278,"15min":3.0310000000000001},"min":{"1min":0.89200000000000002,"5min":0.67700000000000005,"15min":0.51600000000000001},"max":{"1min":36.006999999999998,"5min":36.006999999999998,"15min":36.006999999999998},"last":1.022},{"interface":"front","average":{"1min":7.4550000000000001,"5min":3.3090000000000002,"15min":3.056},"min":{"1min":1.048,"5min":0.75900000000000001,"15min":0.58499999999999996},"max":{"1min":36.979999999999997,"5min":36.979999999999997,"15min":36.979999999999997},"last":3.0710000000000002}]}]},{"osd":0,"up_from":13,"seq":55834580119,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4187908,"kb_used_data":2564860,"kb_used_omap":327,"kb_used_meta":1622712,"kb_avail":90183932,"statfs":{"total":96636764160,"available":92348346368,"internally_reserved":0,"allocated":2626416640,"data_stored":2620221908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":335698,"internal_metadata":1661657262},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":150,"apply_latency_ms":150,"commit_latency_ns":150000000,"apply_latency_ns":150000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 12 17:34:43 2023","interfaces":[{"interface":"back","average":{"1min":2.9569999999999999,"5min":3.2229999999999999,"15min":2.988},"min":{"1min":0.34499999999999997,"5min":0.34300000000000003,"15min":0.32700000000000001},"max":{"1min":8.6050000000000004,"5min":24.763000000000002,"15min":24.763000000000002},"last":9.4039999999999999},{"interface":"front","average":{"1min":3.4039999999999999,"5min":3.536,"15min":3.242},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.378},"max":{"1min":16.047999999999998,"5min":22.780000000000001,"15min":22.780000000000001},"last":10.465}]},{"osd":2,"last update":"Tue Dec 12 17:34:43 2023","interfaces":[{"interface":"back","average":{"1min":3.7789999999999999,"5min":3.601,"15min":3.4929999999999999},"min":{"1min":0.59999999999999998,"5min":0.55800000000000005,"15min":0.51200000000000001},"max":{"1min":16.143999999999998,"5min":23.042999999999999,"15min":23.042999999999999},"last":10.315},{"interface":"front","average":{"1min":3.113,"5min":3.476,"15min":3.9380000000000002},"min":{"1min":0.64000000000000001,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":8.6940000000000008,"5min":24.658000000000001,"15min":151.84100000000001},"last":9.8330000000000002}]},{"osd":3,"last update":"Tue Dec 12 17:34:43 2023","interfaces":[{"interface":"back","average":{"1min":5.1059999999999999,"5min":4.4020000000000001,"15min":3.6680000000000001},"min":{"1min":0.89100000000000001,"5min":0.42399999999999999,"15min":0.38500000000000001},"max":{"1min":31.922999999999998,"5min":64.292000000000002,"15min":64.292000000000002},"last":9.4890000000000008},{"interface":"front","average":{"1min":4.181,"5min":3.891,"15min":3.524},"min":{"1min":0.70199999999999996,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":15.932,"5min":25.207999999999998,"15min":25.207999999999998},"last":10.108000000000001}]},{"osd":4,"last update":"Tue Dec 12 17:34:43 2023","interfaces":[{"interface":"back","average":{"1min":2.4620000000000002,"5min":2.855,"15min":2.4199999999999999},"min":{"1min":0.69799999999999995,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":8.1769999999999996,"5min":24.856000000000002,"15min":24.856000000000002},"last":9.5640000000000001},{"interface":"front","average":{"1min":4.2249999999999996,"5min":3.9180000000000001,"15min":2.8919999999999999},"min":{"1min":0.51900000000000002,"5min":0.47299999999999998,"15min":0.434},"max":{"1min":32.006999999999998,"5min":64.061999999999998,"15min":64.061999999999998},"last":9.6379999999999999}]},{"osd":5,"last update":"Tue Dec 12 17:34:43 2023","interfaces":[{"interface":"back","average":{"1min":3.6989999999999998,"5min":3.371,"15min":2.6749999999999998},"min":{"1min":0.66000000000000003,"5min":0.49299999999999999,"15min":0.438},"max":{"1min":21.183,"5min":27.843,"15min":27.843},"last":9.9800000000000004},{"interface":"front","average":{"1min":3.0680000000000001,"5min":3.3410000000000002,"15min":2.8439999999999999},"min":{"1min":0.66900000000000004,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":7.1870000000000003,"5min":22.68,"15min":22.68},"last":10.691000000000001}]},{"osd":6,"last update":"Tue Dec 12 17:34:43 2023","interfaces":[{"interface":"back","average":{"1min":3.1480000000000001,"5min":3.085,"15min":2.8370000000000002},"min":{"1min":0.63500000000000001,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":7.4130000000000003,"5min":22.457999999999998,"15min":22.457999999999998},"last":17.977},{"interface":"front","average":{"1min":2.972,"5min":3.3359999999999999,"15min":2.7759999999999998},"min":{"1min":0.79100000000000004,"5min":0.628,"15min":0.51500000000000001},"max":{"1min":8.4109999999999996,"5min":40.453000000000003,"15min":40.453000000000003},"last":10.256}]},{"osd":7,"last update":"Tue Dec 12 17:34:43 2023","interfaces":[{"interface":"back","average":{"1min":2.9380000000000002,"5min":3.2400000000000002,"15min":2.843},"min":{"1min":0.82899999999999996,"5min":0.65900000000000003,"15min":0.60599999999999998},"max":{"1min":8.5120000000000005,"5min":24.510999999999999,"15min":24.510999999999999},"last":10.4},{"interface":"front","average":{"1min":4.5890000000000004,"5min":4.1539999999999999,"15min":3.1059999999999999},"min":{"1min":0.55800000000000005,"5min":0.52000000000000002,"15min":0.46500000000000002},"max":{"1min":32.055,"5min":64.191999999999993,"15min":64.191999999999993},"last":10.218}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-12T17:34:57.233 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-12-12T17:34:57.234 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-12T17:34:57.630 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:57.623+0000 7fd35d068640 1 Processor -- start 2023-12-12T17:34:57.631 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:57.623+0000 7fd35d068640 1 -- start start 2023-12-12T17:34:57.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:57.627+0000 7fd35d068640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fd3580d1cb0 0x7fd358167f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:34:57.634 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:57.627+0000 7fd35d068640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3580b3250 con 0x7fd35815d3c0 2023-12-12T17:34:57.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:57.627+0000 7fd35d068640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3580cee50 con 0x7fd3580d3b10 2023-12-12T17:34:57.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:57.627+0000 7fd35d068640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3580b2920 con 0x7fd3580d1cb0 2023-12-12T17:34:57.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:57.627+0000 7fd356d9d640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fd35815d3c0 0x7fd3580ce670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:40966/0 (socket says 172.21.15.78:40966) 2023-12-12T17:34:57.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:57.627+0000 7fd356d9d640 1 -- 172.21.15.78:0/827733504 learned_addr learned my addr 172.21.15.78:0/827733504 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-12-12T17:34:57.635 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:57.627+0000 7fd35759e640 1 --2- 172.21.15.78:0/827733504 >> v2:172.21.15.187:3300/0 conn(0x7fd3580d1cb0 0x7fd358167f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:34:57.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:57.627+0000 7fd35759e640 1 -- 172.21.15.78:0/827733504 >> v1:172.21.15.187:6789/0 conn(0x7fd3580d3b10 legacy=0x7fd3580d15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T17:34:57.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:57.627+0000 7fd35759e640 1 -- 172.21.15.78:0/827733504 >> v1:172.21.15.78:6789/0 conn(0x7fd35815d3c0 legacy=0x7fd3580ce670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:34:57.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:57.627+0000 7fd35759e640 1 -- 172.21.15.78:0/827733504 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3580b2c00 con 0x7fd3580d1cb0 2023-12-12T17:34:57.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:57.627+0000 7fd355d9b640 1 -- 172.21.15.78:0/827733504 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3257514025 0 0) 0x7fd3580b3250 con 0x7fd35815d3c0 2023-12-12T17:34:57.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:57.631+0000 7fd35759e640 1 --2- 172.21.15.78:0/827733504 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd3580d1cb0 0x7fd358167f50 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7fd350009d90 tx=0x7fd35001f130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=522152dacb095f26 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T17:34:57.639 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:57.631+0000 7fd355d9b640 1 -- 172.21.15.78:0/827733504 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3500af600 con 0x7fd3580d1cb0 2023-12-12T17:34:57.639 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:57.631+0000 7fd355d9b640 1 -- 172.21.15.78:0/827733504 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3500ab050 con 0x7fd3580d1cb0 2023-12-12T17:34:57.639 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:57.631+0000 7fd355d9b640 1 -- 172.21.15.78:0/827733504 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3500af980 con 0x7fd3580d1cb0 2023-12-12T17:34:57.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:57.631+0000 7fd35d068640 1 -- 172.21.15.78:0/827733504 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd3580d1cb0 msgr2=0x7fd358167f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:34:57.640 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:57.631+0000 7fd35d068640 1 --2- 172.21.15.78:0/827733504 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd3580d1cb0 0x7fd358167f50 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7fd350009d90 tx=0x7fd35001f130 comp rx=0 tx=0).stop 2023-12-12T17:34:57.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:57.635+0000 7fd35d068640 1 -- 172.21.15.78:0/827733504 shutdown_connections 2023-12-12T17:34:57.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:57.635+0000 7fd35d068640 1 --2- 172.21.15.78:0/827733504 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd3580d1cb0 0x7fd358167f50 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:57.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:57.635+0000 7fd35d068640 1 -- 172.21.15.78:0/827733504 >> 172.21.15.78:0/827733504 conn(0x7fd35809c2a0 msgr2=0x7fd3580d2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T17:34:57.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:57.635+0000 7fd35d068640 1 -- 172.21.15.78:0/827733504 shutdown_connections 2023-12-12T17:34:57.641 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:57.635+0000 7fd35d068640 1 -- 172.21.15.78:0/827733504 wait complete. 2023-12-12T17:34:57.645 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:57.639+0000 7fd35d068640 1 Processor -- start 2023-12-12T17:34:57.646 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:57.639+0000 7fd35d068640 1 -- start start 2023-12-12T17:34:57.648 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:57.643+0000 7fd35d068640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3580d1cb0 0x7fd3580b6ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:34:57.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:57.643+0000 7fd35d068640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd3580d3b10 0x7fd3580caaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:34:57.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:57.643+0000 7fd35d068640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd35815d3c0 0x7fd35815e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:34:57.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:57.643+0000 7fd35d068640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd35815d920 con 0x7fd3580d1cb0 2023-12-12T17:34:57.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:57.643+0000 7fd35d068640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3580b7400 con 0x7fd35815d3c0 2023-12-12T17:34:57.649 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:57.643+0000 7fd35d068640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3580cb3a0 con 0x7fd3580d3b10 2023-12-12T17:34:57.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:57.643+0000 7fd356d9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3580d1cb0 0x7fd3580b6ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:34:57.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:57.643+0000 7fd35759e640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd35815d3c0 0x7fd35815e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:34:57.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:57.643+0000 7fd35759e640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd35815d3c0 0x7fd35815e610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.78:48042/0 (socket says 172.21.15.78:48042) 2023-12-12T17:34:57.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:57.643+0000 7fd356d9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3580d1cb0 0x7fd3580b6ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:54684/0 (socket says 172.21.15.78:54684) 2023-12-12T17:34:57.651 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:57.643+0000 7fd35759e640 1 -- 172.21.15.78:0/2488234836 learned_addr learned my addr 172.21.15.78:0/2488234836 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T17:34:57.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:57.643+0000 7fd35659c640 1 --2- 172.21.15.78:0/2488234836 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd3580d3b10 0x7fd3580caaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:34:57.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:57.643+0000 7fd35759e640 1 -- 172.21.15.78:0/2488234836 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd3580d3b10 msgr2=0x7fd3580caaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:34:57.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:57.643+0000 7fd35759e640 1 --2- 172.21.15.78:0/2488234836 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd3580d3b10 0x7fd3580caaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:57.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:57.643+0000 7fd35759e640 1 -- 172.21.15.78:0/2488234836 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3580d1cb0 msgr2=0x7fd3580b6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:34:57.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:57.643+0000 7fd35759e640 1 --2- 172.21.15.78:0/2488234836 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3580d1cb0 0x7fd3580b6ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:57.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:57.643+0000 7fd35759e640 1 -- 172.21.15.78:0/2488234836 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd350009a70 con 0x7fd35815d3c0 2023-12-12T17:34:57.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:57.643+0000 7fd35759e640 1 --2- 172.21.15.78:0/2488234836 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd35815d3c0 0x7fd35815e610 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7fd35001cd60 tx=0x7fd35001bed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T17:34:57.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:57.643+0000 7fd33f7fe640 1 -- 172.21.15.78:0/2488234836 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3500b9410 con 0x7fd35815d3c0 2023-12-12T17:34:57.652 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:57.643+0000 7fd33f7fe640 1 -- 172.21.15.78:0/2488234836 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3500b9570 con 0x7fd35815d3c0 2023-12-12T17:34:57.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:57.643+0000 7fd35d068640 1 -- 172.21.15.78:0/2488234836 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd35815db30 con 0x7fd35815d3c0 2023-12-12T17:34:57.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:57.643+0000 7fd33f7fe640 1 -- 172.21.15.78:0/2488234836 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3500b9900 con 0x7fd35815d3c0 2023-12-12T17:34:57.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:57.643+0000 7fd35d068640 1 -- 172.21.15.78:0/2488234836 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd35815e0f0 con 0x7fd35815d3c0 2023-12-12T17:34:57.653 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:57.647+0000 7fd33f7fe640 1 -- 172.21.15.78:0/2488234836 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd3500b6050 con 0x7fd35815d3c0 2023-12-12T17:34:57.654 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:57.647+0000 7fd35d068640 1 -- 172.21.15.78:0/2488234836 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd358067530 con 0x7fd35815d3c0 2023-12-12T17:34:57.655 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:57.647+0000 7fd33f7fe640 1 --2- 172.21.15.78:0/2488234836 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fd344066470 0x7fd344068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:34:57.656 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:57.647+0000 7fd33f7fe640 1 -- 172.21.15.78:0/2488234836 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fd3501222f0 con 0x7fd35815d3c0 2023-12-12T17:34:57.657 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:57.651+0000 7fd356d9d640 1 --2- 172.21.15.78:0/2488234836 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fd344066470 0x7fd344068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:34:57.658 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:57.651+0000 7fd356d9d640 1 --2- 172.21.15.78:0/2488234836 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fd344066470 0x7fd344068930 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fd348007fd0 tx=0x7fd348007d60 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T17:34:57.659 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:57.651+0000 7fd33f7fe640 1 -- 172.21.15.78:0/2488234836 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd3500ef890 con 0x7fd35815d3c0 2023-12-12T17:34:58.502 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:58.491+0000 7fd35d068640 1 -- 172.21.15.78:0/2488234836 --> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd35815d7a0 con 0x7fd344066470 2023-12-12T17:34:58.562 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T17:34:58.562 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2023-12-12T17:34:58.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:58.551+0000 7fd33f7fe640 1 -- 172.21.15.78:0/2488234836 <== mgr.4104 v2:172.21.15.78:6832/1725498448 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+49586 (secure 0 0 0) 0x7fd348004c80 con 0x7fd344066470 2023-12-12T17:34:58.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:58.567+0000 7fd35d068640 1 -- 172.21.15.78:0/2488234836 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fd344066470 msgr2=0x7fd344068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:34:58.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:58.567+0000 7fd35d068640 1 --2- 172.21.15.78:0/2488234836 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fd344066470 0x7fd344068930 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fd348007fd0 tx=0x7fd348007d60 comp rx=0 tx=0).stop 2023-12-12T17:34:58.573 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:58.567+0000 7fd35d068640 1 -- 172.21.15.78:0/2488234836 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd35815d3c0 msgr2=0x7fd35815e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:34:58.574 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:58.567+0000 7fd35d068640 1 --2- 172.21.15.78:0/2488234836 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd35815d3c0 0x7fd35815e610 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7fd35001cd60 tx=0x7fd35001bed0 comp rx=0 tx=0).stop 2023-12-12T17:34:58.576 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:58.571+0000 7fd35d068640 1 -- 172.21.15.78:0/2488234836 shutdown_connections 2023-12-12T17:34:58.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:58.571+0000 7fd35d068640 1 --2- 172.21.15.78:0/2488234836 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fd344066470 0x7fd344068930 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:58.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:58.571+0000 7fd35d068640 1 --2- 172.21.15.78:0/2488234836 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd35815d3c0 0x7fd35815e610 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:58.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:58.571+0000 7fd35d068640 1 --2- 172.21.15.78:0/2488234836 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd3580d3b10 0x7fd3580caaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:58.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:58.571+0000 7fd35d068640 1 --2- 172.21.15.78:0/2488234836 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd3580d1cb0 0x7fd3580b6ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:58.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:58.571+0000 7fd35d068640 1 -- 172.21.15.78:0/2488234836 >> 172.21.15.78:0/2488234836 conn(0x7fd35809c2a0 msgr2=0x7fd3580cffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T17:34:58.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:58.579+0000 7fd35d068640 1 -- 172.21.15.78:0/2488234836 shutdown_connections 2023-12-12T17:34:58.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:58.583+0000 7fd35d068640 1 -- 172.21.15.78:0/2488234836 wait complete. 2023-12-12T17:34:58.763 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":13313,"stamp":"2023-12-12T17:34:56.578281+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":145,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":31423488,"kb_used_data":18398780,"kb_used_omap":3470,"kb_used_meta":12915697,"kb_avail":723551232,"statfs":{"total":773094113280,"available":740916461568,"internally_reserved":0,"allocated":18840350720,"data_stored":18796084386,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3554275,"internal_metadata":13225673757},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":854,"apply_latency_ms":854,"commit_latency_ns":854000000,"apply_latency_ns":854000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-26052398790,"num_objects":-22683,"num_object_clones":0,"num_object_copies":-45366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22683,"num_whiteouts":0,"num_read":-2048850,"num_read_kb":-143355453,"num_write":-6584726,"num_write_kb":-161614443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.007652"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":405,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-12T17:34:43.953907+0000","last_change":"2023-12-12T10:11:58.492812+0000","last_active":"2023-12-12T17:34:43.953907+0000","last_peered":"2023-12-12T17:34:43.953907+0000","last_clean":"2023-12-12T17:34:43.953907+0000","last_became_active":"2023-12-12T10:11:58.491470+0000","last_became_peered":"2023-12-12T10:11:58.491470+0000","last_unstale":"2023-12-12T17:34:43.953907+0000","last_undegraded":"2023-12-12T17:34:43.953907+0000","last_fullsized":"2023-12-12T17:34:43.953907+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:11:57.289641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:11:57.289641+0000","last_clean_scrub_stamp":"2023-12-12T10:11:57.289641+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:10:37.809139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834580163,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4378264,"kb_used_data":2789644,"kb_used_omap":161,"kb_used_meta":1588446,"kb_avail":89993576,"statfs":{"total":96636764160,"available":92153421824,"internally_reserved":0,"allocated":2856595456,"data_stored":2850530923,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":165859,"internal_metadata":1626568733},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":92,"apply_latency_ms":92,"commit_latency_ns":92000000,"apply_latency_ns":92000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 17:34:08 2023","interfaces":[{"interface":"back","average":{"1min":2.952,"5min":1.784,"15min":1.762},"min":{"1min":0.39200000000000002,"5min":0.35999999999999999,"15min":0.30599999999999999},"max":{"1min":21.974,"5min":21.974,"15min":21.974},"last":2.2949999999999999},{"interface":"front","average":{"1min":2.931,"5min":2.367,"15min":1.8959999999999999},"min":{"1min":0.45100000000000001,"5min":0.38900000000000001,"15min":0.30199999999999999},"max":{"1min":22.475999999999999,"5min":22.475999999999999,"15min":22.475999999999999},"last":4.0810000000000004}]},{"osd":1,"last update":"Tue Dec 12 17:34:08 2023","interfaces":[{"interface":"back","average":{"1min":1.954,"5min":1.9039999999999999,"15min":1.9159999999999999},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.35599999999999998},"max":{"1min":8.8350000000000009,"5min":10.756,"15min":24.129000000000001},"last":0.91000000000000003},{"interface":"front","average":{"1min":2.0529999999999999,"5min":1.726,"15min":1.859},"min":{"1min":0.36399999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":9.0660000000000007,"5min":9.0660000000000007,"15min":10.593999999999999},"last":7.9800000000000004}]},{"osd":2,"last update":"Tue Dec 12 17:34:08 2023","interfaces":[{"interface":"back","average":{"1min":2.7280000000000002,"5min":2.1640000000000001,"15min":2.044},"min":{"1min":0.57199999999999995,"5min":0.41699999999999998,"15min":0.374},"max":{"1min":8.9410000000000007,"5min":11.038,"15min":11.038},"last":2.2549999999999999},{"interface":"front","average":{"1min":1.8049999999999999,"5min":2.1789999999999998,"15min":1.909},"min":{"1min":0.52200000000000002,"5min":0.51500000000000001,"15min":0.41899999999999998},"max":{"1min":12.380000000000001,"5min":19.434999999999999,"15min":19.434999999999999},"last":4.718}]},{"osd":3,"last update":"Tue Dec 12 17:34:08 2023","interfaces":[{"interface":"back","average":{"1min":2.1970000000000001,"5min":2.9049999999999998,"15min":2.2759999999999998},"min":{"1min":0.55700000000000005,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":8.8680000000000003,"5min":113.107,"15min":113.107},"last":2.0590000000000002},{"interface":"front","average":{"1min":2.3769999999999998,"5min":3.2490000000000001,"15min":2.2890000000000001},"min":{"1min":0.57699999999999996,"5min":0.49299999999999999,"15min":0.40699999999999997},"max":{"1min":8.9890000000000008,"5min":109.90900000000001,"15min":109.90900000000001},"last":2.3300000000000001}]},{"osd":4,"last update":"Tue Dec 12 17:34:08 2023","interfaces":[{"interface":"back","average":{"1min":1.496,"5min":1.0349999999999999,"15min":0.74099999999999999},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":12.436999999999999,"5min":12.436999999999999,"15min":12.436999999999999},"last":4.1139999999999999},{"interface":"front","average":{"1min":1.484,"5min":0.93200000000000005,"15min":0.751},"min":{"1min":0.42099999999999999,"5min":0.40200000000000002,"15min":0.33400000000000002},"max":{"1min":8.7880000000000003,"5min":8.7880000000000003,"15min":8.7880000000000003},"last":0.84999999999999998}]},{"osd":5,"last update":"Tue Dec 12 17:34:08 2023","interfaces":[{"interface":"back","average":{"1min":1.5169999999999999,"5min":0.85099999999999998,"15min":0.67700000000000005},"min":{"1min":0.39100000000000001,"5min":0.33300000000000002,"15min":0.32800000000000001},"max":{"1min":9.3640000000000008,"5min":9.3640000000000008,"15min":9.3640000000000008},"last":2.3660000000000001},{"interface":"front","average":{"1min":1.3999999999999999,"5min":1.0469999999999999,"15min":0.75},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.33900000000000002},"max":{"1min":12.48,"5min":12.48,"15min":12.48},"last":4.0380000000000003}]},{"osd":6,"last update":"Tue Dec 12 17:34:08 2023","interfaces":[{"interface":"back","average":{"1min":1.5469999999999999,"5min":1.123,"15min":0.81999999999999995},"min":{"1min":0.47899999999999998,"5min":0.441,"15min":0.41999999999999998},"max":{"1min":12.528,"5min":12.528,"15min":12.528},"last":4.1529999999999996},{"interface":"front","average":{"1min":1.294,"5min":0.94799999999999995,"15min":0.78100000000000003},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.35099999999999998},"max":{"1min":8.8979999999999997,"5min":8.8979999999999997,"15min":8.8979999999999997},"last":0.95099999999999996}]}]},{"osd":6,"up_from":13,"seq":55834580164,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4683628,"kb_used_data":2955168,"kb_used_omap":247,"kb_used_meta":1728200,"kb_avail":89688212,"statfs":{"total":96636764160,"available":91840729088,"internally_reserved":0,"allocated":3026092032,"data_stored":3018973276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":253535,"internal_metadata":1769677217},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 17:33:50 2023","interfaces":[{"interface":"back","average":{"1min":2.569,"5min":1.593,"15min":1.6739999999999999},"min":{"1min":0.37,"5min":0.34000000000000002,"15min":0.32900000000000001},"max":{"1min":18.879000000000001,"5min":18.879000000000001,"15min":18.879000000000001},"last":7.79},{"interface":"front","average":{"1min":3.702,"5min":1.9510000000000001,"15min":1.802},"min":{"1min":0.40300000000000002,"5min":0.35099999999999998,"15min":0.30599999999999999},"max":{"1min":19.068000000000001,"5min":19.068000000000001,"15min":19.068000000000001},"last":0.84299999999999997}]},{"osd":1,"last update":"Tue Dec 12 17:33:50 2023","interfaces":[{"interface":"back","average":{"1min":2.4790000000000001,"5min":1.8129999999999999,"15min":1.696},"min":{"1min":0.59799999999999998,"5min":0.376,"15min":0.34699999999999998},"max":{"1min":18.826000000000001,"5min":18.826000000000001,"15min":18.826000000000001},"last":6.8600000000000003},{"interface":"front","average":{"1min":2.3730000000000002,"5min":1.7949999999999999,"15min":1.718},"min":{"1min":0.64500000000000002,"5min":0.46500000000000002,"15min":0.371},"max":{"1min":16.858000000000001,"5min":16.858000000000001,"15min":16.858000000000001},"last":6.8929999999999998}]},{"osd":2,"last update":"Tue Dec 12 17:33:50 2023","interfaces":[{"interface":"back","average":{"1min":1.9279999999999999,"5min":1.706,"15min":1.889},"min":{"1min":0.41999999999999998,"5min":0.39800000000000002,"15min":0.378},"max":{"1min":19,"5min":19,"15min":19},"last":1.4139999999999999},{"interface":"front","average":{"1min":3.206,"5min":1.9990000000000001,"15min":1.917},"min":{"1min":0.51300000000000001,"5min":0.41999999999999998,"15min":0.40799999999999997},"max":{"1min":34.941000000000003,"5min":34.941000000000003,"15min":34.941000000000003},"last":6.0899999999999999}]},{"osd":3,"last update":"Tue Dec 12 17:33:50 2023","interfaces":[{"interface":"back","average":{"1min":2.4510000000000001,"5min":2.472,"15min":2.0790000000000002},"min":{"1min":0.505,"5min":0.48599999999999999,"15min":0.41999999999999998},"max":{"1min":16.475999999999999,"5min":88.251999999999995,"15min":88.251999999999995},"last":7.0730000000000004},{"interface":"front","average":{"1min":3.0880000000000001,"5min":2.8889999999999998,"15min":2.1179999999999999},"min":{"1min":0.44,"5min":0.44,"15min":0.41199999999999998},"max":{"1min":39.072000000000003,"5min":80.805999999999997,"15min":80.805999999999997},"last":5.4779999999999998}]},{"osd":4,"last update":"Tue Dec 12 17:33:50 2023","interfaces":[{"interface":"back","average":{"1min":1.752,"5min":1.0169999999999999,"15min":0.72399999999999998},"min":{"1min":0.36299999999999999,"5min":0.35499999999999998,"15min":0.318},"max":{"1min":16.427,"5min":16.427,"15min":16.427},"last":0.504},{"interface":"front","average":{"1min":1.5800000000000001,"5min":1.0009999999999999,"15min":0.72399999999999998},"min":{"1min":0.41799999999999998,"5min":0.34399999999999997,"15min":0.28100000000000003},"max":{"1min":18.933,"5min":18.933,"15min":18.933},"last":0.53800000000000003}]},{"osd":5,"last update":"Tue Dec 12 17:33:50 2023","interfaces":[{"interface":"back","average":{"1min":1.1850000000000001,"5min":0.95499999999999996,"15min":1.1180000000000001},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.36499999999999999},"max":{"1min":9.1400000000000006,"5min":9.1400000000000006,"15min":123.398},"last":0.58999999999999997},{"interface":"front","average":{"1min":1.78,"5min":1.0580000000000001,"15min":1.165},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":18.969000000000001,"5min":18.969000000000001,"15min":121.617},"last":0.64100000000000001}]},{"osd":7,"last update":"Tue Dec 12 17:33:50 2023","interfaces":[{"interface":"back","average":{"1min":1.6910000000000001,"5min":0.96299999999999997,"15min":0.74399999999999999},"min":{"1min":0.38,"5min":0.36699999999999999,"15min":0.35099999999999998},"max":{"1min":21.306000000000001,"5min":21.306000000000001,"15min":21.306000000000001},"last":0.65900000000000003},{"interface":"front","average":{"1min":1.175,"5min":0.98999999999999999,"15min":0.77900000000000003},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.38400000000000001},"max":{"1min":8.6340000000000003,"5min":8.6340000000000003,"15min":8.6340000000000003},"last":0.70099999999999996}]}]},{"osd":5,"up_from":13,"seq":55834580163,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2276396,"kb_used_data":463348,"kb_used_omap":1077,"kb_used_meta":1714698,"kb_avail":92095444,"statfs":{"total":96636764160,"available":94305734656,"internally_reserved":0,"allocated":474468352,"data_stored":473292390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1102957,"internal_metadata":1755851667},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":184,"apply_latency_ms":184,"commit_latency_ns":184000000,"apply_latency_ns":184000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 17:34:44 2023","interfaces":[{"interface":"back","average":{"1min":2.6600000000000001,"5min":1.718,"15min":1.6759999999999999},"min":{"1min":0.376,"5min":0.36899999999999999,"15min":0.313},"max":{"1min":10.356999999999999,"5min":13.279,"15min":13.279},"last":1.177},{"interface":"front","average":{"1min":2.0230000000000001,"5min":1.8460000000000001,"15min":1.744},"min":{"1min":0.50600000000000001,"5min":0.37,"15min":0.32100000000000001},"max":{"1min":10.586,"5min":10.586,"15min":10.586},"last":0.89800000000000002}]},{"osd":1,"last update":"Tue Dec 12 17:34:44 2023","interfaces":[{"interface":"back","average":{"1min":2.452,"5min":2.1179999999999999,"15min":2.032},"min":{"1min":0.51200000000000001,"5min":0.42299999999999999,"15min":0.38400000000000001},"max":{"1min":10.776,"5min":10.776,"15min":17.175000000000001},"last":1.137},{"interface":"front","average":{"1min":2.266,"5min":1.579,"15min":1.607},"min":{"1min":0.65500000000000003,"5min":0.379,"15min":0.379},"max":{"1min":8.5440000000000005,"5min":8.5440000000000005,"15min":12.363},"last":1.278}]},{"osd":2,"last update":"Tue Dec 12 17:34:44 2023","interfaces":[{"interface":"back","average":{"1min":3.3119999999999998,"5min":2.0430000000000001,"15min":1.8640000000000001},"min":{"1min":0.52400000000000002,"5min":0.40899999999999997,"15min":0.40100000000000002},"max":{"1min":16.010999999999999,"5min":16.010999999999999,"15min":16.010999999999999},"last":28.800000000000001},{"interface":"front","average":{"1min":3.274,"5min":2.0649999999999999,"15min":1.929},"min":{"1min":0.64600000000000002,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":16.209,"5min":16.209,"15min":16.209},"last":28.771999999999998}]},{"osd":3,"last update":"Tue Dec 12 17:34:44 2023","interfaces":[{"interface":"back","average":{"1min":2.6059999999999999,"5min":2.2559999999999998,"15min":2.1930000000000001},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":12.015000000000001,"5min":32.682000000000002,"15min":32.682000000000002},"last":0.70799999999999996},{"interface":"front","average":{"1min":2.7349999999999999,"5min":2.0089999999999999,"15min":2.0489999999999999},"min":{"1min":0.55900000000000005,"5min":0.54400000000000004,"15min":0.42799999999999999},"max":{"1min":10.516999999999999,"5min":10.897,"15min":10.897},"last":0.52100000000000002}]},{"osd":4,"last update":"Tue Dec 12 17:34:44 2023","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.753,"15min":0.66300000000000003},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":6.3639999999999999,"5min":6.3639999999999999,"15min":6.3639999999999999},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.73599999999999999,"15min":0.67000000000000004},"min":{"1min":0.41399999999999998,"5min":0.374,"15min":0.34000000000000002},"max":{"1min":1.6619999999999999,"5min":4.4000000000000004,"15min":4.4000000000000004},"last":1.216}]},{"osd":6,"last update":"Tue Dec 12 17:34:44 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.81499999999999995,"15min":0.69099999999999995},"min":{"1min":0.39100000000000001,"5min":0.35599999999999998,"15min":0.34100000000000003},"max":{"1min":2.9609999999999999,"5min":10.016,"15min":10.016},"last":1.238},{"interface":"front","average":{"1min":1.012,"5min":0.82399999999999995,"15min":0.70099999999999996},"min":{"1min":0.44800000000000001,"5min":0.39300000000000002,"15min":0.34999999999999998},"max":{"1min":7.0049999999999999,"5min":7.0049999999999999,"15min":7.0049999999999999},"last":0.60499999999999998}]},{"osd":7,"last update":"Tue Dec 12 17:34:44 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.76700000000000002,"15min":0.69199999999999995},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":4.109,"5min":4.109,"15min":4.109},"last":1.0880000000000001},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.81000000000000005,"15min":0.73799999999999999},"min":{"1min":0.433,"5min":0.41499999999999998,"15min":0.39600000000000002},"max":{"1min":2.7280000000000002,"5min":3.407,"15min":3.875},"last":0.95099999999999996}]}]},{"osd":4,"up_from":13,"seq":55834580167,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1679988,"kb_used_data":4652,"kb_used_omap":861,"kb_used_meta":1674466,"kb_avail":92691852,"statfs":{"total":96636764160,"available":94916456448,"internally_reserved":0,"allocated":4763648,"data_stored":4464188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":882141,"internal_metadata":1714653731},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":122,"apply_latency_ms":122,"commit_latency_ns":122000000,"apply_latency_ns":122000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 17:34:41 2023","interfaces":[{"interface":"back","average":{"1min":2.0059999999999998,"5min":1.7649999999999999,"15min":2.1789999999999998},"min":{"1min":0.498,"5min":0.36799999999999999,"15min":0.31900000000000001},"max":{"1min":6.0460000000000003,"5min":9.4499999999999993,"15min":170.917},"last":8.8510000000000009},{"interface":"front","average":{"1min":1.52,"5min":1.643,"15min":2.0910000000000002},"min":{"1min":0.47299999999999998,"5min":0.39700000000000002,"15min":0.33800000000000002},"max":{"1min":6.218,"5min":9.3119999999999994,"15min":170.74199999999999},"last":8.2189999999999994}]},{"osd":1,"last update":"Tue Dec 12 17:34:41 2023","interfaces":[{"interface":"back","average":{"1min":1.516,"5min":1.8440000000000001,"15min":1.6919999999999999},"min":{"1min":0.42199999999999999,"5min":0.40600000000000003,"15min":0.33400000000000002},"max":{"1min":4.5170000000000003,"5min":36.478999999999999,"15min":36.478999999999999},"last":17.623999999999999},{"interface":"front","average":{"1min":1.5149999999999999,"5min":1.7709999999999999,"15min":1.931},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":6.5369999999999999,"5min":25.585999999999999,"15min":25.585999999999999},"last":18.757999999999999}]},{"osd":2,"last update":"Tue Dec 12 17:34:41 2023","interfaces":[{"interface":"back","average":{"1min":1.5189999999999999,"5min":2.016,"15min":2.2509999999999999},"min":{"1min":0.47099999999999997,"5min":0.376,"15min":0.376},"max":{"1min":4.5549999999999997,"5min":14.356999999999999,"15min":169.21799999999999},"last":7.2880000000000003},{"interface":"front","average":{"1min":1.7809999999999999,"5min":1.768,"15min":2.3450000000000002},"min":{"1min":0.63800000000000001,"5min":0.57299999999999995,"15min":0.47999999999999998},"max":{"1min":5.9580000000000002,"5min":11.739000000000001,"15min":179.34100000000001},"last":8.8059999999999992}]},{"osd":3,"last update":"Tue Dec 12 17:34:41 2023","interfaces":[{"interface":"back","average":{"1min":1.9119999999999999,"5min":1.8320000000000001,"15min":2.4159999999999999},"min":{"1min":0.58499999999999996,"5min":0.433,"15min":0.39900000000000002},"max":{"1min":5.657,"5min":9.3650000000000002,"15min":169.232},"last":12.829000000000001},{"interface":"front","average":{"1min":1.7529999999999999,"5min":1.861,"15min":2.48},"min":{"1min":0.52200000000000002,"5min":0.432,"15min":0.432},"max":{"1min":4.9370000000000003,"5min":14.401,"15min":168.79300000000001},"last":8.6950000000000003}]},{"osd":5,"last update":"Tue Dec 12 17:34:41 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":1.484,"15min":1.0580000000000001},"min":{"1min":0.34399999999999997,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.498,"5min":53.762,"15min":58.701999999999998},"last":8.9060000000000006},{"interface":"front","average":{"1min":0.65700000000000003,"5min":1.522,"15min":1.101},"min":{"1min":0.42299999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":2.5539999999999998,"5min":53.628,"15min":59.149999999999999},"last":7.4219999999999997}]},{"osd":6,"last update":"Tue Dec 12 17:34:41 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.91600000000000004,"15min":0.71499999999999997},"min":{"1min":0.42999999999999999,"5min":0.378,"15min":0.33100000000000002},"max":{"1min":1.6200000000000001,"5min":14.432,"15min":14.432},"last":7.0389999999999997},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.91700000000000004,"15min":0.72699999999999998},"min":{"1min":0.39300000000000002,"5min":0.38100000000000001,"15min":0.36499999999999999},"max":{"1min":0.74199999999999999,"5min":10.343,"15min":10.343},"last":8.9429999999999996}]},{"osd":7,"last update":"Tue Dec 12 17:34:41 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":1.6319999999999999,"15min":0.95699999999999996},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.35299999999999998},"max":{"1min":0.85299999999999998,"5min":53.590000000000003,"15min":53.590000000000003},"last":6.9779999999999998},{"interface":"front","average":{"1min":0.71099999999999997,"5min":1.7889999999999999,"15min":1.0529999999999999},"min":{"1min":0.502,"5min":0.44,"15min":0.38500000000000001},"max":{"1min":1.6970000000000001,"5min":54.088999999999999,"15min":54.088999999999999},"last":7.0789999999999997}]}]},{"osd":3,"up_from":13,"seq":55834580107,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5352296,"kb_used_data":3696668,"kb_used_omap":494,"kb_used_meta":1646929,"kb_avail":89019544,"statfs":{"total":96636764160,"available":91156013056,"internally_reserved":0,"allocated":3785388032,"data_stored":3776913406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":506379,"internal_metadata":1686455797},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 17:34:43 2023","interfaces":[{"interface":"back","average":{"1min":2.5379999999999998,"5min":2.516,"15min":2.851},"min":{"1min":0.68400000000000005,"5min":0.434,"15min":0.307},"max":{"1min":8.093,"5min":9.9570000000000007,"15min":18.190999999999999},"last":1.127},{"interface":"front","average":{"1min":3.2189999999999999,"5min":2.766,"15min":3.1589999999999998},"min":{"1min":0.85999999999999999,"5min":0.39500000000000002,"15min":0.27800000000000002},"max":{"1min":10.084,"5min":10.084,"15min":20.350000000000001},"last":1.3620000000000001}]},{"osd":1,"last update":"Tue Dec 12 17:34:43 2023","interfaces":[{"interface":"back","average":{"1min":3.1640000000000001,"5min":3.6949999999999998,"15min":3.4489999999999998},"min":{"1min":0.79800000000000004,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":13.246,"5min":49.18,"15min":49.18},"last":1.0880000000000001},{"interface":"front","average":{"1min":4.0030000000000001,"5min":3.758,"15min":3.5779999999999998},"min":{"1min":0.97099999999999997,"5min":0.61299999999999999,"15min":0.379},"max":{"1min":30.030999999999999,"5min":52.167999999999999,"15min":52.167999999999999},"last":1.214}]},{"osd":2,"last update":"Tue Dec 12 17:34:43 2023","interfaces":[{"interface":"back","average":{"1min":2.403,"5min":2.9809999999999999,"15min":3.3140000000000001},"min":{"1min":0.64400000000000002,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":5.0389999999999997,"5min":11.208,"15min":11.630000000000001},"last":1.276},{"interface":"front","average":{"1min":4.4189999999999996,"5min":3.3799999999999999,"15min":3.5510000000000002},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":18.041,"5min":18.379000000000001,"15min":18.379000000000001},"last":1.3460000000000001}]},{"osd":4,"last update":"Tue Dec 12 17:34:43 2023","interfaces":[{"interface":"back","average":{"1min":3.7610000000000001,"5min":2.504,"15min":2.4510000000000001},"min":{"1min":0.63,"5min":0.47099999999999997,"15min":0.38900000000000001},"max":{"1min":19.050000000000001,"5min":19.050000000000001,"15min":20.094999999999999},"last":1.1679999999999999},{"interface":"front","average":{"1min":2.923,"5min":2.5,"15min":2.6680000000000001},"min":{"1min":0.76200000000000001,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":18.914000000000001,"5min":18.914000000000001,"15min":18.914000000000001},"last":1.637}]},{"osd":5,"last update":"Tue Dec 12 17:34:43 2023","interfaces":[{"interface":"back","average":{"1min":2.7799999999999998,"5min":2.5009999999999999,"15min":2.6259999999999999},"min":{"1min":0.65300000000000002,"5min":0.52800000000000002,"15min":0.51900000000000002},"max":{"1min":8.4960000000000004,"5min":17.245000000000001,"15min":17.474},"last":1.589},{"interface":"front","average":{"1min":3.2629999999999999,"5min":2.5,"15min":2.5950000000000002},"min":{"1min":0.73399999999999999,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":10.616,"5min":10.616,"15min":19.887},"last":1.47}]},{"osd":6,"last update":"Tue Dec 12 17:34:43 2023","interfaces":[{"interface":"back","average":{"1min":2.1459999999999999,"5min":2.4039999999999999,"15min":2.7610000000000001},"min":{"1min":0.85699999999999998,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":5.5709999999999997,"5min":11.834,"15min":11.834},"last":1.7509999999999999},{"interface":"front","average":{"1min":2.7010000000000001,"5min":2.5920000000000001,"15min":2.6960000000000002},"min":{"1min":0.72699999999999998,"5min":0.504,"15min":0.504},"max":{"1min":5.3090000000000002,"5min":17.364999999999998,"15min":18.298999999999999},"last":1.659}]},{"osd":7,"last update":"Tue Dec 12 17:34:43 2023","interfaces":[{"interface":"back","average":{"1min":3.4649999999999999,"5min":2.6880000000000002,"15min":2.7869999999999999},"min":{"1min":0.77600000000000002,"5min":0.497,"15min":0.497},"max":{"1min":9.9730000000000008,"5min":9.9730000000000008,"15min":20.006},"last":1.6850000000000001},{"interface":"front","average":{"1min":2.2330000000000001,"5min":2.681,"15min":2.9620000000000002},"min":{"1min":0.94099999999999995,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":5.8259999999999996,"5min":11.954000000000001,"15min":11.954000000000001},"last":1.7150000000000001}]}]},{"osd":2,"up_from":13,"seq":55834580116,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5024116,"kb_used_data":3413028,"kb_used_omap":96,"kb_used_meta":1610975,"kb_avail":89347724,"statfs":{"total":96636764160,"available":91492069376,"internally_reserved":0,"allocated":3494940672,"data_stored":3486701156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":98548,"internal_metadata":1649639180},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":104,"apply_latency_ms":104,"commit_latency_ns":104000000,"apply_latency_ns":104000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 17:34:32 2023","interfaces":[{"interface":"back","average":{"1min":2.097,"5min":2.4129999999999998,"15min":3.1000000000000001},"min":{"1min":0.52700000000000002,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":6.7140000000000004,"5min":11.083,"15min":16.509},"last":6.742},{"interface":"front","average":{"1min":2.9340000000000002,"5min":2.8559999999999999,"15min":3.1299999999999999},"min":{"1min":0.59999999999999998,"5min":0.40000000000000002,"15min":0.317},"max":{"1min":6.069,"5min":12.016999999999999,"15min":17.859999999999999},"last":6.8979999999999997}]},{"osd":1,"last update":"Tue Dec 12 17:34:32 2023","interfaces":[{"interface":"back","average":{"1min":3.25,"5min":2.98,"15min":3.2130000000000001},"min":{"1min":0.61799999999999999,"5min":0.44600000000000001,"15min":0.39900000000000002},"max":{"1min":8.9130000000000003,"5min":13.569000000000001,"15min":13.76},"last":0.83799999999999997},{"interface":"front","average":{"1min":3.0830000000000002,"5min":2.706,"15min":3.5470000000000002},"min":{"1min":0.59699999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":12.25,"5min":12.25,"15min":19.837},"last":6.6479999999999997}]},{"osd":3,"last update":"Tue Dec 12 17:34:32 2023","interfaces":[{"interface":"back","average":{"1min":3.9329999999999998,"5min":4.3559999999999999,"15min":3.6909999999999998},"min":{"1min":0.73199999999999998,"5min":0.47199999999999998,"15min":0.437},"max":{"1min":9.0389999999999997,"5min":84.209999999999994,"15min":84.209999999999994},"last":2.5209999999999999},{"interface":"front","average":{"1min":2.7810000000000001,"5min":4.0039999999999996,"15min":4.1390000000000002},"min":{"1min":1.252,"5min":0.65200000000000002,"15min":0.41299999999999998},"max":{"1min":4.6200000000000001,"5min":80.575999999999993,"15min":80.575999999999993},"last":6.8380000000000001}]},{"osd":4,"last update":"Tue Dec 12 17:34:32 2023","interfaces":[{"interface":"back","average":{"1min":2.3380000000000001,"5min":2.3889999999999998,"15min":2.6110000000000002},"min":{"1min":0.82999999999999996,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":5.8559999999999999,"5min":14.877000000000001,"15min":14.877000000000001},"last":10.885999999999999},{"interface":"front","average":{"1min":2.7509999999999999,"5min":2.573,"15min":2.6240000000000001},"min":{"1min":0.92200000000000004,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":5.2839999999999998,"5min":14.787000000000001,"15min":14.787000000000001},"last":2.2440000000000002}]},{"osd":5,"last update":"Tue Dec 12 17:34:32 2023","interfaces":[{"interface":"back","average":{"1min":1.6479999999999999,"5min":2.5649999999999999,"15min":2.9140000000000001},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.48799999999999999},"max":{"1min":3.7949999999999999,"5min":37.231000000000002,"15min":37.231000000000002},"last":6.5179999999999998},{"interface":"front","average":{"1min":2.4079999999999999,"5min":3.165,"15min":2.9550000000000001},"min":{"1min":0.90600000000000003,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":5.976,"5min":41.021999999999998,"15min":41.021999999999998},"last":11.025}]},{"osd":6,"last update":"Tue Dec 12 17:34:32 2023","interfaces":[{"interface":"back","average":{"1min":2.851,"5min":2.7210000000000001,"15min":2.782},"min":{"1min":0.97599999999999998,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":5.3879999999999999,"5min":10.343999999999999,"15min":13.130000000000001},"last":2.4340000000000002},{"interface":"front","average":{"1min":1.73,"5min":2.3410000000000002,"15min":2.9689999999999999},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.52000000000000002},"max":{"1min":3.8300000000000001,"5min":7.6109999999999998,"15min":14.566000000000001},"last":6.3979999999999997}]},{"osd":7,"last update":"Tue Dec 12 17:34:32 2023","interfaces":[{"interface":"back","average":{"1min":2.6160000000000001,"5min":3.2429999999999999,"15min":3.089},"min":{"1min":1.042,"5min":0.60799999999999998,"15min":0.59399999999999997},"max":{"1min":6.173,"5min":41.134999999999998,"15min":41.134999999999998},"last":11.118},{"interface":"front","average":{"1min":2.9590000000000001,"5min":3.1520000000000001,"15min":3.0070000000000001},"min":{"1min":1.0249999999999999,"5min":0.53700000000000003,"15min":0.53500000000000003},"max":{"1min":5.5640000000000001,"5min":37.591000000000001,"15min":37.591000000000001},"last":2.3460000000000001}]}]},{"osd":1,"up_from":13,"seq":55834580125,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3840892,"kb_used_data":2511412,"kb_used_omap":204,"kb_used_meta":1329267,"kb_avail":90530948,"statfs":{"total":96636764160,"available":92703690752,"internally_reserved":0,"allocated":2571685888,"data_stored":2564987139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":209158,"internal_metadata":1361170170},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":167,"apply_latency_ms":167,"commit_latency_ns":167000000,"apply_latency_ns":167000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 17:33:47 2023","interfaces":[{"interface":"back","average":{"1min":3.5270000000000001,"5min":2.6280000000000001,"15min":3.2719999999999998},"min":{"1min":1.091,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":15.220000000000001,"5min":15.220000000000001,"15min":45.871000000000002},"last":4.2809999999999997},{"interface":"front","average":{"1min":7.2720000000000002,"5min":3.363,"15min":3.5569999999999999},"min":{"1min":0.77700000000000002,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":37.084000000000003,"5min":37.084000000000003,"15min":46.155999999999999},"last":2.0550000000000002}]},{"osd":2,"last update":"Tue Dec 12 17:33:47 2023","interfaces":[{"interface":"back","average":{"1min":6.8330000000000002,"5min":3.5960000000000001,"15min":3.806},"min":{"1min":0.65400000000000003,"5min":0.51500000000000001,"15min":0.45300000000000001},"max":{"1min":36.338999999999999,"5min":36.338999999999999,"15min":69.111000000000004},"last":11.622999999999999},{"interface":"front","average":{"1min":4.0730000000000004,"5min":3.0529999999999999,"15min":3.9449999999999998},"min":{"1min":0.77300000000000002,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":16.756,"5min":16.756,"15min":66.488},"last":11.863}]},{"osd":3,"last update":"Tue Dec 12 17:33:47 2023","interfaces":[{"interface":"back","average":{"1min":5.1289999999999996,"5min":3.3090000000000002,"15min":3.665},"min":{"1min":0.67300000000000004,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":36.104999999999997,"5min":36.104999999999997,"15min":66.596999999999994},"last":12.343},{"interface":"front","average":{"1min":8.016,"5min":3.8820000000000001,"15min":3.9220000000000002},"min":{"1min":1.4670000000000001,"5min":0.45300000000000001,"15min":0.44800000000000001},"max":{"1min":37.051000000000002,"5min":37.051000000000002,"15min":65.433999999999997},"last":7.6790000000000003}]},{"osd":4,"last update":"Tue Dec 12 17:33:47 2023","interfaces":[{"interface":"back","average":{"1min":5.6100000000000003,"5min":2.907,"15min":2.4529999999999998},"min":{"1min":0.79200000000000004,"5min":0.58499999999999996,"15min":0.41399999999999998},"max":{"1min":36.465000000000003,"5min":36.465000000000003,"15min":36.465000000000003},"last":11.237},{"interface":"front","average":{"1min":5.1420000000000003,"5min":3.0470000000000002,"15min":2.8839999999999999},"min":{"1min":0.79700000000000004,"5min":0.64100000000000001,"15min":0.46999999999999997},"max":{"1min":35.859000000000002,"5min":35.859000000000002,"15min":35.859000000000002},"last":1.1639999999999999}]},{"osd":5,"last update":"Tue Dec 12 17:33:47 2023","interfaces":[{"interface":"back","average":{"1min":7.6120000000000001,"5min":3.1949999999999998,"15min":2.8399999999999999},"min":{"1min":0.85299999999999998,"5min":0.51000000000000001,"15min":0.503},"max":{"1min":36.865000000000002,"5min":36.865000000000002,"15min":36.865000000000002},"last":5.4180000000000001},{"interface":"front","average":{"1min":6.4790000000000001,"5min":3.242,"15min":2.661},"min":{"1min":0.84399999999999997,"5min":0.58899999999999997,"15min":0.47399999999999998},"max":{"1min":36.695999999999998,"5min":36.695999999999998,"15min":36.695999999999998},"last":11.132999999999999}]},{"osd":6,"last update":"Tue Dec 12 17:33:47 2023","interfaces":[{"interface":"back","average":{"1min":7.4740000000000002,"5min":3.2360000000000002,"15min":2.9489999999999998},"min":{"1min":0.95999999999999996,"5min":0.55900000000000005,"15min":0.53500000000000003},"max":{"1min":36.433999999999997,"5min":36.433999999999997,"15min":36.433999999999997},"last":5.2939999999999996},{"interface":"front","average":{"1min":6.6349999999999998,"5min":3.2919999999999998,"15min":2.7909999999999999},"min":{"1min":0.873,"5min":0.57499999999999996,"15min":0.49099999999999999},"max":{"1min":36.612000000000002,"5min":36.612000000000002,"15min":36.612000000000002},"last":11.324999999999999}]},{"osd":7,"last update":"Tue Dec 12 17:33:47 2023","interfaces":[{"interface":"back","average":{"1min":5.8739999999999997,"5min":3.278,"15min":3.0310000000000001},"min":{"1min":0.89200000000000002,"5min":0.67700000000000005,"15min":0.51600000000000001},"max":{"1min":36.006999999999998,"5min":36.006999999999998,"15min":36.006999999999998},"last":1.022},{"interface":"front","average":{"1min":7.4550000000000001,"5min":3.3090000000000002,"15min":3.056},"min":{"1min":1.048,"5min":0.75900000000000001,"15min":0.58499999999999996},"max":{"1min":36.979999999999997,"5min":36.979999999999997,"15min":36.979999999999997},"last":3.0710000000000002}]}]},{"osd":0,"up_from":13,"seq":55834580119,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4187908,"kb_used_data":2564860,"kb_used_omap":327,"kb_used_meta":1622712,"kb_avail":90183932,"statfs":{"total":96636764160,"available":92348346368,"internally_reserved":0,"allocated":2626416640,"data_stored":2620221908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":335698,"internal_metadata":1661657262},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":150,"apply_latency_ms":150,"commit_latency_ns":150000000,"apply_latency_ns":150000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 12 17:34:43 2023","interfaces":[{"interface":"back","average":{"1min":2.9569999999999999,"5min":3.2229999999999999,"15min":2.988},"min":{"1min":0.34499999999999997,"5min":0.34300000000000003,"15min":0.32700000000000001},"max":{"1min":8.6050000000000004,"5min":24.763000000000002,"15min":24.763000000000002},"last":9.4039999999999999},{"interface":"front","average":{"1min":3.4039999999999999,"5min":3.536,"15min":3.242},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.378},"max":{"1min":16.047999999999998,"5min":22.780000000000001,"15min":22.780000000000001},"last":10.465}]},{"osd":2,"last update":"Tue Dec 12 17:34:43 2023","interfaces":[{"interface":"back","average":{"1min":3.7789999999999999,"5min":3.601,"15min":3.4929999999999999},"min":{"1min":0.59999999999999998,"5min":0.55800000000000005,"15min":0.51200000000000001},"max":{"1min":16.143999999999998,"5min":23.042999999999999,"15min":23.042999999999999},"last":10.315},{"interface":"front","average":{"1min":3.113,"5min":3.476,"15min":3.9380000000000002},"min":{"1min":0.64000000000000001,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":8.6940000000000008,"5min":24.658000000000001,"15min":151.84100000000001},"last":9.8330000000000002}]},{"osd":3,"last update":"Tue Dec 12 17:34:43 2023","interfaces":[{"interface":"back","average":{"1min":5.1059999999999999,"5min":4.4020000000000001,"15min":3.6680000000000001},"min":{"1min":0.89100000000000001,"5min":0.42399999999999999,"15min":0.38500000000000001},"max":{"1min":31.922999999999998,"5min":64.292000000000002,"15min":64.292000000000002},"last":9.4890000000000008},{"interface":"front","average":{"1min":4.181,"5min":3.891,"15min":3.524},"min":{"1min":0.70199999999999996,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":15.932,"5min":25.207999999999998,"15min":25.207999999999998},"last":10.108000000000001}]},{"osd":4,"last update":"Tue Dec 12 17:34:43 2023","interfaces":[{"interface":"back","average":{"1min":2.4620000000000002,"5min":2.855,"15min":2.4199999999999999},"min":{"1min":0.69799999999999995,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":8.1769999999999996,"5min":24.856000000000002,"15min":24.856000000000002},"last":9.5640000000000001},{"interface":"front","average":{"1min":4.2249999999999996,"5min":3.9180000000000001,"15min":2.8919999999999999},"min":{"1min":0.51900000000000002,"5min":0.47299999999999998,"15min":0.434},"max":{"1min":32.006999999999998,"5min":64.061999999999998,"15min":64.061999999999998},"last":9.6379999999999999}]},{"osd":5,"last update":"Tue Dec 12 17:34:43 2023","interfaces":[{"interface":"back","average":{"1min":3.6989999999999998,"5min":3.371,"15min":2.6749999999999998},"min":{"1min":0.66000000000000003,"5min":0.49299999999999999,"15min":0.438},"max":{"1min":21.183,"5min":27.843,"15min":27.843},"last":9.9800000000000004},{"interface":"front","average":{"1min":3.0680000000000001,"5min":3.3410000000000002,"15min":2.8439999999999999},"min":{"1min":0.66900000000000004,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":7.1870000000000003,"5min":22.68,"15min":22.68},"last":10.691000000000001}]},{"osd":6,"last update":"Tue Dec 12 17:34:43 2023","interfaces":[{"interface":"back","average":{"1min":3.1480000000000001,"5min":3.085,"15min":2.8370000000000002},"min":{"1min":0.63500000000000001,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":7.4130000000000003,"5min":22.457999999999998,"15min":22.457999999999998},"last":17.977},{"interface":"front","average":{"1min":2.972,"5min":3.3359999999999999,"15min":2.7759999999999998},"min":{"1min":0.79100000000000004,"5min":0.628,"15min":0.51500000000000001},"max":{"1min":8.4109999999999996,"5min":40.453000000000003,"15min":40.453000000000003},"last":10.256}]},{"osd":7,"last update":"Tue Dec 12 17:34:43 2023","interfaces":[{"interface":"back","average":{"1min":2.9380000000000002,"5min":3.2400000000000002,"15min":2.843},"min":{"1min":0.82899999999999996,"5min":0.65900000000000003,"15min":0.60599999999999998},"max":{"1min":8.5120000000000005,"5min":24.510999999999999,"15min":24.510999999999999},"last":10.4},{"interface":"front","average":{"1min":4.5890000000000004,"5min":4.1539999999999999,"15min":3.1059999999999999},"min":{"1min":0.55800000000000005,"5min":0.52000000000000002,"15min":0.46500000000000002},"max":{"1min":32.055,"5min":64.191999999999993,"15min":64.191999999999993},"last":10.218}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-12T17:34:58.764 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T17:34:59.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:59.443+0000 7f9fdd32a640 1 Processor -- start 2023-12-12T17:34:59.453 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:59.447+0000 7f9fdd32a640 1 -- start start 2023-12-12T17:34:59.461 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:59.455+0000 7f9fdd32a640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9fd8156b90 0x7f9fd8071940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:34:59.462 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:59.455+0000 7f9fdd32a640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f9fd8071e80 0x7f9fd815cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:34:59.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:59.455+0000 7f9fdd32a640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fd80722e0 con 0x7f9fd815d270 2023-12-12T17:34:59.463 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:59.455+0000 7f9fdd32a640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fd80b4f50 con 0x7f9fd8071e80 2023-12-12T17:34:59.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:59.455+0000 7f9fd7fff640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f9fd815d270 0x7f9fd80b3450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:52924/0 (socket says 172.21.15.78:52924) 2023-12-12T17:34:59.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:59.455+0000 7f9fd7fff640 1 -- 172.21.15.78:0/1600515137 learned_addr learned my addr 172.21.15.78:0/1600515137 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-12-12T17:34:59.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:59.455+0000 7f9fdd32a640 1 -- 172.21.15.78:0/1600515137 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fd806b550 con 0x7f9fd8156b90 2023-12-12T17:34:59.464 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:59.455+0000 7f9fd5ffb640 1 -- 172.21.15.78:0/1600515137 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 252946483 0 0) 0x7f9fd80722e0 con 0x7f9fd815d270 2023-12-12T17:34:59.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:59.455+0000 7f9fd5ffb640 1 -- 172.21.15.78:0/1600515137 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9fc0003530 con 0x7f9fd815d270 2023-12-12T17:34:59.468 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:59.459+0000 7f9fd6ffd640 1 --2- 172.21.15.78:0/1600515137 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9fd8156b90 0x7f9fd8071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:34:59.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:59.459+0000 7f9fd6ffd640 1 -- 172.21.15.78:0/1600515137 >> v2:172.21.15.187:3300/0 conn(0x7f9fd8071e80 msgr2=0x7f9fd815cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T17:34:59.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:59.459+0000 7f9fd67fc640 1 --2- 172.21.15.78:0/1600515137 >> v2:172.21.15.187:3300/0 conn(0x7f9fd8071e80 0x7f9fd815cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:34:59.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:59.459+0000 7f9fd6ffd640 1 --2- 172.21.15.78:0/1600515137 >> v2:172.21.15.187:3300/0 conn(0x7f9fd8071e80 0x7f9fd815cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:59.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:59.459+0000 7f9fd6ffd640 1 -- 172.21.15.78:0/1600515137 >> v1:172.21.15.78:6789/0 conn(0x7f9fd815d270 legacy=0x7f9fd80b3450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:34:59.469 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:59.459+0000 7f9fd6ffd640 1 -- 172.21.15.78:0/1600515137 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fd80b5160 con 0x7f9fd8156b90 2023-12-12T17:34:59.470 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:59.459+0000 7f9fd67fc640 1 --2- 172.21.15.78:0/1600515137 >> v2:172.21.15.187:3300/0 conn(0x7f9fd8071e80 0x7f9fd815cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T17:34:59.494 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:59.487+0000 7f9fd6ffd640 1 --2- 172.21.15.78:0/1600515137 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9fd8156b90 0x7f9fd8071940 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f9fcc0097c0 tx=0x7f9fcc01c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6f29b314f8b33d57 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T17:34:59.494 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:59.487+0000 7f9fd5ffb640 1 -- 172.21.15.78:0/1600515137 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fcc0ab600 con 0x7f9fd8156b90 2023-12-12T17:34:59.495 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:59.487+0000 7f9fd5ffb640 1 -- 172.21.15.78:0/1600515137 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fcc0a7050 con 0x7f9fd8156b90 2023-12-12T17:34:59.495 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:59.487+0000 7f9fd5ffb640 1 -- 172.21.15.78:0/1600515137 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fcc0ab960 con 0x7f9fd8156b90 2023-12-12T17:34:59.496 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:59.491+0000 7f9fdd32a640 1 -- 172.21.15.78:0/1600515137 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9fd8156b90 msgr2=0x7f9fd8071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:34:59.497 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:59.491+0000 7f9fdd32a640 1 --2- 172.21.15.78:0/1600515137 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9fd8156b90 0x7f9fd8071940 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f9fcc0097c0 tx=0x7f9fcc01c4a0 comp rx=0 tx=0).stop 2023-12-12T17:34:59.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:59.491+0000 7f9fdd32a640 1 -- 172.21.15.78:0/1600515137 shutdown_connections 2023-12-12T17:34:59.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:59.491+0000 7f9fdd32a640 1 --2- 172.21.15.78:0/1600515137 >> v2:172.21.15.187:3300/0 conn(0x7f9fd8071e80 0x7f9fd815cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:59.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:59.491+0000 7f9fdd32a640 1 --2- 172.21.15.78:0/1600515137 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9fd8156b90 0x7f9fd8071940 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:59.501 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:59.491+0000 7f9fdd32a640 1 -- 172.21.15.78:0/1600515137 >> 172.21.15.78:0/1600515137 conn(0x7f9fd806dc20 msgr2=0x7f9fd806e030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T17:34:59.501 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:59.495+0000 7f9fdd32a640 1 -- 172.21.15.78:0/1600515137 shutdown_connections 2023-12-12T17:34:59.501 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:59.495+0000 7f9fdd32a640 1 -- 172.21.15.78:0/1600515137 wait complete. 2023-12-12T17:34:59.517 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:59.511+0000 7f9fdd32a640 1 Processor -- start 2023-12-12T17:34:59.521 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:59.515+0000 7f9fdd32a640 1 -- start start 2023-12-12T17:34:59.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:59.523+0000 7f9fdd32a640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9fd8071e80 0x7f9fd8142b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:34:59.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:59.523+0000 7f9fdd32a640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9fd815d270 0x7f9fd813edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:34:59.530 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:59.523+0000 7f9fdd32a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9fd8148280 0x7f9fd81462b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:34:59.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:59.523+0000 7f9fdd32a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fd8145e90 con 0x7f9fd8148280 2023-12-12T17:34:59.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:59.523+0000 7f9fdd32a640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fd8145b40 con 0x7f9fd8071e80 2023-12-12T17:34:59.531 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:59.523+0000 7f9fdd32a640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fd8148840 con 0x7f9fd815d270 2023-12-12T17:34:59.536 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:59.523+0000 7f9fd67fc640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9fd815d270 0x7f9fd813edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:34:59.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:59.523+0000 7f9fd7fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9fd8148280 0x7f9fd81462b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:34:59.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:59.523+0000 7f9fd7fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9fd8148280 0x7f9fd81462b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:44966/0 (socket says 172.21.15.78:44966) 2023-12-12T17:34:59.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:59.523+0000 7f9fd67fc640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9fd815d270 0x7f9fd813edf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.78:58760/0 (socket says 172.21.15.78:58760) 2023-12-12T17:34:59.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:59.523+0000 7f9fd7fff640 1 -- 172.21.15.78:0/1082539606 learned_addr learned my addr 172.21.15.78:0/1082539606 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T17:34:59.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:59.523+0000 7f9fd6ffd640 1 --2- 172.21.15.78:0/1082539606 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9fd8071e80 0x7f9fd8142b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:34:59.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:59.523+0000 7f9fd67fc640 1 -- 172.21.15.78:0/1082539606 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9fd8071e80 msgr2=0x7f9fd8142b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:34:59.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:59.523+0000 7f9fd67fc640 1 --2- 172.21.15.78:0/1082539606 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9fd8071e80 0x7f9fd8142b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:59.537 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:59.523+0000 7f9fd67fc640 1 -- 172.21.15.78:0/1082539606 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9fd8148280 msgr2=0x7f9fd81462b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:34:59.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:59.523+0000 7f9fd67fc640 1 --2- 172.21.15.78:0/1082539606 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9fd8148280 0x7f9fd81462b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:34:59.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:59.523+0000 7f9fd67fc640 1 -- 172.21.15.78:0/1082539606 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fcc009420 con 0x7f9fd815d270 2023-12-12T17:34:59.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:59.527+0000 7f9fd67fc640 1 --2- 172.21.15.78:0/1082539606 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9fd815d270 0x7f9fd813edf0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f9fc800c7f0 tx=0x7f9fc800ccb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T17:34:59.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:59.527+0000 7f9fbf7fe640 1 -- 172.21.15.78:0/1082539606 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fc8004220 con 0x7f9fd815d270 2023-12-12T17:34:59.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:59.527+0000 7f9fbf7fe640 1 -- 172.21.15.78:0/1082539606 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fc8004380 con 0x7f9fd815d270 2023-12-12T17:34:59.538 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:59.527+0000 7f9fbf7fe640 1 -- 172.21.15.78:0/1082539606 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fc8003840 con 0x7f9fd815d270 2023-12-12T17:34:59.539 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:59.527+0000 7f9fdd32a640 1 -- 172.21.15.78:0/1082539606 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fd8148b20 con 0x7f9fd815d270 2023-12-12T17:34:59.539 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:59.527+0000 7f9fdd32a640 1 -- 172.21.15.78:0/1082539606 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fd813f330 con 0x7f9fd815d270 2023-12-12T17:34:59.539 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:59.531+0000 7f9fdd32a640 1 -- 172.21.15.78:0/1082539606 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fb8005260 con 0x7f9fd815d270 2023-12-12T17:34:59.557 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:59.551+0000 7f9fbf7fe640 1 -- 172.21.15.78:0/1082539606 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9fc8003bb0 con 0x7f9fd815d270 2023-12-12T17:34:59.565 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:59.559+0000 7f9fbf7fe640 1 --2- 172.21.15.78:0/1082539606 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f9fc40664a0 0x7f9fc4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:34:59.566 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:59.559+0000 7f9fd6ffd640 1 --2- 172.21.15.78:0/1082539606 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f9fc40664a0 0x7f9fc4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:34:59.567 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:59.559+0000 7f9fbf7fe640 1 -- 172.21.15.78:0/1082539606 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f9fc8083b70 con 0x7f9fd815d270 2023-12-12T17:34:59.570 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:59.563+0000 7f9fbf7fe640 1 -- 172.21.15.78:0/1082539606 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9fc8051260 con 0x7f9fd815d270 2023-12-12T17:34:59.583 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:34:59.575+0000 7f9fd6ffd640 1 --2- 172.21.15.78:0/1082539606 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f9fc40664a0 0x7f9fc4068960 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f9fcc0ad000 tx=0x7f9fcc0a6000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T17:35:00.276 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:00.267+0000 7f9fdd32a640 1 -- 172.21.15.78:0/1082539606 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9fb80057e0 con 0x7f9fd815d270 2023-12-12T17:35:00.394 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:00.387+0000 7f9fbf7fe640 1 -- 172.21.15.78:0/1082539606 <== mon.2 v2:172.21.15.187:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) v1 ==== 74+0+13155 (secure 0 0 0) 0x7f9fc8054880 con 0x7f9fd815d270 2023-12-12T17:35:00.401 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T17:35:00.401 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":44,"fsid":"fc81937c-bd26-483c-952b-d1324fcb0c9e","created":"2023-12-12T10:11:44.020214+0000","modified":"2023-12-12T17:34:45.931255+0000","last_up_change":"2023-12-12T10:11:56.278318+0000","last_in_change":"2023-12-12T10:11:46.553610+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-12T10:11:57.053584+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"22dfdedf-5f6c-4b20-9f6c-30517a1db70a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6809","nonce":3345683600}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6811","nonce":3345683600}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6815","nonce":3345683600}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":3345683600},{"type":"v1","addr":"172.21.15.78:6813","nonce":3345683600}]},"public_addr":"172.21.15.78:6809/3345683600","cluster_addr":"172.21.15.78:6811/3345683600","heartbeat_back_addr":"172.21.15.78:6815/3345683600","heartbeat_front_addr":"172.21.15.78:6813/3345683600","state":["exists","up"]},{"osd":1,"uuid":"be34a7f3-a69a-462e-9ddf-5e537448dba2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6801","nonce":962652768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6803","nonce":962652768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6807","nonce":962652768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":962652768},{"type":"v1","addr":"172.21.15.78:6805","nonce":962652768}]},"public_addr":"172.21.15.78:6801/962652768","cluster_addr":"172.21.15.78:6803/962652768","heartbeat_back_addr":"172.21.15.78:6807/962652768","heartbeat_front_addr":"172.21.15.78:6805/962652768","state":["exists","up"]},{"osd":2,"uuid":"55b381de-5f56-4b14-80f7-e6e41e084a13","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6818","nonce":2910206054}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6822","nonce":2910206054}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6829","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6831","nonce":2910206054}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":2910206054},{"type":"v1","addr":"172.21.15.78:6826","nonce":2910206054}]},"public_addr":"172.21.15.78:6818/2910206054","cluster_addr":"172.21.15.78:6822/2910206054","heartbeat_back_addr":"172.21.15.78:6831/2910206054","heartbeat_front_addr":"172.21.15.78:6826/2910206054","state":["exists","up"]},{"osd":3,"uuid":"d7682de1-25cb-4cec-869f-8851c28b0e6d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6817","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6819","nonce":3750796703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6821","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6823","nonce":3750796703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6830","nonce":3750796703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6825","nonce":3750796703},{"type":"v1","addr":"172.21.15.78:6827","nonce":3750796703}]},"public_addr":"172.21.15.78:6819/3750796703","cluster_addr":"172.21.15.78:6823/3750796703","heartbeat_back_addr":"172.21.15.78:6830/3750796703","heartbeat_front_addr":"172.21.15.78:6827/3750796703","state":["exists","up"]},{"osd":4,"uuid":"8279815a-d6c7-4199-871e-d28971b9dc07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6809","nonce":2944277204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6811","nonce":2944277204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6815","nonce":2944277204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":2944277204},{"type":"v1","addr":"172.21.15.187:6813","nonce":2944277204}]},"public_addr":"172.21.15.187:6809/2944277204","cluster_addr":"172.21.15.187:6811/2944277204","heartbeat_back_addr":"172.21.15.187:6815/2944277204","heartbeat_front_addr":"172.21.15.187:6813/2944277204","state":["exists","up"]},{"osd":5,"uuid":"0a714c65-f8ce-4340-968f-11a799677ef3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6801","nonce":185858620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6803","nonce":185858620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6807","nonce":185858620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":185858620},{"type":"v1","addr":"172.21.15.187:6805","nonce":185858620}]},"public_addr":"172.21.15.187:6801/185858620","cluster_addr":"172.21.15.187:6803/185858620","heartbeat_back_addr":"172.21.15.187:6807/185858620","heartbeat_front_addr":"172.21.15.187:6805/185858620","state":["exists","up"]},{"osd":6,"uuid":"d0bba9ab-f7ee-449e-8999-1c0cf7e6d53c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6817","nonce":4213392126}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6819","nonce":4213392126}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6824","nonce":4213392126}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":4213392126},{"type":"v1","addr":"172.21.15.187:6821","nonce":4213392126}]},"public_addr":"172.21.15.187:6817/4213392126","cluster_addr":"172.21.15.187:6819/4213392126","heartbeat_back_addr":"172.21.15.187:6824/4213392126","heartbeat_front_addr":"172.21.15.187:6821/4213392126","state":["exists","up"]},{"osd":7,"uuid":"efe5e0d9-2f87-4889-a27a-e2a95a632302","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6823","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6825","nonce":85774004}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6827","nonce":85774004}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6831","nonce":85774004}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":85774004},{"type":"v1","addr":"172.21.15.187:6829","nonce":85774004}]},"public_addr":"172.21.15.187:6825/85774004","cluster_addr":"172.21.15.187:6827/85774004","heartbeat_back_addr":"172.21.15.187:6831/85774004","heartbeat_front_addr":"172.21.15.187:6829/85774004","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.214447+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.448899+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.293107+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.564184+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.175026+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.097717+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.261141+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-12T10:11:52.287681+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.78:6837/4134128104":"2023-12-13T17:34:41.303001+0000","172.21.15.78:6835/4134128104":"2023-12-13T17:34:41.303001+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T17:35:00.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:00.403+0000 7f9fdd32a640 1 -- 172.21.15.78:0/1082539606 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f9fc40664a0 msgr2=0x7f9fc4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:35:00.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:00.403+0000 7f9fdd32a640 1 --2- 172.21.15.78:0/1082539606 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f9fc40664a0 0x7f9fc4068960 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f9fcc0ad000 tx=0x7f9fcc0a6000 comp rx=0 tx=0).stop 2023-12-12T17:35:00.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:00.403+0000 7f9fdd32a640 1 -- 172.21.15.78:0/1082539606 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9fd815d270 msgr2=0x7f9fd813edf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:35:00.409 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:00.403+0000 7f9fdd32a640 1 --2- 172.21.15.78:0/1082539606 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9fd815d270 0x7f9fd813edf0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f9fc800c7f0 tx=0x7f9fc800ccb0 comp rx=0 tx=0).stop 2023-12-12T17:35:00.410 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:00.403+0000 7f9fdd32a640 1 -- 172.21.15.78:0/1082539606 shutdown_connections 2023-12-12T17:35:00.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:00.403+0000 7f9fdd32a640 1 --2- 172.21.15.78:0/1082539606 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f9fc40664a0 0x7f9fc4068960 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:00.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:00.403+0000 7f9fdd32a640 1 --2- 172.21.15.78:0/1082539606 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f9fd8148280 0x7f9fd81462b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:00.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:00.403+0000 7f9fdd32a640 1 --2- 172.21.15.78:0/1082539606 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9fd815d270 0x7f9fd813edf0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:00.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:00.403+0000 7f9fdd32a640 1 --2- 172.21.15.78:0/1082539606 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9fd8071e80 0x7f9fd8142b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:00.413 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:00.403+0000 7f9fdd32a640 1 -- 172.21.15.78:0/1082539606 >> 172.21.15.78:0/1082539606 conn(0x7f9fd806dc20 msgr2=0x7f9fd8072e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T17:35:00.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:00.403+0000 7f9fdd32a640 1 -- 172.21.15.78:0/1082539606 shutdown_connections 2023-12-12T17:35:00.414 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:00.403+0000 7f9fdd32a640 1 -- 172.21.15.78:0/1082539606 wait complete. 2023-12-12T17:35:01.562 INFO:tasks.ceph:Scrubbing osd.0 2023-12-12T17:35:01.562 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-12-12T17:35:02.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:02.715+0000 7f64144bb640 1 Processor -- start 2023-12-12T17:35:02.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:02.715+0000 7f64144bb640 1 -- start start 2023-12-12T17:35:02.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:02.715+0000 7f64144bb640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f640c156be0 0x7f640c0720b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:35:02.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:02.715+0000 7f64144bb640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f640c159cc0 0x7f640c15a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:35:02.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:02.715+0000 7f6412257640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f640c156be0 0x7f640c0720b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:35:02.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:02.715+0000 7f6411a56640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f640c159cc0 0x7f640c15a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:35:02.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:02.715+0000 7f6412257640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f640c156be0 0x7f640c0720b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.78:58774/0 (socket says 172.21.15.78:58774) 2023-12-12T17:35:02.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:02.719+0000 7f6411a56640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f640c159cc0 0x7f640c15a120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.78:53322/0 (socket says 172.21.15.78:53322) 2023-12-12T17:35:02.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:02.723+0000 7f64144bb640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f640c06e970 con 0x7f640c0b1640 2023-12-12T17:35:02.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:02.723+0000 7f64144bb640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f640c1595b0 con 0x7f640c159cc0 2023-12-12T17:35:02.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:02.723+0000 7f64144bb640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f640c156fc0 con 0x7f640c156be0 2023-12-12T17:35:02.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:02.723+0000 7f6412a58640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f640c0b1640 0x7f640c0702c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:52936/0 (socket says 172.21.15.78:52936) 2023-12-12T17:35:02.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:02.723+0000 7f6412a58640 1 -- 172.21.15.78:0/2786173101 learned_addr learned my addr 172.21.15.78:0/2786173101 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-12-12T17:35:02.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:02.723+0000 7f6411255640 1 -- 172.21.15.78:0/2786173101 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2785175696 0 0) 0x7f640c06e970 con 0x7f640c0b1640 2023-12-12T17:35:02.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:02.723+0000 7f6411255640 1 -- 172.21.15.78:0/2786173101 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f63f4003530 con 0x7f640c0b1640 2023-12-12T17:35:02.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:02.723+0000 7f6411255640 1 -- 172.21.15.78:0/2786173101 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3119401118 0 0) 0x7f63f4003530 con 0x7f640c0b1640 2023-12-12T17:35:02.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:02.723+0000 7f6411255640 1 -- 172.21.15.78:0/2786173101 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f640c156be0 msgr2=0x7f640c0720b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T17:35:02.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:02.723+0000 7f6411255640 1 --2- 172.21.15.78:0/2786173101 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f640c156be0 0x7f640c0720b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:02.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:02.723+0000 7f6411255640 1 -- 172.21.15.78:0/2786173101 >> v2:172.21.15.187:3300/0 conn(0x7f640c159cc0 msgr2=0x7f640c15a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T17:35:02.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:02.723+0000 7f6411255640 1 --2- 172.21.15.78:0/2786173101 >> v2:172.21.15.187:3300/0 conn(0x7f640c159cc0 0x7f640c15a120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:02.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:02.723+0000 7f6411255640 1 -- 172.21.15.78:0/2786173101 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f640c06e0d0 con 0x7f640c0b1640 2023-12-12T17:35:02.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:02.723+0000 7f6411255640 1 -- 172.21.15.78:0/2786173101 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 465499599 0 0) 0x7f6400001680 con 0x7f640c0b1640 2023-12-12T17:35:02.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:02.723+0000 7f6411255640 1 -- 172.21.15.78:0/2786173101 >> v1:172.21.15.78:6789/0 conn(0x7f640c0b1640 legacy=0x7f640c0702c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:35:02.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:02.723+0000 7f6411255640 1 --2- 172.21.15.78:0/2786173101 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f63f4003980 0x7f63f4003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:35:02.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:02.723+0000 7f6411255640 1 --2- 172.21.15.78:0/2786173101 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f63f40047d0 0x7f63f4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:35:02.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:02.723+0000 7f6411255640 1 --2- 172.21.15.78:0/2786173101 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f63f40052b0 0x7f63f400dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:35:02.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:02.723+0000 7f6411255640 1 -- 172.21.15.78:0/2786173101 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f640c156fc0 con 0x7f63f40052b0 2023-12-12T17:35:02.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:02.723+0000 7f6411255640 1 -- 172.21.15.78:0/2786173101 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63f400e370 con 0x7f63f40047d0 2023-12-12T17:35:02.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:02.723+0000 7f6411255640 1 -- 172.21.15.78:0/2786173101 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63f400e530 con 0x7f63f4003980 2023-12-12T17:35:02.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:02.723+0000 7f6412a58640 1 --2- 172.21.15.78:0/2786173101 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f63f40052b0 0x7f63f400dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:35:02.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:02.723+0000 7f6412257640 1 --2- 172.21.15.78:0/2786173101 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f640c156be0 0x7f640c0720b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2023-12-12T17:35:02.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:02.723+0000 7f6411a56640 1 --2- 172.21.15.78:0/2786173101 >> v2:172.21.15.187:3300/0 conn(0x7f640c159cc0 0x7f640c15a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2023-12-12T17:35:02.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:02.723+0000 7f6412a58640 1 -- 172.21.15.78:0/2786173101 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f63f4003980 msgr2=0x7f63f4003da0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-12-12T17:35:02.737 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:02.723+0000 7f6412a58640 1 --2- 172.21.15.78:0/2786173101 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f63f4003980 0x7f63f4003da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:02.737 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:02.723+0000 7f6412a58640 1 -- 172.21.15.78:0/2786173101 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f63f40047d0 msgr2=0x7f63f4004c50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-12T17:35:02.737 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:02.723+0000 7f6412a58640 1 --2- 172.21.15.78:0/2786173101 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f63f40047d0 0x7f63f4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:02.737 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:02.723+0000 7f6412a58640 1 -- 172.21.15.78:0/2786173101 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63f4003530 con 0x7f63f40052b0 2023-12-12T17:35:02.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:02.735+0000 7f6412a58640 1 --2- 172.21.15.78:0/2786173101 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f63f40052b0 0x7f63f400dba0 secure :-1 s=READY pgs=2125 cs=0 l=1 rev1=1 crypto rx=0x7f640000c190 tx=0x7f640001cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff528214866e311b server_cookie=0 in_seq=0 out_seq=0 2023-12-12T17:35:02.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:02.735+0000 7f6411255640 1 -- 172.21.15.78:0/2786173101 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64000058e0 con 0x7f63f40052b0 2023-12-12T17:35:02.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:02.735+0000 7f6411255640 1 -- 172.21.15.78:0/2786173101 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6400005a40 con 0x7f63f40052b0 2023-12-12T17:35:02.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:02.735+0000 7f6411255640 1 -- 172.21.15.78:0/2786173101 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6400005e50 con 0x7f63f40052b0 2023-12-12T17:35:02.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:02.735+0000 7f64144bb640 1 -- 172.21.15.78:0/2786173101 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f63f40052b0 msgr2=0x7f63f400dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:35:02.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:02.735+0000 7f64144bb640 1 --2- 172.21.15.78:0/2786173101 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f63f40052b0 0x7f63f400dba0 secure :-1 s=READY pgs=2125 cs=0 l=1 rev1=1 crypto rx=0x7f640000c190 tx=0x7f640001cba0 comp rx=0 tx=0).stop 2023-12-12T17:35:02.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:02.735+0000 7f6412a58640 1 -- 172.21.15.78:0/2786173101 reap_dead start 2023-12-12T17:35:02.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:02.735+0000 7f64144bb640 1 -- 172.21.15.78:0/2786173101 shutdown_connections 2023-12-12T17:35:02.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:02.735+0000 7f64144bb640 1 -- 172.21.15.78:0/2786173101 >> 172.21.15.78:0/2786173101 conn(0x7f640c0b0b20 msgr2=0x7f640c0b0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T17:35:02.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:02.735+0000 7f64144bb640 1 -- 172.21.15.78:0/2786173101 shutdown_connections 2023-12-12T17:35:02.746 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:02.739+0000 7f64144bb640 1 -- 172.21.15.78:0/2786173101 wait complete. 2023-12-12T17:35:02.753 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:02.747+0000 7f64144bb640 1 Processor -- start 2023-12-12T17:35:02.754 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:02.747+0000 7f64144bb640 1 -- start start 2023-12-12T17:35:02.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:02.747+0000 7f64144bb640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f63f40052b0 0x7f640c148d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:35:02.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:02.747+0000 7f64144bb640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f640c0cc780 0x7f640c0ccbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:35:02.755 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:02.747+0000 7f64144bb640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f640c150900 0x7f640c150d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:35:02.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:02.747+0000 7f64144bb640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f640c1512c0 con 0x7f63f40052b0 2023-12-12T17:35:02.756 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:02.747+0000 7f64144bb640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f640c0cd120 con 0x7f640c0cc780 2023-12-12T17:35:02.760 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:02.747+0000 7f64144bb640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f640c1517c0 con 0x7f640c150900 2023-12-12T17:35:02.760 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:02.747+0000 7f6412a58640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f640c150900 0x7f640c150d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:35:02.761 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:02.747+0000 7f6412a58640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f640c150900 0x7f640c150d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.78:58786/0 (socket says 172.21.15.78:58786) 2023-12-12T17:35:02.761 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:02.747+0000 7f6412a58640 1 -- 172.21.15.78:0/201359546 learned_addr learned my addr 172.21.15.78:0/201359546 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T17:35:02.762 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:02.747+0000 7f6412257640 1 --2- 172.21.15.78:0/201359546 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f63f40052b0 0x7f640c148d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:35:02.762 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:02.751+0000 7f6411a56640 1 --2- 172.21.15.78:0/201359546 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f640c0cc780 0x7f640c0ccbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:35:02.762 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:02.751+0000 7f6412a58640 1 -- 172.21.15.78:0/201359546 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f640c0cc780 msgr2=0x7f640c0ccbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:35:02.762 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:02.751+0000 7f6412a58640 1 --2- 172.21.15.78:0/201359546 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f640c0cc780 0x7f640c0ccbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:02.762 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:02.751+0000 7f6412a58640 1 -- 172.21.15.78:0/201359546 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f63f40052b0 msgr2=0x7f640c148d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:35:02.762 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:02.751+0000 7f6412a58640 1 --2- 172.21.15.78:0/201359546 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f63f40052b0 0x7f640c148d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:02.762 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:02.751+0000 7f6412a58640 1 -- 172.21.15.78:0/201359546 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f640c1f8d50 con 0x7f640c150900 2023-12-12T17:35:02.762 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:02.751+0000 7f6411a56640 1 --2- 172.21.15.78:0/201359546 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f640c0cc780 0x7f640c0ccbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T17:35:02.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:02.751+0000 7f6412a58640 1 --2- 172.21.15.78:0/201359546 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f640c150900 0x7f640c150d80 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f64000ab040 tx=0x7f63f4005800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T17:35:02.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:02.751+0000 7f640affd640 1 -- 172.21.15.78:0/201359546 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64000a5cb0 con 0x7f640c150900 2023-12-12T17:35:02.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:02.751+0000 7f64144bb640 1 -- 172.21.15.78:0/201359546 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f640c0a8780 con 0x7f640c150900 2023-12-12T17:35:02.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:02.751+0000 7f640affd640 1 -- 172.21.15.78:0/201359546 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64000a5e10 con 0x7f640c150900 2023-12-12T17:35:02.763 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:02.751+0000 7f640affd640 1 -- 172.21.15.78:0/201359546 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64000049f0 con 0x7f640c150900 2023-12-12T17:35:02.764 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:02.751+0000 7f64144bb640 1 -- 172.21.15.78:0/201359546 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f640c1f8700 con 0x7f640c150900 2023-12-12T17:35:02.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:02.763+0000 7f640affd640 1 -- 172.21.15.78:0/201359546 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6400004b50 con 0x7f640c150900 2023-12-12T17:35:02.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:02.767+0000 7f64144bb640 1 -- 172.21.15.78:0/201359546 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f640c1597a0 con 0x7f640c150900 2023-12-12T17:35:02.776 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:02.771+0000 7f640affd640 1 --2- 172.21.15.78:0/201359546 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f63f8077480 0x7f63f8079940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:35:02.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:02.771+0000 7f640affd640 1 -- 172.21.15.78:0/201359546 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f640011d610 con 0x7f640c150900 2023-12-12T17:35:02.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:02.771+0000 7f6412257640 1 --2- 172.21.15.78:0/201359546 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f63f8077480 0x7f63f8079940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:35:02.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:02.771+0000 7f640affd640 1 --2- 172.21.15.78:0/201359546 >> [v2:172.21.15.78:6808/3345683600,v1:172.21.15.78:6809/3345683600] conn(0x7f63f807d780 0x7f63f807fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:35:02.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:02.771+0000 7f640affd640 1 -- 172.21.15.78:0/201359546 --> [v2:172.21.15.78:6808/3345683600,v1:172.21.15.78:6809/3345683600] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f63f8080290 con 0x7f63f807d780 2023-12-12T17:35:02.778 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:02.771+0000 7f640affd640 1 -- 172.21.15.78:0/201359546 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f640011fb50 con 0x7f640c150900 2023-12-12T17:35:02.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:02.771+0000 7f6412257640 1 --2- 172.21.15.78:0/201359546 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f63f8077480 0x7f63f8079940 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f640c06fe50 tx=0x7f64040074b0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T17:35:02.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:02.775+0000 7f6411a56640 1 --2- 172.21.15.78:0/201359546 >> [v2:172.21.15.78:6808/3345683600,v1:172.21.15.78:6809/3345683600] conn(0x7f63f807d780 0x7f63f807fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:35:02.786 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:02.779+0000 7f6411a56640 1 --2- 172.21.15.78:0/201359546 >> [v2:172.21.15.78:6808/3345683600,v1:172.21.15.78:6809/3345683600] conn(0x7f63f807d780 0x7f63f807fbc0 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T17:35:02.906 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:02.899+0000 7f640affd640 1 -- 172.21.15.78:0/201359546 <== osd.0 v2:172.21.15.78:6808/3345683600 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f63f8080290 con 0x7f63f807d780 2023-12-12T17:35:03.072 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:03.063+0000 7f64144bb640 1 -- 172.21.15.78:0/201359546 --> [v2:172.21.15.78:6808/3345683600,v1:172.21.15.78:6809/3345683600] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f640c06e690 con 0x7f63f807d780 2023-12-12T17:35:03.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:03.083+0000 7f640affd640 1 -- 172.21.15.78:0/201359546 <== osd.0 v2:172.21.15.78:6808/3345683600 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f63fc00c040 con 0x7f63f807d780 2023-12-12T17:35:03.092 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2023-12-12T17:35:03.092 INFO:teuthology.orchestra.run.smithi078.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-12-12T17:35:03.093 INFO:teuthology.orchestra.run.smithi078.stdout:} 2023-12-12T17:35:03.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:03.091+0000 7f64144bb640 1 -- 172.21.15.78:0/201359546 >> [v2:172.21.15.78:6808/3345683600,v1:172.21.15.78:6809/3345683600] conn(0x7f63f807d780 msgr2=0x7f63f807fbc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:35:03.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:03.091+0000 7f64144bb640 1 --2- 172.21.15.78:0/201359546 >> [v2:172.21.15.78:6808/3345683600,v1:172.21.15.78:6809/3345683600] conn(0x7f63f807d780 0x7f63f807fbc0 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:03.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:03.091+0000 7f64144bb640 1 -- 172.21.15.78:0/201359546 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f63f8077480 msgr2=0x7f63f8079940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:35:03.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:03.091+0000 7f64144bb640 1 --2- 172.21.15.78:0/201359546 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f63f8077480 0x7f63f8079940 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f640c06fe50 tx=0x7f64040074b0 comp rx=0 tx=0).stop 2023-12-12T17:35:03.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:03.091+0000 7f64144bb640 1 -- 172.21.15.78:0/201359546 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f640c150900 msgr2=0x7f640c150d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:35:03.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:03.091+0000 7f64144bb640 1 --2- 172.21.15.78:0/201359546 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f640c150900 0x7f640c150d80 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f64000ab040 tx=0x7f63f4005800 comp rx=0 tx=0).stop 2023-12-12T17:35:03.098 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:03.091+0000 7f6412a58640 1 -- 172.21.15.78:0/201359546 reap_dead start 2023-12-12T17:35:03.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:03.091+0000 7f64144bb640 1 -- 172.21.15.78:0/201359546 shutdown_connections 2023-12-12T17:35:03.099 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:03.091+0000 7f64144bb640 1 -- 172.21.15.78:0/201359546 >> 172.21.15.78:0/201359546 conn(0x7f640c0b0b20 msgr2=0x7f640c0b0390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T17:35:03.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:03.091+0000 7f64144bb640 1 -- 172.21.15.78:0/201359546 shutdown_connections 2023-12-12T17:35:03.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:03.091+0000 7f64144bb640 1 -- 172.21.15.78:0/201359546 wait complete. 2023-12-12T17:35:03.178 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-12-12T17:35:03.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:03.979+0000 7f5747f80640 1 Processor -- start 2023-12-12T17:35:03.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:03.979+0000 7f5747f80640 1 -- start start 2023-12-12T17:35:03.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:03.983+0000 7f5747f80640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f57400d0be0 0x7f57400d1040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:35:03.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:03.983+0000 7f5747f80640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57400d04f0 con 0x7f5740160890 2023-12-12T17:35:03.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:03.983+0000 7f5747f80640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57400cdc20 con 0x7f57400d15d0 2023-12-12T17:35:03.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:03.983+0000 7f5747f80640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57400cfc50 con 0x7f57400d0be0 2023-12-12T17:35:03.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:03.983+0000 7f5745d1c640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f5740160890 0x7f57400b5e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:52950/0 (socket says 172.21.15.78:52950) 2023-12-12T17:35:03.992 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:03.983+0000 7f5745d1c640 1 -- 172.21.15.78:0/1332805010 learned_addr learned my addr 172.21.15.78:0/1332805010 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-12-12T17:35:03.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:03.987+0000 7f574551b640 1 --2- 172.21.15.78:0/1332805010 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f57400d0be0 0x7f57400d1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:35:03.993 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:03.987+0000 7f5744d1a640 1 -- 172.21.15.78:0/1332805010 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4270941039 0 0) 0x7f57380014a0 con 0x7f5740160890 2023-12-12T17:35:03.994 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:03.987+0000 7f5744d1a640 1 -- 172.21.15.78:0/1332805010 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f572c003530 con 0x7f5740160890 2023-12-12T17:35:03.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:03.987+0000 7f574551b640 1 -- 172.21.15.78:0/1332805010 >> v1:172.21.15.187:6789/0 conn(0x7f57400d15d0 legacy=0x7f57400ce3e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-12-12T17:35:03.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:03.987+0000 7f574551b640 1 -- 172.21.15.78:0/1332805010 >> v1:172.21.15.78:6789/0 conn(0x7f5740160890 legacy=0x7f57400b5e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:35:03.996 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:03.987+0000 7f574551b640 1 -- 172.21.15.78:0/1332805010 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57400cff30 con 0x7f57400d0be0 2023-12-12T17:35:04.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:03.999+0000 7f574551b640 1 --2- 172.21.15.78:0/1332805010 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f57400d0be0 0x7f57400d1040 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f57300097f0 tx=0x7f573001c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3aa953c09aceb843 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T17:35:04.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:04.003+0000 7f5744d1a640 1 -- 172.21.15.78:0/1332805010 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57300ab650 con 0x7f57400d0be0 2023-12-12T17:35:04.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:04.003+0000 7f5744d1a640 1 -- 172.21.15.78:0/1332805010 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57300ab7b0 con 0x7f57400d0be0 2023-12-12T17:35:04.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:04.003+0000 7f5744d1a640 1 -- 172.21.15.78:0/1332805010 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57300abb40 con 0x7f57400d0be0 2023-12-12T17:35:04.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:04.003+0000 7f5747f80640 1 -- 172.21.15.78:0/1332805010 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f57400d0be0 msgr2=0x7f57400d1040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:35:04.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:04.003+0000 7f5747f80640 1 --2- 172.21.15.78:0/1332805010 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f57400d0be0 0x7f57400d1040 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f57300097f0 tx=0x7f573001c450 comp rx=0 tx=0).stop 2023-12-12T17:35:04.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:04.003+0000 7f5747f80640 1 -- 172.21.15.78:0/1332805010 shutdown_connections 2023-12-12T17:35:04.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:04.003+0000 7f5747f80640 1 --2- 172.21.15.78:0/1332805010 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f57400d0be0 0x7f57400d1040 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:04.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:04.003+0000 7f5747f80640 1 -- 172.21.15.78:0/1332805010 >> 172.21.15.78:0/1332805010 conn(0x7f574009c2f0 msgr2=0x7f57400d3010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T17:35:04.012 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:04.007+0000 7f5747f80640 1 -- 172.21.15.78:0/1332805010 shutdown_connections 2023-12-12T17:35:04.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:04.007+0000 7f5747f80640 1 -- 172.21.15.78:0/1332805010 wait complete. 2023-12-12T17:35:04.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:04.011+0000 7f5747f80640 1 Processor -- start 2023-12-12T17:35:04.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:04.015+0000 7f5747f80640 1 -- start start 2023-12-12T17:35:04.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:04.019+0000 7f5747f80640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f57400d0be0 0x7f574014b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:35:04.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:04.019+0000 7f5747f80640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f57400d15d0 0x7f57400c9770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:35:04.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:04.019+0000 7f5747f80640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5740160890 0x7f57401536a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:35:04.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:04.019+0000 7f5747f80640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57400cb9e0 con 0x7f57400d0be0 2023-12-12T17:35:04.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:04.019+0000 7f5747f80640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f574014e5e0 con 0x7f5740160890 2023-12-12T17:35:04.026 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:04.019+0000 7f5747f80640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57400cb700 con 0x7f57400d15d0 2023-12-12T17:35:04.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:04.019+0000 7f574551b640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f57400d15d0 0x7f57400c9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:35:04.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:04.019+0000 7f574551b640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f57400d15d0 0x7f57400c9770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.78:58804/0 (socket says 172.21.15.78:58804) 2023-12-12T17:35:04.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:04.019+0000 7f574551b640 1 -- 172.21.15.78:0/3109881153 learned_addr learned my addr 172.21.15.78:0/3109881153 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T17:35:04.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:04.019+0000 7f574651d640 1 --2- 172.21.15.78:0/3109881153 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5740160890 0x7f57401536a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:35:04.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:04.019+0000 7f5745d1c640 1 --2- 172.21.15.78:0/3109881153 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f57400d0be0 0x7f574014b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:35:04.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:04.019+0000 7f574551b640 1 -- 172.21.15.78:0/3109881153 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5740160890 msgr2=0x7f57401536a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:35:04.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:04.019+0000 7f574551b640 1 --2- 172.21.15.78:0/3109881153 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5740160890 0x7f57401536a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:04.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:04.019+0000 7f574551b640 1 -- 172.21.15.78:0/3109881153 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f57400d0be0 msgr2=0x7f574014b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:35:04.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:04.019+0000 7f574551b640 1 --2- 172.21.15.78:0/3109881153 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f57400d0be0 0x7f574014b520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:04.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:04.019+0000 7f574551b640 1 -- 172.21.15.78:0/3109881153 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5730009420 con 0x7f57400d15d0 2023-12-12T17:35:04.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:04.023+0000 7f574551b640 1 --2- 172.21.15.78:0/3109881153 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f57400d15d0 0x7f57400c9770 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f57300ad040 tx=0x7f573001ac90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T17:35:04.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:04.023+0000 7f57367fc640 1 -- 172.21.15.78:0/3109881153 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57300bf610 con 0x7f57400d15d0 2023-12-12T17:35:04.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:04.023+0000 7f57367fc640 1 -- 172.21.15.78:0/3109881153 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57300bf790 con 0x7f57400d15d0 2023-12-12T17:35:04.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:04.023+0000 7f57367fc640 1 -- 172.21.15.78:0/3109881153 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57300bfb40 con 0x7f57400d15d0 2023-12-12T17:35:04.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:04.027+0000 7f5747f80640 1 -- 172.21.15.78:0/3109881153 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57400c7ce0 con 0x7f57400d15d0 2023-12-12T17:35:04.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:04.027+0000 7f5747f80640 1 -- 172.21.15.78:0/3109881153 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57400c82a0 con 0x7f57400d15d0 2023-12-12T17:35:04.038 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:04.031+0000 7f5747f80640 1 -- 172.21.15.78:0/3109881153 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57400cbd40 con 0x7f57400d15d0 2023-12-12T17:35:04.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:04.035+0000 7f57367fc640 1 -- 172.21.15.78:0/3109881153 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f57300bfca0 con 0x7f57400d15d0 2023-12-12T17:35:04.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:04.039+0000 7f57367fc640 1 --2- 172.21.15.78:0/3109881153 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f57240664f0 0x7f57240689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:35:04.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:04.039+0000 7f57367fc640 1 -- 172.21.15.78:0/3109881153 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f573011ea60 con 0x7f57400d15d0 2023-12-12T17:35:04.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:04.039+0000 7f5745d1c640 1 --2- 172.21.15.78:0/3109881153 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f57240664f0 0x7f57240689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:35:04.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:04.039+0000 7f5745d1c640 1 --2- 172.21.15.78:0/3109881153 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f57240664f0 0x7f57240689b0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f5738001600 tx=0x7f5738009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T17:35:04.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:04.043+0000 7f57367fc640 1 -- 172.21.15.78:0/3109881153 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f57400cbd40 con 0x7f57400d15d0 2023-12-12T17:35:04.354 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:04.347+0000 7f5747f80640 1 -- 172.21.15.78:0/3109881153 --> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f574015fb90 con 0x7f57240664f0 2023-12-12T17:35:04.377 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:04.371+0000 7f57367fc640 1 -- 172.21.15.78:0/3109881153 <== mgr.4104 v2:172.21.15.78:6832/1725498448 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f574015fb90 con 0x7f57240664f0 2023-12-12T17:35:04.377 INFO:teuthology.orchestra.run.smithi078.stderr:instructed osd(s) 0 to deep-scrub 2023-12-12T17:35:04.384 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:04.379+0000 7f5747f80640 1 -- 172.21.15.78:0/3109881153 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f57240664f0 msgr2=0x7f57240689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:35:04.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:04.379+0000 7f5747f80640 1 --2- 172.21.15.78:0/3109881153 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f57240664f0 0x7f57240689b0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f5738001600 tx=0x7f5738009040 comp rx=0 tx=0).stop 2023-12-12T17:35:04.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:04.379+0000 7f5747f80640 1 -- 172.21.15.78:0/3109881153 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f57400d15d0 msgr2=0x7f57400c9770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:35:04.385 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:04.379+0000 7f5747f80640 1 --2- 172.21.15.78:0/3109881153 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f57400d15d0 0x7f57400c9770 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f57300ad040 tx=0x7f573001ac90 comp rx=0 tx=0).stop 2023-12-12T17:35:04.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:04.379+0000 7f5747f80640 1 -- 172.21.15.78:0/3109881153 shutdown_connections 2023-12-12T17:35:04.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:04.379+0000 7f5747f80640 1 --2- 172.21.15.78:0/3109881153 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f57240664f0 0x7f57240689b0 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:04.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:04.379+0000 7f5747f80640 1 --2- 172.21.15.78:0/3109881153 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5740160890 0x7f57401536a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:04.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:04.379+0000 7f5747f80640 1 --2- 172.21.15.78:0/3109881153 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f57400d15d0 0x7f57400c9770 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:04.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:04.379+0000 7f5747f80640 1 --2- 172.21.15.78:0/3109881153 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f57400d0be0 0x7f574014b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:04.386 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:04.379+0000 7f5747f80640 1 -- 172.21.15.78:0/3109881153 >> 172.21.15.78:0/3109881153 conn(0x7f574009c2f0 msgr2=0x7f574015e2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T17:35:04.387 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:04.379+0000 7f5747f80640 1 -- 172.21.15.78:0/3109881153 shutdown_connections 2023-12-12T17:35:04.387 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:04.379+0000 7f5747f80640 1 -- 172.21.15.78:0/3109881153 wait complete. 2023-12-12T17:35:04.459 INFO:tasks.ceph:Scrubbing osd.1 2023-12-12T17:35:04.459 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-12-12T17:35:05.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:04.999+0000 7f8852fd0640 1 Processor -- start 2023-12-12T17:35:05.008 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:04.999+0000 7f8852fd0640 1 -- start start 2023-12-12T17:35:05.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.003+0000 7f8852fd0640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f884c15d1f0 0x7f884c0d0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:35:05.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.003+0000 7f8852fd0640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f884c0b3c80 0x7f884c0d1530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:35:05.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.003+0000 7f8852fd0640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f884c0b27e0 con 0x7f884c0d3910 2023-12-12T17:35:05.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.003+0000 7f8852fd0640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f884c0ce410 con 0x7f884c15d1f0 2023-12-12T17:35:05.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.003+0000 7f8852fd0640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f884c0ce6f0 con 0x7f884c0b3c80 2023-12-12T17:35:05.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.003+0000 7f88517cd640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f884c0d3910 0x7f884c0cf750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:52954/0 (socket says 172.21.15.78:52954) 2023-12-12T17:35:05.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.003+0000 7f88517cd640 1 -- 172.21.15.78:0/4205171213 learned_addr learned my addr 172.21.15.78:0/4205171213 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-12-12T17:35:05.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.003+0000 7f88527cf640 1 --2- 172.21.15.78:0/4205171213 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f884c0b3c80 0x7f884c0d1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:35:05.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.003+0000 7f8851fce640 1 --2- 172.21.15.78:0/4205171213 >> v2:172.21.15.187:3300/0 conn(0x7f884c15d1f0 0x7f884c0d0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:35:05.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.003+0000 7f8850fcc640 1 -- 172.21.15.78:0/4205171213 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1414328397 0 0) 0x7f884c0b27e0 con 0x7f884c0d3910 2023-12-12T17:35:05.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.003+0000 7f8850fcc640 1 -- 172.21.15.78:0/4205171213 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8838003530 con 0x7f884c0d3910 2023-12-12T17:35:05.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.003+0000 7f88527cf640 1 -- 172.21.15.78:0/4205171213 >> v2:172.21.15.187:3300/0 conn(0x7f884c15d1f0 msgr2=0x7f884c0d0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T17:35:05.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.003+0000 7f88527cf640 1 --2- 172.21.15.78:0/4205171213 >> v2:172.21.15.187:3300/0 conn(0x7f884c15d1f0 0x7f884c0d0ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:05.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.003+0000 7f88527cf640 1 -- 172.21.15.78:0/4205171213 >> v1:172.21.15.78:6789/0 conn(0x7f884c0d3910 legacy=0x7f884c0cf750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:35:05.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.003+0000 7f88527cf640 1 -- 172.21.15.78:0/4205171213 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f884c0ce9d0 con 0x7f884c0b3c80 2023-12-12T17:35:05.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.007+0000 7f88527cf640 1 --2- 172.21.15.78:0/4205171213 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f884c0b3c80 0x7f884c0d1530 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f8844009d90 tx=0x7f884401c890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4ec2979a57d5398c server_cookie=0 in_seq=0 out_seq=0 2023-12-12T17:35:05.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.007+0000 7f8850fcc640 1 -- 172.21.15.78:0/4205171213 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88440a5860 con 0x7f884c0b3c80 2023-12-12T17:35:05.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.007+0000 7f8850fcc640 1 -- 172.21.15.78:0/4205171213 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88440a59c0 con 0x7f884c0b3c80 2023-12-12T17:35:05.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.007+0000 7f8850fcc640 1 -- 172.21.15.78:0/4205171213 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88440a5d50 con 0x7f884c0b3c80 2023-12-12T17:35:05.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.007+0000 7f8852fd0640 1 -- 172.21.15.78:0/4205171213 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f884c0b3c80 msgr2=0x7f884c0d1530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:35:05.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.007+0000 7f8852fd0640 1 --2- 172.21.15.78:0/4205171213 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f884c0b3c80 0x7f884c0d1530 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f8844009d90 tx=0x7f884401c890 comp rx=0 tx=0).stop 2023-12-12T17:35:05.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.007+0000 7f8852fd0640 1 -- 172.21.15.78:0/4205171213 shutdown_connections 2023-12-12T17:35:05.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.007+0000 7f8852fd0640 1 --2- 172.21.15.78:0/4205171213 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f884c0b3c80 0x7f884c0d1530 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:05.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.007+0000 7f8852fd0640 1 --2- 172.21.15.78:0/4205171213 >> v2:172.21.15.187:3300/0 conn(0x7f884c15d1f0 0x7f884c0d0ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:05.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.007+0000 7f8852fd0640 1 -- 172.21.15.78:0/4205171213 >> 172.21.15.78:0/4205171213 conn(0x7f884c0d2df0 msgr2=0x7f884c0d3200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T17:35:05.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.007+0000 7f8852fd0640 1 -- 172.21.15.78:0/4205171213 shutdown_connections 2023-12-12T17:35:05.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.007+0000 7f8852fd0640 1 -- 172.21.15.78:0/4205171213 wait complete. 2023-12-12T17:35:05.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.011+0000 7f8852fd0640 1 Processor -- start 2023-12-12T17:35:05.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.011+0000 7f8852fd0640 1 -- start start 2023-12-12T17:35:05.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.011+0000 7f8852fd0640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f884c0b3c80 0x7f884c154290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:35:05.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.011+0000 7f8852fd0640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f884c0d3910 0x7f884c0b6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:35:05.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.011+0000 7f8852fd0640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f884c15d1f0 0x7f884c0cbc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:35:05.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.011+0000 7f8852fd0640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f884c1547d0 con 0x7f884c0d3910 2023-12-12T17:35:05.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.011+0000 7f8852fd0640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f884c0b5f10 con 0x7f884c0b3c80 2023-12-12T17:35:05.020 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.011+0000 7f8852fd0640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f884c0b61f0 con 0x7f884c15d1f0 2023-12-12T17:35:05.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.011+0000 7f88517cd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f884c0d3910 0x7f884c0b6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:35:05.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.011+0000 7f88517cd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f884c0d3910 0x7f884c0b6fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:45012/0 (socket says 172.21.15.78:45012) 2023-12-12T17:35:05.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.011+0000 7f88517cd640 1 -- 172.21.15.78:0/465745903 learned_addr learned my addr 172.21.15.78:0/465745903 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T17:35:05.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.011+0000 7f8851fce640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f884c0b3c80 0x7f884c154290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:35:05.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.011+0000 7f88527cf640 1 --2- 172.21.15.78:0/465745903 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f884c15d1f0 0x7f884c0cbc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:35:05.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.011+0000 7f88517cd640 1 -- 172.21.15.78:0/465745903 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f884c15d1f0 msgr2=0x7f884c0cbc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:35:05.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.011+0000 7f88517cd640 1 --2- 172.21.15.78:0/465745903 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f884c15d1f0 0x7f884c0cbc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:05.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.011+0000 7f88517cd640 1 -- 172.21.15.78:0/465745903 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f884c0b3c80 msgr2=0x7f884c154290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:35:05.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.011+0000 7f88517cd640 1 --2- 172.21.15.78:0/465745903 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f884c0b3c80 0x7f884c154290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:05.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.011+0000 7f88517cd640 1 -- 172.21.15.78:0/465745903 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8844009a70 con 0x7f884c0d3910 2023-12-12T17:35:05.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.011+0000 7f88517cd640 1 --2- 172.21.15.78:0/465745903 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f884c0d3910 0x7f884c0b6fb0 secure :-1 s=READY pgs=2128 cs=0 l=1 rev1=1 crypto rx=0x7f884000c4d0 tx=0x7f884000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T17:35:05.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.011+0000 7f883e7fc640 1 -- 172.21.15.78:0/465745903 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8840005cf0 con 0x7f884c0d3910 2023-12-12T17:35:05.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.011+0000 7f883e7fc640 1 -- 172.21.15.78:0/465745903 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8840005e50 con 0x7f884c0d3910 2023-12-12T17:35:05.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.011+0000 7f883e7fc640 1 -- 172.21.15.78:0/465745903 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8840007270 con 0x7f884c0d3910 2023-12-12T17:35:05.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.011+0000 7f8852fd0640 1 -- 172.21.15.78:0/465745903 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f884c0b64d0 con 0x7f884c0d3910 2023-12-12T17:35:05.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.015+0000 7f8852fd0640 1 -- 172.21.15.78:0/465745903 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f884c0b6a90 con 0x7f884c0d3910 2023-12-12T17:35:05.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.015+0000 7f8852fd0640 1 -- 172.21.15.78:0/465745903 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f884c074610 con 0x7f884c0d3910 2023-12-12T17:35:05.029 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.023+0000 7f883e7fc640 1 -- 172.21.15.78:0/465745903 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f88400073d0 con 0x7f884c0d3910 2023-12-12T17:35:05.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.023+0000 7f883e7fc640 1 --2- 172.21.15.78:0/465745903 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f88300664c0 0x7f8830068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:35:05.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.023+0000 7f883e7fc640 1 -- 172.21.15.78:0/465745903 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f88400830a0 con 0x7f884c0d3910 2023-12-12T17:35:05.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.023+0000 7f883e7fc640 1 --2- 172.21.15.78:0/465745903 >> [v2:172.21.15.78:6800/962652768,v1:172.21.15.78:6801/962652768] conn(0x7f883006c7c0 0x7f883006ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:35:05.030 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.023+0000 7f883e7fc640 1 -- 172.21.15.78:0/465745903 --> [v2:172.21.15.78:6800/962652768,v1:172.21.15.78:6801/962652768] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f883006f2d0 con 0x7f883006c7c0 2023-12-12T17:35:05.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.023+0000 7f883e7fc640 1 -- 172.21.15.78:0/465745903 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8840050900 con 0x7f884c0d3910 2023-12-12T17:35:05.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.023+0000 7f88527cf640 1 --2- 172.21.15.78:0/465745903 >> [v2:172.21.15.78:6800/962652768,v1:172.21.15.78:6801/962652768] conn(0x7f883006c7c0 0x7f883006ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:35:05.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.023+0000 7f8851fce640 1 --2- 172.21.15.78:0/465745903 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f88300664c0 0x7f8830068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:35:05.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.023+0000 7f88527cf640 1 --2- 172.21.15.78:0/465745903 >> [v2:172.21.15.78:6800/962652768,v1:172.21.15.78:6801/962652768] conn(0x7f883006c7c0 0x7f883006ec00 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T17:35:05.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.027+0000 7f8851fce640 1 --2- 172.21.15.78:0/465745903 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f88300664c0 0x7f8830068980 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f88480096f0 tx=0x7f8848008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T17:35:05.069 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.063+0000 7f883e7fc640 1 -- 172.21.15.78:0/465745903 <== osd.1 v2:172.21.15.78:6800/962652768 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f883006f2d0 con 0x7f883006c7c0 2023-12-12T17:35:05.140 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.131+0000 7f8852fd0640 1 -- 172.21.15.78:0/465745903 --> [v2:172.21.15.78:6800/962652768,v1:172.21.15.78:6801/962652768] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f884c0b6c80 con 0x7f883006c7c0 2023-12-12T17:35:05.161 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.155+0000 7f883e7fc640 1 -- 172.21.15.78:0/465745903 <== osd.1 v2:172.21.15.78:6800/962652768 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f884c0b6c80 con 0x7f883006c7c0 2023-12-12T17:35:05.162 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2023-12-12T17:35:05.163 INFO:teuthology.orchestra.run.smithi078.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-12-12T17:35:05.163 INFO:teuthology.orchestra.run.smithi078.stdout:} 2023-12-12T17:35:05.164 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.155+0000 7f8852fd0640 1 -- 172.21.15.78:0/465745903 >> [v2:172.21.15.78:6800/962652768,v1:172.21.15.78:6801/962652768] conn(0x7f883006c7c0 msgr2=0x7f883006ec00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:35:05.164 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.155+0000 7f8852fd0640 1 --2- 172.21.15.78:0/465745903 >> [v2:172.21.15.78:6800/962652768,v1:172.21.15.78:6801/962652768] conn(0x7f883006c7c0 0x7f883006ec00 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:05.164 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.155+0000 7f8852fd0640 1 -- 172.21.15.78:0/465745903 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f88300664c0 msgr2=0x7f8830068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:35:05.164 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.155+0000 7f8852fd0640 1 --2- 172.21.15.78:0/465745903 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f88300664c0 0x7f8830068980 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f88480096f0 tx=0x7f8848008040 comp rx=0 tx=0).stop 2023-12-12T17:35:05.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.155+0000 7f8852fd0640 1 -- 172.21.15.78:0/465745903 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f884c0d3910 msgr2=0x7f884c0b6fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:35:05.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.155+0000 7f8852fd0640 1 --2- 172.21.15.78:0/465745903 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f884c0d3910 0x7f884c0b6fb0 secure :-1 s=READY pgs=2128 cs=0 l=1 rev1=1 crypto rx=0x7f884000c4d0 tx=0x7f884000c990 comp rx=0 tx=0).stop 2023-12-12T17:35:05.165 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.159+0000 7f88527cf640 1 -- 172.21.15.78:0/465745903 reap_dead start 2023-12-12T17:35:05.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.159+0000 7f8852fd0640 1 -- 172.21.15.78:0/465745903 shutdown_connections 2023-12-12T17:35:05.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.159+0000 7f8852fd0640 1 -- 172.21.15.78:0/465745903 >> 172.21.15.78:0/465745903 conn(0x7f884c0d2df0 msgr2=0x7f884c0cf750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T17:35:05.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.159+0000 7f8852fd0640 1 -- 172.21.15.78:0/465745903 shutdown_connections 2023-12-12T17:35:05.166 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.159+0000 7f8852fd0640 1 -- 172.21.15.78:0/465745903 wait complete. 2023-12-12T17:35:05.231 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-12-12T17:35:05.693 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.687+0000 7fd20523a640 1 Processor -- start 2023-12-12T17:35:05.694 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.687+0000 7fd20523a640 1 -- start start 2023-12-12T17:35:05.699 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.691+0000 7fd20523a640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd20015d070 0x7fd2000d1930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:35:05.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.691+0000 7fd20523a640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2000ceb30 con 0x7fd20015d450 2023-12-12T17:35:05.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.691+0000 7fd20523a640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2000d0b70 con 0x7fd2000d3a20 2023-12-12T17:35:05.700 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.691+0000 7fd20523a640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2000d1e70 con 0x7fd20015d070 2023-12-12T17:35:05.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.691+0000 7fd204a39640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fd20015d450 0x7fd200160e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:52958/0 (socket says 172.21.15.78:52958) 2023-12-12T17:35:05.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.691+0000 7fd204a39640 1 -- 172.21.15.78:0/2757325253 learned_addr learned my addr 172.21.15.78:0/2757325253 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-12-12T17:35:05.701 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.695+0000 7fd1feffd640 1 -- 172.21.15.78:0/2757325253 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 373001133 0 0) 0x7fd2000ceb30 con 0x7fd20015d450 2023-12-12T17:35:05.702 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.695+0000 7fd1feffd640 1 -- 172.21.15.78:0/2757325253 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1e8003530 con 0x7fd20015d450 2023-12-12T17:35:05.702 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.695+0000 7fd1fffff640 1 --2- 172.21.15.78:0/2757325253 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd20015d070 0x7fd2000d1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:35:05.702 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.695+0000 7fd1feffd640 1 -- 172.21.15.78:0/2757325253 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 924689856 0 0) 0x7fd1e8003530 con 0x7fd20015d450 2023-12-12T17:35:05.702 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.695+0000 7fd1feffd640 1 -- 172.21.15.78:0/2757325253 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd20015d070 msgr2=0x7fd2000d1930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T17:35:05.702 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.695+0000 7fd1feffd640 1 --2- 172.21.15.78:0/2757325253 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd20015d070 0x7fd2000d1930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:05.702 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.695+0000 7fd1feffd640 1 -- 172.21.15.78:0/2757325253 >> v1:172.21.15.187:6789/0 conn(0x7fd2000d3a20 legacy=0x7fd2000ce420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:35:05.702 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.695+0000 7fd1feffd640 1 -- 172.21.15.78:0/2757325253 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2000d0e50 con 0x7fd20015d450 2023-12-12T17:35:05.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.695+0000 7fd1feffd640 1 -- 172.21.15.78:0/2757325253 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 465499599 0 0) 0x7fd1f8001a00 con 0x7fd20015d450 2023-12-12T17:35:05.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.695+0000 7fd1feffd640 1 -- 172.21.15.78:0/2757325253 >> v1:172.21.15.78:6789/0 conn(0x7fd20015d450 legacy=0x7fd200160e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:35:05.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.695+0000 7fd1feffd640 1 --2- 172.21.15.78:0/2757325253 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd1e80039b0 0x7fd1e8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:35:05.703 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.695+0000 7fd1feffd640 1 --2- 172.21.15.78:0/2757325253 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd1e80047d0 0x7fd1e8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:35:05.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.695+0000 7fd1feffd640 1 --2- 172.21.15.78:0/2757325253 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd1e80051e0 0x7fd1e80141a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:35:05.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.695+0000 7fd1feffd640 1 -- 172.21.15.78:0/2757325253 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2000d1e70 con 0x7fd1e80039b0 2023-12-12T17:35:05.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.695+0000 7fd1feffd640 1 -- 172.21.15.78:0/2757325253 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e80148f0 con 0x7fd1e80051e0 2023-12-12T17:35:05.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.695+0000 7fd1feffd640 1 -- 172.21.15.78:0/2757325253 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e8014ab0 con 0x7fd1e80047d0 2023-12-12T17:35:05.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.695+0000 7fd1fffff640 1 --2- 172.21.15.78:0/2757325253 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd1e80039b0 0x7fd1e8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:35:05.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.695+0000 7fd204a39640 1 --2- 172.21.15.78:0/2757325253 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd1e80051e0 0x7fd1e80141a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:35:05.704 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.695+0000 7fd1ff7fe640 1 --2- 172.21.15.78:0/2757325253 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd1e80047d0 0x7fd1e8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:35:05.705 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.695+0000 7fd1fffff640 1 -- 172.21.15.78:0/2757325253 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd1e80047d0 msgr2=0x7fd1e8004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T17:35:05.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.695+0000 7fd1fffff640 1 --2- 172.21.15.78:0/2757325253 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd1e80047d0 0x7fd1e8004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:05.707 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.695+0000 7fd1fffff640 1 -- 172.21.15.78:0/2757325253 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd1e80051e0 msgr2=0x7fd1e80141a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T17:35:05.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.695+0000 7fd1fffff640 1 --2- 172.21.15.78:0/2757325253 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd1e80051e0 0x7fd1e80141a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:05.708 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.695+0000 7fd1fffff640 1 -- 172.21.15.78:0/2757325253 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1e8003530 con 0x7fd1e80039b0 2023-12-12T17:35:05.709 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.703+0000 7fd1fffff640 1 --2- 172.21.15.78:0/2757325253 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd1e80039b0 0x7fd1e8003dd0 secure :-1 s=READY pgs=2130 cs=0 l=1 rev1=1 crypto rx=0x7fd2000b5990 tx=0x7fd1f001c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=709b449e01006b6c server_cookie=0 in_seq=0 out_seq=0 2023-12-12T17:35:05.710 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.703+0000 7fd1feffd640 1 -- 172.21.15.78:0/2757325253 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1f00a7070 con 0x7fd1e80039b0 2023-12-12T17:35:05.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.703+0000 7fd1feffd640 1 -- 172.21.15.78:0/2757325253 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1f00ad400 con 0x7fd1e80039b0 2023-12-12T17:35:05.711 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.703+0000 7fd1feffd640 1 -- 172.21.15.78:0/2757325253 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1f00ad7b0 con 0x7fd1e80039b0 2023-12-12T17:35:05.713 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.707+0000 7fd20523a640 1 -- 172.21.15.78:0/2757325253 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd1e80039b0 msgr2=0x7fd1e8003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:35:05.713 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.707+0000 7fd20523a640 1 --2- 172.21.15.78:0/2757325253 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd1e80039b0 0x7fd1e8003dd0 secure :-1 s=READY pgs=2130 cs=0 l=1 rev1=1 crypto rx=0x7fd2000b5990 tx=0x7fd1f001c510 comp rx=0 tx=0).stop 2023-12-12T17:35:05.713 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.707+0000 7fd204a39640 1 -- 172.21.15.78:0/2757325253 reap_dead start 2023-12-12T17:35:05.713 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.707+0000 7fd20523a640 1 -- 172.21.15.78:0/2757325253 shutdown_connections 2023-12-12T17:35:05.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.707+0000 7fd20523a640 1 -- 172.21.15.78:0/2757325253 >> 172.21.15.78:0/2757325253 conn(0x7fd2000d2e00 msgr2=0x7fd2000d3210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T17:35:05.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.707+0000 7fd20523a640 1 -- 172.21.15.78:0/2757325253 shutdown_connections 2023-12-12T17:35:05.714 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.707+0000 7fd20523a640 1 -- 172.21.15.78:0/2757325253 wait complete. 2023-12-12T17:35:05.721 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.715+0000 7fd20523a640 1 Processor -- start 2023-12-12T17:35:05.722 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.715+0000 7fd20523a640 1 -- start start 2023-12-12T17:35:05.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.719+0000 7fd20523a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd1e80039b0 0x7fd2001577c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:35:05.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.719+0000 7fd20523a640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd20015ab70 0x7fd20015afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:35:05.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.719+0000 7fd20523a640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd2001f4e90 0x7fd2001f5310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:35:05.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.719+0000 7fd20523a640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2000ca870 con 0x7fd1e80039b0 2023-12-12T17:35:05.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.719+0000 7fd20523a640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd20015b510 con 0x7fd2001f4e90 2023-12-12T17:35:05.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.719+0000 7fd20523a640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd200157e80 con 0x7fd20015ab70 2023-12-12T17:35:05.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.719+0000 7fd1ff7fe640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd20015ab70 0x7fd20015afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:35:05.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.719+0000 7fd1fffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd1e80039b0 0x7fd2001577c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:35:05.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.719+0000 7fd1ff7fe640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd20015ab70 0x7fd20015afd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.78:58856/0 (socket says 172.21.15.78:58856) 2023-12-12T17:35:05.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.719+0000 7fd1ff7fe640 1 -- 172.21.15.78:0/1885293007 learned_addr learned my addr 172.21.15.78:0/1885293007 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T17:35:05.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.719+0000 7fd204a39640 1 --2- 172.21.15.78:0/1885293007 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd2001f4e90 0x7fd2001f5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:35:05.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.723+0000 7fd1ff7fe640 1 -- 172.21.15.78:0/1885293007 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd2001f4e90 msgr2=0x7fd2001f5310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:35:05.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.723+0000 7fd1ff7fe640 1 --2- 172.21.15.78:0/1885293007 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd2001f4e90 0x7fd2001f5310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:05.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.723+0000 7fd1ff7fe640 1 -- 172.21.15.78:0/1885293007 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd1e80039b0 msgr2=0x7fd2001577c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:35:05.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.723+0000 7fd1ff7fe640 1 --2- 172.21.15.78:0/1885293007 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd1e80039b0 0x7fd2001577c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:05.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.723+0000 7fd1ff7fe640 1 -- 172.21.15.78:0/1885293007 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2000c9ed0 con 0x7fd20015ab70 2023-12-12T17:35:05.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.723+0000 7fd1ff7fe640 1 --2- 172.21.15.78:0/1885293007 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd20015ab70 0x7fd20015afd0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fd1f400e500 tx=0x7fd1f400e9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T17:35:05.730 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.723+0000 7fd1fcff9640 1 -- 172.21.15.78:0/1885293007 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1f40053a0 con 0x7fd20015ab70 2023-12-12T17:35:05.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.723+0000 7fd1fcff9640 1 -- 172.21.15.78:0/1885293007 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1f4003600 con 0x7fd20015ab70 2023-12-12T17:35:05.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.723+0000 7fd1fcff9640 1 -- 172.21.15.78:0/1885293007 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1f4005500 con 0x7fd20015ab70 2023-12-12T17:35:05.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.723+0000 7fd20523a640 1 -- 172.21.15.78:0/1885293007 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2000ca1b0 con 0x7fd20015ab70 2023-12-12T17:35:05.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.723+0000 7fd20523a640 1 -- 172.21.15.78:0/1885293007 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2001f5850 con 0x7fd20015ab70 2023-12-12T17:35:05.733 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.727+0000 7fd20523a640 1 -- 172.21.15.78:0/1885293007 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2000ca9b0 con 0x7fd20015ab70 2023-12-12T17:35:05.738 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.731+0000 7fd1fcff9640 1 -- 172.21.15.78:0/1885293007 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd1f4003990 con 0x7fd20015ab70 2023-12-12T17:35:05.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.731+0000 7fd1fcff9640 1 --2- 172.21.15.78:0/1885293007 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fd1ec066470 0x7fd1ec068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:35:05.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.731+0000 7fd1fcff9640 1 -- 172.21.15.78:0/1885293007 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fd1f4083970 con 0x7fd20015ab70 2023-12-12T17:35:05.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.735+0000 7fd1fffff640 1 --2- 172.21.15.78:0/1885293007 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fd1ec066470 0x7fd1ec068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:35:05.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.735+0000 7fd1fffff640 1 --2- 172.21.15.78:0/1885293007 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fd1ec066470 0x7fd1ec068930 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fd1f00af000 tx=0x7fd1f00046d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T17:35:05.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.739+0000 7fd1fcff9640 1 -- 172.21.15.78:0/1885293007 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd2000ca9b0 con 0x7fd20015ab70 2023-12-12T17:35:05.955 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.947+0000 7fd20523a640 1 -- 172.21.15.78:0/1885293007 --> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7fd200161750 con 0x7fd1ec066470 2023-12-12T17:35:05.957 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.951+0000 7fd1fcff9640 1 -- 172.21.15.78:0/1885293007 <== mgr.4104 v2:172.21.15.78:6832/1725498448 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fd1f00ad850 con 0x7fd1ec066470 2023-12-12T17:35:05.957 INFO:teuthology.orchestra.run.smithi078.stderr:instructed osd(s) 1 to deep-scrub 2023-12-12T17:35:05.960 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.951+0000 7fd20523a640 1 -- 172.21.15.78:0/1885293007 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fd1ec066470 msgr2=0x7fd1ec068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:35:05.960 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.951+0000 7fd20523a640 1 --2- 172.21.15.78:0/1885293007 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fd1ec066470 0x7fd1ec068930 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fd1f00af000 tx=0x7fd1f00046d0 comp rx=0 tx=0).stop 2023-12-12T17:35:05.960 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.951+0000 7fd20523a640 1 -- 172.21.15.78:0/1885293007 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd20015ab70 msgr2=0x7fd20015afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:35:05.960 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.951+0000 7fd20523a640 1 --2- 172.21.15.78:0/1885293007 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd20015ab70 0x7fd20015afd0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fd1f400e500 tx=0x7fd1f400e9c0 comp rx=0 tx=0).stop 2023-12-12T17:35:05.960 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.951+0000 7fd20523a640 1 -- 172.21.15.78:0/1885293007 shutdown_connections 2023-12-12T17:35:05.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.951+0000 7fd20523a640 1 --2- 172.21.15.78:0/1885293007 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fd1ec066470 0x7fd1ec068930 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:05.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.951+0000 7fd20523a640 1 --2- 172.21.15.78:0/1885293007 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd2001f4e90 0x7fd2001f5310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:05.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.951+0000 7fd20523a640 1 --2- 172.21.15.78:0/1885293007 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd20015ab70 0x7fd20015afd0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:05.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.951+0000 7fd20523a640 1 --2- 172.21.15.78:0/1885293007 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fd1e80039b0 0x7fd2001577c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:05.961 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.951+0000 7fd20523a640 1 -- 172.21.15.78:0/1885293007 >> 172.21.15.78:0/1885293007 conn(0x7fd2000d2e00 msgr2=0x7fd2000b05c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T17:35:05.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.955+0000 7fd20523a640 1 -- 172.21.15.78:0/1885293007 shutdown_connections 2023-12-12T17:35:05.962 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:05.955+0000 7fd20523a640 1 -- 172.21.15.78:0/1885293007 wait complete. 2023-12-12T17:35:05.991 INFO:tasks.ceph:Scrubbing osd.2 2023-12-12T17:35:05.991 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-12-12T17:35:06.478 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:06.471+0000 7fc94f1d1640 1 Processor -- start 2023-12-12T17:35:06.479 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:06.471+0000 7fc94f1d1640 1 -- start start 2023-12-12T17:35:06.484 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:06.475+0000 7fc94f1d1640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc9480cf860 0x7fc9480cfc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:35:06.484 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:06.479+0000 7fc94f1d1640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fc9480c71f0 0x7fc9480c7680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:35:06.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:06.479+0000 7fc94f1d1640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9480d01c0 con 0x7fc94815d100 2023-12-12T17:35:06.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:06.479+0000 7fc94f1d1640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9480c6d10 con 0x7fc9480c71f0 2023-12-12T17:35:06.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:06.479+0000 7fc94f1d1640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9480d1fd0 con 0x7fc9480cf860 2023-12-12T17:35:06.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:06.479+0000 7fc94cf6d640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7fc94815d100 0x7fc9480d3730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.78:40384/0 (socket says 172.21.15.78:40384) 2023-12-12T17:35:06.486 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:06.479+0000 7fc94cf6d640 1 -- 172.21.15.78:0/1225521811 learned_addr learned my addr 172.21.15.78:0/1225521811 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-12-12T17:35:06.486 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:06.479+0000 7fc94d76e640 1 --2- 172.21.15.78:0/1225521811 >> v2:172.21.15.187:3300/0 conn(0x7fc9480c71f0 0x7fc9480c7680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:35:06.486 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:06.479+0000 7fc947fff640 1 --2- 172.21.15.78:0/1225521811 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc9480cf860 0x7fc9480cfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:35:06.487 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:06.479+0000 7fc9477fe640 1 -- 172.21.15.78:0/1225521811 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 844198836 0 0) 0x7fc9480d01c0 con 0x7fc94815d100 2023-12-12T17:35:06.487 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:06.479+0000 7fc9477fe640 1 -- 172.21.15.78:0/1225521811 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc930003530 con 0x7fc94815d100 2023-12-12T17:35:06.487 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:06.479+0000 7fc94d76e640 1 -- 172.21.15.78:0/1225521811 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc9480cf860 msgr2=0x7fc9480cfc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T17:35:06.487 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:06.479+0000 7fc94d76e640 1 --2- 172.21.15.78:0/1225521811 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc9480cf860 0x7fc9480cfc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:06.487 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:06.479+0000 7fc94d76e640 1 -- 172.21.15.78:0/1225521811 >> v1:172.21.15.187:6789/0 conn(0x7fc94815d100 legacy=0x7fc9480d3730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:35:06.487 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:06.479+0000 7fc94d76e640 1 -- 172.21.15.78:0/1225521811 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9480d1730 con 0x7fc9480c71f0 2023-12-12T17:35:06.489 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:06.483+0000 7fc94d76e640 1 --2- 172.21.15.78:0/1225521811 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc9480c71f0 0x7fc9480c7680 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7fc940009d90 tx=0x7fc94001c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=53da02a84c625ad1 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T17:35:06.490 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:06.483+0000 7fc9477fe640 1 -- 172.21.15.78:0/1225521811 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9400a59e0 con 0x7fc9480c71f0 2023-12-12T17:35:06.490 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:06.483+0000 7fc9477fe640 1 -- 172.21.15.78:0/1225521811 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9400a5b40 con 0x7fc9480c71f0 2023-12-12T17:35:06.490 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:06.483+0000 7fc9477fe640 1 -- 172.21.15.78:0/1225521811 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9400ad440 con 0x7fc9480c71f0 2023-12-12T17:35:06.491 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:06.483+0000 7fc94f1d1640 1 -- 172.21.15.78:0/1225521811 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc9480c71f0 msgr2=0x7fc9480c7680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:35:06.491 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:06.483+0000 7fc94f1d1640 1 --2- 172.21.15.78:0/1225521811 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc9480c71f0 0x7fc9480c7680 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7fc940009d90 tx=0x7fc94001c920 comp rx=0 tx=0).stop 2023-12-12T17:35:06.491 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:06.483+0000 7fc94f1d1640 1 -- 172.21.15.78:0/1225521811 shutdown_connections 2023-12-12T17:35:06.492 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:06.483+0000 7fc94f1d1640 1 --2- 172.21.15.78:0/1225521811 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc9480c71f0 0x7fc9480c7680 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:06.492 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:06.483+0000 7fc94f1d1640 1 --2- 172.21.15.78:0/1225521811 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc9480cf860 0x7fc9480cfc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:06.492 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:06.483+0000 7fc94f1d1640 1 -- 172.21.15.78:0/1225521811 >> 172.21.15.78:0/1225521811 conn(0x7fc94809c360 msgr2=0x7fc9480d3020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T17:35:06.492 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:06.483+0000 7fc94f1d1640 1 -- 172.21.15.78:0/1225521811 shutdown_connections 2023-12-12T17:35:06.492 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:06.483+0000 7fc94f1d1640 1 -- 172.21.15.78:0/1225521811 wait complete. 2023-12-12T17:35:06.493 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:06.487+0000 7fc94f1d1640 1 Processor -- start 2023-12-12T17:35:06.493 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:06.487+0000 7fc94f1d1640 1 -- start start 2023-12-12T17:35:06.495 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:06.487+0000 7fc94f1d1640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc9480c71f0 0x7fc948157e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:35:06.495 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:06.487+0000 7fc94f1d1640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc9480cf860 0x7fc94815bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:35:06.495 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:06.487+0000 7fc94f1d1640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc94815d100 0x7fc94815c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:35:06.495 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:06.487+0000 7fc94f1d1640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9480b5bf0 con 0x7fc94815d100 2023-12-12T17:35:06.496 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:06.487+0000 7fc94f1d1640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc948158e70 con 0x7fc9480cf860 2023-12-12T17:35:06.496 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:06.487+0000 7fc94f1d1640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9481588b0 con 0x7fc9480c71f0 2023-12-12T17:35:06.496 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:06.487+0000 7fc94d76e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc94815d100 0x7fc94815c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:35:06.496 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:06.487+0000 7fc94d76e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc94815d100 0x7fc94815c090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:45046/0 (socket says 172.21.15.78:45046) 2023-12-12T17:35:06.496 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:06.487+0000 7fc94d76e640 1 -- 172.21.15.78:0/3088565001 learned_addr learned my addr 172.21.15.78:0/3088565001 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T17:35:06.496 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:06.487+0000 7fc94cf6d640 1 --2- 172.21.15.78:0/3088565001 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc9480c71f0 0x7fc948157e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:35:06.496 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:06.487+0000 7fc947fff640 1 --2- 172.21.15.78:0/3088565001 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc9480cf860 0x7fc94815bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:35:06.498 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:06.487+0000 7fc94d76e640 1 -- 172.21.15.78:0/3088565001 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc9480c71f0 msgr2=0x7fc948157e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:35:06.498 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:06.487+0000 7fc94d76e640 1 --2- 172.21.15.78:0/3088565001 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc9480c71f0 0x7fc948157e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:06.498 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:06.487+0000 7fc94d76e640 1 -- 172.21.15.78:0/3088565001 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc9480cf860 msgr2=0x7fc94815bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:35:06.498 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:06.487+0000 7fc94d76e640 1 --2- 172.21.15.78:0/3088565001 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc9480cf860 0x7fc94815bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:06.498 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:06.487+0000 7fc94d76e640 1 -- 172.21.15.78:0/3088565001 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc940009a70 con 0x7fc94815d100 2023-12-12T17:35:06.498 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:06.487+0000 7fc94d76e640 1 --2- 172.21.15.78:0/3088565001 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc94815d100 0x7fc94815c090 secure :-1 s=READY pgs=2131 cs=0 l=1 rev1=1 crypto rx=0x7fc9400b0040 tx=0x7fc9400196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T17:35:06.499 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:06.491+0000 7fc947fff640 1 --2- 172.21.15.78:0/3088565001 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc9480cf860 0x7fc94815bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T17:35:06.499 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:06.491+0000 7fc9457fa640 1 -- 172.21.15.78:0/3088565001 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9400adce0 con 0x7fc94815d100 2023-12-12T17:35:06.499 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:06.491+0000 7fc9457fa640 1 -- 172.21.15.78:0/3088565001 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9400ade40 con 0x7fc94815d100 2023-12-12T17:35:06.499 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:06.491+0000 7fc94f1d1640 1 -- 172.21.15.78:0/3088565001 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc948158b90 con 0x7fc94815d100 2023-12-12T17:35:06.499 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:06.491+0000 7fc9457fa640 1 -- 172.21.15.78:0/3088565001 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9400b9670 con 0x7fc94815d100 2023-12-12T17:35:06.499 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:06.491+0000 7fc94f1d1640 1 -- 172.21.15.78:0/3088565001 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9480ca500 con 0x7fc94815d100 2023-12-12T17:35:06.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:06.491+0000 7fc92effd640 1 -- 172.21.15.78:0/3088565001 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc9480cee00 con 0x7fc94815d100 2023-12-12T17:35:06.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:06.491+0000 7fc9457fa640 1 -- 172.21.15.78:0/3088565001 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc9400b97d0 con 0x7fc94815d100 2023-12-12T17:35:06.501 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:06.495+0000 7fc9457fa640 1 --2- 172.21.15.78:0/3088565001 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fc934066470 0x7fc934068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:35:06.501 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:06.495+0000 7fc9457fa640 1 -- 172.21.15.78:0/3088565001 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fc94011fe60 con 0x7fc94815d100 2023-12-12T17:35:06.501 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:06.495+0000 7fc9457fa640 1 --2- 172.21.15.78:0/3088565001 >> [v2:172.21.15.78:6816/2910206054,v1:172.21.15.78:6818/2910206054] conn(0x7fc93406c770 0x7fc93406ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:35:06.501 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:06.495+0000 7fc9457fa640 1 -- 172.21.15.78:0/3088565001 --> [v2:172.21.15.78:6816/2910206054,v1:172.21.15.78:6818/2910206054] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc93406f280 con 0x7fc93406c770 2023-12-12T17:35:06.501 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:06.495+0000 7fc9457fa640 1 -- 172.21.15.78:0/3088565001 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc9401201d0 con 0x7fc94815d100 2023-12-12T17:35:06.502 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:06.495+0000 7fc94cf6d640 1 --2- 172.21.15.78:0/3088565001 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fc934066470 0x7fc934068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:35:06.502 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:06.495+0000 7fc947fff640 1 --2- 172.21.15.78:0/3088565001 >> [v2:172.21.15.78:6816/2910206054,v1:172.21.15.78:6818/2910206054] conn(0x7fc93406c770 0x7fc93406ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:35:06.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:06.495+0000 7fc94cf6d640 1 --2- 172.21.15.78:0/3088565001 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fc934066470 0x7fc934068930 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fc93c0011f0 tx=0x7fc93c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T17:35:06.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:06.495+0000 7fc947fff640 1 --2- 172.21.15.78:0/3088565001 >> [v2:172.21.15.78:6816/2910206054,v1:172.21.15.78:6818/2910206054] conn(0x7fc93406c770 0x7fc93406ebb0 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T17:35:06.577 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:06.571+0000 7fc9457fa640 1 -- 172.21.15.78:0/3088565001 <== osd.2 v2:172.21.15.78:6816/2910206054 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fc93406f280 con 0x7fc93406c770 2023-12-12T17:35:06.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:06.583+0000 7fc92effd640 1 -- 172.21.15.78:0/3088565001 --> [v2:172.21.15.78:6816/2910206054,v1:172.21.15.78:6818/2910206054] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fc9480ca6f0 con 0x7fc93406c770 2023-12-12T17:35:06.636 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:06.627+0000 7fc9457fa640 1 -- 172.21.15.78:0/3088565001 <== osd.2 v2:172.21.15.78:6816/2910206054 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fc9480ca6f0 con 0x7fc93406c770 2023-12-12T17:35:06.636 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2023-12-12T17:35:06.637 INFO:teuthology.orchestra.run.smithi078.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-12-12T17:35:06.637 INFO:teuthology.orchestra.run.smithi078.stdout:} 2023-12-12T17:35:06.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:06.631+0000 7fc92effd640 1 -- 172.21.15.78:0/3088565001 >> [v2:172.21.15.78:6816/2910206054,v1:172.21.15.78:6818/2910206054] conn(0x7fc93406c770 msgr2=0x7fc93406ebb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:35:06.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:06.631+0000 7fc92effd640 1 --2- 172.21.15.78:0/3088565001 >> [v2:172.21.15.78:6816/2910206054,v1:172.21.15.78:6818/2910206054] conn(0x7fc93406c770 0x7fc93406ebb0 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:06.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:06.631+0000 7fc92effd640 1 -- 172.21.15.78:0/3088565001 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fc934066470 msgr2=0x7fc934068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:35:06.638 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:06.631+0000 7fc92effd640 1 --2- 172.21.15.78:0/3088565001 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fc934066470 0x7fc934068930 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fc93c0011f0 tx=0x7fc93c009040 comp rx=0 tx=0).stop 2023-12-12T17:35:06.639 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:06.631+0000 7fc92effd640 1 -- 172.21.15.78:0/3088565001 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc94815d100 msgr2=0x7fc94815c090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:35:06.639 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:06.631+0000 7fc92effd640 1 --2- 172.21.15.78:0/3088565001 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc94815d100 0x7fc94815c090 secure :-1 s=READY pgs=2131 cs=0 l=1 rev1=1 crypto rx=0x7fc9400b0040 tx=0x7fc9400196c0 comp rx=0 tx=0).stop 2023-12-12T17:35:06.639 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:06.631+0000 7fc94d76e640 1 -- 172.21.15.78:0/3088565001 reap_dead start 2023-12-12T17:35:06.639 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:06.631+0000 7fc92effd640 1 -- 172.21.15.78:0/3088565001 shutdown_connections 2023-12-12T17:35:06.639 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:06.631+0000 7fc92effd640 1 -- 172.21.15.78:0/3088565001 >> 172.21.15.78:0/3088565001 conn(0x7fc94809c360 msgr2=0x7fc9481595b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T17:35:06.639 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:06.631+0000 7fc92effd640 1 -- 172.21.15.78:0/3088565001 shutdown_connections 2023-12-12T17:35:06.639 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:06.631+0000 7fc92effd640 1 -- 172.21.15.78:0/3088565001 wait complete. 2023-12-12T17:35:06.661 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-12-12T17:35:07.047 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:07.039+0000 7f382af9d640 1 Processor -- start 2023-12-12T17:35:07.048 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:07.039+0000 7f382af9d640 1 -- start start 2023-12-12T17:35:07.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:07.043+0000 7f382af9d640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f38240716f0 0x7f3824071ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:35:07.049 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:07.043+0000 7f382af9d640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f3824072010 0x7f3824146370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:35:07.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:07.043+0000 7f382af9d640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3824072730 con 0x7f38241468b0 2023-12-12T17:35:07.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:07.043+0000 7f382af9d640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f382406d310 con 0x7f3824072010 2023-12-12T17:35:07.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:07.043+0000 7f382af9d640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f382406d5f0 con 0x7f38240716f0 2023-12-12T17:35:07.050 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:07.043+0000 7f3823fff640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f3824072010 0x7f3824146370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:35:07.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:07.043+0000 7f3828d39640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f38240716f0 0x7f3824071ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:35:07.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:07.043+0000 7f3828d39640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f38240716f0 0x7f3824071ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.78:58890/0 (socket says 172.21.15.78:58890) 2023-12-12T17:35:07.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:07.043+0000 7f3823fff640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f3824072010 0x7f3824146370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.78:53452/0 (socket says 172.21.15.78:53452) 2023-12-12T17:35:07.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:07.043+0000 7f3828d39640 1 -- 172.21.15.78:0/298068543 learned_addr learned my addr 172.21.15.78:0/298068543 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T17:35:07.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:07.043+0000 7f3828d39640 1 -- 172.21.15.78:0/298068543 >> v2:172.21.15.187:3300/0 conn(0x7f3824072010 msgr2=0x7f3824146370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T17:35:07.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:07.043+0000 7f3828d39640 1 --2- 172.21.15.78:0/298068543 >> v2:172.21.15.187:3300/0 conn(0x7f3824072010 0x7f3824146370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:07.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:07.043+0000 7f3828d39640 1 -- 172.21.15.78:0/298068543 >> v1:172.21.15.187:6789/0 conn(0x7f38241468b0 legacy=0x7f38240b1f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:35:07.051 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:07.043+0000 7f3828d39640 1 -- 172.21.15.78:0/298068543 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f382406d8d0 con 0x7f38240716f0 2023-12-12T17:35:07.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:07.043+0000 7f3823fff640 1 --2- 172.21.15.78:0/298068543 >> v2:172.21.15.187:3300/0 conn(0x7f3824072010 0x7f3824146370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-12T17:35:07.053 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:07.047+0000 7f3828d39640 1 --2- 172.21.15.78:0/298068543 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f38240716f0 0x7f3824071ad0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f3814009e50 tx=0x7f381401c950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b424dd4aefe8a20 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T17:35:07.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:07.047+0000 7f38237fe640 1 -- 172.21.15.78:0/298068543 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38140a5810 con 0x7f38240716f0 2023-12-12T17:35:07.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:07.047+0000 7f38237fe640 1 -- 172.21.15.78:0/298068543 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38140a5970 con 0x7f38240716f0 2023-12-12T17:35:07.054 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:07.047+0000 7f38237fe640 1 -- 172.21.15.78:0/298068543 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38140a5d00 con 0x7f38240716f0 2023-12-12T17:35:07.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:07.047+0000 7f382af9d640 1 -- 172.21.15.78:0/298068543 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f38240716f0 msgr2=0x7f3824071ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:35:07.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:07.047+0000 7f382af9d640 1 --2- 172.21.15.78:0/298068543 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f38240716f0 0x7f3824071ad0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f3814009e50 tx=0x7f381401c950 comp rx=0 tx=0).stop 2023-12-12T17:35:07.055 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:07.047+0000 7f382af9d640 1 -- 172.21.15.78:0/298068543 shutdown_connections 2023-12-12T17:35:07.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:07.047+0000 7f382af9d640 1 --2- 172.21.15.78:0/298068543 >> v2:172.21.15.187:3300/0 conn(0x7f3824072010 0x7f3824146370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:07.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:07.047+0000 7f382af9d640 1 --2- 172.21.15.78:0/298068543 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f38240716f0 0x7f3824071ad0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:07.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:07.047+0000 7f382af9d640 1 -- 172.21.15.78:0/298068543 >> 172.21.15.78:0/298068543 conn(0x7f382406a710 msgr2=0x7f382406ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T17:35:07.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:07.047+0000 7f382af9d640 1 -- 172.21.15.78:0/298068543 shutdown_connections 2023-12-12T17:35:07.056 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:07.047+0000 7f382af9d640 1 -- 172.21.15.78:0/298068543 wait complete. 2023-12-12T17:35:07.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:07.051+0000 7f382af9d640 1 Processor -- start 2023-12-12T17:35:07.060 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:07.051+0000 7f382af9d640 1 -- start start 2023-12-12T17:35:07.063 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:07.055+0000 7f382af9d640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f38240716f0 0x7f382412d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:35:07.063 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:07.055+0000 7f382af9d640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3824072010 0x7f3824160330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:35:07.063 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:07.055+0000 7f382af9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f38241468b0 0x7f3824141d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:35:07.063 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:07.055+0000 7f382af9d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38241648d0 con 0x7f38241468b0 2023-12-12T17:35:07.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:07.055+0000 7f382af9d640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3824164bb0 con 0x7f3824072010 2023-12-12T17:35:07.064 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:07.055+0000 7f382af9d640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3824164e90 con 0x7f38240716f0 2023-12-12T17:35:07.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:07.055+0000 7f382953a640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f38241468b0 0x7f3824141d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:35:07.065 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:07.055+0000 7f3828d39640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f38240716f0 0x7f382412d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:35:07.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:07.055+0000 7f3828d39640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f38240716f0 0x7f382412d230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.78:58892/0 (socket says 172.21.15.78:58892) 2023-12-12T17:35:07.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:07.055+0000 7f3828d39640 1 -- 172.21.15.78:0/3681031345 learned_addr learned my addr 172.21.15.78:0/3681031345 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T17:35:07.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:07.055+0000 7f3823fff640 1 --2- 172.21.15.78:0/3681031345 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3824072010 0x7f3824160330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:35:07.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:07.055+0000 7f3828d39640 1 -- 172.21.15.78:0/3681031345 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3824072010 msgr2=0x7f3824160330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:35:07.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:07.055+0000 7f3828d39640 1 --2- 172.21.15.78:0/3681031345 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3824072010 0x7f3824160330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:07.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:07.059+0000 7f3828d39640 1 -- 172.21.15.78:0/3681031345 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f38241468b0 msgr2=0x7f3824141d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:35:07.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:07.059+0000 7f3828d39640 1 --2- 172.21.15.78:0/3681031345 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f38241468b0 0x7f3824141d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:07.066 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:07.059+0000 7f3828d39640 1 -- 172.21.15.78:0/3681031345 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f380c009420 con 0x7f38240716f0 2023-12-12T17:35:07.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:07.059+0000 7f3823fff640 1 --2- 172.21.15.78:0/3681031345 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3824072010 0x7f3824160330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T17:35:07.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:07.059+0000 7f3828d39640 1 --2- 172.21.15.78:0/3681031345 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f38240716f0 0x7f382412d230 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f381401a580 tx=0x7f38140196f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T17:35:07.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:07.059+0000 7f38217fa640 1 -- 172.21.15.78:0/3681031345 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38140b8670 con 0x7f38240716f0 2023-12-12T17:35:07.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:07.059+0000 7f38217fa640 1 -- 172.21.15.78:0/3681031345 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38140b87d0 con 0x7f38240716f0 2023-12-12T17:35:07.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:07.059+0000 7f38217fa640 1 -- 172.21.15.78:0/3681031345 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38140b8b80 con 0x7f38240716f0 2023-12-12T17:35:07.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:07.059+0000 7f382af9d640 1 -- 172.21.15.78:0/3681031345 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3814009b30 con 0x7f38240716f0 2023-12-12T17:35:07.067 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:07.059+0000 7f382af9d640 1 -- 172.21.15.78:0/3681031345 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3824142650 con 0x7f38240716f0 2023-12-12T17:35:07.068 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:07.059+0000 7f382af9d640 1 -- 172.21.15.78:0/3681031345 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38240671f0 con 0x7f38240716f0 2023-12-12T17:35:07.071 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:07.063+0000 7f38217fa640 1 -- 172.21.15.78:0/3681031345 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f38140b8ce0 con 0x7f38240716f0 2023-12-12T17:35:07.075 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:07.067+0000 7f38217fa640 1 --2- 172.21.15.78:0/3681031345 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f3804066470 0x7f3804068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:35:07.076 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:07.067+0000 7f38217fa640 1 -- 172.21.15.78:0/3681031345 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f381411f250 con 0x7f38240716f0 2023-12-12T17:35:07.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:07.071+0000 7f3823fff640 1 --2- 172.21.15.78:0/3681031345 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f3804066470 0x7f3804068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:35:07.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:07.071+0000 7f3823fff640 1 --2- 172.21.15.78:0/3681031345 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f3804066470 0x7f3804068930 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f38241412f0 tx=0x7f380c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T17:35:07.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:07.071+0000 7f38217fa640 1 -- 172.21.15.78:0/3681031345 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f38140ec910 con 0x7f38240716f0 2023-12-12T17:35:07.553 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:07.547+0000 7f382af9d640 1 -- 172.21.15.78:0/3681031345 --> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f38240725c0 con 0x7f3804066470 2023-12-12T17:35:07.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:07.547+0000 7f38217fa640 1 -- 172.21.15.78:0/3681031345 <== mgr.4104 v2:172.21.15.78:6832/1725498448 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f38240725c0 con 0x7f3804066470 2023-12-12T17:35:07.555 INFO:teuthology.orchestra.run.smithi078.stderr:instructed osd(s) 2 to deep-scrub 2023-12-12T17:35:07.559 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:07.551+0000 7f382af9d640 1 -- 172.21.15.78:0/3681031345 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f3804066470 msgr2=0x7f3804068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:35:07.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:07.551+0000 7f382af9d640 1 --2- 172.21.15.78:0/3681031345 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f3804066470 0x7f3804068930 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f38241412f0 tx=0x7f380c008040 comp rx=0 tx=0).stop 2023-12-12T17:35:07.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:07.551+0000 7f382af9d640 1 -- 172.21.15.78:0/3681031345 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f38240716f0 msgr2=0x7f382412d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:35:07.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:07.551+0000 7f382af9d640 1 --2- 172.21.15.78:0/3681031345 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f38240716f0 0x7f382412d230 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f381401a580 tx=0x7f38140196f0 comp rx=0 tx=0).stop 2023-12-12T17:35:07.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:07.551+0000 7f382af9d640 1 -- 172.21.15.78:0/3681031345 shutdown_connections 2023-12-12T17:35:07.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:07.551+0000 7f382af9d640 1 --2- 172.21.15.78:0/3681031345 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f3804066470 0x7f3804068930 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:07.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:07.551+0000 7f382af9d640 1 --2- 172.21.15.78:0/3681031345 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f38241468b0 0x7f3824141d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:07.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:07.551+0000 7f382af9d640 1 --2- 172.21.15.78:0/3681031345 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3824072010 0x7f3824160330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:07.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:07.551+0000 7f382af9d640 1 --2- 172.21.15.78:0/3681031345 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f38240716f0 0x7f382412d230 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:07.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:07.551+0000 7f382af9d640 1 -- 172.21.15.78:0/3681031345 >> 172.21.15.78:0/3681031345 conn(0x7f382406a710 msgr2=0x7f3824160ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T17:35:07.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:07.551+0000 7f382af9d640 1 -- 172.21.15.78:0/3681031345 shutdown_connections 2023-12-12T17:35:07.562 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:07.555+0000 7f382af9d640 1 -- 172.21.15.78:0/3681031345 wait complete. 2023-12-12T17:35:07.605 INFO:tasks.ceph:Scrubbing osd.3 2023-12-12T17:35:07.606 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-12-12T17:35:08.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.003+0000 7fb78aff8640 1 Processor -- start 2023-12-12T17:35:08.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.003+0000 7fb78aff8640 1 -- start start 2023-12-12T17:35:08.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.007+0000 7fb78aff8640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb7840cf860 0x7fb7840cfcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:35:08.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.007+0000 7fb78aff8640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fb7840c71f0 0x7fb7840c7680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:35:08.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.007+0000 7fb78aff8640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7840d01f0 con 0x7fb78415d100 2023-12-12T17:35:08.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.007+0000 7fb78aff8640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7840c6d10 con 0x7fb7840cf860 2023-12-12T17:35:08.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.007+0000 7fb78aff8640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7840d1fd0 con 0x7fb7840c71f0 2023-12-12T17:35:08.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.007+0000 7fb783fff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb7840cf860 0x7fb7840cfcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:35:08.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.007+0000 7fb783fff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb7840cf860 0x7fb7840cfcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:45078/0 (socket says 172.21.15.78:45078) 2023-12-12T17:35:08.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.007+0000 7fb783fff640 1 -- 172.21.15.78:0/230289645 learned_addr learned my addr 172.21.15.78:0/230289645 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T17:35:08.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.007+0000 7fb789595640 1 --2- 172.21.15.78:0/230289645 >> v2:172.21.15.187:3300/0 conn(0x7fb7840c71f0 0x7fb7840c7680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:35:08.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.007+0000 7fb788d94640 1 --1- 172.21.15.78:0/230289645 >> v1:172.21.15.187:6789/0 conn(0x7fb78415d100 0x7fb7840d3730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.78:40402/0 (socket says 172.21.15.78:40402) 2023-12-12T17:35:08.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.007+0000 7fb783fff640 1 -- 172.21.15.78:0/230289645 >> v2:172.21.15.187:3300/0 conn(0x7fb7840c71f0 msgr2=0x7fb7840c7680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T17:35:08.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.007+0000 7fb783fff640 1 --2- 172.21.15.78:0/230289645 >> v2:172.21.15.187:3300/0 conn(0x7fb7840c71f0 0x7fb7840c7680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:08.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.007+0000 7fb783fff640 1 -- 172.21.15.78:0/230289645 >> v1:172.21.15.187:6789/0 conn(0x7fb78415d100 legacy=0x7fb7840d3730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:35:08.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.007+0000 7fb783fff640 1 -- 172.21.15.78:0/230289645 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7840d1730 con 0x7fb7840cf860 2023-12-12T17:35:08.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.015+0000 7fb783fff640 1 --2- 172.21.15.78:0/230289645 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb7840cf860 0x7fb7840cfcb0 secure :-1 s=READY pgs=2132 cs=0 l=1 rev1=1 crypto rx=0x7fb770009870 tx=0x7fb77001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e95f79cf5104197 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T17:35:08.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.015+0000 7fb7837fe640 1 -- 172.21.15.78:0/230289645 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7700aa430 con 0x7fb7840cf860 2023-12-12T17:35:08.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.015+0000 7fb7837fe640 1 -- 172.21.15.78:0/230289645 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7700aa590 con 0x7fb7840cf860 2023-12-12T17:35:08.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.015+0000 7fb7837fe640 1 -- 172.21.15.78:0/230289645 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7700aa920 con 0x7fb7840cf860 2023-12-12T17:35:08.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.015+0000 7fb78aff8640 1 -- 172.21.15.78:0/230289645 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb7840cf860 msgr2=0x7fb7840cfcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:35:08.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.015+0000 7fb78aff8640 1 --2- 172.21.15.78:0/230289645 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb7840cf860 0x7fb7840cfcb0 secure :-1 s=READY pgs=2132 cs=0 l=1 rev1=1 crypto rx=0x7fb770009870 tx=0x7fb77001c4d0 comp rx=0 tx=0).stop 2023-12-12T17:35:08.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.015+0000 7fb78aff8640 1 -- 172.21.15.78:0/230289645 shutdown_connections 2023-12-12T17:35:08.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.015+0000 7fb78aff8640 1 --2- 172.21.15.78:0/230289645 >> v2:172.21.15.187:3300/0 conn(0x7fb7840c71f0 0x7fb7840c7680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:08.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.015+0000 7fb78aff8640 1 --2- 172.21.15.78:0/230289645 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb7840cf860 0x7fb7840cfcb0 unknown :-1 s=CLOSED pgs=2132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:08.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.015+0000 7fb78aff8640 1 -- 172.21.15.78:0/230289645 >> 172.21.15.78:0/230289645 conn(0x7fb78409c360 msgr2=0x7fb7840d3020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T17:35:08.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.015+0000 7fb78aff8640 1 -- 172.21.15.78:0/230289645 shutdown_connections 2023-12-12T17:35:08.025 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.015+0000 7fb78aff8640 1 -- 172.21.15.78:0/230289645 wait complete. 2023-12-12T17:35:08.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.023+0000 7fb78aff8640 1 Processor -- start 2023-12-12T17:35:08.028 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.023+0000 7fb78aff8640 1 -- start start 2023-12-12T17:35:08.031 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.023+0000 7fb78aff8640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb7840c71f0 0x7fb78414fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:35:08.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.023+0000 7fb78aff8640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb7840cf860 0x7fb78415c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:35:08.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.023+0000 7fb78aff8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb78415d100 0x7fb78415c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:35:08.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.023+0000 7fb78aff8640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb78414f950 con 0x7fb78415d100 2023-12-12T17:35:08.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.023+0000 7fb78aff8640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7841514d0 con 0x7fb7840cf860 2023-12-12T17:35:08.032 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.023+0000 7fb78aff8640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7841508c0 con 0x7fb7840c71f0 2023-12-12T17:35:08.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.023+0000 7fb789595640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb78415d100 0x7fb78415c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:35:08.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.023+0000 7fb788d94640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb7840c71f0 0x7fb78414fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:35:08.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.027+0000 7fb788d94640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb7840c71f0 0x7fb78414fb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.78:58896/0 (socket says 172.21.15.78:58896) 2023-12-12T17:35:08.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.027+0000 7fb788d94640 1 -- 172.21.15.78:0/3765413545 learned_addr learned my addr 172.21.15.78:0/3765413545 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T17:35:08.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.027+0000 7fb783fff640 1 --2- 172.21.15.78:0/3765413545 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb7840cf860 0x7fb78415c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:35:08.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.027+0000 7fb788d94640 1 -- 172.21.15.78:0/3765413545 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb7840cf860 msgr2=0x7fb78415c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:35:08.033 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.027+0000 7fb788d94640 1 --2- 172.21.15.78:0/3765413545 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb7840cf860 0x7fb78415c000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:08.034 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.027+0000 7fb788d94640 1 -- 172.21.15.78:0/3765413545 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb78415d100 msgr2=0x7fb78415c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:35:08.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.027+0000 7fb788d94640 1 --2- 172.21.15.78:0/3765413545 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb78415d100 0x7fb78415c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:08.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.027+0000 7fb788d94640 1 -- 172.21.15.78:0/3765413545 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7700094d0 con 0x7fb7840c71f0 2023-12-12T17:35:08.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.027+0000 7fb788d94640 1 --2- 172.21.15.78:0/3765413545 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb7840c71f0 0x7fb78414fb30 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fb77800c430 tx=0x7fb77800c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T17:35:08.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.027+0000 7fb7817fa640 1 -- 172.21.15.78:0/3765413545 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7780074e0 con 0x7fb7840c71f0 2023-12-12T17:35:08.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.027+0000 7fb7817fa640 1 -- 172.21.15.78:0/3765413545 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb778007640 con 0x7fb7840c71f0 2023-12-12T17:35:08.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.027+0000 7fb78aff8640 1 -- 172.21.15.78:0/3765413545 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb784150ba0 con 0x7fb7840c71f0 2023-12-12T17:35:08.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.027+0000 7fb7817fa640 1 -- 172.21.15.78:0/3765413545 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb778004a10 con 0x7fb7840c71f0 2023-12-12T17:35:08.035 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.027+0000 7fb78aff8640 1 -- 172.21.15.78:0/3765413545 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb784151160 con 0x7fb7840c71f0 2023-12-12T17:35:08.036 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.027+0000 7fb78aff8640 1 -- 172.21.15.78:0/3765413545 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb7840b4290 con 0x7fb7840c71f0 2023-12-12T17:35:08.037 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.031+0000 7fb7817fa640 1 -- 172.21.15.78:0/3765413545 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb778004b70 con 0x7fb7840c71f0 2023-12-12T17:35:08.039 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.031+0000 7fb7817fa640 1 --2- 172.21.15.78:0/3765413545 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fb7680664a0 0x7fb768068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:35:08.040 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.031+0000 7fb7817fa640 1 -- 172.21.15.78:0/3765413545 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fb778083440 con 0x7fb7840c71f0 2023-12-12T17:35:08.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.031+0000 7fb783fff640 1 --2- 172.21.15.78:0/3765413545 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fb7680664a0 0x7fb768068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:35:08.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.035+0000 7fb7817fa640 1 --2- 172.21.15.78:0/3765413545 >> [v2:172.21.15.78:6817/3750796703,v1:172.21.15.78:6819/3750796703] conn(0x7fb76806c7a0 0x7fb76806ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:35:08.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.035+0000 7fb7817fa640 1 -- 172.21.15.78:0/3765413545 --> [v2:172.21.15.78:6817/3750796703,v1:172.21.15.78:6819/3750796703] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb76806f2b0 con 0x7fb76806c7a0 2023-12-12T17:35:08.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.035+0000 7fb7817fa640 1 -- 172.21.15.78:0/3765413545 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb778085a20 con 0x7fb7840c71f0 2023-12-12T17:35:08.041 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.035+0000 7fb789595640 1 --2- 172.21.15.78:0/3765413545 >> [v2:172.21.15.78:6817/3750796703,v1:172.21.15.78:6819/3750796703] conn(0x7fb76806c7a0 0x7fb76806ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:35:08.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.035+0000 7fb783fff640 1 --2- 172.21.15.78:0/3765413545 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fb7680664a0 0x7fb768068960 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fb7700ae000 tx=0x7fb7700b5040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T17:35:08.042 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.035+0000 7fb789595640 1 --2- 172.21.15.78:0/3765413545 >> [v2:172.21.15.78:6817/3750796703,v1:172.21.15.78:6819/3750796703] conn(0x7fb76806c7a0 0x7fb76806ebe0 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T17:35:08.179 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.171+0000 7fb7817fa640 1 -- 172.21.15.78:0/3765413545 <== osd.3 v2:172.21.15.78:6817/3750796703 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fb76806f2b0 con 0x7fb76806c7a0 2023-12-12T17:35:08.220 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.211+0000 7fb78aff8640 1 -- 172.21.15.78:0/3765413545 --> [v2:172.21.15.78:6817/3750796703,v1:172.21.15.78:6819/3750796703] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fb7840cee00 con 0x7fb76806c7a0 2023-12-12T17:35:08.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.219+0000 7fb7817fa640 1 -- 172.21.15.78:0/3765413545 <== osd.3 v2:172.21.15.78:6817/3750796703 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fb77c00f040 con 0x7fb76806c7a0 2023-12-12T17:35:08.228 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2023-12-12T17:35:08.229 INFO:teuthology.orchestra.run.smithi078.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-12-12T17:35:08.229 INFO:teuthology.orchestra.run.smithi078.stdout:} 2023-12-12T17:35:08.230 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.223+0000 7fb78aff8640 1 -- 172.21.15.78:0/3765413545 >> [v2:172.21.15.78:6817/3750796703,v1:172.21.15.78:6819/3750796703] conn(0x7fb76806c7a0 msgr2=0x7fb76806ebe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:35:08.230 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.223+0000 7fb78aff8640 1 --2- 172.21.15.78:0/3765413545 >> [v2:172.21.15.78:6817/3750796703,v1:172.21.15.78:6819/3750796703] conn(0x7fb76806c7a0 0x7fb76806ebe0 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:08.230 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.223+0000 7fb78aff8640 1 -- 172.21.15.78:0/3765413545 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fb7680664a0 msgr2=0x7fb768068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:35:08.230 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.223+0000 7fb78aff8640 1 --2- 172.21.15.78:0/3765413545 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fb7680664a0 0x7fb768068960 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fb7700ae000 tx=0x7fb7700b5040 comp rx=0 tx=0).stop 2023-12-12T17:35:08.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.223+0000 7fb78aff8640 1 -- 172.21.15.78:0/3765413545 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb7840c71f0 msgr2=0x7fb78414fb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:35:08.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.223+0000 7fb78aff8640 1 --2- 172.21.15.78:0/3765413545 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb7840c71f0 0x7fb78414fb30 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fb77800c430 tx=0x7fb77800c8f0 comp rx=0 tx=0).stop 2023-12-12T17:35:08.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.223+0000 7fb789595640 1 -- 172.21.15.78:0/3765413545 reap_dead start 2023-12-12T17:35:08.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.223+0000 7fb78aff8640 1 -- 172.21.15.78:0/3765413545 shutdown_connections 2023-12-12T17:35:08.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.223+0000 7fb78aff8640 1 -- 172.21.15.78:0/3765413545 >> 172.21.15.78:0/3765413545 conn(0x7fb78409c360 msgr2=0x7fb78406c200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T17:35:08.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.223+0000 7fb78aff8640 1 -- 172.21.15.78:0/3765413545 shutdown_connections 2023-12-12T17:35:08.231 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.223+0000 7fb78aff8640 1 -- 172.21.15.78:0/3765413545 wait complete. 2023-12-12T17:35:08.276 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-12-12T17:35:08.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.475+0000 7ff180878640 1 Processor -- start 2023-12-12T17:35:08.482 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.475+0000 7ff180878640 1 -- start start 2023-12-12T17:35:08.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.479+0000 7ff180878640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7ff17c15cf40 0x7ff17c0ce3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:35:08.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.479+0000 7ff180878640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff17c0d1ac0 0x7ff17c0b2220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:35:08.486 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.479+0000 7ff180878640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff17c0cf400 con 0x7ff17c0ce930 2023-12-12T17:35:08.486 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.479+0000 7ff180878640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff17c0cfff0 con 0x7ff17c0d1ac0 2023-12-12T17:35:08.486 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.479+0000 7ff180878640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff17c0cf650 con 0x7ff17c15cf40 2023-12-12T17:35:08.487 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.479+0000 7ff17ad9d640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7ff17c15cf40 0x7ff17c0ce3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:35:08.487 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.479+0000 7ff17ad9d640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7ff17c15cf40 0x7ff17c0ce3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.78:53486/0 (socket says 172.21.15.78:53486) 2023-12-12T17:35:08.487 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.479+0000 7ff17ad9d640 1 -- 172.21.15.78:0/3137177750 learned_addr learned my addr 172.21.15.78:0/3137177750 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T17:35:08.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.479+0000 7ff17b59e640 1 --2- 172.21.15.78:0/3137177750 >> v2:172.21.15.78:3300/0 conn(0x7ff17c0d1ac0 0x7ff17c0b2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:35:08.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.479+0000 7ff17ad9d640 1 -- 172.21.15.78:0/3137177750 >> v2:172.21.15.78:3300/0 conn(0x7ff17c0d1ac0 msgr2=0x7ff17c0b2220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T17:35:08.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.479+0000 7ff17ad9d640 1 --2- 172.21.15.78:0/3137177750 >> v2:172.21.15.78:3300/0 conn(0x7ff17c0d1ac0 0x7ff17c0b2220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:08.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.479+0000 7ff17ad9d640 1 -- 172.21.15.78:0/3137177750 >> v1:172.21.15.187:6789/0 conn(0x7ff17c0ce930 legacy=0x7ff17c0d13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T17:35:08.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.479+0000 7ff17ad9d640 1 -- 172.21.15.78:0/3137177750 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff17c0cf930 con 0x7ff17c15cf40 2023-12-12T17:35:08.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.479+0000 7ff17b59e640 1 --2- 172.21.15.78:0/3137177750 >> v2:172.21.15.78:3300/0 conn(0x7ff17c0d1ac0 0x7ff17c0b2220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T17:35:08.490 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.483+0000 7ff17ad9d640 1 --2- 172.21.15.78:0/3137177750 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff17c15cf40 0x7ff17c0ce3f0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7ff16c009870 tx=0x7ff16c01c440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b0c3361cfd213de3 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T17:35:08.490 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.483+0000 7ff179d9b640 1 -- 172.21.15.78:0/3137177750 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff16c0ab660 con 0x7ff17c15cf40 2023-12-12T17:35:08.490 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.483+0000 7ff179d9b640 1 -- 172.21.15.78:0/3137177750 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff16c0ab7c0 con 0x7ff17c15cf40 2023-12-12T17:35:08.491 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.483+0000 7ff179d9b640 1 -- 172.21.15.78:0/3137177750 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff16c0abb50 con 0x7ff17c15cf40 2023-12-12T17:35:08.491 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.483+0000 7ff180878640 1 -- 172.21.15.78:0/3137177750 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff17c15cf40 msgr2=0x7ff17c0ce3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:35:08.491 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.483+0000 7ff180878640 1 --2- 172.21.15.78:0/3137177750 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff17c15cf40 0x7ff17c0ce3f0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7ff16c009870 tx=0x7ff16c01c440 comp rx=0 tx=0).stop 2023-12-12T17:35:08.492 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.483+0000 7ff180878640 1 -- 172.21.15.78:0/3137177750 shutdown_connections 2023-12-12T17:35:08.492 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.483+0000 7ff180878640 1 --2- 172.21.15.78:0/3137177750 >> v2:172.21.15.78:3300/0 conn(0x7ff17c0d1ac0 0x7ff17c0b2220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:08.492 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.483+0000 7ff180878640 1 --2- 172.21.15.78:0/3137177750 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff17c15cf40 0x7ff17c0ce3f0 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:08.492 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.483+0000 7ff180878640 1 -- 172.21.15.78:0/3137177750 >> 172.21.15.78:0/3137177750 conn(0x7ff17c0d2dd0 msgr2=0x7ff17c0d31e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T17:35:08.492 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.483+0000 7ff180878640 1 -- 172.21.15.78:0/3137177750 shutdown_connections 2023-12-12T17:35:08.493 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.483+0000 7ff180878640 1 -- 172.21.15.78:0/3137177750 wait complete. 2023-12-12T17:35:08.496 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.491+0000 7ff180878640 1 Processor -- start 2023-12-12T17:35:08.497 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.491+0000 7ff180878640 1 -- start start 2023-12-12T17:35:08.499 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.491+0000 7ff180878640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff17c0ce930 0x7ff17c0b3de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:35:08.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.491+0000 7ff180878640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff17c0d1ac0 0x7ff17c153870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:35:08.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.491+0000 7ff180878640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff17c15cf40 0x7ff17c15b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:35:08.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.491+0000 7ff180878640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff17c1541a0 con 0x7ff17c15cf40 2023-12-12T17:35:08.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.491+0000 7ff180878640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff17c0b6170 con 0x7ff17c0d1ac0 2023-12-12T17:35:08.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.491+0000 7ff180878640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff17c154710 con 0x7ff17c0ce930 2023-12-12T17:35:08.502 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.491+0000 7ff17ad9d640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff17c0ce930 0x7ff17c0b3de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:35:08.502 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.491+0000 7ff17ad9d640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff17c0ce930 0x7ff17c0b3de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.78:58902/0 (socket says 172.21.15.78:58902) 2023-12-12T17:35:08.502 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.491+0000 7ff17ad9d640 1 -- 172.21.15.78:0/2181384222 learned_addr learned my addr 172.21.15.78:0/2181384222 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T17:35:08.502 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.495+0000 7ff17a59c640 1 --2- 172.21.15.78:0/2181384222 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff17c0d1ac0 0x7ff17c153870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:35:08.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.495+0000 7ff17b59e640 1 --2- 172.21.15.78:0/2181384222 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff17c15cf40 0x7ff17c15b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:35:08.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.495+0000 7ff17ad9d640 1 -- 172.21.15.78:0/2181384222 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff17c0d1ac0 msgr2=0x7ff17c153870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:35:08.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.495+0000 7ff17ad9d640 1 --2- 172.21.15.78:0/2181384222 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff17c0d1ac0 0x7ff17c153870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:08.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.495+0000 7ff17ad9d640 1 -- 172.21.15.78:0/2181384222 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff17c15cf40 msgr2=0x7ff17c15b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:35:08.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.495+0000 7ff17ad9d640 1 --2- 172.21.15.78:0/2181384222 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff17c15cf40 0x7ff17c15b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:08.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.495+0000 7ff17ad9d640 1 -- 172.21.15.78:0/2181384222 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff16c0094d0 con 0x7ff17c0ce930 2023-12-12T17:35:08.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.495+0000 7ff17a59c640 1 --2- 172.21.15.78:0/2181384222 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff17c0d1ac0 0x7ff17c153870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T17:35:08.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.495+0000 7ff17b59e640 1 --2- 172.21.15.78:0/2181384222 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff17c15cf40 0x7ff17c15b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T17:35:08.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.495+0000 7ff17ad9d640 1 --2- 172.21.15.78:0/2181384222 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff17c0ce930 0x7ff17c0b3de0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7ff16c0ad040 tx=0x7ff16c01ac80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T17:35:08.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.495+0000 7ff1637fe640 1 -- 172.21.15.78:0/2181384222 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff16c0b4800 con 0x7ff17c0ce930 2023-12-12T17:35:08.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.495+0000 7ff1637fe640 1 -- 172.21.15.78:0/2181384222 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff16c0b4980 con 0x7ff17c0ce930 2023-12-12T17:35:08.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.495+0000 7ff1637fe640 1 -- 172.21.15.78:0/2181384222 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff16c0b4d30 con 0x7ff17c0ce930 2023-12-12T17:35:08.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.495+0000 7ff180878640 1 -- 172.21.15.78:0/2181384222 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff17c153ec0 con 0x7ff17c0ce930 2023-12-12T17:35:08.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.495+0000 7ff180878640 1 -- 172.21.15.78:0/2181384222 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff17c0b5e00 con 0x7ff17c0ce930 2023-12-12T17:35:08.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.499+0000 7ff1637fe640 1 -- 172.21.15.78:0/2181384222 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff16c0a9070 con 0x7ff17c0ce930 2023-12-12T17:35:08.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.499+0000 7ff180878640 1 -- 172.21.15.78:0/2181384222 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff17c0745a0 con 0x7ff17c0ce930 2023-12-12T17:35:08.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.499+0000 7ff1637fe640 1 --2- 172.21.15.78:0/2181384222 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7ff1680664f0 0x7ff1680689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:35:08.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.499+0000 7ff1637fe640 1 -- 172.21.15.78:0/2181384222 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5263+0+0 (secure 0 0 0) 0x7ff16c11e6d0 con 0x7ff17c0ce930 2023-12-12T17:35:08.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.499+0000 7ff17a59c640 1 --2- 172.21.15.78:0/2181384222 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7ff1680664f0 0x7ff1680689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:35:08.508 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.503+0000 7ff17a59c640 1 --2- 172.21.15.78:0/2181384222 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7ff1680664f0 0x7ff1680689b0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7ff17c0b1810 tx=0x7ff170009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T17:35:08.511 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.503+0000 7ff1637fe640 1 -- 172.21.15.78:0/2181384222 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff16c0ebea0 con 0x7ff17c0ce930 2023-12-12T17:35:08.983 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.975+0000 7ff180878640 1 -- 172.21.15.78:0/2181384222 --> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7ff17c0b62b0 con 0x7ff1680664f0 2023-12-12T17:35:08.985 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.979+0000 7ff1637fe640 1 -- 172.21.15.78:0/2181384222 <== mgr.4104 v2:172.21.15.78:6832/1725498448 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7ff170001cc0 con 0x7ff1680664f0 2023-12-12T17:35:08.985 INFO:teuthology.orchestra.run.smithi078.stderr:instructed osd(s) 3 to deep-scrub 2023-12-12T17:35:08.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.983+0000 7ff180878640 1 -- 172.21.15.78:0/2181384222 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7ff1680664f0 msgr2=0x7ff1680689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:35:08.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.983+0000 7ff180878640 1 --2- 172.21.15.78:0/2181384222 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7ff1680664f0 0x7ff1680689b0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7ff17c0b1810 tx=0x7ff170009040 comp rx=0 tx=0).stop 2023-12-12T17:35:08.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.983+0000 7ff180878640 1 -- 172.21.15.78:0/2181384222 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff17c0ce930 msgr2=0x7ff17c0b3de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:35:08.989 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.983+0000 7ff180878640 1 --2- 172.21.15.78:0/2181384222 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff17c0ce930 0x7ff17c0b3de0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7ff16c0ad040 tx=0x7ff16c01ac80 comp rx=0 tx=0).stop 2023-12-12T17:35:08.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.983+0000 7ff180878640 1 -- 172.21.15.78:0/2181384222 shutdown_connections 2023-12-12T17:35:08.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.983+0000 7ff180878640 1 --2- 172.21.15.78:0/2181384222 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7ff1680664f0 0x7ff1680689b0 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:08.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.983+0000 7ff180878640 1 --2- 172.21.15.78:0/2181384222 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff17c15cf40 0x7ff17c15b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:08.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.983+0000 7ff180878640 1 --2- 172.21.15.78:0/2181384222 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff17c0d1ac0 0x7ff17c153870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:08.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.983+0000 7ff180878640 1 --2- 172.21.15.78:0/2181384222 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff17c0ce930 0x7ff17c0b3de0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:08.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.983+0000 7ff180878640 1 -- 172.21.15.78:0/2181384222 >> 172.21.15.78:0/2181384222 conn(0x7ff17c0d2dd0 msgr2=0x7ff17c06c350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T17:35:08.990 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.983+0000 7ff180878640 1 -- 172.21.15.78:0/2181384222 shutdown_connections 2023-12-12T17:35:08.991 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:08.983+0000 7ff180878640 1 -- 172.21.15.78:0/2181384222 wait complete. 2023-12-12T17:35:09.039 INFO:tasks.ceph:Scrubbing osd.4 2023-12-12T17:35:09.039 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-12-12T17:35:09.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.255+0000 7f16c6438640 1 Processor -- start 2023-12-12T17:35:09.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.255+0000 7f16c6438640 1 -- start start 2023-12-12T17:35:09.266 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.259+0000 7f16c6438640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f16c015cfd0 0x7f16c00cfbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:35:09.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.259+0000 7f16c6438640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f16c006e670 0x7f16c006a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:35:09.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.259+0000 7f16c6438640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16c01610d0 con 0x7f16c0160c40 2023-12-12T17:35:09.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.259+0000 7f16c6438640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16c006a5b0 con 0x7f16c015cfd0 2023-12-12T17:35:09.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.259+0000 7f16c6438640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16c01613b0 con 0x7f16c006e670 2023-12-12T17:35:09.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.259+0000 7f16c5436640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f16c015cfd0 0x7f16c00cfbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:35:09.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.259+0000 7f16c5436640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f16c015cfd0 0x7f16c00cfbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55006/0 (socket says 172.21.15.78:55006) 2023-12-12T17:35:09.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.259+0000 7f16c5436640 1 -- 172.21.15.78:0/1518850841 learned_addr learned my addr 172.21.15.78:0/1518850841 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T17:35:09.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.259+0000 7f16c5c37640 1 --2- 172.21.15.78:0/1518850841 >> v2:172.21.15.187:3300/0 conn(0x7f16c006e670 0x7f16c006a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:35:09.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.259+0000 7f16c5436640 1 -- 172.21.15.78:0/1518850841 >> v2:172.21.15.187:3300/0 conn(0x7f16c006e670 msgr2=0x7f16c006a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T17:35:09.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.259+0000 7f16c5436640 1 --2- 172.21.15.78:0/1518850841 >> v2:172.21.15.187:3300/0 conn(0x7f16c006e670 0x7f16c006a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:09.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.259+0000 7f16c5436640 1 -- 172.21.15.78:0/1518850841 >> v1:172.21.15.187:6789/0 conn(0x7f16c0160c40 legacy=0x7f16c006df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T17:35:09.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.259+0000 7f16c5436640 1 -- 172.21.15.78:0/1518850841 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16c0161690 con 0x7f16c015cfd0 2023-12-12T17:35:09.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.259+0000 7f16c5c37640 1 --2- 172.21.15.78:0/1518850841 >> v2:172.21.15.187:3300/0 conn(0x7f16c006e670 0x7f16c006a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T17:35:09.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.263+0000 7f16c5436640 1 --2- 172.21.15.78:0/1518850841 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f16c015cfd0 0x7f16c00cfbc0 secure :-1 s=READY pgs=2133 cs=0 l=1 rev1=1 crypto rx=0x7f16c0070cf0 tx=0x7f16bc01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ac5b6cec9b3d67c server_cookie=0 in_seq=0 out_seq=0 2023-12-12T17:35:09.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.263+0000 7f16b7fff640 1 -- 172.21.15.78:0/1518850841 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16bc0ac640 con 0x7f16c015cfd0 2023-12-12T17:35:09.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.263+0000 7f16b7fff640 1 -- 172.21.15.78:0/1518850841 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16bc0ac7a0 con 0x7f16c015cfd0 2023-12-12T17:35:09.271 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.263+0000 7f16b7fff640 1 -- 172.21.15.78:0/1518850841 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16bc0acb30 con 0x7f16c015cfd0 2023-12-12T17:35:09.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.267+0000 7f16c6438640 1 -- 172.21.15.78:0/1518850841 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f16c015cfd0 msgr2=0x7f16c00cfbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:35:09.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.267+0000 7f16c6438640 1 --2- 172.21.15.78:0/1518850841 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f16c015cfd0 0x7f16c00cfbc0 secure :-1 s=READY pgs=2133 cs=0 l=1 rev1=1 crypto rx=0x7f16c0070cf0 tx=0x7f16bc01c400 comp rx=0 tx=0).stop 2023-12-12T17:35:09.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.267+0000 7f16c6438640 1 -- 172.21.15.78:0/1518850841 shutdown_connections 2023-12-12T17:35:09.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.267+0000 7f16c6438640 1 --2- 172.21.15.78:0/1518850841 >> v2:172.21.15.187:3300/0 conn(0x7f16c006e670 0x7f16c006a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:09.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.267+0000 7f16c6438640 1 --2- 172.21.15.78:0/1518850841 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f16c015cfd0 0x7f16c00cfbc0 unknown :-1 s=CLOSED pgs=2133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:09.273 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.267+0000 7f16c6438640 1 -- 172.21.15.78:0/1518850841 >> 172.21.15.78:0/1518850841 conn(0x7f16c00b2e30 msgr2=0x7f16c00b4090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T17:35:09.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.267+0000 7f16c6438640 1 -- 172.21.15.78:0/1518850841 shutdown_connections 2023-12-12T17:35:09.274 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.267+0000 7f16c6438640 1 -- 172.21.15.78:0/1518850841 wait complete. 2023-12-12T17:35:09.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.271+0000 7f16c6438640 1 Processor -- start 2023-12-12T17:35:09.278 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.271+0000 7f16c6438640 1 -- start start 2023-12-12T17:35:09.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.275+0000 7f16c6438640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f16c006e670 0x7f16c00b14b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:35:09.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.275+0000 7f16c6438640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f16c015cfd0 0x7f16c01542b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:35:09.281 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.275+0000 7f16c6438640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f16c01547f0 0x7f16c01561a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:35:09.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.275+0000 7f16c6438640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16c0154c80 con 0x7f16c006e670 2023-12-12T17:35:09.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.275+0000 7f16c6438640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16c01575b0 con 0x7f16c01547f0 2023-12-12T17:35:09.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.275+0000 7f16c6438640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16c0156ff0 con 0x7f16c015cfd0 2023-12-12T17:35:09.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.275+0000 7f16c5436640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f16c006e670 0x7f16c00b14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:35:09.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.275+0000 7f16c5436640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f16c006e670 0x7f16c00b14b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55010/0 (socket says 172.21.15.78:55010) 2023-12-12T17:35:09.282 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.275+0000 7f16c5436640 1 -- 172.21.15.78:0/1221470539 learned_addr learned my addr 172.21.15.78:0/1221470539 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T17:35:09.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.275+0000 7f16c5436640 1 -- 172.21.15.78:0/1221470539 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f16c015cfd0 msgr2=0x7f16c01542b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:35:09.283 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.275+0000 7f16c5436640 1 --2- 172.21.15.78:0/1221470539 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f16c015cfd0 0x7f16c01542b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:09.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.275+0000 7f16c5436640 1 -- 172.21.15.78:0/1221470539 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f16c01547f0 msgr2=0x7f16c01561a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:35:09.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.275+0000 7f16c5c37640 1 --2- 172.21.15.78:0/1221470539 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f16c01547f0 0x7f16c01561a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:35:09.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.275+0000 7f16c5436640 1 --2- 172.21.15.78:0/1221470539 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f16c01547f0 0x7f16c01561a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:09.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.275+0000 7f16c5436640 1 -- 172.21.15.78:0/1221470539 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16bc0094d0 con 0x7f16c006e670 2023-12-12T17:35:09.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.275+0000 7f16c5c37640 1 --2- 172.21.15.78:0/1221470539 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f16c01547f0 0x7f16c01561a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T17:35:09.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.275+0000 7f16c5436640 1 --2- 172.21.15.78:0/1221470539 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f16c006e670 0x7f16c00b14b0 secure :-1 s=READY pgs=2134 cs=0 l=1 rev1=1 crypto rx=0x7f16bc01aab0 tx=0x7f16bc0191a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T17:35:09.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.275+0000 7f16b5ffb640 1 -- 172.21.15.78:0/1221470539 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16bc0aa850 con 0x7f16c006e670 2023-12-12T17:35:09.284 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.275+0000 7f16b5ffb640 1 -- 172.21.15.78:0/1221470539 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16bc0aa9f0 con 0x7f16c006e670 2023-12-12T17:35:09.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.275+0000 7f16c6438640 1 -- 172.21.15.78:0/1221470539 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16c01572d0 con 0x7f16c006e670 2023-12-12T17:35:09.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.275+0000 7f16b5ffb640 1 -- 172.21.15.78:0/1221470539 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16bc0aada0 con 0x7f16c006e670 2023-12-12T17:35:09.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.275+0000 7f16c6438640 1 -- 172.21.15.78:0/1221470539 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16c0151040 con 0x7f16c006e670 2023-12-12T17:35:09.285 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.279+0000 7f16c6438640 1 -- 172.21.15.78:0/1221470539 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f16c015d5c0 con 0x7f16c006e670 2023-12-12T17:35:09.288 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.279+0000 7f16b5ffb640 1 -- 172.21.15.78:0/1221470539 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f16bc0b3040 con 0x7f16c006e670 2023-12-12T17:35:09.290 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.283+0000 7f16b5ffb640 1 --2- 172.21.15.78:0/1221470539 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f16a4066470 0x7f16a4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:35:09.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.283+0000 7f16b5ffb640 1 -- 172.21.15.78:0/1221470539 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f16bc11df10 con 0x7f16c006e670 2023-12-12T17:35:09.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.283+0000 7f16c4c35640 1 --2- 172.21.15.78:0/1221470539 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f16a4066470 0x7f16a4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:35:09.291 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.283+0000 7f16b5ffb640 1 --2- 172.21.15.78:0/1221470539 >> [v2:172.21.15.187:6808/2944277204,v1:172.21.15.187:6809/2944277204] conn(0x7f16a406c770 0x7f16a406ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:35:09.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.283+0000 7f16b5ffb640 1 -- 172.21.15.78:0/1221470539 --> [v2:172.21.15.187:6808/2944277204,v1:172.21.15.187:6809/2944277204] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f16a406f280 con 0x7f16a406c770 2023-12-12T17:35:09.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.283+0000 7f16b5ffb640 1 -- 172.21.15.78:0/1221470539 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f16bc1204f0 con 0x7f16c006e670 2023-12-12T17:35:09.292 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.283+0000 7f16c5c37640 1 --2- 172.21.15.78:0/1221470539 >> [v2:172.21.15.187:6808/2944277204,v1:172.21.15.187:6809/2944277204] conn(0x7f16a406c770 0x7f16a406ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:35:09.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.287+0000 7f16c5c37640 1 --2- 172.21.15.78:0/1221470539 >> [v2:172.21.15.187:6808/2944277204,v1:172.21.15.187:6809/2944277204] conn(0x7f16a406c770 0x7f16a406ebb0 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T17:35:09.293 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.287+0000 7f16c4c35640 1 --2- 172.21.15.78:0/1221470539 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f16a4066470 0x7f16a4068930 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f16c006c520 tx=0x7f16b0006bd0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T17:35:09.452 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.443+0000 7f16b5ffb640 1 -- 172.21.15.78:0/1221470539 <== osd.4 v2:172.21.15.187:6808/2944277204 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f16a406f280 con 0x7f16a406c770 2023-12-12T17:35:09.465 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.459+0000 7f16c6438640 1 -- 172.21.15.78:0/1221470539 --> [v2:172.21.15.187:6808/2944277204,v1:172.21.15.187:6809/2944277204] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f16c0074610 con 0x7f16a406c770 2023-12-12T17:35:09.485 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.479+0000 7f16b5ffb640 1 -- 172.21.15.78:0/1221470539 <== osd.4 v2:172.21.15.187:6808/2944277204 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f16c0074610 con 0x7f16a406c770 2023-12-12T17:35:09.486 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2023-12-12T17:35:09.486 INFO:teuthology.orchestra.run.smithi078.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-12-12T17:35:09.486 INFO:teuthology.orchestra.run.smithi078.stdout:} 2023-12-12T17:35:09.487 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.479+0000 7f16c6438640 1 -- 172.21.15.78:0/1221470539 >> [v2:172.21.15.187:6808/2944277204,v1:172.21.15.187:6809/2944277204] conn(0x7f16a406c770 msgr2=0x7f16a406ebb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:35:09.487 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.479+0000 7f16c6438640 1 --2- 172.21.15.78:0/1221470539 >> [v2:172.21.15.187:6808/2944277204,v1:172.21.15.187:6809/2944277204] conn(0x7f16a406c770 0x7f16a406ebb0 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:09.487 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.479+0000 7f16c6438640 1 -- 172.21.15.78:0/1221470539 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f16a4066470 msgr2=0x7f16a4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:35:09.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.479+0000 7f16c6438640 1 --2- 172.21.15.78:0/1221470539 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f16a4066470 0x7f16a4068930 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f16c006c520 tx=0x7f16b0006bd0 comp rx=0 tx=0).stop 2023-12-12T17:35:09.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.479+0000 7f16c6438640 1 -- 172.21.15.78:0/1221470539 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f16c006e670 msgr2=0x7f16c00b14b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:35:09.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.479+0000 7f16c6438640 1 --2- 172.21.15.78:0/1221470539 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f16c006e670 0x7f16c00b14b0 secure :-1 s=READY pgs=2134 cs=0 l=1 rev1=1 crypto rx=0x7f16bc01aab0 tx=0x7f16bc0191a0 comp rx=0 tx=0).stop 2023-12-12T17:35:09.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.479+0000 7f16c5c37640 1 -- 172.21.15.78:0/1221470539 reap_dead start 2023-12-12T17:35:09.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.479+0000 7f16c6438640 1 -- 172.21.15.78:0/1221470539 shutdown_connections 2023-12-12T17:35:09.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.479+0000 7f16c6438640 1 -- 172.21.15.78:0/1221470539 >> 172.21.15.78:0/1221470539 conn(0x7f16c00b2e30 msgr2=0x7f16c015abf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T17:35:09.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.479+0000 7f16c6438640 1 -- 172.21.15.78:0/1221470539 shutdown_connections 2023-12-12T17:35:09.488 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.479+0000 7f16c6438640 1 -- 172.21.15.78:0/1221470539 wait complete. 2023-12-12T17:35:09.511 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-12-12T17:35:09.716 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.711+0000 7fe78b0f5640 1 Processor -- start 2023-12-12T17:35:09.717 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.711+0000 7fe78b0f5640 1 -- start start 2023-12-12T17:35:09.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.715+0000 7fe78b0f5640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe7840d3a20 0x7fe7840d1930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:35:09.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.715+0000 7fe78b0f5640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fe78415d450 0x7fe784160e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:35:09.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.715+0000 7fe78b0f5640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7840ceb30 con 0x7fe78415d070 2023-12-12T17:35:09.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.715+0000 7fe78b0f5640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7840d1e70 con 0x7fe78415d450 2023-12-12T17:35:09.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.715+0000 7fe78b0f5640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7840d0b70 con 0x7fe7840d3a20 2023-12-12T17:35:09.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.715+0000 7fe78a0f3640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fe78415d070 0x7fe7840ce420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:50718/0 (socket says 172.21.15.78:50718) 2023-12-12T17:35:09.723 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.715+0000 7fe78a0f3640 1 -- 172.21.15.78:0/2217064383 learned_addr learned my addr 172.21.15.78:0/2217064383 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-12-12T17:35:09.724 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.715+0000 7fe78a8f4640 1 --2- 172.21.15.78:0/2217064383 >> v2:172.21.15.78:3300/0 conn(0x7fe78415d450 0x7fe784160e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:35:09.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.715+0000 7fe7898f2640 1 --2- 172.21.15.78:0/2217064383 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe7840d3a20 0x7fe7840d1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:35:09.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.715+0000 7fe7890f1640 1 -- 172.21.15.78:0/2217064383 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2017401995 0 0) 0x7fe7840ceb30 con 0x7fe78415d070 2023-12-12T17:35:09.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.715+0000 7fe7890f1640 1 -- 172.21.15.78:0/2217064383 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe770003530 con 0x7fe78415d070 2023-12-12T17:35:09.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.715+0000 7fe7890f1640 1 -- 172.21.15.78:0/2217064383 <== mon.0 v1:172.21.15.78:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4096153488 0 0) 0x7fe770003530 con 0x7fe78415d070 2023-12-12T17:35:09.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.715+0000 7fe7890f1640 1 -- 172.21.15.78:0/2217064383 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe7840d3a20 msgr2=0x7fe7840d1930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T17:35:09.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.715+0000 7fe7890f1640 1 --2- 172.21.15.78:0/2217064383 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe7840d3a20 0x7fe7840d1930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:09.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.719+0000 7fe7890f1640 1 -- 172.21.15.78:0/2217064383 >> v2:172.21.15.78:3300/0 conn(0x7fe78415d450 msgr2=0x7fe784160e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T17:35:09.725 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.719+0000 7fe7890f1640 1 --2- 172.21.15.78:0/2217064383 >> v2:172.21.15.78:3300/0 conn(0x7fe78415d450 0x7fe784160e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:09.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.719+0000 7fe7890f1640 1 -- 172.21.15.78:0/2217064383 --> v1:172.21.15.78:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7840d0e50 con 0x7fe78415d070 2023-12-12T17:35:09.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.719+0000 7fe7890f1640 1 -- 172.21.15.78:0/2217064383 <== mon.0 v1:172.21.15.78:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 465499599 0 0) 0x7fe780001680 con 0x7fe78415d070 2023-12-12T17:35:09.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.719+0000 7fe7890f1640 1 -- 172.21.15.78:0/2217064383 >> v1:172.21.15.78:6789/0 conn(0x7fe78415d070 legacy=0x7fe7840ce420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:35:09.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.719+0000 7fe7890f1640 1 --2- 172.21.15.78:0/2217064383 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe770003980 0x7fe770003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:35:09.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.719+0000 7fe7890f1640 1 --2- 172.21.15.78:0/2217064383 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe7840d3a20 0x7fe7700047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:35:09.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.719+0000 7fe7890f1640 1 --2- 172.21.15.78:0/2217064383 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe770004d10 0x7fe770005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:35:09.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.719+0000 7fe7890f1640 1 -- 172.21.15.78:0/2217064383 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7840d1e70 con 0x7fe770003980 2023-12-12T17:35:09.726 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.719+0000 7fe7890f1640 1 -- 172.21.15.78:0/2217064383 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7840d0b70 con 0x7fe770004d10 2023-12-12T17:35:09.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.719+0000 7fe7890f1640 1 -- 172.21.15.78:0/2217064383 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe77000b990 con 0x7fe7840d3a20 2023-12-12T17:35:09.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.719+0000 7fe78a0f3640 1 --2- 172.21.15.78:0/2217064383 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe770003980 0x7fe770003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:35:09.727 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.719+0000 7fe78a8f4640 1 --2- 172.21.15.78:0/2217064383 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe770004d10 0x7fe770005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:35:09.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.719+0000 7fe7898f2640 1 --2- 172.21.15.78:0/2217064383 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe7840d3a20 0x7fe7700047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:35:09.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.719+0000 7fe78a0f3640 1 -- 172.21.15.78:0/2217064383 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe7840d3a20 msgr2=0x7fe7700047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T17:35:09.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.719+0000 7fe78a0f3640 1 --2- 172.21.15.78:0/2217064383 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe7840d3a20 0x7fe7700047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:09.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.719+0000 7fe78a0f3640 1 -- 172.21.15.78:0/2217064383 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe770004d10 msgr2=0x7fe770005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T17:35:09.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.719+0000 7fe78a0f3640 1 --2- 172.21.15.78:0/2217064383 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe770004d10 0x7fe770005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:09.728 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.719+0000 7fe78a0f3640 1 -- 172.21.15.78:0/2217064383 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7840d0e50 con 0x7fe770003980 2023-12-12T17:35:09.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.723+0000 7fe78a0f3640 1 --2- 172.21.15.78:0/2217064383 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe770003980 0x7fe770003da0 secure :-1 s=READY pgs=2136 cs=0 l=1 rev1=1 crypto rx=0x7fe78000c260 tx=0x7fe78001cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25f06a62fdf013d5 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T17:35:09.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.723+0000 7fe7890f1640 1 -- 172.21.15.78:0/2217064383 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7800058e0 con 0x7fe770003980 2023-12-12T17:35:09.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.723+0000 7fe7890f1640 1 -- 172.21.15.78:0/2217064383 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe780005a40 con 0x7fe770003980 2023-12-12T17:35:09.729 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.723+0000 7fe7890f1640 1 -- 172.21.15.78:0/2217064383 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe780005dd0 con 0x7fe770003980 2023-12-12T17:35:09.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.723+0000 7fe78b0f5640 1 -- 172.21.15.78:0/2217064383 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe770003980 msgr2=0x7fe770003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:35:09.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.723+0000 7fe78b0f5640 1 --2- 172.21.15.78:0/2217064383 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe770003980 0x7fe770003da0 secure :-1 s=READY pgs=2136 cs=0 l=1 rev1=1 crypto rx=0x7fe78000c260 tx=0x7fe78001cc30 comp rx=0 tx=0).stop 2023-12-12T17:35:09.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.723+0000 7fe78a8f4640 1 -- 172.21.15.78:0/2217064383 reap_dead start 2023-12-12T17:35:09.731 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.723+0000 7fe78b0f5640 1 -- 172.21.15.78:0/2217064383 shutdown_connections 2023-12-12T17:35:09.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.723+0000 7fe78b0f5640 1 -- 172.21.15.78:0/2217064383 >> 172.21.15.78:0/2217064383 conn(0x7fe7840d2e00 msgr2=0x7fe7840d3210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T17:35:09.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.723+0000 7fe78b0f5640 1 -- 172.21.15.78:0/2217064383 shutdown_connections 2023-12-12T17:35:09.732 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.723+0000 7fe78b0f5640 1 -- 172.21.15.78:0/2217064383 wait complete. 2023-12-12T17:35:09.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.731+0000 7fe78b0f5640 1 Processor -- start 2023-12-12T17:35:09.736 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.731+0000 7fe78b0f5640 1 -- start start 2023-12-12T17:35:09.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.731+0000 7fe78b0f5640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe770003980 0x7fe7840c9650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:35:09.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.731+0000 7fe78b0f5640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe784153060 0x7fe7840cf5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:35:09.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.731+0000 7fe78b0f5640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe7841534e0 0x7fe7840cfae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:35:09.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.731+0000 7fe78b0f5640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe784152320 con 0x7fe7841534e0 2023-12-12T17:35:09.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.731+0000 7fe78b0f5640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7841525a0 con 0x7fe784153060 2023-12-12T17:35:09.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.731+0000 7fe78b0f5640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7841f7150 con 0x7fe770003980 2023-12-12T17:35:09.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.731+0000 7fe78a0f3640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe770003980 0x7fe7840c9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:35:09.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.731+0000 7fe78a0f3640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe770003980 0x7fe7840c9650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.78:54198/0 (socket says 172.21.15.78:54198) 2023-12-12T17:35:09.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.731+0000 7fe78a0f3640 1 -- 172.21.15.78:0/283873733 learned_addr learned my addr 172.21.15.78:0/283873733 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T17:35:09.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.731+0000 7fe78a8f4640 1 --2- 172.21.15.78:0/283873733 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe7841534e0 0x7fe7840cfae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:35:09.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.731+0000 7fe7898f2640 1 --2- 172.21.15.78:0/283873733 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe784153060 0x7fe7840cf5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:35:09.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.731+0000 7fe78a0f3640 1 -- 172.21.15.78:0/283873733 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe784153060 msgr2=0x7fe7840cf5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:35:09.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.731+0000 7fe78a0f3640 1 --2- 172.21.15.78:0/283873733 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe784153060 0x7fe7840cf5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:09.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.731+0000 7fe78a0f3640 1 -- 172.21.15.78:0/283873733 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe7841534e0 msgr2=0x7fe7840cfae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:35:09.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.731+0000 7fe78a0f3640 1 --2- 172.21.15.78:0/283873733 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe7841534e0 0x7fe7840cfae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:09.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.731+0000 7fe78a0f3640 1 -- 172.21.15.78:0/283873733 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe784152860 con 0x7fe770003980 2023-12-12T17:35:09.742 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.731+0000 7fe78a8f4640 1 --2- 172.21.15.78:0/283873733 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe7841534e0 0x7fe7840cfae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T17:35:09.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.735+0000 7fe78a0f3640 1 --2- 172.21.15.78:0/283873733 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe770003980 0x7fe7840c9650 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fe78001ca60 tx=0x7fe770005800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T17:35:09.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.735+0000 7fe77affd640 1 -- 172.21.15.78:0/283873733 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7800a5a20 con 0x7fe770003980 2023-12-12T17:35:09.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.735+0000 7fe77affd640 1 -- 172.21.15.78:0/283873733 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe780005e90 con 0x7fe770003980 2023-12-12T17:35:09.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.735+0000 7fe77affd640 1 -- 172.21.15.78:0/283873733 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7800a5da0 con 0x7fe770003980 2023-12-12T17:35:09.743 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.735+0000 7fe78b0f5640 1 -- 172.21.15.78:0/283873733 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe784152b40 con 0x7fe770003980 2023-12-12T17:35:09.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.735+0000 7fe78b0f5640 1 -- 172.21.15.78:0/283873733 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7840b59c0 con 0x7fe770003980 2023-12-12T17:35:09.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.735+0000 7fe78b0f5640 1 -- 172.21.15.78:0/283873733 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe784152d30 con 0x7fe770003980 2023-12-12T17:35:09.744 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.735+0000 7fe77affd640 1 -- 172.21.15.78:0/283873733 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe7800047f0 con 0x7fe770003980 2023-12-12T17:35:09.745 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.739+0000 7fe77affd640 1 --2- 172.21.15.78:0/283873733 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fe768066470 0x7fe768068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:35:09.745 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.739+0000 7fe77affd640 1 -- 172.21.15.78:0/283873733 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fe78011d6d0 con 0x7fe770003980 2023-12-12T17:35:09.745 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.739+0000 7fe7898f2640 1 --2- 172.21.15.78:0/283873733 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fe768066470 0x7fe768068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:35:09.746 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.739+0000 7fe7898f2640 1 --2- 172.21.15.78:0/283873733 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fe768066470 0x7fe768068930 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fe774017f00 tx=0x7fe774008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T17:35:09.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:09.743+0000 7fe77affd640 1 -- 172.21.15.78:0/283873733 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe7800eabe0 con 0x7fe770003980 2023-12-12T17:35:10.220 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.211+0000 7fe78b0f5640 1 -- 172.21.15.78:0/283873733 --> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7fe7840745a0 con 0x7fe768066470 2023-12-12T17:35:10.234 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.227+0000 7fe77affd640 1 -- 172.21.15.78:0/283873733 <== mgr.4104 v2:172.21.15.78:6832/1725498448 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fe7840745a0 con 0x7fe768066470 2023-12-12T17:35:10.234 INFO:teuthology.orchestra.run.smithi078.stderr:instructed osd(s) 4 to deep-scrub 2023-12-12T17:35:10.237 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.231+0000 7fe78b0f5640 1 -- 172.21.15.78:0/283873733 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fe768066470 msgr2=0x7fe768068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:35:10.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.231+0000 7fe78b0f5640 1 --2- 172.21.15.78:0/283873733 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fe768066470 0x7fe768068930 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fe774017f00 tx=0x7fe774008040 comp rx=0 tx=0).stop 2023-12-12T17:35:10.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.231+0000 7fe78b0f5640 1 -- 172.21.15.78:0/283873733 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe770003980 msgr2=0x7fe7840c9650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:35:10.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.231+0000 7fe78b0f5640 1 --2- 172.21.15.78:0/283873733 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe770003980 0x7fe7840c9650 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fe78001ca60 tx=0x7fe770005800 comp rx=0 tx=0).stop 2023-12-12T17:35:10.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.231+0000 7fe78b0f5640 1 -- 172.21.15.78:0/283873733 shutdown_connections 2023-12-12T17:35:10.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.231+0000 7fe78b0f5640 1 --2- 172.21.15.78:0/283873733 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fe768066470 0x7fe768068930 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:10.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.231+0000 7fe78b0f5640 1 --2- 172.21.15.78:0/283873733 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fe7841534e0 0x7fe7840cfae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:10.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.231+0000 7fe78b0f5640 1 --2- 172.21.15.78:0/283873733 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe784153060 0x7fe7840cf5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:10.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.231+0000 7fe78b0f5640 1 --2- 172.21.15.78:0/283873733 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe770003980 0x7fe7840c9650 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:10.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.231+0000 7fe78b0f5640 1 -- 172.21.15.78:0/283873733 >> 172.21.15.78:0/283873733 conn(0x7fe7840d2e00 msgr2=0x7fe784162c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T17:35:10.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.231+0000 7fe78b0f5640 1 -- 172.21.15.78:0/283873733 shutdown_connections 2023-12-12T17:35:10.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.231+0000 7fe78b0f5640 1 -- 172.21.15.78:0/283873733 wait complete. 2023-12-12T17:35:10.269 INFO:tasks.ceph:Scrubbing osd.5 2023-12-12T17:35:10.269 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-12-12T17:35:10.489 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.483+0000 7f4ee5162640 1 Processor -- start 2023-12-12T17:35:10.490 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.483+0000 7f4ee5162640 1 -- start start 2023-12-12T17:35:10.493 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.487+0000 7f4ee5162640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f4ee00cfa00 0x7f4ee00d0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:35:10.493 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.487+0000 7f4ee5162640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f4ee00d13e0 0x7f4ee00b0810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:35:10.493 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.487+0000 7f4ee5162640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ee00b0380 con 0x7f4ee015d380 2023-12-12T17:35:10.493 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.487+0000 7f4ee5162640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ee00afa90 con 0x7f4ee00d13e0 2023-12-12T17:35:10.494 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.487+0000 7f4ee5162640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ee00d1c10 con 0x7f4ee00cfa00 2023-12-12T17:35:10.495 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.487+0000 7f4edffff640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f4ee015d380 0x7f4ee00cf2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:50720/0 (socket says 172.21.15.78:50720) 2023-12-12T17:35:10.495 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.487+0000 7f4edffff640 1 -- 172.21.15.78:0/184303522 learned_addr learned my addr 172.21.15.78:0/184303522 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-12-12T17:35:10.495 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.487+0000 7f4edf7fe640 1 --2- 172.21.15.78:0/184303522 >> v2:172.21.15.187:3300/0 conn(0x7f4ee00cfa00 0x7f4ee00d0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:35:10.495 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.487+0000 7f4ee4961640 1 --2- 172.21.15.78:0/184303522 >> v2:172.21.15.78:3300/0 conn(0x7f4ee00d13e0 0x7f4ee00b0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:35:10.495 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.487+0000 7f4edf7fe640 1 -- 172.21.15.78:0/184303522 >> v2:172.21.15.78:3300/0 conn(0x7f4ee00d13e0 msgr2=0x7f4ee00b0810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T17:35:10.495 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.487+0000 7f4edf7fe640 1 --2- 172.21.15.78:0/184303522 >> v2:172.21.15.78:3300/0 conn(0x7f4ee00d13e0 0x7f4ee00b0810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:10.495 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.487+0000 7f4edf7fe640 1 -- 172.21.15.78:0/184303522 >> v1:172.21.15.78:6789/0 conn(0x7f4ee015d380 legacy=0x7f4ee00cf2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:35:10.495 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.487+0000 7f4edf7fe640 1 -- 172.21.15.78:0/184303522 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ee00afd30 con 0x7f4ee00cfa00 2023-12-12T17:35:10.497 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.491+0000 7f4edf7fe640 1 --2- 172.21.15.78:0/184303522 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4ee00cfa00 0x7f4ee00d0ea0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f4ee00d3d40 tx=0x7f4ed401ec50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9538cf6c3492df79 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T17:35:10.498 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.491+0000 7f4edeffd640 1 -- 172.21.15.78:0/184303522 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ed40a8950 con 0x7f4ee00cfa00 2023-12-12T17:35:10.498 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.491+0000 7f4edeffd640 1 -- 172.21.15.78:0/184303522 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ed40a8ab0 con 0x7f4ee00cfa00 2023-12-12T17:35:10.498 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.491+0000 7f4edeffd640 1 -- 172.21.15.78:0/184303522 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ed40a8e40 con 0x7f4ee00cfa00 2023-12-12T17:35:10.499 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.491+0000 7f4ee5162640 1 -- 172.21.15.78:0/184303522 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4ee00cfa00 msgr2=0x7f4ee00d0ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:35:10.499 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.491+0000 7f4ee5162640 1 --2- 172.21.15.78:0/184303522 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4ee00cfa00 0x7f4ee00d0ea0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f4ee00d3d40 tx=0x7f4ed401ec50 comp rx=0 tx=0).stop 2023-12-12T17:35:10.499 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.491+0000 7f4ee5162640 1 -- 172.21.15.78:0/184303522 shutdown_connections 2023-12-12T17:35:10.499 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.491+0000 7f4ee5162640 1 --2- 172.21.15.78:0/184303522 >> v2:172.21.15.78:3300/0 conn(0x7f4ee00d13e0 0x7f4ee00b0810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:10.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.491+0000 7f4ee5162640 1 --2- 172.21.15.78:0/184303522 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4ee00cfa00 0x7f4ee00d0ea0 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:10.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.491+0000 7f4ee5162640 1 -- 172.21.15.78:0/184303522 >> 172.21.15.78:0/184303522 conn(0x7f4ee00d2de0 msgr2=0x7f4ee00d31f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T17:35:10.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.491+0000 7f4ee5162640 1 -- 172.21.15.78:0/184303522 shutdown_connections 2023-12-12T17:35:10.500 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.491+0000 7f4ee5162640 1 -- 172.21.15.78:0/184303522 wait complete. 2023-12-12T17:35:10.501 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.495+0000 7f4ee5162640 1 Processor -- start 2023-12-12T17:35:10.502 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.495+0000 7f4ee5162640 1 -- start start 2023-12-12T17:35:10.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.495+0000 7f4ee5162640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4ee00cfa00 0x7f4ee00b3520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:35:10.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.495+0000 7f4ee5162640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4ee00d13e0 0x7f4ee00b3a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:35:10.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.495+0000 7f4ee5162640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4ee015d380 0x7f4ee00c7520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:35:10.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.495+0000 7f4ee5162640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ee015ffe0 con 0x7f4ee00cfa00 2023-12-12T17:35:10.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.495+0000 7f4ee5162640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ee01602c0 con 0x7f4ee00d13e0 2023-12-12T17:35:10.503 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.495+0000 7f4ee5162640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ee01605a0 con 0x7f4ee015d380 2023-12-12T17:35:10.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.495+0000 7f4edffff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4ee00cfa00 0x7f4ee00b3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:35:10.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.495+0000 7f4edf7fe640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4ee00d13e0 0x7f4ee00b3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:35:10.504 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.495+0000 7f4ee4961640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4ee015d380 0x7f4ee00c7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:35:10.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.495+0000 7f4ee4961640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4ee015d380 0x7f4ee00c7520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.78:54206/0 (socket says 172.21.15.78:54206) 2023-12-12T17:35:10.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.495+0000 7f4edf7fe640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4ee00d13e0 0x7f4ee00b3a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.78:50762/0 (socket says 172.21.15.78:50762) 2023-12-12T17:35:10.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.495+0000 7f4ee4961640 1 -- 172.21.15.78:0/3867281918 learned_addr learned my addr 172.21.15.78:0/3867281918 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T17:35:10.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.495+0000 7f4ee4961640 1 -- 172.21.15.78:0/3867281918 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4ee00d13e0 msgr2=0x7f4ee00b3a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:35:10.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.495+0000 7f4ee4961640 1 --2- 172.21.15.78:0/3867281918 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4ee00d13e0 0x7f4ee00b3a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:10.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.495+0000 7f4ee4961640 1 -- 172.21.15.78:0/3867281918 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4ee00cfa00 msgr2=0x7f4ee00b3520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:35:10.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.495+0000 7f4ee4961640 1 --2- 172.21.15.78:0/3867281918 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4ee00cfa00 0x7f4ee00b3520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:10.505 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.495+0000 7f4ee4961640 1 -- 172.21.15.78:0/3867281918 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ed4009420 con 0x7f4ee015d380 2023-12-12T17:35:10.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.499+0000 7f4ee4961640 1 --2- 172.21.15.78:0/3867281918 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4ee015d380 0x7f4ee00c7520 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f4ed800efc0 tx=0x7f4ed800c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T17:35:10.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.499+0000 7f4edcff9640 1 -- 172.21.15.78:0/3867281918 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ed8014480 con 0x7f4ee015d380 2023-12-12T17:35:10.506 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.499+0000 7f4edcff9640 1 -- 172.21.15.78:0/3867281918 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ed800f040 con 0x7f4ee015d380 2023-12-12T17:35:10.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.499+0000 7f4ee5162640 1 -- 172.21.15.78:0/3867281918 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ee0160880 con 0x7f4ee015d380 2023-12-12T17:35:10.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.499+0000 7f4edcff9640 1 -- 172.21.15.78:0/3867281918 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ed8014820 con 0x7f4ee015d380 2023-12-12T17:35:10.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.499+0000 7f4ee5162640 1 -- 172.21.15.78:0/3867281918 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ee015fc70 con 0x7f4ee015d380 2023-12-12T17:35:10.507 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.499+0000 7f4ee5162640 1 -- 172.21.15.78:0/3867281918 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4ee0160430 con 0x7f4ee015d380 2023-12-12T17:35:10.512 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.507+0000 7f4edcff9640 1 -- 172.21.15.78:0/3867281918 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4ed8014980 con 0x7f4ee015d380 2023-12-12T17:35:10.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.507+0000 7f4edcff9640 1 --2- 172.21.15.78:0/3867281918 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f4ecc0664a0 0x7f4ecc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:35:10.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.507+0000 7f4edcff9640 1 -- 172.21.15.78:0/3867281918 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f4ed80847f0 con 0x7f4ee015d380 2023-12-12T17:35:10.515 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.507+0000 7f4edffff640 1 --2- 172.21.15.78:0/3867281918 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f4ecc0664a0 0x7f4ecc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:35:10.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.507+0000 7f4edcff9640 1 --2- 172.21.15.78:0/3867281918 >> [v2:172.21.15.187:6800/185858620,v1:172.21.15.187:6801/185858620] conn(0x7f4ecc06c7a0 0x7f4ecc06ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:35:10.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.507+0000 7f4edcff9640 1 -- 172.21.15.78:0/3867281918 --> [v2:172.21.15.187:6800/185858620,v1:172.21.15.187:6801/185858620] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4ecc06f2b0 con 0x7f4ecc06c7a0 2023-12-12T17:35:10.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.507+0000 7f4edcff9640 1 -- 172.21.15.78:0/3867281918 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4ed8086dd0 con 0x7f4ee015d380 2023-12-12T17:35:10.516 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.511+0000 7f4edf7fe640 1 --2- 172.21.15.78:0/3867281918 >> [v2:172.21.15.187:6800/185858620,v1:172.21.15.187:6801/185858620] conn(0x7f4ecc06c7a0 0x7f4ecc06ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:35:10.517 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.511+0000 7f4edffff640 1 --2- 172.21.15.78:0/3867281918 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f4ecc0664a0 0x7f4ecc068960 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f4ed0005890 tx=0x7f4ed0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T17:35:10.517 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.511+0000 7f4edf7fe640 1 --2- 172.21.15.78:0/3867281918 >> [v2:172.21.15.187:6800/185858620,v1:172.21.15.187:6801/185858620] conn(0x7f4ecc06c7a0 0x7f4ecc06ebe0 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T17:35:10.550 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.543+0000 7f4edcff9640 1 -- 172.21.15.78:0/3867281918 <== osd.5 v2:172.21.15.187:6800/185858620 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f4ecc06f2b0 con 0x7f4ecc06c7a0 2023-12-12T17:35:10.588 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.583+0000 7f4ee5162640 1 -- 172.21.15.78:0/3867281918 --> [v2:172.21.15.187:6800/185858620,v1:172.21.15.187:6801/185858620] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f4ee00d1890 con 0x7f4ecc06c7a0 2023-12-12T17:35:10.590 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.583+0000 7f4edcff9640 1 -- 172.21.15.78:0/3867281918 <== osd.5 v2:172.21.15.187:6800/185858620 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f4ed40bb450 con 0x7f4ecc06c7a0 2023-12-12T17:35:10.591 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2023-12-12T17:35:10.591 INFO:teuthology.orchestra.run.smithi078.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-12-12T17:35:10.591 INFO:teuthology.orchestra.run.smithi078.stdout:} 2023-12-12T17:35:10.592 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.583+0000 7f4ee5162640 1 -- 172.21.15.78:0/3867281918 >> [v2:172.21.15.187:6800/185858620,v1:172.21.15.187:6801/185858620] conn(0x7f4ecc06c7a0 msgr2=0x7f4ecc06ebe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:35:10.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.583+0000 7f4ee5162640 1 --2- 172.21.15.78:0/3867281918 >> [v2:172.21.15.187:6800/185858620,v1:172.21.15.187:6801/185858620] conn(0x7f4ecc06c7a0 0x7f4ecc06ebe0 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:10.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.583+0000 7f4ee5162640 1 -- 172.21.15.78:0/3867281918 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f4ecc0664a0 msgr2=0x7f4ecc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:35:10.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.583+0000 7f4ee5162640 1 --2- 172.21.15.78:0/3867281918 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f4ecc0664a0 0x7f4ecc068960 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f4ed0005890 tx=0x7f4ed0009040 comp rx=0 tx=0).stop 2023-12-12T17:35:10.593 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.583+0000 7f4ee5162640 1 -- 172.21.15.78:0/3867281918 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4ee015d380 msgr2=0x7f4ee00c7520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:35:10.594 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.583+0000 7f4ee5162640 1 --2- 172.21.15.78:0/3867281918 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4ee015d380 0x7f4ee00c7520 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f4ed800efc0 tx=0x7f4ed800c490 comp rx=0 tx=0).stop 2023-12-12T17:35:10.594 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.583+0000 7f4ee4961640 1 -- 172.21.15.78:0/3867281918 reap_dead start 2023-12-12T17:35:10.594 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.583+0000 7f4ee5162640 1 -- 172.21.15.78:0/3867281918 shutdown_connections 2023-12-12T17:35:10.594 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.583+0000 7f4ee5162640 1 -- 172.21.15.78:0/3867281918 >> 172.21.15.78:0/3867281918 conn(0x7f4ee00d2de0 msgr2=0x7f4ee0072e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T17:35:10.595 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.583+0000 7f4ee5162640 1 -- 172.21.15.78:0/3867281918 shutdown_connections 2023-12-12T17:35:10.595 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.583+0000 7f4ee5162640 1 -- 172.21.15.78:0/3867281918 wait complete. 2023-12-12T17:35:10.616 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-12-12T17:35:10.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.799+0000 7fc59f4c8640 1 Processor -- start 2023-12-12T17:35:10.808 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.799+0000 7fc59f4c8640 1 -- start start 2023-12-12T17:35:10.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.803+0000 7fc59f4c8640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fc5980d3a20 0x7fc5980d1930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:35:10.811 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.803+0000 7fc59f4c8640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5980ceb30 con 0x7fc59815d450 2023-12-12T17:35:10.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.803+0000 7fc59e4c6640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7fc59815d070 0x7fc5980ce420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.78:36788/0 (socket says 172.21.15.78:36788) 2023-12-12T17:35:10.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.803+0000 7fc59e4c6640 1 -- 172.21.15.78:0/2061598766 learned_addr learned my addr 172.21.15.78:0/2061598766 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-12-12T17:35:10.812 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.803+0000 7fc59dcc5640 1 --2- 172.21.15.78:0/2061598766 >> v2:172.21.15.78:3300/0 conn(0x7fc5980d3a20 0x7fc5980d1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:35:10.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.807+0000 7fc59f4c8640 1 -- 172.21.15.78:0/2061598766 --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5980d0b70 con 0x7fc59815d070 2023-12-12T17:35:10.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.807+0000 7fc59f4c8640 1 -- 172.21.15.78:0/2061598766 --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5980d1e70 con 0x7fc5980d3a20 2023-12-12T17:35:10.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.807+0000 7fc59d4c4640 1 -- 172.21.15.78:0/2061598766 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2920214204 0 0) 0x7fc5980d0b70 con 0x7fc59815d070 2023-12-12T17:35:10.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.807+0000 7fc59d4c4640 1 -- 172.21.15.78:0/2061598766 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc584003530 con 0x7fc59815d070 2023-12-12T17:35:10.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.807+0000 7fc59d4c4640 1 -- 172.21.15.78:0/2061598766 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3292779566 0 0) 0x7fc5980ceb30 con 0x7fc59815d450 2023-12-12T17:35:10.813 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.807+0000 7fc59d4c4640 1 -- 172.21.15.78:0/2061598766 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc5980d0b70 con 0x7fc59815d450 2023-12-12T17:35:10.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.807+0000 7fc59d4c4640 1 -- 172.21.15.78:0/2061598766 <== mon.1 v1:172.21.15.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3571279283 0 0) 0x7fc584003530 con 0x7fc59815d070 2023-12-12T17:35:10.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.807+0000 7fc59d4c4640 1 -- 172.21.15.78:0/2061598766 >> v2:172.21.15.78:3300/0 conn(0x7fc5980d3a20 msgr2=0x7fc5980d1930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T17:35:10.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.807+0000 7fc59d4c4640 1 --2- 172.21.15.78:0/2061598766 >> v2:172.21.15.78:3300/0 conn(0x7fc5980d3a20 0x7fc5980d1930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:10.815 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.807+0000 7fc59d4c4640 1 -- 172.21.15.78:0/2061598766 >> v1:172.21.15.78:6789/0 conn(0x7fc59815d450 legacy=0x7fc598160e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:35:10.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.807+0000 7fc59d4c4640 1 -- 172.21.15.78:0/2061598766 --> v1:172.21.15.187:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5980d0e50 con 0x7fc59815d070 2023-12-12T17:35:10.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.807+0000 7fc59d4c4640 1 -- 172.21.15.78:0/2061598766 <== mon.1 v1:172.21.15.187:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 465499599 0 0) 0x7fc594001680 con 0x7fc59815d070 2023-12-12T17:35:10.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.807+0000 7fc59d4c4640 1 -- 172.21.15.78:0/2061598766 >> v1:172.21.15.187:6789/0 conn(0x7fc59815d070 legacy=0x7fc5980ce420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:35:10.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.807+0000 7fc59d4c4640 1 --2- 172.21.15.78:0/2061598766 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc584003b10 0x7fc584003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:35:10.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.807+0000 7fc59d4c4640 1 --2- 172.21.15.78:0/2061598766 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc5840047d0 0x7fc584004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:35:10.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.807+0000 7fc59d4c4640 1 --2- 172.21.15.78:0/2061598766 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc584005190 0x7fc58400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:35:10.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.807+0000 7fc59d4c4640 1 -- 172.21.15.78:0/2061598766 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5900015e0 con 0x7fc584005190 2023-12-12T17:35:10.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.807+0000 7fc59d4c4640 1 -- 172.21.15.78:0/2061598766 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5980d1e70 con 0x7fc5840047d0 2023-12-12T17:35:10.816 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.807+0000 7fc59d4c4640 1 -- 172.21.15.78:0/2061598766 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc58400c060 con 0x7fc584003b10 2023-12-12T17:35:10.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.807+0000 7fc59ecc7640 1 --2- 172.21.15.78:0/2061598766 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc584005190 0x7fc58400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:35:10.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.807+0000 7fc59dcc5640 1 --2- 172.21.15.78:0/2061598766 >> v2:172.21.15.78:3300/0 conn(0x7fc5980d3a20 0x7fc5980d1930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-12T17:35:10.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.807+0000 7fc59e4c6640 1 --2- 172.21.15.78:0/2061598766 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc584003b10 0x7fc584003ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:35:10.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.807+0000 7fc59ecc7640 1 -- 172.21.15.78:0/2061598766 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc584003b10 msgr2=0x7fc584003ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T17:35:10.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.807+0000 7fc59ecc7640 1 --2- 172.21.15.78:0/2061598766 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc584003b10 0x7fc584003ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:10.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.807+0000 7fc59ecc7640 1 -- 172.21.15.78:0/2061598766 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc5840047d0 msgr2=0x7fc584004c50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-12T17:35:10.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.807+0000 7fc59ecc7640 1 --2- 172.21.15.78:0/2061598766 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc5840047d0 0x7fc584004c50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:10.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.807+0000 7fc59ecc7640 1 -- 172.21.15.78:0/2061598766 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc584003530 con 0x7fc584005190 2023-12-12T17:35:10.817 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.807+0000 7fc59e4c6640 1 --2- 172.21.15.78:0/2061598766 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc584003b10 0x7fc584003ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T17:35:10.822 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.815+0000 7fc59ecc7640 1 -- 172.21.15.78:0/2061598766 reap_dead start 2023-12-12T17:35:10.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.815+0000 7fc59ecc7640 1 --2- 172.21.15.78:0/2061598766 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc584005190 0x7fc58400b990 secure :-1 s=READY pgs=2139 cs=0 l=1 rev1=1 crypto rx=0x7fc5980b8eb0 tx=0x7fc59001ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9205547d6fc9061a server_cookie=0 in_seq=0 out_seq=0 2023-12-12T17:35:10.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.815+0000 7fc59d4c4640 1 -- 172.21.15.78:0/2061598766 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5900a5930 con 0x7fc584005190 2023-12-12T17:35:10.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.815+0000 7fc59d4c4640 1 -- 172.21.15.78:0/2061598766 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5900a5a90 con 0x7fc584005190 2023-12-12T17:35:10.823 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.815+0000 7fc59d4c4640 1 -- 172.21.15.78:0/2061598766 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5900a5e00 con 0x7fc584005190 2023-12-12T17:35:10.824 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.819+0000 7fc59f4c8640 1 -- 172.21.15.78:0/2061598766 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc584005190 msgr2=0x7fc58400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:35:10.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.819+0000 7fc59f4c8640 1 --2- 172.21.15.78:0/2061598766 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc584005190 0x7fc58400b990 secure :-1 s=READY pgs=2139 cs=0 l=1 rev1=1 crypto rx=0x7fc5980b8eb0 tx=0x7fc59001ca40 comp rx=0 tx=0).stop 2023-12-12T17:35:10.825 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.819+0000 7fc59f4c8640 1 -- 172.21.15.78:0/2061598766 shutdown_connections 2023-12-12T17:35:10.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.819+0000 7fc59f4c8640 1 --2- 172.21.15.78:0/2061598766 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc584005190 0x7fc58400b990 unknown :-1 s=CLOSED pgs=2139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:10.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.819+0000 7fc59f4c8640 1 -- 172.21.15.78:0/2061598766 >> 172.21.15.78:0/2061598766 conn(0x7fc5980d2e00 msgr2=0x7fc5980d3210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T17:35:10.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.819+0000 7fc59f4c8640 1 -- 172.21.15.78:0/2061598766 shutdown_connections 2023-12-12T17:35:10.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.819+0000 7fc59f4c8640 1 -- 172.21.15.78:0/2061598766 wait complete. 2023-12-12T17:35:10.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.823+0000 7fc59f4c8640 1 Processor -- start 2023-12-12T17:35:10.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.823+0000 7fc59f4c8640 1 -- start start 2023-12-12T17:35:10.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.827+0000 7fc59f4c8640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc584005190 0x7fc5980b6ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:35:10.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.827+0000 7fc59f4c8640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc59814c0f0 0x7fc5980b7f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:35:10.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.827+0000 7fc59f4c8640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc5980b84b0 0x7fc598156b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:35:10.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.827+0000 7fc59f4c8640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5980b8930 con 0x7fc584005190 2023-12-12T17:35:10.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.827+0000 7fc59f4c8640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5980b7410 con 0x7fc59814c0f0 2023-12-12T17:35:10.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.827+0000 7fc59f4c8640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5980b5e30 con 0x7fc5980b84b0 2023-12-12T17:35:10.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.827+0000 7fc59dcc5640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc59814c0f0 0x7fc5980b7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:35:10.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.827+0000 7fc59dcc5640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc59814c0f0 0x7fc5980b7f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.78:50784/0 (socket says 172.21.15.78:50784) 2023-12-12T17:35:10.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.827+0000 7fc59dcc5640 1 -- 172.21.15.78:0/1041070959 learned_addr learned my addr 172.21.15.78:0/1041070959 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T17:35:10.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.827+0000 7fc59e4c6640 1 --2- 172.21.15.78:0/1041070959 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc584005190 0x7fc5980b6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:35:10.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.827+0000 7fc59ecc7640 1 --2- 172.21.15.78:0/1041070959 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc5980b84b0 0x7fc598156b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:35:10.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.827+0000 7fc59dcc5640 1 -- 172.21.15.78:0/1041070959 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc5980b84b0 msgr2=0x7fc598156b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:35:10.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.827+0000 7fc59dcc5640 1 --2- 172.21.15.78:0/1041070959 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc5980b84b0 0x7fc598156b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:10.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.827+0000 7fc59dcc5640 1 -- 172.21.15.78:0/1041070959 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc584005190 msgr2=0x7fc5980b6ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:35:10.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.827+0000 7fc59dcc5640 1 --2- 172.21.15.78:0/1041070959 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc584005190 0x7fc5980b6ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:10.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.827+0000 7fc59dcc5640 1 -- 172.21.15.78:0/1041070959 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5980b6110 con 0x7fc59814c0f0 2023-12-12T17:35:10.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.827+0000 7fc59dcc5640 1 --2- 172.21.15.78:0/1041070959 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc59814c0f0 0x7fc5980b7f70 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7fc58800e860 tx=0x7fc58800ed20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T17:35:10.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.827+0000 7fc58effd640 1 -- 172.21.15.78:0/1041070959 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc588004020 con 0x7fc59814c0f0 2023-12-12T17:35:10.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.827+0000 7fc58effd640 1 -- 172.21.15.78:0/1041070959 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc588004180 con 0x7fc59814c0f0 2023-12-12T17:35:10.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.827+0000 7fc59f4c8640 1 -- 172.21.15.78:0/1041070959 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5980b63f0 con 0x7fc59814c0f0 2023-12-12T17:35:10.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.827+0000 7fc58effd640 1 -- 172.21.15.78:0/1041070959 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc58800c940 con 0x7fc59814c0f0 2023-12-12T17:35:10.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.827+0000 7fc59f4c8640 1 -- 172.21.15.78:0/1041070959 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5980b69b0 con 0x7fc59814c0f0 2023-12-12T17:35:10.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.831+0000 7fc58effd640 1 -- 172.21.15.78:0/1041070959 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc58800caa0 con 0x7fc59814c0f0 2023-12-12T17:35:10.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.831+0000 7fc59f4c8640 1 -- 172.21.15.78:0/1041070959 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5980b6bd0 con 0x7fc59814c0f0 2023-12-12T17:35:10.841 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.835+0000 7fc58effd640 1 --2- 172.21.15.78:0/1041070959 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fc57c066470 0x7fc57c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:35:10.842 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.835+0000 7fc58effd640 1 -- 172.21.15.78:0/1041070959 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fc588083b20 con 0x7fc59814c0f0 2023-12-12T17:35:10.842 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.835+0000 7fc59e4c6640 1 --2- 172.21.15.78:0/1041070959 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fc57c066470 0x7fc57c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:35:10.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.835+0000 7fc59e4c6640 1 --2- 172.21.15.78:0/1041070959 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fc57c066470 0x7fc57c068930 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fc594004880 tx=0x7fc594001550 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T17:35:10.844 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:10.835+0000 7fc58effd640 1 -- 172.21.15.78:0/1041070959 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc588051200 con 0x7fc59814c0f0 2023-12-12T17:35:11.308 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:11.299+0000 7fc59f4c8640 1 -- 172.21.15.78:0/1041070959 --> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7fc5980d1410 con 0x7fc57c066470 2023-12-12T17:35:11.309 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:11.303+0000 7fc58effd640 1 -- 172.21.15.78:0/1041070959 <== mgr.4104 v2:172.21.15.78:6832/1725498448 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fc5940053c0 con 0x7fc57c066470 2023-12-12T17:35:11.309 INFO:teuthology.orchestra.run.smithi078.stderr:instructed osd(s) 5 to deep-scrub 2023-12-12T17:35:11.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:11.307+0000 7fc59f4c8640 1 -- 172.21.15.78:0/1041070959 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fc57c066470 msgr2=0x7fc57c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:35:11.313 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:11.307+0000 7fc59f4c8640 1 --2- 172.21.15.78:0/1041070959 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fc57c066470 0x7fc57c068930 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fc594004880 tx=0x7fc594001550 comp rx=0 tx=0).stop 2023-12-12T17:35:11.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:11.307+0000 7fc59f4c8640 1 -- 172.21.15.78:0/1041070959 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc59814c0f0 msgr2=0x7fc5980b7f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:35:11.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:11.307+0000 7fc59f4c8640 1 --2- 172.21.15.78:0/1041070959 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc59814c0f0 0x7fc5980b7f70 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7fc58800e860 tx=0x7fc58800ed20 comp rx=0 tx=0).stop 2023-12-12T17:35:11.314 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:11.307+0000 7fc59f4c8640 1 -- 172.21.15.78:0/1041070959 shutdown_connections 2023-12-12T17:35:11.315 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:11.307+0000 7fc59f4c8640 1 --2- 172.21.15.78:0/1041070959 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fc57c066470 0x7fc57c068930 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:11.315 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:11.307+0000 7fc59f4c8640 1 --2- 172.21.15.78:0/1041070959 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc5980b84b0 0x7fc598156b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:11.315 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:11.307+0000 7fc59f4c8640 1 --2- 172.21.15.78:0/1041070959 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc59814c0f0 0x7fc5980b7f70 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:11.315 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:11.307+0000 7fc59f4c8640 1 --2- 172.21.15.78:0/1041070959 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc584005190 0x7fc5980b6ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:11.315 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:11.307+0000 7fc59f4c8640 1 -- 172.21.15.78:0/1041070959 >> 172.21.15.78:0/1041070959 conn(0x7fc5980d2e00 msgr2=0x7fc5980c9250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T17:35:11.315 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:11.307+0000 7fc59f4c8640 1 -- 172.21.15.78:0/1041070959 shutdown_connections 2023-12-12T17:35:11.315 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:11.307+0000 7fc59f4c8640 1 -- 172.21.15.78:0/1041070959 wait complete. 2023-12-12T17:35:11.364 INFO:tasks.ceph:Scrubbing osd.6 2023-12-12T17:35:11.364 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-12-12T17:35:11.746 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:11.739+0000 7ff7910d6640 1 Processor -- start 2023-12-12T17:35:11.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:11.739+0000 7ff7910d6640 1 -- start start 2023-12-12T17:35:11.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:11.739+0000 7ff7910d6640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7ff78c06c740 0x7ff78c0702c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:35:11.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:11.739+0000 7ff7910d6640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff78c06d230 0x7ff78c0719f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:35:11.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:11.739+0000 7ff7910d6640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff78c070950 con 0x7ff78c0b2ba0 2023-12-12T17:35:11.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:11.739+0000 7ff7910d6640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff78c071f30 con 0x7ff78c06c740 2023-12-12T17:35:11.748 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:11.739+0000 7ff7910d6640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff78c070c30 con 0x7ff78c06d230 2023-12-12T17:35:11.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:11.743+0000 7ff78a59c640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7ff78c0b2ba0 0x7ff78c06cb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.78:36798/0 (socket says 172.21.15.78:36798) 2023-12-12T17:35:11.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:11.743+0000 7ff78a59c640 1 -- 172.21.15.78:0/628001285 learned_addr learned my addr 172.21.15.78:0/628001285 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-12-12T17:35:11.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:11.743+0000 7ff78ad9d640 1 --2- 172.21.15.78:0/628001285 >> v2:172.21.15.78:3300/0 conn(0x7ff78c06c740 0x7ff78c0702c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:35:11.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:11.743+0000 7ff78b59e640 1 --2- 172.21.15.78:0/628001285 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff78c06d230 0x7ff78c0719f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:35:11.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:11.743+0000 7ff789d9b640 1 -- 172.21.15.78:0/628001285 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1455051819 0 0) 0x7ff78c070950 con 0x7ff78c0b2ba0 2023-12-12T17:35:11.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:11.743+0000 7ff789d9b640 1 -- 172.21.15.78:0/628001285 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff774003530 con 0x7ff78c0b2ba0 2023-12-12T17:35:11.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:11.743+0000 7ff78b59e640 1 -- 172.21.15.78:0/628001285 >> v2:172.21.15.78:3300/0 conn(0x7ff78c06c740 msgr2=0x7ff78c0702c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T17:35:11.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:11.743+0000 7ff78b59e640 1 --2- 172.21.15.78:0/628001285 >> v2:172.21.15.78:3300/0 conn(0x7ff78c06c740 0x7ff78c0702c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:11.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:11.743+0000 7ff78b59e640 1 -- 172.21.15.78:0/628001285 >> v1:172.21.15.187:6789/0 conn(0x7ff78c0b2ba0 legacy=0x7ff78c06cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:35:11.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:11.743+0000 7ff78b59e640 1 -- 172.21.15.78:0/628001285 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff78c070f10 con 0x7ff78c06d230 2023-12-12T17:35:11.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:11.751+0000 7ff78b59e640 1 --2- 172.21.15.78:0/628001285 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff78c06d230 0x7ff78c0719f0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7ff784009d90 tx=0x7ff78401c950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eff0e33d9fedf088 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T17:35:11.758 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:11.751+0000 7ff789d9b640 1 -- 172.21.15.78:0/628001285 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7840a5a10 con 0x7ff78c06d230 2023-12-12T17:35:11.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:11.751+0000 7ff789d9b640 1 -- 172.21.15.78:0/628001285 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7840a5b70 con 0x7ff78c06d230 2023-12-12T17:35:11.759 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:11.751+0000 7ff789d9b640 1 -- 172.21.15.78:0/628001285 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7840ad440 con 0x7ff78c06d230 2023-12-12T17:35:11.760 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:11.751+0000 7ff7910d6640 1 -- 172.21.15.78:0/628001285 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff78c06d230 msgr2=0x7ff78c0719f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:35:11.760 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:11.751+0000 7ff7910d6640 1 --2- 172.21.15.78:0/628001285 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff78c06d230 0x7ff78c0719f0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7ff784009d90 tx=0x7ff78401c950 comp rx=0 tx=0).stop 2023-12-12T17:35:11.761 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:11.755+0000 7ff7910d6640 1 -- 172.21.15.78:0/628001285 shutdown_connections 2023-12-12T17:35:11.761 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:11.755+0000 7ff7910d6640 1 --2- 172.21.15.78:0/628001285 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff78c06d230 0x7ff78c0719f0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:11.761 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:11.755+0000 7ff7910d6640 1 --2- 172.21.15.78:0/628001285 >> v2:172.21.15.78:3300/0 conn(0x7ff78c06c740 0x7ff78c0702c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:11.761 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:11.755+0000 7ff7910d6640 1 -- 172.21.15.78:0/628001285 >> 172.21.15.78:0/628001285 conn(0x7ff78c06a710 msgr2=0x7ff78c06ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T17:35:11.761 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:11.755+0000 7ff7910d6640 1 -- 172.21.15.78:0/628001285 shutdown_connections 2023-12-12T17:35:11.761 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:11.755+0000 7ff7910d6640 1 -- 172.21.15.78:0/628001285 wait complete. 2023-12-12T17:35:11.766 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:11.759+0000 7ff7910d6640 1 Processor -- start 2023-12-12T17:35:11.766 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:11.759+0000 7ff7910d6640 1 -- start start 2023-12-12T17:35:11.769 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:11.763+0000 7ff7910d6640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff78c06c740 0x7ff78c13dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:35:11.769 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:11.763+0000 7ff7910d6640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff78c06d230 0x7ff78c162500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:35:11.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:11.763+0000 7ff7910d6640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff78c0b2ba0 0x7ff78c157c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:35:11.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:11.763+0000 7ff7910d6640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff78c15b9e0 con 0x7ff78c06c740 2023-12-12T17:35:11.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:11.763+0000 7ff7910d6640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff78c15ad40 con 0x7ff78c06d230 2023-12-12T17:35:11.770 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:11.763+0000 7ff7910d6640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff78c15bc30 con 0x7ff78c0b2ba0 2023-12-12T17:35:11.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:11.763+0000 7ff78ad9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff78c06c740 0x7ff78c13dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:35:11.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:11.763+0000 7ff78a59c640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff78c06d230 0x7ff78c162500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:35:11.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:11.763+0000 7ff78ad9d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff78c06c740 0x7ff78c13dc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55090/0 (socket says 172.21.15.78:55090) 2023-12-12T17:35:11.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:11.763+0000 7ff78ad9d640 1 -- 172.21.15.78:0/1102288931 learned_addr learned my addr 172.21.15.78:0/1102288931 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T17:35:11.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:11.763+0000 7ff78b59e640 1 --2- 172.21.15.78:0/1102288931 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff78c0b2ba0 0x7ff78c157c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:35:11.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:11.763+0000 7ff78ad9d640 1 -- 172.21.15.78:0/1102288931 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff78c0b2ba0 msgr2=0x7ff78c157c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:35:11.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:11.763+0000 7ff78ad9d640 1 --2- 172.21.15.78:0/1102288931 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff78c0b2ba0 0x7ff78c157c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:11.771 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:11.763+0000 7ff78ad9d640 1 -- 172.21.15.78:0/1102288931 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff78c06d230 msgr2=0x7ff78c162500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:35:11.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:11.763+0000 7ff78ad9d640 1 --2- 172.21.15.78:0/1102288931 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff78c06d230 0x7ff78c162500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:11.772 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:11.763+0000 7ff78ad9d640 1 -- 172.21.15.78:0/1102288931 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff784009a70 con 0x7ff78c06c740 2023-12-12T17:35:11.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:11.763+0000 7ff78ad9d640 1 --2- 172.21.15.78:0/1102288931 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff78c06c740 0x7ff78c13dc70 secure :-1 s=READY pgs=2140 cs=0 l=1 rev1=1 crypto rx=0x7ff77c00e930 tx=0x7ff77c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T17:35:11.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:11.763+0000 7ff7737fe640 1 -- 172.21.15.78:0/1102288931 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff77c009690 con 0x7ff78c06c740 2023-12-12T17:35:11.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:11.763+0000 7ff7737fe640 1 -- 172.21.15.78:0/1102288931 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff77c00ca00 con 0x7ff78c06c740 2023-12-12T17:35:11.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:11.763+0000 7ff7910d6640 1 -- 172.21.15.78:0/1102288931 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff78c15bf10 con 0x7ff78c06c740 2023-12-12T17:35:11.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:11.763+0000 7ff7737fe640 1 -- 172.21.15.78:0/1102288931 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff77c00cd70 con 0x7ff78c06c740 2023-12-12T17:35:11.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:11.763+0000 7ff7910d6640 1 -- 172.21.15.78:0/1102288931 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff78c13e1b0 con 0x7ff78c06c740 2023-12-12T17:35:11.773 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:11.767+0000 7ff7910d6640 1 -- 172.21.15.78:0/1102288931 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff78c067530 con 0x7ff78c06c740 2023-12-12T17:35:11.777 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:11.771+0000 7ff7737fe640 1 -- 172.21.15.78:0/1102288931 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff77c013470 con 0x7ff78c06c740 2023-12-12T17:35:11.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:11.771+0000 7ff7737fe640 1 --2- 172.21.15.78:0/1102288931 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7ff778066470 0x7ff778068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:35:11.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:11.771+0000 7ff7737fe640 1 -- 172.21.15.78:0/1102288931 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5263+0+0 (secure 0 0 0) 0x7ff77c0841d0 con 0x7ff78c06c740 2023-12-12T17:35:11.779 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:11.771+0000 7ff7737fe640 1 --2- 172.21.15.78:0/1102288931 >> [v2:172.21.15.187:6816/4213392126,v1:172.21.15.187:6817/4213392126] conn(0x7ff77806c770 0x7ff77806ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:35:11.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:11.771+0000 7ff7737fe640 1 -- 172.21.15.78:0/1102288931 --> [v2:172.21.15.187:6816/4213392126,v1:172.21.15.187:6817/4213392126] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff77806f280 con 0x7ff77806c770 2023-12-12T17:35:11.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:11.771+0000 7ff7737fe640 1 -- 172.21.15.78:0/1102288931 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff77c084620 con 0x7ff78c06c740 2023-12-12T17:35:11.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:11.771+0000 7ff78a59c640 1 --2- 172.21.15.78:0/1102288931 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7ff778066470 0x7ff778068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:35:11.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:11.771+0000 7ff78b59e640 1 --2- 172.21.15.78:0/1102288931 >> [v2:172.21.15.187:6816/4213392126,v1:172.21.15.187:6817/4213392126] conn(0x7ff77806c770 0x7ff77806ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:35:11.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:11.771+0000 7ff78a59c640 1 --2- 172.21.15.78:0/1102288931 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7ff778066470 0x7ff778068930 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7ff78c0ce530 tx=0x7ff780007d40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T17:35:11.780 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:11.775+0000 7ff78b59e640 1 --2- 172.21.15.78:0/1102288931 >> [v2:172.21.15.187:6816/4213392126,v1:172.21.15.187:6817/4213392126] conn(0x7ff77806c770 0x7ff77806ebb0 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T17:35:11.951 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:11.943+0000 7ff7737fe640 1 -- 172.21.15.78:0/1102288931 <== osd.6 v2:172.21.15.187:6816/4213392126 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7ff77806f280 con 0x7ff77806c770 2023-12-12T17:35:11.966 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:11.959+0000 7ff7910d6640 1 -- 172.21.15.78:0/1102288931 --> [v2:172.21.15.187:6816/4213392126,v1:172.21.15.187:6817/4213392126] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7ff78c15bda0 con 0x7ff77806c770 2023-12-12T17:35:12.000 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:11.991+0000 7ff7737fe640 1 -- 172.21.15.78:0/1102288931 <== osd.6 v2:172.21.15.187:6816/4213392126 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7ff78c15bda0 con 0x7ff77806c770 2023-12-12T17:35:12.000 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2023-12-12T17:35:12.000 INFO:teuthology.orchestra.run.smithi078.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-12-12T17:35:12.000 INFO:teuthology.orchestra.run.smithi078.stdout:} 2023-12-12T17:35:12.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:11.991+0000 7ff7910d6640 1 -- 172.21.15.78:0/1102288931 >> [v2:172.21.15.187:6816/4213392126,v1:172.21.15.187:6817/4213392126] conn(0x7ff77806c770 msgr2=0x7ff77806ebb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:35:12.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:11.995+0000 7ff7910d6640 1 --2- 172.21.15.78:0/1102288931 >> [v2:172.21.15.187:6816/4213392126,v1:172.21.15.187:6817/4213392126] conn(0x7ff77806c770 0x7ff77806ebb0 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:12.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:11.995+0000 7ff7910d6640 1 -- 172.21.15.78:0/1102288931 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7ff778066470 msgr2=0x7ff778068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:35:12.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:11.995+0000 7ff7910d6640 1 --2- 172.21.15.78:0/1102288931 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7ff778066470 0x7ff778068930 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7ff78c0ce530 tx=0x7ff780007d40 comp rx=0 tx=0).stop 2023-12-12T17:35:12.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:11.995+0000 7ff7910d6640 1 -- 172.21.15.78:0/1102288931 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff78c06c740 msgr2=0x7ff78c13dc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:35:12.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:11.995+0000 7ff7910d6640 1 --2- 172.21.15.78:0/1102288931 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7ff78c06c740 0x7ff78c13dc70 secure :-1 s=READY pgs=2140 cs=0 l=1 rev1=1 crypto rx=0x7ff77c00e930 tx=0x7ff77c00edf0 comp rx=0 tx=0).stop 2023-12-12T17:35:12.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:11.995+0000 7ff78b59e640 1 -- 172.21.15.78:0/1102288931 reap_dead start 2023-12-12T17:35:12.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:11.995+0000 7ff7910d6640 1 -- 172.21.15.78:0/1102288931 shutdown_connections 2023-12-12T17:35:12.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:11.995+0000 7ff7910d6640 1 -- 172.21.15.78:0/1102288931 >> 172.21.15.78:0/1102288931 conn(0x7ff78c06a710 msgr2=0x7ff78c0af240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T17:35:12.002 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:11.995+0000 7ff7910d6640 1 -- 172.21.15.78:0/1102288931 shutdown_connections 2023-12-12T17:35:12.003 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:11.995+0000 7ff7910d6640 1 -- 172.21.15.78:0/1102288931 wait complete. 2023-12-12T17:35:12.026 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-12-12T17:35:12.234 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:12.227+0000 7f4d17067640 1 Processor -- start 2023-12-12T17:35:12.234 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:12.227+0000 7f4d17067640 1 -- start start 2023-12-12T17:35:12.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:12.231+0000 7f4d17067640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4d100d0410 0x7f4d100d13b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:35:12.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:12.231+0000 7f4d17067640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d100cf400 con 0x7f4d1015d320 2023-12-12T17:35:12.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:12.231+0000 7f4d17067640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d100ceb00 con 0x7f4d1015cf40 2023-12-12T17:35:12.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:12.231+0000 7f4d17067640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d100cfff0 con 0x7f4d100d0410 2023-12-12T17:35:12.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:12.231+0000 7f4d16866640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f4d1015d320 0x7f4d100b2220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:50746/0 (socket says 172.21.15.78:50746) 2023-12-12T17:35:12.238 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:12.231+0000 7f4d16866640 1 -- 172.21.15.78:0/3007113318 learned_addr learned my addr 172.21.15.78:0/3007113318 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-12-12T17:35:12.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:12.231+0000 7f4d15864640 1 --2- 172.21.15.78:0/3007113318 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4d100d0410 0x7f4d100d13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:35:12.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:12.231+0000 7f4d15063640 1 -- 172.21.15.78:0/3007113318 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 50528033 0 0) 0x7f4d100cf400 con 0x7f4d1015d320 2023-12-12T17:35:12.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:12.231+0000 7f4d15063640 1 -- 172.21.15.78:0/3007113318 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4cfc003530 con 0x7f4d1015d320 2023-12-12T17:35:12.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:12.231+0000 7f4d15063640 1 -- 172.21.15.78:0/3007113318 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 973062669 0 0) 0x7f4d100ceb00 con 0x7f4d1015cf40 2023-12-12T17:35:12.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:12.231+0000 7f4d15063640 1 -- 172.21.15.78:0/3007113318 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d100cf400 con 0x7f4d1015cf40 2023-12-12T17:35:12.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:12.231+0000 7f4d15864640 1 -- 172.21.15.78:0/3007113318 >> v1:172.21.15.187:6789/0 conn(0x7f4d1015cf40 legacy=0x7f4d100ce3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:35:12.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:12.231+0000 7f4d15864640 1 -- 172.21.15.78:0/3007113318 >> v1:172.21.15.78:6789/0 conn(0x7f4d1015d320 legacy=0x7f4d100b2220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:35:12.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:12.231+0000 7f4d15864640 1 -- 172.21.15.78:0/3007113318 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d100cf650 con 0x7f4d100d0410 2023-12-12T17:35:12.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:12.239+0000 7f4d15864640 1 --2- 172.21.15.78:0/3007113318 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4d100d0410 0x7f4d100d13b0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f4d000097f0 tx=0x7f4d0001c370 comp rx=0 tx=0).ready entity=mon.2 client_cookie=189041d0eb615443 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T17:35:12.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:12.243+0000 7f4d15063640 1 -- 172.21.15.78:0/3007113318 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d000a8050 con 0x7f4d100d0410 2023-12-12T17:35:12.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:12.243+0000 7f4d15063640 1 -- 172.21.15.78:0/3007113318 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d000ac5f0 con 0x7f4d100d0410 2023-12-12T17:35:12.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:12.243+0000 7f4d15063640 1 -- 172.21.15.78:0/3007113318 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d000ac980 con 0x7f4d100d0410 2023-12-12T17:35:12.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:12.243+0000 7f4d17067640 1 -- 172.21.15.78:0/3007113318 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4d100d0410 msgr2=0x7f4d100d13b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:35:12.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:12.243+0000 7f4d17067640 1 --2- 172.21.15.78:0/3007113318 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4d100d0410 0x7f4d100d13b0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f4d000097f0 tx=0x7f4d0001c370 comp rx=0 tx=0).stop 2023-12-12T17:35:12.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:12.243+0000 7f4d17067640 1 -- 172.21.15.78:0/3007113318 shutdown_connections 2023-12-12T17:35:12.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:12.243+0000 7f4d17067640 1 --2- 172.21.15.78:0/3007113318 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4d100d0410 0x7f4d100d13b0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:12.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:12.243+0000 7f4d17067640 1 -- 172.21.15.78:0/3007113318 >> 172.21.15.78:0/3007113318 conn(0x7f4d100d2dd0 msgr2=0x7f4d100d31e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T17:35:12.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:12.243+0000 7f4d17067640 1 -- 172.21.15.78:0/3007113318 shutdown_connections 2023-12-12T17:35:12.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:12.243+0000 7f4d17067640 1 -- 172.21.15.78:0/3007113318 wait complete. 2023-12-12T17:35:12.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:12.247+0000 7f4d17067640 1 Processor -- start 2023-12-12T17:35:12.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:12.251+0000 7f4d17067640 1 -- start start 2023-12-12T17:35:12.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:12.251+0000 7f4d17067640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4d100d0410 0x7f4d100cca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:35:12.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:12.251+0000 7f4d17067640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4d1015cf40 0x7f4d100ca8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:35:12.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:12.251+0000 7f4d17067640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4d1015d320 0x7f4d1015f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:35:12.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:12.251+0000 7f4d17067640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d10159fb0 con 0x7f4d100d0410 2023-12-12T17:35:12.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:12.251+0000 7f4d17067640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d100cadf0 con 0x7f4d1015cf40 2023-12-12T17:35:12.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:12.251+0000 7f4d17067640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d100cb090 con 0x7f4d1015d320 2023-12-12T17:35:12.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:12.251+0000 7f4d16065640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4d100d0410 0x7f4d100cca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:35:12.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:12.251+0000 7f4d15864640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4d1015cf40 0x7f4d100ca8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:35:12.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:12.251+0000 7f4d16065640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4d100d0410 0x7f4d100cca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55092/0 (socket says 172.21.15.78:55092) 2023-12-12T17:35:12.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:12.251+0000 7f4d15864640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4d1015cf40 0x7f4d100ca8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.78:50810/0 (socket says 172.21.15.78:50810) 2023-12-12T17:35:12.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:12.251+0000 7f4d16065640 1 -- 172.21.15.78:0/4226918241 learned_addr learned my addr 172.21.15.78:0/4226918241 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T17:35:12.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:12.251+0000 7f4d16866640 1 --2- 172.21.15.78:0/4226918241 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4d1015d320 0x7f4d1015f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:35:12.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:12.255+0000 7f4d15864640 1 -- 172.21.15.78:0/4226918241 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4d1015d320 msgr2=0x7f4d1015f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:35:12.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:12.255+0000 7f4d15864640 1 --2- 172.21.15.78:0/4226918241 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4d1015d320 0x7f4d1015f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:12.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:12.255+0000 7f4d15864640 1 -- 172.21.15.78:0/4226918241 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4d100d0410 msgr2=0x7f4d100cca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:35:12.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:12.255+0000 7f4d15864640 1 --2- 172.21.15.78:0/4226918241 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4d100d0410 0x7f4d100cca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:12.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:12.255+0000 7f4d15864640 1 -- 172.21.15.78:0/4226918241 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d00009420 con 0x7f4d1015cf40 2023-12-12T17:35:12.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:12.255+0000 7f4d15864640 1 --2- 172.21.15.78:0/4226918241 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4d1015cf40 0x7f4d100ca8b0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f4d000ac000 tx=0x7f4d00019110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T17:35:12.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:12.255+0000 7f4d06ffd640 1 -- 172.21.15.78:0/4226918241 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d000ba070 con 0x7f4d1015cf40 2023-12-12T17:35:12.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:12.255+0000 7f4d06ffd640 1 -- 172.21.15.78:0/4226918241 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d00006e20 con 0x7f4d1015cf40 2023-12-12T17:35:12.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:12.255+0000 7f4d17067640 1 -- 172.21.15.78:0/4226918241 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d100cb370 con 0x7f4d1015cf40 2023-12-12T17:35:12.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:12.255+0000 7f4d06ffd640 1 -- 172.21.15.78:0/4226918241 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d000a8040 con 0x7f4d1015cf40 2023-12-12T17:35:12.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:12.255+0000 7f4d17067640 1 -- 172.21.15.78:0/4226918241 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d100cb930 con 0x7f4d1015cf40 2023-12-12T17:35:12.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:12.255+0000 7f4d17067640 1 -- 172.21.15.78:0/4226918241 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d1015a120 con 0x7f4d1015cf40 2023-12-12T17:35:12.264 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:12.255+0000 7f4d06ffd640 1 -- 172.21.15.78:0/4226918241 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4d000b45c0 con 0x7f4d1015cf40 2023-12-12T17:35:12.266 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:12.259+0000 7f4d06ffd640 1 --2- 172.21.15.78:0/4226918241 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f4cf40664f0 0x7f4cf40689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:35:12.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:12.259+0000 7f4d06ffd640 1 -- 172.21.15.78:0/4226918241 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f4d0011d310 con 0x7f4d1015cf40 2023-12-12T17:35:12.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:12.259+0000 7f4d16065640 1 --2- 172.21.15.78:0/4226918241 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f4cf40664f0 0x7f4cf40689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:35:12.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:12.263+0000 7f4d16065640 1 --2- 172.21.15.78:0/4226918241 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f4cf40664f0 0x7f4cf40689b0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c0011f0 tx=0x7f4d0c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T17:35:12.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:12.263+0000 7f4d06ffd640 1 -- 172.21.15.78:0/4226918241 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4d000eab90 con 0x7f4d1015cf40 2023-12-12T17:35:12.740 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:12.731+0000 7f4d17067640 1 -- 172.21.15.78:0/4226918241 --> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f4d100d1d00 con 0x7f4cf40664f0 2023-12-12T17:35:12.741 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:12.735+0000 7f4d06ffd640 1 -- 172.21.15.78:0/4226918241 <== mgr.4104 v2:172.21.15.78:6832/1725498448 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f4d0c001520 con 0x7f4cf40664f0 2023-12-12T17:35:12.741 INFO:teuthology.orchestra.run.smithi078.stderr:instructed osd(s) 6 to deep-scrub 2023-12-12T17:35:12.746 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:12.739+0000 7f4d17067640 1 -- 172.21.15.78:0/4226918241 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f4cf40664f0 msgr2=0x7f4cf40689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:35:12.746 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:12.739+0000 7f4d17067640 1 --2- 172.21.15.78:0/4226918241 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f4cf40664f0 0x7f4cf40689b0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c0011f0 tx=0x7f4d0c009040 comp rx=0 tx=0).stop 2023-12-12T17:35:12.746 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:12.739+0000 7f4d17067640 1 -- 172.21.15.78:0/4226918241 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4d1015cf40 msgr2=0x7f4d100ca8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:35:12.746 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:12.739+0000 7f4d17067640 1 --2- 172.21.15.78:0/4226918241 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4d1015cf40 0x7f4d100ca8b0 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f4d000ac000 tx=0x7f4d00019110 comp rx=0 tx=0).stop 2023-12-12T17:35:12.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:12.739+0000 7f4d17067640 1 -- 172.21.15.78:0/4226918241 shutdown_connections 2023-12-12T17:35:12.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:12.739+0000 7f4d17067640 1 --2- 172.21.15.78:0/4226918241 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f4cf40664f0 0x7f4cf40689b0 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:12.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:12.739+0000 7f4d17067640 1 --2- 172.21.15.78:0/4226918241 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4d1015d320 0x7f4d1015f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:12.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:12.739+0000 7f4d17067640 1 --2- 172.21.15.78:0/4226918241 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4d1015cf40 0x7f4d100ca8b0 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:12.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:12.739+0000 7f4d17067640 1 --2- 172.21.15.78:0/4226918241 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f4d100d0410 0x7f4d100cca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:12.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:12.739+0000 7f4d17067640 1 -- 172.21.15.78:0/4226918241 >> 172.21.15.78:0/4226918241 conn(0x7f4d100d2dd0 msgr2=0x7f4d1006c330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T17:35:12.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:12.739+0000 7f4d17067640 1 -- 172.21.15.78:0/4226918241 shutdown_connections 2023-12-12T17:35:12.747 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:12.739+0000 7f4d17067640 1 -- 172.21.15.78:0/4226918241 wait complete. 2023-12-12T17:35:12.776 INFO:tasks.ceph:Scrubbing osd.7 2023-12-12T17:35:12.776 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-12-12T17:35:13.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:12.995+0000 7f5fdb59e640 1 Processor -- start 2023-12-12T17:35:13.001 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:12.995+0000 7f5fdb59e640 1 -- start start 2023-12-12T17:35:13.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:12.999+0000 7f5fdb59e640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5fdc160c40 0x7f5fdc06e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:35:13.004 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:12.999+0000 7f5fdb59e640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fdc0cffe0 con 0x7f5fdc0cfbc0 2023-12-12T17:35:13.005 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:12.999+0000 7f5fdb59e640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fdc1610d0 con 0x7f5fdc15cfd0 2023-12-12T17:35:13.005 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:12.999+0000 7f5fdb59e640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fdc06a5b0 con 0x7f5fdc160c40 2023-12-12T17:35:13.005 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:12.999+0000 7f5fda59c640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f5fdc15cfd0 0x7f5fdc06df60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.78:36808/0 (socket says 172.21.15.78:36808) 2023-12-12T17:35:13.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:12.999+0000 7f5fda59c640 1 -- 172.21.15.78:0/2300542706 learned_addr learned my addr 172.21.15.78:0/2300542706 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-12-12T17:35:13.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:12.999+0000 7f5fd3fff640 1 --2- 172.21.15.78:0/2300542706 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5fdc160c40 0x7f5fdc06e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:35:13.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:12.999+0000 7f5fd9d9b640 1 -- 172.21.15.78:0/2300542706 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2743784159 0 0) 0x7f5fdc1610d0 con 0x7f5fdc15cfd0 2023-12-12T17:35:13.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:12.999+0000 7f5fd9d9b640 1 -- 172.21.15.78:0/2300542706 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5fc8003530 con 0x7f5fdc15cfd0 2023-12-12T17:35:13.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:12.999+0000 7f5fd3fff640 1 -- 172.21.15.78:0/2300542706 >> v1:172.21.15.187:6789/0 conn(0x7f5fdc15cfd0 legacy=0x7f5fdc06df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:35:13.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:12.999+0000 7f5fd3fff640 1 -- 172.21.15.78:0/2300542706 >> v1:172.21.15.78:6789/0 conn(0x7f5fdc0cfbc0 legacy=0x7f5fdc06a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T17:35:13.007 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:12.999+0000 7f5fd3fff640 1 -- 172.21.15.78:0/2300542706 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fdc1613b0 con 0x7f5fdc160c40 2023-12-12T17:35:13.009 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.003+0000 7f5fd3fff640 1 --2- 172.21.15.78:0/2300542706 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5fdc160c40 0x7f5fdc06e670 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f5fc40097f0 tx=0x7f5fc401c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5e9177e2c6673838 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T17:35:13.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.003+0000 7f5fd9d9b640 1 -- 172.21.15.78:0/2300542706 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fc40ac620 con 0x7f5fdc160c40 2023-12-12T17:35:13.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.003+0000 7f5fd9d9b640 1 -- 172.21.15.78:0/2300542706 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fc40ac780 con 0x7f5fdc160c40 2023-12-12T17:35:13.010 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.003+0000 7f5fd9d9b640 1 -- 172.21.15.78:0/2300542706 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fc40acb10 con 0x7f5fdc160c40 2023-12-12T17:35:13.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.003+0000 7f5fdb59e640 1 -- 172.21.15.78:0/2300542706 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5fdc160c40 msgr2=0x7f5fdc06e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:35:13.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.003+0000 7f5fdb59e640 1 --2- 172.21.15.78:0/2300542706 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5fdc160c40 0x7f5fdc06e670 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f5fc40097f0 tx=0x7f5fc401c3c0 comp rx=0 tx=0).stop 2023-12-12T17:35:13.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.003+0000 7f5fdb59e640 1 -- 172.21.15.78:0/2300542706 shutdown_connections 2023-12-12T17:35:13.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.003+0000 7f5fdb59e640 1 --2- 172.21.15.78:0/2300542706 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5fdc160c40 0x7f5fdc06e670 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:13.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.003+0000 7f5fdb59e640 1 -- 172.21.15.78:0/2300542706 >> 172.21.15.78:0/2300542706 conn(0x7f5fdc0b2e30 msgr2=0x7f5fdc0b4090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T17:35:13.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.003+0000 7f5fdb59e640 1 -- 172.21.15.78:0/2300542706 shutdown_connections 2023-12-12T17:35:13.011 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.003+0000 7f5fdb59e640 1 -- 172.21.15.78:0/2300542706 wait complete. 2023-12-12T17:35:13.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.007+0000 7f5fdb59e640 1 Processor -- start 2023-12-12T17:35:13.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.007+0000 7f5fdb59e640 1 -- start start 2023-12-12T17:35:13.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.007+0000 7f5fdb59e640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5fdc0cfbc0 0x7f5fdc15f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:35:13.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.007+0000 7f5fdb59e640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5fdc15cfd0 0x7f5fdc150a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:35:13.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.007+0000 7f5fdb59e640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5fdc152830 0x7f5fdc14fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:35:13.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.007+0000 7f5fdb59e640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fdc15eac0 con 0x7f5fdc15cfd0 2023-12-12T17:35:13.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.007+0000 7f5fdb59e640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fdc14bd50 con 0x7f5fdc0cfbc0 2023-12-12T17:35:13.014 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.007+0000 7f5fdb59e640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fdc14c030 con 0x7f5fdc152830 2023-12-12T17:35:13.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.007+0000 7f5fda59c640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5fdc0cfbc0 0x7f5fdc15f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:35:13.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.007+0000 7f5fdad9d640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5fdc152830 0x7f5fdc14fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:35:13.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.007+0000 7f5fd3fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5fdc15cfd0 0x7f5fdc150a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:35:13.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.007+0000 7f5fda59c640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5fdc0cfbc0 0x7f5fdc15f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.78:50816/0 (socket says 172.21.15.78:50816) 2023-12-12T17:35:13.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.007+0000 7f5fd3fff640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5fdc15cfd0 0x7f5fdc150a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55100/0 (socket says 172.21.15.78:55100) 2023-12-12T17:35:13.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.007+0000 7f5fdad9d640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5fdc152830 0x7f5fdc14fab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.78:54288/0 (socket says 172.21.15.78:54288) 2023-12-12T17:35:13.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.007+0000 7f5fda59c640 1 -- 172.21.15.78:0/2746427705 learned_addr learned my addr 172.21.15.78:0/2746427705 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T17:35:13.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.007+0000 7f5fda59c640 1 -- 172.21.15.78:0/2746427705 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5fdc152830 msgr2=0x7f5fdc14fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:35:13.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.007+0000 7f5fda59c640 1 --2- 172.21.15.78:0/2746427705 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5fdc152830 0x7f5fdc14fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:13.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.007+0000 7f5fda59c640 1 -- 172.21.15.78:0/2746427705 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5fdc15cfd0 msgr2=0x7f5fdc150a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:35:13.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.007+0000 7f5fda59c640 1 --2- 172.21.15.78:0/2746427705 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f5fdc15cfd0 0x7f5fdc150a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:13.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.007+0000 7f5fda59c640 1 -- 172.21.15.78:0/2746427705 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fc4009420 con 0x7f5fdc0cfbc0 2023-12-12T17:35:13.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.011+0000 7f5fda59c640 1 --2- 172.21.15.78:0/2746427705 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5fdc0cfbc0 0x7f5fdc15f090 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f5fcc00c4d0 tx=0x7f5fcc00c990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T17:35:13.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.011+0000 7f5fd2ffd640 1 -- 172.21.15.78:0/2746427705 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fcc005cf0 con 0x7f5fdc0cfbc0 2023-12-12T17:35:13.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.011+0000 7f5fd2ffd640 1 -- 172.21.15.78:0/2746427705 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fcc005e50 con 0x7f5fdc0cfbc0 2023-12-12T17:35:13.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.011+0000 7f5fd2ffd640 1 -- 172.21.15.78:0/2746427705 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fcc007270 con 0x7f5fdc0cfbc0 2023-12-12T17:35:13.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.011+0000 7f5fdb59e640 1 -- 172.21.15.78:0/2746427705 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fdc14a2b0 con 0x7f5fdc0cfbc0 2023-12-12T17:35:13.018 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.011+0000 7f5fdb59e640 1 -- 172.21.15.78:0/2746427705 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fdc14a870 con 0x7f5fdc0cfbc0 2023-12-12T17:35:13.019 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.011+0000 7f5fdb59e640 1 -- 172.21.15.78:0/2746427705 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5fdc06b8f0 con 0x7f5fdc0cfbc0 2023-12-12T17:35:13.021 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.015+0000 7f5fd2ffd640 1 -- 172.21.15.78:0/2746427705 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5fcc0073d0 con 0x7f5fdc0cfbc0 2023-12-12T17:35:13.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.015+0000 7f5fd2ffd640 1 --2- 172.21.15.78:0/2746427705 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f5fbc066470 0x7f5fbc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:35:13.022 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.015+0000 7f5fd2ffd640 1 -- 172.21.15.78:0/2746427705 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f5fcc083210 con 0x7f5fdc0cfbc0 2023-12-12T17:35:13.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.015+0000 7f5fd2ffd640 1 --2- 172.21.15.78:0/2746427705 >> [v2:172.21.15.187:6823/85774004,v1:172.21.15.187:6825/85774004] conn(0x7f5fbc06c770 0x7f5fbc06ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:35:13.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.015+0000 7f5fd2ffd640 1 -- 172.21.15.78:0/2746427705 --> [v2:172.21.15.187:6823/85774004,v1:172.21.15.187:6825/85774004] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5fbc06f280 con 0x7f5fbc06c770 2023-12-12T17:35:13.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.015+0000 7f5fd2ffd640 1 -- 172.21.15.78:0/2746427705 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5fcc0857f0 con 0x7f5fdc0cfbc0 2023-12-12T17:35:13.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.015+0000 7f5fd3fff640 1 --2- 172.21.15.78:0/2746427705 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f5fbc066470 0x7f5fbc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:35:13.023 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.015+0000 7f5fdad9d640 1 --2- 172.21.15.78:0/2746427705 >> [v2:172.21.15.187:6823/85774004,v1:172.21.15.187:6825/85774004] conn(0x7f5fbc06c770 0x7f5fbc06ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:35:13.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.015+0000 7f5fd3fff640 1 --2- 172.21.15.78:0/2746427705 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f5fbc066470 0x7f5fbc068930 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f5fc40ae000 tx=0x7f5fc40a7000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T17:35:13.024 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.015+0000 7f5fdad9d640 1 --2- 172.21.15.78:0/2746427705 >> [v2:172.21.15.187:6823/85774004,v1:172.21.15.187:6825/85774004] conn(0x7f5fbc06c770 0x7f5fbc06ebb0 crc :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T17:35:13.052 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.043+0000 7f5fd2ffd640 1 -- 172.21.15.78:0/2746427705 <== osd.7 v2:172.21.15.187:6823/85774004 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f5fbc06f280 con 0x7f5fbc06c770 2023-12-12T17:35:13.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.083+0000 7f5fdb59e640 1 -- 172.21.15.78:0/2746427705 --> [v2:172.21.15.187:6823/85774004,v1:172.21.15.187:6825/85774004] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f5fdc14f840 con 0x7f5fbc06c770 2023-12-12T17:35:13.093 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.087+0000 7f5fd2ffd640 1 -- 172.21.15.78:0/2746427705 <== osd.7 v2:172.21.15.187:6823/85774004 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f5fdc14f840 con 0x7f5fbc06c770 2023-12-12T17:35:13.094 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2023-12-12T17:35:13.094 INFO:teuthology.orchestra.run.smithi078.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2023-12-12T17:35:13.094 INFO:teuthology.orchestra.run.smithi078.stdout:} 2023-12-12T17:35:13.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.087+0000 7f5fdb59e640 1 -- 172.21.15.78:0/2746427705 >> [v2:172.21.15.187:6823/85774004,v1:172.21.15.187:6825/85774004] conn(0x7f5fbc06c770 msgr2=0x7f5fbc06ebb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:35:13.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.087+0000 7f5fdb59e640 1 --2- 172.21.15.78:0/2746427705 >> [v2:172.21.15.187:6823/85774004,v1:172.21.15.187:6825/85774004] conn(0x7f5fbc06c770 0x7f5fbc06ebb0 crc :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:13.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.087+0000 7f5fdb59e640 1 -- 172.21.15.78:0/2746427705 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f5fbc066470 msgr2=0x7f5fbc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:35:13.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.087+0000 7f5fdb59e640 1 --2- 172.21.15.78:0/2746427705 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f5fbc066470 0x7f5fbc068930 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f5fc40ae000 tx=0x7f5fc40a7000 comp rx=0 tx=0).stop 2023-12-12T17:35:13.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.087+0000 7f5fdb59e640 1 -- 172.21.15.78:0/2746427705 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5fdc0cfbc0 msgr2=0x7f5fdc15f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:35:13.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.087+0000 7f5fdb59e640 1 --2- 172.21.15.78:0/2746427705 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5fdc0cfbc0 0x7f5fdc15f090 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f5fcc00c4d0 tx=0x7f5fcc00c990 comp rx=0 tx=0).stop 2023-12-12T17:35:13.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.087+0000 7f5fdad9d640 1 -- 172.21.15.78:0/2746427705 reap_dead start 2023-12-12T17:35:13.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.087+0000 7f5fdb59e640 1 -- 172.21.15.78:0/2746427705 shutdown_connections 2023-12-12T17:35:13.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.087+0000 7f5fdb59e640 1 -- 172.21.15.78:0/2746427705 >> 172.21.15.78:0/2746427705 conn(0x7f5fdc0b2e30 msgr2=0x7f5fdc072e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T17:35:13.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.087+0000 7f5fdb59e640 1 -- 172.21.15.78:0/2746427705 shutdown_connections 2023-12-12T17:35:13.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.087+0000 7f5fdb59e640 1 -- 172.21.15.78:0/2746427705 wait complete. 2023-12-12T17:35:13.141 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-12-12T17:35:13.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.327+0000 7fa0f6e17640 1 Processor -- start 2023-12-12T17:35:13.334 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.327+0000 7fa0f6e17640 1 -- start start 2023-12-12T17:35:13.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.327+0000 7fa0f6e17640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa0f00716f0 0x7fa0f0071ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:35:13.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.327+0000 7fa0f6e17640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa0f0072010 0x7fa0f0146370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:35:13.335 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.327+0000 7fa0f6e17640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fa0f01468b0 0x7fa0f00b1f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:35:13.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.327+0000 7fa0f6e17640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0f0072730 con 0x7fa0f0072010 2023-12-12T17:35:13.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.327+0000 7fa0f6e17640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0f006d310 con 0x7fa0f01468b0 2023-12-12T17:35:13.336 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.327+0000 7fa0f6e17640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0f006d5f0 con 0x7fa0f00716f0 2023-12-12T17:35:13.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.327+0000 7fa0effff640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fa0f0072010 0x7fa0f0146370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:35:13.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.327+0000 7fa0f53b4640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fa0f01468b0 0x7fa0f00b1f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:35:13.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.327+0000 7fa0f53b4640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fa0f01468b0 0x7fa0f00b1f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.78:50826/0 (socket says 172.21.15.78:50826) 2023-12-12T17:35:13.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.327+0000 7fa0f53b4640 1 -- 172.21.15.78:0/3356296411 learned_addr learned my addr 172.21.15.78:0/3356296411 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T17:35:13.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.327+0000 7fa0f4bb3640 1 --2- 172.21.15.78:0/3356296411 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa0f00716f0 0x7fa0f0071ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:35:13.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.331+0000 7fa0f53b4640 1 -- 172.21.15.78:0/3356296411 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa0f00716f0 msgr2=0x7fa0f0071ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T17:35:13.337 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.331+0000 7fa0f53b4640 1 --2- 172.21.15.78:0/3356296411 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa0f00716f0 0x7fa0f0071ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:13.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.331+0000 7fa0f53b4640 1 -- 172.21.15.78:0/3356296411 >> v2:172.21.15.78:3300/0 conn(0x7fa0f0072010 msgr2=0x7fa0f0146370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T17:35:13.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.331+0000 7fa0f53b4640 1 --2- 172.21.15.78:0/3356296411 >> v2:172.21.15.78:3300/0 conn(0x7fa0f0072010 0x7fa0f0146370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:13.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.331+0000 7fa0f53b4640 1 -- 172.21.15.78:0/3356296411 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0f006d8d0 con 0x7fa0f01468b0 2023-12-12T17:35:13.338 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.331+0000 7fa0effff640 1 --2- 172.21.15.78:0/3356296411 >> v2:172.21.15.78:3300/0 conn(0x7fa0f0072010 0x7fa0f0146370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T17:35:13.339 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.331+0000 7fa0f53b4640 1 --2- 172.21.15.78:0/3356296411 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa0f01468b0 0x7fa0f00b1f20 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7fa0f00ced00 tx=0x7fa0e801c910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f60af756bbc29e4 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T17:35:13.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.331+0000 7fa0ef7fe640 1 -- 172.21.15.78:0/3356296411 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0e80a5790 con 0x7fa0f01468b0 2023-12-12T17:35:13.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.335+0000 7fa0ef7fe640 1 -- 172.21.15.78:0/3356296411 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0e80a58f0 con 0x7fa0f01468b0 2023-12-12T17:35:13.340 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.335+0000 7fa0ef7fe640 1 -- 172.21.15.78:0/3356296411 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0e80a5c80 con 0x7fa0f01468b0 2023-12-12T17:35:13.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.335+0000 7fa0f6e17640 1 -- 172.21.15.78:0/3356296411 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa0f01468b0 msgr2=0x7fa0f00b1f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:35:13.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.335+0000 7fa0f6e17640 1 --2- 172.21.15.78:0/3356296411 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa0f01468b0 0x7fa0f00b1f20 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7fa0f00ced00 tx=0x7fa0e801c910 comp rx=0 tx=0).stop 2023-12-12T17:35:13.341 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.335+0000 7fa0f6e17640 1 -- 172.21.15.78:0/3356296411 shutdown_connections 2023-12-12T17:35:13.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.335+0000 7fa0f6e17640 1 --2- 172.21.15.78:0/3356296411 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa0f01468b0 0x7fa0f00b1f20 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:13.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.335+0000 7fa0f6e17640 1 --2- 172.21.15.78:0/3356296411 >> v2:172.21.15.78:3300/0 conn(0x7fa0f0072010 0x7fa0f0146370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:13.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.335+0000 7fa0f6e17640 1 --2- 172.21.15.78:0/3356296411 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa0f00716f0 0x7fa0f0071ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:13.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.335+0000 7fa0f6e17640 1 -- 172.21.15.78:0/3356296411 >> 172.21.15.78:0/3356296411 conn(0x7fa0f006a710 msgr2=0x7fa0f006ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T17:35:13.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.335+0000 7fa0f6e17640 1 -- 172.21.15.78:0/3356296411 shutdown_connections 2023-12-12T17:35:13.342 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.335+0000 7fa0f6e17640 1 -- 172.21.15.78:0/3356296411 wait complete. 2023-12-12T17:35:13.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.335+0000 7fa0f6e17640 1 Processor -- start 2023-12-12T17:35:13.343 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.335+0000 7fa0f6e17640 1 -- start start 2023-12-12T17:35:13.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.335+0000 7fa0f6e17640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa0f00716f0 0x7fa0f0158af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:35:13.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.335+0000 7fa0f6e17640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa0f0072010 0x7fa0f00ae990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:35:13.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.335+0000 7fa0f6e17640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa0f01468b0 0x7fa0f00aeed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:35:13.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.339+0000 7fa0f6e17640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0f013f400 con 0x7fa0f01468b0 2023-12-12T17:35:13.344 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.339+0000 7fa0f6e17640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0f00b03c0 con 0x7fa0f0072010 2023-12-12T17:35:13.345 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.339+0000 7fa0f6e17640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0f013fbd0 con 0x7fa0f00716f0 2023-12-12T17:35:13.346 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.339+0000 7fa0f53b4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa0f01468b0 0x7fa0f00aeed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:35:13.346 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.339+0000 7fa0f53b4640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa0f01468b0 0x7fa0f00aeed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55110/0 (socket says 172.21.15.78:55110) 2023-12-12T17:35:13.346 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.339+0000 7fa0f53b4640 1 -- 172.21.15.78:0/1988577399 learned_addr learned my addr 172.21.15.78:0/1988577399 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T17:35:13.346 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.339+0000 7fa0f4bb3640 1 --2- 172.21.15.78:0/1988577399 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa0f00716f0 0x7fa0f0158af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:35:13.346 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.339+0000 7fa0effff640 1 --2- 172.21.15.78:0/1988577399 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa0f0072010 0x7fa0f00ae990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:35:13.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.339+0000 7fa0f53b4640 1 -- 172.21.15.78:0/1988577399 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa0f00716f0 msgr2=0x7fa0f0158af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:35:13.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.339+0000 7fa0f53b4640 1 --2- 172.21.15.78:0/1988577399 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa0f00716f0 0x7fa0f0158af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:13.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.339+0000 7fa0f53b4640 1 -- 172.21.15.78:0/1988577399 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa0f0072010 msgr2=0x7fa0f00ae990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:35:13.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.339+0000 7fa0f53b4640 1 --2- 172.21.15.78:0/1988577399 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa0f0072010 0x7fa0f00ae990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:13.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.339+0000 7fa0f53b4640 1 -- 172.21.15.78:0/1988577399 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0e8009b30 con 0x7fa0f01468b0 2023-12-12T17:35:13.347 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.339+0000 7fa0f4bb3640 1 --2- 172.21.15.78:0/1988577399 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa0f00716f0 0x7fa0f0158af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-12T17:35:13.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.339+0000 7fa0f53b4640 1 --2- 172.21.15.78:0/1988577399 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa0f01468b0 0x7fa0f00aeed0 secure :-1 s=READY pgs=2143 cs=0 l=1 rev1=1 crypto rx=0x7fa0e80af040 tx=0x7fa0e80196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T17:35:13.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.339+0000 7fa0ed7fa640 1 -- 172.21.15.78:0/1988577399 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0e80b8640 con 0x7fa0f01468b0 2023-12-12T17:35:13.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.339+0000 7fa0ed7fa640 1 -- 172.21.15.78:0/1988577399 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0e80b87a0 con 0x7fa0f01468b0 2023-12-12T17:35:13.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.339+0000 7fa0f6e17640 1 -- 172.21.15.78:0/1988577399 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0f01f5a70 con 0x7fa0f01468b0 2023-12-12T17:35:13.348 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.339+0000 7fa0ed7fa640 1 -- 172.21.15.78:0/1988577399 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0e80b8b10 con 0x7fa0f01468b0 2023-12-12T17:35:13.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.339+0000 7fa0f6e17640 1 -- 172.21.15.78:0/1988577399 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0f013f8f0 con 0x7fa0f01468b0 2023-12-12T17:35:13.349 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.343+0000 7fa0f6e17640 1 -- 172.21.15.78:0/1988577399 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0f00671f0 con 0x7fa0f01468b0 2023-12-12T17:35:13.352 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.343+0000 7fa0ed7fa640 1 -- 172.21.15.78:0/1988577399 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa0e80b8c70 con 0x7fa0f01468b0 2023-12-12T17:35:13.355 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.347+0000 7fa0ed7fa640 1 --2- 172.21.15.78:0/1988577399 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fa0d0066470 0x7fa0d0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:35:13.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.347+0000 7fa0f4bb3640 1 --2- 172.21.15.78:0/1988577399 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fa0d0066470 0x7fa0d0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:35:13.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.347+0000 7fa0ed7fa640 1 -- 172.21.15.78:0/1988577399 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fa0e811f020 con 0x7fa0f01468b0 2023-12-12T17:35:13.356 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.351+0000 7fa0f4bb3640 1 --2- 172.21.15.78:0/1988577399 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fa0d0066470 0x7fa0d0068930 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fa0e0004630 tx=0x7fa0e0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T17:35:13.368 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.363+0000 7fa0ed7fa640 1 -- 172.21.15.78:0/1988577399 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa0e80ec830 con 0x7fa0f01468b0 2023-12-12T17:35:13.833 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.827+0000 7fa0f6e17640 1 -- 172.21.15.78:0/1988577399 --> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7fa0f0070560 con 0x7fa0d0066470 2023-12-12T17:35:13.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.827+0000 7fa0ed7fa640 1 -- 172.21.15.78:0/1988577399 <== mgr.4104 v2:172.21.15.78:6832/1725498448 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fa0f0070560 con 0x7fa0d0066470 2023-12-12T17:35:13.834 INFO:teuthology.orchestra.run.smithi078.stderr:instructed osd(s) 7 to deep-scrub 2023-12-12T17:35:13.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.831+0000 7fa0f6e17640 1 -- 172.21.15.78:0/1988577399 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fa0d0066470 msgr2=0x7fa0d0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:35:13.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.831+0000 7fa0f6e17640 1 --2- 172.21.15.78:0/1988577399 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fa0d0066470 0x7fa0d0068930 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fa0e0004630 tx=0x7fa0e0008040 comp rx=0 tx=0).stop 2023-12-12T17:35:13.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.831+0000 7fa0f6e17640 1 -- 172.21.15.78:0/1988577399 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa0f01468b0 msgr2=0x7fa0f00aeed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:35:13.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.831+0000 7fa0f6e17640 1 --2- 172.21.15.78:0/1988577399 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa0f01468b0 0x7fa0f00aeed0 secure :-1 s=READY pgs=2143 cs=0 l=1 rev1=1 crypto rx=0x7fa0e80af040 tx=0x7fa0e80196b0 comp rx=0 tx=0).stop 2023-12-12T17:35:13.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.831+0000 7fa0f6e17640 1 -- 172.21.15.78:0/1988577399 shutdown_connections 2023-12-12T17:35:13.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.831+0000 7fa0f6e17640 1 --2- 172.21.15.78:0/1988577399 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fa0d0066470 0x7fa0d0068930 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:13.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.831+0000 7fa0f6e17640 1 --2- 172.21.15.78:0/1988577399 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fa0f01468b0 0x7fa0f00aeed0 unknown :-1 s=CLOSED pgs=2143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:13.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.831+0000 7fa0f6e17640 1 --2- 172.21.15.78:0/1988577399 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa0f0072010 0x7fa0f00ae990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:13.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.831+0000 7fa0f6e17640 1 --2- 172.21.15.78:0/1988577399 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa0f00716f0 0x7fa0f0158af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:13.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.831+0000 7fa0f6e17640 1 -- 172.21.15.78:0/1988577399 >> 172.21.15.78:0/1988577399 conn(0x7fa0f006a710 msgr2=0x7fa0f015dc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T17:35:13.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.831+0000 7fa0f6e17640 1 -- 172.21.15.78:0/1988577399 shutdown_connections 2023-12-12T17:35:13.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:13.831+0000 7fa0f6e17640 1 -- 172.21.15.78:0/1988577399 wait complete. 2023-12-12T17:35:13.866 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-12T17:35:14.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:14.067+0000 7f1b7b49f640 1 Processor -- start 2023-12-12T17:35:14.073 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:14.067+0000 7f1b7b49f640 1 -- start start 2023-12-12T17:35:14.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:14.071+0000 7f1b7b49f640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f1b741436b0 0x7f1b7415a910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:35:14.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:14.071+0000 7f1b7b49f640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f1b740719a0 0x7f1b740cf0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:35:14.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:14.071+0000 7f1b7b49f640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b740b2640 con 0x7f1b740cec50 2023-12-12T17:35:14.077 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:14.071+0000 7f1b7b49f640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b740cf600 con 0x7f1b740719a0 2023-12-12T17:35:14.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:14.071+0000 7f1b7b49f640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b740b2920 con 0x7f1b741436b0 2023-12-12T17:35:14.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:14.071+0000 7f1b7ac9e640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f1b740719a0 0x7f1b740cf0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:35:14.078 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:14.071+0000 7f1b7ac9e640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7f1b740719a0 0x7f1b740cf0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:55126/0 (socket says 172.21.15.78:55126) 2023-12-12T17:35:14.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:14.071+0000 7f1b7ac9e640 1 -- 172.21.15.78:0/2479991348 learned_addr learned my addr 172.21.15.78:0/2479991348 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T17:35:14.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:14.071+0000 7f1b7a49d640 1 --2- 172.21.15.78:0/2479991348 >> v2:172.21.15.187:3300/0 conn(0x7f1b741436b0 0x7f1b7415a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:35:14.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:14.071+0000 7f1b7ac9e640 1 -- 172.21.15.78:0/2479991348 >> v2:172.21.15.187:3300/0 conn(0x7f1b741436b0 msgr2=0x7f1b7415a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T17:35:14.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:14.071+0000 7f1b7ac9e640 1 --2- 172.21.15.78:0/2479991348 >> v2:172.21.15.187:3300/0 conn(0x7f1b741436b0 0x7f1b7415a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:14.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:14.071+0000 7f1b7ac9e640 1 -- 172.21.15.78:0/2479991348 >> v1:172.21.15.187:6789/0 conn(0x7f1b740cec50 legacy=0x7f1b7406d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:35:14.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:14.071+0000 7f1b7ac9e640 1 -- 172.21.15.78:0/2479991348 --> v2:172.21.15.78:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b740b2c00 con 0x7f1b740719a0 2023-12-12T17:35:14.079 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:14.071+0000 7f1b7949b640 1 -- 172.21.15.78:0/2479991348 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2768333275 0 0) 0x7f1b740b2640 con 0x7f1b740cec50 2023-12-12T17:35:14.081 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:14.075+0000 7f1b7ac9e640 1 --2- 172.21.15.78:0/2479991348 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1b740719a0 0x7f1b740cf0c0 secure :-1 s=READY pgs=2144 cs=0 l=1 rev1=1 crypto rx=0x7f1b7406e280 tx=0x7f1b6c01eb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce4818b4057ea41d server_cookie=0 in_seq=0 out_seq=0 2023-12-12T17:35:14.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:14.075+0000 7f1b7949b640 1 -- 172.21.15.78:0/2479991348 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b6c00b2d0 con 0x7f1b740719a0 2023-12-12T17:35:14.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:14.075+0000 7f1b7949b640 1 -- 172.21.15.78:0/2479991348 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b6c00b430 con 0x7f1b740719a0 2023-12-12T17:35:14.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:14.075+0000 7f1b7949b640 1 -- 172.21.15.78:0/2479991348 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b6c0a7b30 con 0x7f1b740719a0 2023-12-12T17:35:14.082 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:14.075+0000 7f1b7b49f640 1 -- 172.21.15.78:0/2479991348 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1b740719a0 msgr2=0x7f1b740cf0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:35:14.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:14.075+0000 7f1b7b49f640 1 --2- 172.21.15.78:0/2479991348 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1b740719a0 0x7f1b740cf0c0 secure :-1 s=READY pgs=2144 cs=0 l=1 rev1=1 crypto rx=0x7f1b7406e280 tx=0x7f1b6c01eb40 comp rx=0 tx=0).stop 2023-12-12T17:35:14.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:14.075+0000 7f1b7b49f640 1 -- 172.21.15.78:0/2479991348 shutdown_connections 2023-12-12T17:35:14.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:14.075+0000 7f1b7b49f640 1 --2- 172.21.15.78:0/2479991348 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1b740719a0 0x7f1b740cf0c0 unknown :-1 s=CLOSED pgs=2144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:14.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:14.075+0000 7f1b7b49f640 1 --2- 172.21.15.78:0/2479991348 >> v2:172.21.15.187:3300/0 conn(0x7f1b741436b0 0x7f1b7415a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:14.083 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:14.075+0000 7f1b7b49f640 1 -- 172.21.15.78:0/2479991348 >> 172.21.15.78:0/2479991348 conn(0x7f1b7406a710 msgr2=0x7f1b7406ab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T17:35:14.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:14.075+0000 7f1b7b49f640 1 -- 172.21.15.78:0/2479991348 shutdown_connections 2023-12-12T17:35:14.084 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:14.075+0000 7f1b7b49f640 1 -- 172.21.15.78:0/2479991348 wait complete. 2023-12-12T17:35:14.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:14.079+0000 7f1b7b49f640 1 Processor -- start 2023-12-12T17:35:14.085 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:14.079+0000 7f1b7b49f640 1 -- start start 2023-12-12T17:35:14.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:14.079+0000 7f1b7b49f640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1b740719a0 0x7f1b74132e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:35:14.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:14.079+0000 7f1b7b49f640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1b740cec50 0x7f1b7415fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:35:14.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:14.079+0000 7f1b7b49f640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1b741436b0 0x7f1b74150550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:35:14.088 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:14.083+0000 7f1b7b49f640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b741333a0 con 0x7f1b741436b0 2023-12-12T17:35:14.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:14.083+0000 7f1b7b49f640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b74130740 con 0x7f1b740cec50 2023-12-12T17:35:14.089 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:14.083+0000 7f1b7b49f640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b74130a20 con 0x7f1b740719a0 2023-12-12T17:35:14.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:14.083+0000 7f1b79c9c640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1b740cec50 0x7f1b7415fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:35:14.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:14.083+0000 7f1b79c9c640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1b740cec50 0x7f1b7415fa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.78:50842/0 (socket says 172.21.15.78:50842) 2023-12-12T17:35:14.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:14.083+0000 7f1b79c9c640 1 -- 172.21.15.78:0/27493897 learned_addr learned my addr 172.21.15.78:0/27493897 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T17:35:14.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:14.083+0000 7f1b7a49d640 1 --2- 172.21.15.78:0/27493897 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1b740719a0 0x7f1b74132e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:35:14.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:14.083+0000 7f1b7ac9e640 1 --2- 172.21.15.78:0/27493897 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1b741436b0 0x7f1b74150550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:35:14.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:14.083+0000 7f1b79c9c640 1 -- 172.21.15.78:0/27493897 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1b740719a0 msgr2=0x7f1b74132e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:35:14.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:14.083+0000 7f1b79c9c640 1 --2- 172.21.15.78:0/27493897 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1b740719a0 0x7f1b74132e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:14.090 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:14.083+0000 7f1b79c9c640 1 -- 172.21.15.78:0/27493897 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1b741436b0 msgr2=0x7f1b74150550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:35:14.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:14.083+0000 7f1b79c9c640 1 --2- 172.21.15.78:0/27493897 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1b741436b0 0x7f1b74150550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:14.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:14.083+0000 7f1b79c9c640 1 -- 172.21.15.78:0/27493897 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b6c00bd40 con 0x7f1b740cec50 2023-12-12T17:35:14.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:14.083+0000 7f1b7ac9e640 1 --2- 172.21.15.78:0/27493897 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1b741436b0 0x7f1b74150550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T17:35:14.091 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:14.083+0000 7f1b79c9c640 1 --2- 172.21.15.78:0/27493897 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1b740cec50 0x7f1b7415fa30 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f1b6400c550 tx=0x7f1b6400ca10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T17:35:14.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:14.083+0000 7f1b6affd640 1 -- 172.21.15.78:0/27493897 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b64005500 con 0x7f1b740cec50 2023-12-12T17:35:14.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:14.083+0000 7f1b6affd640 1 -- 172.21.15.78:0/27493897 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b64003650 con 0x7f1b740cec50 2023-12-12T17:35:14.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:14.083+0000 7f1b6affd640 1 -- 172.21.15.78:0/27493897 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b64003a00 con 0x7f1b740cec50 2023-12-12T17:35:14.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:14.083+0000 7f1b7b49f640 1 -- 172.21.15.78:0/27493897 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b74130d00 con 0x7f1b740cec50 2023-12-12T17:35:14.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:14.083+0000 7f1b7b49f640 1 -- 172.21.15.78:0/27493897 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b741312c0 con 0x7f1b740cec50 2023-12-12T17:35:14.092 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:14.083+0000 7f1b7b49f640 1 -- 172.21.15.78:0/27493897 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b740671f0 con 0x7f1b740cec50 2023-12-12T17:35:14.094 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:14.087+0000 7f1b6affd640 1 -- 172.21.15.78:0/27493897 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f1b64003b60 con 0x7f1b740cec50 2023-12-12T17:35:14.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:14.087+0000 7f1b6affd640 1 --2- 172.21.15.78:0/27493897 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f1b58066470 0x7f1b58068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:35:14.095 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:14.087+0000 7f1b6affd640 1 -- 172.21.15.78:0/27493897 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f1b64083290 con 0x7f1b740cec50 2023-12-12T17:35:14.096 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:14.087+0000 7f1b7a49d640 1 --2- 172.21.15.78:0/27493897 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f1b58066470 0x7f1b58068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:35:14.097 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:14.091+0000 7f1b7a49d640 1 --2- 172.21.15.78:0/27493897 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f1b58066470 0x7f1b58068930 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f1b70009ac0 tx=0x7f1b70009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T17:35:14.100 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:14.095+0000 7f1b6affd640 1 -- 172.21.15.78:0/27493897 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1b64050980 con 0x7f1b740cec50 2023-12-12T17:35:14.549 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:14.543+0000 7f1b7b49f640 1 -- 172.21.15.78:0/27493897 --> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1b7406c0b0 con 0x7f1b58066470 2023-12-12T17:35:14.555 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:14.547+0000 7f1b6affd640 1 -- 172.21.15.78:0/27493897 <== mgr.4104 v2:172.21.15.78:6832/1725498448 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+49264 (secure 0 0 0) 0x7f1b700119e0 con 0x7f1b58066470 2023-12-12T17:35:14.557 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T17:35:14.557 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2023-12-12T17:35:14.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:14.551+0000 7f1b7b49f640 1 -- 172.21.15.78:0/27493897 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f1b58066470 msgr2=0x7f1b58068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:35:14.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:14.551+0000 7f1b7b49f640 1 --2- 172.21.15.78:0/27493897 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f1b58066470 0x7f1b58068930 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f1b70009ac0 tx=0x7f1b70009190 comp rx=0 tx=0).stop 2023-12-12T17:35:14.560 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:14.551+0000 7f1b7b49f640 1 -- 172.21.15.78:0/27493897 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1b740cec50 msgr2=0x7f1b7415fa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:35:14.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:14.551+0000 7f1b7b49f640 1 --2- 172.21.15.78:0/27493897 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1b740cec50 0x7f1b7415fa30 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f1b6400c550 tx=0x7f1b6400ca10 comp rx=0 tx=0).stop 2023-12-12T17:35:14.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:14.551+0000 7f1b7b49f640 1 -- 172.21.15.78:0/27493897 shutdown_connections 2023-12-12T17:35:14.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:14.551+0000 7f1b7b49f640 1 --2- 172.21.15.78:0/27493897 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f1b58066470 0x7f1b58068930 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:14.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:14.551+0000 7f1b7b49f640 1 --2- 172.21.15.78:0/27493897 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f1b741436b0 0x7f1b74150550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:14.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:14.551+0000 7f1b7b49f640 1 --2- 172.21.15.78:0/27493897 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1b740cec50 0x7f1b7415fa30 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:14.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:14.551+0000 7f1b7b49f640 1 --2- 172.21.15.78:0/27493897 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1b740719a0 0x7f1b74132e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:14.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:14.551+0000 7f1b7b49f640 1 -- 172.21.15.78:0/27493897 >> 172.21.15.78:0/27493897 conn(0x7f1b7406a710 msgr2=0x7f1b7415ddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T17:35:14.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:14.555+0000 7f1b7b49f640 1 -- 172.21.15.78:0/27493897 shutdown_connections 2023-12-12T17:35:14.561 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:14.555+0000 7f1b7b49f640 1 -- 172.21.15.78:0/27493897 wait complete. 2023-12-12T17:35:14.611 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":13321,"stamp":"2023-12-12T17:35:12.582919+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":12748196,"kb_used_data":5220,"kb_used_omap":3470,"kb_used_meta":12739441,"kb_avail":742226524,"statfs":{"total":773094113280,"available":760039960576,"internally_reserved":0,"allocated":5345280,"data_stored":2982615,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3554275,"internal_metadata":13045187613},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11364,"apply_latency_ms":11364,"commit_latency_ns":11364000000,"apply_latency_ns":11364000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002646"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":405,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-12T17:34:43.953907+0000","last_change":"2023-12-12T10:11:58.492812+0000","last_active":"2023-12-12T17:34:43.953907+0000","last_peered":"2023-12-12T17:34:43.953907+0000","last_clean":"2023-12-12T17:34:43.953907+0000","last_became_active":"2023-12-12T10:11:58.491470+0000","last_became_peered":"2023-12-12T10:11:58.491470+0000","last_unstale":"2023-12-12T17:34:43.953907+0000","last_undegraded":"2023-12-12T17:34:43.953907+0000","last_fullsized":"2023-12-12T17:34:43.953907+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-12T10:11:57.289641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-12T10:11:57.289641+0000","last_clean_scrub_stamp":"2023-12-12T10:11:57.289641+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T12:10:37.809139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834580167,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1607752,"kb_used_data":1088,"kb_used_omap":161,"kb_used_meta":1606494,"kb_avail":92764088,"statfs":{"total":96636764160,"available":94990426112,"internally_reserved":0,"allocated":1114112,"data_stored":815724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":165859,"internal_metadata":1645049885},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 17:34:08 2023","interfaces":[{"interface":"back","average":{"1min":2.952,"5min":1.784,"15min":1.762},"min":{"1min":0.39200000000000002,"5min":0.35999999999999999,"15min":0.30599999999999999},"max":{"1min":21.974,"5min":21.974,"15min":21.974},"last":0.76400000000000001},{"interface":"front","average":{"1min":2.931,"5min":2.367,"15min":1.8959999999999999},"min":{"1min":0.45100000000000001,"5min":0.38900000000000001,"15min":0.30199999999999999},"max":{"1min":22.475999999999999,"5min":22.475999999999999,"15min":22.475999999999999},"last":1.0309999999999999}]},{"osd":1,"last update":"Tue Dec 12 17:34:08 2023","interfaces":[{"interface":"back","average":{"1min":1.954,"5min":1.9039999999999999,"15min":1.9159999999999999},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.35599999999999998},"max":{"1min":8.8350000000000009,"5min":10.756,"15min":24.129000000000001},"last":0.95499999999999996},{"interface":"front","average":{"1min":2.0529999999999999,"5min":1.726,"15min":1.859},"min":{"1min":0.36399999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":9.0660000000000007,"5min":9.0660000000000007,"15min":10.593999999999999},"last":0.73299999999999998}]},{"osd":2,"last update":"Tue Dec 12 17:34:08 2023","interfaces":[{"interface":"back","average":{"1min":2.7280000000000002,"5min":2.1640000000000001,"15min":2.044},"min":{"1min":0.57199999999999995,"5min":0.41699999999999998,"15min":0.374},"max":{"1min":8.9410000000000007,"5min":11.038,"15min":11.038},"last":0.79700000000000004},{"interface":"front","average":{"1min":1.8049999999999999,"5min":2.1789999999999998,"15min":1.909},"min":{"1min":0.52200000000000002,"5min":0.51500000000000001,"15min":0.41899999999999998},"max":{"1min":12.380000000000001,"5min":19.434999999999999,"15min":19.434999999999999},"last":0.82099999999999995}]},{"osd":3,"last update":"Tue Dec 12 17:34:08 2023","interfaces":[{"interface":"back","average":{"1min":2.1970000000000001,"5min":2.9049999999999998,"15min":2.2759999999999998},"min":{"1min":0.55700000000000005,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":8.8680000000000003,"5min":113.107,"15min":113.107},"last":1.089},{"interface":"front","average":{"1min":2.3769999999999998,"5min":3.2490000000000001,"15min":2.2890000000000001},"min":{"1min":0.57699999999999996,"5min":0.49299999999999999,"15min":0.40699999999999997},"max":{"1min":8.9890000000000008,"5min":109.90900000000001,"15min":109.90900000000001},"last":1.1040000000000001}]},{"osd":4,"last update":"Tue Dec 12 17:34:08 2023","interfaces":[{"interface":"back","average":{"1min":1.496,"5min":1.0349999999999999,"15min":0.74099999999999999},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":12.436999999999999,"5min":12.436999999999999,"15min":12.436999999999999},"last":0.78000000000000003},{"interface":"front","average":{"1min":1.484,"5min":0.93200000000000005,"15min":0.751},"min":{"1min":0.42099999999999999,"5min":0.40200000000000002,"15min":0.33400000000000002},"max":{"1min":8.7880000000000003,"5min":8.7880000000000003,"15min":8.7880000000000003},"last":0.67500000000000004}]},{"osd":5,"last update":"Tue Dec 12 17:34:08 2023","interfaces":[{"interface":"back","average":{"1min":1.5169999999999999,"5min":0.85099999999999998,"15min":0.67700000000000005},"min":{"1min":0.39100000000000001,"5min":0.33300000000000002,"15min":0.32800000000000001},"max":{"1min":9.3640000000000008,"5min":9.3640000000000008,"15min":9.3640000000000008},"last":0.68999999999999995},{"interface":"front","average":{"1min":1.3999999999999999,"5min":1.0469999999999999,"15min":0.75},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.33900000000000002},"max":{"1min":12.48,"5min":12.48,"15min":12.48},"last":0.71499999999999997}]},{"osd":6,"last update":"Tue Dec 12 17:34:08 2023","interfaces":[{"interface":"back","average":{"1min":1.5469999999999999,"5min":1.123,"15min":0.81999999999999995},"min":{"1min":0.47899999999999998,"5min":0.441,"15min":0.41999999999999998},"max":{"1min":12.528,"5min":12.528,"15min":12.528},"last":0.85299999999999998},{"interface":"front","average":{"1min":1.294,"5min":0.94799999999999995,"15min":0.78100000000000003},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.35099999999999998},"max":{"1min":8.8979999999999997,"5min":8.8979999999999997,"15min":8.8979999999999997},"last":0.60699999999999998}]}]},{"osd":6,"up_from":13,"seq":55834580168,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1458308,"kb_used_data":508,"kb_used_omap":247,"kb_used_meta":1457544,"kb_avail":92913532,"statfs":{"total":96636764160,"available":95143456768,"internally_reserved":0,"allocated":520192,"data_stored":225356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":253535,"internal_metadata":1492525473},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 17:34:50 2023","interfaces":[{"interface":"back","average":{"1min":3.3559999999999999,"5min":2.069,"15min":1.776},"min":{"1min":0.45000000000000001,"5min":0.34000000000000002,"15min":0.32900000000000001},"max":{"1min":11.975,"5min":18.879000000000001,"15min":18.879000000000001},"last":0.82599999999999996},{"interface":"front","average":{"1min":4.7919999999999998,"5min":2.6800000000000002,"15min":1.952},"min":{"1min":0.501,"5min":0.35099999999999998,"15min":0.30599999999999999},"max":{"1min":43.396000000000001,"5min":43.396000000000001,"15min":43.396000000000001},"last":0.86499999999999999}]},{"osd":1,"last update":"Tue Dec 12 17:34:50 2023","interfaces":[{"interface":"back","average":{"1min":3.2669999999999999,"5min":2.0899999999999999,"15min":1.8180000000000001},"min":{"1min":0.54900000000000004,"5min":0.376,"15min":0.34699999999999998},"max":{"1min":10.798999999999999,"5min":18.826000000000001,"15min":18.826000000000001},"last":0.755},{"interface":"front","average":{"1min":3.0369999999999999,"5min":2.0089999999999999,"15min":1.8129999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.372},"max":{"1min":13.426,"5min":16.858000000000001,"15min":16.858000000000001},"last":0.497}]},{"osd":2,"last update":"Tue Dec 12 17:34:50 2023","interfaces":[{"interface":"back","average":{"1min":2.2490000000000001,"5min":1.829,"15min":1.8879999999999999},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":11.254,"5min":19,"15min":19},"last":0.79700000000000004},{"interface":"front","average":{"1min":1.6879999999999999,"5min":2.0419999999999998,"15min":1.903},"min":{"1min":0.54700000000000004,"5min":0.47099999999999997,"15min":0.40799999999999997},"max":{"1min":6.0899999999999999,"5min":34.941000000000003,"15min":34.941000000000003},"last":0.93000000000000005}]},{"osd":3,"last update":"Tue Dec 12 17:34:50 2023","interfaces":[{"interface":"back","average":{"1min":3.0819999999999999,"5min":2.7679999999999998,"15min":2.121},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":17.741,"5min":88.251999999999995,"15min":88.251999999999995},"last":0.70899999999999996},{"interface":"front","average":{"1min":5.5380000000000003,"5min":3.6200000000000001,"15min":2.3620000000000001},"min":{"1min":0.627,"5min":0.44,"15min":0.44},"max":{"1min":32.055999999999997,"5min":80.805999999999997,"15min":80.805999999999997},"last":0.89800000000000002}]},{"osd":4,"last update":"Tue Dec 12 17:34:50 2023","interfaces":[{"interface":"back","average":{"1min":1.802,"5min":1.226,"15min":0.80100000000000005},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.318},"max":{"1min":12.010999999999999,"5min":16.427,"15min":16.427},"last":0.74299999999999999},{"interface":"front","average":{"1min":1.379,"5min":1.1359999999999999,"15min":0.77400000000000002},"min":{"1min":0.39900000000000002,"5min":0.36599999999999999,"15min":0.28100000000000003},"max":{"1min":10.835000000000001,"5min":18.933,"15min":18.933},"last":0.67600000000000005}]},{"osd":5,"last update":"Tue Dec 12 17:34:50 2023","interfaces":[{"interface":"back","average":{"1min":1.903,"5min":1.1759999999999999,"15min":1.204},"min":{"1min":0.44900000000000001,"5min":0.40899999999999997,"15min":0.36499999999999999},"max":{"1min":13.535,"5min":13.535,"15min":123.398},"last":0.77400000000000002},{"interface":"front","average":{"1min":1.7170000000000001,"5min":1.2430000000000001,"15min":1.2330000000000001},"min":{"1min":0.41199999999999998,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":10.693,"5min":18.969000000000001,"15min":121.617},"last":0.61499999999999999}]},{"osd":7,"last update":"Tue Dec 12 17:34:50 2023","interfaces":[{"interface":"back","average":{"1min":1.5760000000000001,"5min":1.1100000000000001,"15min":0.80100000000000005},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":8.9410000000000007,"5min":21.306000000000001,"15min":21.306000000000001},"last":0.55700000000000005},{"interface":"front","average":{"1min":2.613,"5min":1.3440000000000001,"15min":0.90400000000000003},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":23.573,"5min":23.573,"15min":23.573},"last":0.64900000000000002}]}]},{"osd":5,"up_from":13,"seq":55834580166,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1716292,"kb_used_data":508,"kb_used_omap":1077,"kb_used_meta":1714698,"kb_avail":92655548,"statfs":{"total":96636764160,"available":94879281152,"internally_reserved":0,"allocated":520192,"data_stored":225356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1102957,"internal_metadata":1755851667},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 17:34:44 2023","interfaces":[{"interface":"back","average":{"1min":2.6600000000000001,"5min":1.718,"15min":1.6759999999999999},"min":{"1min":0.376,"5min":0.36899999999999999,"15min":0.313},"max":{"1min":10.356999999999999,"5min":13.279,"15min":13.279},"last":0.81000000000000005},{"interface":"front","average":{"1min":2.0230000000000001,"5min":1.8460000000000001,"15min":1.744},"min":{"1min":0.50600000000000001,"5min":0.37,"15min":0.32100000000000001},"max":{"1min":10.586,"5min":10.586,"15min":10.586},"last":0.67900000000000005}]},{"osd":1,"last update":"Tue Dec 12 17:34:44 2023","interfaces":[{"interface":"back","average":{"1min":2.452,"5min":2.1179999999999999,"15min":2.032},"min":{"1min":0.51200000000000001,"5min":0.42299999999999999,"15min":0.38400000000000001},"max":{"1min":10.776,"5min":10.776,"15min":17.175000000000001},"last":0.75600000000000001},{"interface":"front","average":{"1min":2.266,"5min":1.579,"15min":1.607},"min":{"1min":0.65500000000000003,"5min":0.379,"15min":0.379},"max":{"1min":8.5440000000000005,"5min":8.5440000000000005,"15min":12.363},"last":0.875}]},{"osd":2,"last update":"Tue Dec 12 17:34:44 2023","interfaces":[{"interface":"back","average":{"1min":3.3119999999999998,"5min":2.0430000000000001,"15min":1.8640000000000001},"min":{"1min":0.52400000000000002,"5min":0.40899999999999997,"15min":0.40100000000000002},"max":{"1min":16.010999999999999,"5min":16.010999999999999,"15min":16.010999999999999},"last":1.2410000000000001},{"interface":"front","average":{"1min":3.274,"5min":2.0649999999999999,"15min":1.929},"min":{"1min":0.64600000000000002,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":16.209,"5min":16.209,"15min":16.209},"last":1.296}]},{"osd":3,"last update":"Tue Dec 12 17:34:44 2023","interfaces":[{"interface":"back","average":{"1min":2.6059999999999999,"5min":2.2559999999999998,"15min":2.1930000000000001},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":12.015000000000001,"5min":32.682000000000002,"15min":32.682000000000002},"last":1.032},{"interface":"front","average":{"1min":2.7349999999999999,"5min":2.0089999999999999,"15min":2.0489999999999999},"min":{"1min":0.55900000000000005,"5min":0.54400000000000004,"15min":0.42799999999999999},"max":{"1min":10.516999999999999,"5min":10.897,"15min":10.897},"last":0.78400000000000003}]},{"osd":4,"last update":"Tue Dec 12 17:34:44 2023","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.753,"15min":0.66300000000000003},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":6.3639999999999999,"5min":6.3639999999999999,"15min":6.3639999999999999},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.73599999999999999,"15min":0.67000000000000004},"min":{"1min":0.41399999999999998,"5min":0.374,"15min":0.34000000000000002},"max":{"1min":1.6619999999999999,"5min":4.4000000000000004,"15min":4.4000000000000004},"last":0.65300000000000002}]},{"osd":6,"last update":"Tue Dec 12 17:34:44 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.81499999999999995,"15min":0.69099999999999995},"min":{"1min":0.39100000000000001,"5min":0.35599999999999998,"15min":0.34100000000000003},"max":{"1min":2.9609999999999999,"5min":10.016,"15min":10.016},"last":0.53800000000000003},{"interface":"front","average":{"1min":1.012,"5min":0.82399999999999995,"15min":0.70099999999999996},"min":{"1min":0.44800000000000001,"5min":0.39300000000000002,"15min":0.34999999999999998},"max":{"1min":7.0049999999999999,"5min":7.0049999999999999,"15min":7.0049999999999999},"last":0.60099999999999998}]},{"osd":7,"last update":"Tue Dec 12 17:34:44 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.76700000000000002,"15min":0.69199999999999995},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":4.109,"5min":4.109,"15min":4.109},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.81000000000000005,"15min":0.73799999999999999},"min":{"1min":0.433,"5min":0.41499999999999998,"15min":0.39600000000000002},"max":{"1min":2.7280000000000002,"5min":3.407,"15min":3.875},"last":0.63200000000000001}]}]},{"osd":4,"up_from":13,"seq":55834580170,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1675844,"kb_used_data":508,"kb_used_omap":861,"kb_used_meta":1674466,"kb_avail":92695996,"statfs":{"total":96636764160,"available":94920699904,"internally_reserved":0,"allocated":520192,"data_stored":225356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":882141,"internal_metadata":1714653731},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 17:34:41 2023","interfaces":[{"interface":"back","average":{"1min":2.0059999999999998,"5min":1.7649999999999999,"15min":2.1789999999999998},"min":{"1min":0.498,"5min":0.36799999999999999,"15min":0.31900000000000001},"max":{"1min":6.0460000000000003,"5min":9.4499999999999993,"15min":170.917},"last":0.53300000000000003},{"interface":"front","average":{"1min":1.52,"5min":1.643,"15min":2.0910000000000002},"min":{"1min":0.47299999999999998,"5min":0.39700000000000002,"15min":0.33800000000000002},"max":{"1min":6.218,"5min":9.3119999999999994,"15min":170.74199999999999},"last":0.67800000000000005}]},{"osd":1,"last update":"Tue Dec 12 17:34:41 2023","interfaces":[{"interface":"back","average":{"1min":1.516,"5min":1.8440000000000001,"15min":1.6919999999999999},"min":{"1min":0.42199999999999999,"5min":0.40600000000000003,"15min":0.33400000000000002},"max":{"1min":4.5170000000000003,"5min":36.478999999999999,"15min":36.478999999999999},"last":0.82299999999999995},{"interface":"front","average":{"1min":1.5149999999999999,"5min":1.7709999999999999,"15min":1.931},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":6.5369999999999999,"5min":25.585999999999999,"15min":25.585999999999999},"last":1.0549999999999999}]},{"osd":2,"last update":"Tue Dec 12 17:34:41 2023","interfaces":[{"interface":"back","average":{"1min":1.5189999999999999,"5min":2.016,"15min":2.2509999999999999},"min":{"1min":0.47099999999999997,"5min":0.376,"15min":0.376},"max":{"1min":4.5549999999999997,"5min":14.356999999999999,"15min":169.21799999999999},"last":0.94699999999999995},{"interface":"front","average":{"1min":1.7809999999999999,"5min":1.768,"15min":2.3450000000000002},"min":{"1min":0.63800000000000001,"5min":0.57299999999999995,"15min":0.47999999999999998},"max":{"1min":5.9580000000000002,"5min":11.739000000000001,"15min":179.34100000000001},"last":0.85599999999999998}]},{"osd":3,"last update":"Tue Dec 12 17:34:41 2023","interfaces":[{"interface":"back","average":{"1min":1.9119999999999999,"5min":1.8320000000000001,"15min":2.4159999999999999},"min":{"1min":0.58499999999999996,"5min":0.433,"15min":0.39900000000000002},"max":{"1min":5.657,"5min":9.3650000000000002,"15min":169.232},"last":0.84399999999999997},{"interface":"front","average":{"1min":1.7529999999999999,"5min":1.861,"15min":2.48},"min":{"1min":0.52200000000000002,"5min":0.432,"15min":0.432},"max":{"1min":4.9370000000000003,"5min":14.401,"15min":168.79300000000001},"last":1.071}]},{"osd":5,"last update":"Tue Dec 12 17:34:41 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":1.484,"15min":1.0580000000000001},"min":{"1min":0.34399999999999997,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.498,"5min":53.762,"15min":58.701999999999998},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.65700000000000003,"5min":1.522,"15min":1.101},"min":{"1min":0.42299999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":2.5539999999999998,"5min":53.628,"15min":59.149999999999999},"last":0.80300000000000005}]},{"osd":6,"last update":"Tue Dec 12 17:34:41 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.91600000000000004,"15min":0.71499999999999997},"min":{"1min":0.42999999999999999,"5min":0.378,"15min":0.33100000000000002},"max":{"1min":1.6200000000000001,"5min":14.432,"15min":14.432},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.91700000000000004,"15min":0.72699999999999998},"min":{"1min":0.39300000000000002,"5min":0.38100000000000001,"15min":0.36499999999999999},"max":{"1min":0.74199999999999999,"5min":10.343,"15min":10.343},"last":0.89600000000000002}]},{"osd":7,"last update":"Tue Dec 12 17:34:41 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":1.6319999999999999,"15min":0.95699999999999996},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.35299999999999998},"max":{"1min":0.85299999999999998,"5min":53.590000000000003,"15min":53.590000000000003},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.71099999999999997,"5min":1.7889999999999999,"15min":1.0529999999999999},"min":{"1min":0.502,"5min":0.44,"15min":0.38500000000000001},"max":{"1min":1.6970000000000001,"5min":54.088999999999999,"15min":54.088999999999999},"last":0.76100000000000001}]}]},{"osd":3,"up_from":13,"seq":55834580109,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1670148,"kb_used_data":508,"kb_used_omap":494,"kb_used_meta":1669137,"kb_avail":92701692,"statfs":{"total":96636764160,"available":94926532608,"internally_reserved":0,"allocated":520192,"data_stored":225356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":506379,"internal_metadata":1709196789},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":432,"apply_latency_ms":432,"commit_latency_ns":432000000,"apply_latency_ns":432000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 17:34:43 2023","interfaces":[{"interface":"back","average":{"1min":2.5379999999999998,"5min":2.516,"15min":2.851},"min":{"1min":0.68400000000000005,"5min":0.434,"15min":0.307},"max":{"1min":8.093,"5min":9.9570000000000007,"15min":18.190999999999999},"last":1.046},{"interface":"front","average":{"1min":3.2189999999999999,"5min":2.766,"15min":3.1589999999999998},"min":{"1min":0.85999999999999999,"5min":0.39500000000000002,"15min":0.27800000000000002},"max":{"1min":10.084,"5min":10.084,"15min":20.350000000000001},"last":1.47}]},{"osd":1,"last update":"Tue Dec 12 17:34:43 2023","interfaces":[{"interface":"back","average":{"1min":3.1640000000000001,"5min":3.6949999999999998,"15min":3.4489999999999998},"min":{"1min":0.79800000000000004,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":13.246,"5min":49.18,"15min":49.18},"last":0.90900000000000003},{"interface":"front","average":{"1min":4.0030000000000001,"5min":3.758,"15min":3.5779999999999998},"min":{"1min":0.97099999999999997,"5min":0.61299999999999999,"15min":0.379},"max":{"1min":30.030999999999999,"5min":52.167999999999999,"15min":52.167999999999999},"last":0.83799999999999997}]},{"osd":2,"last update":"Tue Dec 12 17:34:43 2023","interfaces":[{"interface":"back","average":{"1min":2.403,"5min":2.9809999999999999,"15min":3.3140000000000001},"min":{"1min":0.64400000000000002,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":5.0389999999999997,"5min":11.208,"15min":11.630000000000001},"last":0.78400000000000003},{"interface":"front","average":{"1min":4.4189999999999996,"5min":3.3799999999999999,"15min":3.5510000000000002},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":18.041,"5min":18.379000000000001,"15min":18.379000000000001},"last":1.2829999999999999}]},{"osd":4,"last update":"Tue Dec 12 17:34:43 2023","interfaces":[{"interface":"back","average":{"1min":3.7610000000000001,"5min":2.504,"15min":2.4510000000000001},"min":{"1min":0.63,"5min":0.47099999999999997,"15min":0.38900000000000001},"max":{"1min":19.050000000000001,"5min":19.050000000000001,"15min":20.094999999999999},"last":1.589},{"interface":"front","average":{"1min":2.923,"5min":2.5,"15min":2.6680000000000001},"min":{"1min":0.76200000000000001,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":18.914000000000001,"5min":18.914000000000001,"15min":18.914000000000001},"last":1.343}]},{"osd":5,"last update":"Tue Dec 12 17:34:43 2023","interfaces":[{"interface":"back","average":{"1min":2.7799999999999998,"5min":2.5009999999999999,"15min":2.6259999999999999},"min":{"1min":0.65300000000000002,"5min":0.52800000000000002,"15min":0.51900000000000002},"max":{"1min":8.4960000000000004,"5min":17.245000000000001,"15min":17.474},"last":1.6299999999999999},{"interface":"front","average":{"1min":3.2629999999999999,"5min":2.5,"15min":2.5950000000000002},"min":{"1min":0.73399999999999999,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":10.616,"5min":10.616,"15min":19.887},"last":0.97799999999999998}]},{"osd":6,"last update":"Tue Dec 12 17:34:43 2023","interfaces":[{"interface":"back","average":{"1min":2.1459999999999999,"5min":2.4039999999999999,"15min":2.7610000000000001},"min":{"1min":0.85699999999999998,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":5.5709999999999997,"5min":11.834,"15min":11.834},"last":1.111},{"interface":"front","average":{"1min":2.7010000000000001,"5min":2.5920000000000001,"15min":2.6960000000000002},"min":{"1min":0.72699999999999998,"5min":0.504,"15min":0.504},"max":{"1min":5.3090000000000002,"5min":17.364999999999998,"15min":18.298999999999999},"last":1.4139999999999999}]},{"osd":7,"last update":"Tue Dec 12 17:34:43 2023","interfaces":[{"interface":"back","average":{"1min":3.4649999999999999,"5min":2.6880000000000002,"15min":2.7869999999999999},"min":{"1min":0.77600000000000002,"5min":0.497,"15min":0.497},"max":{"1min":9.9730000000000008,"5min":9.9730000000000008,"15min":20.006},"last":1.1639999999999999},{"interface":"front","average":{"1min":2.2330000000000001,"5min":2.681,"15min":2.9620000000000002},"min":{"1min":0.94099999999999995,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":5.8259999999999996,"5min":11.954000000000001,"15min":11.954000000000001},"last":1.5189999999999999}]}]},{"osd":2,"up_from":13,"seq":55834580118,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1629636,"kb_used_data":508,"kb_used_omap":96,"kb_used_meta":1629023,"kb_avail":92742204,"statfs":{"total":96636764160,"available":94968016896,"internally_reserved":0,"allocated":520192,"data_stored":225356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":98548,"internal_metadata":1668120332},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7435,"apply_latency_ms":7435,"commit_latency_ns":7435000000,"apply_latency_ns":7435000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 17:34:32 2023","interfaces":[{"interface":"back","average":{"1min":2.097,"5min":2.4129999999999998,"15min":3.1000000000000001},"min":{"1min":0.52700000000000002,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":6.7140000000000004,"5min":11.083,"15min":16.509},"last":0.98199999999999998},{"interface":"front","average":{"1min":2.9340000000000002,"5min":2.8559999999999999,"15min":3.1299999999999999},"min":{"1min":0.59999999999999998,"5min":0.40000000000000002,"15min":0.317},"max":{"1min":6.069,"5min":12.016999999999999,"15min":17.859999999999999},"last":1.0309999999999999}]},{"osd":1,"last update":"Tue Dec 12 17:34:32 2023","interfaces":[{"interface":"back","average":{"1min":3.25,"5min":2.98,"15min":3.2130000000000001},"min":{"1min":0.61799999999999999,"5min":0.44600000000000001,"15min":0.39900000000000002},"max":{"1min":8.9130000000000003,"5min":13.569000000000001,"15min":13.76},"last":1.167},{"interface":"front","average":{"1min":3.0830000000000002,"5min":2.706,"15min":3.5470000000000002},"min":{"1min":0.59699999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":12.25,"5min":12.25,"15min":19.837},"last":1.1439999999999999}]},{"osd":3,"last update":"Tue Dec 12 17:34:32 2023","interfaces":[{"interface":"back","average":{"1min":3.9329999999999998,"5min":4.3559999999999999,"15min":3.6909999999999998},"min":{"1min":0.73199999999999998,"5min":0.47199999999999998,"15min":0.437},"max":{"1min":9.0389999999999997,"5min":84.209999999999994,"15min":84.209999999999994},"last":1.8109999999999999},{"interface":"front","average":{"1min":2.7810000000000001,"5min":4.0039999999999996,"15min":4.1390000000000002},"min":{"1min":1.252,"5min":0.65200000000000002,"15min":0.41299999999999998},"max":{"1min":4.6200000000000001,"5min":80.575999999999993,"15min":80.575999999999993},"last":1.319}]},{"osd":4,"last update":"Tue Dec 12 17:34:32 2023","interfaces":[{"interface":"back","average":{"1min":2.3380000000000001,"5min":2.3889999999999998,"15min":2.6110000000000002},"min":{"1min":0.82999999999999996,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":5.8559999999999999,"5min":14.877000000000001,"15min":14.877000000000001},"last":1.885},{"interface":"front","average":{"1min":2.7509999999999999,"5min":2.573,"15min":2.6240000000000001},"min":{"1min":0.92200000000000004,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":5.2839999999999998,"5min":14.787000000000001,"15min":14.787000000000001},"last":1.9350000000000001}]},{"osd":5,"last update":"Tue Dec 12 17:34:32 2023","interfaces":[{"interface":"back","average":{"1min":1.6479999999999999,"5min":2.5649999999999999,"15min":2.9140000000000001},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.48799999999999999},"max":{"1min":3.7949999999999999,"5min":37.231000000000002,"15min":37.231000000000002},"last":1.71},{"interface":"front","average":{"1min":2.4079999999999999,"5min":3.165,"15min":2.9550000000000001},"min":{"1min":0.90600000000000003,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":5.976,"5min":41.021999999999998,"15min":41.021999999999998},"last":1.9910000000000001}]},{"osd":6,"last update":"Tue Dec 12 17:34:32 2023","interfaces":[{"interface":"back","average":{"1min":2.851,"5min":2.7210000000000001,"15min":2.782},"min":{"1min":0.97599999999999998,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":5.3879999999999999,"5min":10.343999999999999,"15min":13.130000000000001},"last":2.0449999999999999},{"interface":"front","average":{"1min":1.73,"5min":2.3410000000000002,"15min":2.9689999999999999},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.52000000000000002},"max":{"1min":3.8300000000000001,"5min":7.6109999999999998,"15min":14.566000000000001},"last":1.579}]},{"osd":7,"last update":"Tue Dec 12 17:34:32 2023","interfaces":[{"interface":"back","average":{"1min":2.6160000000000001,"5min":3.2429999999999999,"15min":3.089},"min":{"1min":1.042,"5min":0.60799999999999998,"15min":0.59399999999999997},"max":{"1min":6.173,"5min":41.134999999999998,"15min":41.134999999999998},"last":2.0910000000000002},{"interface":"front","average":{"1min":2.9590000000000001,"5min":3.1520000000000001,"15min":3.0070000000000001},"min":{"1min":1.0249999999999999,"5min":0.53700000000000003,"15min":0.53500000000000003},"max":{"1min":5.5640000000000001,"5min":37.591000000000001,"15min":37.591000000000001},"last":2.1389999999999998}]}]},{"osd":1,"up_from":13,"seq":55834580127,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1348036,"kb_used_data":508,"kb_used_omap":204,"kb_used_meta":1347315,"kb_avail":93023804,"statfs":{"total":96636764160,"available":95256375296,"internally_reserved":0,"allocated":520192,"data_stored":225356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":209158,"internal_metadata":1379651322},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2010,"apply_latency_ms":2010,"commit_latency_ns":2010000000,"apply_latency_ns":2010000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 17:34:47 2023","interfaces":[{"interface":"back","average":{"1min":6.734,"5min":3.395,"15min":3.5209999999999999},"min":{"1min":0.51500000000000001,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":69.915000000000006,"5min":69.915000000000006,"15min":69.915000000000006},"last":1.4590000000000001},{"interface":"front","average":{"1min":4.2789999999999999,"5min":3.8420000000000001,"15min":3.605},"min":{"1min":0.68200000000000005,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":50,"5min":50,"15min":50},"last":1.1479999999999999}]},{"osd":2,"last update":"Tue Dec 12 17:34:47 2023","interfaces":[{"interface":"back","average":{"1min":4.5110000000000001,"5min":3.9689999999999999,"15min":3.8109999999999999},"min":{"1min":0.99099999999999999,"5min":0.51500000000000001,"15min":0.45300000000000001},"max":{"1min":34.095999999999997,"5min":36.338999999999999,"15min":69.111000000000004},"last":2.3260000000000001},{"interface":"front","average":{"1min":5.4279999999999999,"5min":3.4940000000000002,"15min":4.0789999999999997},"min":{"1min":0.98899999999999999,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":33.901000000000003,"5min":33.901000000000003,"15min":66.488},"last":1.8939999999999999}]},{"osd":3,"last update":"Tue Dec 12 17:34:47 2023","interfaces":[{"interface":"back","average":{"1min":4.3890000000000002,"5min":3.552,"15min":3.8170000000000002},"min":{"1min":0.995,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":12.343,"5min":36.104999999999997,"15min":66.596999999999994},"last":3.2559999999999998},{"interface":"front","average":{"1min":4.2130000000000001,"5min":4.1639999999999997,"15min":3.907},"min":{"1min":0.60899999999999999,"5min":0.45300000000000001,"15min":0.44800000000000001},"max":{"1min":18.184000000000001,"5min":37.051000000000002,"15min":65.433999999999997},"last":1.579}]},{"osd":4,"last update":"Tue Dec 12 17:34:47 2023","interfaces":[{"interface":"back","average":{"1min":3.0899999999999999,"5min":3.093,"15min":2.5129999999999999},"min":{"1min":0.69899999999999995,"5min":0.68700000000000006,"15min":0.41399999999999998},"max":{"1min":13.032,"5min":36.465000000000003,"15min":36.465000000000003},"last":3.048},{"interface":"front","average":{"1min":2.891,"5min":3.024,"15min":2.9649999999999999},"min":{"1min":0.68999999999999995,"5min":0.64100000000000001,"15min":0.46999999999999997},"max":{"1min":6.9370000000000003,"5min":35.859000000000002,"15min":35.859000000000002},"last":2.4510000000000001}]},{"osd":5,"last update":"Tue Dec 12 17:34:47 2023","interfaces":[{"interface":"back","average":{"1min":3.5,"5min":3.5289999999999999,"15min":2.843},"min":{"1min":0.89400000000000002,"5min":0.51000000000000001,"15min":0.503},"max":{"1min":24.033000000000001,"5min":36.865000000000002,"15min":36.865000000000002},"last":1.331},{"interface":"front","average":{"1min":2.5289999999999999,"5min":3.2360000000000002,"15min":2.6709999999999998},"min":{"1min":0.69699999999999995,"5min":0.58899999999999997,"15min":0.47399999999999998},"max":{"1min":11.132999999999999,"5min":36.695999999999998,"15min":36.695999999999998},"last":3.2080000000000002}]},{"osd":6,"last update":"Tue Dec 12 17:34:47 2023","interfaces":[{"interface":"back","average":{"1min":3.327,"5min":3.4660000000000002,"15min":2.9399999999999999},"min":{"1min":0.92700000000000005,"5min":0.55900000000000005,"15min":0.53500000000000003},"max":{"1min":24.077000000000002,"5min":36.433999999999997,"15min":36.433999999999997},"last":1.411},{"interface":"front","average":{"1min":2.6840000000000002,"5min":3.3239999999999998,"15min":2.8079999999999998},"min":{"1min":0.878,"5min":0.57499999999999996,"15min":0.49099999999999999},"max":{"1min":11.324999999999999,"5min":36.612000000000002,"15min":36.612000000000002},"last":3.3380000000000001}]},{"osd":7,"last update":"Tue Dec 12 17:34:47 2023","interfaces":[{"interface":"back","average":{"1min":3.2309999999999999,"5min":3.3580000000000001,"15min":3.1349999999999998},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.51600000000000001},"max":{"1min":10.15,"5min":36.006999999999998,"15min":36.006999999999998},"last":2.6190000000000002},{"interface":"front","average":{"1min":3.5089999999999999,"5min":3.601,"15min":3.0489999999999999},"min":{"1min":0.95299999999999996,"5min":0.75900000000000001,"15min":0.58499999999999996},"max":{"1min":24.114999999999998,"5min":36.979999999999997,"15min":36.979999999999997},"last":1.3779999999999999}]}]},{"osd":0,"up_from":13,"seq":55834580122,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1642180,"kb_used_data":1084,"kb_used_omap":327,"kb_used_meta":1640760,"kb_avail":92729660,"statfs":{"total":96636764160,"available":94955171840,"internally_reserved":0,"allocated":1110016,"data_stored":814755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":335698,"internal_metadata":1680138414},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1487,"apply_latency_ms":1487,"commit_latency_ns":1487000000,"apply_latency_ns":1487000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 12 17:34:43 2023","interfaces":[{"interface":"back","average":{"1min":2.9569999999999999,"5min":3.2229999999999999,"15min":2.988},"min":{"1min":0.34499999999999997,"5min":0.34300000000000003,"15min":0.32700000000000001},"max":{"1min":8.6050000000000004,"5min":24.763000000000002,"15min":24.763000000000002},"last":1.6739999999999999},{"interface":"front","average":{"1min":3.4039999999999999,"5min":3.536,"15min":3.242},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.378},"max":{"1min":16.047999999999998,"5min":22.780000000000001,"15min":22.780000000000001},"last":0.78200000000000003}]},{"osd":2,"last update":"Tue Dec 12 17:34:43 2023","interfaces":[{"interface":"back","average":{"1min":3.7789999999999999,"5min":3.601,"15min":3.4929999999999999},"min":{"1min":0.59999999999999998,"5min":0.55800000000000005,"15min":0.51200000000000001},"max":{"1min":16.143999999999998,"5min":23.042999999999999,"15min":23.042999999999999},"last":0.91800000000000004},{"interface":"front","average":{"1min":3.113,"5min":3.476,"15min":3.9380000000000002},"min":{"1min":0.64000000000000001,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":8.6940000000000008,"5min":24.658000000000001,"15min":151.84100000000001},"last":1.1930000000000001}]},{"osd":3,"last update":"Tue Dec 12 17:34:43 2023","interfaces":[{"interface":"back","average":{"1min":5.1059999999999999,"5min":4.4020000000000001,"15min":3.6680000000000001},"min":{"1min":0.89100000000000001,"5min":0.42399999999999999,"15min":0.38500000000000001},"max":{"1min":31.922999999999998,"5min":64.292000000000002,"15min":64.292000000000002},"last":1.417},{"interface":"front","average":{"1min":4.181,"5min":3.891,"15min":3.524},"min":{"1min":0.70199999999999996,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":15.932,"5min":25.207999999999998,"15min":25.207999999999998},"last":1.0269999999999999}]},{"osd":4,"last update":"Tue Dec 12 17:34:43 2023","interfaces":[{"interface":"back","average":{"1min":2.4620000000000002,"5min":2.855,"15min":2.4199999999999999},"min":{"1min":0.69799999999999995,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":8.1769999999999996,"5min":24.856000000000002,"15min":24.856000000000002},"last":1.893},{"interface":"front","average":{"1min":4.2249999999999996,"5min":3.9180000000000001,"15min":2.8919999999999999},"min":{"1min":0.51900000000000002,"5min":0.47299999999999998,"15min":0.434},"max":{"1min":32.006999999999998,"5min":64.061999999999998,"15min":64.061999999999998},"last":1.6200000000000001}]},{"osd":5,"last update":"Tue Dec 12 17:34:43 2023","interfaces":[{"interface":"back","average":{"1min":3.6989999999999998,"5min":3.371,"15min":2.6749999999999998},"min":{"1min":0.66000000000000003,"5min":0.49299999999999999,"15min":0.438},"max":{"1min":21.183,"5min":27.843,"15min":27.843},"last":1.5449999999999999},{"interface":"front","average":{"1min":3.0680000000000001,"5min":3.3410000000000002,"15min":2.8439999999999999},"min":{"1min":0.66900000000000004,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":7.1870000000000003,"5min":22.68,"15min":22.68},"last":1.3720000000000001}]},{"osd":6,"last update":"Tue Dec 12 17:34:43 2023","interfaces":[{"interface":"back","average":{"1min":3.1480000000000001,"5min":3.085,"15min":2.8370000000000002},"min":{"1min":0.63500000000000001,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":7.4130000000000003,"5min":22.457999999999998,"15min":22.457999999999998},"last":1.145},{"interface":"front","average":{"1min":2.972,"5min":3.3359999999999999,"15min":2.7759999999999998},"min":{"1min":0.79100000000000004,"5min":0.628,"15min":0.51500000000000001},"max":{"1min":8.4109999999999996,"5min":40.453000000000003,"15min":40.453000000000003},"last":1.3240000000000001}]},{"osd":7,"last update":"Tue Dec 12 17:34:43 2023","interfaces":[{"interface":"back","average":{"1min":2.9380000000000002,"5min":3.2400000000000002,"15min":2.843},"min":{"1min":0.82899999999999996,"5min":0.65900000000000003,"15min":0.60599999999999998},"max":{"1min":8.5120000000000005,"5min":24.510999999999999,"15min":24.510999999999999},"last":1.782},{"interface":"front","average":{"1min":4.5890000000000004,"5min":4.1539999999999999,"15min":3.1059999999999999},"min":{"1min":0.55800000000000005,"5min":0.52000000000000002,"15min":0.46500000000000002},"max":{"1min":32.055,"5min":64.191999999999993,"15min":64.191999999999993},"last":1.272}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-12T17:35:14.615 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-12-12T10:11:57.289641+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=12, tm_hour=10, tm_min=11, tm_sec=57, tm_wday=1, tm_yday=346, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=12, tm_hour=17, tm_min=35, tm_sec=0, tm_wday=1, tm_yday=346, tm_isdst=0) 2023-12-12T17:35:14.615 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-12T17:35:34.616 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-12T17:35:34.826 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:34.819+0000 7fc9a1b57640 1 Processor -- start 2023-12-12T17:35:34.827 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:34.819+0000 7fc9a1b57640 1 -- start start 2023-12-12T17:35:34.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:34.823+0000 7fc9a1b57640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fc99c0b3490 0x7fc99c0d0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:35:34.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:34.823+0000 7fc9a1b57640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc99c0b3ba0 0x7fc99c0d15f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:35:34.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:34.823+0000 7fc9a1b57640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc99c0cefc0 con 0x7fc99c0d1b30 2023-12-12T17:35:34.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:34.823+0000 7fc9a1b57640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc99c0d1fc0 con 0x7fc99c0b3490 2023-12-12T17:35:34.830 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:34.823+0000 7fc9a1b57640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc99c0ce760 con 0x7fc99c0b3ba0 2023-12-12T17:35:34.831 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:34.823+0000 7fc99b7fe640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fc99c0b3490 0x7fc99c0d0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:35:34.831 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:34.823+0000 7fc99b7fe640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fc99c0b3490 0x7fc99c0d0df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.78:34026/0 (socket says 172.21.15.78:34026) 2023-12-12T17:35:34.831 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:34.823+0000 7fc99b7fe640 1 -- 172.21.15.78:0/22019428 learned_addr learned my addr 172.21.15.78:0/22019428 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T17:35:34.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:34.823+0000 7fc99affd640 1 --2- 172.21.15.78:0/22019428 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc99c0b3ba0 0x7fc99c0d15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:35:34.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:34.823+0000 7fc99bfff640 1 --1- 172.21.15.78:0/22019428 >> v1:172.21.15.187:6789/0 conn(0x7fc99c0d1b30 0x7fc99c0cf6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.78:51456/0 (socket says 172.21.15.78:51456) 2023-12-12T17:35:34.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:34.823+0000 7fc99b7fe640 1 -- 172.21.15.78:0/22019428 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc99c0b3ba0 msgr2=0x7fc99c0d15f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T17:35:34.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:34.823+0000 7fc99b7fe640 1 --2- 172.21.15.78:0/22019428 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc99c0b3ba0 0x7fc99c0d15f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:34.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:34.823+0000 7fc99b7fe640 1 -- 172.21.15.78:0/22019428 >> v1:172.21.15.187:6789/0 conn(0x7fc99c0d1b30 legacy=0x7fc99c0cf6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:35:34.832 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:34.823+0000 7fc99b7fe640 1 -- 172.21.15.78:0/22019428 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc99c0cea00 con 0x7fc99c0b3490 2023-12-12T17:35:34.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:34.827+0000 7fc99b7fe640 1 --2- 172.21.15.78:0/22019428 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc99c0b3490 0x7fc99c0d0df0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7fc98c009870 tx=0x7fc98c01c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d937430e114cfb58 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T17:35:34.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:34.827+0000 7fc99a7fc640 1 -- 172.21.15.78:0/22019428 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc98c0a6040 con 0x7fc99c0b3490 2023-12-12T17:35:34.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:34.827+0000 7fc99a7fc640 1 -- 172.21.15.78:0/22019428 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc98c0aa600 con 0x7fc99c0b3490 2023-12-12T17:35:34.834 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:34.827+0000 7fc99a7fc640 1 -- 172.21.15.78:0/22019428 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc98c0aa990 con 0x7fc99c0b3490 2023-12-12T17:35:34.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:34.827+0000 7fc9a1b57640 1 -- 172.21.15.78:0/22019428 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc99c0b3490 msgr2=0x7fc99c0d0df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:35:34.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:34.827+0000 7fc9a1b57640 1 --2- 172.21.15.78:0/22019428 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc99c0b3490 0x7fc99c0d0df0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7fc98c009870 tx=0x7fc98c01c480 comp rx=0 tx=0).stop 2023-12-12T17:35:34.835 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:34.827+0000 7fc9a1b57640 1 -- 172.21.15.78:0/22019428 shutdown_connections 2023-12-12T17:35:34.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:34.827+0000 7fc9a1b57640 1 --2- 172.21.15.78:0/22019428 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc99c0b3ba0 0x7fc99c0d15f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:34.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:34.827+0000 7fc9a1b57640 1 --2- 172.21.15.78:0/22019428 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc99c0b3490 0x7fc99c0d0df0 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:34.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:34.827+0000 7fc9a1b57640 1 -- 172.21.15.78:0/22019428 >> 172.21.15.78:0/22019428 conn(0x7fc99c0d3010 msgr2=0x7fc99c0d33f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T17:35:34.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:34.827+0000 7fc9a1b57640 1 -- 172.21.15.78:0/22019428 shutdown_connections 2023-12-12T17:35:34.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:34.827+0000 7fc9a1b57640 1 -- 172.21.15.78:0/22019428 wait complete. 2023-12-12T17:35:34.836 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:34.831+0000 7fc9a1b57640 1 Processor -- start 2023-12-12T17:35:34.837 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:34.831+0000 7fc9a1b57640 1 -- start start 2023-12-12T17:35:34.838 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:34.831+0000 7fc9a1b57640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc99c0b3490 0x7fc99c157a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:35:34.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:34.831+0000 7fc9a1b57640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc99c0b3ba0 0x7fc99c0b25a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:35:34.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:34.831+0000 7fc9a1b57640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc99c0d1b30 0x7fc99c0b05f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:35:34.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:34.831+0000 7fc9a1b57640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc99c0cac00 con 0x7fc99c0b3ba0 2023-12-12T17:35:34.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:34.831+0000 7fc9a1b57640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc99c0cae70 con 0x7fc99c0b3490 2023-12-12T17:35:34.839 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:34.831+0000 7fc9a1b57640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc99c0cb150 con 0x7fc99c0d1b30 2023-12-12T17:35:34.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:34.831+0000 7fc99affd640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc99c0b3ba0 0x7fc99c0b25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:35:34.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:34.831+0000 7fc99b7fe640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc99c0b3490 0x7fc99c157a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:35:34.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:34.831+0000 7fc99bfff640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc99c0d1b30 0x7fc99c0b05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:35:34.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:34.831+0000 7fc99b7fe640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc99c0b3490 0x7fc99c157a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.78:34034/0 (socket says 172.21.15.78:34034) 2023-12-12T17:35:34.840 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:34.831+0000 7fc99b7fe640 1 -- 172.21.15.78:0/2503152368 learned_addr learned my addr 172.21.15.78:0/2503152368 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T17:35:34.841 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:34.831+0000 7fc99affd640 1 -- 172.21.15.78:0/2503152368 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc99c0d1b30 msgr2=0x7fc99c0b05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:35:34.841 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:34.831+0000 7fc99affd640 1 --2- 172.21.15.78:0/2503152368 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc99c0d1b30 0x7fc99c0b05f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:34.841 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:34.831+0000 7fc99affd640 1 -- 172.21.15.78:0/2503152368 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc99c0b3490 msgr2=0x7fc99c157a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:35:34.841 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:34.831+0000 7fc99affd640 1 --2- 172.21.15.78:0/2503152368 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc99c0b3490 0x7fc99c157a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:34.841 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:34.831+0000 7fc99affd640 1 -- 172.21.15.78:0/2503152368 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc98c0094d0 con 0x7fc99c0b3ba0 2023-12-12T17:35:34.841 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:34.831+0000 7fc99b7fe640 1 --2- 172.21.15.78:0/2503152368 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc99c0b3490 0x7fc99c157a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-12T17:35:34.842 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:34.835+0000 7fc99affd640 1 --2- 172.21.15.78:0/2503152368 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc99c0b3ba0 0x7fc99c0b25a0 secure :-1 s=READY pgs=2145 cs=0 l=1 rev1=1 crypto rx=0x7fc99000d5a0 tx=0x7fc99000da60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T17:35:34.842 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:34.835+0000 7fc983fff640 1 -- 172.21.15.78:0/2503152368 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9900125f0 con 0x7fc99c0b3ba0 2023-12-12T17:35:34.842 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:34.835+0000 7fc9a1b57640 1 -- 172.21.15.78:0/2503152368 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc99c0cb430 con 0x7fc99c0b3ba0 2023-12-12T17:35:34.843 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:34.835+0000 7fc983fff640 1 -- 172.21.15.78:0/2503152368 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc990012750 con 0x7fc99c0b3ba0 2023-12-12T17:35:34.843 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:34.835+0000 7fc983fff640 1 -- 172.21.15.78:0/2503152368 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc990012ae0 con 0x7fc99c0b3ba0 2023-12-12T17:35:34.843 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:34.835+0000 7fc9a1b57640 1 -- 172.21.15.78:0/2503152368 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc99c0b2c60 con 0x7fc99c0b3ba0 2023-12-12T17:35:34.843 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:34.835+0000 7fc9a1b57640 1 -- 172.21.15.78:0/2503152368 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc99c0671f0 con 0x7fc99c0b3ba0 2023-12-12T17:35:34.846 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:34.839+0000 7fc983fff640 1 -- 172.21.15.78:0/2503152368 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc990012c40 con 0x7fc99c0b3ba0 2023-12-12T17:35:34.848 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:34.839+0000 7fc983fff640 1 --2- 172.21.15.78:0/2503152368 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fc988066470 0x7fc988068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:35:34.848 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:34.843+0000 7fc983fff640 1 -- 172.21.15.78:0/2503152368 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fc990084ab0 con 0x7fc99c0b3ba0 2023-12-12T17:35:34.849 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:34.843+0000 7fc99b7fe640 1 --2- 172.21.15.78:0/2503152368 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fc988066470 0x7fc988068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:35:34.850 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:34.843+0000 7fc99b7fe640 1 --2- 172.21.15.78:0/2503152368 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fc988066470 0x7fc988068930 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fc99c0b0030 tx=0x7fc98c0b5040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T17:35:34.851 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:34.843+0000 7fc983fff640 1 -- 172.21.15.78:0/2503152368 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc9900521b0 con 0x7fc99c0b3ba0 2023-12-12T17:35:35.006 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:34.999+0000 7fc9a1b57640 1 -- 172.21.15.78:0/2503152368 --> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc99c16a150 con 0x7fc988066470 2023-12-12T17:35:35.013 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:35.007+0000 7fc983fff640 1 -- 172.21.15.78:0/2503152368 <== mgr.4104 v2:172.21.15.78:6832/1725498448 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+49302 (secure 0 0 0) 0x7fc98c0aac20 con 0x7fc988066470 2023-12-12T17:35:35.014 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T17:35:35.014 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2023-12-12T17:35:35.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:35.007+0000 7fc9a1b57640 1 -- 172.21.15.78:0/2503152368 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fc988066470 msgr2=0x7fc988068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:35:35.015 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:35.007+0000 7fc9a1b57640 1 --2- 172.21.15.78:0/2503152368 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fc988066470 0x7fc988068930 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fc99c0b0030 tx=0x7fc98c0b5040 comp rx=0 tx=0).stop 2023-12-12T17:35:35.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:35.007+0000 7fc9a1b57640 1 -- 172.21.15.78:0/2503152368 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc99c0b3ba0 msgr2=0x7fc99c0b25a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:35:35.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:35.007+0000 7fc9a1b57640 1 --2- 172.21.15.78:0/2503152368 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc99c0b3ba0 0x7fc99c0b25a0 secure :-1 s=READY pgs=2145 cs=0 l=1 rev1=1 crypto rx=0x7fc99000d5a0 tx=0x7fc99000da60 comp rx=0 tx=0).stop 2023-12-12T17:35:35.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:35.007+0000 7fc9a1b57640 1 -- 172.21.15.78:0/2503152368 shutdown_connections 2023-12-12T17:35:35.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:35.007+0000 7fc9a1b57640 1 --2- 172.21.15.78:0/2503152368 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fc988066470 0x7fc988068930 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:35.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:35.007+0000 7fc9a1b57640 1 --2- 172.21.15.78:0/2503152368 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc99c0d1b30 0x7fc99c0b05f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:35.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:35.007+0000 7fc9a1b57640 1 --2- 172.21.15.78:0/2503152368 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fc99c0b3ba0 0x7fc99c0b25a0 unknown :-1 s=CLOSED pgs=2145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:35.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:35.007+0000 7fc9a1b57640 1 --2- 172.21.15.78:0/2503152368 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc99c0b3490 0x7fc99c157a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:35.016 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:35.007+0000 7fc9a1b57640 1 -- 172.21.15.78:0/2503152368 >> 172.21.15.78:0/2503152368 conn(0x7fc99c0d3010 msgr2=0x7fc99c0cdb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T17:35:35.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:35.007+0000 7fc9a1b57640 1 -- 172.21.15.78:0/2503152368 shutdown_connections 2023-12-12T17:35:35.017 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:35.007+0000 7fc9a1b57640 1 -- 172.21.15.78:0/2503152368 wait complete. 2023-12-12T17:35:35.039 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":13332,"stamp":"2023-12-12T17:35:34.587578+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":12748196,"kb_used_data":5220,"kb_used_omap":3470,"kb_used_meta":12739441,"kb_avail":742226524,"statfs":{"total":773094113280,"available":760039960576,"internally_reserved":0,"allocated":5345280,"data_stored":2982615,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3554275,"internal_metadata":13045187613},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002559"},"pg_stats":[{"pgid":"1.0","version":"44'119","reported_seq":416,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-12-12T17:35:15.953383+0000","last_change":"2023-12-12T17:35:15.953412+0000","last_active":"2023-12-12T17:35:15.953383+0000","last_peered":"2023-12-12T17:35:15.953383+0000","last_clean":"2023-12-12T17:35:15.953383+0000","last_became_active":"2023-12-12T10:11:58.491470+0000","last_became_peered":"2023-12-12T10:11:58.491470+0000","last_unstale":"2023-12-12T17:35:15.953383+0000","last_undegraded":"2023-12-12T17:35:15.953383+0000","last_fullsized":"2023-12-12T17:35:15.953383+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"44'119","last_scrub_stamp":"2023-12-12T17:35:15.953301+0000","last_deep_scrub":"44'119","last_deep_scrub_stamp":"2023-12-12T17:35:15.953301+0000","last_clean_scrub_stamp":"2023-12-12T17:35:15.953301+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T22:36:51.880926+0000","scrub_duration":1.8279775489999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834580171,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1607752,"kb_used_data":1088,"kb_used_omap":161,"kb_used_meta":1606494,"kb_avail":92764088,"statfs":{"total":96636764160,"available":94990426112,"internally_reserved":0,"allocated":1114112,"data_stored":815724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":165859,"internal_metadata":1645049885},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 17:35:12 2023","interfaces":[{"interface":"back","average":{"1min":1.4870000000000001,"5min":1.7949999999999999,"15min":1.776},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.30599999999999999},"max":{"1min":5.8049999999999997,"5min":21.974,"15min":21.974},"last":0.504},{"interface":"front","average":{"1min":2.1160000000000001,"5min":2.3610000000000002,"15min":1.9450000000000001},"min":{"1min":0.59499999999999997,"5min":0.38900000000000001,"15min":0.30199999999999999},"max":{"1min":5.6619999999999999,"5min":22.475999999999999,"15min":22.475999999999999},"last":0.75800000000000001}]},{"osd":1,"last update":"Tue Dec 12 17:35:12 2023","interfaces":[{"interface":"back","average":{"1min":1.4299999999999999,"5min":1.7130000000000001,"15min":1.887},"min":{"1min":0.41199999999999998,"5min":0.36099999999999999,"15min":0.35599999999999998},"max":{"1min":4.5979999999999999,"5min":8.8350000000000009,"15min":24.129000000000001},"last":0.65500000000000003},{"interface":"front","average":{"1min":1.74,"5min":1.7829999999999999,"15min":1.8879999999999999},"min":{"1min":0.42799999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":7.9800000000000004,"5min":9.0660000000000007,"15min":10.593999999999999},"last":0.77500000000000002}]},{"osd":2,"last update":"Tue Dec 12 17:35:12 2023","interfaces":[{"interface":"back","average":{"1min":1.8879999999999999,"5min":2.1720000000000002,"15min":2.052},"min":{"1min":0.58999999999999997,"5min":0.41699999999999998,"15min":0.374},"max":{"1min":5.7110000000000003,"5min":11.038,"15min":11.038},"last":0.69499999999999995},{"interface":"front","average":{"1min":2.8599999999999999,"5min":2.3460000000000001,"15min":1.988},"min":{"1min":0.71099999999999997,"5min":0.51500000000000001,"15min":0.41899999999999998},"max":{"1min":14.130000000000001,"5min":19.434999999999999,"15min":19.434999999999999},"last":0.96399999999999997}]},{"osd":3,"last update":"Tue Dec 12 17:35:12 2023","interfaces":[{"interface":"back","average":{"1min":2.036,"5min":1.911,"15min":2.3100000000000001},"min":{"1min":0.45000000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":13.351000000000001,"5min":13.351000000000001,"15min":113.107},"last":0.74099999999999999},{"interface":"front","average":{"1min":2.359,"5min":2.323,"15min":2.3340000000000001},"min":{"1min":0.54000000000000004,"5min":0.49299999999999999,"15min":0.40699999999999997},"max":{"1min":7.4080000000000004,"5min":8.9890000000000008,"15min":109.90900000000001},"last":0.98399999999999999}]},{"osd":4,"last update":"Tue Dec 12 17:35:12 2023","interfaces":[{"interface":"back","average":{"1min":1.0649999999999999,"5min":1.075,"15min":0.77700000000000002},"min":{"1min":0.375,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":4.1139999999999999,"5min":12.436999999999999,"15min":12.436999999999999},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.94299999999999995,"15min":0.76800000000000002},"min":{"1min":0.5,"5min":0.40200000000000002,"15min":0.33400000000000002},"max":{"1min":2.8069999999999999,"5min":8.7880000000000003,"15min":8.7880000000000003},"last":0.623}]},{"osd":5,"last update":"Tue Dec 12 17:35:12 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.88200000000000001,"15min":0.69299999999999995},"min":{"1min":0.435,"5min":0.33300000000000002,"15min":0.32800000000000001},"max":{"1min":2.3660000000000001,"5min":9.3640000000000008,"15min":9.3640000000000008},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.98099999999999998,"5min":1.0780000000000001,"15min":0.77800000000000002},"min":{"1min":0.45100000000000001,"5min":0.36899999999999999,"15min":0.33900000000000002},"max":{"1min":4.0380000000000003,"5min":12.48,"15min":12.48},"last":0.54300000000000004}]},{"osd":6,"last update":"Tue Dec 12 17:35:12 2023","interfaces":[{"interface":"back","average":{"1min":1.0629999999999999,"5min":1.149,"15min":0.85099999999999998},"min":{"1min":0.53900000000000003,"5min":0.441,"15min":0.41999999999999998},"max":{"1min":4.1529999999999996,"5min":12.528,"15min":12.528},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.94399999999999995,"15min":0.79400000000000004},"min":{"1min":0.48499999999999999,"5min":0.38400000000000001,"15min":0.35099999999999998},"max":{"1min":1.3759999999999999,"5min":8.8979999999999997,"15min":8.8979999999999997},"last":0.58199999999999996}]}]},{"osd":6,"up_from":13,"seq":55834580172,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1458308,"kb_used_data":508,"kb_used_omap":247,"kb_used_meta":1457544,"kb_avail":92913532,"statfs":{"total":96636764160,"available":95143456768,"internally_reserved":0,"allocated":520192,"data_stored":225356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":253535,"internal_metadata":1492525473},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 17:34:50 2023","interfaces":[{"interface":"back","average":{"1min":3.3559999999999999,"5min":2.069,"15min":1.776},"min":{"1min":0.45000000000000001,"5min":0.34000000000000002,"15min":0.32900000000000001},"max":{"1min":11.975,"5min":18.879000000000001,"15min":18.879000000000001},"last":0.88},{"interface":"front","average":{"1min":4.7919999999999998,"5min":2.6800000000000002,"15min":1.952},"min":{"1min":0.501,"5min":0.35099999999999998,"15min":0.30599999999999999},"max":{"1min":43.396000000000001,"5min":43.396000000000001,"15min":43.396000000000001},"last":0.89600000000000002}]},{"osd":1,"last update":"Tue Dec 12 17:34:50 2023","interfaces":[{"interface":"back","average":{"1min":3.2669999999999999,"5min":2.0899999999999999,"15min":1.8180000000000001},"min":{"1min":0.54900000000000004,"5min":0.376,"15min":0.34699999999999998},"max":{"1min":10.798999999999999,"5min":18.826000000000001,"15min":18.826000000000001},"last":0.81599999999999995},{"interface":"front","average":{"1min":3.0369999999999999,"5min":2.0089999999999999,"15min":1.8129999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.372},"max":{"1min":13.426,"5min":16.858000000000001,"15min":16.858000000000001},"last":0.79500000000000004}]},{"osd":2,"last update":"Tue Dec 12 17:34:50 2023","interfaces":[{"interface":"back","average":{"1min":2.2490000000000001,"5min":1.829,"15min":1.8879999999999999},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":11.254,"5min":19,"15min":19},"last":0.94899999999999995},{"interface":"front","average":{"1min":1.6879999999999999,"5min":2.0419999999999998,"15min":1.903},"min":{"1min":0.54700000000000004,"5min":0.47099999999999997,"15min":0.40799999999999997},"max":{"1min":6.0899999999999999,"5min":34.941000000000003,"15min":34.941000000000003},"last":0.72699999999999998}]},{"osd":3,"last update":"Tue Dec 12 17:34:50 2023","interfaces":[{"interface":"back","average":{"1min":3.0819999999999999,"5min":2.7679999999999998,"15min":2.121},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":17.741,"5min":88.251999999999995,"15min":88.251999999999995},"last":0.85699999999999998},{"interface":"front","average":{"1min":5.5380000000000003,"5min":3.6200000000000001,"15min":2.3620000000000001},"min":{"1min":0.627,"5min":0.44,"15min":0.44},"max":{"1min":32.055999999999997,"5min":80.805999999999997,"15min":80.805999999999997},"last":0.97499999999999998}]},{"osd":4,"last update":"Tue Dec 12 17:34:50 2023","interfaces":[{"interface":"back","average":{"1min":1.802,"5min":1.226,"15min":0.80100000000000005},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.318},"max":{"1min":12.010999999999999,"5min":16.427,"15min":16.427},"last":0.60799999999999998},{"interface":"front","average":{"1min":1.379,"5min":1.1359999999999999,"15min":0.77400000000000002},"min":{"1min":0.39900000000000002,"5min":0.36599999999999999,"15min":0.28100000000000003},"max":{"1min":10.835000000000001,"5min":18.933,"15min":18.933},"last":0.749}]},{"osd":5,"last update":"Tue Dec 12 17:34:50 2023","interfaces":[{"interface":"back","average":{"1min":1.903,"5min":1.1759999999999999,"15min":1.204},"min":{"1min":0.44900000000000001,"5min":0.40899999999999997,"15min":0.36499999999999999},"max":{"1min":13.535,"5min":13.535,"15min":123.398},"last":0.77400000000000002},{"interface":"front","average":{"1min":1.7170000000000001,"5min":1.2430000000000001,"15min":1.2330000000000001},"min":{"1min":0.41199999999999998,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":10.693,"5min":18.969000000000001,"15min":121.617},"last":0.68899999999999995}]},{"osd":7,"last update":"Tue Dec 12 17:34:50 2023","interfaces":[{"interface":"back","average":{"1min":1.5760000000000001,"5min":1.1100000000000001,"15min":0.80100000000000005},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":8.9410000000000007,"5min":21.306000000000001,"15min":21.306000000000001},"last":0.64400000000000002},{"interface":"front","average":{"1min":2.613,"5min":1.3440000000000001,"15min":0.90400000000000003},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":23.573,"5min":23.573,"15min":23.573},"last":0.66400000000000003}]}]},{"osd":5,"up_from":13,"seq":55834580170,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1716292,"kb_used_data":508,"kb_used_omap":1077,"kb_used_meta":1714698,"kb_avail":92655548,"statfs":{"total":96636764160,"available":94879281152,"internally_reserved":0,"allocated":520192,"data_stored":225356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1102957,"internal_metadata":1755851667},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 17:34:44 2023","interfaces":[{"interface":"back","average":{"1min":2.6600000000000001,"5min":1.718,"15min":1.6759999999999999},"min":{"1min":0.376,"5min":0.36899999999999999,"15min":0.313},"max":{"1min":10.356999999999999,"5min":13.279,"15min":13.279},"last":0.68799999999999994},{"interface":"front","average":{"1min":2.0230000000000001,"5min":1.8460000000000001,"15min":1.744},"min":{"1min":0.50600000000000001,"5min":0.37,"15min":0.32100000000000001},"max":{"1min":10.586,"5min":10.586,"15min":10.586},"last":0.71199999999999997}]},{"osd":1,"last update":"Tue Dec 12 17:34:44 2023","interfaces":[{"interface":"back","average":{"1min":2.452,"5min":2.1179999999999999,"15min":2.032},"min":{"1min":0.51200000000000001,"5min":0.42299999999999999,"15min":0.38400000000000001},"max":{"1min":10.776,"5min":10.776,"15min":17.175000000000001},"last":0.53700000000000003},{"interface":"front","average":{"1min":2.266,"5min":1.579,"15min":1.607},"min":{"1min":0.65500000000000003,"5min":0.379,"15min":0.379},"max":{"1min":8.5440000000000005,"5min":8.5440000000000005,"15min":12.363},"last":0.496}]},{"osd":2,"last update":"Tue Dec 12 17:34:44 2023","interfaces":[{"interface":"back","average":{"1min":3.3119999999999998,"5min":2.0430000000000001,"15min":1.8640000000000001},"min":{"1min":0.52400000000000002,"5min":0.40899999999999997,"15min":0.40100000000000002},"max":{"1min":16.010999999999999,"5min":16.010999999999999,"15min":16.010999999999999},"last":0.90100000000000002},{"interface":"front","average":{"1min":3.274,"5min":2.0649999999999999,"15min":1.929},"min":{"1min":0.64600000000000002,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":16.209,"5min":16.209,"15min":16.209},"last":0.85599999999999998}]},{"osd":3,"last update":"Tue Dec 12 17:34:44 2023","interfaces":[{"interface":"back","average":{"1min":2.6059999999999999,"5min":2.2559999999999998,"15min":2.1930000000000001},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":12.015000000000001,"5min":32.682000000000002,"15min":32.682000000000002},"last":0.91200000000000003},{"interface":"front","average":{"1min":2.7349999999999999,"5min":2.0089999999999999,"15min":2.0489999999999999},"min":{"1min":0.55900000000000005,"5min":0.54400000000000004,"15min":0.42799999999999999},"max":{"1min":10.516999999999999,"5min":10.897,"15min":10.897},"last":0.92400000000000004}]},{"osd":4,"last update":"Tue Dec 12 17:34:44 2023","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.753,"15min":0.66300000000000003},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":6.3639999999999999,"5min":6.3639999999999999,"15min":6.3639999999999999},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.73599999999999999,"15min":0.67000000000000004},"min":{"1min":0.41399999999999998,"5min":0.374,"15min":0.34000000000000002},"max":{"1min":1.6619999999999999,"5min":4.4000000000000004,"15min":4.4000000000000004},"last":0.41899999999999998}]},{"osd":6,"last update":"Tue Dec 12 17:34:44 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.81499999999999995,"15min":0.69099999999999995},"min":{"1min":0.39100000000000001,"5min":0.35599999999999998,"15min":0.34100000000000003},"max":{"1min":2.9609999999999999,"5min":10.016,"15min":10.016},"last":0.56000000000000005},{"interface":"front","average":{"1min":1.012,"5min":0.82399999999999995,"15min":0.70099999999999996},"min":{"1min":0.44800000000000001,"5min":0.39300000000000002,"15min":0.34999999999999998},"max":{"1min":7.0049999999999999,"5min":7.0049999999999999,"15min":7.0049999999999999},"last":0.59799999999999998}]},{"osd":7,"last update":"Tue Dec 12 17:34:44 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.76700000000000002,"15min":0.69199999999999995},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":4.109,"5min":4.109,"15min":4.109},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.81000000000000005,"15min":0.73799999999999999},"min":{"1min":0.433,"5min":0.41499999999999998,"15min":0.39600000000000002},"max":{"1min":2.7280000000000002,"5min":3.407,"15min":3.875},"last":0.625}]}]},{"osd":4,"up_from":13,"seq":55834580175,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1675844,"kb_used_data":508,"kb_used_omap":861,"kb_used_meta":1674466,"kb_avail":92695996,"statfs":{"total":96636764160,"available":94920699904,"internally_reserved":0,"allocated":520192,"data_stored":225356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":882141,"internal_metadata":1714653731},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 17:34:41 2023","interfaces":[{"interface":"back","average":{"1min":2.0059999999999998,"5min":1.7649999999999999,"15min":2.1789999999999998},"min":{"1min":0.498,"5min":0.36799999999999999,"15min":0.31900000000000001},"max":{"1min":6.0460000000000003,"5min":9.4499999999999993,"15min":170.917},"last":1.2490000000000001},{"interface":"front","average":{"1min":1.52,"5min":1.643,"15min":2.0910000000000002},"min":{"1min":0.47299999999999998,"5min":0.39700000000000002,"15min":0.33800000000000002},"max":{"1min":6.218,"5min":9.3119999999999994,"15min":170.74199999999999},"last":0.84999999999999998}]},{"osd":1,"last update":"Tue Dec 12 17:34:41 2023","interfaces":[{"interface":"back","average":{"1min":1.516,"5min":1.8440000000000001,"15min":1.6919999999999999},"min":{"1min":0.42199999999999999,"5min":0.40600000000000003,"15min":0.33400000000000002},"max":{"1min":4.5170000000000003,"5min":36.478999999999999,"15min":36.478999999999999},"last":1.01},{"interface":"front","average":{"1min":1.5149999999999999,"5min":1.7709999999999999,"15min":1.931},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":6.5369999999999999,"5min":25.585999999999999,"15min":25.585999999999999},"last":0.96299999999999997}]},{"osd":2,"last update":"Tue Dec 12 17:34:41 2023","interfaces":[{"interface":"back","average":{"1min":1.5189999999999999,"5min":2.016,"15min":2.2509999999999999},"min":{"1min":0.47099999999999997,"5min":0.376,"15min":0.376},"max":{"1min":4.5549999999999997,"5min":14.356999999999999,"15min":169.21799999999999},"last":0.97699999999999998},{"interface":"front","average":{"1min":1.7809999999999999,"5min":1.768,"15min":2.3450000000000002},"min":{"1min":0.63800000000000001,"5min":0.57299999999999995,"15min":0.47999999999999998},"max":{"1min":5.9580000000000002,"5min":11.739000000000001,"15min":179.34100000000001},"last":0.93000000000000005}]},{"osd":3,"last update":"Tue Dec 12 17:34:41 2023","interfaces":[{"interface":"back","average":{"1min":1.9119999999999999,"5min":1.8320000000000001,"15min":2.4159999999999999},"min":{"1min":0.58499999999999996,"5min":0.433,"15min":0.39900000000000002},"max":{"1min":5.657,"5min":9.3650000000000002,"15min":169.232},"last":0.997},{"interface":"front","average":{"1min":1.7529999999999999,"5min":1.861,"15min":2.48},"min":{"1min":0.52200000000000002,"5min":0.432,"15min":0.432},"max":{"1min":4.9370000000000003,"5min":14.401,"15min":168.79300000000001},"last":1.105}]},{"osd":5,"last update":"Tue Dec 12 17:34:41 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":1.484,"15min":1.0580000000000001},"min":{"1min":0.34399999999999997,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.498,"5min":53.762,"15min":58.701999999999998},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.65700000000000003,"5min":1.522,"15min":1.101},"min":{"1min":0.42299999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":2.5539999999999998,"5min":53.628,"15min":59.149999999999999},"last":0.94599999999999995}]},{"osd":6,"last update":"Tue Dec 12 17:34:41 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.91600000000000004,"15min":0.71499999999999997},"min":{"1min":0.42999999999999999,"5min":0.378,"15min":0.33100000000000002},"max":{"1min":1.6200000000000001,"5min":14.432,"15min":14.432},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.91700000000000004,"15min":0.72699999999999998},"min":{"1min":0.39300000000000002,"5min":0.38100000000000001,"15min":0.36499999999999999},"max":{"1min":0.74199999999999999,"5min":10.343,"15min":10.343},"last":0.77700000000000002}]},{"osd":7,"last update":"Tue Dec 12 17:34:41 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":1.6319999999999999,"15min":0.95699999999999996},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.35299999999999998},"max":{"1min":0.85299999999999998,"5min":53.590000000000003,"15min":53.590000000000003},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.71099999999999997,"5min":1.7889999999999999,"15min":1.0529999999999999},"min":{"1min":0.502,"5min":0.44,"15min":0.38500000000000001},"max":{"1min":1.6970000000000001,"5min":54.088999999999999,"15min":54.088999999999999},"last":0.90800000000000003}]}]},{"osd":3,"up_from":13,"seq":55834580113,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1670148,"kb_used_data":508,"kb_used_omap":494,"kb_used_meta":1669137,"kb_avail":92701692,"statfs":{"total":96636764160,"available":94926532608,"internally_reserved":0,"allocated":520192,"data_stored":225356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":506379,"internal_metadata":1709196789},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 17:34:43 2023","interfaces":[{"interface":"back","average":{"1min":2.5379999999999998,"5min":2.516,"15min":2.851},"min":{"1min":0.68400000000000005,"5min":0.434,"15min":0.307},"max":{"1min":8.093,"5min":9.9570000000000007,"15min":18.190999999999999},"last":0.68300000000000005},{"interface":"front","average":{"1min":3.2189999999999999,"5min":2.766,"15min":3.1589999999999998},"min":{"1min":0.85999999999999999,"5min":0.39500000000000002,"15min":0.27800000000000002},"max":{"1min":10.084,"5min":10.084,"15min":20.350000000000001},"last":0.754}]},{"osd":1,"last update":"Tue Dec 12 17:34:43 2023","interfaces":[{"interface":"back","average":{"1min":3.1640000000000001,"5min":3.6949999999999998,"15min":3.4489999999999998},"min":{"1min":0.79800000000000004,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":13.246,"5min":49.18,"15min":49.18},"last":0.56599999999999995},{"interface":"front","average":{"1min":4.0030000000000001,"5min":3.758,"15min":3.5779999999999998},"min":{"1min":0.97099999999999997,"5min":0.61299999999999999,"15min":0.379},"max":{"1min":30.030999999999999,"5min":52.167999999999999,"15min":52.167999999999999},"last":0.82799999999999996}]},{"osd":2,"last update":"Tue Dec 12 17:34:43 2023","interfaces":[{"interface":"back","average":{"1min":2.403,"5min":2.9809999999999999,"15min":3.3140000000000001},"min":{"1min":0.64400000000000002,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":5.0389999999999997,"5min":11.208,"15min":11.630000000000001},"last":1.1599999999999999},{"interface":"front","average":{"1min":4.4189999999999996,"5min":3.3799999999999999,"15min":3.5510000000000002},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":18.041,"5min":18.379000000000001,"15min":18.379000000000001},"last":1.407}]},{"osd":4,"last update":"Tue Dec 12 17:34:43 2023","interfaces":[{"interface":"back","average":{"1min":3.7610000000000001,"5min":2.504,"15min":2.4510000000000001},"min":{"1min":0.63,"5min":0.47099999999999997,"15min":0.38900000000000001},"max":{"1min":19.050000000000001,"5min":19.050000000000001,"15min":20.094999999999999},"last":1.2070000000000001},{"interface":"front","average":{"1min":2.923,"5min":2.5,"15min":2.6680000000000001},"min":{"1min":0.76200000000000001,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":18.914000000000001,"5min":18.914000000000001,"15min":18.914000000000001},"last":0.94399999999999995}]},{"osd":5,"last update":"Tue Dec 12 17:34:43 2023","interfaces":[{"interface":"back","average":{"1min":2.7799999999999998,"5min":2.5009999999999999,"15min":2.6259999999999999},"min":{"1min":0.65300000000000002,"5min":0.52800000000000002,"15min":0.51900000000000002},"max":{"1min":8.4960000000000004,"5min":17.245000000000001,"15min":17.474},"last":1.095},{"interface":"front","average":{"1min":3.2629999999999999,"5min":2.5,"15min":2.5950000000000002},"min":{"1min":0.73399999999999999,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":10.616,"5min":10.616,"15min":19.887},"last":1.0109999999999999}]},{"osd":6,"last update":"Tue Dec 12 17:34:43 2023","interfaces":[{"interface":"back","average":{"1min":2.1459999999999999,"5min":2.4039999999999999,"15min":2.7610000000000001},"min":{"1min":0.85699999999999998,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":5.5709999999999997,"5min":11.834,"15min":11.834},"last":1.246},{"interface":"front","average":{"1min":2.7010000000000001,"5min":2.5920000000000001,"15min":2.6960000000000002},"min":{"1min":0.72699999999999998,"5min":0.504,"15min":0.504},"max":{"1min":5.3090000000000002,"5min":17.364999999999998,"15min":18.298999999999999},"last":1.2609999999999999}]},{"osd":7,"last update":"Tue Dec 12 17:34:43 2023","interfaces":[{"interface":"back","average":{"1min":3.4649999999999999,"5min":2.6880000000000002,"15min":2.7869999999999999},"min":{"1min":0.77600000000000002,"5min":0.497,"15min":0.497},"max":{"1min":9.9730000000000008,"5min":9.9730000000000008,"15min":20.006},"last":1.361},{"interface":"front","average":{"1min":2.2330000000000001,"5min":2.681,"15min":2.9620000000000002},"min":{"1min":0.94099999999999995,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":5.8259999999999996,"5min":11.954000000000001,"15min":11.954000000000001},"last":1.3340000000000001}]}]},{"osd":2,"up_from":13,"seq":55834580123,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1629636,"kb_used_data":508,"kb_used_omap":96,"kb_used_meta":1629023,"kb_avail":92742204,"statfs":{"total":96636764160,"available":94968016896,"internally_reserved":0,"allocated":520192,"data_stored":225356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":98548,"internal_metadata":1668120332},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 17:35:32 2023","interfaces":[{"interface":"back","average":{"1min":6.3159999999999998,"5min":3.242,"15min":3.302},"min":{"1min":0.71099999999999997,"5min":0.44500000000000001,"15min":0.27900000000000003},"max":{"1min":43.466999999999999,"5min":43.466999999999999,"15min":43.466999999999999},"last":0.90000000000000002},{"interface":"front","average":{"1min":5.8339999999999996,"5min":3.5310000000000001,"15min":3.226},"min":{"1min":0.73799999999999999,"5min":0.48299999999999998,"15min":0.317},"max":{"1min":43.332000000000001,"5min":43.332000000000001,"15min":43.332000000000001},"last":0.75800000000000001}]},{"osd":1,"last update":"Tue Dec 12 17:35:32 2023","interfaces":[{"interface":"back","average":{"1min":4.851,"5min":3.4319999999999999,"15min":3.2989999999999999},"min":{"1min":0.66400000000000003,"5min":0.52000000000000002,"15min":0.39900000000000002},"max":{"1min":18.922999999999998,"5min":18.922999999999998,"15min":18.922999999999998},"last":0.66400000000000003},{"interface":"front","average":{"1min":5.726,"5min":3.3980000000000001,"15min":3.6949999999999998},"min":{"1min":0.71399999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":32.646999999999998,"5min":32.646999999999998,"15min":32.646999999999998},"last":0.71399999999999997}]},{"osd":3,"last update":"Tue Dec 12 17:35:32 2023","interfaces":[{"interface":"back","average":{"1min":6.6970000000000001,"5min":4.266,"15min":3.8999999999999999},"min":{"1min":0.83799999999999997,"5min":0.47199999999999998,"15min":0.437},"max":{"1min":44.079999999999998,"5min":44.079999999999998,"15min":84.209999999999994},"last":0.95499999999999996},{"interface":"front","average":{"1min":7.5149999999999997,"5min":4.1159999999999997,"15min":4.3609999999999998},"min":{"1min":0.97199999999999998,"5min":0.65200000000000002,"15min":0.41299999999999998},"max":{"1min":52.366999999999997,"5min":52.366999999999997,"15min":80.575999999999993},"last":1}]},{"osd":4,"last update":"Tue Dec 12 17:35:32 2023","interfaces":[{"interface":"back","average":{"1min":5.6550000000000002,"5min":3.121,"15min":2.7679999999999998},"min":{"1min":0.76400000000000001,"5min":0.60199999999999998,"15min":0.45600000000000002},"max":{"1min":27.689,"5min":27.689,"15min":27.689},"last":1.4139999999999999},{"interface":"front","average":{"1min":4.9989999999999997,"5min":3.1909999999999998,"15min":2.7879999999999998},"min":{"1min":0.82399999999999995,"5min":0.52800000000000002,"15min":0.49399999999999999},"max":{"1min":18.827999999999999,"5min":18.827999999999999,"15min":18.827999999999999},"last":1.514}]},{"osd":5,"last update":"Tue Dec 12 17:35:32 2023","interfaces":[{"interface":"back","average":{"1min":5.9370000000000003,"5min":3.3100000000000001,"15min":3.1110000000000002},"min":{"1min":0.92100000000000004,"5min":0.51400000000000001,"15min":0.48799999999999999},"max":{"1min":32.822000000000003,"5min":37.231000000000002,"15min":37.231000000000002},"last":1.337},{"interface":"front","average":{"1min":5.0579999999999998,"5min":3.7879999999999998,"15min":3.052},"min":{"1min":0.88700000000000001,"5min":0.64500000000000002,"15min":0.49399999999999999},"max":{"1min":15.952999999999999,"5min":41.021999999999998,"15min":41.021999999999998},"last":1.673}]},{"osd":6,"last update":"Tue Dec 12 17:35:32 2023","interfaces":[{"interface":"back","average":{"1min":4.3940000000000001,"5min":3.0550000000000002,"15min":2.8919999999999999},"min":{"1min":1.056,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":18.710000000000001,"5min":18.710000000000001,"15min":18.710000000000001},"last":1.452},{"interface":"front","average":{"1min":5.4950000000000001,"5min":2.9399999999999999,"15min":3.1150000000000002},"min":{"1min":1.0129999999999999,"5min":0.55100000000000005,"15min":0.52000000000000002},"max":{"1min":32.936,"5min":32.936,"15min":32.936},"last":1.3089999999999999}]},{"osd":7,"last update":"Tue Dec 12 17:35:32 2023","interfaces":[{"interface":"back","average":{"1min":5.3540000000000001,"5min":3.9169999999999998,"15min":3.1920000000000002},"min":{"1min":1.3009999999999999,"5min":0.68100000000000005,"15min":0.59399999999999997},"max":{"1min":18.443000000000001,"5min":41.134999999999998,"15min":41.134999999999998},"last":1.5580000000000001},{"interface":"front","average":{"1min":7.0220000000000002,"5min":4.0259999999999998,"15min":3.2850000000000001},"min":{"1min":1.169,"5min":0.56799999999999995,"15min":0.53500000000000003},"max":{"1min":51.582999999999998,"5min":51.582999999999998,"15min":51.582999999999998},"last":1.371}]}]},{"osd":1,"up_from":13,"seq":55834580132,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1348036,"kb_used_data":508,"kb_used_omap":204,"kb_used_meta":1347315,"kb_avail":93023804,"statfs":{"total":96636764160,"available":95256375296,"internally_reserved":0,"allocated":520192,"data_stored":225356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":209158,"internal_metadata":1379651322},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Dec 12 17:34:47 2023","interfaces":[{"interface":"back","average":{"1min":6.734,"5min":3.395,"15min":3.5209999999999999},"min":{"1min":0.51500000000000001,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":69.915000000000006,"5min":69.915000000000006,"15min":69.915000000000006},"last":0.81999999999999995},{"interface":"front","average":{"1min":4.2789999999999999,"5min":3.8420000000000001,"15min":3.605},"min":{"1min":0.68200000000000005,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":50,"5min":50,"15min":50},"last":0.91000000000000003}]},{"osd":2,"last update":"Tue Dec 12 17:34:47 2023","interfaces":[{"interface":"back","average":{"1min":4.5110000000000001,"5min":3.9689999999999999,"15min":3.8109999999999999},"min":{"1min":0.99099999999999999,"5min":0.51500000000000001,"15min":0.45300000000000001},"max":{"1min":34.095999999999997,"5min":36.338999999999999,"15min":69.111000000000004},"last":0.78700000000000003},{"interface":"front","average":{"1min":5.4279999999999999,"5min":3.4940000000000002,"15min":4.0789999999999997},"min":{"1min":0.98899999999999999,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":33.901000000000003,"5min":33.901000000000003,"15min":66.488},"last":0.96099999999999997}]},{"osd":3,"last update":"Tue Dec 12 17:34:47 2023","interfaces":[{"interface":"back","average":{"1min":4.3890000000000002,"5min":3.552,"15min":3.8170000000000002},"min":{"1min":0.995,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":12.343,"5min":36.104999999999997,"15min":66.596999999999994},"last":1.228},{"interface":"front","average":{"1min":4.2130000000000001,"5min":4.1639999999999997,"15min":3.907},"min":{"1min":0.60899999999999999,"5min":0.45300000000000001,"15min":0.44800000000000001},"max":{"1min":18.184000000000001,"5min":37.051000000000002,"15min":65.433999999999997},"last":1.3640000000000001}]},{"osd":4,"last update":"Tue Dec 12 17:34:47 2023","interfaces":[{"interface":"back","average":{"1min":3.0899999999999999,"5min":3.093,"15min":2.5129999999999999},"min":{"1min":0.69899999999999995,"5min":0.68700000000000006,"15min":0.41399999999999998},"max":{"1min":13.032,"5min":36.465000000000003,"15min":36.465000000000003},"last":1.5489999999999999},{"interface":"front","average":{"1min":2.891,"5min":3.024,"15min":2.9649999999999999},"min":{"1min":0.68999999999999995,"5min":0.64100000000000001,"15min":0.46999999999999997},"max":{"1min":6.9370000000000003,"5min":35.859000000000002,"15min":35.859000000000002},"last":1.526}]},{"osd":5,"last update":"Tue Dec 12 17:34:47 2023","interfaces":[{"interface":"back","average":{"1min":3.5,"5min":3.5289999999999999,"15min":2.843},"min":{"1min":0.89400000000000002,"5min":0.51000000000000001,"15min":0.503},"max":{"1min":24.033000000000001,"5min":36.865000000000002,"15min":36.865000000000002},"last":1.593},{"interface":"front","average":{"1min":2.5289999999999999,"5min":3.2360000000000002,"15min":2.6709999999999998},"min":{"1min":0.69699999999999995,"5min":0.58899999999999997,"15min":0.47399999999999998},"max":{"1min":11.132999999999999,"5min":36.695999999999998,"15min":36.695999999999998},"last":1.478}]},{"osd":6,"last update":"Tue Dec 12 17:34:47 2023","interfaces":[{"interface":"back","average":{"1min":3.327,"5min":3.4660000000000002,"15min":2.9399999999999999},"min":{"1min":0.92700000000000005,"5min":0.55900000000000005,"15min":0.53500000000000003},"max":{"1min":24.077000000000002,"5min":36.433999999999997,"15min":36.433999999999997},"last":1.4930000000000001},{"interface":"front","average":{"1min":2.6840000000000002,"5min":3.3239999999999998,"15min":2.8079999999999998},"min":{"1min":0.878,"5min":0.57499999999999996,"15min":0.49099999999999999},"max":{"1min":11.324999999999999,"5min":36.612000000000002,"15min":36.612000000000002},"last":1.4099999999999999}]},{"osd":7,"last update":"Tue Dec 12 17:34:47 2023","interfaces":[{"interface":"back","average":{"1min":3.2309999999999999,"5min":3.3580000000000001,"15min":3.1349999999999998},"min":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.51600000000000001},"max":{"1min":10.15,"5min":36.006999999999998,"15min":36.006999999999998},"last":1.4530000000000001},{"interface":"front","average":{"1min":3.5089999999999999,"5min":3.601,"15min":3.0489999999999999},"min":{"1min":0.95299999999999996,"5min":0.75900000000000001,"15min":0.58499999999999996},"max":{"1min":24.114999999999998,"5min":36.979999999999997,"15min":36.979999999999997},"last":1.6910000000000001}]}]},{"osd":0,"up_from":13,"seq":55834580126,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1642180,"kb_used_data":1084,"kb_used_omap":327,"kb_used_meta":1640760,"kb_avail":92729660,"statfs":{"total":96636764160,"available":94955171840,"internally_reserved":0,"allocated":1110016,"data_stored":814755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":335698,"internal_metadata":1680138414},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Dec 12 17:34:43 2023","interfaces":[{"interface":"back","average":{"1min":2.9569999999999999,"5min":3.2229999999999999,"15min":2.988},"min":{"1min":0.34499999999999997,"5min":0.34300000000000003,"15min":0.32700000000000001},"max":{"1min":8.6050000000000004,"5min":24.763000000000002,"15min":24.763000000000002},"last":0.89500000000000002},{"interface":"front","average":{"1min":3.4039999999999999,"5min":3.536,"15min":3.242},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.378},"max":{"1min":16.047999999999998,"5min":22.780000000000001,"15min":22.780000000000001},"last":1.411}]},{"osd":2,"last update":"Tue Dec 12 17:34:43 2023","interfaces":[{"interface":"back","average":{"1min":3.7789999999999999,"5min":3.601,"15min":3.4929999999999999},"min":{"1min":0.59999999999999998,"5min":0.55800000000000005,"15min":0.51200000000000001},"max":{"1min":16.143999999999998,"5min":23.042999999999999,"15min":23.042999999999999},"last":1.8600000000000001},{"interface":"front","average":{"1min":3.113,"5min":3.476,"15min":3.9380000000000002},"min":{"1min":0.64000000000000001,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":8.6940000000000008,"5min":24.658000000000001,"15min":151.84100000000001},"last":1.0249999999999999}]},{"osd":3,"last update":"Tue Dec 12 17:34:43 2023","interfaces":[{"interface":"back","average":{"1min":5.1059999999999999,"5min":4.4020000000000001,"15min":3.6680000000000001},"min":{"1min":0.89100000000000001,"5min":0.42399999999999999,"15min":0.38500000000000001},"max":{"1min":31.922999999999998,"5min":64.292000000000002,"15min":64.292000000000002},"last":1.157},{"interface":"front","average":{"1min":4.181,"5min":3.891,"15min":3.524},"min":{"1min":0.70199999999999996,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":15.932,"5min":25.207999999999998,"15min":25.207999999999998},"last":1.552}]},{"osd":4,"last update":"Tue Dec 12 17:34:43 2023","interfaces":[{"interface":"back","average":{"1min":2.4620000000000002,"5min":2.855,"15min":2.4199999999999999},"min":{"1min":0.69799999999999995,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":8.1769999999999996,"5min":24.856000000000002,"15min":24.856000000000002},"last":1.0760000000000001},{"interface":"front","average":{"1min":4.2249999999999996,"5min":3.9180000000000001,"15min":2.8919999999999999},"min":{"1min":0.51900000000000002,"5min":0.47299999999999998,"15min":0.434},"max":{"1min":32.006999999999998,"5min":64.061999999999998,"15min":64.061999999999998},"last":1.3480000000000001}]},{"osd":5,"last update":"Tue Dec 12 17:34:43 2023","interfaces":[{"interface":"back","average":{"1min":3.6989999999999998,"5min":3.371,"15min":2.6749999999999998},"min":{"1min":0.66000000000000003,"5min":0.49299999999999999,"15min":0.438},"max":{"1min":21.183,"5min":27.843,"15min":27.843},"last":1.1040000000000001},{"interface":"front","average":{"1min":3.0680000000000001,"5min":3.3410000000000002,"15min":2.8439999999999999},"min":{"1min":0.66900000000000004,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":7.1870000000000003,"5min":22.68,"15min":22.68},"last":1.653}]},{"osd":6,"last update":"Tue Dec 12 17:34:43 2023","interfaces":[{"interface":"back","average":{"1min":3.1480000000000001,"5min":3.085,"15min":2.8370000000000002},"min":{"1min":0.63500000000000001,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":7.4130000000000003,"5min":22.457999999999998,"15min":22.457999999999998},"last":1.7490000000000001},{"interface":"front","average":{"1min":2.972,"5min":3.3359999999999999,"15min":2.7759999999999998},"min":{"1min":0.79100000000000004,"5min":0.628,"15min":0.51500000000000001},"max":{"1min":8.4109999999999996,"5min":40.453000000000003,"15min":40.453000000000003},"last":1.2390000000000001}]},{"osd":7,"last update":"Tue Dec 12 17:34:43 2023","interfaces":[{"interface":"back","average":{"1min":2.9380000000000002,"5min":3.2400000000000002,"15min":2.843},"min":{"1min":0.82899999999999996,"5min":0.65900000000000003,"15min":0.60599999999999998},"max":{"1min":8.5120000000000005,"5min":24.510999999999999,"15min":24.510999999999999},"last":1.2649999999999999},{"interface":"front","average":{"1min":4.5890000000000004,"5min":4.1539999999999999,"15min":3.1059999999999999},"min":{"1min":0.55800000000000005,"5min":0.52000000000000002,"15min":0.46500000000000002},"max":{"1min":32.055,"5min":64.191999999999993,"15min":64.191999999999993},"last":1.6899999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-12T17:35:35.041 DEBUG:teuthology.orchestra.run.smithi078:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-12-12T17:35:35.235 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:35.227+0000 7f528f067640 1 Processor -- start 2023-12-12T17:35:35.236 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:35.227+0000 7f528f067640 1 -- start start 2023-12-12T17:35:35.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:35.231+0000 7f528f067640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f52880cfa20 0x7f528815b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:35:35.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:35.231+0000 7f528f067640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f528815be80 0x7f52880cb840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:35:35.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:35.231+0000 7f528f067640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f528815b4a0 con 0x7f528815b0c0 2023-12-12T17:35:35.239 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:35.231+0000 7f528f067640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f528815c650 con 0x7f52880cfa20 2023-12-12T17:35:35.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:35.231+0000 7f528f067640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52880cd710 con 0x7f528815be80 2023-12-12T17:35:35.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:35.231+0000 7f528e065640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7f528815b0c0 0x7f52880cf310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:37390/0 (socket says 172.21.15.78:37390) 2023-12-12T17:35:35.240 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:35.231+0000 7f528e065640 1 -- 172.21.15.78:0/481011998 learned_addr learned my addr 172.21.15.78:0/481011998 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-12-12T17:35:35.241 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:35.231+0000 7f528e866640 1 --2- 172.21.15.78:0/481011998 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f528815be80 0x7f52880cb840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:35:35.241 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:35.231+0000 7f528d864640 1 --2- 172.21.15.78:0/481011998 >> v2:172.21.15.187:3300/0 conn(0x7f52880cfa20 0x7f528815b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:35:35.241 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:35.231+0000 7f528d063640 1 -- 172.21.15.78:0/481011998 <== mon.0 v1:172.21.15.78:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1891384641 0 0) 0x7f528815b4a0 con 0x7f528815b0c0 2023-12-12T17:35:35.241 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:35.235+0000 7f528d063640 1 -- 172.21.15.78:0/481011998 --> v1:172.21.15.78:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5274003530 con 0x7f528815b0c0 2023-12-12T17:35:35.241 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:35.235+0000 7f528e866640 1 -- 172.21.15.78:0/481011998 >> v2:172.21.15.187:3300/0 conn(0x7f52880cfa20 msgr2=0x7f528815b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T17:35:35.241 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:35.235+0000 7f528e866640 1 --2- 172.21.15.78:0/481011998 >> v2:172.21.15.187:3300/0 conn(0x7f52880cfa20 0x7f528815b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:35.241 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:35.235+0000 7f528e866640 1 -- 172.21.15.78:0/481011998 >> v1:172.21.15.78:6789/0 conn(0x7f528815b0c0 legacy=0x7f52880cf310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:35:35.242 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:35.235+0000 7f528e866640 1 -- 172.21.15.78:0/481011998 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52880cd9f0 con 0x7f528815be80 2023-12-12T17:35:35.248 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:35.243+0000 7f528e866640 1 --2- 172.21.15.78:0/481011998 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f528815be80 0x7f52880cb840 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f5280009d90 tx=0x7f528001c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cf6da720923b5627 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T17:35:35.249 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:35.243+0000 7f528d063640 1 -- 172.21.15.78:0/481011998 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52800a59e0 con 0x7f528815be80 2023-12-12T17:35:35.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:35.243+0000 7f528d063640 1 -- 172.21.15.78:0/481011998 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52800a5b40 con 0x7f528815be80 2023-12-12T17:35:35.250 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:35.243+0000 7f528d063640 1 -- 172.21.15.78:0/481011998 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52800ad440 con 0x7f528815be80 2023-12-12T17:35:35.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:35.243+0000 7f528f067640 1 -- 172.21.15.78:0/481011998 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f528815be80 msgr2=0x7f52880cb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:35:35.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:35.243+0000 7f528f067640 1 --2- 172.21.15.78:0/481011998 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f528815be80 0x7f52880cb840 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f5280009d90 tx=0x7f528001c920 comp rx=0 tx=0).stop 2023-12-12T17:35:35.251 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:35.243+0000 7f528f067640 1 -- 172.21.15.78:0/481011998 shutdown_connections 2023-12-12T17:35:35.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:35.243+0000 7f528f067640 1 --2- 172.21.15.78:0/481011998 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f528815be80 0x7f52880cb840 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:35.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:35.243+0000 7f528f067640 1 --2- 172.21.15.78:0/481011998 >> v2:172.21.15.187:3300/0 conn(0x7f52880cfa20 0x7f528815b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:35.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:35.243+0000 7f528f067640 1 -- 172.21.15.78:0/481011998 >> 172.21.15.78:0/481011998 conn(0x7f52880d0d30 msgr2=0x7f52880d1140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T17:35:35.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:35.243+0000 7f528f067640 1 -- 172.21.15.78:0/481011998 shutdown_connections 2023-12-12T17:35:35.252 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:35.243+0000 7f528f067640 1 -- 172.21.15.78:0/481011998 wait complete. 2023-12-12T17:35:35.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:35.247+0000 7f528f067640 1 Processor -- start 2023-12-12T17:35:35.256 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:35.251+0000 7f528f067640 1 -- start start 2023-12-12T17:35:35.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:35.251+0000 7f528f067640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52880cfa20 0x7f52880c6ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:35:35.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:35.251+0000 7f528f067640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f528815b0c0 0x7f52881f8e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:35:35.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:35.251+0000 7f528f067640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f528815be80 0x7f52881f93a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:35:35.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:35.251+0000 7f528f067640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52880c4840 con 0x7f52880cfa20 2023-12-12T17:35:35.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:35.251+0000 7f528f067640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52880c4ae0 con 0x7f528815b0c0 2023-12-12T17:35:35.259 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:35.251+0000 7f528f067640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52880c4dc0 con 0x7f528815be80 2023-12-12T17:35:35.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:35.251+0000 7f528e065640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52880cfa20 0x7f52880c6ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:35:35.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:35.251+0000 7f528e065640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52880cfa20 0x7f52880c6ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.78:3300/0 says I am v2:172.21.15.78:48232/0 (socket says 172.21.15.78:48232) 2023-12-12T17:35:35.260 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:35.251+0000 7f528e065640 1 -- 172.21.15.78:0/2565888079 learned_addr learned my addr 172.21.15.78:0/2565888079 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T17:35:35.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:35.251+0000 7f528e866640 1 --2- 172.21.15.78:0/2565888079 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f528815be80 0x7f52881f93a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:35:35.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:35.251+0000 7f528d864640 1 --2- 172.21.15.78:0/2565888079 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f528815b0c0 0x7f52881f8e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:35:35.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:35.255+0000 7f528e065640 1 -- 172.21.15.78:0/2565888079 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f528815be80 msgr2=0x7f52881f93a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:35:35.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:35.255+0000 7f528e065640 1 --2- 172.21.15.78:0/2565888079 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f528815be80 0x7f52881f93a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:35.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:35.255+0000 7f528e065640 1 -- 172.21.15.78:0/2565888079 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f528815b0c0 msgr2=0x7f52881f8e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:35:35.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:35.255+0000 7f528e065640 1 --2- 172.21.15.78:0/2565888079 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f528815b0c0 0x7f52881f8e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:35.261 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:35.255+0000 7f528e065640 1 -- 172.21.15.78:0/2565888079 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5280009a70 con 0x7f52880cfa20 2023-12-12T17:35:35.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:35.255+0000 7f528e065640 1 --2- 172.21.15.78:0/2565888079 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52880cfa20 0x7f52880c6ff0 secure :-1 s=READY pgs=2147 cs=0 l=1 rev1=1 crypto rx=0x7f528400c4d0 tx=0x7f528400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T17:35:35.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:35.255+0000 7f527effd640 1 -- 172.21.15.78:0/2565888079 <== mon.0 v2:172.21.15.78:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5284005cf0 con 0x7f52880cfa20 2023-12-12T17:35:35.262 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:35.255+0000 7f527effd640 1 -- 172.21.15.78:0/2565888079 <== mon.0 v2:172.21.15.78:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5284005e50 con 0x7f52880cfa20 2023-12-12T17:35:35.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:35.255+0000 7f528f067640 1 -- 172.21.15.78:0/2565888079 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52880c50a0 con 0x7f52880cfa20 2023-12-12T17:35:35.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:35.255+0000 7f527effd640 1 -- 172.21.15.78:0/2565888079 <== mon.0 v2:172.21.15.78:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5284007270 con 0x7f52880cfa20 2023-12-12T17:35:35.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:35.255+0000 7f528f067640 1 -- 172.21.15.78:0/2565888079 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52880c5660 con 0x7f52880cfa20 2023-12-12T17:35:35.263 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:35.255+0000 7f528f067640 1 -- 172.21.15.78:0/2565888079 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52880745a0 con 0x7f52880cfa20 2023-12-12T17:35:35.265 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:35.259+0000 7f527effd640 1 -- 172.21.15.78:0/2565888079 <== mon.0 v2:172.21.15.78:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f52840073d0 con 0x7f52880cfa20 2023-12-12T17:35:35.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:35.259+0000 7f527effd640 1 --2- 172.21.15.78:0/2565888079 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f526c066470 0x7f526c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:35:35.267 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:35.259+0000 7f527effd640 1 -- 172.21.15.78:0/2565888079 <== mon.0 v2:172.21.15.78:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f5284083180 con 0x7f52880cfa20 2023-12-12T17:35:35.268 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:35.259+0000 7f528d864640 1 --2- 172.21.15.78:0/2565888079 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f526c066470 0x7f526c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:35:35.269 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:35.263+0000 7f528d864640 1 --2- 172.21.15.78:0/2565888079 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f526c066470 0x7f526c068930 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f52880b6c80 tx=0x7f5278009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T17:35:35.270 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:35.263+0000 7f527effd640 1 -- 172.21.15.78:0/2565888079 <== mon.0 v2:172.21.15.78:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5284050860 con 0x7f52880cfa20 2023-12-12T17:35:35.734 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:35.727+0000 7f528f067640 1 -- 172.21.15.78:0/2565888079 --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f52880b6cb0 con 0x7f52880cfa20 2023-12-12T17:35:35.745 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:35.735+0000 7f527effd640 1 -- 172.21.15.78:0/2565888079 <== mon.0 v2:172.21.15.78:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v12)=0 v12) v1 ==== 123+0+0 (secure 0 0 0) 0x7f5284053e80 con 0x7f52880cfa20 2023-12-12T17:35:35.745 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:35.739+0000 7f527effd640 1 -- 172.21.15.78:0/2565888079 <== mon.0 v2:172.21.15.78:3300/0 8 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f5284050860 con 0x7f52880cfa20 2023-12-12T17:35:35.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:35.743+0000 7f528f067640 1 -- 172.21.15.78:0/2565888079 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f526c066470 msgr2=0x7f526c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:35:35.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:35.743+0000 7f528f067640 1 --2- 172.21.15.78:0/2565888079 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f526c066470 0x7f526c068930 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f52880b6c80 tx=0x7f5278009190 comp rx=0 tx=0).stop 2023-12-12T17:35:35.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:35.743+0000 7f528f067640 1 -- 172.21.15.78:0/2565888079 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52880cfa20 msgr2=0x7f52880c6ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:35:35.749 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:35.743+0000 7f528f067640 1 --2- 172.21.15.78:0/2565888079 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52880cfa20 0x7f52880c6ff0 secure :-1 s=READY pgs=2147 cs=0 l=1 rev1=1 crypto rx=0x7f528400c4d0 tx=0x7f528400c990 comp rx=0 tx=0).stop 2023-12-12T17:35:35.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:35.743+0000 7f528f067640 1 -- 172.21.15.78:0/2565888079 shutdown_connections 2023-12-12T17:35:35.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:35.743+0000 7f528f067640 1 --2- 172.21.15.78:0/2565888079 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7f526c066470 0x7f526c068930 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:35.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:35.743+0000 7f528f067640 1 --2- 172.21.15.78:0/2565888079 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f528815be80 0x7f52881f93a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:35.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:35.743+0000 7f528f067640 1 --2- 172.21.15.78:0/2565888079 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f528815b0c0 0x7f52881f8e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:35.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:35.743+0000 7f528f067640 1 --2- 172.21.15.78:0/2565888079 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7f52880cfa20 0x7f52880c6ff0 unknown :-1 s=CLOSED pgs=2147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:35.750 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:35.743+0000 7f528f067640 1 -- 172.21.15.78:0/2565888079 >> 172.21.15.78:0/2565888079 conn(0x7f52880d0d30 msgr2=0x7f52880ada90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T17:35:35.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:35.743+0000 7f528f067640 1 -- 172.21.15.78:0/2565888079 shutdown_connections 2023-12-12T17:35:35.751 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:35.743+0000 7f528f067640 1 -- 172.21.15.78:0/2565888079 wait complete. 2023-12-12T17:35:35.799 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-12T17:35:35.800 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-12T17:35:36.198 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:36.191+0000 7fb79671d640 1 Processor -- start 2023-12-12T17:35:36.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:36.191+0000 7fb79671d640 1 -- start start 2023-12-12T17:35:36.199 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:36.191+0000 7fb79671d640 1 --2- >> v2:172.21.15.78:3300/0 conn(0x7fb7900ade10 0x7fb7900ce5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:35:36.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:36.191+0000 7fb79671d640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fb7900b47d0 0x7fb7901580a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:35:36.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:36.191+0000 7fb79671d640 1 -- --> v1:172.21.15.78:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7900ae1f0 con 0x7fb7900cb7e0 2023-12-12T17:35:36.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:36.191+0000 7fb79671d640 1 -- --> v2:172.21.15.78:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb79015c410 con 0x7fb7900ade10 2023-12-12T17:35:36.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:36.191+0000 7fb79671d640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7900ceb00 con 0x7fb7900b47d0 2023-12-12T17:35:36.200 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:36.191+0000 7fb7877fe640 1 --1- >> v1:172.21.15.78:6789/0 conn(0x7fb7900cb7e0 0x7fb7900b40c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.78:6789/0 says I am v1:172.21.15.78:37398/0 (socket says 172.21.15.78:37398) 2023-12-12T17:35:36.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:36.195+0000 7fb7877fe640 1 -- 172.21.15.78:0/782622679 learned_addr learned my addr 172.21.15.78:0/782622679 (peer_addr_for_me v1:172.21.15.78:0/0) 2023-12-12T17:35:36.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:36.195+0000 7fb794cba640 1 --2- 172.21.15.78:0/782622679 >> v2:172.21.15.187:3300/0 conn(0x7fb7900b47d0 0x7fb7901580a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:35:36.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:36.195+0000 7fb78ffff640 1 --2- 172.21.15.78:0/782622679 >> v2:172.21.15.78:3300/0 conn(0x7fb7900ade10 0x7fb7900ce5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:35:36.201 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:36.195+0000 7fb794cba640 1 -- 172.21.15.78:0/782622679 >> v2:172.21.15.78:3300/0 conn(0x7fb7900ade10 msgr2=0x7fb7900ce5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T17:35:36.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:36.195+0000 7fb794cba640 1 --2- 172.21.15.78:0/782622679 >> v2:172.21.15.78:3300/0 conn(0x7fb7900ade10 0x7fb7900ce5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:36.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:36.195+0000 7fb794cba640 1 -- 172.21.15.78:0/782622679 >> v1:172.21.15.78:6789/0 conn(0x7fb7900cb7e0 legacy=0x7fb7900b40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:35:36.202 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:36.195+0000 7fb794cba640 1 -- 172.21.15.78:0/782622679 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb79015b800 con 0x7fb7900b47d0 2023-12-12T17:35:36.209 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:36.203+0000 7fb794cba640 1 --2- 172.21.15.78:0/782622679 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb7900b47d0 0x7fb7901580a0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7fb7900b1e40 tx=0x7fb78801c730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f610829a939e9eb2 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T17:35:36.210 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:36.203+0000 7fb78f7fe640 1 -- 172.21.15.78:0/782622679 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7880a66f0 con 0x7fb7900b47d0 2023-12-12T17:35:36.210 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:36.203+0000 7fb78f7fe640 1 -- 172.21.15.78:0/782622679 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fb7880a6850 con 0x7fb7900b47d0 2023-12-12T17:35:36.210 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:36.203+0000 7fb78f7fe640 1 -- 172.21.15.78:0/782622679 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7880a6c00 con 0x7fb7900b47d0 2023-12-12T17:35:36.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:36.203+0000 7fb79671d640 1 -- 172.21.15.78:0/782622679 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb7900b47d0 msgr2=0x7fb7901580a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:35:36.211 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:36.203+0000 7fb79671d640 1 --2- 172.21.15.78:0/782622679 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb7900b47d0 0x7fb7901580a0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7fb7900b1e40 tx=0x7fb78801c730 comp rx=0 tx=0).stop 2023-12-12T17:35:36.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:36.203+0000 7fb79671d640 1 -- 172.21.15.78:0/782622679 shutdown_connections 2023-12-12T17:35:36.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:36.203+0000 7fb79671d640 1 --2- 172.21.15.78:0/782622679 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb7900b47d0 0x7fb7901580a0 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:36.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:36.203+0000 7fb79671d640 1 --2- 172.21.15.78:0/782622679 >> v2:172.21.15.78:3300/0 conn(0x7fb7900ade10 0x7fb7900ce5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:36.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:36.203+0000 7fb79671d640 1 -- 172.21.15.78:0/782622679 >> 172.21.15.78:0/782622679 conn(0x7fb79006c5d0 msgr2=0x7fb79006c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T17:35:36.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:36.203+0000 7fb79671d640 1 -- 172.21.15.78:0/782622679 shutdown_connections 2023-12-12T17:35:36.212 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:36.203+0000 7fb79671d640 1 -- 172.21.15.78:0/782622679 wait complete. 2023-12-12T17:35:36.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:36.207+0000 7fb79671d640 1 Processor -- start 2023-12-12T17:35:36.214 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:36.207+0000 7fb79671d640 1 -- start start 2023-12-12T17:35:36.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:36.207+0000 7fb79671d640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb7900ade10 0x7fb7901fa5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:35:36.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:36.207+0000 7fb79671d640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb7900b47d0 0x7fb79014d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:35:36.215 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:36.207+0000 7fb79671d640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb7900cb7e0 0x7fb79014d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:35:36.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:36.207+0000 7fb79671d640 1 -- --> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7901fae00 con 0x7fb7900cb7e0 2023-12-12T17:35:36.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:36.207+0000 7fb79671d640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb790165f40 con 0x7fb7900ade10 2023-12-12T17:35:36.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:36.207+0000 7fb79671d640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb790165610 con 0x7fb7900b47d0 2023-12-12T17:35:36.216 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:36.207+0000 7fb794cba640 1 --2- >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb7900cb7e0 0x7fb79014d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:35:36.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:36.207+0000 7fb78ffff640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb7900ade10 0x7fb7901fa5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:35:36.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:36.207+0000 7fb78ffff640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb7900ade10 0x7fb7901fa5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.78:34076/0 (socket says 172.21.15.78:34076) 2023-12-12T17:35:36.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:36.207+0000 7fb78ffff640 1 -- 172.21.15.78:0/202236411 learned_addr learned my addr 172.21.15.78:0/202236411 (peer_addr_for_me v2:172.21.15.78:0/0) 2023-12-12T17:35:36.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:36.207+0000 7fb7877fe640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb7900b47d0 0x7fb79014d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:35:36.217 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:36.211+0000 7fb78ffff640 1 -- 172.21.15.78:0/202236411 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb7900b47d0 msgr2=0x7fb79014d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:35:36.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:36.211+0000 7fb78ffff640 1 --2- 172.21.15.78:0/202236411 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb7900b47d0 0x7fb79014d290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:36.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:36.211+0000 7fb78ffff640 1 -- 172.21.15.78:0/202236411 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb7900cb7e0 msgr2=0x7fb79014d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:35:36.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:36.211+0000 7fb78ffff640 1 --2- 172.21.15.78:0/202236411 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb7900cb7e0 0x7fb79014d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:36.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:36.211+0000 7fb78ffff640 1 -- 172.21.15.78:0/202236411 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb788009a70 con 0x7fb7900ade10 2023-12-12T17:35:36.218 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:36.211+0000 7fb794cba640 1 --2- 172.21.15.78:0/202236411 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb7900cb7e0 0x7fb79014d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-12T17:35:36.219 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:36.211+0000 7fb78ffff640 1 --2- 172.21.15.78:0/202236411 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb7900ade10 0x7fb7901fa5b0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7fb78000e930 tx=0x7fb78000edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T17:35:36.219 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:36.211+0000 7fb78d7fa640 1 -- 172.21.15.78:0/202236411 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb780009690 con 0x7fb7900ade10 2023-12-12T17:35:36.219 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:36.211+0000 7fb78d7fa640 1 -- 172.21.15.78:0/202236411 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fb78000ca00 con 0x7fb7900ade10 2023-12-12T17:35:36.219 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:36.211+0000 7fb79671d640 1 -- 172.21.15.78:0/202236411 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7901658f0 con 0x7fb7900ade10 2023-12-12T17:35:36.219 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:36.211+0000 7fb78d7fa640 1 -- 172.21.15.78:0/202236411 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb78000cd90 con 0x7fb7900ade10 2023-12-12T17:35:36.220 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:36.211+0000 7fb79671d640 1 -- 172.21.15.78:0/202236411 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7901faaf0 con 0x7fb7900ade10 2023-12-12T17:35:36.221 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:36.215+0000 7fb79671d640 1 -- 172.21.15.78:0/202236411 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7900671f0 con 0x7fb7900ade10 2023-12-12T17:35:36.226 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:36.219+0000 7fb78d7fa640 1 -- 172.21.15.78:0/202236411 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb780013470 con 0x7fb7900ade10 2023-12-12T17:35:36.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:36.223+0000 7fb78d7fa640 1 --2- 172.21.15.78:0/202236411 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fb770066470 0x7fb770068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T17:35:36.228 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:36.223+0000 7fb78d7fa640 1 -- 172.21.15.78:0/202236411 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fb780083ff0 con 0x7fb7900ade10 2023-12-12T17:35:36.229 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:36.223+0000 7fb7877fe640 1 --2- 172.21.15.78:0/202236411 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fb770066470 0x7fb770068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T17:35:36.230 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:36.223+0000 7fb7877fe640 1 --2- 172.21.15.78:0/202236411 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fb770066470 0x7fb770068930 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fb790166cf0 tx=0x7fb778009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T17:35:36.232 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:36.227+0000 7fb78d7fa640 1 -- 172.21.15.78:0/202236411 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb7800b5280 con 0x7fb7900ade10 2023-12-12T17:35:36.798 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:36.791+0000 7fb79671d640 1 -- 172.21.15.78:0/202236411 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb790067530 con 0x7fb7900ade10 2023-12-12T17:35:36.799 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:36.791+0000 7fb78d7fa640 1 -- 172.21.15.78:0/202236411 <== mon.1 v2:172.21.15.187:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+3700 (secure 0 0 0) 0x7fb780021090 con 0x7fb7900ade10 2023-12-12T17:35:36.800 INFO:teuthology.orchestra.run.smithi078.stdout: 2023-12-12T17:35:36.800 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":19,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5024,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/142991070","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":142991070},{"type":"v1","addr":"172.21.15.187:6835","nonce":142991070}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5374,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/1159092364","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":1159092364},{"type":"v1","addr":"172.21.15.187:6834","nonce":1159092364}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5469,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6836/314422656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6834","nonce":314422656},{"type":"v1","addr":"172.21.15.78:6836","nonce":314422656}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":10359,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.78:6837/2161499223","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6835","nonce":2161499223},{"type":"v1","addr":"172.21.15.78:6837","nonce":2161499223}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19}],"filesystems":[]} 2023-12-12T17:35:36.800 INFO:teuthology.orchestra.run.smithi078.stderr:dumped fsmap epoch 19 2023-12-12T17:35:36.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:36.795+0000 7fb79671d640 1 -- 172.21.15.78:0/202236411 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fb770066470 msgr2=0x7fb770068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:35:36.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:36.795+0000 7fb79671d640 1 --2- 172.21.15.78:0/202236411 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fb770066470 0x7fb770068930 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fb790166cf0 tx=0x7fb778009040 comp rx=0 tx=0).stop 2023-12-12T17:35:36.804 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:36.795+0000 7fb79671d640 1 -- 172.21.15.78:0/202236411 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb7900ade10 msgr2=0x7fb7901fa5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T17:35:36.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:36.795+0000 7fb79671d640 1 --2- 172.21.15.78:0/202236411 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb7900ade10 0x7fb7901fa5b0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7fb78000e930 tx=0x7fb78000edf0 comp rx=0 tx=0).stop 2023-12-12T17:35:36.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:36.799+0000 7fb79671d640 1 -- 172.21.15.78:0/202236411 shutdown_connections 2023-12-12T17:35:36.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:36.799+0000 7fb79671d640 1 --2- 172.21.15.78:0/202236411 >> [v2:172.21.15.78:6832/1725498448,v1:172.21.15.78:6833/1725498448] conn(0x7fb770066470 0x7fb770068930 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:36.805 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:36.799+0000 7fb79671d640 1 --2- 172.21.15.78:0/202236411 >> [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] conn(0x7fb7900cb7e0 0x7fb79014d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:36.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:36.799+0000 7fb79671d640 1 --2- 172.21.15.78:0/202236411 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb7900b47d0 0x7fb79014d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:36.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:36.799+0000 7fb79671d640 1 --2- 172.21.15.78:0/202236411 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb7900ade10 0x7fb7901fa5b0 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T17:35:36.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:36.799+0000 7fb79671d640 1 -- 172.21.15.78:0/202236411 >> 172.21.15.78:0/202236411 conn(0x7fb79006c5d0 msgr2=0x7fb790150700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T17:35:36.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:36.799+0000 7fb79671d640 1 -- 172.21.15.78:0/202236411 shutdown_connections 2023-12-12T17:35:36.806 INFO:teuthology.orchestra.run.smithi078.stderr:2023-12-12T17:35:36.799+0000 7fb79671d640 1 -- 172.21.15.78:0/202236411 wait complete. 2023-12-12T17:35:36.852 DEBUG:tasks.cephfs.filesystem:already dead... 2023-12-12T17:35:36.852 INFO:teuthology.misc:Shutting down mds daemons... 2023-12-12T17:35:36.853 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-12T17:35:36.853 INFO:teuthology.orchestra.run:waiting for 300 2023-12-12T17:35:38.492 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2023-12-12T17:35:42.955 INFO:tasks.ceph.mds.a:Stopped 2023-12-12T17:35:42.955 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-12T17:35:42.956 INFO:teuthology.orchestra.run:waiting for 300 2023-12-12T17:35:43.027 INFO:tasks.ceph.mds.c:Stopped 2023-12-12T17:35:43.027 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-12T17:35:43.027 INFO:teuthology.orchestra.run:waiting for 300 2023-12-12T17:35:43.043 INFO:tasks.ceph.mds.b:Stopped 2023-12-12T17:35:43.043 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-12T17:35:43.043 INFO:teuthology.orchestra.run:waiting for 300 2023-12-12T17:35:44.804 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2023-12-12T17:35:44.804 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a has been restored 2023-12-12T17:35:49.146 INFO:tasks.ceph.mds.d:Stopped 2023-12-12T17:35:49.146 INFO:teuthology.misc:Shutting down osd daemons... 2023-12-12T17:35:49.147 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-12-12T17:35:49.147 INFO:teuthology.orchestra.run:waiting for 300 2023-12-12T17:35:51.114 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2023-12-12T17:35:55.249 INFO:tasks.ceph.osd.0:Stopped 2023-12-12T17:35:55.250 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-12-12T17:35:55.250 INFO:teuthology.orchestra.run:waiting for 300 2023-12-12T17:36:01.352 INFO:tasks.ceph.osd.1:Stopped 2023-12-12T17:36:01.352 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-12-12T17:36:01.353 INFO:teuthology.orchestra.run:waiting for 300 2023-12-12T17:36:07.454 INFO:tasks.ceph.osd.2:Stopped 2023-12-12T17:36:07.455 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-12-12T17:36:07.455 INFO:teuthology.orchestra.run:waiting for 300 2023-12-12T17:36:13.557 INFO:tasks.ceph.osd.3:Stopped 2023-12-12T17:36:13.557 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-12-12T17:36:13.558 INFO:teuthology.orchestra.run:waiting for 300 2023-12-12T17:36:19.659 INFO:tasks.ceph.osd.4:Stopped 2023-12-12T17:36:19.660 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-12-12T17:36:19.660 INFO:teuthology.orchestra.run:waiting for 300 2023-12-12T17:36:25.762 INFO:tasks.ceph.osd.5:Stopped 2023-12-12T17:36:25.762 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-12-12T17:36:25.762 INFO:teuthology.orchestra.run:waiting for 300 2023-12-12T17:36:31.863 INFO:tasks.ceph.osd.6:Stopped 2023-12-12T17:36:31.864 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-12-12T17:36:31.864 INFO:teuthology.orchestra.run:waiting for 300 2023-12-12T17:36:32.465 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2023-12-12T17:36:37.966 INFO:tasks.ceph.osd.7:Stopped 2023-12-12T17:36:37.967 INFO:teuthology.misc:Shutting down mgr daemons... 2023-12-12T17:36:37.967 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-12-12T17:36:37.968 INFO:teuthology.orchestra.run:waiting for 300 2023-12-12T17:36:37.969 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2023-12-12T17:36:37.969 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2023-12-12T17:36:43.373 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~0s 2023-12-12T17:36:43.374 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2023-12-12T17:36:44.069 INFO:tasks.ceph.mgr.y:Stopped 2023-12-12T17:36:44.069 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-12-12T17:36:44.069 INFO:teuthology.orchestra.run:waiting for 300 2023-12-12T17:36:48.677 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~0s 2023-12-12T17:36:48.677 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y has been restored 2023-12-12T17:36:50.170 INFO:tasks.ceph.mgr.x:Stopped 2023-12-12T17:36:50.171 INFO:teuthology.misc:Shutting down mon daemons... 2023-12-12T17:36:50.171 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-12-12T17:36:50.171 INFO:teuthology.orchestra.run:waiting for 300 2023-12-12T17:36:53.880 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2023-12-12T17:36:53.880 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x has been restored 2023-12-12T17:36:56.273 INFO:tasks.ceph.mon.a:Stopped 2023-12-12T17:36:56.274 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-12-12T17:36:56.274 INFO:teuthology.orchestra.run:waiting for 300 2023-12-12T17:36:58.983 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2023-12-12T17:36:58.983 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a has been restored 2023-12-12T17:37:02.376 INFO:tasks.ceph.mon.b:Stopped 2023-12-12T17:37:02.376 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-12-12T17:37:02.377 INFO:teuthology.orchestra.run:waiting for 300 2023-12-12T17:37:03.984 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2023-12-12T17:37:03.984 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b has been restored 2023-12-12T17:37:08.479 INFO:tasks.ceph.mon.c:Stopped 2023-12-12T17:37:08.479 INFO:tasks.ceph:Checking cluster log for badness... 2023-12-12T17:37:08.480 DEBUG:teuthology.orchestra.run.smithi078:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-12-12T17:37:08.623 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi078.front.sepia.ceph.com 2023-12-12T17:37:08.624 DEBUG:teuthology.orchestra.run.smithi078:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-12-12T17:37:08.985 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c has been restored 2023-12-12T17:37:09.220 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi078.front.sepia.ceph.com 2023-12-12T17:37:09.220 DEBUG:teuthology.orchestra.run.smithi078:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-12-12T17:37:09.846 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi078.front.sepia.ceph.com 2023-12-12T17:37:09.847 DEBUG:teuthology.orchestra.run.smithi078:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-12-12T17:37:10.472 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi078.front.sepia.ceph.com 2023-12-12T17:37:10.472 DEBUG:teuthology.orchestra.run.smithi078:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-12-12T17:37:10.910 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi187.front.sepia.ceph.com 2023-12-12T17:37:10.911 DEBUG:teuthology.orchestra.run.smithi187:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-12-12T17:37:11.439 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi187.front.sepia.ceph.com 2023-12-12T17:37:11.440 DEBUG:teuthology.orchestra.run.smithi187:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-12-12T17:37:11.989 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi187.front.sepia.ceph.com 2023-12-12T17:37:11.990 DEBUG:teuthology.orchestra.run.smithi187:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-12-12T17:37:12.373 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi187.front.sepia.ceph.com 2023-12-12T17:37:12.374 DEBUG:teuthology.orchestra.run.smithi187:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-12-12T17:37:12.936 INFO:tasks.ceph:Archiving mon data... 2023-12-12T17:37:12.937 DEBUG:teuthology.misc:Transferring archived files from smithi078:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/mchangir-2023-12-12_08:46:52-fs-wip-mchangir-testing-20231205.064351-testing-default-smithi/7488242/data/mon.a.tgz 2023-12-12T17:37:12.937 DEBUG:teuthology.orchestra.run.smithi078:> mktemp 2023-12-12T17:37:12.956 INFO:teuthology.orchestra.run.smithi078.stdout:/tmp/tmp.i24OLjRvdL 2023-12-12T17:37:12.957 DEBUG:teuthology.orchestra.run.smithi078:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.i24OLjRvdL 2023-12-12T17:37:13.334 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 0666 /tmp/tmp.i24OLjRvdL 2023-12-12T17:37:13.473 DEBUG:teuthology.orchestra.remote:smithi078:/tmp/tmp.i24OLjRvdL is 566KB 2023-12-12T17:37:13.554 DEBUG:teuthology.orchestra.run.smithi078:> rm -fr /tmp/tmp.i24OLjRvdL 2023-12-12T17:37:13.574 DEBUG:teuthology.misc:Transferring archived files from smithi187:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/mchangir-2023-12-12_08:46:52-fs-wip-mchangir-testing-20231205.064351-testing-default-smithi/7488242/data/mon.b.tgz 2023-12-12T17:37:13.574 DEBUG:teuthology.orchestra.run.smithi187:> mktemp 2023-12-12T17:37:13.583 INFO:teuthology.orchestra.run.smithi187.stdout:/tmp/tmp.yhFacjPXBv 2023-12-12T17:37:13.584 DEBUG:teuthology.orchestra.run.smithi187:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.yhFacjPXBv 2023-12-12T17:37:13.980 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod 0666 /tmp/tmp.yhFacjPXBv 2023-12-12T17:37:14.105 DEBUG:teuthology.orchestra.remote:smithi187:/tmp/tmp.yhFacjPXBv is 575KB 2023-12-12T17:37:14.236 DEBUG:teuthology.orchestra.run.smithi187:> rm -fr /tmp/tmp.yhFacjPXBv 2023-12-12T17:37:14.245 DEBUG:teuthology.misc:Transferring archived files from smithi187:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/mchangir-2023-12-12_08:46:52-fs-wip-mchangir-testing-20231205.064351-testing-default-smithi/7488242/data/mon.c.tgz 2023-12-12T17:37:14.246 DEBUG:teuthology.orchestra.run.smithi187:> mktemp 2023-12-12T17:37:14.298 INFO:teuthology.orchestra.run.smithi187.stdout:/tmp/tmp.0EkGwRKtp9 2023-12-12T17:37:14.298 DEBUG:teuthology.orchestra.run.smithi187:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.0EkGwRKtp9 2023-12-12T17:37:14.451 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod 0666 /tmp/tmp.0EkGwRKtp9 2023-12-12T17:37:14.527 DEBUG:teuthology.orchestra.remote:smithi187:/tmp/tmp.0EkGwRKtp9 is 575KB 2023-12-12T17:37:14.596 DEBUG:teuthology.orchestra.run.smithi187:> rm -fr /tmp/tmp.0EkGwRKtp9 2023-12-12T17:37:14.605 INFO:tasks.ceph:Cleaning ceph cluster... 2023-12-12T17:37:14.606 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-12-12T17:37:14.610 DEBUG:teuthology.orchestra.run.smithi187:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-12-12T17:37:14.731 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2023-12-12T17:37:14.752 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2023-12-12T17:37:14.753 INFO:tasks.ceph:Archiving crash dumps... 2023-12-12T17:37:14.754 DEBUG:teuthology.misc:Transferring archived files from smithi078:/var/lib/ceph/crash to /home/teuthworker/archive/mchangir-2023-12-12_08:46:52-fs-wip-mchangir-testing-20231205.064351-testing-default-smithi/7488242/remote/smithi078/crash 2023-12-12T17:37:14.755 DEBUG:teuthology.orchestra.run.smithi078:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-12-12T17:37:14.826 DEBUG:teuthology.misc:Transferring archived files from smithi187:/var/lib/ceph/crash to /home/teuthworker/archive/mchangir-2023-12-12_08:46:52-fs-wip-mchangir-testing-20231205.064351-testing-default-smithi/7488242/remote/smithi187/crash 2023-12-12T17:37:14.827 DEBUG:teuthology.orchestra.run.smithi187:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-12-12T17:37:14.847 INFO:tasks.ceph:Shutting down logrotate 2023-12-12T17:38:20.421 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-12-12T17:38:20.489 DEBUG:teuthology.orchestra.run.smithi187:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-12-12T17:38:20.614 INFO:tasks.ceph:Compressing logs... 2023-12-12T17:38:20.614 DEBUG:teuthology.orchestra.run.smithi078:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-12T17:38:20.618 DEBUG:teuthology.orchestra.run.smithi187:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-12T17:38:20.670 INFO:teuthology.orchestra.run.smithi187.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.44152.log 2023-12-12T17:38:20.671 INFO:teuthology.orchestra.run.smithi187.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38427.log 2023-12-12T17:38:20.672 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph-client.3.44152.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38403.log 2023-12-12T17:38:20.673 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph-client.admin.38427.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2023-12-12T17:38:20.673 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph-client.admin.38403.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2023-12-12T17:38:20.674 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38379.log 2023-12-12T17:38:20.675 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.44038.log 2023-12-12T17:38:20.677 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph-client.admin.38379.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2023-12-12T17:38:20.677 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph-client.1.44038.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38451.log 2023-12-12T17:38:20.678 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38355.log 2023-12-12T17:38:20.680 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph-client.admin.38451.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.38403.log.gz 2023-12-12T17:38:20.681 INFO:teuthology.orchestra.run.smithi187.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38307.log 2023-12-12T17:38:20.681 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph-client.admin.38355.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.38451.log.gz 2023-12-12T17:38:20.681 INFO:teuthology.orchestra.run.smithi187.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-12-12T17:38:20.681 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph-client.admin.38307.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-12-12T17:38:20.682 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-12-12T17:38:20.683 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180787.log 2023-12-12T17:38:20.684 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38475.log 2023-12-12T17:38:20.684 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-12-12T17:38:20.685 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph-client.admin.38475.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2023-12-12T17:38:20.685 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46123.log 2023-12-12T17:38:20.686 INFO:teuthology.orchestra.run.smithi187.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.1.44038.log.gz 2023-12-12T17:38:20.686 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38331.log 2023-12-12T17:38:20.687 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2023-12-12T17:38:20.688 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.180787.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.491702.log 2023-12-12T17:38:20.688 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph-client.admin.38331.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-12-12T17:38:20.689 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2023-12-12T17:38:20.693 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.221795.log 2023-12-12T17:38:20.695 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.46123.log: /var/log/ceph/ceph-client.admin.491702.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.315145.log 2023-12-12T17:38:20.696 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.203752.log 2023-12-12T17:38:20.699 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.221795.log: /var/log/ceph/ceph-client.admin.315145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.408908.log 2023-12-12T17:38:20.701 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.399938.log 2023-12-12T17:38:20.703 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/ceph-mon.b.log: /var/log/ceph/ceph-osd.4.log: 91.3% -- replaced with /var/log/ceph/ceph-client.3.44152.log.gz 2023-12-12T17:38:20.704 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.203752.log: /var/log/ceph/ceph-client.admin.408908.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44282.log 2023-12-12T17:38:20.705 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188474.log 2023-12-12T17:38:20.705 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.399938.log: 79.8% -- replaced with /var/log/ceph/ceph-client.admin.491702.log.gz 2023-12-12T17:38:20.707 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.44282.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.445638.log 2023-12-12T17:38:20.709 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.188474.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.408908.log.gz 2023-12-12T17:38:20.709 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.519819.log 2023-12-12T17:38:20.712 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.445638.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.246182.log 2023-12-12T17:38:20.713 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.390280.log 2023-12-12T17:38:20.713 INFO:teuthology.orchestra.run.smithi078.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.221795.log.gz 2023-12-12T17:38:20.715 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.519819.log: /var/log/ceph/ceph-client.admin.246182.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.188474.log.gz 2023-12-12T17:38:20.715 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.254441.log 2023-12-12T17:38:20.717 INFO:teuthology.orchestra.run.smithi078.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.519819.log.gz 2023-12-12T17:38:20.717 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.429836.log 2023-12-12T17:38:20.718 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.390280.log: /var/log/ceph/ceph-client.admin.254441.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.44282.log.gz 2023-12-12T17:38:20.718 INFO:teuthology.orchestra.run.smithi187.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.38307.log.gz 2023-12-12T17:38:20.718 INFO:teuthology.orchestra.run.smithi187.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.38331.log.gz 2023-12-12T17:38:20.719 INFO:teuthology.orchestra.run.smithi187.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.38355.log.gz 2023-12-12T17:38:20.719 INFO:teuthology.orchestra.run.smithi078.stderr: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.315145.log.gz 2023-12-12T17:38:20.720 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.313134.log 2023-12-12T17:38:20.720 INFO:teuthology.orchestra.run.smithi187.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.38379.log.gz 2023-12-12T17:38:20.722 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.429836.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.395881.log 2023-12-12T17:38:20.722 INFO:teuthology.orchestra.run.smithi078.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46123.log.gz 2023-12-12T17:38:20.723 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.491299.log 2023-12-12T17:38:20.724 INFO:teuthology.orchestra.run.smithi187.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.38427.log.gz 2023-12-12T17:38:20.725 INFO:teuthology.orchestra.run.smithi187.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.38475.log.gz 2023-12-12T17:38:20.725 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.313134.log: /var/log/ceph/ceph-client.admin.395881.log: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.203752.log.gz 2023-12-12T17:38:20.726 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47903.log 2023-12-12T17:38:20.728 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.491299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.264135.log 2023-12-12T17:38:20.730 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47903.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.504603.log 2023-12-12T17:38:20.732 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.264135.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.227545.log 2023-12-12T17:38:20.734 INFO:teuthology.orchestra.run.smithi187.stderr: 93.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-12-12T17:38:20.735 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.504603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.495379.log 2023-12-12T17:38:20.735 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.313134.log.gz 2023-12-12T17:38:20.737 INFO:teuthology.orchestra.run.smithi078.stderr: 78.4% -- replaced with /var/log/ceph/ceph-client.admin.264135.log.gz 2023-12-12T17:38:20.738 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.227545.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.330789.log 2023-12-12T17:38:20.739 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111871.log 2023-12-12T17:38:20.742 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.495379.log: /var/log/ceph/ceph-client.admin.330789.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.440273.log 2023-12-12T17:38:20.743 INFO:teuthology.orchestra.run.smithi078.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.180787.log.gz 2023-12-12T17:38:20.743 INFO:teuthology.orchestra.run.smithi078.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.504603.log.gz 2023-12-12T17:38:20.744 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.111871.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.384599.log 2023-12-12T17:38:20.746 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.440273.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.487271.log 2023-12-12T17:38:20.747 INFO:teuthology.orchestra.run.smithi078.stderr: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.429836.log.gz 2023-12-12T17:38:20.749 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.384599.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.503562.log 2023-12-12T17:38:20.750 INFO:teuthology.orchestra.run.smithi078.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.227545.log.gz 2023-12-12T17:38:20.751 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.487271.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44688.log 2023-12-12T17:38:20.752 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175365.log 2023-12-12T17:38:20.752 INFO:teuthology.orchestra.run.smithi078.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47903.log.gz 2023-12-12T17:38:20.754 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.503562.log: /var/log/ceph/ceph-client.admin.44688.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.324283.log 2023-12-12T17:38:20.755 INFO:teuthology.orchestra.run.smithi078.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.111871.log.gz 2023-12-12T17:38:20.756 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.325888.log 2023-12-12T17:38:20.758 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.324283.log: /var/log/ceph/ceph-client.admin.175365.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139616.log 2023-12-12T17:38:20.759 INFO:teuthology.orchestra.run.smithi078.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.395881.log.gz 2023-12-12T17:38:20.760 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.325888.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172396.log 2023-12-12T17:38:20.762 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.139616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.207170.log 2023-12-12T17:38:20.762 INFO:teuthology.orchestra.run.smithi078.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.330789.log.gz 2023-12-12T17:38:20.764 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.172396.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.356775.log 2023-12-12T17:38:20.766 INFO:teuthology.orchestra.run.smithi078.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.324283.log.gz 2023-12-12T17:38:20.769 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.207170.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.446954.log 2023-12-12T17:38:20.770 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.325888.log.gz 2023-12-12T17:38:20.770 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.356775.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168496.log 2023-12-12T17:38:20.771 INFO:teuthology.orchestra.run.smithi078.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.172396.log.gz 2023-12-12T17:38:20.771 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.446954.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183347.log 2023-12-12T17:38:20.772 INFO:teuthology.orchestra.run.smithi078.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44688.log.gz 2023-12-12T17:38:20.773 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.168496.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.392169.log 2023-12-12T17:38:20.774 INFO:teuthology.orchestra.run.smithi078.stderr: 79.3% -- replaced with /var/log/ceph/ceph-client.admin.356775.log.gz 2023-12-12T17:38:20.775 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.183347.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.168496.log.gz 2023-12-12T17:38:20.776 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.244957.log 2023-12-12T17:38:20.778 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113895.log 2023-12-12T17:38:20.779 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.392169.log: /var/log/ceph/ceph-client.admin.244957.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.327083.log 2023-12-12T17:38:20.780 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.113895.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.207170.log.gz 2023-12-12T17:38:20.782 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.449212.log 2023-12-12T17:38:20.783 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48064.log 2023-12-12T17:38:20.787 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.327083.log: /var/log/ceph/ceph-client.admin.449212.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.139616.log.gz 2023-12-12T17:38:20.787 INFO:teuthology.orchestra.run.smithi078.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.113895.log.gz 2023-12-12T17:38:20.787 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.382946.log 2023-12-12T17:38:20.789 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.48064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.344579.log 2023-12-12T17:38:20.790 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.382946.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46959.log 2023-12-12T17:38:20.790 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.344579.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.392169.log.gz 2023-12-12T17:38:20.791 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45394.log 2023-12-12T17:38:20.793 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.46959.log: 77.4% -- replaced with /var/log/ceph/ceph-client.admin.327083.log.gz 2023-12-12T17:38:20.794 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49699.log 2023-12-12T17:38:20.795 INFO:teuthology.orchestra.run.smithi078.stderr: 79.8% -- replaced with /var/log/ceph/ceph-client.admin.244957.log.gz 2023-12-12T17:38:20.796 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.45394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93729.log 2023-12-12T17:38:20.798 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.49699.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.46959.log.gz 2023-12-12T17:38:20.798 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194316.log 2023-12-12T17:38:20.800 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.93729.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148713.log 2023-12-12T17:38:20.801 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.516382.log 2023-12-12T17:38:20.805 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.194316.log: /var/log/ceph/ceph-client.admin.148713.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.424763.log 2023-12-12T17:38:20.808 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.516382.log: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.516382.log.gz 2023-12-12T17:38:20.808 INFO:teuthology.orchestra.run.smithi078.stderr: 94.3% -- replaced with /var/log/ceph/ceph-client.admin.175365.log.gz 2023-12-12T17:38:20.809 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.208025.log 2023-12-12T17:38:20.809 INFO:teuthology.orchestra.run.smithi078.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.183347.log.gz 2023-12-12T17:38:20.811 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.424763.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.242517.log 2023-12-12T17:38:20.811 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.208025.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48064.log.gz 2023-12-12T17:38:20.814 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.444399.log 2023-12-12T17:38:20.814 INFO:teuthology.orchestra.run.smithi078.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.194316.log.gz 2023-12-12T17:38:20.817 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.242517.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.227536.log 2023-12-12T17:38:20.819 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.444399.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49699.log.gz 2023-12-12T17:38:20.819 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2023-12-12T17:38:20.821 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.227536.log: 79.9% -- replaced with /var/log/ceph/ceph-client.admin.227536.log.gz 2023-12-12T17:38:20.822 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.469851.log 2023-12-12T17:38:20.826 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147373.log 2023-12-12T17:38:20.828 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.469851.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.208025.log.gz 2023-12-12T17:38:20.829 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49647.log 2023-12-12T17:38:20.830 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.147373.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.470682.log 2023-12-12T17:38:20.833 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.49647.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.410703.log 2023-12-12T17:38:20.834 INFO:teuthology.orchestra.run.smithi078.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49647.log.gz 2023-12-12T17:38:20.835 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.224279.log 2023-12-12T17:38:20.837 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.470682.log: /var/log/ceph/ceph-client.admin.410703.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45394.log.gz 2023-12-12T17:38:20.838 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.509586.log 2023-12-12T17:38:20.840 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.444821.log 2023-12-12T17:38:20.841 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.224279.log: /var/log/ceph/ceph-client.admin.509586.log: 80.2% -- replaced with /var/log/ceph/ceph-client.admin.509586.log.gz 2023-12-12T17:38:20.841 INFO:teuthology.orchestra.run.smithi078.stderr: 79.5% -- replaced with /var/log/ceph/ceph-client.admin.470682.log.gz 2023-12-12T17:38:20.842 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.335640.log 2023-12-12T17:38:20.843 INFO:teuthology.orchestra.run.smithi078.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.242517.log.gz 2023-12-12T17:38:20.845 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150955.log 2023-12-12T17:38:20.847 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.444821.log: /var/log/ceph/ceph-client.admin.335640.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101639.log 2023-12-12T17:38:20.848 INFO:teuthology.orchestra.run.smithi078.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.224279.log.gz 2023-12-12T17:38:20.849 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.207563.log 2023-12-12T17:38:20.850 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.101639.log: /var/log/ceph/ceph-client.admin.150955.log: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.344579.log.gz 2023-12-12T17:38:20.852 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.197943.log 2023-12-12T17:38:20.852 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.254441.log.gz 2023-12-12T17:38:20.854 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.240902.log 2023-12-12T17:38:20.855 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.207563.log: /var/log/ceph/ceph-client.admin.197943.log: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.101639.log.gz 2023-12-12T17:38:20.856 INFO:teuthology.orchestra.run.smithi078.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.207563.log.gz 2023-12-12T17:38:20.857 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.381731.log 2023-12-12T17:38:20.859 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.240902.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.206759.log 2023-12-12T17:38:20.859 INFO:teuthology.orchestra.run.smithi078.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.147373.log.gz 2023-12-12T17:38:20.862 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.381731.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.434346.log 2023-12-12T17:38:20.865 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.206759.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.263738.log 2023-12-12T17:38:20.868 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.434346.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38461.log 2023-12-12T17:38:20.869 INFO:teuthology.orchestra.run.smithi078.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.434346.log.gz 2023-12-12T17:38:20.870 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.263738.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.261107.log 2023-12-12T17:38:20.874 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.38461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.492114.log 2023-12-12T17:38:20.874 INFO:teuthology.orchestra.run.smithi078.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.240902.log.gz 2023-12-12T17:38:20.876 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.261107.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48511.log 2023-12-12T17:38:20.876 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.492114.log: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.197943.log.gz 2023-12-12T17:38:20.878 INFO:teuthology.orchestra.run.smithi078.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.492114.log.gz 2023-12-12T17:38:20.878 INFO:teuthology.orchestra.run.smithi078.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.38461.log.gz 2023-12-12T17:38:20.879 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.429420.log 2023-12-12T17:38:20.881 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.48511.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.509595.log 2023-12-12T17:38:20.885 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.429420.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.246617.log 2023-12-12T17:38:20.885 INFO:teuthology.orchestra.run.smithi078.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.261107.log.gz 2023-12-12T17:38:20.888 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.509595.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.406875.log 2023-12-12T17:38:20.889 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.263738.log.gz 2023-12-12T17:38:20.891 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.246617.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45917.log 2023-12-12T17:38:20.894 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.406875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115102.log 2023-12-12T17:38:20.894 INFO:teuthology.orchestra.run.smithi078.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.206759.log.gz 2023-12-12T17:38:20.895 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.45917.log: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.509595.log.gz 2023-12-12T17:38:20.895 INFO:teuthology.orchestra.run.smithi078.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.45917.log.gz 2023-12-12T17:38:20.897 INFO:teuthology.orchestra.run.smithi078.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48511.log.gz 2023-12-12T17:38:20.898 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.513842.log 2023-12-12T17:38:20.901 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.115102.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.316375.log 2023-12-12T17:38:20.903 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.513842.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.435286.log 2023-12-12T17:38:20.903 INFO:teuthology.orchestra.run.smithi078.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.513842.log.gz 2023-12-12T17:38:20.904 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.316375.log: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.445638.log.gz 2023-12-12T17:38:20.906 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46383.log 2023-12-12T17:38:20.909 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.435286.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47011.log 2023-12-12T17:38:20.912 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.46383.log: 78.2% -- replaced with /var/log/ceph/ceph-client.admin.115102.log.gz 2023-12-12T17:38:20.912 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.435286.log.gz 2023-12-12T17:38:20.913 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47063.log 2023-12-12T17:38:20.915 INFO:teuthology.orchestra.run.smithi078.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46383.log.gz 2023-12-12T17:38:20.917 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47011.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102464.log 2023-12-12T17:38:20.917 INFO:teuthology.orchestra.run.smithi078.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.150955.log.gz 2023-12-12T17:38:20.918 INFO:teuthology.orchestra.run.smithi078.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47011.log.gz 2023-12-12T17:38:20.918 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47063.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49595.log 2023-12-12T17:38:20.921 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.102464.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.316375.log.gz 2023-12-12T17:38:20.921 INFO:teuthology.orchestra.run.smithi078.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.102464.log.gz 2023-12-12T17:38:20.921 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46201.log 2023-12-12T17:38:20.923 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.400345.log 2023-12-12T17:38:20.924 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.49595.log: 88.4%/var/log/ceph/ceph-client.admin.46201.log: -- replaced with /var/log/ceph/ceph-client.admin.47063.log.gz 2023-12-12T17:38:20.926 INFO:teuthology.orchestra.run.smithi078.stderr: 89.7%gzip -- replaced with /var/log/ceph/ceph-client.admin.49595.log.gz -5 2023-12-12T17:38:20.926 INFO:teuthology.orchestra.run.smithi078.stderr: --verbose -- /var/log/ceph/ceph-client.admin.319299.log 2023-12-12T17:38:20.927 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.454745.log 2023-12-12T17:38:20.929 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.400345.log: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.440273.log.gz 2023-12-12T17:38:20.929 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.319299.log: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.444821.log.gz 2023-12-12T17:38:20.929 INFO:teuthology.orchestra.run.smithi078.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.444399.log.gz 2023-12-12T17:38:20.929 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192304.log 2023-12-12T17:38:20.932 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.454745.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.493314.log 2023-12-12T17:38:20.934 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.192304.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.265762.log 2023-12-12T17:38:20.938 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.493314.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.461058.log 2023-12-12T17:38:20.938 INFO:teuthology.orchestra.run.smithi078.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.487271.log.gz 2023-12-12T17:38:20.941 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.265762.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.314753.log 2023-12-12T17:38:20.942 INFO:teuthology.orchestra.run.smithi078.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.381731.log.gz 2023-12-12T17:38:20.943 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.461058.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.382946.log.gz 2023-12-12T17:38:20.944 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.463490.log 2023-12-12T17:38:20.946 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.314753.log: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.399938.log.gz 2023-12-12T17:38:20.948 INFO:teuthology.orchestra.run.smithi078.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.400345.log.gz 2023-12-12T17:38:20.948 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.215677.log 2023-12-12T17:38:20.950 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.463490.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.406875.log.gz 2023-12-12T17:38:20.951 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.520219.log 2023-12-12T17:38:20.954 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.215677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166060.log 2023-12-12T17:38:20.955 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.446954.log.gz 2023-12-12T17:38:20.956 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.313125.log 2023-12-12T17:38:20.958 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.166060.log: /var/log/ceph/ceph-client.admin.520219.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.461058.log.gz 2023-12-12T17:38:20.958 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170576.log 2023-12-12T17:38:20.959 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.313125.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.520219.log.gz 2023-12-12T17:38:20.960 INFO:teuthology.orchestra.run.smithi078.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.463490.log.gz 2023-12-12T17:38:20.960 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142500.log 2023-12-12T17:38:20.961 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.170576.log: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.491299.log.gz 2023-12-12T17:38:20.963 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47271.log 2023-12-12T17:38:20.966 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.142500.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.454745.log.gz 2023-12-12T17:38:20.967 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.233681.log 2023-12-12T17:38:20.970 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47271.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.222209.log 2023-12-12T17:38:20.970 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.424763.log.gz 2023-12-12T17:38:20.972 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.233681.log: 77.8% -- replaced with /var/log/ceph/ceph-client.admin.429420.log.gz 2023-12-12T17:38:20.973 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.308286.log 2023-12-12T17:38:20.975 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.222209.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.492105.log 2023-12-12T17:38:20.978 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.308286.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.314753.log.gz 2023-12-12T17:38:20.979 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.403621.log 2023-12-12T17:38:20.980 INFO:teuthology.orchestra.run.smithi078.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.222209.log.gz 2023-12-12T17:38:20.983 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.492105.log: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.233681.log.gz 2023-12-12T17:38:20.983 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191501.log 2023-12-12T17:38:20.983 INFO:teuthology.orchestra.run.smithi078.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47271.log.gz 2023-12-12T17:38:20.984 INFO:teuthology.orchestra.run.smithi078.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.492105.log.gz 2023-12-12T17:38:20.985 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.403621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179404.log 2023-12-12T17:38:20.985 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.191501.log: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.313125.log.gz 2023-12-12T17:38:20.986 INFO:teuthology.orchestra.run.smithi078.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.192304.log.gz 2023-12-12T17:38:20.987 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.416641.log 2023-12-12T17:38:20.989 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.179404.log: -- /var/log/ceph/ceph-client.admin.90177.log 2023-12-12T17:38:20.989 INFO:teuthology.orchestra.run.smithi078.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.493314.log.gz 2023-12-12T17:38:20.992 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.416641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49341.log 2023-12-12T17:38:20.992 INFO:teuthology.orchestra.run.smithi078.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.166060.log.gz 2023-12-12T17:38:20.995 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.90177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.459456.log 2023-12-12T17:38:20.995 INFO:teuthology.orchestra.run.smithi078.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.308286.log.gz 2023-12-12T17:38:20.997 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.49341.log: 78.2% -- replaced with /var/log/ceph/ceph-client.admin.90177.log.gz 2023-12-12T17:38:20.997 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.494552.log 2023-12-12T17:38:20.999 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.459456.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.459456.log.gz 2023-12-12T17:38:21.000 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.471123.log 2023-12-12T17:38:21.001 INFO:teuthology.orchestra.run.smithi078.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.49341.log.gz 2023-12-12T17:38:21.002 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.494552.log: 77.9% -- replaced with /var/log/ceph/ceph-client.admin.319299.log.gz 2023-12-12T17:38:21.004 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.394618.log 2023-12-12T17:38:21.005 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.265762.log.gz 2023-12-12T17:38:21.007 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.471123.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46435.log 2023-12-12T17:38:21.007 INFO:teuthology.orchestra.run.smithi078.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.403621.log.gz 2023-12-12T17:38:21.009 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.448686.log 2023-12-12T17:38:21.011 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.394618.log: /var/log/ceph/ceph-client.admin.46435.log: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.394618.log.gz 2023-12-12T17:38:21.012 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.442052.log 2023-12-12T17:38:21.012 INFO:teuthology.orchestra.run.smithi078.stderr: 77.5% -- replaced with /var/log/ceph/ceph-client.admin.449212.log.gz 2023-12-12T17:38:21.014 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119332.log 2023-12-12T17:38:21.016 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.448686.log: /var/log/ceph/ceph-client.admin.442052.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.345459.log 2023-12-12T17:38:21.017 INFO:teuthology.orchestra.run.smithi078.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.494552.log.gz 2023-12-12T17:38:21.019 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.119332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.245364.log 2023-12-12T17:38:21.021 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.46857.log 2023-12-12T17:38:21.022 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.345459.log: /var/log/ceph/ceph-client.admin.245364.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.255641.log 2023-12-12T17:38:21.023 INFO:teuthology.orchestra.run.smithi078.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.245364.log.gz 2023-12-12T17:38:21.023 INFO:teuthology.orchestra.run.smithi078.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.345459.log.gz 2023-12-12T17:38:21.026 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.2.46857.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.255238.log 2023-12-12T17:38:21.027 INFO:teuthology.orchestra.run.smithi078.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.2.46857.log.gz 2023-12-12T17:38:21.027 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.255641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.425969.log 2023-12-12T17:38:21.029 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.255238.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.204565.log 2023-12-12T17:38:21.031 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.425969.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.503299.log 2023-12-12T17:38:21.032 INFO:teuthology.orchestra.run.smithi078.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.119332.log.gz 2023-12-12T17:38:21.034 INFO:teuthology.orchestra.run.smithi078.stderr: 93.1%/var/log/ceph/ceph-client.admin.204565.log: -- replaced with /var/log/ceph/ceph-client.admin.191501.log.gz 2023-12-12T17:38:21.034 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150715.log 2023-12-12T17:38:21.035 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.142500.log.gz 2023-12-12T17:38:21.038 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.341726.log 2023-12-12T17:38:21.038 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.503299.log: /var/log/ceph/ceph-client.admin.150715.log: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.503299.log.gz 2023-12-12T17:38:21.039 INFO:teuthology.orchestra.run.smithi078.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.255641.log.gz 2023-12-12T17:38:21.039 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.228806.log 2023-12-12T17:38:21.040 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.341726.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.427614.log 2023-12-12T17:38:21.042 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.228806.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.447814.log 2023-12-12T17:38:21.044 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.427614.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.219337.log 90.2% 2023-12-12T17:38:21.044 INFO:teuthology.orchestra.run.smithi078.stderr: -- replaced with /var/log/ceph/ceph-client.admin.204565.log.gz 2023-12-12T17:38:21.045 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.447814.log: 77.5% -- replaced with /var/log/ceph/ceph-client.admin.447814.log.gz 2023-12-12T17:38:21.046 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.410057.log 2023-12-12T17:38:21.047 INFO:teuthology.orchestra.run.smithi078.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.228806.log.gz 2023-12-12T17:38:21.049 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.219337.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.46435.log.gz 2023-12-12T17:38:21.050 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.405663.log 2023-12-12T17:38:21.051 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148279.log 2023-12-12T17:38:21.052 INFO:teuthology.orchestra.run.smithi078.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.219337.log.gz 2023-12-12T17:38:21.054 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.410057.log: /var/log/ceph/ceph-client.admin.405663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.235163.log 2023-12-12T17:38:21.055 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.219738.log 2023-12-12T17:38:21.056 INFO:teuthology.orchestra.run.smithi078.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.46201.log.gz 2023-12-12T17:38:21.057 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.235163.log: /var/log/ceph/ceph-client.admin.148279.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180778.log 2023-12-12T17:38:21.058 INFO:teuthology.orchestra.run.smithi078.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.405663.log.gz 2023-12-12T17:38:21.061 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.219738.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.390222.log 2023-12-12T17:38:21.062 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92328.log 2023-12-12T17:38:21.063 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.180778.log: /var/log/ceph/ceph-client.admin.390222.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.255238.log.gz 2023-12-12T17:38:21.064 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.423909.log 2023-12-12T17:38:21.067 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.92328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.500751.log 2023-12-12T17:38:21.068 INFO:teuthology.orchestra.run.smithi078.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.442052.log.gz 2023-12-12T17:38:21.068 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-12-12T17:38:21.069 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.423909.log: /var/log/ceph/ceph-client.admin.500751.log: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.500751.log.gz 2023-12-12T17:38:21.071 INFO:teuthology.orchestra.run.smithi078.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.416641.log.gz 2023-12-12T17:38:21.072 INFO:teuthology.orchestra.run.smithi078.stderr: 77.7% -- replaced with /var/log/ceph/ceph-client.admin.427614.log.gz 2023-12-12T17:38:21.072 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.425969.log.gz 2023-12-12T17:38:21.072 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94392.log 2023-12-12T17:38:21.074 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-osd.0.log: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.390222.log.gz 2023-12-12T17:38:21.075 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.385680.log 2023-12-12T17:38:21.077 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.94392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44638.log 2023-12-12T17:38:21.079 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.385680.log: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.235163.log.gz 2023-12-12T17:38:21.080 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.359115.log 2023-12-12T17:38:21.081 INFO:teuthology.orchestra.run.smithi078.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.215677.log.gz 2023-12-12T17:38:21.083 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.44638.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45103.log 2023-12-12T17:38:21.084 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.359115.log: 94.1% -- replaced with /var/log/ceph/ceph-client.admin.150715.log.gz 2023-12-12T17:38:21.086 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.353885.log 2023-12-12T17:38:21.086 INFO:teuthology.orchestra.run.smithi078.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.219738.log.gz 2023-12-12T17:38:21.088 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.45103.log: 79.3% -- replaced with /var/log/ceph/ceph-client.admin.180778.log.gz 2023-12-12T17:38:21.090 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.489296.log 2023-12-12T17:38:21.091 INFO:teuthology.orchestra.run.smithi078.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.359115.log.gz 2023-12-12T17:38:21.093 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.353885.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.353885.log.gz 2023-12-12T17:38:21.093 INFO:teuthology.orchestra.run.smithi078.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.94392.log.gz 2023-12-12T17:38:21.093 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.233279.log 2023-12-12T17:38:21.097 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.489296.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95658.log 2023-12-12T17:38:21.097 INFO:teuthology.orchestra.run.smithi078.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.44638.log.gz 2023-12-12T17:38:21.098 INFO:teuthology.orchestra.run.smithi078.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.45103.log.gz 2023-12-12T17:38:21.099 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.233279.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54979.log 2023-12-12T17:38:21.102 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.95658.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.489296.log.gz 2023-12-12T17:38:21.102 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.400746.log 2023-12-12T17:38:21.104 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.521065.log 2023-12-12T17:38:21.106 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.520141.log 2023-12-12T17:38:21.110 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.393813.log 2023-12-12T17:38:21.113 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.456455.log 2023-12-12T17:38:21.115 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.452684.log 2023-12-12T17:38:21.119 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.521039.log 2023-12-12T17:38:21.120 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.400746.log: /var/log/ceph/ceph-client.admin.521065.log: /var/log/ceph/ceph-client.admin.520141.log: /var/log/ceph/ceph-client.admin.54979.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.341726.log.gz 2023-12-12T17:38:21.120 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.393813.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.520141.log.gz 2023-12-12T17:38:21.121 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.456455.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.521065.log.gz 2023-12-12T17:38:21.122 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.452684.log: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.148279.log.gz 2023-12-12T17:38:21.123 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.426786.log 2023-12-12T17:38:21.123 INFO:teuthology.orchestra.run.smithi078.stderr: 83.3% -- replaced with /var/log/ceph/ceph-client.admin.233279.log.gz 2023-12-12T17:38:21.126 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.521039.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.521039.log.gz 2023-12-12T17:38:21.126 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.213007.log 2023-12-12T17:38:21.130 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.426786.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113078.log 2023-12-12T17:38:21.131 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.213007.log: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.95658.log.gz 2023-12-12T17:38:21.133 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.254005.log 2023-12-12T17:38:21.136 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.113078.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54953.log 2023-12-12T17:38:21.139 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.254005.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.54979.log.gz 2023-12-12T17:38:21.139 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.378671.log 2023-12-12T17:38:21.142 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.54953.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.342530.log 2023-12-12T17:38:21.144 INFO:teuthology.orchestra.run.smithi078.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.54953.log.gz 2023-12-12T17:38:21.146 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.378671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.331589.log 2023-12-12T17:38:21.149 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.342530.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.456857.log 2023-12-12T17:38:21.150 INFO:teuthology.orchestra.run.smithi078.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.393813.log.gz 2023-12-12T17:38:21.153 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.331589.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.426786.log.gz 2023-12-12T17:38:21.153 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.251144.log 2023-12-12T17:38:21.154 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.456857.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.331589.log.gz 2023-12-12T17:38:21.156 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.242526.log 2023-12-12T17:38:21.159 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.251144.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.227939.log 2023-12-12T17:38:21.162 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.242526.log: 94.3% -- replaced with /var/log/ceph/ceph-client.admin.254005.log.gz 2023-12-12T17:38:21.162 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.518987.log 2023-12-12T17:38:21.165 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.227939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47245.log 2023-12-12T17:38:21.165 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.242526.log.gz 2023-12-12T17:38:21.166 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.518987.log: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.518987.log.gz 2023-12-12T17:38:21.168 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107434.log 2023-12-12T17:38:21.168 INFO:teuthology.orchestra.run.smithi078.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.251144.log.gz 2023-12-12T17:38:21.169 INFO:teuthology.orchestra.run.smithi078.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.213007.log.gz 2023-12-12T17:38:21.171 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47245.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.390378.log 2023-12-12T17:38:21.174 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.107434.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.47245.log.gz 2023-12-12T17:38:21.174 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187183.log 2023-12-12T17:38:21.179 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.390378.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.392576.log 2023-12-12T17:38:21.179 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.187183.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48459.log 2023-12-12T17:38:21.181 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.392576.log: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.400746.log.gz 2023-12-12T17:38:21.182 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.251959.log 2023-12-12T17:38:21.184 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.48459.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.352190.log 2023-12-12T17:38:21.187 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.251959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.308681.log 2023-12-12T17:38:21.188 INFO:teuthology.orchestra.run.smithi078.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.448686.log.gz 2023-12-12T17:38:21.189 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.352190.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48142.log 2023-12-12T17:38:21.193 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.308681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44114.log 2023-12-12T17:38:21.193 INFO:teuthology.orchestra.run.smithi078.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.352190.log.gz 2023-12-12T17:38:21.195 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.48142.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.253996.log 2023-12-12T17:38:21.197 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.44114.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47694.log 2023-12-12T17:38:21.201 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.253996.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.357241.log 2023-12-12T17:38:21.204 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47694.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.513001.log 2023-12-12T17:38:21.207 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.357241.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.226089.log 2023-12-12T17:38:21.210 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.513001.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44534.log 2023-12-12T17:38:21.212 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.226089.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91864.log 2023-12-12T17:38:21.214 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.44534.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.416632.log 2023-12-12T17:38:21.216 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.91864.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.520646.log 2023-12-12T17:38:21.216 INFO:teuthology.orchestra.run.smithi078.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.513001.log.gz 2023-12-12T17:38:21.218 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.416632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95265.log 2023-12-12T17:38:21.219 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.520646.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.520646.log.gz 2023-12-12T17:38:21.219 INFO:teuthology.orchestra.run.smithi078.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.456455.log.gz 2023-12-12T17:38:21.221 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.498123.log 2023-12-12T17:38:21.222 INFO:teuthology.orchestra.run.smithi078.stderr: 77.4% -- replaced with /var/log/ceph/ceph-client.admin.227939.log.gz 2023-12-12T17:38:21.224 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.95265.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115518.log 2023-12-12T17:38:21.224 INFO:teuthology.orchestra.run.smithi078.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44114.log.gz 2023-12-12T17:38:21.227 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.498123.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.47694.log.gz 2023-12-12T17:38:21.228 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.413146.log 2023-12-12T17:38:21.229 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.115518.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.498123.log.gz 2023-12-12T17:38:21.230 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.458989.log 2023-12-12T17:38:21.233 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.413146.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.463923.log 2023-12-12T17:38:21.235 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.458989.log: 77.8% -- replaced with /var/log/ceph/ceph-client.admin.253996.log.gz 2023-12-12T17:38:21.236 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.407277.log 2023-12-12T17:38:21.237 INFO:teuthology.orchestra.run.smithi078.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.187183.log.gz 2023-12-12T17:38:21.238 INFO:teuthology.orchestra.run.smithi078.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.357241.log.gz 2023-12-12T17:38:21.238 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.463923.log: 77.8% -- replaced with /var/log/ceph/ceph-client.admin.226089.log.gz 2023-12-12T17:38:21.239 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48984.log 2023-12-12T17:38:21.240 INFO:teuthology.orchestra.run.smithi078.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.113078.log.gz 2023-12-12T17:38:21.241 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.407277.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.503777.log 2023-12-12T17:38:21.242 INFO:teuthology.orchestra.run.smithi078.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.416632.log.gz 2023-12-12T17:38:21.243 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.48984.log: 79.2% -- replaced with /var/log/ceph/ceph-client.admin.91864.log.gz 2023-12-12T17:38:21.245 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.238885.log 2023-12-12T17:38:21.245 INFO:teuthology.orchestra.run.smithi078.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.308681.log.gz 2023-12-12T17:38:21.247 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.503777.log: 78.4% -- replaced with /var/log/ceph/ceph-client.admin.503777.log.gz 2023-12-12T17:38:21.248 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.350917.log 2023-12-12T17:38:21.249 INFO:teuthology.orchestra.run.smithi078.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.458989.log.gz 2023-12-12T17:38:21.250 INFO:teuthology.orchestra.run.smithi078.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.463923.log.gz 2023-12-12T17:38:21.251 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.238885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171991.log 2023-12-12T17:38:21.251 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.342530.log.gz 2023-12-12T17:38:21.254 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.350917.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.313532.log 2023-12-12T17:38:21.255 INFO:teuthology.orchestra.run.smithi078.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48459.log.gz 2023-12-12T17:38:21.257 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.171991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45368.log 2023-12-12T17:38:21.260 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.313532.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48485.log 2023-12-12T17:38:21.262 INFO:teuthology.orchestra.run.smithi078.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.251959.log.gz 2023-12-12T17:38:21.263 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.45368.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113492.log 2023-12-12T17:38:21.266 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.48485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.232883.log 2023-12-12T17:38:21.268 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.113492.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.261098.log 2023-12-12T17:38:21.270 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.232883.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44534.log.gz 2023-12-12T17:38:21.271 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.467838.log 2023-12-12T17:38:21.272 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.450593.log 2023-12-12T17:38:21.275 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.261098.log: /var/log/ceph/ceph-client.admin.467838.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.498526.log 2023-12-12T17:38:21.277 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.450593.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45690.log 2023-12-12T17:38:21.280 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.498526.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49491.log 2023-12-12T17:38:21.281 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.45690.log: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.261098.log.gz 2023-12-12T17:38:21.282 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.209222.log 2023-12-12T17:38:21.283 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48038.log 2023-12-12T17:38:21.285 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.209222.log: /var/log/ceph/ceph-client.admin.49491.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.498526.log.gz 2023-12-12T17:38:21.285 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140437.log 2023-12-12T17:38:21.288 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.48038.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.457313.log 2023-12-12T17:38:21.290 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.140437.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.433133.log 2023-12-12T17:38:21.291 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.308690.log 2023-12-12T17:38:21.294 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.433133.log: /var/log/ceph/ceph-client.admin.457313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.256507.log 2023-12-12T17:38:21.295 INFO:teuthology.orchestra.run.smithi078.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.410703.log.gz 2023-12-12T17:38:21.296 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.308690.log: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.413146.log.gz 2023-12-12T17:38:21.297 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107837.log 2023-12-12T17:38:21.297 INFO:teuthology.orchestra.run.smithi078.stderr: 77.1% -- replaced with /var/log/ceph/ceph-client.admin.503562.log.gz 2023-12-12T17:38:21.299 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.244966.log 2023-12-12T17:38:21.300 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.107837.log: /var/log/ceph/ceph-client.admin.256507.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.335640.log.gz 2023-12-12T17:38:21.300 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.350917.log.gz 2023-12-12T17:38:21.301 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147382.log 2023-12-12T17:38:21.303 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.495388.log 2023-12-12T17:38:21.305 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.244966.log: /var/log/ceph/ceph-client.admin.147382.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.327484.log 2023-12-12T17:38:21.308 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.495388.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.510872.log 2023-12-12T17:38:21.309 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.489690.log 2023-12-12T17:38:21.312 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.327484.log: /var/log/ceph/ceph-client.admin.510872.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.50160.log 2023-12-12T17:38:21.313 INFO:teuthology.orchestra.run.smithi078.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.510872.log.gz 2023-12-12T17:38:21.314 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.489690.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.462287.log 2023-12-12T17:38:21.317 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.0.50160.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.311914.log 2023-12-12T17:38:21.320 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.462287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45446.log 2023-12-12T17:38:21.321 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.373980.log 2023-12-12T17:38:21.323 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.311914.log: /var/log/ceph/ceph-client.admin.45446.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.438610.log 2023-12-12T17:38:21.325 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.373980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.483669.log 2023-12-12T17:38:21.326 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.242115.log 2023-12-12T17:38:21.328 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.438610.log: /var/log/ceph/ceph-client.admin.483669.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.456053.log 2023-12-12T17:38:21.330 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.242115.log: 77.5% -- replaced with /var/log/ceph/ceph-client.admin.373980.log.gz 2023-12-12T17:38:21.330 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.240101.log 2023-12-12T17:38:21.332 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.456053.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48563.log 2023-12-12T17:38:21.334 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.383758.log 2023-12-12T17:38:21.335 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.240101.log: /var/log/ceph/ceph-client.admin.48563.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111469.log 2023-12-12T17:38:21.338 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.383758.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.396692.log 2023-12-12T17:38:21.339 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.111469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.217288.log 2023-12-12T17:38:21.342 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.396692.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.428559.log 2023-12-12T17:38:21.342 INFO:teuthology.orchestra.run.smithi078.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48142.log.gz 2023-12-12T17:38:21.343 INFO:teuthology.orchestra.run.smithi078.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.48485.log.gz 2023-12-12T17:38:21.344 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.217288.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48563.log.gz 2023-12-12T17:38:21.344 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100453.log 2023-12-12T17:38:21.347 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.428559.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.349111.log 2023-12-12T17:38:21.350 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.100453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.326289.log 2023-12-12T17:38:21.351 INFO:teuthology.orchestra.run.smithi078.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.147382.log.gz 2023-12-12T17:38:21.351 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.452684.log.gz 2023-12-12T17:38:21.352 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.508756.log 2023-12-12T17:38:21.354 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.349111.log: /var/log/ceph/ceph-client.admin.326289.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.251153.log 2023-12-12T17:38:21.355 INFO:teuthology.orchestra.run.smithi078.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.256507.log.gz 2023-12-12T17:38:21.355 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.520935.log 2023-12-12T17:38:21.358 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.251153.log: /var/log/ceph/ceph-client.admin.508756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173256.log 2023-12-12T17:38:21.359 INFO:teuthology.orchestra.run.smithi078.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.508756.log.gz 2023-12-12T17:38:21.359 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95667.log 2023-12-12T17:38:21.361 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.520935.log: /var/log/ceph/ceph-client.admin.173256.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.520935.log.gz 2023-12-12T17:38:21.361 INFO:teuthology.orchestra.run.smithi078.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45446.log.gz 2023-12-12T17:38:21.361 INFO:teuthology.orchestra.run.smithi078.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.45368.log.gz 2023-12-12T17:38:21.362 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142088.log 2023-12-12T17:38:21.364 INFO:teuthology.orchestra.run.smithi078.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48984.log.gz 2023-12-12T17:38:21.364 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.95667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.210844.log 2023-12-12T17:38:21.366 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.142088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.491711.log 2023-12-12T17:38:21.368 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.210844.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.235998.log 2023-12-12T17:38:21.370 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.491711.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.244152.log 2023-12-12T17:38:21.371 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.431515.log 2023-12-12T17:38:21.374 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.235998.log: /var/log/ceph/ceph-client.admin.244152.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49491.log.gz 2023-12-12T17:38:21.374 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.209624.log 2023-12-12T17:38:21.375 INFO:teuthology.orchestra.run.smithi078.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.392576.log.gz 2023-12-12T17:38:21.375 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.504193.log 2023-12-12T17:38:21.376 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.431515.log: /var/log/ceph/ceph-client.admin.209624.log: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.107837.log.gz 2023-12-12T17:38:21.377 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.451464.log 2023-12-12T17:38:21.378 INFO:teuthology.orchestra.run.smithi078.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.111469.log.gz 2023-12-12T17:38:21.380 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.433947.log 2023-12-12T17:38:21.381 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.504193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.207572.log 2023-12-12T17:38:21.383 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.433947.log: /var/log/ceph/ceph-client.admin.451464.log: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.173256.log.gz 2023-12-12T17:38:21.383 INFO:teuthology.orchestra.run.smithi078.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.232883.log.gz 2023-12-12T17:38:21.383 INFO:teuthology.orchestra.run.smithi078.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.504193.log.gz 2023-12-12T17:38:21.384 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.404855.log 2023-12-12T17:38:21.384 INFO:teuthology.orchestra.run.smithi078.stderr: 83.2% -- replaced with /var/log/ceph/ceph-client.admin.242115.log.gz 2023-12-12T17:38:21.384 INFO:teuthology.orchestra.run.smithi078.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.308690.log.gz 2023-12-12T17:38:21.385 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.240101.log.gz 2023-12-12T17:38:21.386 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.207572.log: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.209222.log.gz 2023-12-12T17:38:21.386 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.318810.log 2023-12-12T17:38:21.388 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46409.log 2023-12-12T17:38:21.390 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.404855.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.244966.log.gz 2023-12-12T17:38:21.391 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.318810.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.113492.log.gz 2023-12-12T17:38:21.391 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194718.log 2023-12-12T17:38:21.393 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.46409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87390.log 2023-12-12T17:38:21.394 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.194718.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104129.log 2023-12-12T17:38:21.395 INFO:teuthology.orchestra.run.smithi078.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.244152.log.gz 2023-12-12T17:38:21.396 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.87390.log: 77.6% -- replaced with /var/log/ceph/ceph-client.admin.433133.log.gz 2023-12-12T17:38:21.397 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.442520.log 2023-12-12T17:38:21.399 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.433947.log.gz 2023-12-12T17:38:21.399 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.104129.log: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.489690.log.gz 2023-12-12T17:38:21.399 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.442511.log 2023-12-12T17:38:21.400 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.442520.log: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.311914.log.gz 2023-12-12T17:38:21.402 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.238885.log.gz 2023-12-12T17:38:21.402 INFO:teuthology.orchestra.run.smithi078.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.313532.log.gz 2023-12-12T17:38:21.402 INFO:teuthology.orchestra.run.smithi078.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.428559.log.gz 2023-12-12T17:38:21.402 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.215274.log 2023-12-12T17:38:21.403 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.442520.log.gz 2023-12-12T17:38:21.404 INFO:teuthology.orchestra.run.smithi078.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45690.log.gz 2023-12-12T17:38:21.404 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.442511.log: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.483669.log.gz 2023-12-12T17:38:21.405 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49948.log 2023-12-12T17:38:21.406 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.322640.log 2023-12-12T17:38:21.408 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.215274.log: /var/log/ceph/ceph-client.admin.49948.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.382937.log 2023-12-12T17:38:21.410 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.492508.log 2023-12-12T17:38:21.411 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.322640.log: /var/log/ceph/ceph-client.admin.382937.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172405.log 2023-12-12T17:38:21.414 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.492508.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106143.log 2023-12-12T17:38:21.415 INFO:teuthology.orchestra.run.smithi078.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.171991.log.gz 2023-12-12T17:38:21.416 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.172405.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.263729.log 2023-12-12T17:38:21.417 INFO:teuthology.orchestra.run.smithi078.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.382937.log.gz 2023-12-12T17:38:21.417 INFO:teuthology.orchestra.run.smithi078.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.462287.log.gz 2023-12-12T17:38:21.419 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.106143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151787.log 2023-12-12T17:38:21.420 INFO:teuthology.orchestra.run.smithi078.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.457313.log.gz 2023-12-12T17:38:21.421 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.264144.log 2023-12-12T17:38:21.424 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.263729.log: /var/log/ceph/ceph-client.admin.151787.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.467838.log.gz 2023-12-12T17:38:21.424 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.204163.log 2023-12-12T17:38:21.424 INFO:teuthology.orchestra.run.smithi078.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.491711.log.gz 2023-12-12T17:38:21.424 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.33435.log 2023-12-12T17:38:21.426 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.204163.log: /var/log/ceph/ceph-client.admin.264144.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119746.log 2023-12-12T17:38:21.428 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph.tmp-client.admin.33435.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180239.log 2023-12-12T17:38:21.429 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.33435.log.gz 2023-12-12T17:38:21.431 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.119746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45903.log 2023-12-12T17:38:21.433 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174922.log 2023-12-12T17:38:21.434 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.180239.log: /var/log/ceph/ceph-client.admin.45903.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.251547.log 2023-12-12T17:38:21.435 INFO:teuthology.orchestra.run.smithi078.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.404855.log.gz 2023-12-12T17:38:21.437 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.410694.log 2023-12-12T17:38:21.437 INFO:teuthology.orchestra.run.smithi078.stderr: 78.8% -- replaced with /var/log/ceph/ceph-client.admin.327484.log.gz 2023-12-12T17:38:21.438 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.174922.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.438610.log.gz 2023-12-12T17:38:21.439 INFO:teuthology.orchestra.run.smithi078.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.106143.log.gz 2023-12-12T17:38:21.439 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.322640.log.gz 2023-12-12T17:38:21.439 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183338.log 2023-12-12T17:38:21.439 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.410694.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.326289.log.gz 2023-12-12T17:38:21.440 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.251547.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105737.log 2023-12-12T17:38:21.441 INFO:teuthology.orchestra.run.smithi078.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.217288.log.gz 2023-12-12T17:38:21.442 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.183338.log: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.107434.log.gz 2023-12-12T17:38:21.442 INFO:teuthology.orchestra.run.smithi078.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.48038.log.gz 2023-12-12T17:38:21.443 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99997.log 2023-12-12T17:38:21.446 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.105737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.469441.log 2023-12-12T17:38:21.446 INFO:teuthology.orchestra.run.smithi078.stderr: 83.6% -- replaced with /var/log/ceph/ceph-client.admin.450593.log.gz 2023-12-12T17:38:21.447 INFO:teuthology.orchestra.run.smithi078.stderr: 78.4% -- replaced with /var/log/ceph/ceph-client.admin.451464.log.gz 2023-12-12T17:38:21.448 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.99997.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.346288.log 2023-12-12T17:38:21.452 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.456053.log.gz 2023-12-12T17:38:21.452 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.469441.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46901.log 2023-12-12T17:38:21.452 INFO:teuthology.orchestra.run.smithi078.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.142088.log.gz 2023-12-12T17:38:21.455 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.346288.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.406070.log 2023-12-12T17:38:21.457 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.46901.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45316.log 2023-12-12T17:38:21.459 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.406070.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.211247.log 2023-12-12T17:38:21.462 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.45316.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.432740.log 2023-12-12T17:38:21.462 INFO:teuthology.orchestra.run.smithi078.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.209624.log.gz 2023-12-12T17:38:21.465 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.211247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.490092.log 2023-12-12T17:38:21.465 INFO:teuthology.orchestra.run.smithi078.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.318810.log.gz 2023-12-12T17:38:21.465 INFO:teuthology.orchestra.run.smithi078.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.251547.log.gz 2023-12-12T17:38:21.467 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.432740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100444.log 2023-12-12T17:38:21.469 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.264144.log.gz 2023-12-12T17:38:21.469 INFO:teuthology.orchestra.run.smithi078.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.263729.log.gz 2023-12-12T17:38:21.470 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.490092.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.458177.log 2023-12-12T17:38:21.474 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.100444.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.248732.log 2023-12-12T17:38:21.474 INFO:teuthology.orchestra.run.smithi078.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45316.log.gz 2023-12-12T17:38:21.475 INFO:teuthology.orchestra.run.smithi078.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45903.log.gz 2023-12-12T17:38:21.475 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.458177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.496415.log 2023-12-12T17:38:21.476 INFO:teuthology.orchestra.run.smithi078.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.431515.log.gz 2023-12-12T17:38:21.476 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.347904.log 2023-12-12T17:38:21.478 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.496415.log: /var/log/ceph/ceph-client.admin.248732.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.473934.log 2023-12-12T17:38:21.481 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.347904.log: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.496415.log.gz 2023-12-12T17:38:21.481 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121413.log 2023-12-12T17:38:21.483 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.473934.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45901.log 2023-12-12T17:38:21.485 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.121413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.376950.log 2023-12-12T17:38:21.487 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.45901.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46901.log.gz 2023-12-12T17:38:21.488 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143759.log 2023-12-12T17:38:21.489 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.376950.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44310.log 2023-12-12T17:38:21.491 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.143759.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.433536.log 2023-12-12T17:38:21.492 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.327886.log 2023-12-12T17:38:21.495 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.433536.log: /var/log/ceph/ceph-client.admin.44310.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.238469.log 2023-12-12T17:38:21.497 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.327886.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.251153.log.gz 2023-12-12T17:38:21.497 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.320144.log 2023-12-12T17:38:21.499 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.238469.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.95667.log.gz 2023-12-12T17:38:21.499 INFO:teuthology.orchestra.run.smithi078.stderr: 78.0% -- replaced with /var/log/ceph/ceph-client.admin.151787.log.gz 2023-12-12T17:38:21.500 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.520245.log 2023-12-12T17:38:21.502 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.310305.log 2023-12-12T17:38:21.502 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.320144.log: /var/log/ceph/ceph-client.admin.520245.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.520245.log.gz 2023-12-12T17:38:21.504 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102060.log 2023-12-12T17:38:21.506 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.488088.log 2023-12-12T17:38:21.507 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.310305.log: /var/log/ceph/ceph-client.admin.102060.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.375686.log 2023-12-12T17:38:21.508 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.488088.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.204163.log.gz 2023-12-12T17:38:21.510 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.476454.log 2023-12-12T17:38:21.511 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.507911.log 2023-12-12T17:38:21.514 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.375686.log: /var/log/ceph/ceph-client.admin.476454.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.464778.log 2023-12-12T17:38:21.516 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44176.log 2023-12-12T17:38:21.516 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.507911.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46409.log.gz 2023-12-12T17:38:21.516 INFO:teuthology.orchestra.run.smithi078.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.235998.log.gz 2023-12-12T17:38:21.517 INFO:teuthology.orchestra.run.smithi078.stderr: 93.0% 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49948.log.gz 2023-12-12T17:38:21.517 INFO:teuthology.orchestra.run.smithi078.stderr: -- replaced with /var/log/ceph/ceph-client.admin.140437.log.gz 2023-12-12T17:38:21.517 INFO:teuthology.orchestra.run.smithi078.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.507911.log.gz 2023-12-12T17:38:21.518 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.464778.log: 79.7% -- replaced with /var/log/ceph/ceph-client.admin.104129.log.gz 2023-12-12T17:38:21.518 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181208.log 2023-12-12T17:38:21.519 INFO:teuthology.orchestra.run.smithi078.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.194718.log.gz 2023-12-12T17:38:21.521 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.44176.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112273.log 2023-12-12T17:38:21.521 INFO:teuthology.orchestra.run.smithi078.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.174922.log.gz 2023-12-12T17:38:21.523 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.181208.log: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.433536.log.gz 2023-12-12T17:38:21.523 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.454736.log 2023-12-12T17:38:21.523 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46331.log 2023-12-12T17:38:21.526 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.112273.log: /var/log/ceph/ceph-client.admin.454736.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182056.log 2023-12-12T17:38:21.528 INFO:teuthology.orchestra.run.smithi078.stderr: 94.0% -- replaced with /var/log/ceph/ceph-client.admin.390378.log.gz 2023-12-12T17:38:21.529 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.515107.log 2023-12-12T17:38:21.529 INFO:teuthology.orchestra.run.smithi078.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.346288.log.gz 2023-12-12T17:38:21.529 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.182056.log: /var/log/ceph/ceph-client.admin.46331.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171029.log 2023-12-12T17:38:21.530 INFO:teuthology.orchestra.run.smithi078.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.215274.log.gz 2023-12-12T17:38:21.531 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.396275.log 2023-12-12T17:38:21.532 INFO:teuthology.orchestra.run.smithi078.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.442511.log.gz 2023-12-12T17:38:21.532 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.515107.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.444830.log 2023-12-12T17:38:21.532 INFO:teuthology.orchestra.run.smithi078.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.238469.log.gz 2023-12-12T17:38:21.534 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.210844.log.gz 2023-12-12T17:38:21.534 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.396275.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.515107.log.gz 80.8% 2023-12-12T17:38:21.534 INFO:teuthology.orchestra.run.smithi078.stderr: -- replaced with /var/log/ceph/ceph-client.admin.454736.log.gz 2023-12-12T17:38:21.536 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.171029.log: 77.6%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.180239.log.gz --verbose -- 2023-12-12T17:38:21.536 INFO:teuthology.orchestra.run.smithi078.stderr: /var/log/ceph/ceph-client.admin.113087.log 2023-12-12T17:38:21.537 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.444830.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49922.log 2023-12-12T17:38:21.538 INFO:teuthology.orchestra.run.smithi078.stderr: 77.6% -- replaced with /var/log/ceph/ceph-client.admin.183338.log.gz 2023-12-12T17:38:21.539 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.113087.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.402816.log 2023-12-12T17:38:21.541 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.49922.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189765.log 2023-12-12T17:38:21.543 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.402816.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110272.log 2023-12-12T17:38:21.547 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.189765.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182047.log 2023-12-12T17:38:21.547 INFO:teuthology.orchestra.run.smithi078.stderr: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.148713.log.gz 2023-12-12T17:38:21.548 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.110272.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.384188.log 2023-12-12T17:38:21.550 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.182047.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44366.log 2023-12-12T17:38:21.551 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.384188.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.95265.log.gz 2023-12-12T17:38:21.552 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.486070.log 2023-12-12T17:38:21.553 INFO:teuthology.orchestra.run.smithi078.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.248732.log.gz 2023-12-12T17:38:21.555 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.44366.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.199156.log 2023-12-12T17:38:21.557 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.486070.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.329922.log 2023-12-12T17:38:21.560 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.199156.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.446041.log 2023-12-12T17:38:21.561 INFO:teuthology.orchestra.run.smithi078.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.375686.log.gz 2023-12-12T17:38:21.562 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.329922.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48698.log 2023-12-12T17:38:21.563 INFO:teuthology.orchestra.run.smithi078.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.492508.log.gz 2023-12-12T17:38:21.565 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.446041.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.355339.log 2023-12-12T17:38:21.565 INFO:teuthology.orchestra.run.smithi078.stderr: 78.3% -- replaced with /var/log/ceph/ceph-client.admin.464778.log.gz 2023-12-12T17:38:21.565 INFO:teuthology.orchestra.run.smithi078.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.406070.log.gz 2023-12-12T17:38:21.567 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168894.log 2023-12-12T17:38:21.569 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.48698.log: /var/log/ceph/ceph-client.admin.355339.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.262358.log 2023-12-12T17:38:21.571 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.168894.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139204.log 2023-12-12T17:38:21.574 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.262358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44972.log 2023-12-12T17:38:21.575 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.139204.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-12-12T17:38:21.577 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108244.log 2023-12-12T17:38:21.579 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.44972.log: /var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.204958.log 2023-12-12T17:38:21.581 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.108244.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116362.log 2023-12-12T17:38:21.584 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.204958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179846.log 2023-12-12T17:38:21.586 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.116362.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47531.log 2023-12-12T17:38:21.590 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.179846.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.232874.log 2023-12-12T17:38:21.590 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.509158.log 2023-12-12T17:38:21.591 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47531.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.119746.log.gz 2023-12-12T17:38:21.592 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.232874.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.463499.log 2023-12-12T17:38:21.594 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.430285.log 2023-12-12T17:38:21.597 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.509158.log: /var/log/ceph/ceph-client.admin.463499.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174529.log 2023-12-12T17:38:21.599 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121404.log 2023-12-12T17:38:21.600 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.430285.log: /var/log/ceph/ceph-client.admin.174529.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89732.log 2023-12-12T17:38:21.602 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.121404.log: 95.1% -- replaced with /var/log/ceph/ceph-client.admin.179404.log.gz 2023-12-12T17:38:21.602 INFO:teuthology.orchestra.run.smithi078.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.329922.log.gz 2023-12-12T17:38:21.604 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.459447.log 2023-12-12T17:38:21.605 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.399141.log 2023-12-12T17:38:21.606 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.89732.log: /var/log/ceph/ceph-client.admin.459447.log: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.87390.log.gz 2023-12-12T17:38:21.608 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115111.log 2023-12-12T17:38:21.608 INFO:teuthology.orchestra.run.smithi078.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.100444.log.gz 2023-12-12T17:38:21.608 INFO:teuthology.orchestra.run.smithi078.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.105737.log.gz 2023-12-12T17:38:21.610 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.399141.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.392974.log 2023-12-12T17:38:21.612 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.115111.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.517260.log 2023-12-12T17:38:21.614 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.392974.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49870.log 2023-12-12T17:38:21.616 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.517260.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101648.log 2023-12-12T17:38:21.617 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109459.log 2023-12-12T17:38:21.620 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.49870.log: /var/log/ceph/ceph-client.admin.101648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.511718.log 2023-12-12T17:38:21.621 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.109459.log: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.116362.log.gz 2023-12-12T17:38:21.622 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139213.log 2023-12-12T17:38:21.623 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.511718.log: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.511718.log.gz 2023-12-12T17:38:21.624 INFO:teuthology.orchestra.run.smithi078.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.517260.log.gz 2023-12-12T17:38:21.625 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150000.log 2023-12-12T17:38:21.627 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.412715.log 2023-12-12T17:38:21.629 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.139213.log: /var/log/ceph/ceph-client.admin.150000.log: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.347904.log.gz 2023-12-12T17:38:21.629 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.212566.log 2023-12-12T17:38:21.629 INFO:teuthology.orchestra.run.smithi078.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.396275.log.gz 2023-12-12T17:38:21.631 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.220997.log 2023-12-12T17:38:21.633 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.412715.log: /var/log/ceph/ceph-client.admin.212566.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45914.log 2023-12-12T17:38:21.636 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.220997.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.485254.log 2023-12-12T17:38:21.638 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.405654.log 2023-12-12T17:38:21.639 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.45914.log: /var/log/ceph/ceph-client.admin.485254.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94796.log 2023-12-12T17:38:21.642 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.405654.log: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.172405.log.gz 2023-12-12T17:38:21.642 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.390328.log 2023-12-12T17:38:21.645 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.94796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141278.log 2023-12-12T17:38:21.646 INFO:teuthology.orchestra.run.smithi078.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45901.log.gz 2023-12-12T17:38:21.646 INFO:teuthology.orchestra.run.smithi078.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.44972.log.gz 2023-12-12T17:38:21.648 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.390328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.223857.log 2023-12-12T17:38:21.649 INFO:teuthology.orchestra.run.smithi078.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44176.log.gz 2023-12-12T17:38:21.651 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.141278.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.227143.log 2023-12-12T17:38:21.652 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.332395.log 2023-12-12T17:38:21.654 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.223857.log: /var/log/ceph/ceph-client.admin.227143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.460665.log 2023-12-12T17:38:21.655 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.332395.log: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.108244.log.gz 2023-12-12T17:38:21.655 INFO:teuthology.orchestra.run.smithi078.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.320144.log.gz 2023-12-12T17:38:21.658 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.462278.log 2023-12-12T17:38:21.660 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.460665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45290.log 2023-12-12T17:38:21.661 INFO:teuthology.orchestra.run.smithi078.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.109459.log.gz 2023-12-12T17:38:21.663 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.462278.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.475169.log 2023-12-12T17:38:21.663 INFO:teuthology.orchestra.run.smithi078.stderr: 96.4% -- replaced with /var/log/ceph/ceph-client.admin.509158.log.gz 2023-12-12T17:38:21.663 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.45290.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.112273.log.gz 2023-12-12T17:38:21.664 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.110272.log.gz 2023-12-12T17:38:21.665 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.113087.log.gz 2023-12-12T17:38:21.665 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45500.log 2023-12-12T17:38:21.666 INFO:teuthology.orchestra.run.smithi078.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.171029.log.gz 2023-12-12T17:38:21.667 INFO:teuthology.orchestra.run.smithi078.stderr: 79.3% -- replaced with /var/log/ceph/ceph-client.admin.181208.log.gz 2023-12-12T17:38:21.667 INFO:teuthology.orchestra.run.smithi078.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47531.log.gz/var/log/ceph/ceph-client.admin.475169.log: 2023-12-12T17:38:21.668 INFO:teuthology.orchestra.run.smithi078.stderr: 79.6% -- replaced with /var/log/ceph/ceph-client.admin.182047.log.gz 2023-12-12T17:38:21.668 INFO:teuthology.orchestra.run.smithi078.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.150000.log.gz 2023-12-12T17:38:21.669 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96071.log 2023-12-12T17:38:21.670 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.174529.log.gz 2023-12-12T17:38:21.671 INFO:teuthology.orchestra.run.smithi078.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.89732.log.gz 2023-12-12T17:38:21.671 INFO:teuthology.orchestra.run.smithi078.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.189765.log.gz 2023-12-12T17:38:21.673 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.45500.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.376950.log.gz 2023-12-12T17:38:21.673 INFO:teuthology.orchestra.run.smithi078.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.310305.log.gz 2023-12-12T17:38:21.673 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45499.log 2023-12-12T17:38:21.674 INFO:teuthology.orchestra.run.smithi078.stderr: 80.1% -- replaced with /var/log/ceph/ceph-client.admin.475169.log.gz 2023-12-12T17:38:21.675 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143309.log 81.6% 2023-12-12T17:38:21.675 INFO:teuthology.orchestra.run.smithi078.stderr: -- replaced with /var/log/ceph/ceph-client.admin.402816.log.gz 2023-12-12T17:38:21.675 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.96071.log: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.446041.log.gz 2023-12-12T17:38:21.676 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.45499.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.486070.log.gz 2023-12-12T17:38:21.677 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.490897.log 2023-12-12T17:38:21.677 INFO:teuthology.orchestra.run.smithi078.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.199156.log.gz 2023-12-12T17:38:21.679 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.143309.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.396284.log 2023-12-12T17:38:21.682 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.490897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95256.log 2023-12-12T17:38:21.685 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.227134.log 2023-12-12T17:38:21.686 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.396284.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49315.log 2023-12-12T17:38:21.688 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.95256.log: /var/log/ceph/ceph-client.admin.227134.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.467829.log 2023-12-12T17:38:21.690 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.49315.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.404033.log 2023-12-12T17:38:21.692 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.467829.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.353894.log 2023-12-12T17:38:21.694 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106585.log 2023-12-12T17:38:21.697 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.404033.log: /var/log/ceph/ceph-client.admin.353894.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.197952.log 2023-12-12T17:38:21.698 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.106585.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.399141.log.gz 2023-12-12T17:38:21.699 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.243327.log 2023-12-12T17:38:21.702 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.197952.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185901.log 2023-12-12T17:38:21.703 INFO:teuthology.orchestra.run.smithi078.stderr: 78.3% -- replaced with /var/log/ceph/ceph-client.admin.459447.log.gz 2023-12-12T17:38:21.703 INFO:teuthology.orchestra.run.smithi078.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.469441.log.gz 2023-12-12T17:38:21.704 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.243327.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49010.log 2023-12-12T17:38:21.704 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.432740.log.gz 2023-12-12T17:38:21.706 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.185901.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.496406.log 2023-12-12T17:38:21.708 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.49010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50054.log 2023-12-12T17:38:21.710 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.496406.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.240092.log 2023-12-12T17:38:21.711 INFO:teuthology.orchestra.run.smithi078.stderr: 83.6% -- replaced with /var/log/ceph/ceph-client.admin.496406.log.gz 2023-12-12T17:38:21.712 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.50054.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.497252.log 2023-12-12T17:38:21.714 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.309087.log 2023-12-12T17:38:21.715 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.240092.log: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.462278.log.gz 2023-12-12T17:38:21.716 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.460665.log.gz 2023-12-12T17:38:21.717 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.497252.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171982.log 2023-12-12T17:38:21.719 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.309087.log: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.332395.log.gz 2023-12-12T17:38:21.719 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.430285.log.gz 2023-12-12T17:38:21.720 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138753.log 2023-12-12T17:38:21.722 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.494120.log 2023-12-12T17:38:21.723 INFO:teuthology.orchestra.run.smithi078.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.106585.log.gz 2023-12-12T17:38:21.723 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.171982.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188483.log 2023-12-12T17:38:21.725 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.494120.log: /var/log/ceph/ceph-client.admin.138753.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.115111.log.gz 2023-12-12T17:38:21.726 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.220140.log 2023-12-12T17:38:21.727 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45915.log 2023-12-12T17:38:21.730 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.220140.log: /var/log/ceph/ceph-client.admin.188483.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151796.log 2023-12-12T17:38:21.730 INFO:teuthology.orchestra.run.smithi078.stderr: 92.8% -- replaced with /var/log/ceph/ceph-client.admin.497252.log.gz 2023-12-12T17:38:21.731 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.497243.log 2023-12-12T17:38:21.733 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.151796.log: /var/log/ceph/ceph-client.admin.45915.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.325077.log 2023-12-12T17:38:21.735 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.497243.log: 77.3% -- replaced with /var/log/ceph/ceph-client.admin.327886.log.gz 2023-12-12T17:38:21.736 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.451005.log 2023-12-12T17:38:21.736 INFO:teuthology.orchestra.run.smithi078.stderr: 80.2% -- replaced with /var/log/ceph/ceph-client.admin.497243.log.gz 2023-12-12T17:38:21.737 INFO:teuthology.orchestra.run.smithi078.stderr: 92.7% -- replaced with /var/log/ceph/ceph-client.admin.102060.log.gz 2023-12-12T17:38:21.739 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.325077.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.355834.log 2023-12-12T17:38:21.739 INFO:teuthology.orchestra.run.smithi078.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48698.log.gz 2023-12-12T17:38:21.740 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.451005.log: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.139204.log.gz 2023-12-12T17:38:21.742 INFO:teuthology.orchestra.run.smithi078.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.141278.log.gz 2023-12-12T17:38:21.742 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174520.log 2023-12-12T17:38:21.742 INFO:teuthology.orchestra.run.smithi078.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.204958.log.gz 2023-12-12T17:38:21.743 INFO:teuthology.orchestra.run.smithi078.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.392974.log.gz 2023-12-12T17:38:21.745 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.355834.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-12-12T17:38:21.745 INFO:teuthology.orchestra.run.smithi078.stderr: 79.6% -- replaced with /var/log/ceph/ceph-client.admin.467829.log.gz 2023-12-12T17:38:21.746 INFO:teuthology.orchestra.run.smithi078.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45290.log.gz 2023-12-12T17:38:21.747 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.174520.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45500.log.gz 2023-12-12T17:38:21.749 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.389162.log 2023-12-12T17:38:21.750 INFO:teuthology.orchestra.run.smithi078.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.101648.log.gz 2023-12-12T17:38:21.752 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.196336.log 2023-12-12T17:38:21.753 INFO:teuthology.orchestra.run.smithi078.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49922.log.gz 2023-12-12T17:38:21.754 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.389162.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44366.log.gz 2023-12-12T17:38:21.754 INFO:teuthology.orchestra.run.smithi078.stderr: 95.2% -- replaced with /var/log/ceph/ceph-client.0.50160.log.gz 2023-12-12T17:38:21.755 INFO:teuthology.orchestra.run.smithi078.stderr: 79.2% -- replaced with /var/log/ceph/ceph-client.admin.121404.log.gz 2023-12-12T17:38:21.755 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.378662.log 2023-12-12T17:38:21.756 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.196336.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.96071.log.gz 2023-12-12T17:38:21.756 INFO:teuthology.orchestra.run.smithi078.stderr: 77.6% -- replaced with /var/log/ceph/ceph-client.admin.94796.log.gz 2023-12-12T17:38:21.759 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.323042.log 2023-12-12T17:38:21.760 INFO:teuthology.orchestra.run.smithi078.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.384188.log.gz 2023-12-12T17:38:21.760 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.378662.log: 79.3% -- replaced with /var/log/ceph/ceph-client.admin.385680.log.gz 2023-12-12T17:38:21.762 INFO:teuthology.orchestra.run.smithi078.stderr: 78.8% -- replaced with /var/log/ceph/ceph-client.admin.212566.log.gz 2023-12-12T17:38:21.762 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44426.log 2023-12-12T17:38:21.763 INFO:teuthology.orchestra.run.smithi078.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.174520.log.gz 80.7% 2023-12-12T17:38:21.763 INFO:teuthology.orchestra.run.smithi078.stderr: -- replaced with /var/log/ceph/ceph-client.admin.309087.log.gz 2023-12-12T17:38:21.763 INFO:teuthology.orchestra.run.smithi078.stderr: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.171982.log.gz 2023-12-12T17:38:21.765 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.323042.log: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.240092.log.gz 2023-12-12T17:38:21.765 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.485665.log 2023-12-12T17:38:21.766 INFO:teuthology.orchestra.run.smithi078.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.243327.log.gz 2023-12-12T17:38:21.767 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.44426.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.425960.log 2023-12-12T17:38:21.767 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.353894.log.gz 2023-12-12T17:38:21.769 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.485665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.324675.log 2023-12-12T17:38:21.772 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49140.log 2023-12-12T17:38:21.775 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.425960.log: /var/log/ceph/ceph-client.admin.324675.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.313541.log 2023-12-12T17:38:21.775 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.458177.log.gz 2023-12-12T17:38:21.775 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.49140.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.451005.log.gz 2023-12-12T17:38:21.776 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.341251.log 2023-12-12T17:38:21.781 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.313541.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.228377.log 2023-12-12T17:38:21.783 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.341251.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.227948.log 2023-12-12T17:38:21.790 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.228377.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.203350.log 2023-12-12T17:38:21.790 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.227948.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.444830.log.gz 2023-12-12T17:38:21.790 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.401577.log 2023-12-12T17:38:21.791 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.323873.log 2023-12-12T17:38:21.791 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.203350.log: /var/log/ceph/ceph-client.admin.401577.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.389162.log.gz 2023-12-12T17:38:21.793 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.516806.log 2023-12-12T17:38:21.795 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.323873.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183769.log 2023-12-12T17:38:21.798 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.516806.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188053.log 2023-12-12T17:38:21.798 INFO:teuthology.orchestra.run.smithi078.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.516806.log.gz 2023-12-12T17:38:21.799 INFO:teuthology.orchestra.run.smithi078.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.232874.log.gz 2023-12-12T17:38:21.801 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.183769.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.196336.log.gz 2023-12-12T17:38:21.801 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.380465.log 2023-12-12T17:38:21.802 INFO:teuthology.orchestra.run.smithi078.stderr:gzip/var/log/ceph/ceph-client.admin.188053.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.262349.log 2023-12-12T17:38:21.803 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.380465.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45499.log.gz 2023-12-12T17:38:21.805 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.202949.log 2023-12-12T17:38:21.806 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.440696.log 2023-12-12T17:38:21.809 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.262349.log: /var/log/ceph/ceph-client.admin.202949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.335234.log 2023-12-12T17:38:21.812 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.440696.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.441091.log 2023-12-12T17:38:21.814 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47349.log 2023-12-12T17:38:21.816 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.335234.log: /var/log/ceph/ceph-client.admin.441091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.235172.log 2023-12-12T17:38:21.818 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47349.log: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.490897.log.gz 2023-12-12T17:38:21.819 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.518996.log 2023-12-12T17:38:21.819 INFO:teuthology.orchestra.run.smithi078.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.412715.log.gz 2023-12-12T17:38:21.822 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.235172.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191057.log 2023-12-12T17:38:21.824 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142097.log 2023-12-12T17:38:21.827 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.518996.log: /var/log/ceph/ceph-client.admin.191057.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.518996.log.gz 2023-12-12T17:38:21.827 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140834.log 2023-12-12T17:38:21.830 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.142097.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47986.log 2023-12-12T17:38:21.831 INFO:teuthology.orchestra.run.smithi078.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.349111.log.gz 2023-12-12T17:38:21.832 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.140834.log: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.325077.log.gzgzip 2023-12-12T17:38:21.832 INFO:teuthology.orchestra.run.smithi078.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.460656.log 2023-12-12T17:38:21.838 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47986.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.515966.log 2023-12-12T17:38:21.838 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.460656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.231655.log 2023-12-12T17:38:21.839 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.432731.log 2023-12-12T17:38:21.844 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.515966.log: /var/log/ceph/ceph-client.admin.231655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177666.log 2023-12-12T17:38:21.845 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.487280.log 2023-12-12T17:38:21.846 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.432731.log: /var/log/ceph/ceph-client.admin.177666.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49569.log 2023-12-12T17:38:21.847 INFO:teuthology.orchestra.run.smithi078.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.515966.log.gz 2023-12-12T17:38:21.849 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.487280.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.415416.log 2023-12-12T17:38:21.851 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.49569.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.498965.log 2023-12-12T17:38:21.854 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.415416.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.310296.log 2023-12-12T17:38:21.855 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.208829.log 2023-12-12T17:38:21.858 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.498965.log: /var/log/ceph/ceph-client.admin.310296.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.232062.log 2023-12-12T17:38:21.861 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.208829.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172826.log 2023-12-12T17:38:21.864 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.232062.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114695.log 2023-12-12T17:38:21.865 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.429827.log 2023-12-12T17:38:21.867 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.114695.log: /var/log/ceph/ceph-client.admin.172826.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149196.log 2023-12-12T17:38:21.868 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.196731.log 2023-12-12T17:38:21.871 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.429827.log: /var/log/ceph/ceph-client.admin.149196.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.520961.log 2023-12-12T17:38:21.873 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.196731.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.399535.log 2023-12-12T17:38:21.874 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45212.log 2023-12-12T17:38:21.876 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.520961.log: /var/log/ceph/ceph-client.admin.399535.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.520961.log.gz 2023-12-12T17:38:21.877 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.394211.log 2023-12-12T17:38:21.878 INFO:teuthology.orchestra.run.smithi078.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.410694.log.gz 2023-12-12T17:38:21.879 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.45212.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94401.log 2023-12-12T17:38:21.880 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.471114.log 2023-12-12T17:38:21.882 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.394211.log: /var/log/ceph/ceph-client.admin.94401.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44612.log 2023-12-12T17:38:21.884 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.223422.log 2023-12-12T17:38:21.885 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.471114.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47115.log 2023-12-12T17:38:21.888 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.223422.log: /var/log/ceph/ceph-client.admin.44612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.197144.log 2023-12-12T17:38:21.890 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47115.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166869.log 2023-12-12T17:38:21.892 INFO:teuthology.orchestra.run.smithi078.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.139213.log.gz 2023-12-12T17:38:21.892 INFO:teuthology.orchestra.run.smithi078.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.485254.log.gz 2023-12-12T17:38:21.892 INFO:teuthology.orchestra.run.smithi078.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.485665.log.gz 2023-12-12T17:38:21.892 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.415823.log 2023-12-12T17:38:21.893 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.197144.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.488088.log.gz 2023-12-12T17:38:21.894 INFO:teuthology.orchestra.run.smithi078.stderr: 83.7% -- replaced with /var/log/ceph/ceph-client.admin.490092.log.gz 2023-12-12T17:38:21.894 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.249536.log 2023-12-12T17:38:21.894 INFO:teuthology.orchestra.run.smithi078.stderr: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.495379.log.gz 2023-12-12T17:38:21.897 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.415823.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45212.log.gz 2023-12-12T17:38:21.897 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.166869.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.45915.log.gz 2023-12-12T17:38:21.897 INFO:teuthology.orchestra.run.smithi078.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.396284.log.gz 2023-12-12T17:38:21.897 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48168.log 2023-12-12T17:38:21.899 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.437797.log 2023-12-12T17:38:21.900 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.249536.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49870.log.gz 2023-12-12T17:38:21.900 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.48168.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44310.log.gz 2023-12-12T17:38:21.902 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.424351.log 2023-12-12T17:38:21.904 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.437797.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191898.log 2023-12-12T17:38:21.907 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.424351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.228815.log 2023-12-12T17:38:21.909 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.191898.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.385287.log 2023-12-12T17:38:21.911 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.228815.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.261922.log 2023-12-12T17:38:21.914 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.385287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.506230.log 2023-12-12T17:38:21.915 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.261922.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.343335.log 2023-12-12T17:38:21.917 INFO:teuthology.orchestra.run.smithi078.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.231655.log.gz 2023-12-12T17:38:21.917 INFO:teuthology.orchestra.run.smithi078.stderr: 79.1% -- replaced with /var/log/ceph/ceph-client.admin.228377.log.gz 2023-12-12T17:38:21.918 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168487.log 2023-12-12T17:38:21.919 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.506230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.196327.log 2023-12-12T17:38:21.920 INFO:teuthology.orchestra.run.smithi078.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.262349.log.gz 2023-12-12T17:38:21.920 INFO:teuthology.orchestra.run.smithi078.stderr: 79.6% -- replaced with /var/log/ceph/ceph-client.admin.261922.log.gz 2023-12-12T17:38:21.921 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.343335.log: /var/log/ceph/ceph-client.admin.168487.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.220997.log.gz 2023-12-12T17:38:21.922 INFO:teuthology.orchestra.run.smithi078.stderr: 78.5% -- replaced with /var/log/ceph/ceph-client.admin.471114.log.gz 2023-12-12T17:38:21.922 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.313541.log.gz 2023-12-12T17:38:21.922 INFO:teuthology.orchestra.run.smithi078.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44426.log.gz 2023-12-12T17:38:21.923 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.483678.log 2023-12-12T17:38:21.923 INFO:teuthology.orchestra.run.smithi078.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.168894.log.gz 2023-12-12T17:38:21.927 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49621.log 2023-12-12T17:38:21.927 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.196327.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178198.log 2023-12-12T17:38:21.929 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.49621.log: /var/log/ceph/ceph-client.admin.483678.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.197144.log.gz 2023-12-12T17:38:21.929 INFO:teuthology.orchestra.run.smithi078.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.378662.log.gz 2023-12-12T17:38:21.930 INFO:teuthology.orchestra.run.smithi078.stderr:gzip 92.2% -5 --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.506230.log.gz /var/log/ceph/ceph-client.admin.375260.log 2023-12-12T17:38:21.930 INFO:teuthology.orchestra.run.smithi078.stderr: 2023-12-12T17:38:21.930 INFO:teuthology.orchestra.run.smithi078.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.415416.log.gz 2023-12-12T17:38:21.931 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.429429.log 2023-12-12T17:38:21.931 INFO:teuthology.orchestra.run.smithi078.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.232062.log.gz 2023-12-12T17:38:21.932 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.375260.log: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.415823.log.gz 2023-12-12T17:38:21.933 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.178198.log: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.425960.log.gz 2023-12-12T17:38:21.933 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.520401.log 2023-12-12T17:38:21.934 INFO:teuthology.orchestra.run.smithi078.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47349.log.gz 2023-12-12T17:38:21.934 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.247935.log 2023-12-12T17:38:21.935 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.520401.log: /var/log/ceph/ceph-client.admin.429429.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.520401.log.gz 2023-12-12T17:38:21.936 INFO:teuthology.orchestra.run.smithi078.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47986.log.gz 2023-12-12T17:38:21.937 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.520193.log 2023-12-12T17:38:21.939 INFO:teuthology.orchestra.run.smithi078.stderr: 77.5% -- replaced with /var/log/ceph/ceph-client.admin.183769.log.gz 2023-12-12T17:38:21.939 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.241721.log 2023-12-12T17:38:21.941 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.247935.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195120.log 2023-12-12T17:38:21.941 INFO:teuthology.orchestra.run.smithi078.stderr: 80.0% -- replaced with /var/log/ceph/ceph-client.admin.227134.log.gz 2023-12-12T17:38:21.944 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.241721.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49315.log.gz 2023-12-12T17:38:21.944 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.520193.log: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.399535.log.gz 2023-12-12T17:38:21.944 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.375269.log 2023-12-12T17:38:21.944 INFO:teuthology.orchestra.run.smithi078.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.520193.log.gz 2023-12-12T17:38:21.945 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.237216.log 2023-12-12T17:38:21.946 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.195120.log: /var/log/ceph/ceph-client.admin.375269.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.375260.log.gz 2023-12-12T17:38:21.947 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.465179.log 2023-12-12T17:38:21.947 INFO:teuthology.orchestra.run.smithi078.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.50054.log.gz 2023-12-12T17:38:21.948 INFO:teuthology.orchestra.run.smithi078.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.143309.log.gz 2023-12-12T17:38:21.949 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.237216.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47583.log 2023-12-12T17:38:21.952 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47746.log 2023-12-12T17:38:21.954 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.465179.log: /var/log/ceph/ceph-client.admin.47583.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.238876.log 2023-12-12T17:38:21.954 INFO:teuthology.orchestra.run.smithi078.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.235172.log.gz 2023-12-12T17:38:21.955 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.206357.log 2023-12-12T17:38:21.956 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90589.log 2023-12-12T17:38:21.958 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.206357.log: /var/log/ceph/ceph-client.admin.238876.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.382133.log 2023-12-12T17:38:21.961 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.90589.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.246173.log 2023-12-12T17:38:21.963 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.382133.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.452675.log 2023-12-12T17:38:21.964 INFO:teuthology.orchestra.run.smithi078.stderr: 78.8% -- replaced with /var/log/ceph/ceph-client.admin.324675.log.gz 2023-12-12T17:38:21.965 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.246173.log: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.323873.log.gz 2023-12-12T17:38:21.966 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.315154.log 2023-12-12T17:38:21.968 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.466558.log 2023-12-12T17:38:21.969 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.452675.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.387909.log 2023-12-12T17:38:21.971 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.466558.log: /var/log/ceph/ceph-client.admin.315154.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120152.log 2023-12-12T17:38:21.974 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.387909.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47505.log 2023-12-12T17:38:21.975 INFO:teuthology.orchestra.run.smithi078.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.182056.log.gz 2023-12-12T17:38:21.977 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.120152.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.438601.log 2023-12-12T17:38:21.980 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47505.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45496.log 2023-12-12T17:38:21.983 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.320938.log 2023-12-12T17:38:21.984 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.438601.log: /var/log/ceph/ceph-client.admin.45496.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.473924.log 2023-12-12T17:38:21.988 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.320938.log: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.114695.log.gz 2023-12-12T17:38:21.988 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190204.log 2023-12-12T17:38:21.989 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.473924.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147791.log 2023-12-12T17:38:21.991 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.190204.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.513417.log 2023-12-12T17:38:21.992 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.405262.log 2023-12-12T17:38:21.993 INFO:teuthology.orchestra.run.smithi078.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.48168.log.gz 2023-12-12T17:38:21.994 INFO:teuthology.orchestra.run.smithi078.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.383758.log.gz 2023-12-12T17:38:21.994 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.513417.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49140.log.gz 2023-12-12T17:38:21.994 INFO:teuthology.orchestra.run.smithi078.stderr: 79.5% -- replaced with /var/log/ceph/ceph-client.admin.513417.log.gz 2023-12-12T17:38:21.995 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.147791.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107040.log 2023-12-12T17:38:21.997 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.405262.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.389570.log 2023-12-12T17:38:21.999 INFO:teuthology.orchestra.run.smithi078.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.140834.log.gz 2023-12-12T17:38:21.999 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.107040.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.208829.log.gz 2023-12-12T17:38:22.000 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.456848.log 2023-12-12T17:38:22.002 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.389570.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.447823.log 2023-12-12T17:38:22.004 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.456848.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116808.log 2023-12-12T17:38:22.006 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.447823.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.375269.log.gz 2023-12-12T17:38:22.006 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.202146.log 2023-12-12T17:38:22.007 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116371.log 2023-12-12T17:38:22.007 INFO:teuthology.orchestra.run.smithi078.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.202949.log.gz 2023-12-12T17:38:22.009 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.116808.log: /var/log/ceph/ceph-client.admin.202146.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45482.log 2023-12-12T17:38:22.010 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.348709.log 2023-12-12T17:38:22.012 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.116371.log: /var/log/ceph/ceph-client.admin.45482.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45496.log.gz 2023-12-12T17:38:22.014 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.510438.log 2023-12-12T17:38:22.014 INFO:teuthology.orchestra.run.smithi078.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.223857.log.gz 2023-12-12T17:38:22.014 INFO:teuthology.orchestra.run.smithi078.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.341251.log.gz 2023-12-12T17:38:22.014 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.380063.log 2023-12-12T17:38:22.015 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.510438.log: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.510438.log.gz 2023-12-12T17:38:22.016 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.348709.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.249536.log.gz 2023-12-12T17:38:22.017 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.518139.log 2023-12-12T17:38:22.018 INFO:teuthology.orchestra.run.smithi078.stderr: 90.0% 89.4% -- replaced with /var/log/ceph/ceph-client.admin.47583.log.gz -- replaced with /var/log/ceph/ceph-client.admin.227143.log.gz 2023-12-12T17:38:22.018 INFO:teuthology.orchestra.run.smithi078.stderr: 2023-12-12T17:38:22.019 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.512567.log 2023-12-12T17:38:22.019 INFO:teuthology.orchestra.run.smithi078.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.49621.log.gz 2023-12-12T17:38:22.020 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.518139.log: 77.6% -- replaced with /var/log/ceph/ceph-client.admin.518139.log.gz 2023-12-12T17:38:22.020 INFO:teuthology.orchestra.run.smithi078.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.195120.log.gz 2023-12-12T17:38:22.021 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.380063.log: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.196327.log.gz 2023-12-12T17:38:22.022 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.520167.log 2023-12-12T17:38:22.023 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.512567.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.241721.log.gz 2023-12-12T17:38:22.023 INFO:teuthology.orchestra.run.smithi078.stderr: 83.4% -- replaced with /var/log/ceph/ceph-client.admin.512567.log.gz 2023-12-12T17:38:22.024 INFO:teuthology.orchestra.run.smithi078.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.387909.log.gz 2023-12-12T17:38:22.024 INFO:teuthology.orchestra.run.smithi078.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.389570.log.gz 2023-12-12T17:38:22.026 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.319308.log 2023-12-12T17:38:22.027 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.316776.log 2023-12-12T17:38:22.029 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.520167.log: /var/log/ceph/ceph-client.admin.319308.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.246173.log.gz 2023-12-12T17:38:22.029 INFO:teuthology.orchestra.run.smithi078.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.437797.log.gz 2023-12-12T17:38:22.030 INFO:teuthology.orchestra.run.smithi078.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.520167.log.gz 2023-12-12T17:38:22.030 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.493726.log 2023-12-12T17:38:22.031 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.453479.log 2023-12-12T17:38:22.033 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.493726.log: /var/log/ceph/ceph-client.admin.316776.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.120152.log.gz 2023-12-12T17:38:22.034 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.487685.log 2023-12-12T17:38:22.036 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.205374.log 2023-12-12T17:38:22.038 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.453479.log: /var/log/ceph/ceph-client.admin.487685.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.245780.log 2023-12-12T17:38:22.040 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.447411.log 2023-12-12T17:38:22.042 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.205374.log: /var/log/ceph/ceph-client.admin.245780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.435277.log 2023-12-12T17:38:22.045 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193110.log 2023-12-12T17:38:22.046 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.447411.log: /var/log/ceph/ceph-client.admin.435277.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.345878.log 2023-12-12T17:38:22.048 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.193110.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.216079.log 2023-12-12T17:38:22.050 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.345878.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.464386.log 2023-12-12T17:38:22.053 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.216079.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47851.log 2023-12-12T17:38:22.056 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.464386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.197539.log 2023-12-12T17:38:22.058 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.241712.log 2023-12-12T17:38:22.060 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47851.log: /var/log/ceph/ceph-client.admin.197539.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.340323.log 2023-12-12T17:38:22.063 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.241712.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.395055.log 2023-12-12T17:38:22.065 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.520567.log 2023-12-12T17:38:22.068 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.395055.log: /var/log/ceph/ceph-client.admin.340323.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48724.log 2023-12-12T17:38:22.069 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.349532.log 2023-12-12T17:38:22.072 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.520567.log: /var/log/ceph/ceph-client.admin.48724.log: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.424351.log.gz 2023-12-12T17:38:22.072 INFO:teuthology.orchestra.run.smithi078.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.520567.log.gz 2023-12-12T17:38:22.073 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48272.log 2023-12-12T17:38:22.073 INFO:teuthology.orchestra.run.smithi078.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.452675.log.gz 2023-12-12T17:38:22.074 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.499871.log 2023-12-12T17:38:22.077 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.349532.log: /var/log/ceph/ceph-client.admin.48272.log: 77.5% -- replaced with /var/log/ceph/ceph-client.admin.438601.log.gz 2023-12-12T17:38:22.077 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.254432.log 2023-12-12T17:38:22.079 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45694.log 2023-12-12T17:38:22.080 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.499871.log: /var/log/ceph/ceph-client.admin.254432.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.221400.log 2023-12-12T17:38:22.081 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.45694.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.197135.log 2023-12-12T17:38:22.082 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.221400.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.46331.log.gz 2023-12-12T17:38:22.087 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.201722.log 2023-12-12T17:38:22.087 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.222606.log 2023-12-12T17:38:22.087 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.178198.log.gz 2023-12-12T17:38:22.088 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.197135.log: /var/log/ceph/ceph-client.admin.201722.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44400.log 2023-12-12T17:38:22.089 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.222606.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.385287.log.gz 2023-12-12T17:38:22.091 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88381.log 2023-12-12T17:38:22.093 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.313935.log 2023-12-12T17:38:22.094 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.44400.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.203761.log 2023-12-12T17:38:22.097 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.88381.log: /var/log/ceph/ceph-client.admin.313935.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174931.log 2023-12-12T17:38:22.098 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.246608.log 2023-12-12T17:38:22.100 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.174931.log: /var/log/ceph/ceph-client.admin.203761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.455578.log 2023-12-12T17:38:22.101 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.464386.log.gz 2023-12-12T17:38:22.104 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.246608.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.256080.log 2023-12-12T17:38:22.104 INFO:teuthology.orchestra.run.smithi078.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.494120.log.gz 2023-12-12T17:38:22.106 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.455578.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.256071.log 2023-12-12T17:38:22.107 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.405262.log.gz 2023-12-12T17:38:22.108 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.249938.log 2023-12-12T17:38:22.109 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.256080.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.317983.log 2023-12-12T17:38:22.112 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.249938.log: /var/log/ceph/ceph-client.admin.256071.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148704.log 2023-12-12T17:38:22.112 INFO:teuthology.orchestra.run.smithi078.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.493726.log.gz 2023-12-12T17:38:22.116 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.317983.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.408113.log 2023-12-12T17:38:22.116 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.431524.log 2023-12-12T17:38:22.117 INFO:teuthology.orchestra.run.smithi078.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.487280.log.gz 2023-12-12T17:38:22.120 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.148704.log: /var/log/ceph/ceph-client.admin.408113.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.321434.log 2023-12-12T17:38:22.120 INFO:teuthology.orchestra.run.smithi078.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.432731.log.gz 2023-12-12T17:38:22.120 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.431121.log 2023-12-12T17:38:22.123 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.431524.log: /var/log/ceph/ceph-client.admin.321434.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.520831.log 2023-12-12T17:38:22.125 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.431121.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102051.log 2023-12-12T17:38:22.126 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.520831.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.520831.log.gz 2023-12-12T17:38:22.128 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180249.log 2023-12-12T17:38:22.129 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46279.log 2023-12-12T17:38:22.132 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.180249.log: /var/log/ceph/ceph-client.admin.102051.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.379259.log 2023-12-12T17:38:22.133 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.424360.log 2023-12-12T17:38:22.136 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.379259.log: /var/log/ceph/ceph-client.admin.46279.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.439871.log 2023-12-12T17:38:22.138 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.424360.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.328690.log 2023-12-12T17:38:22.140 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.439871.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.500760.log 2023-12-12T17:38:22.141 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192313.log 2023-12-12T17:38:22.144 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.500760.log: /var/log/ceph/ceph-client.admin.328690.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.500760.log.gz 2023-12-12T17:38:22.144 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117263.log 2023-12-12T17:38:22.145 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109861.log 2023-12-12T17:38:22.147 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.117263.log: /var/log/ceph/ceph-client.admin.192313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.392567.log 2023-12-12T17:38:22.148 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.338556.log 2023-12-12T17:38:22.151 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.392567.log: /var/log/ceph/ceph-client.admin.109861.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.438208.log 2023-12-12T17:38:22.153 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.338556.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46602.log 2023-12-12T17:38:22.156 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.438208.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.479975.log 2023-12-12T17:38:22.157 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.46602.log: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.188483.log.gz 2023-12-12T17:38:22.158 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184172.log 2023-12-12T17:38:22.159 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115964.log 2023-12-12T17:38:22.161 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.479975.log: /var/log/ceph/ceph-client.admin.184172.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.399132.log 2023-12-12T17:38:22.164 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.115964.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.453086.log 2023-12-12T17:38:22.164 INFO:teuthology.orchestra.run.smithi078.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.48272.log.gz 2023-12-12T17:38:22.165 INFO:teuthology.orchestra.run.smithi078.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48724.log.gz 2023-12-12T17:38:22.166 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.399132.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49010.log.gzgzip 2023-12-12T17:38:22.166 INFO:teuthology.orchestra.run.smithi078.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.206366.log 2023-12-12T17:38:22.172 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.453086.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48589.log 2023-12-12T17:38:22.173 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.206366.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.200447.log 2023-12-12T17:38:22.173 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.521141.log 2023-12-12T17:38:22.175 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.48589.log: /var/log/ceph/ceph-client.admin.200447.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.426371.log 2023-12-12T17:38:22.176 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49517.log 2023-12-12T17:38:22.178 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.426371.log: /var/log/ceph/ceph-client.admin.521141.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.443849.log 2023-12-12T17:38:22.179 INFO:teuthology.orchestra.run.smithi078.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.521141.log.gz 2023-12-12T17:38:22.181 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.49517.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.218119.log 2023-12-12T17:38:22.184 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.443849.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.350451.log 2023-12-12T17:38:22.184 INFO:teuthology.orchestra.run.smithi078.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.205374.log.gz 2023-12-12T17:38:22.186 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.218119.log: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.185901.log.gz 2023-12-12T17:38:22.186 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.334023.log 2023-12-12T17:38:22.187 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.316366.log 2023-12-12T17:38:22.189 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.350451.log: /var/log/ceph/ceph-client.admin.334023.log: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.392567.log.gz 2023-12-12T17:38:22.189 INFO:teuthology.orchestra.run.smithi078.stderr: 77.8% -- replaced with /var/log/ceph/ceph-client.admin.218119.log.gz 2023-12-12T17:38:22.189 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.387039.log 2023-12-12T17:38:22.192 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.316366.log: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.394211.log.gz 2023-12-12T17:38:22.192 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.380890.log 2023-12-12T17:38:22.193 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48906.log 2023-12-12T17:38:22.193 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.408113.log.gz 2023-12-12T17:38:22.196 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.387039.log: /var/log/ceph/ceph-client.admin.380890.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.333612.log 2023-12-12T17:38:22.196 INFO:teuthology.orchestra.run.smithi078.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45482.log.gz 2023-12-12T17:38:22.196 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.48906.log: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.317983.log.gz 2023-12-12T17:38:22.197 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.316776.log.gz 2023-12-12T17:38:22.198 INFO:teuthology.orchestra.run.smithi078.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47746.log.gz 2023-12-12T17:38:22.198 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166069.log 2023-12-12T17:38:22.198 INFO:teuthology.orchestra.run.smithi078.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49517.log.gz 2023-12-12T17:38:22.201 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.333612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.212132.log 2023-12-12T17:38:22.201 INFO:teuthology.orchestra.run.smithi078.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.94401.log.gz 2023-12-12T17:38:22.202 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.166069.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.179846.log.gz 2023-12-12T17:38:22.207 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.508747.log 2023-12-12T17:38:22.209 INFO:teuthology.orchestra.run.smithi078.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.221400.log.gz 2023-12-12T17:38:22.209 INFO:teuthology.orchestra.run.smithi078.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.222606.log.gz 2023-12-12T17:38:22.209 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.212132.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.382533.log 2023-12-12T17:38:22.211 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.508747.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47323.log 2023-12-12T17:38:22.211 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.382533.log: 83.9% -- replaced with /var/log/ceph/ceph-client.admin.508747.log.gz 2023-12-12T17:38:22.211 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47401.log 2023-12-12T17:38:22.212 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47323.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.197548.log 2023-12-12T17:38:22.213 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47401.log: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.184172.log.gz 2023-12-12T17:38:22.215 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.445237.log 2023-12-12T17:38:22.216 INFO:teuthology.orchestra.run.smithi078.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.203350.log.gz 2023-12-12T17:38:22.217 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149598.log 2023-12-12T17:38:22.218 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.445237.log: /var/log/ceph/ceph-client.admin.197548.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.206366.log.gz 2023-12-12T17:38:22.221 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.496006.log 2023-12-12T17:38:22.224 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.149598.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.348305.log 2023-12-12T17:38:22.225 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.496006.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.496006.log.gz 2023-12-12T17:38:22.226 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.247935.log.gz 2023-12-12T17:38:22.226 INFO:teuthology.orchestra.run.smithi078.stderr: 78.2% -- replaced with /var/log/ceph/ceph-client.admin.254432.log.gz 2023-12-12T17:38:22.227 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.215686.log 2023-12-12T17:38:22.228 INFO:teuthology.orchestra.run.smithi078.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.380890.log.gz 2023-12-12T17:38:22.229 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.348305.log: 77.4% -- replaced with /var/log/ceph/ceph-client.admin.380063.log.gz 2023-12-12T17:38:22.229 INFO:teuthology.orchestra.run.smithi078.stderr: 83.2% -- replaced with /var/log/ceph/ceph-client.admin.238876.log.gz 2023-12-12T17:38:22.230 INFO:teuthology.orchestra.run.smithi078.stderr: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.196731.log.gz 2023-12-12T17:38:22.231 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.441566.log 2023-12-12T17:38:22.232 INFO:teuthology.orchestra.run.smithi078.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.197539.log.gz 2023-12-12T17:38:22.233 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.215686.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.235595.log 2023-12-12T17:38:22.234 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.441566.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.310296.log.gz 2023-12-12T17:38:22.235 INFO:teuthology.orchestra.run.smithi078.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.197548.log.gz 2023-12-12T17:38:22.237 INFO:teuthology.orchestra.run.smithi078.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.191898.log.gz 2023-12-12T17:38:22.237 INFO:teuthology.orchestra.run.smithi078.stderr: 78.4% -- replaced with /var/log/ceph/ceph-client.admin.193110.log.gz 2023-12-12T17:38:22.237 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44946.log 2023-12-12T17:38:22.238 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.453086.log.gz 2023-12-12T17:38:22.238 INFO:teuthology.orchestra.run.smithi078.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.455578.log.gz 2023-12-12T17:38:22.239 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.192313.log.gz 2023-12-12T17:38:22.240 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.235595.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.461879.log 2023-12-12T17:38:22.240 INFO:teuthology.orchestra.run.smithi078.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.387039.log.gz 2023-12-12T17:38:22.242 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.44946.log: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.249938.log.gz 2023-12-12T17:38:22.242 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.315561.log 2023-12-12T17:38:22.244 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.461879.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.387445.log 2023-12-12T17:38:22.248 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.315561.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.414793.log 2023-12-12T17:38:22.248 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.387445.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.245780.log.gz 2023-12-12T17:38:22.249 INFO:teuthology.orchestra.run.smithi078.stderr: 79.4% -- replaced with /var/log/ceph/ceph-client.admin.149196.log.gz 2023-12-12T17:38:22.254 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.500314.log 2023-12-12T17:38:22.257 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.166069.log.gz 2023-12-12T17:38:22.257 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.414793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.243734.log 2023-12-12T17:38:22.257 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.500314.log: 79.4% -- replaced with /var/log/ceph/ceph-client.admin.168487.log.gz 2023-12-12T17:38:22.258 INFO:teuthology.orchestra.run.smithi078.stderr: 77.6% -- replaced with /var/log/ceph/ceph-client.admin.399132.log.gz 2023-12-12T17:38:22.258 INFO:teuthology.orchestra.run.smithi078.stderr: 79.6% -- replaced with /var/log/ceph/ceph-client.admin.500314.log.gz 2023-12-12T17:38:22.259 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.379671.log 2023-12-12T17:38:22.260 INFO:teuthology.orchestra.run.smithi078.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.461879.log.gz 2023-12-12T17:38:22.260 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.243734.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.317168.log 2023-12-12T17:38:22.263 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.379671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.236410.log 2023-12-12T17:38:22.265 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.317168.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.350908.log 2023-12-12T17:38:22.267 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.236410.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.349532.log.gz 2023-12-12T17:38:22.268 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109066.log 2023-12-12T17:38:22.269 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.350908.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173659.log 2023-12-12T17:38:22.272 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.109066.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.511293.log 2023-12-12T17:38:22.273 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.173659.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.469037.log 2023-12-12T17:38:22.273 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.511293.log: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.511293.log.gz 2023-12-12T17:38:22.275 INFO:teuthology.orchestra.run.smithi078.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.404033.log.gz 2023-12-12T17:38:22.276 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50000.log 2023-12-12T17:38:22.278 INFO:teuthology.orchestra.run.smithi078.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.328690.log.gz 2023-12-12T17:38:22.278 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.221804.log/var/log/ceph/ceph-client.admin.469037.log: 2023-12-12T17:38:22.280 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.50000.log: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.333612.log.gz 2023-12-12T17:38:22.281 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.232466.log 2023-12-12T17:38:22.282 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175790.log 2023-12-12T17:38:22.285 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.221804.log: /var/log/ceph/ceph-client.admin.232466.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.442988.log 2023-12-12T17:38:22.286 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195129.log 2023-12-12T17:38:22.289 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.442988.log: /var/log/ceph/ceph-client.admin.175790.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.218531.log 2023-12-12T17:38:22.289 INFO:teuthology.orchestra.run.smithi078.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.256080.log.gz 2023-12-12T17:38:22.291 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.195129.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.107040.log.gz 2023-12-12T17:38:22.292 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121828.log 2023-12-12T17:38:22.294 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.251556.log 2023-12-12T17:38:22.295 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.218531.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48246.log 2023-12-12T17:38:22.298 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.121828.log: /var/log/ceph/ceph-client.admin.251556.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47037.log 2023-12-12T17:38:22.301 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.48246.log: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.190204.log.gz 2023-12-12T17:38:22.301 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.239283.log 2023-12-12T17:38:22.303 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104935.log 2023-12-12T17:38:22.304 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47037.log: /var/log/ceph/ceph-client.admin.239283.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48906.log.gz 2023-12-12T17:38:22.305 INFO:teuthology.orchestra.run.smithi078.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.116808.log.gz 2023-12-12T17:38:22.305 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189335.log 2023-12-12T17:38:22.308 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.104935.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.387918.log 2023-12-12T17:38:22.308 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.189335.log: 93.7% -- replaced with /var/log/ceph/ceph-client.admin.188053.log.gz 2023-12-12T17:38:22.311 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111067.log 2023-12-12T17:38:22.312 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.387918.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.201722.log.gz 2023-12-12T17:38:22.313 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176260.log 2023-12-12T17:38:22.315 INFO:teuthology.orchestra.run.smithi078.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.441091.log.gz 2023-12-12T17:38:22.317 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104532.log 2023-12-12T17:38:22.318 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.111067.log: 79.7% -- replaced with /var/log/ceph/ceph-client.admin.443849.log.gz 2023-12-12T17:38:22.318 INFO:teuthology.orchestra.run.smithi078.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.441566.log.gz 2023-12-12T17:38:22.318 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.440696.log.gz 2023-12-12T17:38:22.318 INFO:teuthology.orchestra.run.smithi078.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.203761.log.gz 2023-12-12T17:38:22.319 INFO:teuthology.orchestra.run.smithi078.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.395055.log.gz 2023-12-12T17:38:22.319 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.176260.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.348305.log.gz 2023-12-12T17:38:22.319 INFO:teuthology.orchestra.run.smithi078.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44946.log.gz 2023-12-12T17:38:22.320 INFO:teuthology.orchestra.run.smithi078.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47323.log.gz 2023-12-12T17:38:22.320 INFO:teuthology.orchestra.run.smithi078.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.49569.log.gz 2023-12-12T17:38:22.320 INFO:teuthology.orchestra.run.smithi078.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46602.log.gz 2023-12-12T17:38:22.323 INFO:teuthology.orchestra.run.smithi078.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47037.log.gz 2023-12-12T17:38:22.323 INFO:teuthology.orchestra.run.smithi078.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.251556.log.gz 2023-12-12T17:38:22.323 INFO:teuthology.orchestra.run.smithi078.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.90589.log.gz 2023-12-12T17:38:22.324 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.448281.log 2023-12-12T17:38:22.324 INFO:teuthology.orchestra.run.smithi078.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.469037.log.gz 2023-12-12T17:38:22.324 INFO:teuthology.orchestra.run.smithi078.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.109066.log.gz 2023-12-12T17:38:22.324 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.104532.log: 79.4% -- replaced with /var/log/ceph/ceph-client.admin.111067.log.gz 2023-12-12T17:38:22.325 INFO:teuthology.orchestra.run.smithi078.stderr: 82.9% -- replaced with /var/log/ceph/ceph-client.admin.379259.log.gz 2023-12-12T17:38:22.326 INFO:teuthology.orchestra.run.smithi078.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.380465.log.gz 2023-12-12T17:38:22.327 INFO:teuthology.orchestra.run.smithi078.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.239283.log.gz 2023-12-12T17:38:22.327 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177657.log 2023-12-12T17:38:22.327 INFO:teuthology.orchestra.run.smithi078.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.221804.log.gz 2023-12-12T17:38:22.327 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.197952.log.gz 2023-12-12T17:38:22.328 INFO:teuthology.orchestra.run.smithi078.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.172826.log.gz 2023-12-12T17:38:22.328 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-12-12T17:38:22.330 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.177657.log: /var/log/ceph/ceph-client.admin.448281.log: gzip 84.5% -5 --verbose -- /var/log/ceph/ceph-client.admin.518583.log -- replaced with /var/log/ceph/ceph-client.admin.235595.log.gz 2023-12-12T17:38:22.342 INFO:teuthology.orchestra.run.smithi078.stderr: 2023-12-12T17:38:22.345 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141687.log 2023-12-12T17:38:22.345 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.518583.log: /var/log/ceph/ceph-osd.3.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.195129.log.gz 2023-12-12T17:38:22.346 INFO:teuthology.orchestra.run.smithi078.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.518583.log.gz 2023-12-12T17:38:22.346 INFO:teuthology.orchestra.run.smithi078.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.215686.log.gz 2023-12-12T17:38:22.346 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.312325.log 2023-12-12T17:38:22.346 INFO:teuthology.orchestra.run.smithi078.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.175790.log.gz 2023-12-12T17:38:22.346 INFO:teuthology.orchestra.run.smithi078.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.176260.log.gz 2023-12-12T17:38:22.346 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- 90.2% /var/log/ceph/ceph-client.admin.424754.log 2023-12-12T17:38:22.346 INFO:teuthology.orchestra.run.smithi078.stderr: -- replaced with /var/log/ceph/ceph-client.admin.387918.log.gz 2023-12-12T17:38:22.347 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.141687.log: /var/log/ceph/ceph-client.admin.312325.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194325.log 2023-12-12T17:38:22.347 INFO:teuthology.orchestra.run.smithi078.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.414793.log.gz 2023-12-12T17:38:22.347 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.442988.log.gz 2023-12-12T17:38:22.348 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.424754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.351779.log 2023-12-12T17:38:22.348 INFO:teuthology.orchestra.run.smithi078.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.50000.log.gz 2023-12-12T17:38:22.348 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.194325.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.325879.log 2023-12-12T17:38:22.349 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.351779.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.349523.log 2023-12-12T17:38:22.349 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.355330.log 2023-12-12T17:38:22.351 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.325879.log: /var/log/ceph/ceph-client.admin.349523.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175799.log 2023-12-12T17:38:22.352 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.515957.log 2023-12-12T17:38:22.355 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.175799.log: /var/log/ceph/ceph-client.admin.355330.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142902.log 2023-12-12T17:38:22.356 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140843.log 2023-12-12T17:38:22.357 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.515957.log: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.435277.log.gz 2023-12-12T17:38:22.359 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.142902.log: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.466558.log.gz 2023-12-12T17:38:22.359 INFO:teuthology.orchestra.run.smithi078.stderr: 84.5% -- replaced with /var/log/ceph/ceph-client.admin.515957.log.gz 2023-12-12T17:38:22.359 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.415087.log 2023-12-12T17:38:22.361 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.140843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.389972.log 2023-12-12T17:38:22.362 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.448290.log 2023-12-12T17:38:22.365 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.389972.log: /var/log/ceph/ceph-client.admin.415087.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46253.log 2023-12-12T17:38:22.367 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.402393.log 2023-12-12T17:38:22.369 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.448290.log: /var/log/ceph/ceph-client.admin.46253.log: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.246608.log.gz 2023-12-12T17:38:22.370 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.210835.log 2023-12-12T17:38:22.371 INFO:teuthology.orchestra.run.smithi078.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.465179.log.gz 2023-12-12T17:38:22.371 INFO:teuthology.orchestra.run.smithi078.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.256071.log.gz 2023-12-12T17:38:22.373 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.520727.log 2023-12-12T17:38:22.373 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.402393.log: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.335234.log.gz 2023-12-12T17:38:22.375 INFO:teuthology.orchestra.run.smithi078.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.487685.log.gz 2023-12-12T17:38:22.375 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.427200.log 2023-12-12T17:38:22.378 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.210835.log: /var/log/ceph/ceph-client.admin.520727.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121011.log 2023-12-12T17:38:22.379 INFO:teuthology.orchestra.run.smithi078.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.520727.log.gz 2023-12-12T17:38:22.380 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.427200.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.512992.log 2023-12-12T17:38:22.382 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.121011.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49289.log 2023-12-12T17:38:22.384 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.512992.log: 77.7% -- replaced with /var/log/ceph/ceph-client.admin.512992.log.gz 2023-12-12T17:38:22.385 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.505412.log 2023-12-12T17:38:22.386 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93947.log 2023-12-12T17:38:22.387 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.49289.log: /var/log/ceph/ceph-client.admin.505412.log: 77.7% -- replaced with /var/log/ceph/ceph-client.admin.505412.log.gz 2023-12-12T17:38:22.388 INFO:teuthology.orchestra.run.smithi078.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.316366.log.gz 2023-12-12T17:38:22.389 INFO:teuthology.orchestra.run.smithi078.stderr: 77.3% -- replaced with /var/log/ceph/ceph-client.admin.317168.log.gz 2023-12-12T17:38:22.389 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117658.log 2023-12-12T17:38:22.391 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113483.log 2023-12-12T17:38:22.393 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.93947.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.324274.log 2023-12-12T17:38:22.397 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.117658.log: /var/log/ceph/ceph-client.admin.113483.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117667.log 2023-12-12T17:38:22.397 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.324274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.327895.log 2023-12-12T17:38:22.399 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.117667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90598.log 2023-12-12T17:38:22.401 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.327895.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.512576.log 2023-12-12T17:38:22.403 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.90598.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.497711.log 2023-12-12T17:38:22.406 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.512576.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.401161.log 2023-12-12T17:38:22.410 INFO:teuthology.orchestra.run.smithi078.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.512576.log.gz 2023-12-12T17:38:22.410 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.379671.log.gz 2023-12-12T17:38:22.410 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.497711.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.244143.log 2023-12-12T17:38:22.410 INFO:teuthology.orchestra.run.smithi078.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.497711.log.gz 2023-12-12T17:38:22.412 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.401161.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.468240.log 2023-12-12T17:38:22.412 INFO:teuthology.orchestra.run.smithi078.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49289.log.gz 2023-12-12T17:38:22.413 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.244143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.515532.log 2023-12-12T17:38:22.415 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.468240.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.401577.log.gz 2023-12-12T17:38:22.417 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.142097.log.gz 2023-12-12T17:38:22.418 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.215283.log 2023-12-12T17:38:22.418 INFO:teuthology.orchestra.run.smithi078.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.141687.log.gz 2023-12-12T17:38:22.419 INFO:teuthology.orchestra.run.smithi078.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.445237.log.gz 2023-12-12T17:38:22.426 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.515532.log: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.447411.log.gz 2023-12-12T17:38:22.426 INFO:teuthology.orchestra.run.smithi078.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.515532.log.gz 2023-12-12T17:38:22.426 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.447823.log.gz 2023-12-12T17:38:22.426 INFO:teuthology.orchestra.run.smithi078.stderr: 83.2% -- replaced with /var/log/ceph/ceph-client.admin.200447.log.gz 2023-12-12T17:38:22.426 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.496848.log 2023-12-12T17:38:22.426 INFO:teuthology.orchestra.run.smithi078.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.206357.log.gz 2023-12-12T17:38:22.427 INFO:teuthology.orchestra.run.smithi078.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.448281.log.gz 2023-12-12T17:38:22.427 INFO:teuthology.orchestra.run.smithi078.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.338556.log.gz 2023-12-12T17:38:22.427 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.499435.log 2023-12-12T17:38:22.427 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.496848.log: /var/log/ceph/ceph-client.admin.215283.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.496848.log.gz 2023-12-12T17:38:22.427 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.512143.log 2023-12-12T17:38:22.431 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.499435.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112684.log 2023-12-12T17:38:22.431 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.512143.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.512143.log.gz 2023-12-12T17:38:22.431 INFO:teuthology.orchestra.run.smithi078.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.45914.log.gz 2023-12-12T17:38:22.433 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.218522.log 2023-12-12T17:38:22.435 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.112684.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112675.log 2023-12-12T17:38:22.438 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.218522.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44612.log.gz 2023-12-12T17:38:22.438 INFO:teuthology.orchestra.run.smithi078.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47851.log.gz 2023-12-12T17:38:22.438 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47798.log 2023-12-12T17:38:22.439 INFO:teuthology.orchestra.run.smithi078.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.121011.log.gz 2023-12-12T17:38:22.441 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.401984.log 2023-12-12T17:38:22.443 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.112675.log: /var/log/ceph/ceph-client.admin.47798.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48880.log 2023-12-12T17:38:22.443 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.401984.log: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.109861.log.gz 2023-12-12T17:38:22.445 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.216894.log 2023-12-12T17:38:22.446 INFO:teuthology.orchestra.run.smithi078.stderr: 85.2%/var/log/ceph/ceph-client.admin.48880.log: -- replaced with /var/log/ceph/ceph-client.admin.112675.log.gz 2023-12-12T17:38:22.448 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.350442.log 2023-12-12T17:38:22.449 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.340794.log 2023-12-12T17:38:22.451 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.350442.log: /var/log/ceph/ceph-client.admin.216894.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.244559.log 2023-12-12T17:38:22.452 INFO:teuthology.orchestra.run.smithi078.stderr: 96.6% -- replaced with /var/log/ceph/ceph-client.admin.498965.log.gz 2023-12-12T17:38:22.453 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.340794.log: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.189335.log.gz 2023-12-12T17:38:22.454 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.250349.log 2023-12-12T17:38:22.454 INFO:teuthology.orchestra.run.smithi078.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.191057.log.gz 2023-12-12T17:38:22.457 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.244559.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150402.log 2023-12-12T17:38:22.458 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.250349.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.312325.log.gz 2023-12-12T17:38:22.458 INFO:teuthology.orchestra.run.smithi078.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.313935.log.gz 2023-12-12T17:38:22.460 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.482429.log 2023-12-12T17:38:22.462 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.150402.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.494958.log 2023-12-12T17:38:22.465 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.482429.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47141.log 2023-12-12T17:38:22.465 INFO:teuthology.orchestra.run.smithi078.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.241712.log.gz 2023-12-12T17:38:22.466 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.494958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.355825.log 2023-12-12T17:38:22.469 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47141.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.411098.log 2023-12-12T17:38:22.471 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.355825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120143.log 2023-12-12T17:38:22.473 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.411098.log: 94.3% -- replaced with /var/log/ceph/ceph-client.admin.407277.log.gz 2023-12-12T17:38:22.474 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.403218.log 2023-12-12T17:38:22.476 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.120143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.436527.log 2023-12-12T17:38:22.477 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.403218.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.142902.log.gz 2023-12-12T17:38:22.478 INFO:teuthology.orchestra.run.smithi078.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45694.log.gz 2023-12-12T17:38:22.479 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.326690.log 2023-12-12T17:38:22.481 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.436527.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45493.log 2023-12-12T17:38:22.484 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.326690.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94805.log 2023-12-12T17:38:22.485 INFO:teuthology.orchestra.run.smithi078.stderr: 77.4% -- replaced with /var/log/ceph/ceph-client.admin.348709.log.gz 2023-12-12T17:38:22.486 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.45493.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.208427.log 2023-12-12T17:38:22.490 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.94805.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.392983.log 2023-12-12T17:38:22.491 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.208427.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.230781.log 2023-12-12T17:38:22.494 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.392983.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.415208.log 2023-12-12T17:38:22.495 INFO:teuthology.orchestra.run.smithi078.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.148704.log.gz 2023-12-12T17:38:22.495 INFO:teuthology.orchestra.run.smithi078.stderr: 78.5% -- replaced with /var/log/ceph/ceph-client.admin.177657.log.gz 2023-12-12T17:38:22.496 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.230781.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.248328.log 2023-12-12T17:38:22.497 INFO:teuthology.orchestra.run.smithi078.stderr: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.102051.log.gz 2023-12-12T17:38:22.499 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.415208.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.205955.log 2023-12-12T17:38:22.501 INFO:teuthology.orchestra.run.smithi078.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.323042.log.gz 2023-12-12T17:38:22.501 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47668.log 2023-12-12T17:38:22.502 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.248328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.338958.log 2023-12-12T17:38:22.505 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47668.log: /var/log/ceph/ceph-client.admin.205955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.520857.log 2023-12-12T17:38:22.505 INFO:teuthology.orchestra.run.smithi078.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.315154.log.gz 2023-12-12T17:38:22.508 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.338958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.233288.log 2023-12-12T17:38:22.508 INFO:teuthology.orchestra.run.smithi078.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.215283.log.gz 2023-12-12T17:38:22.509 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.520857.log: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.401161.log.gz 2023-12-12T17:38:22.511 INFO:teuthology.orchestra.run.smithi078.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.520857.log.gz 2023-12-12T17:38:22.512 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.340314.log 2023-12-12T17:38:22.514 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.213862.log 2023-12-12T17:38:22.515 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.233288.log: /var/log/ceph/ceph-client.admin.340314.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.218531.log.gz 2023-12-12T17:38:22.516 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96464.log 2023-12-12T17:38:22.519 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.213862.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103727.log 2023-12-12T17:38:22.522 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.96464.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.388321.log 2023-12-12T17:38:22.522 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.103727.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.244559.log.gz 2023-12-12T17:38:22.524 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111076.log 2023-12-12T17:38:22.524 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.388321.log: 79.6% -- replaced with /var/log/ceph/ceph-client.admin.104532.log.gz 84.1% 2023-12-12T17:38:22.525 INFO:teuthology.orchestra.run.smithi078.stderr: -- replaced with /var/log/ceph/ceph-client.admin.104935.log.gz 2023-12-12T17:38:22.526 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99988.log 2023-12-12T17:38:22.529 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.111076.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.455149.log 2023-12-12T17:38:22.530 INFO:teuthology.orchestra.run.smithi078.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.262358.log.gz 2023-12-12T17:38:22.533 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.99988.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122235.log 2023-12-12T17:38:22.536 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.455149.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.247121.log 2023-12-12T17:38:22.538 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.122235.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.373571.log 2023-12-12T17:38:22.539 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.247121.log: gzip -5 --verbose -- 85.2% -- replaced with /var/log/ceph/ceph-client.admin.349523.log.gz /var/log/ceph/ceph-client.admin.45708.log 2023-12-12T17:38:22.539 INFO:teuthology.orchestra.run.smithi078.stderr: 2023-12-12T17:38:22.541 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.373571.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.494958.log.gz 2023-12-12T17:38:22.541 INFO:teuthology.orchestra.run.smithi078.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.315561.log.gz 2023-12-12T17:38:22.543 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.408917.log 2023-12-12T17:38:22.547 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.45708.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.453077.log 2023-12-12T17:38:22.549 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.408917.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.376100.log 2023-12-12T17:38:22.551 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.413953.log 2023-12-12T17:38:22.553 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.376100.log: /var/log/ceph/ceph-client.admin.453077.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46489.log 2023-12-12T17:38:22.554 INFO:teuthology.orchestra.run.smithi078.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.115964.log.gz 2023-12-12T17:38:22.555 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.413953.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.329515.log 2023-12-12T17:38:22.558 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.400354.log 2023-12-12T17:38:22.561 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.46489.log: /var/log/ceph/ceph-client.admin.329515.log: 88.8% 89.3% -- replaced with /var/log/ceph/ceph-client.admin.48246.log.gz -- replaced with /var/log/ceph/ceph-client.admin.48589.log.gz 2023-12-12T17:38:22.561 INFO:teuthology.orchestra.run.smithi078.stderr: 2023-12-12T17:38:22.561 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.520375.log 2023-12-12T17:38:22.561 INFO:teuthology.orchestra.run.smithi078.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48880.log.gz 2023-12-12T17:38:22.562 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49673.log 2023-12-12T17:38:22.563 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.520375.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.520375.log.gz 2023-12-12T17:38:22.564 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.400354.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138744.log 2023-12-12T17:38:22.566 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.49673.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.208427.log.gz 2023-12-12T17:38:22.566 INFO:teuthology.orchestra.run.smithi078.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.218522.log.gz 2023-12-12T17:38:22.568 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184602.log 2023-12-12T17:38:22.568 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.250349.log.gz 2023-12-12T17:38:22.568 INFO:teuthology.orchestra.run.smithi078.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.340314.log.gz 2023-12-12T17:38:22.570 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.387436.log 2023-12-12T17:38:22.571 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.138744.log: /var/log/ceph/ceph-client.admin.184602.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.340794.log.gz 2023-12-12T17:38:22.571 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.445647.log 2023-12-12T17:38:22.573 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.387436.log: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.120143.log.gz 2023-12-12T17:38:22.574 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45342.log 2023-12-12T17:38:22.575 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.445647.log: 91.9% -- replaced with /var/log/ceph/ceph-client.admin.402393.log.gz 2023-12-12T17:38:22.577 INFO:teuthology.orchestra.run.smithi078.stderr:gzip 88.8% -5 -- replaced with /var/log/ceph/ceph-client.admin.45493.log.gz --verbose 2023-12-12T17:38:22.577 INFO:teuthology.orchestra.run.smithi078.stderr: -- /var/log/ceph/ceph-client.admin.517696.log 2023-12-12T17:38:22.578 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.45342.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45708.log.gz 2023-12-12T17:38:22.578 INFO:teuthology.orchestra.run.smithi078.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.47798.log.gz 2023-12-12T17:38:22.580 INFO:teuthology.orchestra.run.smithi078.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.436527.log.gz 2023-12-12T17:38:22.581 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.463932.log 2023-12-12T17:38:22.581 INFO:teuthology.orchestra.run.smithi078.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44400.log.gz 2023-12-12T17:38:22.581 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.517696.log: 83.5% -- replaced with /var/log/ceph/ceph-client.admin.517696.log.gz 2023-12-12T17:38:22.582 INFO:teuthology.orchestra.run.smithi078.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.248328.log.gz 80.8% 2023-12-12T17:38:22.583 INFO:teuthology.orchestra.run.smithi078.stderr: -- replaced with /var/log/ceph/ceph-client.admin.166869.log.gz 2023-12-12T17:38:22.584 INFO:teuthology.orchestra.run.smithi078.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.111076.log.gz 2023-12-12T17:38:22.585 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186331.log 2023-12-12T17:38:22.590 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.463932.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.194325.log.gz 2023-12-12T17:38:22.590 INFO:teuthology.orchestra.run.smithi078.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.426371.log.gz 2023-12-12T17:38:22.591 INFO:teuthology.orchestra.run.smithi078.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.197135.log.gz 2023-12-12T17:38:22.591 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.520323.log 2023-12-12T17:38:22.591 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.198346.log 2023-12-12T17:38:22.593 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.520323.log: /var/log/ceph/ceph-client.admin.186331.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.520323.log.gz 2023-12-12T17:38:22.595 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.380474.log 2023-12-12T17:38:22.595 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105336.log 2023-12-12T17:38:22.598 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.198346.log: /var/log/ceph/ceph-client.admin.380474.log: 83.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.247121.log.gz -5 2023-12-12T17:38:22.598 INFO:teuthology.orchestra.run.smithi078.stderr: --verbose -- /var/log/ceph/ceph-client.admin.446477.log 2023-12-12T17:38:22.600 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.105336.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.233288.log.gz 2023-12-12T17:38:22.600 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.316767.log 2023-12-12T17:38:22.601 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109057.log 2023-12-12T17:38:22.602 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.446477.log: /var/log/ceph/ceph-client.admin.316767.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.376100.log.gz 2023-12-12T17:38:22.603 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48194.log 2023-12-12T17:38:22.604 INFO:teuthology.orchestra.run.smithi078.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.99988.log.gz 2023-12-12T17:38:22.606 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.109057.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.397116.log 2023-12-12T17:38:22.608 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.48194.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182916.log 2023-12-12T17:38:22.610 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.397116.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.235604.log 2023-12-12T17:38:22.612 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.308277.log 2023-12-12T17:38:22.613 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.235604.log: /var/log/ceph/ceph-client.admin.182916.log: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.453077.log.gz 2023-12-12T17:38:22.618 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.208820.log 2023-12-12T17:38:22.619 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.308277.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.344177.log 2023-12-12T17:38:22.622 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.264954.log 2023-12-12T17:38:22.623 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.208820.log: /var/log/ceph/ceph-client.admin.344177.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-12-12T17:38:22.626 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.264954.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.339391.log 2023-12-12T17:38:22.628 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.507496.log 2023-12-12T17:38:22.630 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-osd.1.log: /var/log/ceph/ceph-client.admin.339391.log: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.387436.log.gz 2023-12-12T17:38:22.632 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45077.log 2023-12-12T17:38:22.634 INFO:teuthology.orchestra.run.smithi078.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.382133.log.gz 2023-12-12T17:38:22.635 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.507496.log: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.507496.log.gz 2023-12-12T17:38:22.635 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.327493.log 2023-12-12T17:38:22.639 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.45077.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44560.log 2023-12-12T17:38:22.640 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.327493.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.202155.log 2023-12-12T17:38:22.641 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.44560.log: 79.3% -- replaced with /var/log/ceph/ceph-client.admin.446477.log.gz 2023-12-12T17:38:22.641 INFO:teuthology.orchestra.run.smithi078.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.445647.log.gz 2023-12-12T17:38:22.641 INFO:teuthology.orchestra.run.smithi078.stderr: 77.4% -- replaced with /var/log/ceph/ceph-client.admin.460656.log.gz 2023-12-12T17:38:22.642 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.479966.log 2023-12-12T17:38:22.643 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.318400.log 2023-12-12T17:38:22.643 INFO:teuthology.orchestra.run.smithi078.stderr: 92.8% -- replaced with /var/log/ceph/ceph-client.admin.469851.log.gz 2023-12-12T17:38:22.645 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.479966.log: 77.6% -- replaced with /var/log/ceph/ceph-client.admin.482429.log.gz 2023-12-12T17:38:22.646 INFO:teuthology.orchestra.run.smithi078.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.431121.log.gz 2023-12-12T17:38:22.646 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.202155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46722.log 2023-12-12T17:38:22.646 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.398336.log 2023-12-12T17:38:22.649 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.0.46722.log: /var/log/ceph/ceph-client.admin.318400.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46927.log 2023-12-12T17:38:22.650 INFO:teuthology.orchestra.run.smithi078.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.415208.log.gz 2023-12-12T17:38:22.652 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.398336.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.213439.log 2023-12-12T17:38:22.654 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.429027.log 2023-12-12T17:38:22.658 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.46927.log: /var/log/ceph/ceph-client.admin.213439.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.475178.log 2023-12-12T17:38:22.660 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.408515.log 2023-12-12T17:38:22.664 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.429027.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.249545.log 2023-12-12T17:38:22.664 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.475178.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.240504.log 2023-12-12T17:38:22.665 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.249545.log: /var/log/ceph/ceph-client.admin.408515.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.318391.log 2023-12-12T17:38:22.666 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195924.log 2023-12-12T17:38:22.669 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.318391.log: /var/log/ceph/ceph-client.admin.240504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144646.log 2023-12-12T17:38:22.670 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.510012.log 2023-12-12T17:38:22.672 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.195924.log: /var/log/ceph/ceph-client.admin.144646.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.316767.log.gz 2023-12-12T17:38:22.673 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.353057.log 2023-12-12T17:38:22.676 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.430687.log 2023-12-12T17:38:22.677 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.510012.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.510012.log.gz 2023-12-12T17:38:22.678 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.373989.log 2023-12-12T17:38:22.679 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.353057.log: /var/log/ceph/ceph-client.admin.430687.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45908.log 2023-12-12T17:38:22.682 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.373989.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.252359.log 2023-12-12T17:38:22.686 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.398739.log 2023-12-12T17:38:22.687 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.45908.log: /var/log/ceph/ceph-client.admin.252359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.389153.log 2023-12-12T17:38:22.689 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.398739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38242.log 2023-12-12T17:38:22.690 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.389153.log: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.220140.log.gz 2023-12-12T17:38:22.691 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.488893.log 2023-12-12T17:38:22.693 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.38242.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.409324.log 2023-12-12T17:38:22.695 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.433142.log 2023-12-12T17:38:22.697 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.488893.log: /var/log/ceph/ceph-client.admin.409324.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.416240.log 2023-12-12T17:38:22.698 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.433142.log: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.117658.log.gz 2023-12-12T17:38:22.700 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.251950.log 2023-12-12T17:38:22.702 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.238071.log 2023-12-12T17:38:22.702 INFO:teuthology.orchestra.run.smithi078.stderr: 96.7% -- replaced with /var/log/ceph/ceph-client.admin.499871.log.gz 2023-12-12T17:38:22.704 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.416240.log: /var/log/ceph/ceph-client.admin.251950.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102473.log 2023-12-12T17:38:22.707 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.238071.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90186.log 2023-12-12T17:38:22.708 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.397523.log 2023-12-12T17:38:22.712 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.90186.log: /var/log/ceph/ceph-client.admin.102473.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93938.log 2023-12-12T17:38:22.712 INFO:teuthology.orchestra.run.smithi078.stderr: 94.4% -- replaced with /var/log/ceph/ceph-client.admin.174931.log.gz 2023-12-12T17:38:22.714 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.397523.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.446050.log 2023-12-12T17:38:22.717 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.93938.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.394220.log 2023-12-12T17:38:22.719 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.261931.log 2023-12-12T17:38:22.722 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.446050.log: /var/log/ceph/ceph-client.admin.394220.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.520594.log 2023-12-12T17:38:22.724 INFO:teuthology.orchestra.run.smithi078.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.184602.log.gz 2023-12-12T17:38:22.726 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.261931.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.235604.log.gz 2023-12-12T17:38:22.726 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.224690.log 2023-12-12T17:38:22.727 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.202155.log.gz 2023-12-12T17:38:22.727 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.520594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.321836.log 2023-12-12T17:38:22.729 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.224690.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.520594.log.gz 2023-12-12T17:38:22.730 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.347502.log 2023-12-12T17:38:22.733 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.321836.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.446945.log 2023-12-12T17:38:22.735 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.329092.log 2023-12-12T17:38:22.737 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.347502.log: /var/log/ceph/ceph-client.admin.446945.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.230781.log.gz 2023-12-12T17:38:22.738 INFO:teuthology.orchestra.run.smithi078.stderr:gzip 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45342.log.gz 2023-12-12T17:38:22.738 INFO:teuthology.orchestra.run.smithi078.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.468633.log 2023-12-12T17:38:22.739 INFO:teuthology.orchestra.run.smithi078.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46279.log.gz 2023-12-12T17:38:22.740 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.329092.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.46253.log.gz 2023-12-12T17:38:22.740 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.330316.log 2023-12-12T17:38:22.741 INFO:teuthology.orchestra.run.smithi078.stderr: 80.5%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.344177.log.gz --verbose -- 2023-12-12T17:38:22.741 INFO:teuthology.orchestra.run.smithi078.stderr: /var/log/ceph/ceph-client.admin.352602.log 2023-12-12T17:38:22.743 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.330316.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.44560.log.gz 2023-12-12T17:38:22.743 INFO:teuthology.orchestra.run.smithi078.stderr: 89.5%/var/log/ceph/ceph-client.admin.468633.log: -- replaced with /var/log/ceph/ceph-client.admin.38242.log.gz 2023-12-12T17:38:22.743 INFO:teuthology.orchestra.run.smithi078.stderr: 84.5% -- replaced with /var/log/ceph/ceph-client.admin.109057.log.gz 2023-12-12T17:38:22.744 INFO:teuthology.orchestra.run.smithi078.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45077.log.gz 2023-12-12T17:38:22.744 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.210026.log 2023-12-12T17:38:22.745 INFO:teuthology.orchestra.run.smithi078.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.112684.log.gz 2023-12-12T17:38:22.747 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.352602.log: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.244143.log.gzgzip 2023-12-12T17:38:22.747 INFO:teuthology.orchestra.run.smithi078.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.489699.log 2023-12-12T17:38:22.748 INFO:teuthology.orchestra.run.smithi078.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.238071.log.gz 2023-12-12T17:38:22.750 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.210026.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.520297.log 2023-12-12T17:38:22.753 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.327895.log.gz 2023-12-12T17:38:22.753 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.489699.log: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.456848.log.gz 2023-12-12T17:38:22.753 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.210433.log 2023-12-12T17:38:22.754 INFO:teuthology.orchestra.run.smithi078.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.327493.log.gz 2023-12-12T17:38:22.754 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192706.log 2023-12-12T17:38:22.755 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.210433.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.329515.log.gz 2023-12-12T17:38:22.756 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.520297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88795.log 2023-12-12T17:38:22.759 INFO:teuthology.orchestra.run.smithi078.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.520297.log.gz 2023-12-12T17:38:22.759 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.200026.log 2023-12-12T17:38:22.760 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.192706.log: /var/log/ceph/ceph-client.admin.88795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.202548.log 2023-12-12T17:38:22.762 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.200026.log: 79.5% -- replaced with /var/log/ceph/ceph-client.admin.144646.log.gz 2023-12-12T17:38:22.763 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.403630.log 2023-12-12T17:38:22.763 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.202548.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.232071.log 2023-12-12T17:38:22.766 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.403630.log: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.355330.log.gz 2023-12-12T17:38:22.767 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.520987.log 2023-12-12T17:38:22.769 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.232071.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150009.log 2023-12-12T17:38:22.770 INFO:teuthology.orchestra.run.smithi078.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.198346.log.gz 2023-12-12T17:38:22.770 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.520987.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.520987.log.gz 2023-12-12T17:38:22.770 INFO:teuthology.orchestra.run.smithi078.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.473924.log.gz 2023-12-12T17:38:22.770 INFO:teuthology.orchestra.run.smithi078.stderr: 77.6% -- replaced with /var/log/ceph/ceph-client.admin.479966.log.gz 2023-12-12T17:38:22.771 INFO:teuthology.orchestra.run.smithi078.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.431524.log.gz 2023-12-12T17:38:22.772 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.417034.log 2023-12-12T17:38:22.772 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.433142.log.gz 2023-12-12T17:38:22.772 INFO:teuthology.orchestra.run.smithi078.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.382533.log.gz 2023-12-12T17:38:22.774 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.464787.log 2023-12-12T17:38:22.774 INFO:teuthology.orchestra.run.smithi078.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.405654.log.gz 2023-12-12T17:38:22.775 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.150009.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179002.log 2023-12-12T17:38:22.775 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.398739.log.gz 2023-12-12T17:38:22.778 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.464787.log: /var/log/ceph/ceph-client.admin.417034.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.262812.log 2023-12-12T17:38:22.780 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.179002.log: 77.4% -- replaced with /var/log/ceph/ceph-client.admin.308277.log.gz 2023-12-12T17:38:22.780 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.507089.log 2023-12-12T17:38:22.782 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.262812.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190195.log 2023-12-12T17:38:22.782 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.507089.log: 77.6% -- replaced with /var/log/ceph/ceph-client.admin.507089.log.gz 2023-12-12T17:38:22.783 INFO:teuthology.orchestra.run.smithi078.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.105336.log.gz 2023-12-12T17:38:22.784 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45155.log 2023-12-12T17:38:22.786 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103307.log 2023-12-12T17:38:22.788 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.190195.log: /var/log/ceph/ceph-client.admin.45155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46097.log 2023-12-12T17:38:22.791 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.103307.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118915.log 2023-12-12T17:38:22.792 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.46097.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.95256.log.gz 2023-12-12T17:38:22.793 INFO:teuthology.orchestra.run.smithi078.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.138744.log.gz 2023-12-12T17:38:22.793 INFO:teuthology.orchestra.run.smithi078.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.373571.log.gz 2023-12-12T17:38:22.793 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.514693.log 2023-12-12T17:38:22.795 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.373989.log.gz 2023-12-12T17:38:22.795 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.238478.log 2023-12-12T17:38:22.796 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.118915.log: /var/log/ceph/ceph-client.admin.514693.log: 79.9% -- replaced with /var/log/ceph/ceph-client.admin.514693.log.gz 2023-12-12T17:38:22.797 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.477587.log 2023-12-12T17:38:22.800 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48432.log 2023-12-12T17:38:22.802 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.238478.log: /var/log/ceph/ceph-client.admin.477587.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.234564.log 2023-12-12T17:38:22.804 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45129.log 2023-12-12T17:38:22.806 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.234564.log: /var/log/ceph/ceph-client.admin.48432.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185041.log 2023-12-12T17:38:22.807 INFO:teuthology.orchestra.run.smithi078.stderr: 77.5% -- replaced with /var/log/ceph/ceph-client.admin.453479.log.gz 2023-12-12T17:38:22.808 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.520498.log 2023-12-12T17:38:22.811 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.45129.log: /var/log/ceph/ceph-client.admin.185041.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.354853.log 2023-12-12T17:38:22.814 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.520498.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.520271.log 2023-12-12T17:38:22.814 INFO:teuthology.orchestra.run.smithi078.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.520498.log.gz 2023-12-12T17:38:22.817 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.354853.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.222615.log 2023-12-12T17:38:22.818 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.266159.log 2023-12-12T17:38:22.822 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.520271.log: /var/log/ceph/ceph-client.admin.222615.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.520271.log.gz 2023-12-12T17:38:22.822 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.208016.log 2023-12-12T17:38:22.824 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.266159.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.326690.log.gz 2023-12-12T17:38:22.824 INFO:teuthology.orchestra.run.smithi078.stderr: 78.0% -- replaced with /var/log/ceph/ceph-client.admin.329092.log.gz 2023-12-12T17:38:22.824 INFO:teuthology.orchestra.run.smithi078.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.330316.log.gz 2023-12-12T17:38:22.824 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141678.log 2023-12-12T17:38:22.827 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.208016.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105345.log 2023-12-12T17:38:22.829 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.141678.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.460254.log 2023-12-12T17:38:22.830 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.439405.log 2023-12-12T17:38:22.833 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.460254.log: /var/log/ceph/ceph-client.admin.105345.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193512.log 2023-12-12T17:38:22.835 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.439405.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182907.log 2023-12-12T17:38:22.837 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.193512.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.449788.log 2023-12-12T17:38:22.838 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45912.log 2023-12-12T17:38:22.840 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.449788.log: /var/log/ceph/ceph-client.admin.182907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.408506.log 2023-12-12T17:38:22.842 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.45912.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.342128.log 2023-12-12T17:38:22.845 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.408506.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.320546.log 2023-12-12T17:38:22.845 INFO:teuthology.orchestra.run.smithi078.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.117263.log.gz 2023-12-12T17:38:22.845 INFO:teuthology.orchestra.run.smithi078.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.118915.log.gz 2023-12-12T17:38:22.847 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.342128.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.457765.log 2023-12-12T17:38:22.849 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.320546.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89283.log 2023-12-12T17:38:22.850 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.507920.log 2023-12-12T17:38:22.852 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.457765.log: /var/log/ceph/ceph-client.admin.89283.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.494967.log 2023-12-12T17:38:22.854 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.507920.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.415832.log 2023-12-12T17:38:22.855 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.210035.log 2023-12-12T17:38:22.856 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.494967.log: /var/log/ceph/ceph-client.admin.415832.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.507920.log.gz 2023-12-12T17:38:22.858 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.216482.log 2023-12-12T17:38:22.860 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.210035.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.344186.log 2023-12-12T17:38:22.862 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.216482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.205964.log 2023-12-12T17:38:22.864 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.344186.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44812.log 2023-12-12T17:38:22.865 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102895.log 2023-12-12T17:38:22.865 INFO:teuthology.orchestra.run.smithi078.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.205955.log.gz 2023-12-12T17:38:22.867 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.44812.log: /var/log/ceph/ceph-client.admin.205964.log: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.208016.log.gz 2023-12-12T17:38:22.868 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.390584.log 2023-12-12T17:38:22.870 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.102895.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46227.log 2023-12-12T17:38:22.871 INFO:teuthology.orchestra.run.smithi078.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.266159.log.gz 2023-12-12T17:38:22.874 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.390584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.209633.log 2023-12-12T17:38:22.874 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.223413.log 2023-12-12T17:38:22.875 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.46227.log: /var/log/ceph/ceph-client.admin.209633.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.342128.log.gz 2023-12-12T17:38:22.876 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.404042.log 2023-12-12T17:38:22.879 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.223413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49166.log 2023-12-12T17:38:22.880 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119323.log 2023-12-12T17:38:22.883 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.404042.log: /var/log/ceph/ceph-client.admin.49166.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.121828.log.gz 2023-12-12T17:38:22.883 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.179002.log.gz 2023-12-12T17:38:22.884 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176269.log 2023-12-12T17:38:22.884 INFO:teuthology.orchestra.run.smithi078.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.122235.log.gz 2023-12-12T17:38:22.885 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48300.log 2023-12-12T17:38:22.885 INFO:teuthology.orchestra.run.smithi078.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.408506.log.gz 2023-12-12T17:38:22.885 INFO:teuthology.orchestra.run.smithi078.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.340323.log.gz 2023-12-12T17:38:22.886 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.119323.log: /var/log/ceph/ceph-client.admin.176269.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45497.log 2023-12-12T17:38:22.887 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.48300.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45912.log.gz 2023-12-12T17:38:22.888 INFO:teuthology.orchestra.run.smithi078.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.408515.log.gz 2023-12-12T17:38:22.888 INFO:teuthology.orchestra.run.smithi078.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.96464.log.gz 2023-12-12T17:38:22.888 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.408917.log.gz 2023-12-12T17:38:22.889 INFO:teuthology.orchestra.run.smithi078.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.468240.log.gz 2023-12-12T17:38:22.889 INFO:teuthology.orchestra.run.smithi078.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.113483.log.gz 2023-12-12T17:38:22.889 INFO:teuthology.orchestra.run.smithi078.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.468633.log.gz 2023-12-12T17:38:22.890 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.514268.log 2023-12-12T17:38:22.890 INFO:teuthology.orchestra.run.smithi078.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.213862.log.gz 2023-12-12T17:38:22.891 INFO:teuthology.orchestra.run.smithi078.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.190195.log.gz 2023-12-12T17:38:22.891 INFO:teuthology.orchestra.run.smithi078.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.150009.log.gz 2023-12-12T17:38:22.892 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.45497.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103736.log 2023-12-12T17:38:22.893 INFO:teuthology.orchestra.run.smithi078.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.238478.log.gz 2023-12-12T17:38:22.894 INFO:teuthology.orchestra.run.smithi078.stderr: 77.9% -- replaced with /var/log/ceph/ceph-client.admin.234564.log.gz 2023-12-12T17:38:22.895 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.226731.log 2023-12-12T17:38:22.895 INFO:teuthology.orchestra.run.smithi078.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.105345.log.gz 2023-12-12T17:38:22.897 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.514268.log: /var/log/ceph/ceph-client.admin.103736.log: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.514268.log.gz 2023-12-12T17:38:22.897 INFO:teuthology.orchestra.run.smithi078.stderr: 78.4% -- replaced with /var/log/ceph/ceph-client.admin.216482.log.gz 2023-12-12T17:38:22.897 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.203359.log 2023-12-12T17:38:22.899 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.226731.log: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.355825.log.gz 2023-12-12T17:38:22.899 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.506687.log 2023-12-12T17:38:22.899 INFO:teuthology.orchestra.run.smithi078.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.232071.log.gz 2023-12-12T17:38:22.900 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186761.log 2023-12-12T17:38:22.902 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.506687.log: /var/log/ceph/ceph-client.admin.203359.log: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.506687.log.gz 2023-12-12T17:38:22.902 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.176269.log.gz 2023-12-12T17:38:22.903 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.493717.log 2023-12-12T17:38:22.903 INFO:teuthology.orchestra.run.smithi078.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.424754.log.gz 2023-12-12T17:38:22.904 INFO:teuthology.orchestra.run.smithi078.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.415832.log.gz 2023-12-12T17:38:22.905 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.186761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.249143.log 2023-12-12T17:38:22.907 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.493717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.454332.log 2023-12-12T17:38:22.907 INFO:teuthology.orchestra.run.smithi187.stderr: 94.7% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2023-12-12T17:38:22.908 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.249143.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.321434.log.gz 2023-12-12T17:38:22.909 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.221391.log 2023-12-12T17:38:22.912 INFO:teuthology.orchestra.run.smithi078.stderr: 84.2% 80.7% -- replaced with /var/log/ceph/ceph-client.admin.88795.log.gz -- replaced with /var/log/ceph/ceph-client.admin.89283.log.gz 2023-12-12T17:38:22.912 INFO:teuthology.orchestra.run.smithi078.stderr: 2023-12-12T17:38:22.912 INFO:teuthology.orchestra.run.smithi078.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.489699.log.gz 2023-12-12T17:38:22.913 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.454332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142893.log 2023-12-12T17:38:22.914 INFO:teuthology.orchestra.run.smithi078.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45155.log.gz 2023-12-12T17:38:22.915 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.221391.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45129.log.gz 2023-12-12T17:38:22.916 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.343771.log 2023-12-12T17:38:22.919 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.142893.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49790.log 2023-12-12T17:38:22.920 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.486473.log 2023-12-12T17:38:22.922 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.343771.log: /var/log/ceph/ceph-client.admin.49790.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.255247.log 2023-12-12T17:38:22.924 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.486473.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89741.log 2023-12-12T17:38:22.926 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.465590.log 2023-12-12T17:38:22.927 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.255247.log: /var/log/ceph/ceph-client.admin.89741.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.236410.log.gz 2023-12-12T17:38:22.928 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.230772.log 2023-12-12T17:38:22.931 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.465590.log: 78.3% -- replaced with /var/log/ceph/ceph-client.admin.88381.log.gz 2023-12-12T17:38:22.932 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.487676.log 2023-12-12T17:38:22.933 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.264547.log 2023-12-12T17:38:22.934 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.487676.log: /var/log/ceph/ceph-client.admin.230772.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48012.log 2023-12-12T17:38:22.938 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.264547.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.486877.log 2023-12-12T17:38:22.939 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166878.log 2023-12-12T17:38:22.942 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.48012.log: /var/log/ceph/ceph-client.admin.486877.log: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.119323.log.gz 2023-12-12T17:38:22.942 INFO:teuthology.orchestra.run.smithi078.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.429429.log.gzgzip 2023-12-12T17:38:22.942 INFO:teuthology.orchestra.run.smithi078.stderr: 80.8% -5 -- replaced with /var/log/ceph/ceph-client.admin.413953.log.gz 2023-12-12T17:38:22.943 INFO:teuthology.orchestra.run.smithi078.stderr: --verbose -- /var/log/ceph/ceph-client.admin.178189.log 2023-12-12T17:38:22.944 INFO:teuthology.orchestra.run.smithi078.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48194.log.gz 2023-12-12T17:38:22.945 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.166878.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.48300.log.gz 2023-12-12T17:38:22.945 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.247533.log 2023-12-12T17:38:22.946 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.178189.log: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.449788.log.gz 2023-12-12T17:38:22.946 INFO:teuthology.orchestra.run.smithi078.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49166.log.gz 2023-12-12T17:38:22.946 INFO:teuthology.orchestra.run.smithi078.stderr: 79.8% -- replaced with /var/log/ceph/ceph-client.admin.202146.log.gz 2023-12-12T17:38:22.946 INFO:teuthology.orchestra.run.smithi078.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.209633.log.gz 2023-12-12T17:38:22.948 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 90.1% -- replaced with /var/log/ceph/ceph-client.admin.203359.log.gz 2023-12-12T17:38:22.949 INFO:teuthology.orchestra.run.smithi078.stderr: --verbose -- /var/log/ceph/ceph-client.admin.108650.log 2023-12-12T17:38:22.953 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.247533.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142491.log 2023-12-12T17:38:22.956 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.108650.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49062.log 2023-12-12T17:38:22.957 INFO:teuthology.orchestra.run.smithi078.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.251950.log.gz 2023-12-12T17:38:22.959 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.142491.log: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.390584.log.gz 2023-12-12T17:38:22.959 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 81.3% --verbose -- replaced with /var/log/ceph/ceph-client.admin.347502.log.gz -- 2023-12-12T17:38:22.959 INFO:teuthology.orchestra.run.smithi078.stderr: /var/log/ceph/ceph-client.admin.187622.log 2023-12-12T17:38:22.960 INFO:teuthology.orchestra.run.smithi078.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.493717.log.gz 2023-12-12T17:38:22.961 INFO:teuthology.orchestra.run.smithi078.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.392983.log.gz 2023-12-12T17:38:22.962 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.49062.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.497720.log 2023-12-12T17:38:22.962 INFO:teuthology.orchestra.run.smithi078.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.388321.log.gz 2023-12-12T17:38:22.963 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.187622.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45497.log.gz 2023-12-12T17:38:22.964 INFO:teuthology.orchestra.run.smithi078.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.226731.log.gz 2023-12-12T17:38:22.965 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118924.log 2023-12-12T17:38:22.967 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.199165.log 2023-12-12T17:38:22.968 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.497720.log: /var/log/ceph/ceph-client.admin.118924.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47668.log.gz 2023-12-12T17:38:22.970 INFO:teuthology.orchestra.run.smithi078.stderr: 80.1% -- replaced with /var/log/ceph/ceph-client.admin.103727.log.gz 2023-12-12T17:38:22.970 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.249545.log.gz 2023-12-12T17:38:22.970 INFO:teuthology.orchestra.run.smithi078.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.200026.log.gz 2023-12-12T17:38:22.971 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.199165.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47141.log.gz 2023-12-12T17:38:22.971 INFO:teuthology.orchestra.run.smithi078.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.497720.log.gz 2023-12-12T17:38:22.972 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.243336.log 2023-12-12T17:38:22.972 INFO:teuthology.orchestra.run.smithi078.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.166878.log.gz 2023-12-12T17:38:22.972 INFO:teuthology.orchestra.run.smithi078.stderr: 80.9% 90.0% -- replaced with /var/log/ceph/ceph-client.admin.103736.log.gz -- replaced with /var/log/ceph/ceph-client.admin.221391.log.gz 2023-12-12T17:38:22.972 INFO:teuthology.orchestra.run.smithi078.stderr: 2023-12-12T17:38:22.975 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169707.log 2023-12-12T17:38:22.976 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.243336.log: 92.7% -- replaced with /var/log/ceph/ceph-client.admin.44812.log.gz 2023-12-12T17:38:22.978 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.517705.log 2023-12-12T17:38:22.981 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.169707.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.247130.log 2023-12-12T17:38:22.983 INFO:teuthology.orchestra.run.smithi078.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.353057.log.gz 2023-12-12T17:38:22.983 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87979.log 2023-12-12T17:38:22.984 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.517705.log: /var/log/ceph/ceph-client.admin.247130.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.378197.log 2023-12-12T17:38:22.986 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.87979.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.242933.log 2023-12-12T17:38:22.987 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.378197.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.330780.log 2023-12-12T17:38:22.989 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.242933.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.427209.log 2023-12-12T17:38:22.991 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.330780.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.247130.log.gz 2023-12-12T17:38:22.992 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.490906.log 2023-12-12T17:38:22.992 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.249143.log.gz 2023-12-12T17:38:22.994 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148270.log 2023-12-12T17:38:22.995 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.427209.log: /var/log/ceph/ceph-client.admin.490906.log: 92.7% -- replaced with /var/log/ceph/ceph-client.admin.517705.log.gz 2023-12-12T17:38:22.996 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.450602.log 2023-12-12T17:38:22.999 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.148270.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.431922.log 2023-12-12T17:38:23.000 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.450602.log: -- /var/log/ceph/ceph-client.admin.45051.log 2023-12-12T17:38:23.003 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.431922.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195933.log 2023-12-12T17:38:23.006 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.45051.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.344588.log 2023-12-12T17:38:23.007 INFO:teuthology.orchestra.run.smithi078.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.350908.log.gz 2023-12-12T17:38:23.009 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.195933.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.334023.log.gz 2023-12-12T17:38:23.009 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.416240.log.gz 2023-12-12T17:38:23.010 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184611.log 2023-12-12T17:38:23.011 INFO:teuthology.orchestra.run.smithi078.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.427209.log.gz 2023-12-12T17:38:23.014 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.344588.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.434355.log 2023-12-12T17:38:23.016 INFO:teuthology.orchestra.run.smithi078.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.429827.log.gz 2023-12-12T17:38:23.017 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.184611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103298.log 2023-12-12T17:38:23.017 INFO:teuthology.orchestra.run.smithi078.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.454332.log.gz 2023-12-12T17:38:23.020 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.434355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.459861.log 2023-12-12T17:38:23.021 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.103298.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.334425.log 2023-12-12T17:38:23.026 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.459861.log: 96.8% -- replaced with /var/log/ceph/ceph-client.admin.499435.log.gz 2023-12-12T17:38:23.026 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.219729.log 2023-12-12T17:38:23.026 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.485263.log 2023-12-12T17:38:23.028 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.334425.log: /var/log/ceph/ceph-client.admin.219729.log: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.243734.log.gz 2023-12-12T17:38:23.029 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.225636.log 2023-12-12T17:38:23.031 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.485263.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.430678.log 2023-12-12T17:38:23.033 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.225636.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45889.log 2023-12-12T17:38:23.034 INFO:teuthology.orchestra.run.smithi078.stderr: 77.5% -- replaced with /var/log/ceph/ceph-client.admin.397523.log.gz 2023-12-12T17:38:23.035 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.430678.log: 78.9% -- replaced with /var/log/ceph/ceph-client.admin.142893.log.gz 2023-12-12T17:38:23.035 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.395474.log 2023-12-12T17:38:23.036 INFO:teuthology.orchestra.run.smithi078.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.398336.log.gz 2023-12-12T17:38:23.037 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.45889.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176677.log 2023-12-12T17:38:23.039 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.395474.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.232466.log.gz 2023-12-12T17:38:23.040 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.390232.log 2023-12-12T17:38:23.041 INFO:teuthology.orchestra.run.smithi078.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.178189.log.gz 2023-12-12T17:38:23.042 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.176677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.416231.log 2023-12-12T17:38:23.044 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.390232.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.340785.log 2023-12-12T17:38:23.046 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.416231.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.213430.log 2023-12-12T17:38:23.048 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.340785.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.397934.log 2023-12-12T17:38:23.049 INFO:teuthology.orchestra.run.smithi078.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.400354.log.gz 2023-12-12T17:38:23.050 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.213430.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.379662.log 2023-12-12T17:38:23.052 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.397934.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.345468.log 2023-12-12T17:38:23.054 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.379662.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49262.log 2023-12-12T17:38:23.056 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.345468.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.237669.log 2023-12-12T17:38:23.058 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.49262.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177140.log 2023-12-12T17:38:23.061 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.237669.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.209231.log 2023-12-12T17:38:23.063 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.177140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47635.log 2023-12-12T17:38:23.065 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.209231.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.452280.log 2023-12-12T17:38:23.066 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.396683.log 2023-12-12T17:38:23.066 INFO:teuthology.orchestra.run.smithi078.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.485263.log.gz 2023-12-12T17:38:23.069 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.452280.log: /var/log/ceph/ceph-client.admin.47635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48380.log 2023-12-12T17:38:23.071 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.396683.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.374455.log 2023-12-12T17:38:23.073 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.48380.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.461461.log 2023-12-12T17:38:23.077 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.374455.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.517251.log 2023-12-12T17:38:23.078 INFO:teuthology.orchestra.run.smithi078.stderr: 77.6% -- replaced with /var/log/ceph/ceph-client.admin.324274.log.gz 2023-12-12T17:38:23.078 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.467427.log 2023-12-12T17:38:23.078 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.461461.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.330780.log.gz 2023-12-12T17:38:23.081 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.202557.log 2023-12-12T17:38:23.082 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.467427.log: /var/log/ceph/ceph-client.admin.517251.log: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.517251.log.gz 2023-12-12T17:38:23.082 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.244550.log 2023-12-12T17:38:23.084 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.202557.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.508322.log 2023-12-12T17:38:23.086 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.244550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187613.log 2023-12-12T17:38:23.089 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.508322.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.461067.log 2023-12-12T17:38:23.091 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.374446.log 2023-12-12T17:38:23.093 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.187613.log: /var/log/ceph/ceph-client.admin.461067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.395872.log 2023-12-12T17:38:23.094 INFO:teuthology.orchestra.run.smithi078.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.48432.log.gz 2023-12-12T17:38:23.095 INFO:teuthology.orchestra.run.smithi078.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49062.log.gz 2023-12-12T17:38:23.096 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.502429.log 2023-12-12T17:38:23.097 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.374446.log: /var/log/ceph/ceph-client.admin.395872.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.352199.log 2023-12-12T17:38:23.099 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.502429.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.502429.log.gz 2023-12-12T17:38:23.100 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.437360.log 2023-12-12T17:38:23.101 INFO:teuthology.orchestra.run.smithi078.stderr: 79.3% -- replaced with /var/log/ceph/ceph-client.admin.142491.log.gz 2023-12-12T17:38:23.102 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.209231.log.gz 2023-12-12T17:38:23.103 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.338153.log 2023-12-12T17:38:23.103 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.352199.log: /var/log/ceph/ceph-client.admin.437360.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.202557.log.gz 2023-12-12T17:38:23.104 INFO:teuthology.orchestra.run.smithi078.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.102473.log.gz 2023-12-12T17:38:23.105 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.326681.log 2023-12-12T17:38:23.108 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.338153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.490495.log 2023-12-12T17:38:23.110 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189774.log 2023-12-12T17:38:23.113 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.326681.log: /var/log/ceph/ceph-client.admin.490495.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.486877.log.gz 2023-12-12T17:38:23.113 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.198355.log 2023-12-12T17:38:23.114 INFO:teuthology.orchestra.run.smithi078.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.340785.log.gz 2023-12-12T17:38:23.115 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.189774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47427.log 2023-12-12T17:38:23.115 INFO:teuthology.orchestra.run.smithi078.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.339391.log.gz 2023-12-12T17:38:23.119 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.198355.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.395872.log.gz 2023-12-12T17:38:23.119 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.518574.log 2023-12-12T17:38:23.119 INFO:teuthology.orchestra.run.smithi078.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.396683.log.gz 2023-12-12T17:38:23.120 INFO:teuthology.orchestra.run.smithi078.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.395474.log.gz 2023-12-12T17:38:23.121 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.508313.log 2023-12-12T17:38:23.121 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47427.log: /var/log/ceph/ceph-client.admin.518574.log: 79.8% -- replaced with /var/log/ceph/ceph-client.admin.518574.log.gz 2023-12-12T17:38:23.123 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.204154.log 2023-12-12T17:38:23.123 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.508313.log: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.508313.log.gz 2023-12-12T17:38:23.126 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104944.log 2023-12-12T17:38:23.127 INFO:teuthology.orchestra.run.smithi078.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47427.log.gz 2023-12-12T17:38:23.128 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.204154.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49673.log.gz 2023-12-12T17:38:23.129 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89292.log 2023-12-12T17:38:23.129 INFO:teuthology.orchestra.run.smithi078.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.87979.log.gz 2023-12-12T17:38:23.131 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.493323.log 2023-12-12T17:38:23.132 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.104944.log: /var/log/ceph/ceph-client.admin.89292.log: 84.4% -- replaced with /var/log/ceph/ceph-client.admin.225636.log.gz 2023-12-12T17:38:23.133 INFO:teuthology.orchestra.run.smithi078.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.186761.log.gz 2023-12-12T17:38:23.134 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.466120.log 2023-12-12T17:38:23.136 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2%/var/log/ceph/ceph-client.admin.493323.log: -- replaced with /var/log/ceph/ceph-client.admin.198355.log.gz 2023-12-12T17:38:23.138 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.470283.log 2023-12-12T17:38:23.139 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.470274.log 2023-12-12T17:38:23.140 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.466120.log: /var/log/ceph/ceph-client.admin.470283.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.216894.log.gz 2023-12-12T17:38:23.141 INFO:teuthology.orchestra.run.smithi078.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.262812.log.gz 2023-12-12T17:38:23.142 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.245373.log 2023-12-12T17:38:23.144 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.214828.log 2023-12-12T17:38:23.145 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.245373.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.255247.log.gz 2023-12-12T17:38:23.145 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.470274.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-12-12T17:38:23.148 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.214828.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115955.log 2023-12-12T17:38:23.150 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.504184.log 2023-12-12T17:38:23.151 INFO:teuthology.orchestra.run.smithi078.stderr: 77.3% -- replaced with /var/log/ceph/ceph-client.admin.252359.log.gz 2023-12-12T17:38:23.152 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.350451.log.gz 2023-12-12T17:38:23.153 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150964.log 2023-12-12T17:38:23.154 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.115955.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.338153.log.gz 2023-12-12T17:38:23.154 INFO:teuthology.orchestra.run.smithi078.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.427200.log.gz 2023-12-12T17:38:23.156 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.492921.log 2023-12-12T17:38:23.156 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.504184.log: /var/log/ceph/ceph-client.admin.150964.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46489.log.gz 2023-12-12T17:38:23.157 INFO:teuthology.orchestra.run.smithi078.stderr: 94.3% -- replaced with /var/log/ceph/ceph-client.admin.508322.log.gz 2023-12-12T17:38:23.157 INFO:teuthology.orchestra.run.smithi078.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.504184.log.gz 2023-12-12T17:38:23.159 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.425558.log 2023-12-12T17:38:23.160 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.492921.log: 77.4% -- replaced with /var/log/ceph/ceph-client.admin.439871.log.gz 2023-12-12T17:38:23.162 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.320135.log 2023-12-12T17:38:23.165 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.425558.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.413561.log 2023-12-12T17:38:23.168 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.320135.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.458980.log 2023-12-12T17:38:23.171 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.413561.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.417043.log 2023-12-12T17:38:23.173 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.458980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118104.log 2023-12-12T17:38:23.174 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.417043.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.429027.log.gz 2023-12-12T17:38:23.174 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.448290.log.gz 2023-12-12T17:38:23.176 INFO:teuthology.orchestra.run.smithi078.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.461461.log.gz 2023-12-12T17:38:23.176 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.352199.log.gz 2023-12-12T17:38:23.177 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.461067.log.gz 2023-12-12T17:38:23.177 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.224288.log 2023-12-12T17:38:23.178 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.325478.log 2023-12-12T17:38:23.179 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.118104.log: /var/log/ceph/ceph-client.admin.224288.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.464787.log.gz 2023-12-12T17:38:23.181 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44508.log 2023-12-12T17:38:23.184 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.325478.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46541.log 2023-12-12T17:38:23.187 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.44508.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.503786.log 2023-12-12T17:38:23.189 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48802.log 2023-12-12T17:38:23.190 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.46541.log: /var/log/ceph/ceph-client.admin.503786.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.503786.log.gz 2023-12-12T17:38:23.192 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.309499.log 2023-12-12T17:38:23.195 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.48802.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.338949.log 2023-12-12T17:38:23.197 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166476.log 2023-12-12T17:38:23.198 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.309499.log: /var/log/ceph/ceph-client.admin.338949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105746.log 2023-12-12T17:38:23.201 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.166476.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48326.log 2023-12-12T17:38:23.203 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.406061.log 2023-12-12T17:38:23.204 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.105746.log: /var/log/ceph/ceph-client.admin.48326.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49842.log 2023-12-12T17:38:23.206 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.406061.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.488079.log 2023-12-12T17:38:23.207 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.520675.log 2023-12-12T17:38:23.209 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.488079.log: /var/log/ceph/ceph-client.admin.49842.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.404448.log 2023-12-12T17:38:23.210 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.520675.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.520675.log.gz 2023-12-12T17:38:23.211 INFO:teuthology.orchestra.run.smithi078.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.493323.log.gz 2023-12-12T17:38:23.212 INFO:teuthology.orchestra.run.smithi078.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.411098.log.gz 2023-12-12T17:38:23.213 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.482439.log 2023-12-12T17:38:23.216 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.404448.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.455587.log 2023-12-12T17:38:23.218 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.482439.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.239690.log 2023-12-12T17:38:23.221 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.455587.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.330325.log 2023-12-12T17:38:23.224 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.239690.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.388751.log 2023-12-12T17:38:23.228 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.330325.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.426777.log 2023-12-12T17:38:23.228 INFO:teuthology.orchestra.run.smithi078.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.397116.log.gz 2023-12-12T17:38:23.229 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.311521.log 2023-12-12T17:38:23.233 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.426777.log: /var/log/ceph/ceph-client.admin.388751.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.231199.log 2023-12-12T17:38:23.234 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.311521.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.252770.log 2023-12-12T17:38:23.235 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.468642.log 2023-12-12T17:38:23.237 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.231199.log: /var/log/ceph/ceph-client.admin.252770.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.310703.log 2023-12-12T17:38:23.240 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.468642.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.217716.log 2023-12-12T17:38:23.241 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45692.log 2023-12-12T17:38:23.244 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.217716.log: /var/log/ceph/ceph-client.admin.310703.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.510447.log 2023-12-12T17:38:23.245 INFO:teuthology.orchestra.run.smithi078.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.118104.log.gz 2023-12-12T17:38:23.245 INFO:teuthology.orchestra.run.smithi078.stderr: 89.0% -- replaced with /var/log/ceph/ceph.log.gz 2023-12-12T17:38:23.245 INFO:teuthology.orchestra.run.smithi078.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.104944.log.gz 2023-12-12T17:38:23.246 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.423900.log 2023-12-12T17:38:23.249 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.510447.log: /var/log/ceph/ceph-client.admin.45692.log: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.510447.log.gz 2023-12-12T17:38:23.250 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.237207.log 2023-12-12T17:38:23.252 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.423900.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.202958.log 2023-12-12T17:38:23.253 INFO:teuthology.orchestra.run.smithi078.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.204154.log.gz 2023-12-12T17:38:23.254 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.335243.log 2023-12-12T17:38:23.256 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.202958.log: /var/log/ceph/ceph-client.admin.237207.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.224288.log.gz 2023-12-12T17:38:23.257 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88804.log 2023-12-12T17:38:23.258 INFO:teuthology.orchestra.run.smithi078.stderr: 78.3% -- replaced with /var/log/ceph/ceph-client.admin.466120.log.gz 2023-12-12T17:38:23.259 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168080.log 2023-12-12T17:38:23.260 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.335243.log: /var/log/ceph/ceph-client.admin.88804.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.344186.log.gz 2023-12-12T17:38:23.261 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.468642.log.gz 2023-12-12T17:38:23.262 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.311114.log 2023-12-12T17:38:23.264 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.168080.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.264954.log.gz 2023-12-12T17:38:23.265 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.435688.log 2023-12-12T17:38:23.267 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.311114.log: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.264547.log.gz 2023-12-12T17:38:23.267 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.335649.log 2023-12-12T17:38:23.269 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.435688.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.312727.log 2023-12-12T17:38:23.271 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.335649.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.386584.log 2023-12-12T17:38:23.274 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.312727.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.509149.log 2023-12-12T17:38:23.275 INFO:teuthology.orchestra.run.smithi078.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.102895.log.gz 2023-12-12T17:38:23.275 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.150964.log.gz 2023-12-12T17:38:23.275 INFO:teuthology.orchestra.run.smithi078.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.168080.log.gz 2023-12-12T17:38:23.276 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.386584.log: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.214828.log.gz 2023-12-12T17:38:23.277 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.332001.log 2023-12-12T17:38:23.281 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.509149.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.403227.log 2023-12-12T17:38:23.282 INFO:teuthology.orchestra.run.smithi078.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.509149.log.gz 2023-12-12T17:38:23.282 INFO:teuthology.orchestra.run.smithi078.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.245373.log.gz 2023-12-12T17:38:23.282 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.332001.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.200017.log 2023-12-12T17:38:23.283 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.403227.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49842.log.gz 2023-12-12T17:38:23.284 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.476444.log 2023-12-12T17:38:23.286 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.200017.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.505017.log 2023-12-12T17:38:23.288 INFO:teuthology.orchestra.run.smithi078.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.45908.log.gz 2023-12-12T17:38:23.289 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.476444.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.426362.log 2023-12-12T17:38:23.292 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.505017.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.341260.log 2023-12-12T17:38:23.293 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.414802.log 2023-12-12T17:38:23.293 INFO:teuthology.orchestra.run.smithi078.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.505017.log.gz 2023-12-12T17:38:23.296 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.426362.log: /var/log/ceph/ceph-client.admin.341260.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.467029.log 2023-12-12T17:38:23.297 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.502839.log 2023-12-12T17:38:23.298 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.414802.log: /var/log/ceph/ceph-client.admin.467029.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.492921.log.gz 2023-12-12T17:38:23.299 INFO:teuthology.orchestra.run.smithi078.stderr: 77.4% -- replaced with /var/log/ceph/ceph-client.admin.470274.log.gz 2023-12-12T17:38:23.300 INFO:teuthology.orchestra.run.smithi078.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.486473.log.gz 2023-12-12T17:38:23.300 INFO:teuthology.orchestra.run.smithi078.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.425558.log.gz 2023-12-12T17:38:23.301 INFO:teuthology.orchestra.run.smithi078.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.470283.log.gz 2023-12-12T17:38:23.301 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.212575.log 2023-12-12T17:38:23.304 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.502839.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.397925.log 2023-12-12T17:38:23.305 INFO:teuthology.orchestra.run.smithi078.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.389153.log.gz 2023-12-12T17:38:23.306 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.212575.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.502839.log.gz 2023-12-12T17:38:23.307 INFO:teuthology.orchestra.run.smithi078.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.403218.log.gz 2023-12-12T17:38:23.308 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.454341.log 2023-12-12T17:38:23.308 INFO:teuthology.orchestra.run.smithi078.stderr: 79.5% -- replaced with /var/log/ceph/ceph-client.admin.431922.log.gz 2023-12-12T17:38:23.309 INFO:teuthology.orchestra.run.smithi078.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.446945.log.gz 2023-12-12T17:38:23.310 INFO:teuthology.orchestra.run.smithi078.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.404448.log.gz/var/log/ceph/ceph-client.admin.397925.log: 2023-12-12T17:38:23.311 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48537.log 2023-12-12T17:38:23.314 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.454341.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.458980.log.gz 2023-12-12T17:38:23.315 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.236804.log 2023-12-12T17:38:23.315 INFO:teuthology.orchestra.run.smithi078.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.460254.log.gz 2023-12-12T17:38:23.316 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100901.log 2023-12-12T17:38:23.319 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.236804.log: /var/log/ceph/ceph-client.admin.48537.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46175.log 2023-12-12T17:38:23.321 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.100901.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.323033.log 2023-12-12T17:38:23.324 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.46175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.210442.log 2023-12-12T17:38:23.327 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.323033.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.436948.log 2023-12-12T17:38:23.329 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.488884.log 2023-12-12T17:38:23.330 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.210442.log: /var/log/ceph/ceph-client.admin.436948.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.457765.log.gz 2023-12-12T17:38:23.331 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151357.log 2023-12-12T17:38:23.333 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.335243.log.gz 2023-12-12T17:38:23.334 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.488884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.200877.log 2023-12-12T17:38:23.337 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.151357.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.351770.log 2023-12-12T17:38:23.338 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179395.log 2023-12-12T17:38:23.341 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.200877.log: /var/log/ceph/ceph-client.admin.351770.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.488079.log.gz 2023-12-12T17:38:23.341 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.345017.log 2023-12-12T17:38:23.342 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.404846.log 2023-12-12T17:38:23.345 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.179395.log: /var/log/ceph/ceph-client.admin.345017.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.503308.log 2023-12-12T17:38:23.347 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.404846.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185892.log 2023-12-12T17:38:23.348 INFO:teuthology.orchestra.run.smithi078.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.199165.log.gz 2023-12-12T17:38:23.350 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.503308.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.348314.log 2023-12-12T17:38:23.352 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185462.log 2023-12-12T17:38:23.353 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.185892.log: /var/log/ceph/ceph-client.admin.348314.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.204556.log 2023-12-12T17:38:23.356 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.185462.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.216088.log 2023-12-12T17:38:23.356 INFO:teuthology.orchestra.run.smithi078.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.503308.log.gz 2023-12-12T17:38:23.357 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.466804.log 2023-12-12T17:38:23.360 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.204556.log: /var/log/ceph/ceph-client.admin.216088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.223019.log 2023-12-12T17:38:23.362 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.466804.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.521117.log 2023-12-12T17:38:23.366 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.223019.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.405253.log 2023-12-12T17:38:23.367 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.521117.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.312727.log.gz 2023-12-12T17:38:23.368 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.399544.log 2023-12-12T17:38:23.369 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.195933.log.gz 2023-12-12T17:38:23.371 INFO:teuthology.orchestra.run.smithi078.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.521117.log.gz 2023-12-12T17:38:23.371 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109468.log 2023-12-12T17:38:23.371 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.399544.log: /var/log/ceph/ceph-client.admin.405253.log: 93.0% -- replaced with /var/log/ceph/ceph-client.admin.330325.log.gz 2023-12-12T17:38:23.372 INFO:teuthology.orchestra.run.smithi078.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.118924.log.gz 2023-12-12T17:38:23.373 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.516815.log 2023-12-12T17:38:23.376 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.109468.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.434877.log 2023-12-12T17:38:23.378 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45264.log 2023-12-12T17:38:23.378 INFO:teuthology.orchestra.run.smithi078.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.48537.log.gz 2023-12-12T17:38:23.379 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.202958.log.gz 2023-12-12T17:38:23.380 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.434877.log: /var/log/ceph/ceph-client.admin.516815.log: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.467427.log.gz 2023-12-12T17:38:23.380 INFO:teuthology.orchestra.run.smithi078.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.436948.log.gzgzip 2023-12-12T17:38:23.380 INFO:teuthology.orchestra.run.smithi078.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.342924.log 2023-12-12T17:38:23.381 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.45264.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.467029.log.gz 2023-12-12T17:38:23.382 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.442043.log 2023-12-12T17:38:23.382 INFO:teuthology.orchestra.run.smithi078.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.187622.log.gz 2023-12-12T17:38:23.383 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.342924.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.46097.log.gz 2023-12-12T17:38:23.383 INFO:teuthology.orchestra.run.smithi078.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45264.log.gz 2023-12-12T17:38:23.384 INFO:teuthology.orchestra.run.smithi078.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47505.log.gz 2023-12-12T17:38:23.386 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.325086.log 2023-12-12T17:38:23.388 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.442043.log: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.516815.log.gz 2023-12-12T17:38:23.389 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.328699.log 2023-12-12T17:38:23.390 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.382124.log 2023-12-12T17:38:23.393 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.325086.log: /var/log/ceph/ceph-client.admin.328699.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.450190.log 2023-12-12T17:38:23.394 INFO:teuthology.orchestra.run.smithi078.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.148270.log.gz 2023-12-12T17:38:23.396 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.382124.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.210835.log.gz 2023-12-12T17:38:23.396 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106594.log 2023-12-12T17:38:23.397 INFO:teuthology.orchestra.run.smithi078.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.189774.log.gz 2023-12-12T17:38:23.398 INFO:teuthology.orchestra.run.smithi078.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.236804.log.gz 2023-12-12T17:38:23.398 INFO:teuthology.orchestra.run.smithi078.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.210442.log.gz 2023-12-12T17:38:23.399 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.450190.log: 79.2% -- replaced with /var/log/ceph/ceph-client.admin.476444.log.gz 2023-12-12T17:38:23.400 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.231664.log 2023-12-12T17:38:23.403 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.106594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.415199.log 2023-12-12T17:38:23.405 INFO:teuthology.orchestra.run.smithi187.stderr: 94.1% -- replaced with /var/log/ceph/ceph.log.gz 2023-12-12T17:38:23.405 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.231664.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.212123.log 2023-12-12T17:38:23.407 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.341717.log 2023-12-12T17:38:23.408 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.415199.log: /var/log/ceph/ceph-client.admin.212123.log: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.404846.log.gz 2023-12-12T17:38:23.408 INFO:teuthology.orchestra.run.smithi078.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.434877.log.gz 2023-12-12T17:38:23.409 INFO:teuthology.orchestra.run.smithi078.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.404042.log.gz 2023-12-12T17:38:23.409 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.205383.log 2023-12-12T17:38:23.410 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.388760.log 2023-12-12T17:38:23.413 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.341717.log: /var/log/ceph/ceph-client.admin.205383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48776.log 2023-12-12T17:38:23.415 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.388760.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.440282.log 2023-12-12T17:38:23.415 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.332001.log.gz 2023-12-12T17:38:23.416 INFO:teuthology.orchestra.run.smithi078.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.182916.log.gz 2023-12-12T17:38:23.417 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.48776.log: 83.1% -- replaced with /var/log/ceph/ceph-client.admin.450190.log.gz 2023-12-12T17:38:23.418 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.250751.log 2023-12-12T17:38:23.419 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.440282.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149205.log 2023-12-12T17:38:23.422 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.250751.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.239699.log 2023-12-12T17:38:23.425 INFO:teuthology.orchestra.run.smithi078.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.454341.log.gz 2023-12-12T17:38:23.425 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192715.log 2023-12-12T17:38:23.426 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.149205.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.322229.log 2023-12-12T17:38:23.429 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.239699.log: /var/log/ceph/ceph-client.admin.192715.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.238062.log 2023-12-12T17:38:23.431 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.322229.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.317992.log 2023-12-12T17:38:23.433 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.234573.log 2023-12-12T17:38:23.439 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.317992.log: /var/log/ceph/ceph-client.admin.238062.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.490906.log.gz 2023-12-12T17:38:23.439 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.466549.log 2023-12-12T17:38:23.440 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.234573.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149607.log 2023-12-12T17:38:23.440 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.452280.log.gz 2023-12-12T17:38:23.441 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.466549.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.347091.log 2023-12-12T17:38:23.442 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45025.log 2023-12-12T17:38:23.445 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.149607.log: /var/log/ceph/ceph-client.admin.347091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.411499.log 2023-12-12T17:38:23.447 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.45025.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49114.log 2023-12-12T17:38:23.449 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110665.log 2023-12-12T17:38:23.451 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.411499.log: /var/log/ceph/ceph-client.admin.49114.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.388312.log 2023-12-12T17:38:23.453 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.428550.log 2023-12-12T17:38:23.456 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.110665.log: /var/log/ceph/ceph-client.admin.388312.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173668.log 2023-12-12T17:38:23.456 INFO:teuthology.orchestra.run.smithi078.stderr: 83.8% -- replaced with /var/log/ceph/ceph-client.admin.488884.log.gz 2023-12-12T17:38:23.459 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.428550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49465.log 2023-12-12T17:38:23.459 INFO:teuthology.orchestra.run.smithi078.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.397925.log.gz 2023-12-12T17:38:23.459 INFO:teuthology.orchestra.run.smithi078.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.399544.log.gz 2023-12-12T17:38:23.461 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.173668.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.374455.log.gz 2023-12-12T17:38:23.462 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.226740.log 2023-12-12T17:38:23.464 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.49465.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.414364.log 2023-12-12T17:38:23.467 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.226740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.434868.log 2023-12-12T17:38:23.469 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.414364.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168903.log 2023-12-12T17:38:23.471 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.434868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.463087.log 2023-12-12T17:38:23.473 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.168903.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.226098.log 2023-12-12T17:38:23.475 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.463087.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87399.log 2023-12-12T17:38:23.477 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.376959.log 2023-12-12T17:38:23.479 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.226098.log: /var/log/ceph/ceph-client.admin.87399.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.449221.log 2023-12-12T17:38:23.483 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.376959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.314744.log 2023-12-12T17:38:23.484 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48932.log 2023-12-12T17:38:23.486 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.449221.log: /var/log/ceph/ceph-client.admin.314744.log: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.351779.log.gz 2023-12-12T17:38:23.487 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.412308.log 2023-12-12T17:38:23.488 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174089.log 2023-12-12T17:38:23.490 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.48932.log: /var/log/ceph/ceph-client.admin.412308.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193923.log 2023-12-12T17:38:23.493 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.174089.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.507505.log 2023-12-12T17:38:23.495 INFO:teuthology.orchestra.run.smithi078.stderr: 93.8% -- replaced with /var/log/ceph/ceph-client.admin.355834.log.gz 2023-12-12T17:38:23.495 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.193923.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169306.log 2023-12-12T17:38:23.497 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91873.log 2023-12-12T17:38:23.498 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.169306.log: /var/log/ceph/ceph-client.admin.507505.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.222615.log.gz 2023-12-12T17:38:23.500 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.315552.log 2023-12-12T17:38:23.500 INFO:teuthology.orchestra.run.smithi078.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.507505.log.gz 2023-12-12T17:38:23.502 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.91873.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191492.log 2023-12-12T17:38:23.505 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.315552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.506696.log 2023-12-12T17:38:23.507 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.191492.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.521167.log 2023-12-12T17:38:23.509 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.506696.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.433545.log 2023-12-12T17:38:23.511 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.521167.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.253172.log 2023-12-12T17:38:23.512 INFO:teuthology.orchestra.run.smithi078.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.506696.log.gz 2023-12-12T17:38:23.513 INFO:teuthology.orchestra.run.smithi078.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.521167.log.gz 2023-12-12T17:38:23.514 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.433545.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.494543.log 2023-12-12T17:38:23.515 INFO:teuthology.orchestra.run.smithi078.stderr: 77.5% -- replaced with /var/log/ceph/ceph-client.admin.442043.log.gz 2023-12-12T17:38:23.515 INFO:teuthology.orchestra.run.smithi078.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.403630.log.gz 2023-12-12T17:38:23.517 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.253172.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47609.log 2023-12-12T17:38:23.517 INFO:teuthology.orchestra.run.smithi078.stderr: 77.6% -- replaced with /var/log/ceph/ceph-client.admin.325879.log.gz 2023-12-12T17:38:23.519 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.325086.log.gz 2023-12-12T17:38:23.519 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.494543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173265.log 2023-12-12T17:38:23.521 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47609.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.466813.log 2023-12-12T17:38:23.522 INFO:teuthology.orchestra.run.smithi078.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.250751.log.gz 2023-12-12T17:38:23.523 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.173265.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.377794.log 2023-12-12T17:38:23.525 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.466813.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.409315.log 2023-12-12T17:38:23.528 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.377794.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.451869.log 2023-12-12T17:38:23.529 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.409315.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.354844.log 2023-12-12T17:38:23.530 INFO:teuthology.orchestra.run.smithi078.stderr: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.341717.log.gz 2023-12-12T17:38:23.531 INFO:teuthology.orchestra.run.smithi078.stderr: 80.5%/var/log/ceph/ceph-client.admin.451869.log: -- replaced with /var/log/ceph/ceph-client.admin.342924.log.gz 2023-12-12T17:38:23.531 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.374853.log 2023-12-12T17:38:23.534 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.354844.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.345468.log.gz 2023-12-12T17:38:23.534 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.469842.log 2023-12-12T17:38:23.536 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92319.log 2023-12-12T17:38:23.537 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.374853.log: /var/log/ceph/ceph-client.admin.469842.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.212575.log.gz 2023-12-12T17:38:23.539 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.505008.log 2023-12-12T17:38:23.541 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.92319.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169716.log 2023-12-12T17:38:23.543 INFO:teuthology.orchestra.run.smithi078.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.49465.log.gz 2023-12-12T17:38:23.543 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.505818.log 2023-12-12T17:38:23.545 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.505008.log: /var/log/ceph/ceph-client.admin.169716.log: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.505008.log.gz 2023-12-12T17:38:23.545 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.243743.log 2023-12-12T17:38:23.547 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.505818.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.322229.log.gz 2023-12-12T17:38:23.548 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.382542.log 2023-12-12T17:38:23.548 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.243743.log: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.505818.log.gz 2023-12-12T17:38:23.550 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49218.log 2023-12-12T17:38:23.553 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.382542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46515.log 2023-12-12T17:38:23.556 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.49218.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.461470.log 2023-12-12T17:38:23.559 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.46515.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44086.log 2023-12-12T17:38:23.560 INFO:teuthology.orchestra.run.smithi078.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.253172.log.gz 2023-12-12T17:38:23.561 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.461470.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182477.log 2023-12-12T17:38:23.561 INFO:teuthology.orchestra.run.smithi078.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.174089.log.gz 2023-12-12T17:38:23.562 INFO:teuthology.orchestra.run.smithi078.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.231664.log.gz 2023-12-12T17:38:23.562 INFO:teuthology.orchestra.run.smithi078.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.238062.log.gz 2023-12-12T17:38:23.563 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47219.log 2023-12-12T17:38:23.566 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.44086.log: /var/log/ceph/ceph-client.admin.182477.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147782.log 2023-12-12T17:38:23.568 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47219.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.217297.log 2023-12-12T17:38:23.570 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.147782.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.315968.log 2023-12-12T17:38:23.572 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.217297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.392160.log 2023-12-12T17:38:23.574 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.315968.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.239699.log.gz 2023-12-12T17:38:23.574 INFO:teuthology.orchestra.run.smithi078.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.173265.log.gz 2023-12-12T17:38:23.575 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.411901.log 2023-12-12T17:38:23.576 INFO:teuthology.orchestra.run.smithi078.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.243743.log.gz 2023-12-12T17:38:23.577 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.399947.log 2023-12-12T17:38:23.577 INFO:teuthology.orchestra.run.smithi078.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.182907.log.gz 2023-12-12T17:38:23.577 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.433545.log.gz 2023-12-12T17:38:23.577 INFO:teuthology.orchestra.run.smithi078.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.219729.log.gz 2023-12-12T17:38:23.579 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.392160.log: /var/log/ceph/ceph-client.admin.411901.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48090.log 2023-12-12T17:38:23.580 INFO:teuthology.orchestra.run.smithi078.stderr: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.434868.log.gz 2023-12-12T17:38:23.581 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.399947.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.499862.log 2023-12-12T17:38:23.582 INFO:teuthology.orchestra.run.smithi078.stderr: 82.7% -- replaced with /var/log/ceph/ceph-client.admin.169306.log.gz 2023-12-12T17:38:23.583 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.48090.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.520779.log 2023-12-12T17:38:23.585 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.499862.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.253565.log 2023-12-12T17:38:23.586 INFO:teuthology.orchestra.run.smithi078.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.499862.log.gz 2023-12-12T17:38:23.588 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.520779.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.385278.log 2023-12-12T17:38:23.588 INFO:teuthology.orchestra.run.smithi078.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.520779.log.gz 2023-12-12T17:38:23.589 INFO:teuthology.orchestra.run.smithi078.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.426777.log.gz 2023-12-12T17:38:23.589 INFO:teuthology.orchestra.run.smithi078.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.388760.log.gz 2023-12-12T17:38:23.590 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.253565.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.196740.log 2023-12-12T17:38:23.592 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.385278.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.317578.log 2023-12-12T17:38:23.593 INFO:teuthology.orchestra.run.smithi078.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.451869.log.gz 2023-12-12T17:38:23.594 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.455587.log.gz 2023-12-12T17:38:23.594 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.196740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49727.log 2023-12-12T17:38:23.595 INFO:teuthology.orchestra.run.smithi078.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.438208.log.gz 2023-12-12T17:38:23.596 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111880.log 2023-12-12T17:38:23.598 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.317578.log: /var/log/ceph/ceph-client.admin.49727.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49756.log 2023-12-12T17:38:23.600 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.111880.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.514702.log 2023-12-12T17:38:23.602 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.49756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.414355.log 2023-12-12T17:38:23.605 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.223010.log 2023-12-12T17:38:23.606 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.514702.log: /var/log/ceph/ceph-client.admin.414355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.386171.log 2023-12-12T17:38:23.608 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.223010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.393804.log 2023-12-12T17:38:23.611 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.386171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45705.log 2023-12-12T17:38:23.613 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.393804.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150411.log 2023-12-12T17:38:23.615 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.45705.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189344.log 2023-12-12T17:38:23.615 INFO:teuthology.orchestra.run.smithi078.stderr: 94.3% -- replaced with /var/log/ceph/ceph-client.admin.514702.log.gz 2023-12-12T17:38:23.616 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.399947.log.gz 2023-12-12T17:38:23.617 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.150411.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.219328.log 2023-12-12T17:38:23.620 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.189344.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151366.log 2023-12-12T17:38:23.620 INFO:teuthology.orchestra.run.smithi078.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.461470.log.gz 2023-12-12T17:38:23.622 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.459861.log.gz 2023-12-12T17:38:23.622 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46149.log 2023-12-12T17:38:23.622 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.151366.log: 80.4%/var/log/ceph/ceph-client.admin.219328.log: -- replaced with /var/log/ceph/ceph-client.admin.428550.log.gz 2023-12-12T17:38:23.623 INFO:teuthology.orchestra.run.smithi078.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.334425.log.gz 2023-12-12T17:38:23.625 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.252368.log 2023-12-12T17:38:23.628 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.46149.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167687.log 2023-12-12T17:38:23.630 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.252368.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.248741.log 2023-12-12T17:38:23.632 INFO:teuthology.orchestra.run.smithi078.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.405253.log.gz 2023-12-12T17:38:23.632 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.408104.log 2023-12-12T17:38:23.633 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.248741.log: /var/log/ceph/ceph-client.admin.167687.log: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.415199.log.gz 2023-12-12T17:38:23.634 INFO:teuthology.orchestra.run.smithi078.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.430678.log.gz 2023-12-12T17:38:23.635 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188913.log 2023-12-12T17:38:23.638 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.408104.log: 78.9% -- replaced with /var/log/ceph/ceph-client.admin.494543.log.gz 2023-12-12T17:38:23.638 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.433938.log 2023-12-12T17:38:23.642 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.188913.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107846.log 2023-12-12T17:38:23.643 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.433938.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144219.log 2023-12-12T17:38:23.646 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.107846.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.317578.log.gz 2023-12-12T17:38:23.646 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193914.log 2023-12-12T17:38:23.649 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.144219.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121002.log 2023-12-12T17:38:23.651 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.193914.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48646.log 2023-12-12T17:38:23.651 INFO:teuthology.orchestra.run.smithi078.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.115955.log.gz 2023-12-12T17:38:23.652 INFO:teuthology.orchestra.run.smithi078.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.48090.log.gz 2023-12-12T17:38:23.654 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.121002.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170146.log 2023-12-12T17:38:23.657 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.48646.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.520620.log 2023-12-12T17:38:23.660 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.170146.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170567.log 2023-12-12T17:38:23.660 INFO:teuthology.orchestra.run.smithi078.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.408104.log.gz 2023-12-12T17:38:23.661 INFO:teuthology.orchestra.run.smithi078.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.219328.log.gz 2023-12-12T17:38:23.661 INFO:teuthology.orchestra.run.smithi078.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.392160.log.gz 2023-12-12T17:38:23.663 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.520620.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49543.log 2023-12-12T17:38:23.663 INFO:teuthology.orchestra.run.smithi078.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.520620.log.gz 2023-12-12T17:38:23.664 INFO:teuthology.orchestra.run.smithi078.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.466813.log.gz 2023-12-12T17:38:23.664 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.478805.log 2023-12-12T17:38:23.666 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.49543.log: /var/log/ceph/ceph-client.admin.170567.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.314351.log 2023-12-12T17:38:23.667 INFO:teuthology.orchestra.run.smithi078.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.217297.log.gz 2023-12-12T17:38:23.667 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109870.log 2023-12-12T17:38:23.670 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.478805.log: /var/log/ceph/ceph-client.admin.314351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43986.log 2023-12-12T17:38:23.672 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.109870.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.353468.log 2023-12-12T17:38:23.675 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.43986.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47401.log.gz 2023-12-12T17:38:23.675 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46357.log 2023-12-12T17:38:23.676 INFO:teuthology.orchestra.run.smithi078.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45705.log.gz 2023-12-12T17:38:23.676 INFO:teuthology.orchestra.run.smithi078.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45889.log.gz 2023-12-12T17:38:23.676 INFO:teuthology.orchestra.run.smithi078.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.49756.log.gz 2023-12-12T17:38:23.677 INFO:teuthology.orchestra.run.smithi078.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49727.log.gz 2023-12-12T17:38:23.677 INFO:teuthology.orchestra.run.smithi078.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47115.log.gz 2023-12-12T17:38:23.678 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.353468.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.107846.log.gz 2023-12-12T17:38:23.679 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44053.log 2023-12-12T17:38:23.680 INFO:teuthology.orchestra.run.smithi078.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.414364.log.gz 2023-12-12T17:38:23.680 INFO:teuthology.orchestra.run.smithi078.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.213430.log.gz 2023-12-12T17:38:23.680 INFO:teuthology.orchestra.run.smithi078.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.0.46722.log.gz 2023-12-12T17:38:23.680 INFO:teuthology.orchestra.run.smithi078.stderr: 79.3% -- replaced with /var/log/ceph/ceph-client.admin.169707.log.gz 2023-12-12T17:38:23.682 INFO:teuthology.orchestra.run.smithi078.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.182477.log.gz 2023-12-12T17:38:23.683 INFO:teuthology.orchestra.run.smithi078.stderr: 78.2% -- replaced with /var/log/ceph/ceph-client.admin.170567.log.gz 2023-12-12T17:38:23.683 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.46357.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.223010.log.gz 2023-12-12T17:38:23.683 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108659.log 2023-12-12T17:38:23.684 INFO:teuthology.orchestra.run.smithi078.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.149598.log.gz 2023-12-12T17:38:23.684 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.44053.log: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.193512.log.gz 2023-12-12T17:38:23.684 INFO:teuthology.orchestra.run.smithi078.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.43986.log.gz 2023-12-12T17:38:23.684 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.201320.log 2023-12-12T17:38:23.685 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.108659.log: 79.2% -- replaced with /var/log/ceph/ceph-client.admin.253565.log.gz 2023-12-12T17:38:23.687 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.347913.log 2023-12-12T17:38:23.687 INFO:teuthology.orchestra.run.smithi078.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44508.log.gz 2023-12-12T17:38:23.688 INFO:teuthology.orchestra.run.smithi078.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.248741.log.gz 2023-12-12T17:38:23.690 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.201320.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.397125.log 2023-12-12T17:38:23.692 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.347913.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.196740.log.gz 2023-12-12T17:38:23.693 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.331186.log 2023-12-12T17:38:23.694 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.453881.log 2023-12-12T17:38:23.697 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.397125.log: /var/log/ceph/ceph-client.admin.331186.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.222200.log 2023-12-12T17:38:23.699 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.453881.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.511727.log 2023-12-12T17:38:23.701 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.256516.log 2023-12-12T17:38:23.704 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.511727.log: /var/log/ceph/ceph-client.admin.222200.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.375695.log 2023-12-12T17:38:23.704 INFO:teuthology.orchestra.run.smithi078.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.511727.log.gz 2023-12-12T17:38:23.706 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.453488.log 2023-12-12T17:38:23.709 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.256516.log: /var/log/ceph/ceph-client.admin.375695.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.320947.log 2023-12-12T17:38:23.710 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.236401.log 2023-12-12T17:38:23.713 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.453488.log: /var/log/ceph/ceph-client.admin.320947.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.239292.log 2023-12-12T17:38:23.715 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.236401.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.519400.log 2023-12-12T17:38:23.718 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.239292.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96473.log 2023-12-12T17:38:23.719 INFO:teuthology.orchestra.run.smithi078.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.416231.log.gz 2023-12-12T17:38:23.721 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.519400.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.444408.log 2023-12-12T17:38:23.722 INFO:teuthology.orchestra.run.smithi078.stderr: 84.5% -- replaced with /var/log/ceph/ceph-client.admin.519400.log.gz 2023-12-12T17:38:23.723 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44204.log 2023-12-12T17:38:23.725 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.96473.log: /var/log/ceph/ceph-client.admin.444408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.510021.log 2023-12-12T17:38:23.728 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.44204.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.242124.log 2023-12-12T17:38:23.728 INFO:teuthology.orchestra.run.smithi078.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.411901.log.gz 2023-12-12T17:38:23.729 INFO:teuthology.orchestra.run.smithi078.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.412308.log.gz 2023-12-12T17:38:23.729 INFO:teuthology.orchestra.run.smithi078.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.411499.log.gz 2023-12-12T17:38:23.730 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.510021.log: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.487676.log.gz 2023-12-12T17:38:23.730 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.224681.log 2023-12-12T17:38:23.733 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.242124.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.237660.log 2023-12-12T17:38:23.734 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49373.log 2023-12-12T17:38:23.737 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.224681.log: /var/log/ceph/ceph-client.admin.237660.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.334828.log 2023-12-12T17:38:23.737 INFO:teuthology.orchestra.run.smithi078.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.510021.log.gz 2023-12-12T17:38:23.741 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.49373.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118515.log 2023-12-12T17:38:23.742 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.334828.log: /var/log/ceph/ceph-client.admin.329101.log 2023-12-12T17:38:23.745 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.118515.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185032.log 2023-12-12T17:38:23.747 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.329101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.322631.log 2023-12-12T17:38:23.750 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.185032.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.412724.log 2023-12-12T17:38:23.753 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.322631.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.451878.log 2023-12-12T17:38:23.756 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.412724.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.331598.log 2023-12-12T17:38:23.756 INFO:teuthology.orchestra.run.smithi078.stderr: 78.3% -- replaced with /var/log/ceph/ceph-client.admin.374446.log.gz 2023-12-12T17:38:23.759 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.451878.log: 79.8% -- replaced with /var/log/ceph/ceph-client.admin.490495.log.gz 2023-12-12T17:38:23.759 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.231208.log 2023-12-12T17:38:23.761 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.331598.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44894.log 2023-12-12T17:38:23.764 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.231208.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.492912.log 2023-12-12T17:38:23.766 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.44894.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.220131.log 2023-12-12T17:38:23.767 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.425156.log 2023-12-12T17:38:23.770 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.492912.log: /var/log/ceph/ceph-client.admin.220131.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118506.log 2023-12-12T17:38:23.773 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.425156.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118113.log 2023-12-12T17:38:23.774 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.220595.log 2023-12-12T17:38:23.776 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.118113.log: /var/log/ceph/ceph-client.admin.118506.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.380474.log.gz 2023-12-12T17:38:23.777 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.488491.log 2023-12-12T17:38:23.780 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.220595.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.49262.log.gz 2023-12-12T17:38:23.780 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.494129.log 2023-12-12T17:38:23.783 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.488491.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.520524.log 2023-12-12T17:38:23.785 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.494129.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.353459.log 2023-12-12T17:38:23.787 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.457774.log 2023-12-12T17:38:23.788 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.520524.log: /var/log/ceph/ceph-client.admin.353459.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.520524.log.gz 2023-12-12T17:38:23.789 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44998.log 2023-12-12T17:38:23.792 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.457774.log: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.208820.log.gz 2023-12-12T17:38:23.792 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.253574.log 2023-12-12T17:38:23.792 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.201320.log.gz 2023-12-12T17:38:23.794 INFO:teuthology.orchestra.run.smithi078.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.210026.log.gz 2023-12-12T17:38:23.794 INFO:teuthology.orchestra.run.smithi078.stderr: 78.5% -- replaced with /var/log/ceph/ceph-client.admin.217716.log.gz 2023-12-12T17:38:23.794 INFO:teuthology.orchestra.run.smithi078.stderr: 84.2%/var/log/ceph/ceph-client.admin.44998.log: -- replaced with /var/log/ceph/ceph-client.admin.320135.log.gz 2023-12-12T17:38:23.795 INFO:teuthology.orchestra.run.smithi078.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.175799.log.gz 2023-12-12T17:38:23.795 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.345878.log.gz 2023-12-12T17:38:23.796 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.321827.log 2023-12-12T17:38:23.799 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.253574.log: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.169716.log.gz 2023-12-12T17:38:23.800 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140428.log 2023-12-12T17:38:23.800 INFO:teuthology.orchestra.run.smithi078.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.311521.log.gz 2023-12-12T17:38:23.800 INFO:teuthology.orchestra.run.smithi078.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49373.log.gz 2023-12-12T17:38:23.802 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.321827.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.345869.log 2023-12-12T17:38:23.805 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.140428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187192.log 2023-12-12T17:38:23.806 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.345869.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44586.log 2023-12-12T17:38:23.809 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.187192.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.339848.log 2023-12-12T17:38:23.811 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.44586.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.411910.log 2023-12-12T17:38:23.814 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.339848.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.428082.log 2023-12-12T17:38:23.815 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.411910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110263.log 2023-12-12T17:38:23.816 INFO:teuthology.orchestra.run.smithi078.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.44998.log.gz 2023-12-12T17:38:23.817 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193521.log 2023-12-12T17:38:23.819 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.428082.log: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.170146.log.gz 2023-12-12T17:38:23.821 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.110263.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.513851.log 2023-12-12T17:38:23.822 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.201311.log 2023-12-12T17:38:23.825 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.193521.log: /var/log/ceph/ceph-client.admin.513851.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.108659.log.gz 2023-12-12T17:38:23.826 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.521013.log 2023-12-12T17:38:23.827 INFO:teuthology.orchestra.run.smithi078.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.237660.log.gz 2023-12-12T17:38:23.827 INFO:teuthology.orchestra.run.smithi078.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.513851.log.gz 2023-12-12T17:38:23.828 INFO:teuthology.orchestra.run.smithi078.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.193521.log.gz 2023-12-12T17:38:23.829 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.201311.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-12-12T17:38:23.830 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.380899.log 2023-12-12T17:38:23.832 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.521013.log: /var/log/ceph/ceph.audit.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.521013.log.gz 2023-12-12T17:38:23.832 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88390.log 2023-12-12T17:38:23.834 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.380899.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.378188.log 2023-12-12T17:38:23.837 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.88390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.400755.log 2023-12-12T17:38:23.839 INFO:teuthology.orchestra.run.smithi078.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.220595.log.gz 2023-12-12T17:38:23.839 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46766.log 2023-12-12T17:38:23.839 INFO:teuthology.orchestra.run.smithi078.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.224681.log.gz 2023-12-12T17:38:23.840 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.378188.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47297.log 2023-12-12T17:38:23.846 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.400755.log: /var/log/ceph/ceph-client.admin.46766.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.376557.log 2023-12-12T17:38:23.846 INFO:teuthology.orchestra.run.smithi078.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.412724.log.gz 2023-12-12T17:38:23.847 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47297.log: 77.5% -- replaced with /var/log/ceph/ceph-client.admin.425156.log.gz 2023-12-12T17:38:23.847 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2023-12-12T17:38:23.848 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.376557.log: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.173668.log.gz 2023-12-12T17:38:23.849 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104541.log 2023-12-12T17:38:23.851 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-mds.c.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.451878.log.gz 2023-12-12T17:38:23.852 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.342119.log 2023-12-12T17:38:23.853 INFO:teuthology.orchestra.run.smithi078.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.236401.log.gz 2023-12-12T17:38:23.854 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.458570.log 2023-12-12T17:38:23.857 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.104541.log: /var/log/ceph/ceph-client.admin.342119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181613.log 2023-12-12T17:38:23.858 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.458570.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172835.log 2023-12-12T17:38:23.860 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.181613.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112282.log 2023-12-12T17:38:23.863 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.172835.log: 83.1% -- replaced with /var/log/ceph/ceph-client.admin.428082.log.gz 2023-12-12T17:38:23.863 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183778.log 2023-12-12T17:38:23.865 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.112282.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.329913.log 2023-12-12T17:38:23.867 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.183778.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.510863.log 2023-12-12T17:38:23.869 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.329913.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.427623.log 2023-12-12T17:38:23.871 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.510863.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.490504.log 2023-12-12T17:38:23.872 INFO:teuthology.orchestra.run.smithi078.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.510863.log.gz 2023-12-12T17:38:23.874 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.427623.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.354351.log 2023-12-12T17:38:23.876 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.490504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.252761.log 2023-12-12T17:38:23.878 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.354351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119737.log 2023-12-12T17:38:23.880 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.252761.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2023-12-12T17:38:23.882 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.119737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47825.log 2023-12-12T17:38:23.883 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.380899.log.gz 2023-12-12T17:38:23.885 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-mds.a.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.411910.log.gz 2023-12-12T17:38:23.885 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.441557.log 2023-12-12T17:38:23.886 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.463096.log 2023-12-12T17:38:23.888 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47825.log: /var/log/ceph/ceph-client.admin.441557.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.515541.log 2023-12-12T17:38:23.889 INFO:teuthology.orchestra.run.smithi078.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.325478.log.gz 2023-12-12T17:38:23.890 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.463096.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115509.log 2023-12-12T17:38:23.891 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.515541.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.331598.log.gz 2023-12-12T17:38:23.893 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141269.log 2023-12-12T17:38:23.894 INFO:teuthology.orchestra.run.smithi078.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.515541.log.gz 2023-12-12T17:38:23.895 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.115509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47453.log 2023-12-12T17:38:23.898 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.141269.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177131.log 2023-12-12T17:38:23.898 INFO:teuthology.orchestra.run.smithi078.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.406061.log.gz 2023-12-12T17:38:23.899 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.457322.log 2023-12-12T17:38:23.901 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47453.log: /var/log/ceph/ceph-client.admin.177131.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.460263.log 2023-12-12T17:38:23.903 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.457322.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.331195.log 2023-12-12T17:38:23.905 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.460263.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.206768.log 2023-12-12T17:38:23.907 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.331195.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.373580.log 2023-12-12T17:38:23.909 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.206768.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.104541.log.gz 2023-12-12T17:38:23.910 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.326280.log 2023-12-12T17:38:23.911 INFO:teuthology.orchestra.run.smithi078.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.115509.log.gz 2023-12-12T17:38:23.911 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.323882.log 2023-12-12T17:38:23.913 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.326280.log: /var/log/ceph/ceph-client.admin.373580.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.346279.log 2023-12-12T17:38:23.916 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.323882.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45701.log 2023-12-12T17:38:23.917 INFO:teuthology.orchestra.run.smithi078.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.119737.log.gz 2023-12-12T17:38:23.917 INFO:teuthology.orchestra.run.smithi078.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48932.log.gz 2023-12-12T17:38:23.917 INFO:teuthology.orchestra.run.smithi078.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.48012.log.gz 2023-12-12T17:38:23.918 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.346279.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.351326.log 2023-12-12T17:38:23.921 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.357250.log 2023-12-12T17:38:23.921 INFO:teuthology.orchestra.run.smithi078.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.200017.log.gz 2023-12-12T17:38:23.922 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.45701.log: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.201311.log.gz 2023-12-12T17:38:23.923 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.520115.log 2023-12-12T17:38:23.925 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.351326.log: /var/log/ceph/ceph-client.admin.357250.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.357689.log 2023-12-12T17:38:23.925 INFO:teuthology.orchestra.run.smithi078.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.320938.log.gz 2023-12-12T17:38:23.928 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.218934.log 2023-12-12T17:38:23.930 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.520115.log: /var/log/ceph/ceph-client.admin.357689.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.520115.log.gz 2023-12-12T17:38:23.930 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.359124.log 2023-12-12T17:38:23.932 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.218934.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.432329.log 2023-12-12T17:38:23.934 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.359124.log: 92.7% -- replaced with /var/log/ceph/ceph-client.admin.329101.log.gz 2023-12-12T17:38:23.936 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48116.log 2023-12-12T17:38:23.936 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.394220.log.gz 2023-12-12T17:38:23.937 INFO:teuthology.orchestra.run.smithi078.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45701.log.gz 2023-12-12T17:38:23.938 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.432329.log: 78.9% -- replaced with /var/log/ceph/ceph-client.admin.185462.log.gz 2023-12-12T17:38:23.938 INFO:teuthology.orchestra.run.smithi078.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47297.log.gz 2023-12-12T17:38:23.939 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.346698.log 2023-12-12T17:38:23.942 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.48116.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190626.log 2023-12-12T17:38:23.946 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.346698.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166467.log 2023-12-12T17:38:23.948 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.190626.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48828.log 2023-12-12T17:38:23.951 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.166467.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.220586.log 2023-12-12T17:38:23.954 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.48828.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.312718.log 2023-12-12T17:38:23.955 INFO:teuthology.orchestra.run.smithi078.stderr: 83.1% -- replaced with /var/log/ceph/ceph-client.admin.195924.log.gz 2023-12-12T17:38:23.957 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.220586.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.347100.log 2023-12-12T17:38:23.961 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.312718.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48352.log 2023-12-12T17:38:23.963 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.347100.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49036.log 2023-12-12T17:38:23.966 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.48352.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.342521.log 2023-12-12T17:38:23.969 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.49036.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.329506.log 2023-12-12T17:38:23.972 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.342521.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.502830.log 2023-12-12T17:38:23.974 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.329506.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46461.log 2023-12-12T17:38:23.975 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.502830.log: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.502830.log.gz 2023-12-12T17:38:23.976 INFO:teuthology.orchestra.run.smithi078.stderr: 78.0% -- replaced with /var/log/ceph/ceph-client.admin.350442.log.gz 2023-12-12T17:38:23.977 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.334819.log 2023-12-12T17:38:23.979 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.46461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.266168.log 2023-12-12T17:38:23.982 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.334819.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121837.log 2023-12-12T17:38:23.985 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.266168.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.322238.log 2023-12-12T17:38:23.988 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.121837.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.466129.log 2023-12-12T17:38:23.991 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.322238.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.264538.log 2023-12-12T17:38:23.994 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.466129.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.393381.log 2023-12-12T17:38:23.996 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.264538.log: 77.6% -- replaced with /var/log/ceph/ceph-client.admin.458570.log.gz 2023-12-12T17:38:23.997 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.390319.log 2023-12-12T17:38:23.998 INFO:teuthology.orchestra.run.smithi078.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.457774.log.gz 2023-12-12T17:38:23.999 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.393381.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.512152.log 2023-12-12T17:38:24.002 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.390319.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.389561.log 2023-12-12T17:38:24.005 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.512152.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.450996.log 2023-12-12T17:38:24.007 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.389561.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.430276.log 2023-12-12T17:38:24.009 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.450996.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.413561.log.gz 2023-12-12T17:38:24.010 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.214332.log 2023-12-12T17:38:24.011 INFO:teuthology.orchestra.run.smithi078.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.512152.log.gz 2023-12-12T17:38:24.013 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.430276.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.437806.log 2023-12-12T17:38:24.014 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.214332.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.427623.log.gz 2023-12-12T17:38:24.015 INFO:teuthology.orchestra.run.smithi078.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.441557.log.gz 2023-12-12T17:38:24.015 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.356312.log 2023-12-12T17:38:24.017 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.437806.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.463096.log.gz 2023-12-12T17:38:24.018 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.467020.log 2023-12-12T17:38:24.019 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.356312.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.378188.log.gz 2023-12-12T17:38:24.020 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.216491.log 2023-12-12T17:38:24.022 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.467020.log: 92.7% -- replaced with /var/log/ceph/ceph-client.admin.375695.log.gz 2023-12-12T17:38:24.023 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.315959.log 2023-12-12T17:38:24.024 INFO:teuthology.orchestra.run.smithi078.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.231199.log.gz 2023-12-12T17:38:24.026 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.216491.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.320537.log 2023-12-12T17:38:24.028 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.315959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.261504.log 2023-12-12T17:38:24.029 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.376557.log.gz 2023-12-12T17:38:24.029 INFO:teuthology.orchestra.run.smithi078.stderr: 81.9%/var/log/ceph/ceph-client.admin.320537.log: -- replaced with /var/log/ceph/ceph-client.admin.177131.log.gz 2023-12-12T17:38:24.031 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.485017.log 2023-12-12T17:38:24.034 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.261504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.383349.log 2023-12-12T17:38:24.038 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.485017.log: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.227948.log.gz 2023-12-12T17:38:24.039 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.402384.log 2023-12-12T17:38:24.041 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.383349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.234147.log 2023-12-12T17:38:24.041 INFO:teuthology.orchestra.run.smithi078.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.189344.log.gz 2023-12-12T17:38:24.043 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.402384.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179837.log 2023-12-12T17:38:24.046 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.431931.log 2023-12-12T17:38:24.049 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.234147.log: /var/log/ceph/ceph-client.admin.179837.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.505827.log 2023-12-12T17:38:24.050 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.431931.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49790.log.gz 2023-12-12T17:38:24.051 INFO:teuthology.orchestra.run.smithi078.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.44053.log.gz 2023-12-12T17:38:24.051 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47089.log 2023-12-12T17:38:24.052 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.319742.log 2023-12-12T17:38:24.055 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.505827.log: /var/log/ceph/ceph-client.admin.47089.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.214322.log 2023-12-12T17:38:24.055 INFO:teuthology.orchestra.run.smithi078.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.505827.log.gz 2023-12-12T17:38:24.055 INFO:teuthology.orchestra.run.smithi078.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.118113.log.gz 2023-12-12T17:38:24.056 INFO:teuthology.orchestra.run.smithi078.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.118506.log.gz 2023-12-12T17:38:24.057 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.319742.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.230772.log.gz 2023-12-12T17:38:24.057 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.439414.log 2023-12-12T17:38:24.059 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.214322.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.520805.log 2023-12-12T17:38:24.062 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.439414.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.242124.log.gz 2023-12-12T17:38:24.062 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193119.log 2023-12-12T17:38:24.063 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.520805.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.183778.log.gz 2023-12-12T17:38:24.064 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.498956.log 2023-12-12T17:38:24.065 INFO:teuthology.orchestra.run.smithi078.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.520805.log.gz 2023-12-12T17:38:24.065 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.342933.log 2023-12-12T17:38:24.065 INFO:teuthology.orchestra.run.smithi078.stderr: 77.3% -- replaced with /var/log/ceph/ceph-client.admin.321827.log.gz 2023-12-12T17:38:24.066 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.498956.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.498956.log.gz 2023-12-12T17:38:24.068 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.193119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167280.log 2023-12-12T17:38:24.068 INFO:teuthology.orchestra.run.smithi078.stderr: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.140428.log.gz 2023-12-12T17:38:24.068 INFO:teuthology.orchestra.run.smithi078.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.323033.log.gz 2023-12-12T17:38:24.069 INFO:teuthology.orchestra.run.smithi078.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.326280.log.gz 2023-12-12T17:38:24.069 INFO:teuthology.orchestra.run.smithi078.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.105746.log.gz 2023-12-12T17:38:24.070 INFO:teuthology.orchestra.run.smithi078.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.48116.log.gz 2023-12-12T17:38:24.070 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.342933.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.318819.log 2023-12-12T17:38:24.071 INFO:teuthology.orchestra.run.smithi078.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48326.log.gz 2023-12-12T17:38:24.072 INFO:teuthology.orchestra.run.smithi078.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.341260.log.gz 2023-12-12T17:38:24.073 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.261513.log 2023-12-12T17:38:24.075 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.167280.log: /var/log/ceph/ceph-client.admin.318819.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.448695.log 2023-12-12T17:38:24.076 INFO:teuthology.orchestra.run.smithi078.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.320537.log.gz 2023-12-12T17:38:24.078 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.448695.log: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.329506.log.gz 2023-12-12T17:38:24.079 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.261513.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178600.log 2023-12-12T17:38:24.079 INFO:teuthology.orchestra.run.smithi078.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.393381.log.gz 2023-12-12T17:38:24.080 INFO:teuthology.orchestra.run.smithi078.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.467020.log.gz 2023-12-12T17:38:24.080 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.342933.log.gz 2023-12-12T17:38:24.080 INFO:teuthology.orchestra.run.smithi078.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.218934.log.gz 2023-12-12T17:38:24.081 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.478814.log 2023-12-12T17:38:24.082 INFO:teuthology.orchestra.run.smithi078.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.226740.log.gz 2023-12-12T17:38:24.083 INFO:teuthology.orchestra.run.smithi078.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.45025.log.gz 2023-12-12T17:38:24.084 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.178600.log: /var/log/ceph/ceph-client.admin.478814.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47609.log.gz 2023-12-12T17:38:24.085 INFO:teuthology.orchestra.run.smithi078.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47089.log.gz 2023-12-12T17:38:24.085 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91010.log 2023-12-12T17:38:24.085 INFO:teuthology.orchestra.run.smithi078.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.179837.log.gz 2023-12-12T17:38:24.086 INFO:teuthology.orchestra.run.smithi078.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.193119.log.gz 2023-12-12T17:38:24.087 INFO:teuthology.orchestra.run.smithi078.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.109468.log.gz 2023-12-12T17:38:24.087 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.343762.log 2023-12-12T17:38:24.088 INFO:teuthology.orchestra.run.smithi078.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.167280.log.gz 2023-12-12T17:38:24.088 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.338144.log 2023-12-12T17:38:24.091 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.343762.log: /var/log/ceph/ceph-client.admin.91010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.319733.log 2023-12-12T17:38:24.093 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.338144.log: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.432329.log.gz 2023-12-12T17:38:24.093 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114704.log 2023-12-12T17:38:24.095 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.319733.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.309490.log 2023-12-12T17:38:24.098 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.114704.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.513426.log 2023-12-12T17:38:24.100 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.309490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.413962.log 2023-12-12T17:38:24.103 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45704.log 2023-12-12T17:38:24.105 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.513426.log: /var/log/ceph/ceph-client.admin.413962.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91413.log 2023-12-12T17:38:24.106 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.45704.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.354360.log 2023-12-12T17:38:24.110 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.91413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.263301.log 2023-12-12T17:38:24.114 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.354360.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.441100.log 2023-12-12T17:38:24.114 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.263301.log: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.513426.log.gz 2023-12-12T17:38:24.114 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47557.log 2023-12-12T17:38:24.115 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.437806.log.gz 2023-12-12T17:38:24.116 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.441100.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.439414.log.gz 2023-12-12T17:38:24.118 INFO:teuthology.orchestra.run.smithi078.stderr:gzip 85.3% -- replaced with /var/log/ceph/ceph-client.admin.390319.log.gz -5 2023-12-12T17:38:24.118 INFO:teuthology.orchestra.run.smithi078.stderr: --verbose -- /var/log/ceph/ceph-client.admin.390593.log 2023-12-12T17:38:24.119 INFO:teuthology.orchestra.run.smithi078.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.414355.log.gz 2023-12-12T17:38:24.119 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.450602.log.gz 2023-12-12T17:38:24.120 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.413962.log.gz 2023-12-12T17:38:24.122 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47557.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106152.log 2023-12-12T17:38:24.124 INFO:teuthology.orchestra.run.smithi078.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.478805.log.gz 2023-12-12T17:38:24.124 INFO:teuthology.orchestra.run.smithi078.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.430276.log.gz 2023-12-12T17:38:24.125 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.390593.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.436081.log 2023-12-12T17:38:24.127 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.106152.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.346689.log 2023-12-12T17:38:24.130 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.436081.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.349990.log 2023-12-12T17:38:24.132 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.346689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44868.log 2023-12-12T17:38:24.133 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.439003.log 2023-12-12T17:38:24.136 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.349990.log: /var/log/ceph/ceph-client.admin.44868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.381722.log 2023-12-12T17:38:24.138 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.439003.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.428091.log 2023-12-12T17:38:24.140 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.381722.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.214837.log 2023-12-12T17:38:24.142 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.428091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139607.log 2023-12-12T17:38:24.144 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.214837.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.339382.log 2023-12-12T17:38:24.146 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.139607.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.201713.log 2023-12-12T17:38:24.148 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.339382.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.383340.log 2023-12-12T17:38:24.151 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.201713.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45420.log 2023-12-12T17:38:24.153 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.383340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.401170.log 2023-12-12T17:38:24.155 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.45420.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.429018.log 2023-12-12T17:38:24.157 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.401170.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.516391.log 2023-12-12T17:38:24.159 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.429018.log: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.374853.log.gz 2023-12-12T17:38:24.160 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.198758.log 2023-12-12T17:38:24.163 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.516391.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.489287.log 2023-12-12T17:38:24.164 INFO:teuthology.orchestra.run.smithi078.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.516391.log.gz 2023-12-12T17:38:24.165 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194727.log 2023-12-12T17:38:24.167 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.198758.log: /var/log/ceph/ceph-client.admin.489287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.505421.log 2023-12-12T17:38:24.170 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.194727.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191066.log 2023-12-12T17:38:24.172 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.505421.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.451473.log 2023-12-12T17:38:24.174 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.191066.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.505421.log.gz 2023-12-12T17:38:24.175 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.356784.log 2023-12-12T17:38:24.178 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.451473.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.232475.log 2023-12-12T17:38:24.179 INFO:teuthology.orchestra.run.smithi078.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.328699.log.gz 2023-12-12T17:38:24.180 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.356784.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.263292.log 2023-12-12T17:38:24.183 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.232475.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191907.log 2023-12-12T17:38:24.186 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.263292.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178591.log 2023-12-12T17:38:24.190 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.191907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.447420.log 2023-12-12T17:38:24.192 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.178591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.212998.log 2023-12-12T17:38:24.196 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.447420.log: 78.3% -- replaced with /var/log/ceph/ceph-client.admin.223413.log.gz 88.0% 2023-12-12T17:38:24.196 INFO:teuthology.orchestra.run.smithi078.stderr: -- replaced with /var/log/ceph/ceph-client.admin.49218.log.gz 2023-12-12T17:38:24.196 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167678.log 2023-12-12T17:38:24.197 INFO:teuthology.orchestra.run.smithi078.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.338144.log.gz 2023-12-12T17:38:24.198 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.212998.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.325487.log 2023-12-12T17:38:24.200 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.167678.log: 79.3% -- replaced with /var/log/ceph/ceph-client.admin.339382.log.gz 2023-12-12T17:38:24.201 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.349120.log 2023-12-12T17:38:24.202 INFO:teuthology.orchestra.run.smithi078.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45704.log.gz 2023-12-12T17:38:24.203 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.325487.log: 92.7% -- replaced with /var/log/ceph/ceph-client.admin.151366.log.gz 2023-12-12T17:38:24.204 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.498517.log 2023-12-12T17:38:24.207 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.349120.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.250742.log 2023-12-12T17:38:24.211 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.498517.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.208418.log 2023-12-12T17:38:24.211 INFO:teuthology.orchestra.run.smithi078.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.498517.log.gz 2023-12-12T17:38:24.213 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.425165.log 2023-12-12T17:38:24.216 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.208418.log: /var/log/ceph/ceph-client.admin.250742.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.348718.log 2023-12-12T17:38:24.218 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.425165.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.325487.log.gz 2023-12-12T17:38:24.218 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.413552.log 2023-12-12T17:38:24.218 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.348718.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44868.log.gz 2023-12-12T17:38:24.220 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.452271.log 2023-12-12T17:38:24.220 INFO:teuthology.orchestra.run.smithi078.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.383349.log.gz 2023-12-12T17:38:24.222 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.413552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188044.log 2023-12-12T17:38:24.224 INFO:teuthology.orchestra.run.smithi078.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.47219.log.gz 2023-12-12T17:38:24.225 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.452271.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47557.log.gz 2023-12-12T17:38:24.225 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.357698.log 2023-12-12T17:38:24.226 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.188044.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44086.log.gz 2023-12-12T17:38:24.229 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96062.log 2023-12-12T17:38:24.231 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.357698.log: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.212123.log.gz 2023-12-12T17:38:24.232 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170137.log 2023-12-12T17:38:24.233 INFO:teuthology.orchestra.run.smithi078.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.111880.log.gz 2023-12-12T17:38:24.236 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.96062.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.469450.log 2023-12-12T17:38:24.238 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.170137.log: gzip 90.2% -- replaced with /var/log/ceph/ceph-client.admin.376959.log.gz -5 2023-12-12T17:38:24.238 INFO:teuthology.orchestra.run.smithi078.stderr: --verbose -- /var/log/ceph/ceph-client.admin.48750.log 2023-12-12T17:38:24.238 INFO:teuthology.orchestra.run.smithi078.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.214322.log.gz 2023-12-12T17:38:24.240 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.469450.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.319733.log.gz 2023-12-12T17:38:24.241 INFO:teuthology.orchestra.run.smithi078.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.216491.log.gz 2023-12-12T17:38:24.241 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.252770.log.gz 2023-12-12T17:38:24.241 INFO:teuthology.orchestra.run.smithi078.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.167678.log.gz 2023-12-12T17:38:24.241 INFO:teuthology.orchestra.run.smithi078.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.192706.log.gz 2023-12-12T17:38:24.242 INFO:teuthology.orchestra.run.smithi078.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.439003.log.gz 2023-12-12T17:38:24.242 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.506221.log 2023-12-12T17:38:24.243 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.319742.log.gz 2023-12-12T17:38:24.243 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.332404.log 2023-12-12T17:38:24.245 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.48750.log: /var/log/ceph/ceph-client.admin.506221.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.356784.log.gz 2023-12-12T17:38:24.245 INFO:teuthology.orchestra.run.smithi078.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.436081.log.gz 2023-12-12T17:38:24.245 INFO:teuthology.orchestra.run.smithi078.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.506221.log.gz 2023-12-12T17:38:24.246 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.428091.log.gz 2023-12-12T17:38:24.246 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.425165.log.gz 2023-12-12T17:38:24.247 INFO:teuthology.orchestra.run.smithi078.stderr: 78.4% -- replaced with /var/log/ceph/ceph-client.admin.100901.log.gz 2023-12-12T17:38:24.247 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.404439.log 2023-12-12T17:38:24.248 INFO:teuthology.orchestra.run.smithi078.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.429018.log.gz 2023-12-12T17:38:24.248 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.332404.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.453881.log.gz 2023-12-12T17:38:24.249 INFO:teuthology.orchestra.run.smithi078.stderr: 78.8% -- replaced with /var/log/ceph/ceph-client.admin.237207.log.gz 2023-12-12T17:38:24.249 INFO:teuthology.orchestra.run.smithi078.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.452271.log.gz 2023-12-12T17:38:24.249 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.331992.log 2023-12-12T17:38:24.255 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.404439.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.469450.log.gz 2023-12-12T17:38:24.255 INFO:teuthology.orchestra.run.smithi078.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.397125.log.gz 2023-12-12T17:38:24.255 INFO:teuthology.orchestra.run.smithi078.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.494129.log.gz 2023-12-12T17:38:24.255 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.520753.log 2023-12-12T17:38:24.256 INFO:teuthology.orchestra.run.smithi078.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.347913.log.gz 2023-12-12T17:38:24.256 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.331992.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47167.log 2023-12-12T17:38:24.256 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.520753.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.520753.log.gz 2023-12-12T17:38:24.258 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.213871.log 2023-12-12T17:38:24.260 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47167.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44230.log 2023-12-12T17:38:24.262 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.213871.log: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.185041.log.gz 2023-12-12T17:38:24.263 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.188904.log 2023-12-12T17:38:24.265 INFO:teuthology.orchestra.run.smithi078.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46227.log.gz 2023-12-12T17:38:24.265 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.44230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.234138.log 2023-12-12T17:38:24.268 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.188904.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.254844.log 2023-12-12T17:38:24.270 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.234138.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.502420.log 2023-12-12T17:38:24.271 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.254844.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.261513.log.gz 2023-12-12T17:38:24.274 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.443858.log 2023-12-12T17:38:24.275 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.502420.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.333217.log 2023-12-12T17:38:24.276 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.443858.log: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.502420.log.gz 2023-12-12T17:38:24.278 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.406464.log 2023-12-12T17:38:24.281 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.333217.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45707.log 2023-12-12T17:38:24.282 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.406464.log: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.143759.log.gz 2023-12-12T17:38:24.282 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.446486.log 2023-12-12T17:38:24.285 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.45707.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49896.log 2023-12-12T17:38:24.286 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50104.log 2023-12-12T17:38:24.288 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.446486.log: /var/log/ceph/ceph-client.admin.49896.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.121002.log.gz 2023-12-12T17:38:24.289 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.440687.log 2023-12-12T17:38:24.290 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.443447.log 2023-12-12T17:38:24.292 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.50104.log: /var/log/ceph/ceph-client.admin.440687.log: 78.3% -- replaced with /var/log/ceph/ceph-client.admin.178591.log.gz 2023-12-12T17:38:24.293 INFO:teuthology.orchestra.run.smithi078.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.178600.log.gz 2023-12-12T17:38:24.293 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182486.log 2023-12-12T17:38:24.293 INFO:teuthology.orchestra.run.smithi078.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.168903.log.gz 2023-12-12T17:38:24.294 INFO:teuthology.orchestra.run.smithi078.stderr:gzip/var/log/ceph/ceph-client.admin.443447.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.356303.log 2023-12-12T17:38:24.295 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.182486.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.315552.log.gz 2023-12-12T17:38:24.297 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.233690.log 2023-12-12T17:38:24.300 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.356303.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.402825.log 2023-12-12T17:38:24.303 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.233690.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.245771.log 2023-12-12T17:38:24.305 INFO:teuthology.orchestra.run.smithi078.stderr: 84.1% 79.0% -- replaced with /var/log/ceph/ceph-client.admin.331992.log.gz 2023-12-12T17:38:24.305 INFO:teuthology.orchestra.run.smithi078.stderr: -- replaced with /var/log/ceph/ceph-client.admin.326681.log.gz 2023-12-12T17:38:24.305 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.402825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.443456.log 2023-12-12T17:38:24.306 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.245771.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.315968.log.gz 2023-12-12T17:38:24.307 INFO:teuthology.orchestra.run.smithi078.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.332404.log.gz 2023-12-12T17:38:24.309 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.435679.log 2023-12-12T17:38:24.312 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.443456.log: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.430687.log.gz 2023-12-12T17:38:24.312 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.327092.log 2023-12-12T17:38:24.315 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.435679.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.496839.log 2023-12-12T17:38:24.318 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.327092.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.383340.log.gz 2023-12-12T17:38:24.318 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.498114.log 2023-12-12T17:38:24.321 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.496839.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.496839.log.gz 2023-12-12T17:38:24.321 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47772.log 2023-12-12T17:38:24.323 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.498114.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.247524.log 2023-12-12T17:38:24.324 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47772.log: 78.1% -- replaced with /var/log/ceph/ceph-client.admin.498114.log.gz 2023-12-12T17:38:24.325 INFO:teuthology.orchestra.run.smithi078.stderr: 79.2% -- replaced with /var/log/ceph/ceph-client.admin.345017.log.gz 2023-12-12T17:38:24.326 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186752.log 2023-12-12T17:38:24.327 INFO:teuthology.orchestra.run.smithi078.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.348314.log.gz 2023-12-12T17:38:24.327 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.348718.log.gz 2023-12-12T17:38:24.327 INFO:teuthology.orchestra.run.smithi078.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.435679.log.gz 2023-12-12T17:38:24.329 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.247524.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.447420.log.gz 2023-12-12T17:38:24.329 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.500323.log 2023-12-12T17:38:24.332 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.338547.log 2023-12-12T17:38:24.334 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.186752.log: /var/log/ceph/ceph-client.admin.500323.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45707.log.gz 2023-12-12T17:38:24.335 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.311105.log 2023-12-12T17:38:24.339 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.338547.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.48750.log.gz 2023-12-12T17:38:24.339 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111478.log 2023-12-12T17:38:24.340 INFO:teuthology.orchestra.run.smithi078.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.47167.log.gz 2023-12-12T17:38:24.341 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.311105.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47772.log.gz 2023-12-12T17:38:24.343 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.311923.log 2023-12-12T17:38:24.345 INFO:teuthology.orchestra.run.smithi078.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.349120.log.gz 2023-12-12T17:38:24.347 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.111478.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.240495.log 2023-12-12T17:38:24.348 INFO:teuthology.orchestra.run.smithi078.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.186752.log.gz 2023-12-12T17:38:24.350 INFO:teuthology.orchestra.run.smithi078.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.181613.log.gz 2023-12-12T17:38:24.350 INFO:teuthology.orchestra.run.smithi078.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.170137.log.gz 2023-12-12T17:38:24.350 INFO:teuthology.orchestra.run.smithi078.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.112282.log.gz 2023-12-12T17:38:24.351 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.311923.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44230.log.gz 2023-12-12T17:38:24.353 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143300.log 2023-12-12T17:38:24.353 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.240495.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.234138.log.gz 2023-12-12T17:38:24.353 INFO:teuthology.orchestra.run.smithi078.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.311105.log.gz 2023-12-12T17:38:24.354 INFO:teuthology.orchestra.run.smithi078.stderr: 84.4% -- replaced with /var/log/ceph/ceph-client.admin.379662.log.gz 2023-12-12T17:38:24.354 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.237669.log.gz 2023-12-12T17:38:24.355 INFO:teuthology.orchestra.run.smithi078.stderr: 79.8% -- replaced with /var/log/ceph/ceph-client.admin.151357.log.gz 2023-12-12T17:38:24.355 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.349999.log 2023-12-12T17:38:24.356 INFO:teuthology.orchestra.run.smithi078.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.353459.log.gz 2023-12-12T17:38:24.356 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.143300.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.193923.log.gz 2023-12-12T17:38:24.356 INFO:teuthology.orchestra.run.smithi078.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.96062.log.gz 2023-12-12T17:38:24.357 INFO:teuthology.orchestra.run.smithi078.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.357689.log.gz 2023-12-12T17:38:24.358 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174099.log 2023-12-12T17:38:24.361 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.349999.log: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.244550.log.gz 2023-12-12T17:38:24.362 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190635.log 2023-12-12T17:38:24.362 INFO:teuthology.orchestra.run.smithi078.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.439405.log.gz 2023-12-12T17:38:24.366 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.174099.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48620.log 2023-12-12T17:38:24.366 INFO:teuthology.orchestra.run.smithi078.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.140843.log.gz 2023-12-12T17:38:24.367 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.247533.log.gz 2023-12-12T17:38:24.367 INFO:teuthology.orchestra.run.smithi078.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.247524.log.gz 2023-12-12T17:38:24.369 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.190635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47955.log 2023-12-12T17:38:24.373 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.48620.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.406866.log 2023-12-12T17:38:24.374 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.118515.log.gz 2023-12-12T17:38:24.375 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.501608.log 2023-12-12T17:38:24.379 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.406866.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.386575.log 2023-12-12T17:38:24.381 INFO:teuthology.orchestra.run.smithi078.stderr: 77.8% -- replaced with /var/log/ceph/ceph-client.admin.388312.log.gz 2023-12-12T17:38:24.382 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.501608.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.481208.log 2023-12-12T17:38:24.382 INFO:teuthology.orchestra.run.smithi078.stderr: 77.9% -- replaced with /var/log/ceph/ceph-client.admin.501608.log.gz 2023-12-12T17:38:24.383 INFO:teuthology.orchestra.run.smithi078.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.404439.log.gz 2023-12-12T17:38:24.384 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.386575.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.381297.log 2023-12-12T17:38:24.387 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.481208.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87988.log 2023-12-12T17:38:24.391 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.381297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.501617.log 2023-12-12T17:38:24.395 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.87988.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.520909.log 2023-12-12T17:38:24.398 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.501617.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.520883.log 2023-12-12T17:38:24.399 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.453488.log.gz 2023-12-12T17:38:24.399 INFO:teuthology.orchestra.run.smithi078.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.501617.log.gz 2023-12-12T17:38:24.402 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.520909.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.460263.log.gz 2023-12-12T17:38:24.402 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181217.log 2023-12-12T17:38:24.403 INFO:teuthology.orchestra.run.smithi078.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.520909.log.gz 2023-12-12T17:38:24.405 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.520883.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.439880.log 2023-12-12T17:38:24.406 INFO:teuthology.orchestra.run.smithi078.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.520883.log.gz 2023-12-12T17:38:24.408 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.181217.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.398729.log 2023-12-12T17:38:24.412 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.439880.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.332798.log 2023-12-12T17:38:24.414 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.398729.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.265356.log 2023-12-12T17:38:24.415 INFO:teuthology.orchestra.run.smithi078.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.481208.log.gz 2023-12-12T17:38:24.417 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.332798.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140015.log 2023-12-12T17:38:24.420 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.265356.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.390271.log 2023-12-12T17:38:24.423 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.140015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.453890.log 2023-12-12T17:38:24.426 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.390271.log: gzip 81.2% -- replaced with /var/log/ceph/ceph-client.admin.338547.log.gz 2023-12-12T17:38:24.426 INFO:teuthology.orchestra.run.smithi078.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.45487.log 2023-12-12T17:38:24.428 INFO:teuthology.orchestra.run.smithi078.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.390271.log.gz 2023-12-12T17:38:24.428 INFO:teuthology.orchestra.run.smithi078.stderr: 83.1% -- replaced with /var/log/ceph/ceph-client.admin.393804.log.gz 2023-12-12T17:38:24.430 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.453890.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.218128.log 2023-12-12T17:38:24.433 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.45487.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44920.log 2023-12-12T17:38:24.437 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.218128.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.407268.log 2023-12-12T17:38:24.440 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.44920.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.401568.log 2023-12-12T17:38:24.442 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.407268.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120545.log 2023-12-12T17:38:24.443 INFO:teuthology.orchestra.run.smithi078.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46149.log.gz 2023-12-12T17:38:24.445 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.401568.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46985.log 2023-12-12T17:38:24.448 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.120545.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.415078.log 2023-12-12T17:38:24.450 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.46985.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.394627.log 2023-12-12T17:38:24.453 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.415078.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.464377.log 2023-12-12T17:38:24.458 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.394627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.345026.log 2023-12-12T17:38:24.458 INFO:teuthology.orchestra.run.smithi078.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44920.log.gz 2023-12-12T17:38:24.460 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.464377.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117254.log 2023-12-12T17:38:24.464 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.345026.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.309096.log 2023-12-12T17:38:24.467 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.117254.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.111478.log.gz 2023-12-12T17:38:24.468 INFO:teuthology.orchestra.run.smithi078.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.167687.log.gz 2023-12-12T17:38:24.470 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.204967.log 2023-12-12T17:38:24.470 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.192715.log.gz 2023-12-12T17:38:24.472 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.309096.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.339857.log 2023-12-12T17:38:24.476 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.204967.log: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.239690.log.gz 2023-12-12T17:38:24.478 INFO:teuthology.orchestra.run.smithi078.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.240495.log.gz 2023-12-12T17:38:24.478 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.377353.log 2023-12-12T17:38:24.480 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.339857.log: 91.6% -- replaced with /var/log/ceph/ceph-client.admin.357698.log.gz 2023-12-12T17:38:24.480 INFO:teuthology.orchestra.run.smithi078.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.403227.log.gz 2023-12-12T17:38:24.481 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45483.log 2023-12-12T17:38:24.484 INFO:teuthology.orchestra.run.smithi078.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.439880.log.gz 2023-12-12T17:38:24.484 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.377353.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168089.log 2023-12-12T17:38:24.486 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.45483.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.87988.log.gz 2023-12-12T17:38:24.487 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.456044.log 2023-12-12T17:38:24.487 INFO:teuthology.orchestra.run.smithi078.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.426362.log.gz 2023-12-12T17:38:24.491 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.168089.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.438199.log 2023-12-12T17:38:24.492 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.311923.log.gz 2023-12-12T17:38:24.494 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.456044.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45487.log.gz 2023-12-12T17:38:24.495 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.376109.log 2023-12-12T17:38:24.497 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.438199.log: 77.6% -- replaced with /var/log/ceph/ceph-client.admin.386575.log.gz 2023-12-12T17:38:24.498 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.199596.log 2023-12-12T17:38:24.501 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.376109.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114299.log 2023-12-12T17:38:24.504 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.199596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.310712.log 2023-12-12T17:38:24.506 INFO:teuthology.orchestra.run.smithi078.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46357.log.gz 2023-12-12T17:38:24.507 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.114299.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46515.log.gz 2023-12-12T17:38:24.508 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.385689.log 2023-12-12T17:38:24.511 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.310712.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.264945.log 2023-12-12T17:38:24.515 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.385689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.225645.log 2023-12-12T17:38:24.518 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.264945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47877.log 2023-12-12T17:38:24.521 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.225645.log: 77.5% -- replaced with /var/log/ceph/ceph-client.admin.398729.log.gz 2023-12-12T17:38:24.523 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.199587.log 2023-12-12T17:38:24.523 INFO:teuthology.orchestra.run.smithi078.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.401568.log.gz 2023-12-12T17:38:24.526 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47877.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.501205.log 2023-12-12T17:38:24.526 INFO:teuthology.orchestra.run.smithi078.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.182486.log.gz 2023-12-12T17:38:24.529 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.199587.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.507098.log 2023-12-12T17:38:24.530 INFO:teuthology.orchestra.run.smithi078.stderr: 96.7% -- replaced with /var/log/ceph/ceph-client.admin.500323.log.gz 2023-12-12T17:38:24.531 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.501205.log: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.202548.log.gz 2023-12-12T17:38:24.533 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44456.log 2023-12-12T17:38:24.534 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.204967.log.gz 2023-12-12T17:38:24.534 INFO:teuthology.orchestra.run.smithi078.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.501205.log.gz 2023-12-12T17:38:24.536 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.507098.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108253.log 2023-12-12T17:38:24.537 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.44456.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.339857.log.gz 2023-12-12T17:38:24.538 INFO:teuthology.orchestra.run.smithi078.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.507098.log.gz 2023-12-12T17:38:24.539 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140024.log 2023-12-12T17:38:24.540 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.108253.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.436957.log 2023-12-12T17:38:24.542 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.140024.log: 84.1% 90.2% -- replaced with /var/log/ceph/ceph-client.admin.333217.log.gz -- replaced with /var/log/ceph/ceph-client.admin.345869.log.gz 2023-12-12T17:38:24.542 INFO:teuthology.orchestra.run.smithi078.stderr: 2023-12-12T17:38:24.543 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.477578.log 2023-12-12T17:38:24.543 INFO:teuthology.orchestra.run.smithi078.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.334828.log.gz 2023-12-12T17:38:24.546 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.436957.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.242924.log 2023-12-12T17:38:24.549 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.477578.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.384590.log 2023-12-12T17:38:24.550 INFO:teuthology.orchestra.run.smithi078.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47877.log.gz 2023-12-12T17:38:24.553 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.242924.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91001.log 2023-12-12T17:38:24.554 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.425567.log 2023-12-12T17:38:24.555 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.384590.log: /var/log/ceph/ceph-client.admin.91001.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.223019.log.gz 2023-12-12T17:38:24.557 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.397532.log 2023-12-12T17:38:24.557 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.425567.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.149607.log.gz 2023-12-12T17:38:24.559 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.389963.log 2023-12-12T17:38:24.559 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.168089.log.gz 2023-12-12T17:38:24.562 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.397532.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.249947.log 2023-12-12T17:38:24.563 INFO:teuthology.orchestra.run.smithi078.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.144219.log.gz 2023-12-12T17:38:24.564 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.241309.log 2023-12-12T17:38:24.566 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.389963.log: /var/log/ceph/ceph-client.admin.249947.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.520701.log 2023-12-12T17:38:24.568 INFO:teuthology.orchestra.run.smithi078.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.347100.log.gz 2023-12-12T17:38:24.570 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.241309.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.211684.log 2023-12-12T17:38:24.572 INFO:teuthology.orchestra.run.smithi078.stderr:gzip/var/log/ceph/ceph-client.admin.520701.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.181622.log 2023-12-12T17:38:24.573 INFO:teuthology.orchestra.run.smithi078.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.354351.log.gz 2023-12-12T17:38:24.575 INFO:teuthology.orchestra.run.smithi078.stderr:gzip 87.2% -5 -- replaced with /var/log/ceph/ceph-client.admin.520701.log.gz --verbose 2023-12-12T17:38:24.575 INFO:teuthology.orchestra.run.smithi078.stderr: -- /var/log/ceph/ceph-client.admin.313944.log 2023-12-12T17:38:24.575 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.211684.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.310712.log.gz 2023-12-12T17:38:24.577 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.181622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.347511.log 2023-12-12T17:38:24.581 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.313944.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.467436.log 2023-12-12T17:38:24.582 INFO:teuthology.orchestra.run.smithi078.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.425567.log.gz 2023-12-12T17:38:24.584 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.347511.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.88390.log.gz 2023-12-12T17:38:24.584 INFO:teuthology.orchestra.run.smithi078.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.456044.log.gz 2023-12-12T17:38:24.585 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.406473.log 2023-12-12T17:38:24.586 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.467436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47479.log 2023-12-12T17:38:24.588 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.406473.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.411508.log 2023-12-12T17:38:24.589 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47479.log: 83.9% -- replaced with /var/log/ceph/ceph-client.admin.384590.log.gz 2023-12-12T17:38:24.590 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.398327.log 2023-12-12T17:38:24.591 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.411508.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.397532.log.gz 2023-12-12T17:38:24.593 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.200886.log 2023-12-12T17:38:24.593 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.398327.log: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.199587.log.gz 2023-12-12T17:38:24.596 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.492517.log 2023-12-12T17:38:24.596 INFO:teuthology.orchestra.run.smithi078.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.334819.log.gz 2023-12-12T17:38:24.597 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.309096.log.gz 2023-12-12T17:38:24.598 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.200886.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.411508.log.gz 2023-12-12T17:38:24.599 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.491308.log 2023-12-12T17:38:24.599 INFO:teuthology.orchestra.run.smithi078.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.477578.log.gz 2023-12-12T17:38:24.600 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.492517.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47193.log 2023-12-12T17:38:24.603 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.491308.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.254835.log 2023-12-12T17:38:24.604 INFO:teuthology.orchestra.run.smithi078.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.206768.log.gz 2023-12-12T17:38:24.605 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.377362.log 2023-12-12T17:38:24.606 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47193.log: /var/log/ceph/ceph-client.admin.254835.log: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.351770.log.gz 2023-12-12T17:38:24.607 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.458579.log 2023-12-12T17:38:24.608 INFO:teuthology.orchestra.run.smithi078.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.413552.log.gz 2023-12-12T17:38:24.609 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.377362.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.332807.log 2023-12-12T17:38:24.612 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.458579.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.519409.log 2023-12-12T17:38:24.614 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.353066.log 2023-12-12T17:38:24.615 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.332807.log: /var/log/ceph/ceph-client.admin.519409.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.519409.log.gz 2023-12-12T17:38:24.617 INFO:teuthology.orchestra.run.smithi078.stderr: 80.9%gzip -- replaced with /var/log/ceph/ceph-client.admin.117254.log.gz -5 2023-12-12T17:38:24.617 INFO:teuthology.orchestra.run.smithi078.stderr: --verbose -- /var/log/ceph/ceph-client.admin.502025.log 2023-12-12T17:38:24.618 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.353066.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.114299.log.gz 2023-12-12T17:38:24.619 INFO:teuthology.orchestra.run.smithi078.stderr: 77.2% -- replaced with /var/log/ceph/ceph-client.admin.314744.log.gz 2023-12-12T17:38:24.620 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114290.log 2023-12-12T17:38:24.622 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.502025.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46305.log 2023-12-12T17:38:24.624 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.114290.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.502025.log.gz 2023-12-12T17:38:24.624 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.468231.log 2023-12-12T17:38:24.628 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.46305.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.351317.log 2023-12-12T17:38:24.629 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.468231.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47720.log 2023-12-12T17:38:24.631 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.351317.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.48620.log.gz 2023-12-12T17:38:24.632 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.465581.log 2023-12-12T17:38:24.634 INFO:teuthology.orchestra.run.smithi078.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.143300.log.gz 2023-12-12T17:38:24.635 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47720.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185471.log 2023-12-12T17:38:24.637 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5/var/log/ceph/ceph-client.admin.465581.log: --verbose -- /var/log/ceph/ceph-client.admin.175356.log 2023-12-12T17:38:24.639 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.185471.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48828.log.gz 2023-12-12T17:38:24.639 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.228386.log 2023-12-12T17:38:24.641 INFO:teuthology.orchestra.run.smithi078.stderr: 77.9% -- replaced with /var/log/ceph/ceph-client.admin.141269.log.gz 2023-12-12T17:38:24.643 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.175356.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49816.log 2023-12-12T17:38:24.643 INFO:teuthology.orchestra.run.smithi078.stderr: 79.7% -- replaced with /var/log/ceph/ceph-client.admin.339848.log.gz 2023-12-12T17:38:24.645 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.228386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48854.log 2023-12-12T17:38:24.648 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.49816.log: 77.5%gzip -- replaced with /var/log/ceph/ceph-client.admin.468231.log.gz 2023-12-12T17:38:24.648 INFO:teuthology.orchestra.run.smithi078.stderr: -5 --verbose 81.5% -- -- replaced with /var/log/ceph/ceph-client.admin.120545.log.gz /var/log/ceph/ceph-client.admin.116817.log 2023-12-12T17:38:24.649 INFO:teuthology.orchestra.run.smithi078.stderr: 2023-12-12T17:38:24.651 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.48854.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.449797.log 2023-12-12T17:38:24.653 INFO:teuthology.orchestra.run.smithi078.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47193.log.gz 2023-12-12T17:38:24.654 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.116817.log: 91.6% -- replaced with /var/log/ceph/ceph-client.admin.46541.log.gz 2023-12-12T17:38:24.654 INFO:teuthology.orchestra.run.smithi078.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.47479.log.gz 2023-12-12T17:38:24.655 INFO:teuthology.orchestra.run.smithi078.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49816.log.gz 2023-12-12T17:38:24.655 INFO:teuthology.orchestra.run.smithi078.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47720.log.gz 2023-12-12T17:38:24.655 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.488482.log 2023-12-12T17:38:24.658 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.449797.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.91001.log.gz 81.0% 2023-12-12T17:38:24.658 INFO:teuthology.orchestra.run.smithi078.stderr: -- replaced with /var/log/ceph/ceph-client.admin.175356.log.gz 2023-12-12T17:38:24.658 INFO:teuthology.orchestra.run.smithi078.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.185892.log.gz 2023-12-12T17:38:24.659 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195522.log 2023-12-12T17:38:24.660 INFO:teuthology.orchestra.run.smithi078.stderr: 79.4% -- replaced with /var/log/ceph/ceph-client.admin.409315.log.gz 2023-12-12T17:38:24.662 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.488482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.459852.log 2023-12-12T17:38:24.662 INFO:teuthology.orchestra.run.smithi078.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.212998.log.gz 2023-12-12T17:38:24.664 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.195522.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.353066.log.gz 2023-12-12T17:38:24.664 INFO:teuthology.orchestra.run.smithi078.stderr: 77.5% -- replaced with /var/log/ceph/ceph-client.admin.402384.log.gz 2023-12-12T17:38:24.664 INFO:teuthology.orchestra.run.smithi078.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.436957.log.gz 2023-12-12T17:38:24.665 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167271.log 2023-12-12T17:38:24.666 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.459852.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.240504.log.gz 2023-12-12T17:38:24.668 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.412317.log 2023-12-12T17:38:24.671 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.167271.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44482.log 2023-12-12T17:38:24.672 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.485656.log 2023-12-12T17:38:24.673 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.44482.log: /var/log/ceph/ceph-client.admin.412317.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49439.log 2023-12-12T17:38:24.674 INFO:teuthology.orchestra.run.smithi078.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.492517.log.gz 2023-12-12T17:38:24.674 INFO:teuthology.orchestra.run.smithi078.stderr: 81.6%/var/log/ceph/ceph-client.admin.485656.log: -- replaced with /var/log/ceph/ceph-client.admin.261504.log.gz 2023-12-12T17:38:24.676 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.503571.log 2023-12-12T17:38:24.679 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.49439.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38359.log 2023-12-12T17:38:24.681 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122244.log 2023-12-12T17:38:24.682 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.503571.log: /var/log/ceph/ceph-client.admin.38359.log: 78.9% -- replaced with /var/log/ceph/ceph-client.admin.489287.log.gz 2023-12-12T17:38:24.684 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.393390.log 85.6% 2023-12-12T17:38:24.684 INFO:teuthology.orchestra.run.smithi078.stderr: -- replaced with /var/log/ceph/ceph-client.admin.469842.log.gz 2023-12-12T17:38:24.684 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.122244.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.449797.log.gz 2023-12-12T17:38:24.687 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144655.log 2023-12-12T17:38:24.689 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.393390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104138.log 2023-12-12T17:38:24.691 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.144655.log: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.398327.log.gz 2023-12-12T17:38:24.692 INFO:teuthology.orchestra.run.smithi078.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.459852.log.gz 2023-12-12T17:38:24.693 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.312316.log 2023-12-12T17:38:24.694 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.436090.log 2023-12-12T17:38:24.697 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.312316.log: /var/log/ceph/ceph-client.admin.104138.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.343326.log 2023-12-12T17:38:24.700 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.436090.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49192.log 2023-12-12T17:38:24.701 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.241318.log 2023-12-12T17:38:24.703 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.343326.log: /var/log/ceph/ceph-client.admin.49192.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.491308.log.gz 2023-12-12T17:38:24.704 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.198749.log 2023-12-12T17:38:24.706 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.265753.log 2023-12-12T17:38:24.707 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.241318.log: /var/log/ceph/ceph-client.admin.198749.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.309893.log 2023-12-12T17:38:24.708 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.265753.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.415425.log 2023-12-12T17:38:24.710 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.309893.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.248337.log 2023-12-12T17:38:24.711 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.415425.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.386182.log 2023-12-12T17:38:24.714 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.248337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150706.log 2023-12-12T17:38:24.717 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.386182.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.407702.log 2023-12-12T17:38:24.720 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.150706.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.485008.log 2023-12-12T17:38:24.721 INFO:teuthology.orchestra.run.smithi078.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.176677.log.gz 2023-12-12T17:38:24.723 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.439012.log 2023-12-12T17:38:24.726 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.407702.log: /var/log/ceph/ceph-client.admin.485008.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100910.log 2023-12-12T17:38:24.729 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.439012.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.217725.log 2023-12-12T17:38:24.731 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.100910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.470691.log 2023-12-12T17:38:24.733 INFO:teuthology.orchestra.run.smithi078.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.331186.log.gz 2023-12-12T17:38:24.734 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.217725.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.490101.log 2023-12-12T17:38:24.735 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.332807.log.gz 2023-12-12T17:38:24.737 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.470691.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50026.log 2023-12-12T17:38:24.739 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.490101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.401975.log 2023-12-12T17:38:24.741 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.501196.log 2023-12-12T17:38:24.745 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.50026.log: /var/log/ceph/ceph-client.admin.401975.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.384197.log 2023-12-12T17:38:24.746 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176668.log 2023-12-12T17:38:24.748 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.501196.log: /var/log/ceph/ceph-client.admin.384197.log: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.501196.log.gz 2023-12-12T17:38:24.748 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.518148.log 2023-12-12T17:38:24.751 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.176668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.216885.log 2023-12-12T17:38:24.751 INFO:teuthology.orchestra.run.smithi078.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.443456.log.gz 2023-12-12T17:38:24.752 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.518148.log: 77.5% -- replaced with /var/log/ceph/ceph-client.admin.114290.log.gz 2023-12-12T17:38:24.753 INFO:teuthology.orchestra.run.smithi078.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48854.log.gz 2023-12-12T17:38:24.754 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.321425.log 2023-12-12T17:38:24.756 INFO:teuthology.orchestra.run.smithi078.stderr: 92.7% -- replaced with /var/log/ceph/ceph-client.admin.518148.log.gz 2023-12-12T17:38:24.757 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.216885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186322.log 2023-12-12T17:38:24.761 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.321425.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.314342.log 2023-12-12T17:38:24.762 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.456446.log 2023-12-12T17:38:24.764 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.186322.log: /var/log/ceph/ceph-client.admin.314342.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.486868.log 2023-12-12T17:38:24.767 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.456446.log: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.140024.log.gz 2023-12-12T17:38:24.767 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120554.log 2023-12-12T17:38:24.768 INFO:teuthology.orchestra.run.smithi078.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.343326.log.gz 2023-12-12T17:38:24.769 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.486868.log: gzip -5 81.6% --verbose -- /var/log/ceph/ceph-client.admin.514277.log 2023-12-12T17:38:24.769 INFO:teuthology.orchestra.run.smithi078.stderr: -- replaced with /var/log/ceph/ceph-client.admin.263292.log.gz 2023-12-12T17:38:24.771 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.120554.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.395465.log 2023-12-12T17:38:24.773 INFO:teuthology.orchestra.run.smithi078.stderr: 77.8% -- replaced with /var/log/ceph/ceph-client.admin.351317.log.gz 2023-12-12T17:38:24.774 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.333208.log 2023-12-12T17:38:24.775 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.514277.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.334416.log 2023-12-12T17:38:24.775 INFO:teuthology.orchestra.run.smithi078.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.443447.log.gz 2023-12-12T17:38:24.777 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.333208.log: /var/log/ceph/ceph-client.admin.395465.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169315.log 2023-12-12T17:38:24.777 INFO:teuthology.orchestra.run.smithi078.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.417034.log.gz 2023-12-12T17:38:24.778 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.334416.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44482.log.gz 2023-12-12T17:38:24.779 INFO:teuthology.orchestra.run.smithi078.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.45420.log.gz 2023-12-12T17:38:24.781 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.211675.log 2023-12-12T17:38:24.783 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.169315.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.381306.log 2023-12-12T17:38:24.783 INFO:teuthology.orchestra.run.smithi078.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.514277.log.gz 2023-12-12T17:38:24.786 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.211675.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.436536.log 2023-12-12T17:38:24.786 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.169315.log.gz 2023-12-12T17:38:24.787 INFO:teuthology.orchestra.run.smithi078.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.93938.log.gz 2023-12-12T17:38:24.787 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.390369.log 2023-12-12T17:38:24.788 INFO:teuthology.orchestra.run.smithi078.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.167271.log.gz 2023-12-12T17:38:24.789 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.436536.log: 88.0%/var/log/ceph/ceph-client.admin.381306.log: -- replaced with /var/log/ceph/ceph-client.admin.38359.log.gz 2023-12-12T17:38:24.790 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.413155.log 2023-12-12T17:38:24.792 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.390369.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.437351.log 2023-12-12T17:38:24.794 INFO:teuthology.orchestra.run.smithi078.stderr: 83.9% -- replaced with /var/log/ceph/ceph-client.admin.312316.log.gz 2023-12-12T17:38:24.794 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171038.log 2023-12-12T17:38:24.796 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.413155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.250340.log 2023-12-12T17:38:24.799 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.171038.log: /var/log/ceph/ceph-client.admin.437351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.211238.log 2023-12-12T17:38:24.800 INFO:teuthology.orchestra.run.smithi078.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.228386.log.gz 2023-12-12T17:38:24.801 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.250340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.481217.log 2023-12-12T17:38:24.802 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.407711.log 2023-12-12T17:38:24.804 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.211238.log: /var/log/ceph/ceph-client.admin.481217.log: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.265753.log.gz 2023-12-12T17:38:24.805 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.220988.log 2023-12-12T17:38:24.807 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.407711.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.207161.log 2023-12-12T17:38:24.810 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.220988.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.411107.log 2023-12-12T17:38:24.812 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.207161.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.253163.log 2023-12-12T17:38:24.813 INFO:teuthology.orchestra.run.smithi078.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.217725.log.gz 2023-12-12T17:38:24.814 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.441100.log.gz 2023-12-12T17:38:24.815 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.411107.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.328297.log 2023-12-12T17:38:24.817 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.253163.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107031.log 2023-12-12T17:38:24.818 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.450199.log 2023-12-12T17:38:24.821 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.328297.log: /var/log/ceph/ceph-client.admin.107031.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.324684.log 2023-12-12T17:38:24.822 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.519810.log 2023-12-12T17:38:24.823 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.324684.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.173659.log.gz 2023-12-12T17:38:24.823 INFO:teuthology.orchestra.run.smithi078.stderr: 85.2%/var/log/ceph/ceph-client.admin.450199.log: -- replaced with /var/log/ceph/ceph-client.admin.195522.log.gz 2023-12-12T17:38:24.825 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.379268.log 2023-12-12T17:38:24.825 INFO:teuthology.orchestra.run.smithi078.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.486868.log.gz 2023-12-12T17:38:24.826 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.265347.log 2023-12-12T17:38:24.828 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.379268.log: /var/log/ceph/ceph-client.admin.519810.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.519810.log.gz 2023-12-12T17:38:24.829 INFO:teuthology.orchestra.run.smithi078.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.377794.log.gz 2023-12-12T17:38:24.829 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.223848.log 2023-12-12T17:38:24.829 INFO:teuthology.orchestra.run.smithi078.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.242933.log.gz 2023-12-12T17:38:24.829 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45186.log 2023-12-12T17:38:24.831 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.265347.log: /var/log/ceph/ceph-client.admin.223848.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44256.log 2023-12-12T17:38:24.834 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.45186.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102904.log 2023-12-12T17:38:24.835 INFO:teuthology.orchestra.run.smithi078.stderr: 79.7% -- replaced with /var/log/ceph/ceph-client.admin.176668.log.gz 2023-12-12T17:38:24.836 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91404.log 2023-12-12T17:38:24.837 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.44256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.377785.log 2023-12-12T17:38:24.837 INFO:teuthology.orchestra.run.smithi078.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.211675.log.gz 2023-12-12T17:38:24.839 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.102904.log: /var/log/ceph/ceph-client.admin.91404.log: 84.6% -- replaced with /var/log/ceph/ceph-client.admin.216885.log.gz 2023-12-12T17:38:24.840 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.461870.log 2023-12-12T17:38:24.842 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.377785.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47929.log 2023-12-12T17:38:24.844 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.461870.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.249134.log 2023-12-12T17:38:24.847 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47929.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.387030.log 2023-12-12T17:38:24.849 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.249134.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.520446.log 2023-12-12T17:38:24.850 INFO:teuthology.orchestra.run.smithi078.stderr: 94.4% -- replaced with /var/log/ceph/ceph-client.admin.181622.log.gz 2023-12-12T17:38:24.851 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.387030.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144210.log 2023-12-12T17:38:24.853 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.520446.log: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.329913.log.gz 2023-12-12T17:38:24.854 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.465188.log 2023-12-12T17:38:24.854 INFO:teuthology.orchestra.run.smithi078.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.520446.log.gz 2023-12-12T17:38:24.856 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.144210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.521091.log 2023-12-12T17:38:24.858 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.465188.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195531.log 2023-12-12T17:38:24.859 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.521091.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.521091.log.gz 2023-12-12T17:38:24.860 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113886.log 2023-12-12T17:38:24.862 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.469046.log 2023-12-12T17:38:24.863 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.195531.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49088.log 2023-12-12T17:38:24.866 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.113886.log: /var/log/ceph/ceph-client.admin.469046.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.406473.log.gz 2023-12-12T17:38:24.867 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.380072.log 2023-12-12T17:38:24.869 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.49088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.240911.log 2023-12-12T17:38:24.870 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184181.log 2023-12-12T17:38:24.874 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.240911.log: /var/log/ceph/ceph-client.admin.380072.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47375.log 2023-12-12T17:38:24.874 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143750.log 2023-12-12T17:38:24.875 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47375.log: /var/log/ceph/ceph-client.admin.184181.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48958.log 2023-12-12T17:38:24.877 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.486061.log 2023-12-12T17:38:24.878 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.143750.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.504594.log 2023-12-12T17:38:24.881 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.486061.log: /var/log/ceph/ceph-client.admin.48958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.247926.log 2023-12-12T17:38:24.883 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.504594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.236813.log 2023-12-12T17:38:24.884 INFO:teuthology.orchestra.run.smithi078.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.504594.log.gz 2023-12-12T17:38:24.886 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.247926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.511302.log 2023-12-12T17:38:24.889 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.236813.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.324684.log.gz 2023-12-12T17:38:24.889 INFO:teuthology.orchestra.run.smithi078.stderr: 79.3% -- replaced with /var/log/ceph/ceph-client.admin.334416.log.gz 2023-12-12T17:38:24.889 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48220.log 2023-12-12T17:38:24.892 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.511302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.262821.log 2023-12-12T17:38:24.893 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.462686.log 2023-12-12T17:38:24.896 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.262821.log: /var/log/ceph/ceph-client.admin.48220.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.323468.log 2023-12-12T17:38:24.897 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49974.log 2023-12-12T17:38:24.899 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.323468.log: /var/log/ceph/ceph-client.admin.462686.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.520349.log 2023-12-12T17:38:24.900 INFO:teuthology.orchestra.run.smithi078.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.511302.log.gz 2023-12-12T17:38:24.902 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.49974.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45238.log 2023-12-12T17:38:24.905 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.520349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.255650.log 2023-12-12T17:38:24.905 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.410048.log 2023-12-12T17:38:24.906 INFO:teuthology.orchestra.run.smithi078.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.520349.log.gz 2023-12-12T17:38:24.907 INFO:teuthology.orchestra.run.smithi078.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.322631.log.gz 2023-12-12T17:38:24.908 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.255650.log: /var/log/ceph/ceph-client.admin.45238.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.323477.log 2023-12-12T17:38:24.910 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.410048.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.352593.log 2023-12-12T17:38:24.913 INFO:teuthology.orchestra.run.smithi078.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.414802.log.gz 2023-12-12T17:38:24.913 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.323477.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.462695.log 2023-12-12T17:38:24.914 INFO:teuthology.orchestra.run.smithi078.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.49088.log.gz 2023-12-12T17:38:24.915 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.352593.log: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.207161.log.gz 2023-12-12T17:38:24.916 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.432338.log 2023-12-12T17:38:24.916 INFO:teuthology.orchestra.run.smithi078.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.342119.log.gz 2023-12-12T17:38:24.916 INFO:teuthology.orchestra.run.smithi078.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.436536.log.gz 2023-12-12T17:38:24.918 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.462695.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.328288.log 2023-12-12T17:38:24.920 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.432338.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44338.log 2023-12-12T17:38:24.923 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.328288.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.376548.log 2023-12-12T17:38:24.924 INFO:teuthology.orchestra.run.smithi078.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.503571.log.gz 2023-12-12T17:38:24.925 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.515116.log 2023-12-12T17:38:24.926 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.44338.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.317177.log 2023-12-12T17:38:24.926 INFO:teuthology.orchestra.run.smithi078.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45186.log.gz 2023-12-12T17:38:24.930 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.376548.log: /var/log/ceph/ceph-client.admin.515116.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.264538.log.gz 2023-12-12T17:38:24.930 INFO:teuthology.orchestra.run.smithi078.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46461.log.gz 2023-12-12T17:38:24.930 INFO:teuthology.orchestra.run.smithi078.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46927.log.gz 2023-12-12T17:38:24.931 INFO:teuthology.orchestra.run.smithi078.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.92319.log.gz 2023-12-12T17:38:24.931 INFO:teuthology.orchestra.run.smithi078.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44256.log.gz 2023-12-12T17:38:24.931 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93719.log 2023-12-12T17:38:24.931 INFO:teuthology.orchestra.run.smithi078.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.515116.log.gz 2023-12-12T17:38:24.933 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.317177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.431112.log 2023-12-12T17:38:24.936 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.93719.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.311512.log 2023-12-12T17:38:24.936 INFO:teuthology.orchestra.run.smithi078.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.247926.log.gz 2023-12-12T17:38:24.937 INFO:teuthology.orchestra.run.smithi078.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.253163.log.gz 2023-12-12T17:38:24.937 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.499426.log 2023-12-12T17:38:24.937 INFO:teuthology.orchestra.run.smithi078.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.184611.log.gz 2023-12-12T17:38:24.939 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.311512.log: /var/log/ceph/ceph-client.admin.431112.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.455140.log 2023-12-12T17:38:24.941 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.499426.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.374862.log 2023-12-12T17:38:24.942 INFO:teuthology.orchestra.run.smithi078.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.144210.log.gz 2023-12-12T17:38:24.942 INFO:teuthology.orchestra.run.smithi078.stderr: 83.1% -- replaced with /var/log/ceph/ceph-client.admin.499426.log.gz 2023-12-12T17:38:24.942 INFO:teuthology.orchestra.run.smithi078.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.188044.log.gz 2023-12-12T17:38:24.944 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.455140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.333621.log 2023-12-12T17:38:24.944 INFO:teuthology.orchestra.run.smithi078.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.188904.log.gz 2023-12-12T17:38:24.945 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.374862.log: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.311512.log.gz 2023-12-12T17:38:24.946 INFO:teuthology.orchestra.run.smithi078.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.311114.log.gz 2023-12-12T17:38:24.946 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.194727.log.gz 2023-12-12T17:38:24.947 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.383749.log 2023-12-12T17:38:24.949 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.333621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.442979.log 2023-12-12T17:38:24.951 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.383749.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.239292.log.gz 2023-12-12T17:38:24.951 INFO:teuthology.orchestra.run.smithi078.stderr: 77.3% -- replaced with /var/log/ceph/ceph-client.admin.376548.log.gz 2023-12-12T17:38:24.953 INFO:teuthology.orchestra.run.smithi078.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.220988.log.gz 2023-12-12T17:38:24.953 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.486464.log 2023-12-12T17:38:24.954 INFO:teuthology.orchestra.run.smithi078.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.352593.log.gz 2023-12-12T17:38:24.954 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.450199.log.gz 2023-12-12T17:38:24.955 INFO:teuthology.orchestra.run.smithi078.stderr: 79.7% -- replaced with /var/log/ceph/ceph-client.admin.455140.log.gz 2023-12-12T17:38:24.956 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.442979.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.236007.log 2023-12-12T17:38:24.958 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48672.log 2023-12-12T17:38:24.961 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.486464.log: /var/log/ceph/ceph-client.admin.236007.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178993.log 2023-12-12T17:38:24.962 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.395064.log 2023-12-12T17:38:24.966 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.48672.log: /var/log/ceph/ceph-client.admin.178993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48406.log 2023-12-12T17:38:24.968 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.395064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.458168.log 2023-12-12T17:38:24.971 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.48406.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.495997.log 2023-12-12T17:38:24.973 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.458168.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110674.log 2023-12-12T17:38:24.973 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.495997.log: 78.7% -- replaced with /var/log/ceph/ceph-client.admin.495997.log.gz 2023-12-12T17:38:24.976 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.218925.log 2023-12-12T17:38:24.977 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.200456.log 2023-12-12T17:38:24.980 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.218925.log: /var/log/ceph/ceph-client.admin.110674.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.445228.log 2023-12-12T17:38:24.983 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.200456.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.317569.log 2023-12-12T17:38:24.984 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.502016.log 2023-12-12T17:38:24.987 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.445228.log: /var/log/ceph/ceph-client.admin.317569.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107443.log 2023-12-12T17:38:24.990 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.309902.log 2023-12-12T17:38:24.990 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.502016.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.334014.log 2023-12-12T17:38:24.991 INFO:teuthology.orchestra.run.smithi078.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.502016.log.gz 2023-12-12T17:38:24.993 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.309902.log: /var/log/ceph/ceph-client.admin.107443.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.520472.log 2023-12-12T17:38:24.999 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.334014.log: /var/log/ceph/ceph-client.admin.520472.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.520472.log.gz 2023-12-12T17:38:25.001 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.381306.log.gz 2023-12-12T17:38:25.006 INFO:teuthology.orchestra.run.smithi078.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.379268.log.gz 2023-12-12T17:38:25.009 INFO:teuthology.orchestra.run.smithi078.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.431931.log.gz 2023-12-12T17:38:25.011 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.432338.log.gz 2023-12-12T17:38:25.017 INFO:teuthology.orchestra.run.smithi078.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.463087.log.gz 2023-12-12T17:38:25.018 INFO:teuthology.orchestra.run.smithi078.stderr: 79.6% -- replaced with /var/log/ceph/ceph-client.admin.462686.log.gz 2023-12-12T17:38:25.018 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.462695.log.gz 2023-12-12T17:38:25.020 INFO:teuthology.orchestra.run.smithi078.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.465188.log.gz 2023-12-12T17:38:25.022 INFO:teuthology.orchestra.run.smithi078.stderr: 79.3% -- replaced with /var/log/ceph/ceph-client.admin.458168.log.gz 2023-12-12T17:38:25.040 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.333621.log.gz 2023-12-12T17:38:25.048 INFO:teuthology.orchestra.run.smithi078.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.406464.log.gz 2023-12-12T17:38:25.049 INFO:teuthology.orchestra.run.smithi078.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.407268.log.gz 2023-12-12T17:38:25.090 INFO:teuthology.orchestra.run.smithi078.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.485008.log.gz 2023-12-12T17:38:25.094 INFO:teuthology.orchestra.run.smithi078.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.343762.log.gz 2023-12-12T17:38:25.095 INFO:teuthology.orchestra.run.smithi078.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.346689.log.gz 2023-12-12T17:38:25.096 INFO:teuthology.orchestra.run.smithi078.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.admin.255650.log.gz 2023-12-12T17:38:25.096 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.435688.log.gz 2023-12-12T17:38:25.118 INFO:teuthology.orchestra.run.smithi078.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.190626.log.gz 2023-12-12T17:38:25.149 INFO:teuthology.orchestra.run.smithi078.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.486464.log.gz 2023-12-12T17:38:25.150 INFO:teuthology.orchestra.run.smithi078.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.236007.log.gz 2023-12-12T17:38:25.150 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.232475.log.gz 2023-12-12T17:38:25.151 INFO:teuthology.orchestra.run.smithi078.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.312718.log.gz 2023-12-12T17:38:25.153 INFO:teuthology.orchestra.run.smithi078.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.377353.log.gz 2023-12-12T17:38:25.154 INFO:teuthology.orchestra.run.smithi078.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.222200.log.gz 2023-12-12T17:38:25.158 INFO:teuthology.orchestra.run.smithi078.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49543.log.gz 2023-12-12T17:38:25.161 INFO:teuthology.orchestra.run.smithi078.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.377785.log.gz 2023-12-12T17:38:25.163 INFO:teuthology.orchestra.run.smithi078.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.309902.log.gz 2023-12-12T17:38:25.165 INFO:teuthology.orchestra.run.smithi078.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.488893.log.gz 2023-12-12T17:38:25.172 INFO:teuthology.orchestra.run.smithi078.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.382542.log.gz 2023-12-12T17:38:25.173 INFO:teuthology.orchestra.run.smithi078.stderr: 77.8% -- replaced with /var/log/ceph/ceph-client.admin.349990.log.gz 2023-12-12T17:38:25.175 INFO:teuthology.orchestra.run.smithi078.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.442979.log.gz 2023-12-12T17:38:25.179 INFO:teuthology.orchestra.run.smithi078.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.317569.log.gz 2023-12-12T17:38:25.180 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.317177.log.gz 2023-12-12T17:38:25.198 INFO:teuthology.orchestra.run.smithi078.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.401984.log.gz 2023-12-12T17:38:25.235 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.374862.log.gz 2023-12-12T17:38:25.236 INFO:teuthology.orchestra.run.smithi078.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.410048.log.gz 2023-12-12T17:38:25.241 INFO:teuthology.orchestra.run.smithi078.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.431112.log.gz 2023-12-12T17:38:25.258 INFO:teuthology.orchestra.run.smithi078.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.415078.log.gz 2023-12-12T17:38:25.278 INFO:teuthology.orchestra.run.smithi078.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.185032.log.gz 2023-12-12T17:38:25.279 INFO:teuthology.orchestra.run.smithi078.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.466549.log.gz 2023-12-12T17:38:25.282 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.343771.log.gz 2023-12-12T17:38:25.297 INFO:teuthology.orchestra.run.smithi078.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.46766.log.gz 2023-12-12T17:38:25.298 INFO:teuthology.orchestra.run.smithi078.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.110263.log.gz 2023-12-12T17:38:25.299 INFO:teuthology.orchestra.run.smithi078.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.109870.log.gz 2023-12-12T17:38:25.314 INFO:teuthology.orchestra.run.smithi078.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.318391.log.gz 2023-12-12T17:38:25.314 INFO:teuthology.orchestra.run.smithi078.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.193914.log.gz 2023-12-12T17:38:25.314 INFO:teuthology.orchestra.run.smithi078.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.310703.log.gz 2023-12-12T17:38:25.316 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.149205.log.gz 2023-12-12T17:38:25.316 INFO:teuthology.orchestra.run.smithi078.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.492912.log.gz 2023-12-12T17:38:25.317 INFO:teuthology.orchestra.run.smithi078.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.322238.log.gz 2023-12-12T17:38:25.317 INFO:teuthology.orchestra.run.smithi078.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.438199.log.gz 2023-12-12T17:38:25.317 INFO:teuthology.orchestra.run.smithi078.stderr: 77.6% -- replaced with /var/log/ceph/ceph-client.admin.354844.log.gz 2023-12-12T17:38:25.318 INFO:teuthology.orchestra.run.smithi078.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.200456.log.gz 2023-12-12T17:38:25.322 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.451473.log.gz 2023-12-12T17:38:25.326 INFO:teuthology.orchestra.run.smithi078.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.188913.log.gz 2023-12-12T17:38:25.353 INFO:teuthology.orchestra.run.smithi078.stderr: 77.9% -- replaced with /var/log/ceph/ceph-client.admin.385278.log.gz 2023-12-12T17:38:25.375 INFO:teuthology.orchestra.run.smithi078.stderr: 92.4% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2023-12-12T17:38:25.399 INFO:teuthology.orchestra.run.smithi078.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.admin.262821.log.gz 2023-12-12T17:38:25.442 INFO:teuthology.orchestra.run.smithi078.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.488491.log.gz 2023-12-12T17:38:25.450 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.321836.log.gz 2023-12-12T17:38:25.453 INFO:teuthology.orchestra.run.smithi078.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.187192.log.gz 2023-12-12T17:38:25.461 INFO:teuthology.orchestra.run.smithi078.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48646.log.gz 2023-12-12T17:38:25.471 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.346698.log.gz 2023-12-12T17:38:25.472 INFO:teuthology.orchestra.run.smithi078.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.264945.log.gz 2023-12-12T17:38:25.473 INFO:teuthology.orchestra.run.smithi078.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.467436.log.gz 2023-12-12T17:38:25.473 INFO:teuthology.orchestra.run.smithi078.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.347511.log.gz 2023-12-12T17:38:25.484 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.249947.log.gz 2023-12-12T17:38:25.485 INFO:teuthology.orchestra.run.smithi078.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44894.log.gz 2023-12-12T17:38:25.486 INFO:teuthology.orchestra.run.smithi078.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.254835.log.gz 2023-12-12T17:38:25.490 INFO:teuthology.orchestra.run.smithi078.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.187613.log.gz 2023-12-12T17:38:25.491 INFO:teuthology.orchestra.run.smithi078.stderr: 77.9% -- replaced with /var/log/ceph/ceph-client.admin.139607.log.gz 2023-12-12T17:38:25.495 INFO:teuthology.orchestra.run.smithi078.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.172835.log.gz 2023-12-12T17:38:25.502 INFO:teuthology.orchestra.run.smithi078.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.91404.log.gz 2023-12-12T17:38:25.503 INFO:teuthology.orchestra.run.smithi078.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.313944.log.gz 2023-12-12T17:38:25.511 INFO:teuthology.orchestra.run.smithi078.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.220131.log.gz 2023-12-12T17:38:25.517 INFO:teuthology.orchestra.run.smithi078.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.241318.log.gz 2023-12-12T17:38:25.519 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.243336.log.gz 2023-12-12T17:38:25.572 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.400755.log.gz 2023-12-12T17:38:25.603 INFO:teuthology.orchestra.run.smithi078.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.446486.log.gz 2023-12-12T17:38:25.606 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.458579.log.gz 2023-12-12T17:38:25.607 INFO:teuthology.orchestra.run.smithi078.stderr: 78.0% -- replaced with /var/log/ceph/ceph-client.admin.485656.log.gz 2023-12-12T17:38:25.618 INFO:teuthology.orchestra.run.smithi078.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.332798.log.gz 2023-12-12T17:38:25.623 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.323882.log.gz 2023-12-12T17:38:25.625 INFO:teuthology.orchestra.run.smithi078.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.114704.log.gz 2023-12-12T17:38:25.627 INFO:teuthology.orchestra.run.smithi078.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.356312.log.gz 2023-12-12T17:38:25.632 INFO:teuthology.orchestra.run.smithi078.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.121837.log.gz 2023-12-12T17:38:25.633 INFO:teuthology.orchestra.run.smithi078.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.342521.log.gz 2023-12-12T17:38:25.634 INFO:teuthology.orchestra.run.smithi078.stderr: 77.5% -- replaced with /var/log/ceph/ceph-client.admin.250742.log.gz 2023-12-12T17:38:25.641 INFO:teuthology.orchestra.run.smithi078.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46305.log.gz 2023-12-12T17:38:25.641 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.393390.log.gz 2023-12-12T17:38:25.643 INFO:teuthology.orchestra.run.smithi078.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.50026.log.gz 2023-12-12T17:38:25.644 INFO:teuthology.orchestra.run.smithi078.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.245771.log.gz 2023-12-12T17:38:25.651 INFO:teuthology.orchestra.run.smithi078.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.439012.log.gz 2023-12-12T17:38:25.652 INFO:teuthology.orchestra.run.smithi078.stderr: 94.5% -- replaced with /var/log/ceph/ceph-client.admin.355339.log.gz 2023-12-12T17:38:25.684 INFO:teuthology.orchestra.run.smithi078.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.415425.log.gz 2023-12-12T17:38:25.701 INFO:teuthology.orchestra.run.smithi078.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.190635.log.gz 2023-12-12T17:38:25.702 INFO:teuthology.orchestra.run.smithi078.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.490504.log.gz 2023-12-12T17:38:25.707 INFO:teuthology.orchestra.run.smithi078.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.401170.log.gz 2023-12-12T17:38:25.714 INFO:teuthology.orchestra.run.smithi078.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.216079.log.gz 2023-12-12T17:38:25.726 INFO:teuthology.orchestra.run.smithi078.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.437360.log.gz 2023-12-12T17:38:25.740 INFO:teuthology.orchestra.run.smithi078.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.401975.log.gz 2023-12-12T17:38:25.761 INFO:teuthology.orchestra.run.smithi078.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.490101.log.gz 2023-12-12T17:38:25.765 INFO:teuthology.orchestra.run.smithi078.stderr: 93.8% -- replaced with /var/log/ceph/ceph-client.admin.320947.log.gz 2023-12-12T17:38:25.775 INFO:teuthology.orchestra.run.smithi078.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.admin.106152.log.gz 2023-12-12T17:38:25.776 INFO:teuthology.orchestra.run.smithi078.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48802.log.gz 2023-12-12T17:38:25.779 INFO:teuthology.orchestra.run.smithi078.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.49036.log.gz 2023-12-12T17:38:25.783 INFO:teuthology.orchestra.run.smithi078.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.108650.log.gz 2023-12-12T17:38:25.784 INFO:teuthology.orchestra.run.smithi078.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.254844.log.gz 2023-12-12T17:38:25.785 INFO:teuthology.orchestra.run.smithi078.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.150402.log.gz 2023-12-12T17:38:25.789 INFO:teuthology.orchestra.run.smithi078.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.486061.log.gz 2023-12-12T17:38:25.803 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.373580.log.gz 2023-12-12T17:38:25.847 INFO:teuthology.orchestra.run.smithi078.stderr: 94.3% -- replaced with /var/log/ceph/ceph-client.admin.345026.log.gz 2023-12-12T17:38:25.871 INFO:teuthology.orchestra.run.smithi078.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.218925.log.gz 2023-12-12T17:38:25.927 INFO:teuthology.orchestra.run.smithi078.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.252368.log.gz 2023-12-12T17:38:25.930 INFO:teuthology.orchestra.run.smithi078.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.309499.log.gz 2023-12-12T17:38:25.968 INFO:teuthology.orchestra.run.smithi078.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48776.log.gz 2023-12-12T17:38:26.006 INFO:teuthology.orchestra.run.smithi078.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.110674.log.gz 2023-12-12T17:38:26.043 INFO:teuthology.orchestra.run.smithi078.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.198758.log.gz 2023-12-12T17:38:26.044 INFO:teuthology.orchestra.run.smithi078.stderr: 78.4% -- replaced with /var/log/ceph/ceph-client.admin.186322.log.gz 2023-12-12T17:38:26.046 INFO:teuthology.orchestra.run.smithi078.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.211238.log.gz 2023-12-12T17:38:26.050 INFO:teuthology.orchestra.run.smithi078.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.195531.log.gz 2023-12-12T17:38:26.051 INFO:teuthology.orchestra.run.smithi078.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47825.log.gz 2023-12-12T17:38:26.063 INFO:teuthology.orchestra.run.smithi078.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.179395.log.gz 2023-12-12T17:38:26.102 INFO:teuthology.orchestra.run.smithi078.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.407702.log.gz 2023-12-12T17:38:26.143 INFO:teuthology.orchestra.run.smithi078.stderr: 94.2% -- replaced with /var/log/ceph/ceph-client.admin.389972.log.gz 2023-12-12T17:38:26.162 INFO:teuthology.orchestra.run.smithi078.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.323468.log.gz 2023-12-12T17:38:26.163 INFO:teuthology.orchestra.run.smithi078.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.338958.log.gz 2023-12-12T17:38:26.167 INFO:teuthology.orchestra.run.smithi078.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.380072.log.gz 2023-12-12T17:38:26.167 INFO:teuthology.orchestra.run.smithi078.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.91010.log.gz 2023-12-12T17:38:26.168 INFO:teuthology.orchestra.run.smithi078.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.admin.446050.log.gz 2023-12-12T17:38:26.181 INFO:teuthology.orchestra.run.smithi078.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.387030.log.gz 2023-12-12T17:38:26.184 INFO:teuthology.orchestra.run.smithi078.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44338.log.gz 2023-12-12T17:38:26.184 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.166476.log.gz 2023-12-12T17:38:26.186 INFO:teuthology.orchestra.run.smithi078.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.210433.log.gz 2023-12-12T17:38:26.187 INFO:teuthology.orchestra.run.smithi078.stderr: 77.4% -- replaced with /var/log/ceph/ceph-client.admin.381297.log.gz 2023-12-12T17:38:26.187 INFO:teuthology.orchestra.run.smithi078.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.448695.log.gz 2023-12-12T17:38:26.188 INFO:teuthology.orchestra.run.smithi078.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.223848.log.gz 2023-12-12T17:38:26.197 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.469046.log.gz 2023-12-12T17:38:26.200 INFO:teuthology.orchestra.run.smithi078.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47635.log.gz 2023-12-12T17:38:26.206 INFO:teuthology.orchestra.run.smithi078.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.450996.log.gz 2023-12-12T17:38:26.212 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.328297.log.gz 2023-12-12T17:38:26.215 INFO:teuthology.orchestra.run.smithi078.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.353468.log.gz 2023-12-12T17:38:26.223 INFO:teuthology.orchestra.run.smithi078.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.216088.log.gz 2023-12-12T17:38:26.229 INFO:teuthology.orchestra.run.smithi078.stderr: 94.4% -- replaced with /var/log/ceph/ceph-client.admin.200886.log.gz 2023-12-12T17:38:26.262 INFO:teuthology.orchestra.run.smithi078.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.445228.log.gz 2023-12-12T17:38:26.264 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.444408.log.gz 2023-12-12T17:38:26.307 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.265356.log.gz 2023-12-12T17:38:26.311 INFO:teuthology.orchestra.run.smithi078.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.494967.log.gz 2023-12-12T17:38:26.348 INFO:teuthology.orchestra.run.smithi078.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.213439.log.gz 2023-12-12T17:38:26.358 INFO:teuthology.orchestra.run.smithi078.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49896.log.gz 2023-12-12T17:38:26.362 INFO:teuthology.orchestra.run.smithi078.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.45692.log.gz 2023-12-12T17:38:26.365 INFO:teuthology.orchestra.run.smithi078.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46985.log.gz 2023-12-12T17:38:26.365 INFO:teuthology.orchestra.run.smithi078.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.383749.log.gz 2023-12-12T17:38:26.398 INFO:teuthology.orchestra.run.smithi187.stderr: 94.7% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2023-12-12T17:38:26.429 INFO:teuthology.orchestra.run.smithi078.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.334014.log.gz 2023-12-12T17:38:26.431 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.331195.log.gz 2023-12-12T17:38:26.445 INFO:teuthology.orchestra.run.smithi078.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.93719.log.gz 2023-12-12T17:38:26.462 INFO:teuthology.orchestra.run.smithi078.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.249134.log.gz 2023-12-12T17:38:26.463 INFO:teuthology.orchestra.run.smithi078.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.388751.log.gz 2023-12-12T17:38:26.464 INFO:teuthology.orchestra.run.smithi078.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.347091.log.gz 2023-12-12T17:38:26.466 INFO:teuthology.orchestra.run.smithi078.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.108253.log.gz 2023-12-12T17:38:26.466 INFO:teuthology.orchestra.run.smithi078.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49974.log.gz 2023-12-12T17:38:26.466 INFO:teuthology.orchestra.run.smithi078.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.309893.log.gz 2023-12-12T17:38:26.468 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.205964.log.gz 2023-12-12T17:38:26.469 INFO:teuthology.orchestra.run.smithi078.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48380.log.gz 2023-12-12T17:38:26.472 INFO:teuthology.orchestra.run.smithi078.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.200877.log.gz 2023-12-12T17:38:26.503 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.314351.log.gz 2023-12-12T17:38:26.538 INFO:teuthology.orchestra.run.smithi078.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.397934.log.gz 2023-12-12T17:38:26.573 INFO:teuthology.orchestra.run.smithi078.stderr: 93.7% -- replaced with /var/log/ceph/ceph-client.admin.390328.log.gz 2023-12-12T17:38:26.683 INFO:teuthology.orchestra.run.smithi078.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.346279.log.gz 2023-12-12T17:38:26.686 INFO:teuthology.orchestra.run.smithi078.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48406.log.gz 2023-12-12T17:38:26.698 INFO:teuthology.orchestra.run.smithi078.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.253574.log.gz 2023-12-12T17:38:26.699 INFO:teuthology.orchestra.run.smithi078.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.204556.log.gz 2023-12-12T17:38:26.701 INFO:teuthology.orchestra.run.smithi078.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.213871.log.gz 2023-12-12T17:38:26.704 INFO:teuthology.orchestra.run.smithi078.stderr: 77.5% -- replaced with /var/log/ceph/ceph-client.admin.309490.log.gz 2023-12-12T17:38:26.710 INFO:teuthology.orchestra.run.smithi078.stderr: 77.9% -- replaced with /var/log/ceph/ceph-client.admin.328288.log.gz 2023-12-12T17:38:26.711 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.327092.log.gz 2023-12-12T17:38:26.727 INFO:teuthology.orchestra.run.smithi078.stderr: 78.4% -- replaced with /var/log/ceph/ceph-client.admin.314342.log.gz 2023-12-12T17:38:26.784 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.240911.log.gz 2023-12-12T17:38:26.810 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.407711.log.gz 2023-12-12T17:38:26.889 INFO:teuthology.orchestra.run.smithi078.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.386171.log.gz 2023-12-12T17:38:26.893 INFO:teuthology.orchestra.run.smithi078.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50104.log.gz 2023-12-12T17:38:26.921 INFO:teuthology.orchestra.run.smithi078.stderr: 94.3% 93.7% -- replaced with /var/log/ceph/ceph-client.admin.199596.log.gz -- replaced with /var/log/ceph/ceph-client.admin.191066.log.gz 2023-12-12T17:38:26.922 INFO:teuthology.orchestra.run.smithi078.stderr: 2023-12-12T17:38:26.935 INFO:teuthology.orchestra.run.smithi078.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45238.log.gz 2023-12-12T17:38:27.012 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.384197.log.gz 2023-12-12T17:38:27.086 INFO:teuthology.orchestra.run.smithi078.stderr: 77.5% -- replaced with /var/log/ceph/ceph-client.admin.315959.log.gz 2023-12-12T17:38:27.111 INFO:teuthology.orchestra.run.smithi078.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.437351.log.gz 2023-12-12T17:38:27.115 INFO:teuthology.orchestra.run.smithi078.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45483.log.gz 2023-12-12T17:38:27.122 INFO:teuthology.orchestra.run.smithi078.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47453.log.gz 2023-12-12T17:38:27.123 INFO:teuthology.orchestra.run.smithi078.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.351326.log.gz 2023-12-12T17:38:27.125 INFO:teuthology.orchestra.run.smithi078.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.191907.log.gz 2023-12-12T17:38:27.125 INFO:teuthology.orchestra.run.smithi078.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.104138.log.gz 2023-12-12T17:38:27.136 INFO:teuthology.orchestra.run.smithi078.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.220586.log.gz 2023-12-12T17:38:27.141 INFO:teuthology.orchestra.run.smithi078.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.102904.log.gz 2023-12-12T17:38:27.141 INFO:teuthology.orchestra.run.smithi078.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.356303.log.gz 2023-12-12T17:38:27.142 INFO:teuthology.orchestra.run.smithi078.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.178993.log.gz 2023-12-12T17:38:27.160 INFO:teuthology.orchestra.run.smithi078.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.198749.log.gz 2023-12-12T17:38:27.163 INFO:teuthology.orchestra.run.smithi078.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46175.log.gz 2023-12-12T17:38:27.339 INFO:teuthology.orchestra.run.smithi078.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.113886.log.gz 2023-12-12T17:38:27.345 INFO:teuthology.orchestra.run.smithi078.stderr: 94.2% -- replaced with /var/log/ceph/ceph-client.admin.434355.log.gz 2023-12-12T17:38:27.345 INFO:teuthology.orchestra.run.smithi078.stderr: 93.7% -- replaced with /var/log/ceph/ceph-client.admin.463932.log.gz 2023-12-12T17:38:27.363 INFO:teuthology.orchestra.run.smithi078.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48672.log.gz 2023-12-12T17:38:27.366 INFO:teuthology.orchestra.run.smithi078.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.390369.log.gz 2023-12-12T17:38:27.367 INFO:teuthology.orchestra.run.smithi078.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47929.log.gz 2023-12-12T17:38:27.377 INFO:teuthology.orchestra.run.smithi078.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.344588.log.gz 2023-12-12T17:38:27.378 INFO:teuthology.orchestra.run.smithi078.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.184181.log.gz 2023-12-12T17:38:27.382 INFO:teuthology.orchestra.run.smithi187.stderr: 95.5% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-12-12T17:38:27.460 INFO:teuthology.orchestra.run.smithi078.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.466804.log.gz 2023-12-12T17:38:27.514 INFO:teuthology.orchestra.run.smithi078.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.389963.log.gz 2023-12-12T17:38:27.591 INFO:teuthology.orchestra.run.smithi078.stderr: 77.5% -- replaced with /var/log/ceph/ceph-client.admin.241309.log.gz 2023-12-12T17:38:27.660 INFO:teuthology.orchestra.run.smithi078.stderr: 93.8% -- replaced with /var/log/ceph/ceph-client.admin.390280.log.gz 2023-12-12T17:38:27.674 INFO:teuthology.orchestra.run.smithi078.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.488482.log.gz 2023-12-12T17:38:27.675 INFO:teuthology.orchestra.run.smithi078.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48352.log.gz 2023-12-12T17:38:27.709 INFO:teuthology.orchestra.run.smithi078.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.166467.log.gz 2023-12-12T17:38:27.711 INFO:teuthology.orchestra.run.smithi078.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.265347.log.gz 2023-12-12T17:38:27.729 INFO:teuthology.orchestra.run.smithi078.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.44586.log.gz 2023-12-12T17:38:27.730 INFO:teuthology.orchestra.run.smithi078.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45051.log.gz 2023-12-12T17:38:27.846 INFO:teuthology.orchestra.run.smithi078.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.412317.log.gz 2023-12-12T17:38:27.887 INFO:teuthology.orchestra.run.smithi078.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.338949.log.gz 2023-12-12T17:38:27.900 INFO:teuthology.orchestra.run.smithi078.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44204.log.gz 2023-12-12T17:38:27.903 INFO:teuthology.orchestra.run.smithi078.stderr: 77.4% -- replaced with /var/log/ceph/ceph-client.admin.143750.log.gz 2023-12-12T17:38:28.290 INFO:teuthology.orchestra.run.smithi078.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.107031.log.gz 2023-12-12T17:38:28.291 INFO:teuthology.orchestra.run.smithi078.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.436090.log.gz 2023-12-12T17:38:28.291 INFO:teuthology.orchestra.run.smithi078.stderr: 92.7% -- replaced with /var/log/ceph/ceph-client.admin.413155.log.gz 2023-12-12T17:38:28.291 INFO:teuthology.orchestra.run.smithi078.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.49192.log.gz 2023-12-12T17:38:28.291 INFO:teuthology.orchestra.run.smithi078.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.386182.log.gz 2023-12-12T17:38:28.292 INFO:teuthology.orchestra.run.smithi078.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.191492.log.gz 2023-12-12T17:38:28.292 INFO:teuthology.orchestra.run.smithi078.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.210035.log.gz 2023-12-12T17:38:28.292 INFO:teuthology.orchestra.run.smithi078.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.147782.log.gz 2023-12-12T17:38:28.292 INFO:teuthology.orchestra.run.smithi078.stderr: 82.6% -- replaced with /var/log/ceph/ceph-client.admin.433938.log.gz 2023-12-12T17:38:28.293 INFO:teuthology.orchestra.run.smithi078.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.223422.log.gz 2023-12-12T17:38:28.294 INFO:teuthology.orchestra.run.smithi078.stderr: 96.0% -- replaced with /var/log/ceph/ceph-client.admin.207572.log.gz 2023-12-12T17:38:28.350 INFO:teuthology.orchestra.run.smithi078.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.406866.log.gz 2023-12-12T17:38:28.450 INFO:teuthology.orchestra.run.smithi078.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.107443.log.gz 2023-12-12T17:38:28.457 INFO:teuthology.orchestra.run.smithi078.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.461870.log.gz 2023-12-12T17:38:28.458 INFO:teuthology.orchestra.run.smithi078.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.464377.log.gz 2023-12-12T17:38:28.577 INFO:teuthology.orchestra.run.smithi078.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.181217.log.gz 2023-12-12T17:38:28.579 INFO:teuthology.orchestra.run.smithi078.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.48958.log.gz 2023-12-12T17:38:28.580 INFO:teuthology.orchestra.run.smithi078.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49114.log.gz 2023-12-12T17:38:28.588 INFO:teuthology.orchestra.run.smithi078.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.103298.log.gz 2023-12-12T17:38:28.591 INFO:teuthology.orchestra.run.smithi078.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47375.log.gz 2023-12-12T17:38:28.594 INFO:teuthology.orchestra.run.smithi078.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.440687.log.gz 2023-12-12T17:38:28.623 INFO:teuthology.orchestra.run.smithi078.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.236813.log.gz 2023-12-12T17:38:28.640 INFO:teuthology.orchestra.run.smithi078.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.456446.log.gz 2023-12-12T17:38:28.653 INFO:teuthology.orchestra.run.smithi078.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.449221.log.gz 2023-12-12T17:38:28.761 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.411107.log.gz 2023-12-12T17:38:28.766 INFO:teuthology.orchestra.run.smithi078.stderr: 95.1% -- replaced with /var/log/ceph/ceph-client.admin.378671.log.gz 2023-12-12T17:38:28.833 INFO:teuthology.orchestra.run.smithi078.stderr: 77.5% -- replaced with /var/log/ceph/ceph-client.admin.382124.log.gz 2023-12-12T17:38:28.848 INFO:teuthology.orchestra.run.smithi078.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.395465.log.gz 2023-12-12T17:38:28.850 INFO:teuthology.orchestra.run.smithi078.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.250340.log.gz 2023-12-12T17:38:28.858 INFO:teuthology.orchestra.run.smithi078.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.174099.log.gz 2023-12-12T17:38:28.868 INFO:teuthology.orchestra.run.smithi078.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.242924.log.gz 2023-12-12T17:38:28.870 INFO:teuthology.orchestra.run.smithi078.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.470691.log.gz 2023-12-12T17:38:28.870 INFO:teuthology.orchestra.run.smithi078.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.466129.log.gz 2023-12-12T17:38:28.880 INFO:teuthology.orchestra.run.smithi078.stderr: 94.2% -- replaced with /var/log/ceph/ceph-client.admin.377362.log.gz 2023-12-12T17:38:29.050 INFO:teuthology.orchestra.run.smithi078.stderr: 78.1% -- replaced with /var/log/ceph/ceph-client.admin.140015.log.gz 2023-12-12T17:38:29.054 INFO:teuthology.orchestra.run.smithi078.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.440282.log.gz 2023-12-12T17:38:29.056 INFO:teuthology.orchestra.run.smithi078.stderr: 79.6% -- replaced with /var/log/ceph/ceph-client.admin.150706.log.gz 2023-12-12T17:38:29.058 INFO:teuthology.orchestra.run.smithi078.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.49439.log.gz 2023-12-12T17:38:29.072 INFO:teuthology.orchestra.run.smithi078.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44456.log.gz 2023-12-12T17:38:29.131 INFO:teuthology.orchestra.run.smithi078.stderr: 95.2% -- replaced with /var/log/ceph/ceph-client.admin.390593.log.gz 2023-12-12T17:38:29.314 INFO:teuthology.orchestra.run.smithi078.stderr: 93.9% -- replaced with /var/log/ceph/ceph-client.admin.150411.log.gz 2023-12-12T17:38:29.320 INFO:teuthology.orchestra.run.smithi078.stderr: 92.7% -- replaced with /var/log/ceph/ceph-client.admin.395064.log.gz 2023-12-12T17:38:29.322 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.323477.log.gz 2023-12-12T17:38:29.326 INFO:teuthology.orchestra.run.smithi078.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.47955.log.gz 2023-12-12T17:38:29.508 INFO:teuthology.orchestra.run.smithi078.stderr: 78.4% -- replaced with /var/log/ceph/ceph-client.admin.141678.log.gz 2023-12-12T17:38:29.510 INFO:teuthology.orchestra.run.smithi078.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.48220.log.gz 2023-12-12T17:38:29.514 INFO:teuthology.orchestra.run.smithi078.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.218128.log.gz 2023-12-12T17:38:29.525 INFO:teuthology.orchestra.run.smithi078.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.248337.log.gz 2023-12-12T17:38:29.575 INFO:teuthology.orchestra.run.smithi078.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.455149.log.gz 2023-12-12T17:38:29.577 INFO:teuthology.orchestra.run.smithi078.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.177140.log.gz 2023-12-12T17:38:29.587 INFO:teuthology.orchestra.run.smithi078.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.381722.log.gz 2023-12-12T17:38:29.606 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.402825.log.gz 2023-12-12T17:38:29.613 INFO:teuthology.orchestra.run.smithi078.stderr: 77.6% -- replaced with /var/log/ceph/ceph-client.admin.389561.log.gz 2023-12-12T17:38:29.626 INFO:teuthology.orchestra.run.smithi078.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.465581.log.gz 2023-12-12T17:38:29.738 INFO:teuthology.orchestra.run.smithi078.stderr: 77.5% -- replaced with /var/log/ceph/ceph-client.admin.201713.log.gz 2023-12-12T17:38:29.742 INFO:teuthology.orchestra.run.smithi078.stderr: 94.0% -- replaced with /var/log/ceph/ceph-client.admin.354360.log.gz 2023-12-12T17:38:29.786 INFO:teuthology.orchestra.run.smithi078.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.424360.log.gz 2023-12-12T17:38:30.217 INFO:teuthology.orchestra.run.smithi078.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.185471.log.gz 2023-12-12T17:38:30.245 INFO:teuthology.orchestra.run.smithi078.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.110665.log.gz 2023-12-12T17:38:30.383 INFO:teuthology.orchestra.run.smithi078.stderr: 93.7% -- replaced with /var/log/ceph/ceph-client.admin.354853.log.gz 2023-12-12T17:38:30.386 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.320546.log.gz 2023-12-12T17:38:30.861 INFO:teuthology.orchestra.run.smithi078.stderr: 95.5% -- replaced with /var/log/ceph/ceph-client.admin.415087.log.gz 2023-12-12T17:38:31.354 INFO:teuthology.orchestra.run.smithi078.stderr: 94.3% -- replaced with /var/log/ceph/ceph-client.admin.205383.log.gz 2023-12-12T17:38:31.354 INFO:teuthology.orchestra.run.smithi078.stderr: 94.3% -- replaced with /var/log/ceph/ceph-client.admin.376109.log.gz 2023-12-12T17:38:31.355 INFO:teuthology.orchestra.run.smithi078.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.252761.log.gz 2023-12-12T17:38:31.355 INFO:teuthology.orchestra.run.smithi078.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.317992.log.gz 2023-12-12T17:38:31.355 INFO:teuthology.orchestra.run.smithi078.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.321425.log.gz 2023-12-12T17:38:31.356 INFO:teuthology.orchestra.run.smithi078.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.186331.log.gz 2023-12-12T17:38:31.356 INFO:teuthology.orchestra.run.smithi078.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.261931.log.gz 2023-12-12T17:38:31.356 INFO:teuthology.orchestra.run.smithi078.stderr: 94.3% -- replaced with /var/log/ceph/ceph-client.admin.396692.log.gz 2023-12-12T17:38:31.846 INFO:teuthology.orchestra.run.smithi078.stderr: 94.3% -- replaced with /var/log/ceph/ceph-client.admin.357250.log.gz 2023-12-12T17:38:32.518 INFO:teuthology.orchestra.run.smithi078.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.208418.log.gz 2023-12-12T17:38:32.613 INFO:teuthology.orchestra.run.smithi187.stderr: 92.0% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2023-12-12T17:38:32.673 INFO:teuthology.orchestra.run.smithi078.stderr: 93.8% 95.6% -- replaced with /var/log/ceph/ceph-client.admin.453890.log.gz 2023-12-12T17:38:32.673 INFO:teuthology.orchestra.run.smithi078.stderr: -- replaced with /var/log/ceph/ceph-client.admin.225645.log.gz 2023-12-12T17:38:32.777 INFO:teuthology.orchestra.run.smithi078.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.423900.log.gz 2023-12-12T17:38:32.837 INFO:teuthology.orchestra.run.smithi078.stderr: 89.0% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-12-12T17:38:33.429 INFO:teuthology.orchestra.run.smithi078.stderr: 77.3% -- replaced with /var/log/ceph/ceph-client.admin.333208.log.gz 2023-12-12T17:38:35.049 INFO:teuthology.orchestra.run.smithi078.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.214332.log.gz 2023-12-12T17:38:35.767 INFO:teuthology.orchestra.run.smithi078.stderr: 93.9% -- replaced with /var/log/ceph/ceph-client.admin.390232.log.gz 2023-12-12T17:38:38.836 INFO:teuthology.orchestra.run.smithi078.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.100910.log.gz 2023-12-12T17:38:40.476 INFO:teuthology.orchestra.run.smithi078.stderr: 94.5% -- replaced with /var/log/ceph/ceph-client.admin.88804.log.gz 2023-12-12T17:38:45.151 INFO:teuthology.orchestra.run.smithi078.stderr: 95.9% -- replaced with /var/log/ceph/ceph-client.admin.246182.log.gz 2023-12-12T17:38:45.946 INFO:teuthology.orchestra.run.smithi078.stderr: 94.6% -- replaced with /var/log/ceph/ceph-client.admin.385689.log.gz 2023-12-12T17:38:47.858 INFO:teuthology.orchestra.run.smithi078.stderr: 93.9% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2023-12-12T17:38:48.039 INFO:teuthology.orchestra.run.smithi078.stderr: 95.5% -- replaced with /var/log/ceph/ceph-client.admin.87399.log.gz 2023-12-12T17:38:50.572 INFO:teuthology.orchestra.run.smithi078.stderr: 94.8% -- replaced with /var/log/ceph/ceph-client.admin.103307.log.gz 2023-12-12T17:38:56.419 INFO:teuthology.orchestra.run.smithi078.stderr: 96.6% -- replaced with /var/log/ceph/ceph-client.admin.100453.log.gz 2023-12-12T17:38:57.167 INFO:teuthology.orchestra.run.smithi078.stderr: 97.5% -- replaced with /var/log/ceph/ceph-client.admin.378197.log.gz 2023-12-12T17:38:57.775 INFO:teuthology.orchestra.run.smithi078.stderr: 95.9% -- replaced with /var/log/ceph/ceph-client.admin.212132.log.gz 2023-12-12T17:38:58.278 INFO:teuthology.orchestra.run.smithi078.stderr: 97.0% -- replaced with /var/log/ceph/ceph-client.admin.121413.log.gz 2023-12-12T17:39:00.234 INFO:teuthology.orchestra.run.smithi078.stderr: 96.8% -- replaced with /var/log/ceph/ceph-client.admin.214837.log.gz 2023-12-12T17:39:00.519 INFO:teuthology.orchestra.run.smithi078.stderr: 97.5% -- replaced with /var/log/ceph/ceph-client.admin.115518.log.gz 2023-12-12T17:39:00.706 INFO:teuthology.orchestra.run.smithi078.stderr: 97.4% -- replaced with /var/log/ceph/ceph-client.admin.116371.log.gz 2023-12-12T17:39:01.553 INFO:teuthology.orchestra.run.smithi078.stderr: 97.4% -- replaced with /var/log/ceph/ceph-client.admin.116817.log.gz 2023-12-12T17:39:02.536 INFO:teuthology.orchestra.run.smithi078.stderr: 97.4% -- replaced with /var/log/ceph/ceph-client.admin.117667.log.gz 2023-12-12T17:39:04.649 INFO:teuthology.orchestra.run.smithi078.stderr: 96.7% -- replaced with /var/log/ceph/ceph-client.admin.233690.log.gz 2023-12-12T17:39:04.711 INFO:teuthology.orchestra.run.smithi078.stderr: 96.9% -- replaced with /var/log/ceph/ceph-client.admin.94805.log.gz 2023-12-12T17:39:06.286 INFO:teuthology.orchestra.run.smithi078.stderr: 97.3% -- replaced with /var/log/ceph/ceph-client.admin.343335.log.gz 2023-12-12T17:39:06.618 INFO:teuthology.orchestra.run.smithi078.stderr: 97.2% -- replaced with /var/log/ceph/ceph-client.admin.394627.log.gz 2023-12-12T17:39:07.646 INFO:teuthology.orchestra.run.smithi078.stderr: 97.0% -- replaced with /var/log/ceph/ceph-client.admin.99997.log.gz 2023-12-12T17:39:07.665 INFO:teuthology.orchestra.run.smithi078.stderr: 95.3% -- replaced with /var/log/ceph/ceph-client.admin.443858.log.gz 2023-12-12T17:39:07.701 INFO:teuthology.orchestra.run.smithi078.stderr: 94.1% -- replaced with /var/log/ceph/ceph-client.admin.234573.log.gz 2023-12-12T17:39:07.853 INFO:teuthology.orchestra.run.smithi078.stderr: 97.5% -- replaced with /var/log/ceph/ceph-client.admin.263301.log.gz 2023-12-12T17:39:09.155 INFO:teuthology.orchestra.run.smithi078.stderr: 95.7% -- replaced with /var/log/ceph/ceph-client.admin.384599.log.gz 2023-12-12T17:39:09.733 INFO:teuthology.orchestra.run.smithi078.stderr: 97.2% -- replaced with /var/log/ceph/ceph-client.admin.91873.log.gz 2023-12-12T17:39:10.425 INFO:teuthology.orchestra.run.smithi078.stderr: 97.5% -- replaced with /var/log/ceph/ceph-client.admin.318819.log.gz 2023-12-12T17:39:10.652 INFO:teuthology.orchestra.run.smithi078.stderr: 97.7% -- replaced with /var/log/ceph/ceph-client.admin.318400.log.gz 2023-12-12T17:39:10.923 INFO:teuthology.orchestra.run.smithi078.stderr: 97.2% -- replaced with /var/log/ceph/ceph-client.admin.349999.log.gz 2023-12-12T17:39:11.000 INFO:teuthology.orchestra.run.smithi078.stderr: 97.3% -- replaced with /var/log/ceph/ceph-client.admin.319308.log.gz 2023-12-12T17:39:15.158 INFO:teuthology.orchestra.run.smithi078.stderr: 96.6% -- replaced with /var/log/ceph/ceph-client.admin.234147.log.gz 2023-12-12T17:39:15.167 INFO:teuthology.orchestra.run.smithi078.stderr: 97.6% -- replaced with /var/log/ceph/ceph-client.admin.90186.log.gz 2023-12-12T17:39:16.105 INFO:teuthology.orchestra.run.smithi078.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.admin.224690.log.gz 2023-12-12T17:39:20.360 INFO:teuthology.orchestra.run.smithi078.stderr: 95.5% -- replaced with /var/log/ceph/ceph-client.admin.96473.log.gz 2023-12-12T17:39:21.050 INFO:teuthology.orchestra.run.smithi078.stderr: 96.0% -- replaced with /var/log/ceph/ceph-client.admin.211247.log.gz 2023-12-12T17:39:21.752 INFO:teuthology.orchestra.run.smithi078.stderr: 97.5% -- replaced with /var/log/ceph/ceph-client.admin.90598.log.gz 2023-12-12T17:39:25.695 INFO:teuthology.orchestra.run.smithi078.stderr: 97.1% -- replaced with /var/log/ceph/ceph-client.admin.423909.log.gz 2023-12-12T17:39:26.618 INFO:teuthology.orchestra.run.smithi078.stderr: 96.8% -- replaced with /var/log/ceph/ceph-client.admin.231208.log.gz 2023-12-12T17:39:38.150 INFO:teuthology.orchestra.run.smithi078.stderr: 93.9% -- replaced with /var/log/ceph/ceph-client.admin.465590.log.gz 2023-12-12T17:39:42.610 INFO:teuthology.orchestra.run.smithi078.stderr: 97.2% -- replaced with /var/log/ceph/ceph-client.admin.386584.log.gz 2023-12-12T17:40:05.239 INFO:teuthology.orchestra.run.smithi078.stderr: 95.2% -- replaced with /var/log/ceph/ceph-client.admin.228815.log.gz 2023-12-12T17:40:08.113 INFO:teuthology.orchestra.run.smithi078.stderr: 97.3% -- replaced with /var/log/ceph/ceph-client.admin.106594.log.gz 2023-12-12T17:40:10.345 INFO:teuthology.orchestra.run.smithi078.stderr: 98.0% -- replaced with /var/log/ceph/ceph-client.admin.463499.log.gz 2023-12-12T17:40:39.827 INFO:teuthology.orchestra.run.smithi187.stderr: 92.4% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-12-12T17:40:49.171 INFO:teuthology.orchestra.run.smithi078.stderr: 94.3% -- replaced with /var/log/ceph/ceph-client.admin.237216.log.gz 2023-12-12T17:40:59.446 INFO:teuthology.orchestra.run.smithi078.stderr: 94.0% -- replaced with /var/log/ceph/ceph-client.admin.93729.log.gz 2023-12-12T17:41:11.218 INFO:teuthology.orchestra.run.smithi078.stderr: 94.4% -- replaced with /var/log/ceph/ceph-client.admin.457322.log.gz 2023-12-12T17:41:13.740 INFO:teuthology.orchestra.run.smithi078.stderr: 94.5% -- replaced with /var/log/ceph/ceph-client.admin.170576.log.gz 2023-12-12T17:41:25.184 INFO:teuthology.orchestra.run.smithi187.stderr: 92.3% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-12-12T17:41:29.492 INFO:teuthology.orchestra.run.smithi078.stderr: 94.5% -- replaced with /var/log/ceph/ceph-client.admin.138753.log.gz 2023-12-12T17:41:34.009 INFO:teuthology.orchestra.run.smithi078.stderr: 96.3% -- replaced with /var/log/ceph/ceph-client.admin.335649.log.gz 2023-12-12T17:43:10.330 INFO:teuthology.orchestra.run.smithi078.stderr: 96.3% -- replaced with /var/log/ceph/ceph-client.admin.211684.log.gz 2023-12-12T17:43:20.630 INFO:teuthology.orchestra.run.smithi078.stderr: 94.3% -- replaced with /var/log/ceph/ceph-client.admin.171038.log.gz 2023-12-12T17:43:38.984 INFO:teuthology.orchestra.run.smithi187.stderr: 91.8% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2023-12-12T17:43:39.865 INFO:teuthology.orchestra.run.smithi187.stderr: 91.9% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2023-12-12T17:44:04.268 INFO:teuthology.orchestra.run.smithi078.stderr: 91.9% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-12-12T17:44:10.621 INFO:teuthology.orchestra.run.smithi078.stderr: 95.3% -- replaced with /var/log/ceph/ceph-client.admin.352602.log.gz 2023-12-12T17:44:12.463 INFO:teuthology.orchestra.run.smithi078.stderr: 94.6% -- replaced with /var/log/ceph/ceph-client.admin.147791.log.gz 2023-12-12T17:44:25.602 INFO:teuthology.orchestra.run.smithi078.stderr: 93.9% -- replaced with /var/log/ceph/ceph-client.admin.120554.log.gz 2023-12-12T17:44:31.025 INFO:teuthology.orchestra.run.smithi187.stderr: 91.8% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2023-12-12T17:44:31.028 INFO:teuthology.orchestra.run.smithi187.stderr: 2023-12-12T17:44:31.028 INFO:teuthology.orchestra.run.smithi187.stderr:real 6m10.402s 2023-12-12T17:44:31.028 INFO:teuthology.orchestra.run.smithi187.stderr:user 4m31.102s 2023-12-12T17:44:31.028 INFO:teuthology.orchestra.run.smithi187.stderr:sys 0m33.591s 2023-12-12T17:44:35.969 INFO:teuthology.orchestra.run.smithi078.stderr: 93.7% -- replaced with /var/log/ceph/ceph-client.admin.93947.log.gz 2023-12-12T17:44:49.688 INFO:teuthology.orchestra.run.smithi078.stderr: 91.8% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-12-12T17:46:33.347 INFO:teuthology.orchestra.run.smithi078.stderr: 96.2% -- replaced with /var/log/ceph/ceph-client.admin.180249.log.gz 2023-12-12T17:47:16.471 INFO:teuthology.orchestra.run.smithi078.stderr: 95.2% -- replaced with /var/log/ceph/ceph-client.admin.89292.log.gz 2023-12-12T17:48:13.591 INFO:teuthology.orchestra.run.smithi078.stderr: 94.0% -- replaced with /var/log/ceph/ceph-client.admin.151796.log.gz 2023-12-12T17:48:47.135 INFO:teuthology.orchestra.run.smithi078.stderr: 94.5% -- replaced with /var/log/ceph/ceph-client.admin.456857.log.gz 2023-12-12T17:49:12.645 INFO:teuthology.orchestra.run.smithi078.stderr: 93.8% -- replaced with /var/log/ceph/ceph-client.admin.91413.log.gz 2023-12-12T17:49:33.859 INFO:teuthology.orchestra.run.smithi078.stderr: 95.3% -- replaced with /var/log/ceph/ceph-client.admin.387445.log.gz 2023-12-12T17:52:10.283 INFO:teuthology.orchestra.run.smithi078.stderr: 96.5% -- replaced with /var/log/ceph/ceph-client.admin.246617.log.gz 2023-12-12T17:52:49.992 INFO:teuthology.orchestra.run.smithi078.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.485017.log.gz 2023-12-12T17:55:29.069 INFO:teuthology.orchestra.run.smithi078.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.226098.log.gz 2023-12-12T17:56:31.924 INFO:teuthology.orchestra.run.smithi078.stderr: 96.1% -- replaced with /var/log/ceph/ceph-client.admin.359124.log.gz 2023-12-12T17:57:03.322 INFO:teuthology.orchestra.run.smithi078.stderr: 90.3% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-12-12T17:57:37.554 INFO:teuthology.orchestra.run.smithi078.stderr: 94.1% -- replaced with /var/log/ceph/ceph-client.admin.89741.log.gz 2023-12-12T17:58:39.838 INFO:teuthology.orchestra.run.smithi078.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.92328.log.gz 2023-12-12T18:02:26.561 INFO:teuthology.orchestra.run.smithi078.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.483678.log.gz 2023-12-12T18:02:31.628 INFO:teuthology.orchestra.run.smithi078.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.479975.log.gz 2023-12-12T18:03:30.918 INFO:teuthology.orchestra.run.smithi078.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.471123.log.gz 2023-12-12T18:03:42.471 INFO:teuthology.orchestra.run.smithi078.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.476454.log.gz 2023-12-12T18:03:45.355 INFO:teuthology.orchestra.run.smithi078.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.478814.log.gz 2023-12-12T18:04:17.724 INFO:teuthology.orchestra.run.smithi078.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.481217.log.gz 2023-12-12T18:04:23.329 INFO:teuthology.orchestra.run.smithi078.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.473934.log.gz 2023-12-12T18:04:37.655 INFO:teuthology.orchestra.run.smithi078.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.475178.log.gz 2023-12-12T18:05:00.324 INFO:teuthology.orchestra.run.smithi078.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.482439.log.gz 2023-12-12T18:05:06.841 INFO:teuthology.orchestra.run.smithi078.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.477587.log.gz 2023-12-12T18:07:27.766 INFO:teuthology.orchestra.run.smithi078.stderr: 95.6% -- replaced with /var/log/ceph/ceph-client.admin.266168.log.gz 2023-12-12T18:11:54.046 INFO:teuthology.orchestra.run.smithi078.stderr: 95.8% -- replaced with /var/log/ceph/ceph-client.admin.417043.log.gz 2023-12-12T18:11:59.490 INFO:teuthology.orchestra.run.smithi078.stderr: 95.1% -- replaced with /var/log/ceph/ceph-client.admin.177666.log.gz 2023-12-12T18:23:40.569 INFO:teuthology.orchestra.run.smithi078.stderr: 94.4% -- replaced with /var/log/ceph/ceph-client.admin.409324.log.gz 2023-12-12T18:24:10.059 INFO:teuthology.orchestra.run.smithi078.stderr: 91.9% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-12-12T18:24:29.834 INFO:teuthology.orchestra.run.smithi078.stderr: 94.5% -- replaced with /var/log/ceph/ceph-client.admin.410057.log.gz 2023-12-12T18:27:02.341 INFO:teuthology.orchestra.run.smithi078.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.256516.log.gz 2023-12-12T18:28:19.677 INFO:teuthology.orchestra.run.smithi078.stderr: 91.8% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-12-12T18:31:16.254 INFO:teuthology.orchestra.run.smithi078.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.144655.log.gz 2023-12-12T18:34:11.254 INFO:teuthology.orchestra.run.smithi078.stderr: 91.7% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-12-12T18:49:44.743 INFO:teuthology.orchestra.run.smithi078.stderr: 95.7% -- replaced with /var/log/ceph/ceph-client.admin.122244.log.gz 2023-12-12T19:02:31.500 INFO:teuthology.orchestra.run.smithi078.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.admin.495388.log.gz 2023-12-12T19:02:31.506 INFO:teuthology.orchestra.run.smithi078.stderr: 2023-12-12T19:02:31.506 INFO:teuthology.orchestra.run.smithi078.stderr:real 84m10.878s 2023-12-12T19:02:31.506 INFO:teuthology.orchestra.run.smithi078.stderr:user 49m7.601s 2023-12-12T19:02:31.507 INFO:teuthology.orchestra.run.smithi078.stderr:sys 7m33.992s 2023-12-12T19:02:31.507 INFO:tasks.ceph:Archiving logs... 2023-12-12T19:02:31.508 DEBUG:teuthology.misc:Transferring archived files from smithi078:/var/log/ceph to /home/teuthworker/archive/mchangir-2023-12-12_08:46:52-fs-wip-mchangir-testing-20231205.064351-testing-default-smithi/7488242/remote/smithi078/log 2023-12-12T19:02:31.509 DEBUG:teuthology.orchestra.run.smithi078:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-12T19:13:40.617 DEBUG:teuthology.misc:Transferring archived files from smithi187:/var/log/ceph to /home/teuthworker/archive/mchangir-2023-12-12_08:46:52-fs-wip-mchangir-testing-20231205.064351-testing-default-smithi/7488242/remote/smithi187/log 2023-12-12T19:13:40.640 DEBUG:teuthology.orchestra.run.smithi187:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-12T19:20:21.696 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-12-12T19:20:21.706 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-12-12T19:20:21.707 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-12-12T19:20:21.715 DEBUG:teuthology.orchestra.run.smithi187:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-12-12T19:20:21.942 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-12-12T19:20:21.951 INFO:teuthology.task.clock:Checking final clock skew... 2023-12-12T19:20:21.952 DEBUG:teuthology.orchestra.run.smithi078:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-12T19:20:21.959 DEBUG:teuthology.orchestra.run.smithi187:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-12T19:20:22.018 INFO:teuthology.orchestra.run.smithi187.stdout: remote refid st t when poll reach delay offset jitter 2023-12-12T19:20:22.019 INFO:teuthology.orchestra.run.smithi187.stdout:============================================================================== 2023-12-12T19:20:22.019 INFO:teuthology.orchestra.run.smithi187.stdout:*hv01.front.sepi 44.4.53.2 2 u 850 1024 377 0.234 -6.845 4.924 2023-12-12T19:20:22.019 INFO:teuthology.orchestra.run.smithi187.stdout:+hv02.front.sepi 63.231.80.2 3 u 417 1024 377 0.273 -5.855 4.689 2023-12-12T19:20:22.019 INFO:teuthology.orchestra.run.smithi187.stdout:+hv03.front.sepi 74.6.168.72 3 u 872 1024 377 0.242 -3.032 4.670 2023-12-12T19:20:22.020 INFO:teuthology.orchestra.run.smithi187.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2023-12-12T19:20:22.134 INFO:teuthology.orchestra.run.smithi078.stdout: remote refid st t when poll reach delay offset jitter 2023-12-12T19:20:22.135 INFO:teuthology.orchestra.run.smithi078.stdout:============================================================================== 2023-12-12T19:20:22.135 INFO:teuthology.orchestra.run.smithi078.stdout:*hv01.front.sepi 44.4.53.2 2 u 33 1024 377 0.216 -4.999 3.047 2023-12-12T19:20:22.135 INFO:teuthology.orchestra.run.smithi078.stdout:+hv02.front.sepi 63.231.80.2 3 u 221 1024 377 0.254 -4.256 3.415 2023-12-12T19:20:22.135 INFO:teuthology.orchestra.run.smithi078.stdout:+hv03.front.sepi 74.6.168.72 3 u 404 1024 377 0.247 -1.595 3.411 2023-12-12T19:20:22.136 INFO:teuthology.orchestra.run.smithi078.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2023-12-12T19:20:22.137 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-12-12T19:20:22.147 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-12-12T19:20:22.148 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-12-12T19:20:22.174 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-12-12T19:20:22.211 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-12-12T19:20:22.239 INFO:teuthology.task.internal:Duration was 33678.131946 seconds 2023-12-12T19:20:22.239 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-12-12T19:20:22.280 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-12-12T19:20:22.281 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-12-12T19:20:22.288 DEBUG:teuthology.orchestra.run.smithi187:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-12-12T19:20:22.623 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-12-12T19:20:22.624 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi078.front.sepia.ceph.com 2023-12-12T19:20:22.624 DEBUG:teuthology.orchestra.run.smithi078:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-12-12T19:20:22.687 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi187.front.sepia.ceph.com 2023-12-12T19:20:22.687 DEBUG:teuthology.orchestra.run.smithi187:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-12-12T19:20:22.747 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-12-12T19:20:22.748 DEBUG:teuthology.orchestra.run.smithi078:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-12T19:20:22.765 DEBUG:teuthology.orchestra.run.smithi187:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-12T19:20:23.013 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-12-12T19:20:23.013 DEBUG:teuthology.orchestra.run.smithi078:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-12-12T19:20:23.021 DEBUG:teuthology.orchestra.run.smithi187:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-12-12T19:20:24.044 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-12-12T19:20:24.059 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-12-12T19:20:24.060 DEBUG:teuthology.orchestra.run.smithi078:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-12-12T19:20:24.115 DEBUG:teuthology.orchestra.run.smithi187:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-12-12T19:20:24.170 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-12-12T19:20:24.180 DEBUG:teuthology.orchestra.run.smithi078:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-12-12T19:20:24.188 DEBUG:teuthology.orchestra.run.smithi187:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-12-12T19:20:24.229 INFO:teuthology.orchestra.run.smithi187.stdout:kernel.core_pattern = core 2023-12-12T19:20:24.251 INFO:teuthology.orchestra.run.smithi078.stdout:kernel.core_pattern = core 2023-12-12T19:20:24.319 DEBUG:teuthology.orchestra.run.smithi078:> test -e /home/ubuntu/cephtest/archive/coredump 2023-12-12T19:20:24.339 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-12T19:20:24.340 DEBUG:teuthology.orchestra.run.smithi187:> test -e /home/ubuntu/cephtest/archive/coredump 2023-12-12T19:20:24.348 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-12T19:20:24.348 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-12-12T19:20:24.359 INFO:teuthology.task.internal:Transferring archived files... 2023-12-12T19:20:24.360 DEBUG:teuthology.misc:Transferring archived files from smithi078:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/mchangir-2023-12-12_08:46:52-fs-wip-mchangir-testing-20231205.064351-testing-default-smithi/7488242/remote/smithi078 2023-12-12T19:20:24.361 DEBUG:teuthology.orchestra.run.smithi078:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-12T19:20:24.458 DEBUG:teuthology.misc:Transferring archived files from smithi187:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/mchangir-2023-12-12_08:46:52-fs-wip-mchangir-testing-20231205.064351-testing-default-smithi/7488242/remote/smithi187 2023-12-12T19:20:24.458 DEBUG:teuthology.orchestra.run.smithi187:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-12T19:20:24.492 INFO:teuthology.task.internal:Removing archive directory... 2023-12-12T19:20:24.492 DEBUG:teuthology.orchestra.run.smithi078:> rm -rf -- /home/ubuntu/cephtest/archive 2023-12-12T19:20:24.500 DEBUG:teuthology.orchestra.run.smithi187:> rm -rf -- /home/ubuntu/cephtest/archive 2023-12-12T19:20:24.543 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-12-12T19:20:24.559 INFO:teuthology.task.internal:Not uploading archives. 2023-12-12T19:20:24.559 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-12-12T19:20:24.580 INFO:teuthology.task.internal:Tidying up after the test... 2023-12-12T19:20:24.581 DEBUG:teuthology.orchestra.run.smithi078:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-12-12T19:20:24.588 DEBUG:teuthology.orchestra.run.smithi187:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-12-12T19:20:24.598 INFO:teuthology.orchestra.run.smithi187.stdout: 658043 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Dec 12 19:20 /home/ubuntu/cephtest 2023-12-12T19:20:24.605 INFO:teuthology.orchestra.run.smithi078.stdout: 658042 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Dec 12 19:20 /home/ubuntu/cephtest 2023-12-12T19:20:24.610 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-12-12T19:20:24.621 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-12-12T19:20:24.681 INFO:teuthology.nuke:Checking targets against current locks 2023-12-12T19:20:24.708 DEBUG:teuthology.nuke:shortname: smithi078 2023-12-12T19:20:24.709 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-12T19:20:24.733 DEBUG:teuthology.nuke:shortname: smithi187 2023-12-12T19:20:24.734 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-12T19:20:24.737 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi078.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2023-12-12_08:46:52-fs-wip-mchangir-testing-20231205.064351-testing-default-smithi/7488242', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-12 09:50:12.697375', 'locked_by': 'mchangir', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBK/zlvJHDqEnPl6Dvp8Mv0S2RJ3kT0EukCv3Yxfv+tuVMZqWIVmF0fa1gFxjFMR6lRz0x4V94Th7G/aYJcD1aW4='} 2023-12-12T19:20:24.757 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi187.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/mchangir-2023-12-12_08:46:52-fs-wip-mchangir-testing-20231205.064351-testing-default-smithi/7488242', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-12 09:50:12.695787', 'locked_by': 'mchangir', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCAFaGbbwyvMrg/EarDZihOcX6SBrTXZ9VyF3YFNk8Q1aF8/j7z0M+UVdoAS1IBXUvTaGRP6BEKBAdqaF/lrC9o='} 2023-12-12T19:20:24.786 INFO:teuthology.orchestra.console.smithi078:Power off 2023-12-12T19:20:24.786 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-12T19:20:24.809 DEBUG:teuthology.orchestra.console.smithi078:power off output: Chassis Power Control: Down/Off 2023-12-12T19:20:24.810 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-12T19:20:24.827 INFO:teuthology.orchestra.console.smithi187:Power off 2023-12-12T19:20:24.828 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-12T19:20:24.839 DEBUG:teuthology.orchestra.console.smithi078:check power output: Chassis Power is on 2023-12-12T19:20:24.851 DEBUG:teuthology.orchestra.console.smithi187:power off output: Chassis Power Control: Down/Off 2023-12-12T19:20:24.851 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-12T19:20:24.882 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is on 2023-12-12T19:20:28.839 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-12T19:20:28.883 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-12T19:20:28.951 DEBUG:teuthology.orchestra.console.smithi078:check power output: Chassis Power is on 2023-12-12T19:20:28.995 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is on 2023-12-12T19:20:32.953 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-12T19:20:32.995 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-12T19:20:33.063 DEBUG:teuthology.orchestra.console.smithi078:check power output: Chassis Power is on 2023-12-12T19:20:33.105 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is off 2023-12-12T19:20:33.206 INFO:teuthology.orchestra.console.smithi187:Power off completed 2023-12-12T19:20:37.065 DEBUG:teuthology.orchestra.console.smithi078:pexpect command: ipmitool -H smithi078.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-12T19:20:37.177 DEBUG:teuthology.orchestra.console.smithi078:check power output: Chassis Power is off 2023-12-12T19:20:37.278 INFO:teuthology.orchestra.console.smithi078:Power off completed 2023-12-12T19:20:37.383 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} duration: 33678.131945848465 failure_reason: 'Test failure: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev)' flavor: default mon.a-kernel-sha1: cd68252d7b4d7802f3cae7f5945b38e9b20dad4c mon.b-kernel-sha1: cd68252d7b4d7802f3cae7f5945b38e9b20dad4c owner: mchangir sentry_event: https://sentry.ceph.com/organizations/ceph/?query=4ad4348061cf44aebb891b9964ad44b5 status: fail success: false 2023-12-12T19:20:37.384 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-12T19:20:37.461 INFO:teuthology.run:FAIL